[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:02:12.388770 11443 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.44.254:43963
I20260709 13:02:12.390296 11443 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:02:12.391340 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:12.409971 11452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:12.410000 11449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:12.411159 11443 server_base.cc:1061] running on GCE node
W20260709 13:02:12.410028 11450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:13.656018 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:13.656303 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:13.656476 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602133656456 us; error 0 us; skew 500 ppm
I20260709 13:02:13.657342 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:13.663178 11443 webserver.cc:533] Webserver started at http://127.11.44.254:38355/ using document root <none> and password file <none>
I20260709 13:02:13.664227 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:13.664443 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:13.664855 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:13.671123 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132206461-11443-0/minicluster-data/master-0-root/instance:
uuid: "26781ffade4d4d92b529d633bff43b49"
format_stamp: "Formatted at 2026-07-09 13:02:13 on dist-test-slave-qv7r"
I20260709 13:02:13.679870 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:02:13.685947 11458 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:13.687314 11443 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:02:13.687644 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132206461-11443-0/minicluster-data/master-0-root
uuid: "26781ffade4d4d92b529d633bff43b49"
format_stamp: "Formatted at 2026-07-09 13:02:13 on dist-test-slave-qv7r"
I20260709 13:02:13.688043 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132206461-11443-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132206461-11443-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132206461-11443-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:13.753722 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:13.755326 11443 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:02:13.755774 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:13.837082 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.254:43963
I20260709 13:02:13.837184 11509 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.254:43963 every 8 connection(s)
I20260709 13:02:13.845674 11510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:13.867935 11510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49: Bootstrap starting.
I20260709 13:02:13.874358 11510 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:13.876324 11510 log.cc:826] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49: Log is configured to *not* fsync() on all Append() calls
I20260709 13:02:13.881228 11510 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49: No bootstrap required, opened a new log
I20260709 13:02:13.902752 11510 raft_consensus.cc:359] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26781ffade4d4d92b529d633bff43b49" member_type: VOTER }
I20260709 13:02:13.903322 11510 raft_consensus.cc:385] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:13.903636 11510 raft_consensus.cc:740] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26781ffade4d4d92b529d633bff43b49, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.904745 11510 consensus_queue.cc:260] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26781ffade4d4d92b529d633bff43b49" member_type: VOTER }
I20260709 13:02:13.905273 11510 raft_consensus.cc:399] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:13.905637 11510 raft_consensus.cc:493] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:13.906003 11510 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:13.910434 11510 raft_consensus.cc:515] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26781ffade4d4d92b529d633bff43b49" member_type: VOTER }
I20260709 13:02:13.911429 11510 leader_election.cc:304] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 26781ffade4d4d92b529d633bff43b49; no voters: 
I20260709 13:02:13.913208 11510 leader_election.cc:290] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:13.913740 11513 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:13.916366 11513 raft_consensus.cc:697] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49 [term 1 LEADER]: Becoming Leader. State: Replica: 26781ffade4d4d92b529d633bff43b49, State: Running, Role: LEADER
I20260709 13:02:13.917336 11513 consensus_queue.cc:237] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26781ffade4d4d92b529d633bff43b49" member_type: VOTER }
I20260709 13:02:13.918401 11510 sys_catalog.cc:565] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:13.928537 11515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 26781ffade4d4d92b529d633bff43b49. Latest consensus state: current_term: 1 leader_uuid: "26781ffade4d4d92b529d633bff43b49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26781ffade4d4d92b529d633bff43b49" member_type: VOTER } }
I20260709 13:02:13.928701 11514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "26781ffade4d4d92b529d633bff43b49" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "26781ffade4d4d92b529d633bff43b49" member_type: VOTER } }
I20260709 13:02:13.929418 11514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:13.929368 11515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:13.933199 11523 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:13.945721 11523 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:13.948066 11443 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:13.962582 11523 catalog_manager.cc:1383] Generated new cluster ID: a5e81c884eef4108a3144d6114955414
I20260709 13:02:13.962882 11523 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:13.982093 11523 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:13.983783 11523 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:14.000651 11523 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49: Generated new TSK 0
I20260709 13:02:14.001832 11523 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:14.015455 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:14.025708 11532 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:14.028203 11533 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:14.032614 11535 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:14.035113 11443 server_base.cc:1061] running on GCE node
I20260709 13:02:14.036075 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:14.036326 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:14.036525 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602134036507 us; error 0 us; skew 500 ppm
I20260709 13:02:14.037120 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:14.041309 11443 webserver.cc:533] Webserver started at http://127.11.44.193:33357/ using document root <none> and password file <none>
I20260709 13:02:14.041939 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:14.042172 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:14.042474 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:14.043609 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132206461-11443-0/minicluster-data/ts-0-root/instance:
uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
format_stamp: "Formatted at 2026-07-09 13:02:14 on dist-test-slave-qv7r"
I20260709 13:02:14.049687 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.005s
I20260709 13:02:14.054149 11540 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:14.055305 11443 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:02:14.055974 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132206461-11443-0/minicluster-data/ts-0-root
uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
format_stamp: "Formatted at 2026-07-09 13:02:14 on dist-test-slave-qv7r"
I20260709 13:02:14.056413 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132206461-11443-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132206461-11443-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132206461-11443-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:14.101701 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:14.103124 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:14.105677 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:14.110402 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:14.110708 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:14.110989 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:14.111183 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:14.225515 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.193:40715
I20260709 13:02:14.225626 11602 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.193:40715 every 8 connection(s)
I20260709 13:02:14.234025 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:14.243564 11607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:14.255312 11608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:14.262506 11443 server_base.cc:1061] running on GCE node
W20260709 13:02:14.263697 11610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:14.264211 11603 heartbeater.cc:344] Connected to a master server at 127.11.44.254:43963
I20260709 13:02:14.264714 11603 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:14.264694 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:14.265092 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:14.265336 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602134265313 us; error 0 us; skew 500 ppm
I20260709 13:02:14.266084 11603 heartbeater.cc:507] Master 127.11.44.254:43963 requested a full tablet report, sending...
I20260709 13:02:14.266191 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:14.269753 11443 webserver.cc:533] Webserver started at http://127.11.44.194:36641/ using document root <none> and password file <none>
I20260709 13:02:14.270198 11475 ts_manager.cc:194] Registered new tserver with Master: cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715)
I20260709 13:02:14.270339 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:14.270632 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:14.270866 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:14.272089 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132206461-11443-0/minicluster-data/ts-1-root/instance:
uuid: "83f5882eabbe42bd99758b5455bae87d"
format_stamp: "Formatted at 2026-07-09 13:02:14 on dist-test-slave-qv7r"
I20260709 13:02:14.273315 11475 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54296
I20260709 13:02:14.278952 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:02:14.284076 11615 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:14.285049 11443 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:02:14.285368 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132206461-11443-0/minicluster-data/ts-1-root
uuid: "83f5882eabbe42bd99758b5455bae87d"
format_stamp: "Formatted at 2026-07-09 13:02:14 on dist-test-slave-qv7r"
I20260709 13:02:14.285713 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132206461-11443-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132206461-11443-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132206461-11443-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:14.300518 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:14.301942 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:14.304632 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:14.307691 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:14.307895 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:14.308228 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:14.308413 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:14.407610 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.194:42159
I20260709 13:02:14.407945 11677 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.194:42159 every 8 connection(s)
I20260709 13:02:14.427821 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260709 13:02:14.437090 11678 heartbeater.cc:344] Connected to a master server at 127.11.44.254:43963
W20260709 13:02:14.437242 11681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:14.437536 11678 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:14.438874 11678 heartbeater.cc:507] Master 127.11.44.254:43963 requested a full tablet report, sending...
I20260709 13:02:14.442013 11475 ts_manager.cc:194] Registered new tserver with Master: 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159)
W20260709 13:02:14.444306 11682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:14.444690 11475 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54304
W20260709 13:02:14.453848 11684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:14.454768 11443 server_base.cc:1061] running on GCE node
I20260709 13:02:14.455971 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:14.456243 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:14.456442 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602134456425 us; error 0 us; skew 500 ppm
I20260709 13:02:14.457182 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:14.459949 11443 webserver.cc:533] Webserver started at http://127.11.44.195:37293/ using document root <none> and password file <none>
I20260709 13:02:14.460544 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:14.460784 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:14.461110 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:14.462492 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132206461-11443-0/minicluster-data/ts-2-root/instance:
uuid: "4216bf0e7b174ad19465277997d74595"
format_stamp: "Formatted at 2026-07-09 13:02:14 on dist-test-slave-qv7r"
I20260709 13:02:14.468281 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:02:14.472515 11689 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:14.473448 11443 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:02:14.473819 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132206461-11443-0/minicluster-data/ts-2-root
uuid: "4216bf0e7b174ad19465277997d74595"
format_stamp: "Formatted at 2026-07-09 13:02:14 on dist-test-slave-qv7r"
I20260709 13:02:14.474191 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132206461-11443-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132206461-11443-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602132206461-11443-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:14.503759 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:14.505452 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:14.507179 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:14.510277 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:14.510555 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:14.510834 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:14.511047 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:14.599560 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.195:42999
I20260709 13:02:14.599612 11751 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.195:42999 every 8 connection(s)
I20260709 13:02:14.618247 11752 heartbeater.cc:344] Connected to a master server at 127.11.44.254:43963
I20260709 13:02:14.618681 11752 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:14.619468 11752 heartbeater.cc:507] Master 127.11.44.254:43963 requested a full tablet report, sending...
I20260709 13:02:14.622028 11475 ts_manager.cc:194] Registered new tserver with Master: 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999)
I20260709 13:02:14.623028 11443 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017464823s
I20260709 13:02:14.623413 11475 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54318
I20260709 13:02:14.681900 11475 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54324:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:14.685628 11475 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:14.803544 11717 tablet_service.cc:1511] Processing CreateTablet for tablet e6fe30474f964ee6aeb9e40e79b9d588 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:14.804359 11715 tablet_service.cc:1511] Processing CreateTablet for tablet 6b537af1f78d42d5ae93c345152f3ce6 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:14.806841 11716 tablet_service.cc:1511] Processing CreateTablet for tablet 2d2f548451cc4108a5cbae2c2979f42e (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:14.807395 11714 tablet_service.cc:1511] Processing CreateTablet for tablet 73a3e05897bb4ca8867a12693c28e411 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:14.805507 11717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6fe30474f964ee6aeb9e40e79b9d588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.811932 11716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d2f548451cc4108a5cbae2c2979f42e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.812937 11568 tablet_service.cc:1511] Processing CreateTablet for tablet e6fe30474f964ee6aeb9e40e79b9d588 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:14.814349 11568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6fe30474f964ee6aeb9e40e79b9d588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.821331 11715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b537af1f78d42d5ae93c345152f3ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.834895 11565 tablet_service.cc:1511] Processing CreateTablet for tablet 73a3e05897bb4ca8867a12693c28e411 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:14.835002 11562 tablet_service.cc:1511] Processing CreateTablet for tablet ae411261bb914f5da14b72347967ca59 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:14.837218 11714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a3e05897bb4ca8867a12693c28e411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.831979 11564 tablet_service.cc:1511] Processing CreateTablet for tablet b4dda2301e22449393d97a5ed6b1c906 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:14.846089 11566 tablet_service.cc:1511] Processing CreateTablet for tablet 6b537af1f78d42d5ae93c345152f3ce6 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:14.833029 11567 tablet_service.cc:1511] Processing CreateTablet for tablet 2d2f548451cc4108a5cbae2c2979f42e (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:14.850735 11711 tablet_service.cc:1511] Processing CreateTablet for tablet ae411261bb914f5da14b72347967ca59 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:14.855639 11711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae411261bb914f5da14b72347967ca59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.861627 11642 tablet_service.cc:1511] Processing CreateTablet for tablet 2d2f548451cc4108a5cbae2c2979f42e (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:14.837664 11563 tablet_service.cc:1511] Processing CreateTablet for tablet df85684d549345889a4683e2df597ee2 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:14.844437 11561 tablet_service.cc:1511] Processing CreateTablet for tablet ab061d0886a84dfca7fd6249f7454842 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:14.867610 11565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a3e05897bb4ca8867a12693c28e411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.872130 11713 tablet_service.cc:1511] Processing CreateTablet for tablet b4dda2301e22449393d97a5ed6b1c906 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:14.873669 11713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4dda2301e22449393d97a5ed6b1c906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.869405 11710 tablet_service.cc:1511] Processing CreateTablet for tablet ab061d0886a84dfca7fd6249f7454842 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:14.877794 11710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab061d0886a84dfca7fd6249f7454842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.876087 11712 tablet_service.cc:1511] Processing CreateTablet for tablet df85684d549345889a4683e2df597ee2 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:14.880021 11712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df85684d549345889a4683e2df597ee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.870225 11643 tablet_service.cc:1511] Processing CreateTablet for tablet e6fe30474f964ee6aeb9e40e79b9d588 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:14.874367 11642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d2f548451cc4108a5cbae2c2979f42e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.895409 11643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6fe30474f964ee6aeb9e40e79b9d588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.899300 11567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d2f548451cc4108a5cbae2c2979f42e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.900390 11641 tablet_service.cc:1511] Processing CreateTablet for tablet 6b537af1f78d42d5ae93c345152f3ce6 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:14.903749 11641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b537af1f78d42d5ae93c345152f3ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.910646 11564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4dda2301e22449393d97a5ed6b1c906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.922003 11638 tablet_service.cc:1511] Processing CreateTablet for tablet df85684d549345889a4683e2df597ee2 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:14.924300 11638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df85684d549345889a4683e2df597ee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.926414 11563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df85684d549345889a4683e2df597ee2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.930474 11637 tablet_service.cc:1511] Processing CreateTablet for tablet ae411261bb914f5da14b72347967ca59 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:14.938143 11566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b537af1f78d42d5ae93c345152f3ce6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.950531 11639 tablet_service.cc:1511] Processing CreateTablet for tablet b4dda2301e22449393d97a5ed6b1c906 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:14.954710 11640 tablet_service.cc:1511] Processing CreateTablet for tablet 73a3e05897bb4ca8867a12693c28e411 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
W20260709 13:02:14.964972 11522 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:14.965970 11560 tablet_service.cc:1511] Processing CreateTablet for tablet b8d4ca4c2f8645e3ac10467b750bcad9 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:14.961345 11639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4dda2301e22449393d97a5ed6b1c906. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.969486 11640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73a3e05897bb4ca8867a12693c28e411. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.962194 11636 tablet_service.cc:1511] Processing CreateTablet for tablet ab061d0886a84dfca7fd6249f7454842 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:14.977131 11637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae411261bb914f5da14b72347967ca59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.976125 11561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab061d0886a84dfca7fd6249f7454842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.989576 11636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab061d0886a84dfca7fd6249f7454842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:14.993911 11560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8d4ca4c2f8645e3ac10467b750bcad9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:15.023094 11716 tablet_service.cc:1511] Processing CreateTablet for tablet b8d4ca4c2f8645e3ac10467b750bcad9 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:15.029114 11562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae411261bb914f5da14b72347967ca59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:15.037004 11635 tablet_service.cc:1511] Processing CreateTablet for tablet b8d4ca4c2f8645e3ac10467b750bcad9 (DEFAULT_TABLE table=test-workload [id=bda9b72edc7540bb853a094cb27a498a]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:15.040612 11635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8d4ca4c2f8645e3ac10467b750bcad9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:15.040889 11716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8d4ca4c2f8645e3ac10467b750bcad9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:15.080682 11770 tablet_bootstrap.cc:492] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595: Bootstrap starting.
I20260709 13:02:15.128321 11771 tablet_bootstrap.cc:492] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1: Bootstrap starting.
W20260709 13:02:15.168649 11459 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.11.44.194:42159, user_credentials={real_user=slave}} blocked reactor thread for 43912us
I20260709 13:02:15.170732 11770 tablet_bootstrap.cc:654] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:15.171417 11460 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.11.44.193:40715, user_credentials={real_user=slave}} blocked reactor thread for 48796us
W20260709 13:02:15.177795 11462 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.11.44.195:42999, user_credentials={real_user=slave}} blocked reactor thread for 44336.2us
I20260709 13:02:15.190531 11772 tablet_bootstrap.cc:492] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d: Bootstrap starting.
I20260709 13:02:15.195849 11770 tablet_bootstrap.cc:492] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595: No bootstrap required, opened a new log
I20260709 13:02:15.196445 11770 ts_tablet_manager.cc:1403] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595: Time spent bootstrapping tablet: real 0.166s	user 0.017s	sys 0.010s
I20260709 13:02:15.198380 11771 tablet_bootstrap.cc:654] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.199795 11772 tablet_bootstrap.cc:654] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.199566 11770 raft_consensus.cc:359] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.200366 11770 raft_consensus.cc:385] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.200727 11770 raft_consensus.cc:740] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.202438 11770 consensus_queue.cc:260] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.211505 11772 tablet_bootstrap.cc:492] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d: No bootstrap required, opened a new log
I20260709 13:02:15.212694 11772 ts_tablet_manager.cc:1403] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 13:02:15.216234 11771 tablet_bootstrap.cc:492] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1: No bootstrap required, opened a new log
I20260709 13:02:15.216732 11771 ts_tablet_manager.cc:1403] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1: Time spent bootstrapping tablet: real 0.136s	user 0.015s	sys 0.018s
I20260709 13:02:15.218276 11752 heartbeater.cc:499] Master 127.11.44.254:43963 was elected leader, sending a full tablet report...
I20260709 13:02:15.218600 11770 ts_tablet_manager.cc:1434] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.019s
I20260709 13:02:15.219515 11770 tablet_bootstrap.cc:492] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595: Bootstrap starting.
I20260709 13:02:15.219710 11771 raft_consensus.cc:359] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.220474 11771 raft_consensus.cc:385] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.220778 11771 raft_consensus.cc:740] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf763ad32cd44f88e0cb7bb80a03be1, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.222769 11771 consensus_queue.cc:260] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.226438 11770 tablet_bootstrap.cc:654] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.234400 11772 raft_consensus.cc:359] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.241781 11772 raft_consensus.cc:385] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.242401 11772 raft_consensus.cc:740] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.242761 11603 heartbeater.cc:499] Master 127.11.44.254:43963 was elected leader, sending a full tablet report...
I20260709 13:02:15.243649 11772 consensus_queue.cc:260] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.244889 11771 ts_tablet_manager.cc:1434] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.017s
I20260709 13:02:15.245973 11771 tablet_bootstrap.cc:492] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1: Bootstrap starting.
I20260709 13:02:15.252975 11771 tablet_bootstrap.cc:654] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.263783 11770 tablet_bootstrap.cc:492] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595: No bootstrap required, opened a new log
I20260709 13:02:15.264174 11771 tablet_bootstrap.cc:492] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1: No bootstrap required, opened a new log
I20260709 13:02:15.264273 11770 ts_tablet_manager.cc:1403] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595: Time spent bootstrapping tablet: real 0.045s	user 0.027s	sys 0.015s
I20260709 13:02:15.264712 11771 ts_tablet_manager.cc:1403] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 13:02:15.265838 11678 heartbeater.cc:499] Master 127.11.44.254:43963 was elected leader, sending a full tablet report...
I20260709 13:02:15.272569 11770 raft_consensus.cc:359] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.266716 11772 ts_tablet_manager.cc:1434] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.005s
I20260709 13:02:15.273321 11770 raft_consensus.cc:385] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.273661 11770 raft_consensus.cc:740] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.274173 11772 tablet_bootstrap.cc:492] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d: Bootstrap starting.
I20260709 13:02:15.274577 11770 consensus_queue.cc:260] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.277637 11770 ts_tablet_manager.cc:1434] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:15.278750 11770 tablet_bootstrap.cc:492] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595: Bootstrap starting.
I20260709 13:02:15.277041 11771 raft_consensus.cc:359] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.280937 11771 raft_consensus.cc:385] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.281246 11771 raft_consensus.cc:740] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf763ad32cd44f88e0cb7bb80a03be1, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.281978 11771 consensus_queue.cc:260] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.286401 11770 tablet_bootstrap.cc:654] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.288086 11771 ts_tablet_manager.cc:1434] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:02:15.289049 11771 tablet_bootstrap.cc:492] T b8d4ca4c2f8645e3ac10467b750bcad9 P cbf763ad32cd44f88e0cb7bb80a03be1: Bootstrap starting.
I20260709 13:02:15.292307 11772 tablet_bootstrap.cc:654] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.295643 11771 tablet_bootstrap.cc:654] T b8d4ca4c2f8645e3ac10467b750bcad9 P cbf763ad32cd44f88e0cb7bb80a03be1: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.307394 11771 tablet_bootstrap.cc:492] T b8d4ca4c2f8645e3ac10467b750bcad9 P cbf763ad32cd44f88e0cb7bb80a03be1: No bootstrap required, opened a new log
I20260709 13:02:15.307859 11771 ts_tablet_manager.cc:1403] T b8d4ca4c2f8645e3ac10467b750bcad9 P cbf763ad32cd44f88e0cb7bb80a03be1: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:02:15.310900 11771 raft_consensus.cc:359] T b8d4ca4c2f8645e3ac10467b750bcad9 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.311651 11771 raft_consensus.cc:385] T b8d4ca4c2f8645e3ac10467b750bcad9 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.311939 11771 raft_consensus.cc:740] T b8d4ca4c2f8645e3ac10467b750bcad9 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf763ad32cd44f88e0cb7bb80a03be1, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.312425 11770 tablet_bootstrap.cc:492] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595: No bootstrap required, opened a new log
I20260709 13:02:15.313160 11770 ts_tablet_manager.cc:1403] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.016s
I20260709 13:02:15.312665 11771 consensus_queue.cc:260] T b8d4ca4c2f8645e3ac10467b750bcad9 P cbf763ad32cd44f88e0cb7bb80a03be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.312990 11772 tablet_bootstrap.cc:492] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d: No bootstrap required, opened a new log
I20260709 13:02:15.314648 11772 ts_tablet_manager.cc:1403] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.004s
I20260709 13:02:15.315232 11771 ts_tablet_manager.cc:1434] T b8d4ca4c2f8645e3ac10467b750bcad9 P cbf763ad32cd44f88e0cb7bb80a03be1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:15.316200 11771 tablet_bootstrap.cc:492] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1: Bootstrap starting.
I20260709 13:02:15.316362 11770 raft_consensus.cc:359] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.317111 11770 raft_consensus.cc:385] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.317404 11770 raft_consensus.cc:740] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.317425 11772 raft_consensus.cc:359] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.318297 11772 raft_consensus.cc:385] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.318894 11770 consensus_queue.cc:260] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.318610 11772 raft_consensus.cc:740] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.321713 11770 ts_tablet_manager.cc:1434] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 13:02:15.323232 11770 tablet_bootstrap.cc:492] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595: Bootstrap starting.
I20260709 13:02:15.324416 11772 consensus_queue.cc:260] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.327234 11771 tablet_bootstrap.cc:654] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.329598 11770 tablet_bootstrap.cc:654] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.341115 11770 tablet_bootstrap.cc:492] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595: No bootstrap required, opened a new log
I20260709 13:02:15.341648 11770 ts_tablet_manager.cc:1403] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.002s
I20260709 13:02:15.342727 11772 ts_tablet_manager.cc:1434] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:02:15.343655 11772 tablet_bootstrap.cc:492] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d: Bootstrap starting.
I20260709 13:02:15.344475 11770 raft_consensus.cc:359] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.345207 11770 raft_consensus.cc:385] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.345503 11770 raft_consensus.cc:740] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.346509 11770 consensus_queue.cc:260] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.348991 11770 ts_tablet_manager.cc:1434] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:02:15.349982 11770 tablet_bootstrap.cc:492] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595: Bootstrap starting.
I20260709 13:02:15.356559 11770 tablet_bootstrap.cc:654] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:15.356881 11753 tablet.cc:2406] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:02:15.356907 11772 tablet_bootstrap.cc:654] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.365636 11771 tablet_bootstrap.cc:492] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1: No bootstrap required, opened a new log
I20260709 13:02:15.366146 11771 ts_tablet_manager.cc:1403] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.002s
I20260709 13:02:15.369059 11770 tablet_bootstrap.cc:492] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595: No bootstrap required, opened a new log
I20260709 13:02:15.369046 11771 raft_consensus.cc:359] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.369879 11771 raft_consensus.cc:385] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.370240 11771 raft_consensus.cc:740] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf763ad32cd44f88e0cb7bb80a03be1, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.369894 11770 ts_tablet_manager.cc:1403] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595: Time spent bootstrapping tablet: real 0.020s	user 0.002s	sys 0.017s
I20260709 13:02:15.371022 11771 consensus_queue.cc:260] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.372745 11772 tablet_bootstrap.cc:492] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d: No bootstrap required, opened a new log
I20260709 13:02:15.373282 11772 ts_tablet_manager.cc:1403] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.005s
I20260709 13:02:15.373751 11771 ts_tablet_manager.cc:1434] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:15.374230 11770 raft_consensus.cc:359] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.375001 11770 raft_consensus.cc:385] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.375326 11770 raft_consensus.cc:740] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.376175 11770 consensus_queue.cc:260] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.376554 11772 raft_consensus.cc:359] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.377312 11772 raft_consensus.cc:385] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.377698 11772 raft_consensus.cc:740] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.378854 11770 ts_tablet_manager.cc:1434] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:02:15.378504 11772 consensus_queue.cc:260] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.379846 11770 tablet_bootstrap.cc:492] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595: Bootstrap starting.
I20260709 13:02:15.381250 11772 ts_tablet_manager.cc:1434] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:02:15.382299 11772 tablet_bootstrap.cc:492] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d: Bootstrap starting.
I20260709 13:02:15.387337 11770 tablet_bootstrap.cc:654] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.389181 11772 tablet_bootstrap.cc:654] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.374713 11771 tablet_bootstrap.cc:492] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1: Bootstrap starting.
I20260709 13:02:15.397194 11775 raft_consensus.cc:493] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.397809 11775 raft_consensus.cc:515] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.402521 11777 raft_consensus.cc:493] T b8d4ca4c2f8645e3ac10467b750bcad9 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.402686 11775 leader_election.cc:290] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159)
I20260709 13:02:15.403066 11777 raft_consensus.cc:515] T b8d4ca4c2f8645e3ac10467b750bcad9 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.406038 11777 leader_election.cc:290] T b8d4ca4c2f8645e3ac10467b750bcad9 P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159), 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999)
I20260709 13:02:15.413622 11770 tablet_bootstrap.cc:492] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595: No bootstrap required, opened a new log
I20260709 13:02:15.414551 11770 ts_tablet_manager.cc:1403] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.010s
I20260709 13:02:15.413628 11771 tablet_bootstrap.cc:654] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.419555 11770 raft_consensus.cc:359] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.422883 11770 raft_consensus.cc:385] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.423388 11770 raft_consensus.cc:740] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.424516 11770 consensus_queue.cc:260] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.431638 11771 tablet_bootstrap.cc:492] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1: No bootstrap required, opened a new log
I20260709 13:02:15.432147 11771 ts_tablet_manager.cc:1403] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.000s
I20260709 13:02:15.437448 11770 ts_tablet_manager.cc:1434] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 13:02:15.439265 11770 tablet_bootstrap.cc:492] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595: Bootstrap starting.
I20260709 13:02:15.443467 11771 raft_consensus.cc:359] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.446974 11771 raft_consensus.cc:385] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.447300 11771 raft_consensus.cc:740] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf763ad32cd44f88e0cb7bb80a03be1, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.448272 11771 consensus_queue.cc:260] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.456950 11772 tablet_bootstrap.cc:492] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d: No bootstrap required, opened a new log
I20260709 13:02:15.457448 11772 ts_tablet_manager.cc:1403] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.006s
I20260709 13:02:15.457844 11771 ts_tablet_manager.cc:1434] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.003s
I20260709 13:02:15.464689 11771 tablet_bootstrap.cc:492] T ab061d0886a84dfca7fd6249f7454842 P cbf763ad32cd44f88e0cb7bb80a03be1: Bootstrap starting.
I20260709 13:02:15.464461 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fe30474f964ee6aeb9e40e79b9d588" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f5882eabbe42bd99758b5455bae87d" is_pre_election: true
I20260709 13:02:15.465862 11653 raft_consensus.cc:2468] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 0.
I20260709 13:02:15.466631 11772 raft_consensus.cc:359] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.470995 11690 leader_election.cc:304] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, 83f5882eabbe42bd99758b5455bae87d; no voters: 
I20260709 13:02:15.472397 11578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fe30474f964ee6aeb9e40e79b9d588" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" is_pre_election: true
I20260709 13:02:15.473191 11775 raft_consensus.cc:2804] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:15.473773 11578 raft_consensus.cc:2468] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 0.
I20260709 13:02:15.473877 11775 raft_consensus.cc:493] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.474710 11775 raft_consensus.cc:3060] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.472826 11772 raft_consensus.cc:385] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.475970 11772 raft_consensus.cc:740] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.481285 11772 consensus_queue.cc:260] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.493743 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d4ca4c2f8645e3ac10467b750bcad9" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f5882eabbe42bd99758b5455bae87d" is_pre_election: true
I20260709 13:02:15.494050 11772 ts_tablet_manager.cc:1434] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 13:02:15.495143 11772 tablet_bootstrap.cc:492] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d: Bootstrap starting.
W20260709 13:02:15.496820 11541 leader_election.cc:343] T b8d4ca4c2f8645e3ac10467b750bcad9 P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.499751 11771 tablet_bootstrap.cc:654] T ab061d0886a84dfca7fd6249f7454842 P cbf763ad32cd44f88e0cb7bb80a03be1: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.499907 11775 raft_consensus.cc:515] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.502516 11775 leader_election.cc:290] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 election: Requested vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159)
I20260709 13:02:15.503978 11578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fe30474f964ee6aeb9e40e79b9d588" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
I20260709 13:02:15.504608 11578 raft_consensus.cc:3060] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.506975 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fe30474f964ee6aeb9e40e79b9d588" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
I20260709 13:02:15.507800 11653 raft_consensus.cc:3060] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.513326 11799 raft_consensus.cc:493] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.515100 11770 tablet_bootstrap.cc:654] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.517967 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d4ca4c2f8645e3ac10467b750bcad9" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4216bf0e7b174ad19465277997d74595" is_pre_election: true
I20260709 13:02:15.519683 11772 tablet_bootstrap.cc:654] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.514271 11799 raft_consensus.cc:515] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.521974 11777 raft_consensus.cc:493] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.522413 11777 raft_consensus.cc:515] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.523511 11799 leader_election.cc:290] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159)
I20260709 13:02:15.523902 11577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b537af1f78d42d5ae93c345152f3ce6" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" is_pre_election: true
I20260709 13:02:15.524320 11777 leader_election.cc:290] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159), 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999)
I20260709 13:02:15.524664 11577 raft_consensus.cc:2468] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 0.
I20260709 13:02:15.525332 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2f548451cc4108a5cbae2c2979f42e" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f5882eabbe42bd99758b5455bae87d" is_pre_election: true
I20260709 13:02:15.532951 11578 raft_consensus.cc:2468] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 1.
I20260709 13:02:15.534204 11691 leader_election.cc:304] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 
I20260709 13:02:15.526933 11652 raft_consensus.cc:2468] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbf763ad32cd44f88e0cb7bb80a03be1 in term 0.
I20260709 13:02:15.534452 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b537af1f78d42d5ae93c345152f3ce6" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f5882eabbe42bd99758b5455bae87d" is_pre_election: true
I20260709 13:02:15.535094 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2f548451cc4108a5cbae2c2979f42e" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4216bf0e7b174ad19465277997d74595" is_pre_election: true
I20260709 13:02:15.536857 11541 leader_election.cc:304] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83f5882eabbe42bd99758b5455bae87d, cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 
I20260709 13:02:15.539242 11726 raft_consensus.cc:2468] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbf763ad32cd44f88e0cb7bb80a03be1 in term 0.
I20260709 13:02:15.540140 11777 raft_consensus.cc:2804] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:02:15.540242 11544 leader_election.cc:343] T b8d4ca4c2f8645e3ac10467b750bcad9 P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.540900 11777 raft_consensus.cc:493] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:15.538540 11690 leader_election.cc:343] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.541013 11544 leader_election.cc:304] T b8d4ca4c2f8645e3ac10467b750bcad9 P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 4216bf0e7b174ad19465277997d74595, 83f5882eabbe42bd99758b5455bae87d
I20260709 13:02:15.541368 11777 raft_consensus.cc:3060] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.542344 11799 raft_consensus.cc:2804] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:15.545024 11691 leader_election.cc:304] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 
I20260709 13:02:15.547031 11775 raft_consensus.cc:2804] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:15.544984 11799 raft_consensus.cc:493] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.553758 11770 tablet_bootstrap.cc:492] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595: No bootstrap required, opened a new log
I20260709 13:02:15.551419 11799 raft_consensus.cc:3060] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.555827 11775 raft_consensus.cc:697] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Becoming Leader. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Running, Role: LEADER
I20260709 13:02:15.557066 11775 consensus_queue.cc:237] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.563925 11771 tablet_bootstrap.cc:492] T ab061d0886a84dfca7fd6249f7454842 P cbf763ad32cd44f88e0cb7bb80a03be1: No bootstrap required, opened a new log
I20260709 13:02:15.564432 11771 ts_tablet_manager.cc:1403] T ab061d0886a84dfca7fd6249f7454842 P cbf763ad32cd44f88e0cb7bb80a03be1: Time spent bootstrapping tablet: real 0.100s	user 0.011s	sys 0.011s
I20260709 13:02:15.565171 11772 tablet_bootstrap.cc:492] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d: No bootstrap required, opened a new log
I20260709 13:02:15.565708 11772 ts_tablet_manager.cc:1403] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d: Time spent bootstrapping tablet: real 0.071s	user 0.019s	sys 0.008s
I20260709 13:02:15.563593 11770 ts_tablet_manager.cc:1403] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595: Time spent bootstrapping tablet: real 0.125s	user 0.007s	sys 0.011s
I20260709 13:02:15.563545 11653 raft_consensus.cc:2468] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 1.
I20260709 13:02:15.568114 11777 raft_consensus.cc:515] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.569038 11771 raft_consensus.cc:359] T ab061d0886a84dfca7fd6249f7454842 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.570253 11777 leader_election.cc:290] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 1 election: Requested vote from peers 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159), 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999)
I20260709 13:02:15.570338 11771 raft_consensus.cc:385] T ab061d0886a84dfca7fd6249f7454842 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.570883 11777 raft_consensus.cc:2749] T b8d4ca4c2f8645e3ac10467b750bcad9 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:15.571038 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2f548451cc4108a5cbae2c2979f42e" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
I20260709 13:02:15.570902 11771 raft_consensus.cc:740] T ab061d0886a84dfca7fd6249f7454842 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf763ad32cd44f88e0cb7bb80a03be1, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.571667 11653 raft_consensus.cc:3060] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.572582 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2f548451cc4108a5cbae2c2979f42e" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4216bf0e7b174ad19465277997d74595"
I20260709 13:02:15.572399 11771 consensus_queue.cc:260] T ab061d0886a84dfca7fd6249f7454842 P cbf763ad32cd44f88e0cb7bb80a03be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.573138 11726 raft_consensus.cc:3060] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.574766 11771 ts_tablet_manager.cc:1434] T ab061d0886a84dfca7fd6249f7454842 P cbf763ad32cd44f88e0cb7bb80a03be1: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:02:15.576000 11771 tablet_bootstrap.cc:492] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1: Bootstrap starting.
I20260709 13:02:15.580559 11726 raft_consensus.cc:2468] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf763ad32cd44f88e0cb7bb80a03be1 in term 1.
I20260709 13:02:15.581085 11653 raft_consensus.cc:2468] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf763ad32cd44f88e0cb7bb80a03be1 in term 1.
I20260709 13:02:15.593636 11541 leader_election.cc:304] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, 83f5882eabbe42bd99758b5455bae87d, cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 
I20260709 13:02:15.581998 11772 raft_consensus.cc:359] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.594575 11777 raft_consensus.cc:2804] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:15.594803 11772 raft_consensus.cc:385] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.595089 11777 raft_consensus.cc:697] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 LEADER]: Becoming Leader. State: Replica: cbf763ad32cd44f88e0cb7bb80a03be1, State: Running, Role: LEADER
I20260709 13:02:15.595155 11772 raft_consensus.cc:740] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.596001 11772 consensus_queue.cc:260] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.596050 11777 consensus_queue.cc:237] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.598431 11772 ts_tablet_manager.cc:1434] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:02:15.601936 11772 tablet_bootstrap.cc:492] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d: Bootstrap starting.
I20260709 13:02:15.603403 11472 catalog_manager.cc:5697] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4216bf0e7b174ad19465277997d74595 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "4216bf0e7b174ad19465277997d74595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.608253 11772 tablet_bootstrap.cc:654] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.583585 11771 tablet_bootstrap.cc:654] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.586128 11799 raft_consensus.cc:515] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.613435 11770 raft_consensus.cc:359] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.613865 11799 leader_election.cc:290] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 election: Requested vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159)
I20260709 13:02:15.614297 11770 raft_consensus.cc:385] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.614357 11578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b537af1f78d42d5ae93c345152f3ce6" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
I20260709 13:02:15.614737 11770 raft_consensus.cc:740] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.614992 11578 raft_consensus.cc:3060] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.615564 11770 consensus_queue.cc:260] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.618151 11770 ts_tablet_manager.cc:1434] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:02:15.618430 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b537af1f78d42d5ae93c345152f3ce6" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
I20260709 13:02:15.619095 11770 tablet_bootstrap.cc:492] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595: Bootstrap starting.
W20260709 13:02:15.619948 11690 leader_election.cc:343] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.624536 11772 tablet_bootstrap.cc:492] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d: No bootstrap required, opened a new log
I20260709 13:02:15.625120 11772 ts_tablet_manager.cc:1403] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.003s
I20260709 13:02:15.626564 11578 raft_consensus.cc:2468] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 1.
I20260709 13:02:15.627974 11691 leader_election.cc:304] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 83f5882eabbe42bd99758b5455bae87d
I20260709 13:02:15.628809 11772 raft_consensus.cc:359] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.643827 11772 raft_consensus.cc:385] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.629331 11799 raft_consensus.cc:2804] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:15.644511 11799 raft_consensus.cc:697] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Becoming Leader. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Running, Role: LEADER
I20260709 13:02:15.644832 11473 catalog_manager.cc:5697] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:15.645656 11799 consensus_queue.cc:237] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.628672 11770 tablet_bootstrap.cc:654] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.631593 11771 tablet_bootstrap.cc:492] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1: No bootstrap required, opened a new log
I20260709 13:02:15.650764 11779 raft_consensus.cc:493] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.651409 11779 raft_consensus.cc:515] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.654197 11772 raft_consensus.cc:740] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.655790 11771 ts_tablet_manager.cc:1403] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1: Time spent bootstrapping tablet: real 0.080s	user 0.011s	sys 0.009s
I20260709 13:02:15.655177 11772 consensus_queue.cc:260] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.657068 11779 leader_election.cc:290] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999)
I20260709 13:02:15.669292 11771 raft_consensus.cc:359] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.670807 11771 raft_consensus.cc:385] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.671133 11771 raft_consensus.cc:740] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf763ad32cd44f88e0cb7bb80a03be1, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.671983 11771 consensus_queue.cc:260] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.679147 11771 ts_tablet_manager.cc:1434] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:02:15.680383 11771 tablet_bootstrap.cc:492] T ae411261bb914f5da14b72347967ca59 P cbf763ad32cd44f88e0cb7bb80a03be1: Bootstrap starting.
I20260709 13:02:15.687232 11770 tablet_bootstrap.cc:492] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595: No bootstrap required, opened a new log
I20260709 13:02:15.693892 11770 ts_tablet_manager.cc:1403] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.008s
I20260709 13:02:15.702232 11772 ts_tablet_manager.cc:1434] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.008s
I20260709 13:02:15.703476 11772 tablet_bootstrap.cc:492] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d: Bootstrap starting.
I20260709 13:02:15.711561 11770 raft_consensus.cc:359] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.712275 11770 raft_consensus.cc:385] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.712622 11770 raft_consensus.cc:740] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.715204 11799 raft_consensus.cc:493] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.715775 11799 raft_consensus.cc:515] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.718277 11799 leader_election.cc:290] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159)
I20260709 13:02:15.718050 11770 consensus_queue.cc:260] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.719053 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab061d0886a84dfca7fd6249f7454842" candidate_uuid: "83f5882eabbe42bd99758b5455bae87d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4216bf0e7b174ad19465277997d74595" is_pre_election: true
I20260709 13:02:15.721016 11771 tablet_bootstrap.cc:654] T ae411261bb914f5da14b72347967ca59 P cbf763ad32cd44f88e0cb7bb80a03be1: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.722112 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a3e05897bb4ca8867a12693c28e411" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f5882eabbe42bd99758b5455bae87d" is_pre_election: true
I20260709 13:02:15.722841 11653 raft_consensus.cc:2468] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 0.
I20260709 13:02:15.727854 11772 tablet_bootstrap.cc:654] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.732409 11770 ts_tablet_manager.cc:1434] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.002s
I20260709 13:02:15.734863 11770 tablet_bootstrap.cc:492] T ab061d0886a84dfca7fd6249f7454842 P 4216bf0e7b174ad19465277997d74595: Bootstrap starting.
I20260709 13:02:15.735435 11690 leader_election.cc:304] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, 83f5882eabbe42bd99758b5455bae87d; no voters: 
I20260709 13:02:15.736384 11799 raft_consensus.cc:2804] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:15.737015 11775 raft_consensus.cc:493] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.737510 11775 raft_consensus.cc:515] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
W20260709 13:02:15.738615 11619 leader_election.cc:343] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.739697 11578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a3e05897bb4ca8867a12693c28e411" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" is_pre_election: true
I20260709 13:02:15.741282 11775 leader_election.cc:290] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159)
I20260709 13:02:15.736778 11799 raft_consensus.cc:493] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.745667 11578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab061d0886a84dfca7fd6249f7454842" candidate_uuid: "83f5882eabbe42bd99758b5455bae87d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" is_pre_election: true
I20260709 13:02:15.749826 11799 raft_consensus.cc:3060] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:15.752238 11691 leader_election.cc:343] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.752899 11770 tablet_bootstrap.cc:654] T ab061d0886a84dfca7fd6249f7454842 P 4216bf0e7b174ad19465277997d74595: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.755759 11578 raft_consensus.cc:2468] T ab061d0886a84dfca7fd6249f7454842 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 83f5882eabbe42bd99758b5455bae87d in term 0.
I20260709 13:02:15.756893 11577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae411261bb914f5da14b72347967ca59" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" is_pre_election: true
I20260709 13:02:15.759706 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae411261bb914f5da14b72347967ca59" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f5882eabbe42bd99758b5455bae87d" is_pre_election: true
I20260709 13:02:15.760643 11653 raft_consensus.cc:2468] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 0.
I20260709 13:02:15.763306 11771 tablet_bootstrap.cc:492] T ae411261bb914f5da14b72347967ca59 P cbf763ad32cd44f88e0cb7bb80a03be1: No bootstrap required, opened a new log
I20260709 13:02:15.763798 11771 ts_tablet_manager.cc:1403] T ae411261bb914f5da14b72347967ca59 P cbf763ad32cd44f88e0cb7bb80a03be1: Time spent bootstrapping tablet: real 0.084s	user 0.016s	sys 0.012s
W20260709 13:02:15.764122 11691 leader_election.cc:343] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.764950 11617 leader_election.cc:304] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83f5882eabbe42bd99758b5455bae87d, cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 4216bf0e7b174ad19465277997d74595
I20260709 13:02:15.764571 11799 raft_consensus.cc:515] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.765067 11472 catalog_manager.cc:5697] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4216bf0e7b174ad19465277997d74595 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "4216bf0e7b174ad19465277997d74595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.769701 11690 leader_election.cc:304] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, 83f5882eabbe42bd99758b5455bae87d; no voters: cbf763ad32cd44f88e0cb7bb80a03be1
I20260709 13:02:15.769948 11577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a3e05897bb4ca8867a12693c28e411" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
I20260709 13:02:15.770601 11775 raft_consensus.cc:2804] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:15.771003 11775 raft_consensus.cc:493] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.771402 11775 raft_consensus.cc:3060] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.772152 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a3e05897bb4ca8867a12693c28e411" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
W20260709 13:02:15.772342 11691 leader_election.cc:343] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.772928 11653 raft_consensus.cc:3060] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.768880 11799 leader_election.cc:290] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 election: Requested vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159)
I20260709 13:02:15.776481 11814 raft_consensus.cc:2804] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:15.776983 11814 raft_consensus.cc:493] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.777366 11814 raft_consensus.cc:3060] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.788297 11775 raft_consensus.cc:515] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.791087 11653 raft_consensus.cc:2468] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 1.
I20260709 13:02:15.792629 11799 raft_consensus.cc:493] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.792773 11690 leader_election.cc:304] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, 83f5882eabbe42bd99758b5455bae87d; no voters: cbf763ad32cd44f88e0cb7bb80a03be1
I20260709 13:02:15.794142 11804 raft_consensus.cc:2804] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:15.793174 11799 raft_consensus.cc:515] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.797245 11799 leader_election.cc:290] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159)
I20260709 13:02:15.801450 11775 leader_election.cc:290] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 election: Requested vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159)
I20260709 13:02:15.801553 11577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df85684d549345889a4683e2df597ee2" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" is_pre_election: true
I20260709 13:02:15.802395 11577 raft_consensus.cc:2468] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 0.
I20260709 13:02:15.803711 11771 raft_consensus.cc:359] T ae411261bb914f5da14b72347967ca59 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.804684 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df85684d549345889a4683e2df597ee2" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f5882eabbe42bd99758b5455bae87d" is_pre_election: true
I20260709 13:02:15.805501 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae411261bb914f5da14b72347967ca59" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
I20260709 13:02:15.805680 11771 raft_consensus.cc:385] T ae411261bb914f5da14b72347967ca59 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.806020 11771 raft_consensus.cc:740] T ae411261bb914f5da14b72347967ca59 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf763ad32cd44f88e0cb7bb80a03be1, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.806087 11651 raft_consensus.cc:3060] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.806852 11771 consensus_queue.cc:260] T ae411261bb914f5da14b72347967ca59 P cbf763ad32cd44f88e0cb7bb80a03be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.806922 11691 leader_election.cc:304] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 
I20260709 13:02:15.811333 11775 raft_consensus.cc:2804] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:15.811760 11775 raft_consensus.cc:493] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.812175 11775 raft_consensus.cc:3060] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.813575 11577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae411261bb914f5da14b72347967ca59" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
I20260709 13:02:15.827528 11771 ts_tablet_manager.cc:1434] T ae411261bb914f5da14b72347967ca59 P cbf763ad32cd44f88e0cb7bb80a03be1: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.005s
I20260709 13:02:15.828591 11771 tablet_bootstrap.cc:492] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1: Bootstrap starting.
I20260709 13:02:15.828480 11577 raft_consensus.cc:3060] T ae411261bb914f5da14b72347967ca59 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.829914 11772 tablet_bootstrap.cc:492] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d: No bootstrap required, opened a new log
I20260709 13:02:15.831610 11775 raft_consensus.cc:515] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.830420 11772 ts_tablet_manager.cc:1403] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d: Time spent bootstrapping tablet: real 0.127s	user 0.026s	sys 0.028s
I20260709 13:02:15.835111 11814 raft_consensus.cc:515] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.837018 11578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df85684d549345889a4683e2df597ee2" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
I20260709 13:02:15.837771 11775 leader_election.cc:290] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 election: Requested vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159)
I20260709 13:02:15.841749 11777 raft_consensus.cc:493] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.843005 11777 raft_consensus.cc:515] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
W20260709 13:02:15.843504 11690 leader_election.cc:343] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.844556 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df85684d549345889a4683e2df597ee2" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
I20260709 13:02:15.845147 11777 leader_election.cc:290] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159), 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999)
I20260709 13:02:15.841382 11772 raft_consensus.cc:359] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.837731 11578 raft_consensus.cc:3060] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.841868 11804 raft_consensus.cc:697] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Becoming Leader. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Running, Role: LEADER
I20260709 13:02:15.847419 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4dda2301e22449393d97a5ed6b1c906" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f5882eabbe42bd99758b5455bae87d" is_pre_election: true
I20260709 13:02:15.848026 11652 raft_consensus.cc:2468] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbf763ad32cd44f88e0cb7bb80a03be1 in term 0.
I20260709 13:02:15.846684 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4dda2301e22449393d97a5ed6b1c906" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4216bf0e7b174ad19465277997d74595" is_pre_election: true
I20260709 13:02:15.846709 11577 raft_consensus.cc:2468] T ae411261bb914f5da14b72347967ca59 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 1.
I20260709 13:02:15.841379 11651 raft_consensus.cc:2468] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 1.
I20260709 13:02:15.849200 11726 raft_consensus.cc:2468] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cbf763ad32cd44f88e0cb7bb80a03be1 in term 0.
I20260709 13:02:15.852315 11690 leader_election.cc:304] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, 83f5882eabbe42bd99758b5455bae87d; no voters: 
I20260709 13:02:15.852434 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab061d0886a84dfca7fd6249f7454842" candidate_uuid: "83f5882eabbe42bd99758b5455bae87d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4216bf0e7b174ad19465277997d74595"
I20260709 13:02:15.845839 11772 raft_consensus.cc:385] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.849932 11541 leader_election.cc:304] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83f5882eabbe42bd99758b5455bae87d, cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 
I20260709 13:02:15.853223 11576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab061d0886a84dfca7fd6249f7454842" candidate_uuid: "83f5882eabbe42bd99758b5455bae87d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
W20260709 13:02:15.854092 11619 leader_election.cc:343] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.854383 11576 raft_consensus.cc:3060] T ab061d0886a84dfca7fd6249f7454842 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.853866 11814 leader_election.cc:290] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d [CANDIDATE]: Term 1 election: Requested vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999)
I20260709 13:02:15.855151 11772 raft_consensus.cc:740] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.857172 11772 consensus_queue.cc:260] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.857951 11777 raft_consensus.cc:2804] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:15.858191 11770 tablet_bootstrap.cc:492] T ab061d0886a84dfca7fd6249f7454842 P 4216bf0e7b174ad19465277997d74595: No bootstrap required, opened a new log
I20260709 13:02:15.858517 11777 raft_consensus.cc:493] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.858654 11770 ts_tablet_manager.cc:1403] T ab061d0886a84dfca7fd6249f7454842 P 4216bf0e7b174ad19465277997d74595: Time spent bootstrapping tablet: real 0.125s	user 0.021s	sys 0.020s
I20260709 13:02:15.862195 11821 raft_consensus.cc:2804] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:15.862708 11821 raft_consensus.cc:697] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Becoming Leader. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Running, Role: LEADER
I20260709 13:02:15.861078 11777 raft_consensus.cc:3060] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.848282 11804 consensus_queue.cc:237] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.861517 11653 raft_consensus.cc:3060] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.871556 11772 ts_tablet_manager.cc:1434] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.001s
I20260709 13:02:15.872630 11772 tablet_bootstrap.cc:492] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d: Bootstrap starting.
I20260709 13:02:15.863893 11578 raft_consensus.cc:2468] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 1.
I20260709 13:02:15.875841 11691 leader_election.cc:304] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 
I20260709 13:02:15.863539 11821 consensus_queue.cc:237] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.879997 11804 raft_consensus.cc:2804] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:15.880733 11804 raft_consensus.cc:697] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Becoming Leader. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Running, Role: LEADER
I20260709 13:02:15.881489 11777 raft_consensus.cc:515] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.881721 11804 consensus_queue.cc:237] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.887320 11771 tablet_bootstrap.cc:654] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.886320 11576 raft_consensus.cc:2468] T ab061d0886a84dfca7fd6249f7454842 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83f5882eabbe42bd99758b5455bae87d in term 1.
I20260709 13:02:15.889524 11770 raft_consensus.cc:359] T ab061d0886a84dfca7fd6249f7454842 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.890677 11653 raft_consensus.cc:2468] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 1.
I20260709 13:02:15.890524 11770 raft_consensus.cc:385] T ab061d0886a84dfca7fd6249f7454842 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.891459 11770 raft_consensus.cc:740] T ab061d0886a84dfca7fd6249f7454842 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.892344 11770 consensus_queue.cc:260] T ab061d0886a84dfca7fd6249f7454842 P 4216bf0e7b174ad19465277997d74595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.889672 11617 leader_election.cc:304] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 83f5882eabbe42bd99758b5455bae87d, cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 4216bf0e7b174ad19465277997d74595
I20260709 13:02:15.894583 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4dda2301e22449393d97a5ed6b1c906" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
I20260709 13:02:15.894819 11814 raft_consensus.cc:2804] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:15.895187 11651 raft_consensus.cc:3060] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.895262 11814 raft_consensus.cc:697] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d [term 1 LEADER]: Becoming Leader. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Running, Role: LEADER
I20260709 13:02:15.899914 11814 consensus_queue.cc:237] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.900792 11770 ts_tablet_manager.cc:1434] T ab061d0886a84dfca7fd6249f7454842 P 4216bf0e7b174ad19465277997d74595: Time spent starting tablet: real 0.042s	user 0.002s	sys 0.006s
I20260709 13:02:15.907308 11777 leader_election.cc:290] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 1 election: Requested vote from peers 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159), 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999)
I20260709 13:02:15.909633 11772 tablet_bootstrap.cc:654] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.906949 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4dda2301e22449393d97a5ed6b1c906" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4216bf0e7b174ad19465277997d74595"
I20260709 13:02:15.910234 11726 raft_consensus.cc:3060] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.913988 11651 raft_consensus.cc:2468] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf763ad32cd44f88e0cb7bb80a03be1 in term 1.
I20260709 13:02:15.918812 11541 leader_election.cc:304] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83f5882eabbe42bd99758b5455bae87d, cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 
I20260709 13:02:15.919911 11777 raft_consensus.cc:2804] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:15.920784 11777 raft_consensus.cc:697] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 LEADER]: Becoming Leader. State: Replica: cbf763ad32cd44f88e0cb7bb80a03be1, State: Running, Role: LEADER
I20260709 13:02:15.926093 11771 tablet_bootstrap.cc:492] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1: No bootstrap required, opened a new log
I20260709 13:02:15.925616 11777 consensus_queue.cc:237] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.926563 11771 ts_tablet_manager.cc:1403] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1: Time spent bootstrapping tablet: real 0.098s	user 0.008s	sys 0.006s
I20260709 13:02:15.929203 11726 raft_consensus.cc:2468] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf763ad32cd44f88e0cb7bb80a03be1 in term 1.
I20260709 13:02:15.930320 11772 tablet_bootstrap.cc:492] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d: No bootstrap required, opened a new log
I20260709 13:02:15.930651 11772 ts_tablet_manager.cc:1403] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.008s
I20260709 13:02:15.933373 11772 raft_consensus.cc:359] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.934366 11772 raft_consensus.cc:385] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.934664 11772 raft_consensus.cc:740] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.934870 11771 raft_consensus.cc:359] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.935571 11771 raft_consensus.cc:385] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.935344 11772 consensus_queue.cc:260] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.935839 11771 raft_consensus.cc:740] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbf763ad32cd44f88e0cb7bb80a03be1, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.936477 11771 consensus_queue.cc:260] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.936983 11772 ts_tablet_manager.cc:1434] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:02:15.937901 11772 tablet_bootstrap.cc:492] T b8d4ca4c2f8645e3ac10467b750bcad9 P 83f5882eabbe42bd99758b5455bae87d: Bootstrap starting.
I20260709 13:02:15.938493 11771 ts_tablet_manager.cc:1434] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:02:15.943449 11472 catalog_manager.cc:5697] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4216bf0e7b174ad19465277997d74595 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "4216bf0e7b174ad19465277997d74595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.944542 11772 tablet_bootstrap.cc:654] T b8d4ca4c2f8645e3ac10467b750bcad9 P 83f5882eabbe42bd99758b5455bae87d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:15.953642 11475 catalog_manager.cc:5697] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 reported cstate change: term changed from 0 to 1, leader changed from <none> to cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:15.961655 11804 raft_consensus.cc:493] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:15.962276 11804 raft_consensus.cc:515] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.963011 11473 catalog_manager.cc:5697] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d reported cstate change: term changed from 0 to 1, leader changed from <none> to 83f5882eabbe42bd99758b5455bae87d (127.11.44.194). New cstate: current_term: 1 leader_uuid: "83f5882eabbe42bd99758b5455bae87d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:15.964493 11804 leader_election.cc:290] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159)
I20260709 13:02:15.966056 11576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d4ca4c2f8645e3ac10467b750bcad9" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" is_pre_election: true
I20260709 13:02:15.966681 11576 raft_consensus.cc:2468] T b8d4ca4c2f8645e3ac10467b750bcad9 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 0.
I20260709 13:02:15.967870 11691 leader_election.cc:304] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 
I20260709 13:02:15.968684 11804 raft_consensus.cc:2804] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:15.969103 11804 raft_consensus.cc:493] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:15.969448 11804 raft_consensus.cc:3060] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.970499 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d4ca4c2f8645e3ac10467b750bcad9" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f5882eabbe42bd99758b5455bae87d" is_pre_election: true
W20260709 13:02:15.971931 11690 leader_election.cc:343] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:15.976877 11804 raft_consensus.cc:515] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.979458 11576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d4ca4c2f8645e3ac10467b750bcad9" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
I20260709 13:02:15.980065 11576 raft_consensus.cc:3060] T b8d4ca4c2f8645e3ac10467b750bcad9 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.981138 11772 tablet_bootstrap.cc:492] T b8d4ca4c2f8645e3ac10467b750bcad9 P 83f5882eabbe42bd99758b5455bae87d: No bootstrap required, opened a new log
I20260709 13:02:15.981648 11772 ts_tablet_manager.cc:1403] T b8d4ca4c2f8645e3ac10467b750bcad9 P 83f5882eabbe42bd99758b5455bae87d: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.012s
I20260709 13:02:15.984416 11772 raft_consensus.cc:359] T b8d4ca4c2f8645e3ac10467b750bcad9 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.985105 11772 raft_consensus.cc:385] T b8d4ca4c2f8645e3ac10467b750bcad9 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:15.986049 11804 leader_election.cc:290] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 election: Requested vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159)
I20260709 13:02:15.985383 11772 raft_consensus.cc:740] T b8d4ca4c2f8645e3ac10467b750bcad9 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Initialized, Role: FOLLOWER
I20260709 13:02:15.987357 11653 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8d4ca4c2f8645e3ac10467b750bcad9" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
I20260709 13:02:15.987190 11772 consensus_queue.cc:260] T b8d4ca4c2f8645e3ac10467b750bcad9 P 83f5882eabbe42bd99758b5455bae87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:15.988176 11653 raft_consensus.cc:3060] T b8d4ca4c2f8645e3ac10467b750bcad9 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:15.989614 11772 ts_tablet_manager.cc:1434] T b8d4ca4c2f8645e3ac10467b750bcad9 P 83f5882eabbe42bd99758b5455bae87d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:02:15.991675 11472 catalog_manager.cc:5697] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4216bf0e7b174ad19465277997d74595 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "4216bf0e7b174ad19465277997d74595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:15.993279 11653 raft_consensus.cc:2468] T b8d4ca4c2f8645e3ac10467b750bcad9 P 83f5882eabbe42bd99758b5455bae87d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 1.
I20260709 13:02:15.993554 11472 catalog_manager.cc:5697] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4216bf0e7b174ad19465277997d74595 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "4216bf0e7b174ad19465277997d74595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:15.971870 11522 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:16.001536 11690 leader_election.cc:304] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, 83f5882eabbe42bd99758b5455bae87d; no voters: 
I20260709 13:02:16.003558 11804 raft_consensus.cc:2804] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:16.004045 11804 raft_consensus.cc:697] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Becoming Leader. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Running, Role: LEADER
I20260709 13:02:16.005057 11576 raft_consensus.cc:2468] T b8d4ca4c2f8645e3ac10467b750bcad9 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 1.
I20260709 13:02:16.004835 11804 consensus_queue.cc:237] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:16.014391 11472 catalog_manager.cc:5697] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4216bf0e7b174ad19465277997d74595 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "4216bf0e7b174ad19465277997d74595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:16.019084 11777 consensus_queue.cc:1048] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.028427 11821 consensus_queue.cc:1048] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.031888 11804 consensus_queue.cc:1048] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.071682 11651 raft_consensus.cc:3060] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:16.079958 11799 consensus_queue.cc:1048] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.087375 11777 consensus_queue.cc:1048] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.091154 11804 consensus_queue.cc:1048] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.162601 11803 raft_consensus.cc:493] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.163136 11803 raft_consensus.cc:515] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:16.165565 11803 leader_election.cc:290] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159), 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999)
I20260709 13:02:16.166255 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a3e05897bb4ca8867a12693c28e411" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4216bf0e7b174ad19465277997d74595" is_pre_election: true
I20260709 13:02:16.166194 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a3e05897bb4ca8867a12693c28e411" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f5882eabbe42bd99758b5455bae87d" is_pre_election: true
I20260709 13:02:16.167271 11651 raft_consensus.cc:2393] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cbf763ad32cd44f88e0cb7bb80a03be1 in current term 1: Already voted for candidate 4216bf0e7b174ad19465277997d74595 in this term.
I20260709 13:02:16.168282 11541 leader_election.cc:304] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 4216bf0e7b174ad19465277997d74595, 83f5882eabbe42bd99758b5455bae87d
I20260709 13:02:16.169106 11803 raft_consensus.cc:3060] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:16.177497 11803 raft_consensus.cc:2749] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:16.272395 11804 raft_consensus.cc:493] T ab061d0886a84dfca7fd6249f7454842 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:16.272960 11804 raft_consensus.cc:515] T ab061d0886a84dfca7fd6249f7454842 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:16.275410 11804 leader_election.cc:290] T ab061d0886a84dfca7fd6249f7454842 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159)
I20260709 13:02:16.276580 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab061d0886a84dfca7fd6249f7454842" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83f5882eabbe42bd99758b5455bae87d" is_pre_election: true
I20260709 13:02:16.278920 11576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab061d0886a84dfca7fd6249f7454842" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" is_pre_election: true
I20260709 13:02:16.279708 11576 raft_consensus.cc:2393] T ab061d0886a84dfca7fd6249f7454842 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4216bf0e7b174ad19465277997d74595 in current term 1: Already voted for candidate 83f5882eabbe42bd99758b5455bae87d in this term.
I20260709 13:02:16.280699 11691 leader_election.cc:304] T ab061d0886a84dfca7fd6249f7454842 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4216bf0e7b174ad19465277997d74595; no voters: 83f5882eabbe42bd99758b5455bae87d, cbf763ad32cd44f88e0cb7bb80a03be1
I20260709 13:02:16.281500 11804 raft_consensus.cc:3060] T ab061d0886a84dfca7fd6249f7454842 P 4216bf0e7b174ad19465277997d74595 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:16.287269 11726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6fe30474f964ee6aeb9e40e79b9d588"
dest_uuid: "4216bf0e7b174ad19465277997d74595"
mode: GRACEFUL
new_leader_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
 from {username='slave'} at 127.0.0.1:52986
I20260709 13:02:16.287995 11726 raft_consensus.cc:606] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Received request to transfer leadership to TS cbf763ad32cd44f88e0cb7bb80a03be1
I20260709 13:02:16.288925 11804 raft_consensus.cc:2749] T ab061d0886a84dfca7fd6249f7454842 P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:16.288710 11775 consensus_queue.cc:1048] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.297945 11804 consensus_queue.cc:1048] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.300185 11726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b537af1f78d42d5ae93c345152f3ce6"
dest_uuid: "4216bf0e7b174ad19465277997d74595"
mode: GRACEFUL
new_leader_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
 from {username='slave'} at 127.0.0.1:52986
I20260709 13:02:16.300886 11726 raft_consensus.cc:606] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Received request to transfer leadership to TS cbf763ad32cd44f88e0cb7bb80a03be1
I20260709 13:02:16.303642 11804 consensus_queue.cc:1048] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.316267 11803 consensus_queue.cc:1048] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.318651 11821 consensus_queue.cc:1048] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.327919 11727 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73a3e05897bb4ca8867a12693c28e411"
dest_uuid: "4216bf0e7b174ad19465277997d74595"
mode: GRACEFUL
new_leader_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
 from {username='slave'} at 127.0.0.1:52986
I20260709 13:02:16.329063 11727 raft_consensus.cc:606] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Received request to transfer leadership to TS cbf763ad32cd44f88e0cb7bb80a03be1
I20260709 13:02:16.361088 11777 consensus_queue.cc:1048] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:16.364491 11576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4dda2301e22449393d97a5ed6b1c906"
dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
mode: GRACEFUL
new_leader_uuid: "83f5882eabbe42bd99758b5455bae87d"
 from {username='slave'} at 127.0.0.1:48134
I20260709 13:02:16.365190 11576 raft_consensus.cc:606] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 LEADER]: Received request to transfer leadership to TS 83f5882eabbe42bd99758b5455bae87d
I20260709 13:02:16.369282 11803 raft_consensus.cc:993] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1: : Instructing follower 83f5882eabbe42bd99758b5455bae87d to start an election
I20260709 13:02:16.369864 11777 raft_consensus.cc:1081] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 LEADER]: Signalling peer 83f5882eabbe42bd99758b5455bae87d to start an election
I20260709 13:02:16.371716 11651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4dda2301e22449393d97a5ed6b1c906"
dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
 from {username='slave'} at 127.0.0.1:37364
I20260709 13:02:16.372314 11651 raft_consensus.cc:493] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:16.373135 11651 raft_consensus.cc:3060] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:16.372944 11726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df85684d549345889a4683e2df597ee2"
dest_uuid: "4216bf0e7b174ad19465277997d74595"
mode: GRACEFUL
new_leader_uuid: "83f5882eabbe42bd99758b5455bae87d"
 from {username='slave'} at 127.0.0.1:52986
I20260709 13:02:16.373737 11726 raft_consensus.cc:606] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Received request to transfer leadership to TS 83f5882eabbe42bd99758b5455bae87d
I20260709 13:02:16.378098 11804 consensus_queue.cc:1048] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.380106 11726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae411261bb914f5da14b72347967ca59"
dest_uuid: "4216bf0e7b174ad19465277997d74595"
mode: GRACEFUL
new_leader_uuid: "83f5882eabbe42bd99758b5455bae87d"
 from {username='slave'} at 127.0.0.1:52986
I20260709 13:02:16.380683 11726 raft_consensus.cc:606] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Received request to transfer leadership to TS 83f5882eabbe42bd99758b5455bae87d
I20260709 13:02:16.384112 11651 raft_consensus.cc:515] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:16.388020 11576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4dda2301e22449393d97a5ed6b1c906" candidate_uuid: "83f5882eabbe42bd99758b5455bae87d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
I20260709 13:02:16.388108 11651 leader_election.cc:290] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [CANDIDATE]: Term 2 election: Requested vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999)
I20260709 13:02:16.388752 11576 raft_consensus.cc:3055] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:16.389125 11576 raft_consensus.cc:740] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbf763ad32cd44f88e0cb7bb80a03be1, State: Running, Role: LEADER
I20260709 13:02:16.389976 11576 consensus_queue.cc:260] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:16.391571 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4dda2301e22449393d97a5ed6b1c906" candidate_uuid: "83f5882eabbe42bd99758b5455bae87d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4216bf0e7b174ad19465277997d74595"
I20260709 13:02:16.392351 11726 raft_consensus.cc:3060] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:16.395298 11576 raft_consensus.cc:3060] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:16.402103 11576 raft_consensus.cc:2468] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83f5882eabbe42bd99758b5455bae87d in term 2.
I20260709 13:02:16.403456 11617 leader_election.cc:304] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83f5882eabbe42bd99758b5455bae87d, cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 
I20260709 13:02:16.404335 11814 raft_consensus.cc:2804] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:16.404806 11726 raft_consensus.cc:2468] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83f5882eabbe42bd99758b5455bae87d in term 2.
I20260709 13:02:16.414147 11814 raft_consensus.cc:697] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [term 2 LEADER]: Becoming Leader. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Running, Role: LEADER
I20260709 13:02:16.414650 11851 consensus_queue.cc:1048] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:16.415127 11814 consensus_queue.cc:237] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:16.419905 11799 consensus_queue.cc:1048] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.439221 11474 catalog_manager.cc:5697] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d reported cstate change: term changed from 1 to 2, leader changed from cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193) to 83f5882eabbe42bd99758b5455bae87d (127.11.44.194). New cstate: current_term: 2 leader_uuid: "83f5882eabbe42bd99758b5455bae87d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:16.445390 11851 consensus_queue.cc:1048] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.450821 11799 raft_consensus.cc:993] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595: : Instructing follower 83f5882eabbe42bd99758b5455bae87d to start an election
I20260709 13:02:16.451326 11799 raft_consensus.cc:1081] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Signalling peer 83f5882eabbe42bd99758b5455bae87d to start an election
I20260709 13:02:16.455775 11651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae411261bb914f5da14b72347967ca59"
dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
 from {username='slave'} at 127.0.0.1:37362
I20260709 13:02:16.456363 11651 raft_consensus.cc:493] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:16.456746 11651 raft_consensus.cc:3060] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:16.471462 11651 raft_consensus.cc:515] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:16.476614 11578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae411261bb914f5da14b72347967ca59" candidate_uuid: "83f5882eabbe42bd99758b5455bae87d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
I20260709 13:02:16.477298 11578 raft_consensus.cc:3060] T ae411261bb914f5da14b72347967ca59 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:16.483664 11578 raft_consensus.cc:2468] T ae411261bb914f5da14b72347967ca59 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83f5882eabbe42bd99758b5455bae87d in term 2.
I20260709 13:02:16.485132 11617 leader_election.cc:304] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83f5882eabbe42bd99758b5455bae87d, cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 
I20260709 13:02:16.486137 11856 raft_consensus.cc:2804] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:16.486258 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae411261bb914f5da14b72347967ca59" candidate_uuid: "83f5882eabbe42bd99758b5455bae87d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4216bf0e7b174ad19465277997d74595"
I20260709 13:02:16.486902 11651 leader_election.cc:290] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [CANDIDATE]: Term 2 election: Requested vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999)
I20260709 13:02:16.487495 11856 raft_consensus.cc:697] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [term 2 LEADER]: Becoming Leader. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Running, Role: LEADER
I20260709 13:02:16.486933 11726 raft_consensus.cc:3055] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:16.488482 11856 consensus_queue.cc:237] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:16.489108 11726 raft_consensus.cc:740] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Running, Role: LEADER
I20260709 13:02:16.490077 11726 consensus_queue.cc:260] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:16.491349 11726 raft_consensus.cc:3060] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:16.498301 11726 raft_consensus.cc:2468] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83f5882eabbe42bd99758b5455bae87d in term 2.
I20260709 13:02:16.498639 11474 catalog_manager.cc:5697] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d reported cstate change: term changed from 1 to 2, leader changed from 4216bf0e7b174ad19465277997d74595 (127.11.44.195) to 83f5882eabbe42bd99758b5455bae87d (127.11.44.194). New cstate: current_term: 2 leader_uuid: "83f5882eabbe42bd99758b5455bae87d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:16.514369 11775 raft_consensus.cc:993] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595: : Instructing follower cbf763ad32cd44f88e0cb7bb80a03be1 to start an election
I20260709 13:02:16.514843 11799 raft_consensus.cc:1081] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Signalling peer cbf763ad32cd44f88e0cb7bb80a03be1 to start an election
I20260709 13:02:16.516510 11578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6fe30474f964ee6aeb9e40e79b9d588"
dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
 from {username='slave'} at 127.0.0.1:48110
I20260709 13:02:16.517160 11578 raft_consensus.cc:493] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:16.517511 11578 raft_consensus.cc:3060] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:16.523805 11578 raft_consensus.cc:515] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:16.525846 11578 leader_election.cc:290] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 2 election: Requested vote from peers 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159), 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999)
I20260709 13:02:16.526892 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fe30474f964ee6aeb9e40e79b9d588" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
I20260709 13:02:16.527107 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fe30474f964ee6aeb9e40e79b9d588" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4216bf0e7b174ad19465277997d74595"
I20260709 13:02:16.527566 11651 raft_consensus.cc:3060] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:16.527787 11726 raft_consensus.cc:3055] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:16.528194 11726 raft_consensus.cc:740] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Running, Role: LEADER
I20260709 13:02:16.529017 11726 consensus_queue.cc:260] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:16.530426 11726 raft_consensus.cc:3060] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:16.535564 11651 raft_consensus.cc:2468] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf763ad32cd44f88e0cb7bb80a03be1 in term 2.
I20260709 13:02:16.536924 11541 leader_election.cc:304] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83f5882eabbe42bd99758b5455bae87d, cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 
I20260709 13:02:16.537819 11777 raft_consensus.cc:2804] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:16.538328 11777 raft_consensus.cc:697] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 LEADER]: Becoming Leader. State: Replica: cbf763ad32cd44f88e0cb7bb80a03be1, State: Running, Role: LEADER
I20260709 13:02:16.539263 11777 consensus_queue.cc:237] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:16.541801 11726 raft_consensus.cc:2468] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf763ad32cd44f88e0cb7bb80a03be1 in term 2.
I20260709 13:02:16.543573 11799 consensus_queue.cc:1048] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.548897 11474 catalog_manager.cc:5697] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 reported cstate change: term changed from 1 to 2, leader changed from 4216bf0e7b174ad19465277997d74595 (127.11.44.195) to cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:16.559218 11775 consensus_queue.cc:1048] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:16.577602 11804 raft_consensus.cc:993] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595: : Instructing follower cbf763ad32cd44f88e0cb7bb80a03be1 to start an election
I20260709 13:02:16.578074 11775 raft_consensus.cc:1081] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Signalling peer cbf763ad32cd44f88e0cb7bb80a03be1 to start an election
I20260709 13:02:16.579849 11578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b537af1f78d42d5ae93c345152f3ce6"
dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
 from {username='slave'} at 127.0.0.1:48110
I20260709 13:02:16.580541 11578 raft_consensus.cc:493] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:16.581014 11578 raft_consensus.cc:3060] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:16.588567 11578 raft_consensus.cc:515] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:16.590974 11578 leader_election.cc:290] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 2 election: Requested vote from peers 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159), 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999)
I20260709 13:02:16.592214 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b537af1f78d42d5ae93c345152f3ce6" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4216bf0e7b174ad19465277997d74595"
I20260709 13:02:16.592214 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b537af1f78d42d5ae93c345152f3ce6" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
I20260709 13:02:16.592892 11726 raft_consensus.cc:3055] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:16.593053 11651 raft_consensus.cc:3060] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:16.593518 11726 raft_consensus.cc:740] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Running, Role: LEADER
I20260709 13:02:16.594586 11726 consensus_queue.cc:260] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:16.596747 11726 raft_consensus.cc:3060] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:16.601758 11651 raft_consensus.cc:2468] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf763ad32cd44f88e0cb7bb80a03be1 in term 2.
I20260709 13:02:16.603252 11541 leader_election.cc:304] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83f5882eabbe42bd99758b5455bae87d, cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 
I20260709 13:02:16.604156 11777 raft_consensus.cc:2804] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:16.604426 11726 raft_consensus.cc:2468] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf763ad32cd44f88e0cb7bb80a03be1 in term 2.
I20260709 13:02:16.604655 11777 raft_consensus.cc:697] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 LEADER]: Becoming Leader. State: Replica: cbf763ad32cd44f88e0cb7bb80a03be1, State: Running, Role: LEADER
I20260709 13:02:16.605523 11777 consensus_queue.cc:237] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:16.612623 11474 catalog_manager.cc:5697] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 reported cstate change: term changed from 1 to 2, leader changed from 4216bf0e7b174ad19465277997d74595 (127.11.44.195) to cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:16.806423 11775 raft_consensus.cc:993] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595: : Instructing follower 83f5882eabbe42bd99758b5455bae87d to start an election
I20260709 13:02:16.806913 11804 raft_consensus.cc:1081] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Signalling peer 83f5882eabbe42bd99758b5455bae87d to start an election
I20260709 13:02:16.808470 11651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df85684d549345889a4683e2df597ee2"
dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
 from {username='slave'} at 127.0.0.1:37362
I20260709 13:02:16.809057 11651 raft_consensus.cc:493] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:16.809417 11651 raft_consensus.cc:3060] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:16.816045 11651 raft_consensus.cc:515] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:16.818159 11651 leader_election.cc:290] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [CANDIDATE]: Term 2 election: Requested vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999)
I20260709 13:02:16.819285 11578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df85684d549345889a4683e2df597ee2" candidate_uuid: "83f5882eabbe42bd99758b5455bae87d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
I20260709 13:02:16.819713 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df85684d549345889a4683e2df597ee2" candidate_uuid: "83f5882eabbe42bd99758b5455bae87d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4216bf0e7b174ad19465277997d74595"
I20260709 13:02:16.819890 11578 raft_consensus.cc:3060] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:16.820399 11726 raft_consensus.cc:3055] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:16.820695 11726 raft_consensus.cc:740] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Running, Role: LEADER
I20260709 13:02:16.821610 11726 consensus_queue.cc:260] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:16.822553 11726 raft_consensus.cc:3060] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:16.827085 11726 raft_consensus.cc:2468] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83f5882eabbe42bd99758b5455bae87d in term 2.
I20260709 13:02:16.827967 11578 raft_consensus.cc:2468] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83f5882eabbe42bd99758b5455bae87d in term 2.
I20260709 13:02:16.828408 11619 leader_election.cc:304] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, 83f5882eabbe42bd99758b5455bae87d; no voters: 
I20260709 13:02:16.829735 11856 raft_consensus.cc:2804] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:16.830477 11856 raft_consensus.cc:697] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 2 LEADER]: Becoming Leader. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Running, Role: LEADER
I20260709 13:02:16.831303 11856 consensus_queue.cc:237] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:16.838830 11474 catalog_manager.cc:5697] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d reported cstate change: term changed from 1 to 2, leader changed from 4216bf0e7b174ad19465277997d74595 (127.11.44.195) to 83f5882eabbe42bd99758b5455bae87d (127.11.44.194). New cstate: current_term: 2 leader_uuid: "83f5882eabbe42bd99758b5455bae87d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:16.854254 11578 raft_consensus.cc:1275] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 FOLLOWER]: Refusing update from remote peer 83f5882eabbe42bd99758b5455bae87d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:16.855832 11856 consensus_queue.cc:1048] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:16.869377 11726 raft_consensus.cc:1275] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Refusing update from remote peer 83f5882eabbe42bd99758b5455bae87d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:16.871147 11851 consensus_queue.cc:1048] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:16.885645 11821 raft_consensus.cc:993] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595: : Instructing follower cbf763ad32cd44f88e0cb7bb80a03be1 to start an election
I20260709 13:02:16.886118 11821 raft_consensus.cc:1081] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Signalling peer cbf763ad32cd44f88e0cb7bb80a03be1 to start an election
I20260709 13:02:16.887737 11578 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73a3e05897bb4ca8867a12693c28e411"
dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
 from {username='slave'} at 127.0.0.1:48110
I20260709 13:02:16.888326 11578 raft_consensus.cc:493] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:16.888741 11578 raft_consensus.cc:3060] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:16.894073 11578 raft_consensus.cc:515] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:16.895934 11578 leader_election.cc:290] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 2 election: Requested vote from peers 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159), 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999)
I20260709 13:02:16.896857 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a3e05897bb4ca8867a12693c28e411" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
I20260709 13:02:16.897004 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a3e05897bb4ca8867a12693c28e411" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4216bf0e7b174ad19465277997d74595"
I20260709 13:02:16.897465 11651 raft_consensus.cc:3060] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:16.897637 11726 raft_consensus.cc:3055] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:16.898152 11726 raft_consensus.cc:740] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Running, Role: LEADER
I20260709 13:02:16.898906 11726 consensus_queue.cc:260] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:16.899920 11726 raft_consensus.cc:3060] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:16.904433 11726 raft_consensus.cc:2468] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf763ad32cd44f88e0cb7bb80a03be1 in term 2.
I20260709 13:02:16.905290 11651 raft_consensus.cc:2468] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf763ad32cd44f88e0cb7bb80a03be1 in term 2.
I20260709 13:02:16.905670 11544 leader_election.cc:304] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 
I20260709 13:02:16.906895 11859 raft_consensus.cc:2804] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:16.907402 11859 raft_consensus.cc:697] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 LEADER]: Becoming Leader. State: Replica: cbf763ad32cd44f88e0cb7bb80a03be1, State: Running, Role: LEADER
I20260709 13:02:16.908270 11859 consensus_queue.cc:237] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:16.915622 11474 catalog_manager.cc:5697] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 reported cstate change: term changed from 1 to 2, leader changed from 4216bf0e7b174ad19465277997d74595 (127.11.44.195) to cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:16.951535 11726 raft_consensus.cc:1275] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Refusing update from remote peer 83f5882eabbe42bd99758b5455bae87d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:16.952920 11578 raft_consensus.cc:1275] T ae411261bb914f5da14b72347967ca59 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 FOLLOWER]: Refusing update from remote peer 83f5882eabbe42bd99758b5455bae87d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:16.953007 11851 consensus_queue.cc:1048] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:16.954407 11814 consensus_queue.cc:1048] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:16.989718 11726 raft_consensus.cc:1275] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Refusing update from remote peer cbf763ad32cd44f88e0cb7bb80a03be1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:16.991078 11859 consensus_queue.cc:1048] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:16.999409 11651 raft_consensus.cc:1275] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Refusing update from remote peer cbf763ad32cd44f88e0cb7bb80a03be1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:17.001899 11859 consensus_queue.cc:1048] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:17.046155 11651 raft_consensus.cc:1275] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Refusing update from remote peer cbf763ad32cd44f88e0cb7bb80a03be1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:17.047983 11859 consensus_queue.cc:1048] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:17.060261 11726 raft_consensus.cc:1275] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Refusing update from remote peer cbf763ad32cd44f88e0cb7bb80a03be1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:17.062049 11803 consensus_queue.cc:1048] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:17.335634 11726 raft_consensus.cc:1275] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Refusing update from remote peer 83f5882eabbe42bd99758b5455bae87d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:17.336967 11851 consensus_queue.cc:1048] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:17.342324 11727 raft_consensus.cc:1275] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Refusing update from remote peer cbf763ad32cd44f88e0cb7bb80a03be1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:17.343708 11803 consensus_queue.cc:1048] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:17.349217 11578 raft_consensus.cc:1275] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 FOLLOWER]: Refusing update from remote peer 83f5882eabbe42bd99758b5455bae87d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:17.350908 11852 consensus_queue.cc:1048] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:17.357468 11651 raft_consensus.cc:1275] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Refusing update from remote peer cbf763ad32cd44f88e0cb7bb80a03be1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:17.359125 11803 consensus_queue.cc:1048] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:19.134351 11506 debug-util.cc:398] Leaking SignalData structure 0x7b0800062060 after lost signal to thread 11446
W20260709 13:02:19.135326 11506 debug-util.cc:398] Leaking SignalData structure 0x7b0800062740 after lost signal to thread 11509
W20260709 13:02:19.136121 11506 debug-util.cc:398] Leaking SignalData structure 0x7b08001dfa60 after lost signal to thread 11602
W20260709 13:02:19.136801 11506 debug-util.cc:398] Leaking SignalData structure 0x7b08001ab3e0 after lost signal to thread 11677
W20260709 13:02:19.137496 11506 debug-util.cc:398] Leaking SignalData structure 0x7b08000d16c0 after lost signal to thread 11751
I20260709 13:02:19.480749 11443 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:02:19.481688 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:19.508067 11577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d2f548451cc4108a5cbae2c2979f42e"
dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
mode: GRACEFUL
new_leader_uuid: "4216bf0e7b174ad19465277997d74595"
 from {username='slave'} at 127.0.0.1:48144
I20260709 13:02:19.509224 11577 raft_consensus.cc:606] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 LEADER]: Received request to transfer leadership to TS 4216bf0e7b174ad19465277997d74595
I20260709 13:02:19.526690 11651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df85684d549345889a4683e2df597ee2"
dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
mode: GRACEFUL
new_leader_uuid: "4216bf0e7b174ad19465277997d74595"
 from {username='slave'} at 127.0.0.1:37372
I20260709 13:02:19.527312 11651 raft_consensus.cc:606] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 2 LEADER]: Received request to transfer leadership to TS 4216bf0e7b174ad19465277997d74595
I20260709 13:02:19.528784 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:19.529433 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:19.719204 11866 raft_consensus.cc:993] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1: : Instructing follower 4216bf0e7b174ad19465277997d74595 to start an election
I20260709 13:02:19.720162 11864 raft_consensus.cc:1081] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 LEADER]: Signalling peer 4216bf0e7b174ad19465277997d74595 to start an election
I20260709 13:02:19.723604 11726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d2f548451cc4108a5cbae2c2979f42e"
dest_uuid: "4216bf0e7b174ad19465277997d74595"
 from {username='slave'} at 127.0.0.1:52962
I20260709 13:02:19.724192 11726 raft_consensus.cc:493] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:19.724653 11726 raft_consensus.cc:3060] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:19.732223 11726 raft_consensus.cc:515] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:19.735445 11726 leader_election.cc:290] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 2 election: Requested vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159)
I20260709 13:02:19.736819 11577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2f548451cc4108a5cbae2c2979f42e" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
I20260709 13:02:19.736774 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2f548451cc4108a5cbae2c2979f42e" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
I20260709 13:02:19.737649 11577 raft_consensus.cc:3055] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:19.737893 11651 raft_consensus.cc:3060] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:19.738200 11577 raft_consensus.cc:740] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cbf763ad32cd44f88e0cb7bb80a03be1, State: Running, Role: LEADER
I20260709 13:02:19.739928 11577 consensus_queue.cc:260] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:19.742376 11577 raft_consensus.cc:3060] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:19.755822 11651 raft_consensus.cc:2468] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 2.
I20260709 13:02:19.757407 11690 leader_election.cc:304] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, 83f5882eabbe42bd99758b5455bae87d; no voters: 
I20260709 13:02:19.757771 11577 raft_consensus.cc:2468] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 2.
I20260709 13:02:19.758437 11867 raft_consensus.cc:2804] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:19.758970 11867 raft_consensus.cc:697] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [term 2 LEADER]: Becoming Leader. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Running, Role: LEADER
I20260709 13:02:19.760205 11867 consensus_queue.cc:237] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:19.781823 11472 catalog_manager.cc:5697] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 reported cstate change: term changed from 1 to 2, leader changed from cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193) to 4216bf0e7b174ad19465277997d74595 (127.11.44.195). New cstate: current_term: 2 leader_uuid: "4216bf0e7b174ad19465277997d74595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:20.021335 11876 raft_consensus.cc:993] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d: : Instructing follower 4216bf0e7b174ad19465277997d74595 to start an election
I20260709 13:02:20.021931 11814 raft_consensus.cc:1081] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 2 LEADER]: Signalling peer 4216bf0e7b174ad19465277997d74595 to start an election
I20260709 13:02:20.023849 11726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df85684d549345889a4683e2df597ee2"
dest_uuid: "4216bf0e7b174ad19465277997d74595"
 from {username='slave'} at 127.0.0.1:52978
I20260709 13:02:20.024475 11726 raft_consensus.cc:493] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:20.024844 11726 raft_consensus.cc:3060] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:20.032698 11726 raft_consensus.cc:515] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:20.035418 11726 leader_election.cc:290] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 3 election: Requested vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159)
I20260709 13:02:20.036487 11577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df85684d549345889a4683e2df597ee2" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
I20260709 13:02:20.036697 11651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df85684d549345889a4683e2df597ee2" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
I20260709 13:02:20.037109 11577 raft_consensus.cc:3060] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:20.037247 11651 raft_consensus.cc:3055] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:20.037637 11651 raft_consensus.cc:740] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Running, Role: LEADER
I20260709 13:02:20.038264 11651 consensus_queue.cc:260] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:20.039131 11651 raft_consensus.cc:3060] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:20.043310 11651 raft_consensus.cc:2468] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 3.
I20260709 13:02:20.044836 11690 leader_election.cc:304] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, 83f5882eabbe42bd99758b5455bae87d; no voters: 
I20260709 13:02:20.045328 11577 raft_consensus.cc:2468] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 3.
I20260709 13:02:20.046319 11867 raft_consensus.cc:2804] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:20.046996 11867 raft_consensus.cc:697] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 3 LEADER]: Becoming Leader. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Running, Role: LEADER
I20260709 13:02:20.047869 11867 consensus_queue.cc:237] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:20.062158 11473 catalog_manager.cc:5697] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 reported cstate change: term changed from 2 to 3, leader changed from 83f5882eabbe42bd99758b5455bae87d (127.11.44.194) to 4216bf0e7b174ad19465277997d74595 (127.11.44.195). New cstate: current_term: 3 leader_uuid: "4216bf0e7b174ad19465277997d74595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:20.174203 11577 raft_consensus.cc:1275] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 FOLLOWER]: Refusing update from remote peer 4216bf0e7b174ad19465277997d74595: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:20.175621 11867 consensus_queue.cc:1048] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:20.186396 11651 raft_consensus.cc:1275] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Refusing update from remote peer 4216bf0e7b174ad19465277997d74595: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:20.191236 11804 consensus_queue.cc:1048] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:20.504736 11577 raft_consensus.cc:1275] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Refusing update from remote peer 4216bf0e7b174ad19465277997d74595: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:20.506559 11804 consensus_queue.cc:1048] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:20.519286 11651 raft_consensus.cc:1275] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Refusing update from remote peer 4216bf0e7b174ad19465277997d74595: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:20.521844 11867 consensus_queue.cc:1048] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:20.530786 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:20.551765 11577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6fe30474f964ee6aeb9e40e79b9d588"
dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
mode: GRACEFUL
new_leader_uuid: "83f5882eabbe42bd99758b5455bae87d"
 from {username='slave'} at 127.0.0.1:48134
I20260709 13:02:20.552425 11577 raft_consensus.cc:606] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 LEADER]: Received request to transfer leadership to TS 83f5882eabbe42bd99758b5455bae87d
I20260709 13:02:20.559928 11726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d2f548451cc4108a5cbae2c2979f42e"
dest_uuid: "4216bf0e7b174ad19465277997d74595"
mode: GRACEFUL
new_leader_uuid: "83f5882eabbe42bd99758b5455bae87d"
 from {username='slave'} at 127.0.0.1:52986
I20260709 13:02:20.560537 11726 raft_consensus.cc:606] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [term 2 LEADER]: Received request to transfer leadership to TS 83f5882eabbe42bd99758b5455bae87d
I20260709 13:02:20.566726 11577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b537af1f78d42d5ae93c345152f3ce6"
dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
mode: GRACEFUL
new_leader_uuid: "83f5882eabbe42bd99758b5455bae87d"
 from {username='slave'} at 127.0.0.1:48134
I20260709 13:02:20.567464 11577 raft_consensus.cc:606] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 LEADER]: Received request to transfer leadership to TS 83f5882eabbe42bd99758b5455bae87d
I20260709 13:02:20.574625 11577 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73a3e05897bb4ca8867a12693c28e411"
dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
mode: GRACEFUL
new_leader_uuid: "83f5882eabbe42bd99758b5455bae87d"
 from {username='slave'} at 127.0.0.1:48134
I20260709 13:02:20.576052 11577 raft_consensus.cc:606] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 LEADER]: Received request to transfer leadership to TS 83f5882eabbe42bd99758b5455bae87d
I20260709 13:02:20.588918 11726 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df85684d549345889a4683e2df597ee2"
dest_uuid: "4216bf0e7b174ad19465277997d74595"
mode: GRACEFUL
new_leader_uuid: "83f5882eabbe42bd99758b5455bae87d"
 from {username='slave'} at 127.0.0.1:52986
I20260709 13:02:20.589877 11726 raft_consensus.cc:606] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 3 LEADER]: Received request to transfer leadership to TS 83f5882eabbe42bd99758b5455bae87d
I20260709 13:02:20.618964 11804 raft_consensus.cc:993] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595: : Instructing follower 83f5882eabbe42bd99758b5455bae87d to start an election
I20260709 13:02:20.619693 11804 raft_consensus.cc:1081] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [term 2 LEADER]: Signalling peer 83f5882eabbe42bd99758b5455bae87d to start an election
I20260709 13:02:20.622447 11651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d2f548451cc4108a5cbae2c2979f42e"
dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
 from {username='slave'} at 127.0.0.1:37362
I20260709 13:02:20.623067 11651 raft_consensus.cc:493] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:20.623435 11651 raft_consensus.cc:3060] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:20.625998 11886 raft_consensus.cc:993] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1: : Instructing follower 83f5882eabbe42bd99758b5455bae87d to start an election
I20260709 13:02:20.628796 11864 raft_consensus.cc:1081] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 LEADER]: Signalling peer 83f5882eabbe42bd99758b5455bae87d to start an election
I20260709 13:02:20.631116 11651 raft_consensus.cc:515] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:20.632499 11652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6fe30474f964ee6aeb9e40e79b9d588"
dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
 from {username='slave'} at 127.0.0.1:37364
I20260709 13:02:20.633399 11651 leader_election.cc:290] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [CANDIDATE]: Term 3 election: Requested vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999)
I20260709 13:02:20.636463 11652 raft_consensus.cc:493] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:20.636992 11652 raft_consensus.cc:3060] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:20.637421 11578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2f548451cc4108a5cbae2c2979f42e" candidate_uuid: "83f5882eabbe42bd99758b5455bae87d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
I20260709 13:02:20.638113 11578 raft_consensus.cc:3060] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:20.642762 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2f548451cc4108a5cbae2c2979f42e" candidate_uuid: "83f5882eabbe42bd99758b5455bae87d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4216bf0e7b174ad19465277997d74595"
I20260709 13:02:20.644363 11726 raft_consensus.cc:3055] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:20.645349 11726 raft_consensus.cc:740] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Running, Role: LEADER
I20260709 13:02:20.647074 11726 consensus_queue.cc:260] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:20.649052 11726 raft_consensus.cc:3060] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:20.649940 11578 raft_consensus.cc:2468] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83f5882eabbe42bd99758b5455bae87d in term 3.
I20260709 13:02:20.649963 11652 raft_consensus.cc:515] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:20.653855 11617 leader_election.cc:304] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83f5882eabbe42bd99758b5455bae87d, cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 
I20260709 13:02:20.654775 11876 raft_consensus.cc:2804] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:20.655278 11876 raft_consensus.cc:697] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [term 3 LEADER]: Becoming Leader. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Running, Role: LEADER
I20260709 13:02:20.656071 11876 consensus_queue.cc:237] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:20.659896 11726 raft_consensus.cc:2468] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83f5882eabbe42bd99758b5455bae87d in term 3.
I20260709 13:02:20.655881 11577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fe30474f964ee6aeb9e40e79b9d588" candidate_uuid: "83f5882eabbe42bd99758b5455bae87d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
I20260709 13:02:20.663108 11652 leader_election.cc:290] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [CANDIDATE]: Term 3 election: Requested vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999)
I20260709 13:02:20.664108 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fe30474f964ee6aeb9e40e79b9d588" candidate_uuid: "83f5882eabbe42bd99758b5455bae87d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4216bf0e7b174ad19465277997d74595"
I20260709 13:02:20.665251 11727 raft_consensus.cc:3060] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:20.660598 11577 raft_consensus.cc:3055] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:20.666574 11577 raft_consensus.cc:740] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cbf763ad32cd44f88e0cb7bb80a03be1, State: Running, Role: LEADER
I20260709 13:02:20.667824 11577 consensus_queue.cc:260] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:20.669262 11577 raft_consensus.cc:3060] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:20.670778 11472 catalog_manager.cc:5697] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d reported cstate change: term changed from 2 to 3, leader changed from 4216bf0e7b174ad19465277997d74595 (127.11.44.195) to 83f5882eabbe42bd99758b5455bae87d (127.11.44.194). New cstate: current_term: 3 leader_uuid: "83f5882eabbe42bd99758b5455bae87d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:20.674227 11727 raft_consensus.cc:2468] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83f5882eabbe42bd99758b5455bae87d in term 3.
I20260709 13:02:20.675431 11619 leader_election.cc:304] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, 83f5882eabbe42bd99758b5455bae87d; no voters: 
I20260709 13:02:20.676427 11876 raft_consensus.cc:2804] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:20.677457 11876 raft_consensus.cc:697] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [term 3 LEADER]: Becoming Leader. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Running, Role: LEADER
I20260709 13:02:20.678742 11876 consensus_queue.cc:237] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:20.681742 11577 raft_consensus.cc:2468] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83f5882eabbe42bd99758b5455bae87d in term 3.
I20260709 13:02:20.704108 11472 catalog_manager.cc:5697] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d reported cstate change: term changed from 2 to 3, leader changed from cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193) to 83f5882eabbe42bd99758b5455bae87d (127.11.44.194). New cstate: current_term: 3 leader_uuid: "83f5882eabbe42bd99758b5455bae87d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:20.800202 11887 raft_consensus.cc:993] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1: : Instructing follower 83f5882eabbe42bd99758b5455bae87d to start an election
I20260709 13:02:20.800658 11864 raft_consensus.cc:1081] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 LEADER]: Signalling peer 83f5882eabbe42bd99758b5455bae87d to start an election
I20260709 13:02:20.802676 11652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73a3e05897bb4ca8867a12693c28e411"
dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
 from {username='slave'} at 127.0.0.1:37364
I20260709 13:02:20.803193 11652 raft_consensus.cc:493] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:20.803514 11652 raft_consensus.cc:3060] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:20.808168 11652 raft_consensus.cc:515] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:20.811522 11652 leader_election.cc:290] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d [CANDIDATE]: Term 3 election: Requested vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999)
I20260709 13:02:20.811870 11577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a3e05897bb4ca8867a12693c28e411" candidate_uuid: "83f5882eabbe42bd99758b5455bae87d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
I20260709 13:02:20.812538 11577 raft_consensus.cc:3055] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:20.812885 11577 raft_consensus.cc:740] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cbf763ad32cd44f88e0cb7bb80a03be1, State: Running, Role: LEADER
I20260709 13:02:20.813146 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73a3e05897bb4ca8867a12693c28e411" candidate_uuid: "83f5882eabbe42bd99758b5455bae87d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4216bf0e7b174ad19465277997d74595"
I20260709 13:02:20.813934 11727 raft_consensus.cc:3060] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:20.813741 11577 consensus_queue.cc:260] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:20.815518 11577 raft_consensus.cc:3060] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:20.818645 11727 raft_consensus.cc:2468] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83f5882eabbe42bd99758b5455bae87d in term 3.
I20260709 13:02:20.820261 11619 leader_election.cc:304] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, 83f5882eabbe42bd99758b5455bae87d; no voters: 
I20260709 13:02:20.821427 11876 raft_consensus.cc:2804] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:20.821990 11876 raft_consensus.cc:697] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d [term 3 LEADER]: Becoming Leader. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Running, Role: LEADER
I20260709 13:02:20.822765 11876 consensus_queue.cc:237] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:20.824676 11577 raft_consensus.cc:2468] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83f5882eabbe42bd99758b5455bae87d in term 3.
I20260709 13:02:20.834415 11472 catalog_manager.cc:5697] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d reported cstate change: term changed from 2 to 3, leader changed from cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193) to 83f5882eabbe42bd99758b5455bae87d (127.11.44.194). New cstate: current_term: 3 leader_uuid: "83f5882eabbe42bd99758b5455bae87d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:20.921959 11887 raft_consensus.cc:993] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1: : Instructing follower 83f5882eabbe42bd99758b5455bae87d to start an election
I20260709 13:02:20.922426 11864 raft_consensus.cc:1081] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 LEADER]: Signalling peer 83f5882eabbe42bd99758b5455bae87d to start an election
I20260709 13:02:20.924072 11652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b537af1f78d42d5ae93c345152f3ce6"
dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
 from {username='slave'} at 127.0.0.1:37364
I20260709 13:02:20.924589 11652 raft_consensus.cc:493] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:20.924911 11652 raft_consensus.cc:3060] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:20.929689 11652 raft_consensus.cc:515] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:20.931375 11652 leader_election.cc:290] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [CANDIDATE]: Term 3 election: Requested vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999)
I20260709 13:02:20.932379 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b537af1f78d42d5ae93c345152f3ce6" candidate_uuid: "83f5882eabbe42bd99758b5455bae87d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4216bf0e7b174ad19465277997d74595"
I20260709 13:02:20.933168 11727 raft_consensus.cc:3060] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:20.932891 11577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b537af1f78d42d5ae93c345152f3ce6" candidate_uuid: "83f5882eabbe42bd99758b5455bae87d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
I20260709 13:02:20.934736 11577 raft_consensus.cc:3055] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:20.935105 11577 raft_consensus.cc:740] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cbf763ad32cd44f88e0cb7bb80a03be1, State: Running, Role: LEADER
I20260709 13:02:20.936044 11577 consensus_queue.cc:260] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:20.938122 11577 raft_consensus.cc:3060] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:20.939749 11727 raft_consensus.cc:2468] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83f5882eabbe42bd99758b5455bae87d in term 3.
I20260709 13:02:20.941238 11619 leader_election.cc:304] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, 83f5882eabbe42bd99758b5455bae87d; no voters: 
I20260709 13:02:20.942306 11876 raft_consensus.cc:2804] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:20.943107 11876 raft_consensus.cc:697] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [term 3 LEADER]: Becoming Leader. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Running, Role: LEADER
I20260709 13:02:20.943948 11876 consensus_queue.cc:237] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:20.946916 11577 raft_consensus.cc:2468] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83f5882eabbe42bd99758b5455bae87d in term 3.
I20260709 13:02:20.952468 11472 catalog_manager.cc:5697] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d reported cstate change: term changed from 2 to 3, leader changed from cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193) to 83f5882eabbe42bd99758b5455bae87d (127.11.44.194). New cstate: current_term: 3 leader_uuid: "83f5882eabbe42bd99758b5455bae87d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:21.032838 11880 raft_consensus.cc:993] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595: : Instructing follower 83f5882eabbe42bd99758b5455bae87d to start an election
I20260709 13:02:21.033294 11867 raft_consensus.cc:1081] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 3 LEADER]: Signalling peer 83f5882eabbe42bd99758b5455bae87d to start an election
I20260709 13:02:21.034875 11652 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df85684d549345889a4683e2df597ee2"
dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
 from {username='slave'} at 127.0.0.1:37362
I20260709 13:02:21.035408 11652 raft_consensus.cc:493] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:21.035799 11652 raft_consensus.cc:3060] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:21.040591 11652 raft_consensus.cc:515] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:21.042465 11652 leader_election.cc:290] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [CANDIDATE]: Term 4 election: Requested vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999)
I20260709 13:02:21.043550 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df85684d549345889a4683e2df597ee2" candidate_uuid: "83f5882eabbe42bd99758b5455bae87d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4216bf0e7b174ad19465277997d74595"
I20260709 13:02:21.043596 11577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df85684d549345889a4683e2df597ee2" candidate_uuid: "83f5882eabbe42bd99758b5455bae87d" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
I20260709 13:02:21.044286 11727 raft_consensus.cc:3055] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:21.044405 11577 raft_consensus.cc:3060] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:21.044613 11727 raft_consensus.cc:740] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Running, Role: LEADER
I20260709 13:02:21.045408 11727 consensus_queue.cc:260] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:21.046392 11727 raft_consensus.cc:3060] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:21.051076 11727 raft_consensus.cc:2468] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83f5882eabbe42bd99758b5455bae87d in term 4.
I20260709 13:02:21.052860 11619 leader_election.cc:304] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, 83f5882eabbe42bd99758b5455bae87d; no voters: 
I20260709 13:02:21.053336 11577 raft_consensus.cc:2468] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 83f5882eabbe42bd99758b5455bae87d in term 4.
I20260709 13:02:21.053704 11814 raft_consensus.cc:2804] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:21.061146 11577 raft_consensus.cc:1275] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Refusing update from remote peer 83f5882eabbe42bd99758b5455bae87d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:21.063311 11876 consensus_queue.cc:1048] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:21.076308 11814 raft_consensus.cc:697] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 4 LEADER]: Becoming Leader. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Running, Role: LEADER
I20260709 13:02:21.077436 11814 consensus_queue.cc:237] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:21.090739 11727 raft_consensus.cc:1275] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [term 3 FOLLOWER]: Refusing update from remote peer 83f5882eabbe42bd99758b5455bae87d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:21.095114 11577 raft_consensus.cc:1275] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Refusing update from remote peer 83f5882eabbe42bd99758b5455bae87d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:21.095211 11895 consensus_queue.cc:1048] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:21.096854 11894 consensus_queue.cc:1048] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:21.096210 11472 catalog_manager.cc:5697] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d reported cstate change: term changed from 3 to 4, leader changed from 4216bf0e7b174ad19465277997d74595 (127.11.44.195) to 83f5882eabbe42bd99758b5455bae87d (127.11.44.194). New cstate: current_term: 4 leader_uuid: "83f5882eabbe42bd99758b5455bae87d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:21.128772 11727 raft_consensus.cc:1275] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 3 FOLLOWER]: Refusing update from remote peer 83f5882eabbe42bd99758b5455bae87d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:21.130256 11894 consensus_queue.cc:1048] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:21.266907 11577 raft_consensus.cc:1275] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Refusing update from remote peer 83f5882eabbe42bd99758b5455bae87d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:21.268622 11894 consensus_queue.cc:1048] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:21.278590 11726 raft_consensus.cc:1275] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [term 3 FOLLOWER]: Refusing update from remote peer 83f5882eabbe42bd99758b5455bae87d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:21.281478 11894 consensus_queue.cc:1048] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:21.373162 11726 raft_consensus.cc:1275] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 3 FOLLOWER]: Refusing update from remote peer 83f5882eabbe42bd99758b5455bae87d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:21.374539 11814 consensus_queue.cc:1048] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:21.388810 11577 raft_consensus.cc:1275] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Refusing update from remote peer 83f5882eabbe42bd99758b5455bae87d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:21.391446 11894 consensus_queue.cc:1048] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:21.531260 11726 raft_consensus.cc:1275] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 4 FOLLOWER]: Refusing update from remote peer 83f5882eabbe42bd99758b5455bae87d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:21.532577 11894 consensus_queue.cc:1048] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:21.546877 11577 raft_consensus.cc:1275] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 4 FOLLOWER]: Refusing update from remote peer 83f5882eabbe42bd99758b5455bae87d: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:21.548753 11876 consensus_queue.cc:1048] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:23.604503 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:23.611975 11652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d2f548451cc4108a5cbae2c2979f42e"
dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
mode: GRACEFUL
new_leader_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
 from {username='slave'} at 127.0.0.1:37372
I20260709 13:02:23.612802 11652 raft_consensus.cc:606] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [term 3 LEADER]: Received request to transfer leadership to TS cbf763ad32cd44f88e0cb7bb80a03be1
I20260709 13:02:23.616101 11652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b537af1f78d42d5ae93c345152f3ce6"
dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
mode: GRACEFUL
new_leader_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
 from {username='slave'} at 127.0.0.1:37372
I20260709 13:02:23.616613 11652 raft_consensus.cc:606] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [term 3 LEADER]: Received request to transfer leadership to TS cbf763ad32cd44f88e0cb7bb80a03be1
I20260709 13:02:23.619189 11652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae411261bb914f5da14b72347967ca59"
dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
mode: GRACEFUL
new_leader_uuid: "4216bf0e7b174ad19465277997d74595"
 from {username='slave'} at 127.0.0.1:37372
I20260709 13:02:23.619695 11652 raft_consensus.cc:606] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [term 2 LEADER]: Received request to transfer leadership to TS 4216bf0e7b174ad19465277997d74595
I20260709 13:02:23.622385 11652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4dda2301e22449393d97a5ed6b1c906"
dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
mode: GRACEFUL
new_leader_uuid: "4216bf0e7b174ad19465277997d74595"
 from {username='slave'} at 127.0.0.1:37372
I20260709 13:02:23.622943 11652 raft_consensus.cc:606] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [term 2 LEADER]: Received request to transfer leadership to TS 4216bf0e7b174ad19465277997d74595
I20260709 13:02:23.625389 11652 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6fe30474f964ee6aeb9e40e79b9d588"
dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
mode: GRACEFUL
new_leader_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
 from {username='slave'} at 127.0.0.1:37372
I20260709 13:02:23.625901 11652 raft_consensus.cc:606] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [term 3 LEADER]: Received request to transfer leadership to TS cbf763ad32cd44f88e0cb7bb80a03be1
I20260709 13:02:23.627089 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:23.627629 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:23.670320 11814 raft_consensus.cc:993] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d: : Instructing follower 4216bf0e7b174ad19465277997d74595 to start an election
I20260709 13:02:23.670871 11909 raft_consensus.cc:1081] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [term 2 LEADER]: Signalling peer 4216bf0e7b174ad19465277997d74595 to start an election
I20260709 13:02:23.672636 11727 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae411261bb914f5da14b72347967ca59"
dest_uuid: "4216bf0e7b174ad19465277997d74595"
 from {username='slave'} at 127.0.0.1:52978
I20260709 13:02:23.673130 11727 raft_consensus.cc:493] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:23.673460 11727 raft_consensus.cc:3060] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:23.678954 11727 raft_consensus.cc:515] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:23.681475 11727 leader_election.cc:290] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 3 election: Requested vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159)
I20260709 13:02:23.682696 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae411261bb914f5da14b72347967ca59" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
I20260709 13:02:23.682471 11578 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae411261bb914f5da14b72347967ca59" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
I20260709 13:02:23.683615 11578 raft_consensus.cc:3060] T ae411261bb914f5da14b72347967ca59 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:23.683791 11814 raft_consensus.cc:993] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d: : Instructing follower cbf763ad32cd44f88e0cb7bb80a03be1 to start an election
I20260709 13:02:23.683552 11652 raft_consensus.cc:3055] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:23.684365 11814 raft_consensus.cc:1081] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [term 3 LEADER]: Signalling peer cbf763ad32cd44f88e0cb7bb80a03be1 to start an election
I20260709 13:02:23.684259 11652 raft_consensus.cc:740] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Running, Role: LEADER
I20260709 13:02:23.685292 11652 consensus_queue.cc:260] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:23.686234 11577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d2f548451cc4108a5cbae2c2979f42e"
dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
 from {username='slave'} at 127.0.0.1:48126
I20260709 13:02:23.686721 11652 raft_consensus.cc:3060] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:23.686743 11577 raft_consensus.cc:493] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:23.687326 11577 raft_consensus.cc:3060] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:23.689651 11578 raft_consensus.cc:2468] T ae411261bb914f5da14b72347967ca59 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 3.
I20260709 13:02:23.691200 11691 leader_election.cc:304] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 
I20260709 13:02:23.692241 11867 raft_consensus.cc:2804] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:23.693296 11867 raft_consensus.cc:697] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 3 LEADER]: Becoming Leader. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Running, Role: LEADER
I20260709 13:02:23.694546 11652 raft_consensus.cc:2468] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 3.
I20260709 13:02:23.694437 11867 consensus_queue.cc:237] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:23.696501 11577 raft_consensus.cc:515] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:23.699545 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2f548451cc4108a5cbae2c2979f42e" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
I20260709 13:02:23.700096 11577 leader_election.cc:290] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 4 election: Requested vote from peers 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159), 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999)
I20260709 13:02:23.700199 11652 raft_consensus.cc:3055] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:23.700510 11652 raft_consensus.cc:740] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Running, Role: LEADER
I20260709 13:02:23.699712 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d2f548451cc4108a5cbae2c2979f42e" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4216bf0e7b174ad19465277997d74595"
I20260709 13:02:23.701431 11652 consensus_queue.cc:260] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:23.702788 11652 raft_consensus.cc:3060] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:23.703464 11473 catalog_manager.cc:5697] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 reported cstate change: term changed from 2 to 3, leader changed from 83f5882eabbe42bd99758b5455bae87d (127.11.44.194) to 4216bf0e7b174ad19465277997d74595 (127.11.44.195). New cstate: current_term: 3 leader_uuid: "4216bf0e7b174ad19465277997d74595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:23.701164 11727 raft_consensus.cc:3060] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:23.709990 11652 raft_consensus.cc:2468] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf763ad32cd44f88e0cb7bb80a03be1 in term 4.
I20260709 13:02:23.711478 11727 raft_consensus.cc:2468] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf763ad32cd44f88e0cb7bb80a03be1 in term 4.
I20260709 13:02:23.711434 11541 leader_election.cc:304] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83f5882eabbe42bd99758b5455bae87d, cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 
I20260709 13:02:23.713858 11914 raft_consensus.cc:2804] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:23.715377 11914 raft_consensus.cc:697] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 4 LEADER]: Becoming Leader. State: Replica: cbf763ad32cd44f88e0cb7bb80a03be1, State: Running, Role: LEADER
I20260709 13:02:23.716697 11914 consensus_queue.cc:237] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:23.725478 11473 catalog_manager.cc:5697] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 reported cstate change: term changed from 3 to 4, leader changed from 83f5882eabbe42bd99758b5455bae87d (127.11.44.194) to cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193). New cstate: current_term: 4 leader_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:23.746068 11909 raft_consensus.cc:993] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d: : Instructing follower cbf763ad32cd44f88e0cb7bb80a03be1 to start an election
I20260709 13:02:23.746531 11814 raft_consensus.cc:1081] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [term 3 LEADER]: Signalling peer cbf763ad32cd44f88e0cb7bb80a03be1 to start an election
I20260709 13:02:23.747982 11577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b537af1f78d42d5ae93c345152f3ce6"
dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
 from {username='slave'} at 127.0.0.1:48126
I20260709 13:02:23.748375 11577 raft_consensus.cc:493] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:23.748596 11577 raft_consensus.cc:3060] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:23.753099 11577 raft_consensus.cc:515] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:23.754803 11577 leader_election.cc:290] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 4 election: Requested vote from peers 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159), 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999)
I20260709 13:02:23.755841 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b537af1f78d42d5ae93c345152f3ce6" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
I20260709 13:02:23.756139 11727 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b537af1f78d42d5ae93c345152f3ce6" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4216bf0e7b174ad19465277997d74595"
I20260709 13:02:23.756492 11652 raft_consensus.cc:3055] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:23.756749 11909 raft_consensus.cc:993] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d: : Instructing follower 4216bf0e7b174ad19465277997d74595 to start an election
I20260709 13:02:23.756701 11727 raft_consensus.cc:3060] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:23.756898 11652 raft_consensus.cc:740] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Running, Role: LEADER
I20260709 13:02:23.757449 11814 raft_consensus.cc:1081] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [term 2 LEADER]: Signalling peer 4216bf0e7b174ad19465277997d74595 to start an election
I20260709 13:02:23.757995 11652 consensus_queue.cc:260] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:23.759373 11652 raft_consensus.cc:3060] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:23.759444 11726 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4dda2301e22449393d97a5ed6b1c906"
dest_uuid: "4216bf0e7b174ad19465277997d74595"
 from {username='slave'} at 127.0.0.1:52978
I20260709 13:02:23.760201 11726 raft_consensus.cc:493] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:23.760454 11726 raft_consensus.cc:3060] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:23.764607 11727 raft_consensus.cc:2468] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf763ad32cd44f88e0cb7bb80a03be1 in term 4.
I20260709 13:02:23.766131 11544 leader_election.cc:304] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 
I20260709 13:02:23.765395 11726 raft_consensus.cc:515] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:23.767154 11652 raft_consensus.cc:2468] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf763ad32cd44f88e0cb7bb80a03be1 in term 4.
I20260709 13:02:23.767498 11914 raft_consensus.cc:2804] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:23.768437 11914 raft_consensus.cc:697] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 4 LEADER]: Becoming Leader. State: Replica: cbf763ad32cd44f88e0cb7bb80a03be1, State: Running, Role: LEADER
I20260709 13:02:23.769075 11577 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4dda2301e22449393d97a5ed6b1c906" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
I20260709 13:02:23.769209 11726 leader_election.cc:290] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 3 election: Requested vote from peers cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715), 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159)
I20260709 13:02:23.769755 11577 raft_consensus.cc:3060] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:23.769269 11914 consensus_queue.cc:237] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:23.770637 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4dda2301e22449393d97a5ed6b1c906" candidate_uuid: "4216bf0e7b174ad19465277997d74595" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
I20260709 13:02:23.771248 11652 raft_consensus.cc:3055] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:23.771651 11652 raft_consensus.cc:740] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Running, Role: LEADER
I20260709 13:02:23.772534 11652 consensus_queue.cc:260] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:23.773998 11652 raft_consensus.cc:3060] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:23.777324 11577 raft_consensus.cc:2468] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 3.
I20260709 13:02:23.777424 11473 catalog_manager.cc:5697] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 reported cstate change: term changed from 3 to 4, leader changed from 83f5882eabbe42bd99758b5455bae87d (127.11.44.194) to cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193). New cstate: current_term: 4 leader_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:23.778532 11691 leader_election.cc:304] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 
I20260709 13:02:23.779358 11867 raft_consensus.cc:2804] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:23.779806 11867 raft_consensus.cc:697] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 [term 3 LEADER]: Becoming Leader. State: Replica: 4216bf0e7b174ad19465277997d74595, State: Running, Role: LEADER
I20260709 13:02:23.780552 11867 consensus_queue.cc:237] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:23.782971 11652 raft_consensus.cc:2468] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4216bf0e7b174ad19465277997d74595 in term 3.
I20260709 13:02:23.788889 11472 catalog_manager.cc:5697] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 reported cstate change: term changed from 2 to 3, leader changed from 83f5882eabbe42bd99758b5455bae87d (127.11.44.194) to 4216bf0e7b174ad19465277997d74595 (127.11.44.195). New cstate: current_term: 3 leader_uuid: "4216bf0e7b174ad19465277997d74595" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:24.013919 11814 raft_consensus.cc:993] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d: : Instructing follower cbf763ad32cd44f88e0cb7bb80a03be1 to start an election
I20260709 13:02:24.014380 11909 raft_consensus.cc:1081] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [term 3 LEADER]: Signalling peer cbf763ad32cd44f88e0cb7bb80a03be1 to start an election
I20260709 13:02:24.015811 11577 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6fe30474f964ee6aeb9e40e79b9d588"
dest_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1"
 from {username='slave'} at 127.0.0.1:48126
I20260709 13:02:24.016270 11577 raft_consensus.cc:493] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:24.016561 11577 raft_consensus.cc:3060] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:24.020706 11577 raft_consensus.cc:515] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:24.022187 11577 leader_election.cc:290] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 4 election: Requested vote from peers 83f5882eabbe42bd99758b5455bae87d (127.11.44.194:42159), 4216bf0e7b174ad19465277997d74595 (127.11.44.195:42999)
I20260709 13:02:24.022964 11652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fe30474f964ee6aeb9e40e79b9d588" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "83f5882eabbe42bd99758b5455bae87d"
I20260709 13:02:24.023412 11726 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6fe30474f964ee6aeb9e40e79b9d588" candidate_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4216bf0e7b174ad19465277997d74595"
I20260709 13:02:24.023519 11652 raft_consensus.cc:3055] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:24.023861 11652 raft_consensus.cc:740] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 83f5882eabbe42bd99758b5455bae87d, State: Running, Role: LEADER
I20260709 13:02:24.023862 11726 raft_consensus.cc:3060] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:24.024688 11652 consensus_queue.cc:260] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:24.025629 11652 raft_consensus.cc:3060] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:24.028270 11726 raft_consensus.cc:2468] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf763ad32cd44f88e0cb7bb80a03be1 in term 4.
I20260709 13:02:24.029196 11544 leader_election.cc:304] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4216bf0e7b174ad19465277997d74595, cbf763ad32cd44f88e0cb7bb80a03be1; no voters: 
I20260709 13:02:24.030165 11914 raft_consensus.cc:2804] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:24.030618 11914 raft_consensus.cc:697] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 4 LEADER]: Becoming Leader. State: Replica: cbf763ad32cd44f88e0cb7bb80a03be1, State: Running, Role: LEADER
I20260709 13:02:24.030730 11652 raft_consensus.cc:2468] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cbf763ad32cd44f88e0cb7bb80a03be1 in term 4.
I20260709 13:02:24.031414 11914 consensus_queue.cc:237] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } }
I20260709 13:02:24.039137 11472 catalog_manager.cc:5697] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 reported cstate change: term changed from 3 to 4, leader changed from 83f5882eabbe42bd99758b5455bae87d (127.11.44.194) to cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193). New cstate: current_term: 4 leader_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:24.118815 11577 raft_consensus.cc:1275] T ae411261bb914f5da14b72347967ca59 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Refusing update from remote peer 4216bf0e7b174ad19465277997d74595: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:24.118815 11652 raft_consensus.cc:1275] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Refusing update from remote peer 4216bf0e7b174ad19465277997d74595: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:24.120509 11867 consensus_queue.cc:1048] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:24.121286 11911 consensus_queue.cc:1048] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:24.150979 11652 raft_consensus.cc:1275] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [term 4 FOLLOWER]: Refusing update from remote peer cbf763ad32cd44f88e0cb7bb80a03be1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:24.152343 11914 consensus_queue.cc:1048] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:24.162774 11726 raft_consensus.cc:1275] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 4 FOLLOWER]: Refusing update from remote peer cbf763ad32cd44f88e0cb7bb80a03be1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:24.164119 11914 consensus_queue.cc:1048] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:24.223387 11726 raft_consensus.cc:1275] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [term 4 FOLLOWER]: Refusing update from remote peer cbf763ad32cd44f88e0cb7bb80a03be1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:24.224716 11914 consensus_queue.cc:1048] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:24.234393 11652 raft_consensus.cc:1275] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [term 4 FOLLOWER]: Refusing update from remote peer cbf763ad32cd44f88e0cb7bb80a03be1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:24.235446 11651 raft_consensus.cc:1275] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Refusing update from remote peer 4216bf0e7b174ad19465277997d74595: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:24.236783 11932 consensus_queue.cc:1048] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:24.237166 11911 consensus_queue.cc:1048] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:24.251076 11577 raft_consensus.cc:1275] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Refusing update from remote peer 4216bf0e7b174ad19465277997d74595: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:24.252791 11927 consensus_queue.cc:1048] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cbf763ad32cd44f88e0cb7bb80a03be1" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40715 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:24.558563 11726 raft_consensus.cc:1275] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 4 FOLLOWER]: Refusing update from remote peer cbf763ad32cd44f88e0cb7bb80a03be1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:24.560096 11916 consensus_queue.cc:1048] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4216bf0e7b174ad19465277997d74595" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 42999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:24.570785 11652 raft_consensus.cc:1275] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [term 4 FOLLOWER]: Refusing update from remote peer cbf763ad32cd44f88e0cb7bb80a03be1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:24.572269 11932 consensus_queue.cc:1048] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "83f5882eabbe42bd99758b5455bae87d" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 42159 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:24.628551 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:24.634063 11443 tablet_server.cc:179] TabletServer@127.11.44.193:0 shutting down...
I20260709 13:02:24.661027 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:24.661955 11443 tablet_replica.cc:333] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1: stopping tablet replica
I20260709 13:02:24.662799 11443 raft_consensus.cc:2243] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:24.663341 11443 raft_consensus.cc:2272] T df85684d549345889a4683e2df597ee2 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:24.665738 11443 tablet_replica.cc:333] T ae411261bb914f5da14b72347967ca59 P cbf763ad32cd44f88e0cb7bb80a03be1: stopping tablet replica
I20260709 13:02:24.666451 11443 raft_consensus.cc:2243] T ae411261bb914f5da14b72347967ca59 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:24.666883 11443 raft_consensus.cc:2272] T ae411261bb914f5da14b72347967ca59 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:24.669405 11443 tablet_replica.cc:333] T ab061d0886a84dfca7fd6249f7454842 P cbf763ad32cd44f88e0cb7bb80a03be1: stopping tablet replica
I20260709 13:02:24.670203 11443 raft_consensus.cc:2243] T ab061d0886a84dfca7fd6249f7454842 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:24.670763 11443 raft_consensus.cc:2272] T ab061d0886a84dfca7fd6249f7454842 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:24.672603 11443 tablet_replica.cc:333] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1: stopping tablet replica
I20260709 13:02:24.673070 11443 raft_consensus.cc:2243] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:02:24.673870 11443 raft_consensus.cc:2272] T 6b537af1f78d42d5ae93c345152f3ce6 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:24.676069 11443 tablet_replica.cc:333] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1: stopping tablet replica
I20260709 13:02:24.677035 11443 raft_consensus.cc:2243] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:24.677753 11443 raft_consensus.cc:2272] T 73a3e05897bb4ca8867a12693c28e411 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:24.679615 11443 tablet_replica.cc:333] T b8d4ca4c2f8645e3ac10467b750bcad9 P cbf763ad32cd44f88e0cb7bb80a03be1: stopping tablet replica
I20260709 13:02:24.680117 11443 raft_consensus.cc:2243] T b8d4ca4c2f8645e3ac10467b750bcad9 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:24.680706 11443 raft_consensus.cc:2272] T b8d4ca4c2f8645e3ac10467b750bcad9 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:24.682789 11443 tablet_replica.cc:333] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1: stopping tablet replica
I20260709 13:02:24.683257 11443 raft_consensus.cc:2243] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:02:24.683993 11443 raft_consensus.cc:2272] T 2d2f548451cc4108a5cbae2c2979f42e P cbf763ad32cd44f88e0cb7bb80a03be1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:24.686640 11443 tablet_replica.cc:333] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1: stopping tablet replica
I20260709 13:02:24.687528 11443 raft_consensus.cc:2243] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:24.688071 11443 raft_consensus.cc:2272] T b4dda2301e22449393d97a5ed6b1c906 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:24.690992 11443 tablet_replica.cc:333] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1: stopping tablet replica
I20260709 13:02:24.691452 11443 raft_consensus.cc:2243] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:02:24.692158 11443 raft_consensus.cc:2272] T e6fe30474f964ee6aeb9e40e79b9d588 P cbf763ad32cd44f88e0cb7bb80a03be1 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:24.881428 11691 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.44.193:40715: connect: Connection refused (error 111)
I20260709 13:02:24.882977 11443 tablet_server.cc:196] TabletServer@127.11.44.193:0 shutdown complete.
W20260709 13:02:24.885710 11691 consensus_peers.cc:597] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 -> Peer cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715): Couldn't send request to peer cbf763ad32cd44f88e0cb7bb80a03be1. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:40715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:24.888760 11617 consensus_peers.cc:597] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d -> Peer cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715): Couldn't send request to peer cbf763ad32cd44f88e0cb7bb80a03be1. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:40715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:24.889204 11617 consensus_peers.cc:597] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d -> Peer cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715): Couldn't send request to peer cbf763ad32cd44f88e0cb7bb80a03be1. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:40715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:24.889693 11617 consensus_peers.cc:597] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d -> Peer cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715): Couldn't send request to peer cbf763ad32cd44f88e0cb7bb80a03be1. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:40715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:24.902963 11691 consensus_peers.cc:597] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 -> Peer cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715): Couldn't send request to peer cbf763ad32cd44f88e0cb7bb80a03be1. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:40715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:24.907510 11443 tablet_server.cc:179] TabletServer@127.11.44.194:0 shutting down...
I20260709 13:02:24.934262 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:24.935111 11443 tablet_replica.cc:333] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d: stopping tablet replica
I20260709 13:02:24.935778 11443 raft_consensus.cc:2243] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:24.936195 11443 raft_consensus.cc:2272] T 6b537af1f78d42d5ae93c345152f3ce6 P 83f5882eabbe42bd99758b5455bae87d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:24.938423 11443 tablet_replica.cc:333] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d: stopping tablet replica
I20260709 13:02:24.938953 11443 raft_consensus.cc:2243] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:02:24.939702 11443 raft_consensus.cc:2272] T df85684d549345889a4683e2df597ee2 P 83f5882eabbe42bd99758b5455bae87d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:24.941427 11443 tablet_replica.cc:333] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d: stopping tablet replica
I20260709 13:02:24.941987 11443 raft_consensus.cc:2243] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:24.942384 11443 raft_consensus.cc:2272] T ae411261bb914f5da14b72347967ca59 P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:24.944212 11443 tablet_replica.cc:333] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d: stopping tablet replica
I20260709 13:02:24.944689 11443 raft_consensus.cc:2243] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:24.945416 11443 raft_consensus.cc:2272] T ab061d0886a84dfca7fd6249f7454842 P 83f5882eabbe42bd99758b5455bae87d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:24.947033 11443 tablet_replica.cc:333] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d: stopping tablet replica
I20260709 13:02:24.947489 11443 raft_consensus.cc:2243] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:24.947854 11443 raft_consensus.cc:2272] T 2d2f548451cc4108a5cbae2c2979f42e P 83f5882eabbe42bd99758b5455bae87d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:24.949914 11443 tablet_replica.cc:333] T b8d4ca4c2f8645e3ac10467b750bcad9 P 83f5882eabbe42bd99758b5455bae87d: stopping tablet replica
I20260709 13:02:24.950424 11443 raft_consensus.cc:2243] T b8d4ca4c2f8645e3ac10467b750bcad9 P 83f5882eabbe42bd99758b5455bae87d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:24.950809 11443 raft_consensus.cc:2272] T b8d4ca4c2f8645e3ac10467b750bcad9 P 83f5882eabbe42bd99758b5455bae87d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:24.952632 11443 tablet_replica.cc:333] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d: stopping tablet replica
I20260709 13:02:24.953161 11443 raft_consensus.cc:2243] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:24.953997 11443 raft_consensus.cc:2272] T 73a3e05897bb4ca8867a12693c28e411 P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:24.955766 11443 tablet_replica.cc:333] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d: stopping tablet replica
I20260709 13:02:24.956225 11443 raft_consensus.cc:2243] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:24.956606 11443 raft_consensus.cc:2272] T b4dda2301e22449393d97a5ed6b1c906 P 83f5882eabbe42bd99758b5455bae87d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:24.958606 11443 tablet_replica.cc:333] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d: stopping tablet replica
I20260709 13:02:24.959059 11443 raft_consensus.cc:2243] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:24.959437 11443 raft_consensus.cc:2272] T e6fe30474f964ee6aeb9e40e79b9d588 P 83f5882eabbe42bd99758b5455bae87d [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:24.989136 11443 tablet_server.cc:196] TabletServer@127.11.44.194:0 shutdown complete.
W20260709 13:02:24.992228 11691 consensus_peers.cc:597] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 -> Peer cbf763ad32cd44f88e0cb7bb80a03be1 (127.11.44.193:40715): Couldn't send request to peer cbf763ad32cd44f88e0cb7bb80a03be1. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:40715: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:25.007254 11443 tablet_server.cc:179] TabletServer@127.11.44.195:0 shutting down...
I20260709 13:02:25.030113 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:25.030855 11443 tablet_replica.cc:333] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595: stopping tablet replica
I20260709 13:02:25.031450 11443 raft_consensus.cc:2243] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.032198 11443 raft_consensus.cc:2272] T b4dda2301e22449393d97a5ed6b1c906 P 4216bf0e7b174ad19465277997d74595 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.034739 11443 tablet_replica.cc:333] T ab061d0886a84dfca7fd6249f7454842 P 4216bf0e7b174ad19465277997d74595: stopping tablet replica
I20260709 13:02:25.035342 11443 raft_consensus.cc:2243] T ab061d0886a84dfca7fd6249f7454842 P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.035887 11443 raft_consensus.cc:2272] T ab061d0886a84dfca7fd6249f7454842 P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.037662 11443 tablet_replica.cc:333] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595: stopping tablet replica
I20260709 13:02:25.038168 11443 raft_consensus.cc:2243] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.038875 11443 raft_consensus.cc:2272] T ae411261bb914f5da14b72347967ca59 P 4216bf0e7b174ad19465277997d74595 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.041082 11443 tablet_replica.cc:333] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595: stopping tablet replica
I20260709 13:02:25.041641 11443 raft_consensus.cc:2243] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.042137 11443 raft_consensus.cc:2272] T 6b537af1f78d42d5ae93c345152f3ce6 P 4216bf0e7b174ad19465277997d74595 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.044198 11443 tablet_replica.cc:333] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595: stopping tablet replica
I20260709 13:02:25.044670 11443 raft_consensus.cc:2243] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.045373 11443 raft_consensus.cc:2272] T b8d4ca4c2f8645e3ac10467b750bcad9 P 4216bf0e7b174ad19465277997d74595 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.047115 11443 tablet_replica.cc:333] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595: stopping tablet replica
I20260709 13:02:25.047596 11443 raft_consensus.cc:2243] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.048028 11443 raft_consensus.cc:2272] T 73a3e05897bb4ca8867a12693c28e411 P 4216bf0e7b174ad19465277997d74595 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.050365 11443 tablet_replica.cc:333] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595: stopping tablet replica
I20260709 13:02:25.050899 11443 raft_consensus.cc:2243] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.051353 11443 raft_consensus.cc:2272] T 2d2f548451cc4108a5cbae2c2979f42e P 4216bf0e7b174ad19465277997d74595 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.053464 11443 tablet_replica.cc:333] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595: stopping tablet replica
I20260709 13:02:25.054286 11443 raft_consensus.cc:2243] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.054764 11443 raft_consensus.cc:2272] T df85684d549345889a4683e2df597ee2 P 4216bf0e7b174ad19465277997d74595 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.056382 11443 tablet_replica.cc:333] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595: stopping tablet replica
I20260709 13:02:25.056838 11443 raft_consensus.cc:2243] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:25.057283 11443 raft_consensus.cc:2272] T e6fe30474f964ee6aeb9e40e79b9d588 P 4216bf0e7b174ad19465277997d74595 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.085902 11443 tablet_server.cc:196] TabletServer@127.11.44.195:0 shutdown complete.
I20260709 13:02:25.103221 11443 master.cc:562] Master@127.11.44.254:43963 shutting down...
I20260709 13:02:25.256247 11443 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:25.256841 11443 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:25.257180 11443 tablet_replica.cc:333] T 00000000000000000000000000000000 P 26781ffade4d4d92b529d633bff43b49: stopping tablet replica
I20260709 13:02:25.293816 11443 master.cc:584] Master@127.11.44.254:43963 shutdown complete.
4216bf0e7b174ad19465277997d74595  1
83f5882eabbe42bd99758b5455bae87d  4
cbf763ad32cd44f88e0cb7bb80a03be1  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12951 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:02:25.337670 11443 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.44.254:43091
I20260709 13:02:25.338896 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:25.345253 11943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:25.345268 11942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:25.345923 11443 server_base.cc:1061] running on GCE node
W20260709 13:02:25.345391 11945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:25.347045 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:25.347223 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:25.347342 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602145347332 us; error 0 us; skew 500 ppm
I20260709 13:02:25.347796 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:25.350560 11443 webserver.cc:533] Webserver started at http://127.11.44.254:37105/ using document root <none> and password file <none>
I20260709 13:02:25.351028 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:25.351188 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:25.351418 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:25.352535 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132206461-11443-0/minicluster-data/master-0-root/instance:
uuid: "8228c1ca674648ec8fc8de83315fd9fd"
format_stamp: "Formatted at 2026-07-09 13:02:25 on dist-test-slave-qv7r"
I20260709 13:02:25.357075 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:02:25.360774 11950 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:25.361845 11443 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:02:25.362157 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132206461-11443-0/minicluster-data/master-0-root
uuid: "8228c1ca674648ec8fc8de83315fd9fd"
format_stamp: "Formatted at 2026-07-09 13:02:25 on dist-test-slave-qv7r"
I20260709 13:02:25.362447 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132206461-11443-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132206461-11443-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132206461-11443-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:25.372855 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:25.374243 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:25.413538 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.254:43091
I20260709 13:02:25.413682 12001 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.254:43091 every 8 connection(s)
I20260709 13:02:25.417593 12002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:25.426980 12002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd: Bootstrap starting.
I20260709 13:02:25.431551 12002 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:25.436021 12002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd: No bootstrap required, opened a new log
I20260709 13:02:25.438088 12002 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8228c1ca674648ec8fc8de83315fd9fd" member_type: VOTER }
I20260709 13:02:25.438459 12002 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:25.438635 12002 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8228c1ca674648ec8fc8de83315fd9fd, State: Initialized, Role: FOLLOWER
I20260709 13:02:25.439122 12002 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8228c1ca674648ec8fc8de83315fd9fd" member_type: VOTER }
I20260709 13:02:25.439520 12002 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:25.439703 12002 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:25.439917 12002 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:25.443750 12002 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8228c1ca674648ec8fc8de83315fd9fd" member_type: VOTER }
I20260709 13:02:25.444242 12002 leader_election.cc:304] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8228c1ca674648ec8fc8de83315fd9fd; no voters: 
I20260709 13:02:25.445399 12002 leader_election.cc:290] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:25.445760 12005 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:25.447233 12005 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd [term 1 LEADER]: Becoming Leader. State: Replica: 8228c1ca674648ec8fc8de83315fd9fd, State: Running, Role: LEADER
I20260709 13:02:25.447947 12005 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8228c1ca674648ec8fc8de83315fd9fd" member_type: VOTER }
I20260709 13:02:25.448807 12002 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:25.452966 12007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8228c1ca674648ec8fc8de83315fd9fd. Latest consensus state: current_term: 1 leader_uuid: "8228c1ca674648ec8fc8de83315fd9fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8228c1ca674648ec8fc8de83315fd9fd" member_type: VOTER } }
I20260709 13:02:25.453727 12007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:25.454670 12006 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8228c1ca674648ec8fc8de83315fd9fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8228c1ca674648ec8fc8de83315fd9fd" member_type: VOTER } }
I20260709 13:02:25.455480 12006 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:25.457796 12012 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:25.463778 12012 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:25.465941 11443 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:25.473261 12012 catalog_manager.cc:1383] Generated new cluster ID: b0ae79c3c3f747c49e3326ba3e685c5d
I20260709 13:02:25.473729 12012 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:25.486858 12012 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:25.488231 12012 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:25.502281 12012 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd: Generated new TSK 0
I20260709 13:02:25.503053 12012 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:25.533432 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:25.540514 12023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:25.540611 12024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:25.542042 12026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:25.542196 11443 server_base.cc:1061] running on GCE node
I20260709 13:02:25.543247 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:25.543464 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:25.543649 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602145543633 us; error 0 us; skew 500 ppm
I20260709 13:02:25.544169 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:25.546765 11443 webserver.cc:533] Webserver started at http://127.11.44.193:34373/ using document root <none> and password file <none>
I20260709 13:02:25.547259 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:25.547474 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:25.547742 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:25.548837 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132206461-11443-0/minicluster-data/ts-0-root/instance:
uuid: "bc350fb650c74e8696ea2aae28d8a753"
format_stamp: "Formatted at 2026-07-09 13:02:25 on dist-test-slave-qv7r"
I20260709 13:02:25.553406 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:02:25.556946 12031 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:25.557938 11443 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:25.558246 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132206461-11443-0/minicluster-data/ts-0-root
uuid: "bc350fb650c74e8696ea2aae28d8a753"
format_stamp: "Formatted at 2026-07-09 13:02:25 on dist-test-slave-qv7r"
I20260709 13:02:25.558571 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132206461-11443-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132206461-11443-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132206461-11443-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:25.583184 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:25.584491 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:25.586588 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:25.589277 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:25.589686 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:02:25.589956 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:25.590324 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:25.634639 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.193:40115
I20260709 13:02:25.634768 12093 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.193:40115 every 8 connection(s)
I20260709 13:02:25.639721 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:25.647837 12099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:25.647935 12098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:25.651064 12101 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:25.651808 11443 server_base.cc:1061] running on GCE node
I20260709 13:02:25.652909 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:25.653151 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:25.653337 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602145653323 us; error 0 us; skew 500 ppm
I20260709 13:02:25.653898 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:25.656505 11443 webserver.cc:533] Webserver started at http://127.11.44.194:33053/ using document root <none> and password file <none>
I20260709 13:02:25.657101 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:25.657358 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:25.657719 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:25.659119 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132206461-11443-0/minicluster-data/ts-1-root/instance:
uuid: "aeb8ce119f6745168cdf20d825ab6d94"
format_stamp: "Formatted at 2026-07-09 13:02:25 on dist-test-slave-qv7r"
I20260709 13:02:25.659691 12094 heartbeater.cc:344] Connected to a master server at 127.11.44.254:43091
I20260709 13:02:25.660053 12094 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:25.660921 12094 heartbeater.cc:507] Master 127.11.44.254:43091 requested a full tablet report, sending...
I20260709 13:02:25.662952 11967 ts_manager.cc:194] Registered new tserver with Master: bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115)
I20260709 13:02:25.664309 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:02:25.664899 11967 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45232
I20260709 13:02:25.669351 12106 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:25.670462 11443 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:02:25.670871 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132206461-11443-0/minicluster-data/ts-1-root
uuid: "aeb8ce119f6745168cdf20d825ab6d94"
format_stamp: "Formatted at 2026-07-09 13:02:25 on dist-test-slave-qv7r"
I20260709 13:02:25.671146 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132206461-11443-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132206461-11443-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132206461-11443-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:25.694044 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:25.695278 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:25.696754 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:25.698977 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:25.699225 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:25.699463 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:25.699637 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:25.747787 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.194:44163
I20260709 13:02:25.747913 12168 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.194:44163 every 8 connection(s)
I20260709 13:02:25.752867 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:25.761173 12173 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:25.761350 12172 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:25.764873 12175 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:25.765794 11443 server_base.cc:1061] running on GCE node
I20260709 13:02:25.767103 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:25.767395 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:25.767572 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602145767560 us; error 0 us; skew 500 ppm
I20260709 13:02:25.768213 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:25.768177 12169 heartbeater.cc:344] Connected to a master server at 127.11.44.254:43091
I20260709 13:02:25.768872 12169 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:25.769843 12169 heartbeater.cc:507] Master 127.11.44.254:43091 requested a full tablet report, sending...
I20260709 13:02:25.771265 11443 webserver.cc:533] Webserver started at http://127.11.44.195:42175/ using document root <none> and password file <none>
I20260709 13:02:25.771931 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:25.772166 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:25.772246 11967 ts_manager.cc:194] Registered new tserver with Master: aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163)
I20260709 13:02:25.772513 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:25.774053 11967 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45244
I20260709 13:02:25.774085 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132206461-11443-0/minicluster-data/ts-2-root/instance:
uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
format_stamp: "Formatted at 2026-07-09 13:02:25 on dist-test-slave-qv7r"
I20260709 13:02:25.779733 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:25.783280 12180 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:25.784271 11443 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 13:02:25.784607 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132206461-11443-0/minicluster-data/ts-2-root
uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
format_stamp: "Formatted at 2026-07-09 13:02:25 on dist-test-slave-qv7r"
I20260709 13:02:25.784912 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132206461-11443-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132206461-11443-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602132206461-11443-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:25.803800 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:25.804972 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:25.806529 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:25.808890 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:25.809142 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:25.809388 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:25.809566 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:25.852969 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.195:40353
I20260709 13:02:25.853116 12242 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.195:40353 every 8 connection(s)
I20260709 13:02:25.870445 12243 heartbeater.cc:344] Connected to a master server at 127.11.44.254:43091
I20260709 13:02:25.870988 12243 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:25.871795 12243 heartbeater.cc:507] Master 127.11.44.254:43091 requested a full tablet report, sending...
I20260709 13:02:25.873930 11967 ts_manager.cc:194] Registered new tserver with Master: 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:25.874517 11443 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.018169307s
I20260709 13:02:25.875658 11967 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45254
I20260709 13:02:25.904441 11967 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45264:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:25.907502 11967 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:25.978304 12208 tablet_service.cc:1511] Processing CreateTablet for tablet ab463b4fae464214b1a0f42acba1d16b (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:02:25.979907 12208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab463b4fae464214b1a0f42acba1d16b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:25.985965 12207 tablet_service.cc:1511] Processing CreateTablet for tablet f1abeea0e34944a5a483d23409d4e963 (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:02:25.987557 12207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1abeea0e34944a5a483d23409d4e963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:25.991669 12206 tablet_service.cc:1511] Processing CreateTablet for tablet f4d15850c4a34c10b3c309fff1dc30b8 (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:02:25.993475 12206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d15850c4a34c10b3c309fff1dc30b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:25.995507 12059 tablet_service.cc:1511] Processing CreateTablet for tablet ab463b4fae464214b1a0f42acba1d16b (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:02:25.997022 12059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab463b4fae464214b1a0f42acba1d16b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:25.997648 12056 tablet_service.cc:1511] Processing CreateTablet for tablet 4571992e2e3943b091d962f680812086 (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:02:25.999058 12056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4571992e2e3943b091d962f680812086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:25.998812 12058 tablet_service.cc:1511] Processing CreateTablet for tablet f1abeea0e34944a5a483d23409d4e963 (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:02:26.000129 12058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1abeea0e34944a5a483d23409d4e963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.002789 12057 tablet_service.cc:1511] Processing CreateTablet for tablet f4d15850c4a34c10b3c309fff1dc30b8 (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:02:26.004169 12057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d15850c4a34c10b3c309fff1dc30b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.013056 12134 tablet_service.cc:1511] Processing CreateTablet for tablet ab463b4fae464214b1a0f42acba1d16b (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:02:26.015909 12134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab463b4fae464214b1a0f42acba1d16b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.018929 12133 tablet_service.cc:1511] Processing CreateTablet for tablet f1abeea0e34944a5a483d23409d4e963 (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:02:26.020504 12133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1abeea0e34944a5a483d23409d4e963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.022811 12132 tablet_service.cc:1511] Processing CreateTablet for tablet f4d15850c4a34c10b3c309fff1dc30b8 (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:02:26.023128 12205 tablet_service.cc:1511] Processing CreateTablet for tablet 4571992e2e3943b091d962f680812086 (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:02:26.024501 12205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4571992e2e3943b091d962f680812086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.025640 12131 tablet_service.cc:1511] Processing CreateTablet for tablet 4571992e2e3943b091d962f680812086 (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:02:26.028548 12204 tablet_service.cc:1511] Processing CreateTablet for tablet 1e6a832558da4cd2895591a547ff6c11 (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:02:26.029831 12055 tablet_service.cc:1511] Processing CreateTablet for tablet 1e6a832558da4cd2895591a547ff6c11 (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:02:26.031176 12055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e6a832558da4cd2895591a547ff6c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.031919 12203 tablet_service.cc:1511] Processing CreateTablet for tablet 4f17c2df097349819756cac635ed58fc (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:02:26.033257 12203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f17c2df097349819756cac635ed58fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.034786 12054 tablet_service.cc:1511] Processing CreateTablet for tablet 4f17c2df097349819756cac635ed58fc (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:02:26.036208 12054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f17c2df097349819756cac635ed58fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.039233 12202 tablet_service.cc:1511] Processing CreateTablet for tablet de1e688e3be741f9bbec4ef43ab84b01 (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:02:26.039736 12056 tablet_service.cc:1511] Processing CreateTablet for tablet de1e688e3be741f9bbec4ef43ab84b01 (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:02:26.040643 12202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de1e688e3be741f9bbec4ef43ab84b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.040980 12056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de1e688e3be741f9bbec4ef43ab84b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.041117 12053 tablet_service.cc:1511] Processing CreateTablet for tablet 0872387060684098a1fbe3e1f23a0c8d (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:02:26.041997 12204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e6a832558da4cd2895591a547ff6c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.042496 12053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0872387060684098a1fbe3e1f23a0c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.048427 12201 tablet_service.cc:1511] Processing CreateTablet for tablet 0872387060684098a1fbe3e1f23a0c8d (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:02:26.050592 12201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0872387060684098a1fbe3e1f23a0c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.050742 12200 tablet_service.cc:1511] Processing CreateTablet for tablet 77ce751ee8a74f3fb9e788ff82aa6e64 (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:02:26.052175 12052 tablet_service.cc:1511] Processing CreateTablet for tablet 77ce751ee8a74f3fb9e788ff82aa6e64 (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:02:26.054060 12200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ce751ee8a74f3fb9e788ff82aa6e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.055701 12051 tablet_service.cc:1511] Processing CreateTablet for tablet 36c91f4f816446e592ed36b65caeb73f (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:02:26.054137 12052 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ce751ee8a74f3fb9e788ff82aa6e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.062435 12132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4d15850c4a34c10b3c309fff1dc30b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.063233 12199 tablet_service.cc:1511] Processing CreateTablet for tablet 36c91f4f816446e592ed36b65caeb73f (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:02:26.067132 12129 tablet_service.cc:1511] Processing CreateTablet for tablet 4f17c2df097349819756cac635ed58fc (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:02:26.068544 12129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f17c2df097349819756cac635ed58fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.069983 12131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4571992e2e3943b091d962f680812086. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.071239 12128 tablet_service.cc:1511] Processing CreateTablet for tablet de1e688e3be741f9bbec4ef43ab84b01 (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:02:26.072595 12128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de1e688e3be741f9bbec4ef43ab84b01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.073766 12051 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c91f4f816446e592ed36b65caeb73f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.073683 12130 tablet_service.cc:1511] Processing CreateTablet for tablet 1e6a832558da4cd2895591a547ff6c11 (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:02:26.075064 12130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e6a832558da4cd2895591a547ff6c11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.086153 12199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c91f4f816446e592ed36b65caeb73f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.093357 12127 tablet_service.cc:1511] Processing CreateTablet for tablet 0872387060684098a1fbe3e1f23a0c8d (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:02:26.093768 12126 tablet_service.cc:1511] Processing CreateTablet for tablet 77ce751ee8a74f3fb9e788ff82aa6e64 (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:02:26.094904 12127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0872387060684098a1fbe3e1f23a0c8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.096185 12125 tablet_service.cc:1511] Processing CreateTablet for tablet 36c91f4f816446e592ed36b65caeb73f (DEFAULT_TABLE table=test-workload [id=8c71ab2606f54036ba68727b71e93dfa]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:02:26.102357 12125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c91f4f816446e592ed36b65caeb73f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.106330 12126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77ce751ee8a74f3fb9e788ff82aa6e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:26.176620 12259 tablet_bootstrap.cc:492] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94: Bootstrap starting.
I20260709 13:02:26.195618 12258 tablet_bootstrap.cc:492] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753: Bootstrap starting.
I20260709 13:02:26.205782 12259 tablet_bootstrap.cc:654] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.211637 12258 tablet_bootstrap.cc:654] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.219933 12260 tablet_bootstrap.cc:492] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634: Bootstrap starting.
I20260709 13:02:26.228343 12258 tablet_bootstrap.cc:492] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753: No bootstrap required, opened a new log
I20260709 13:02:26.228773 12259 tablet_bootstrap.cc:492] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94: No bootstrap required, opened a new log
I20260709 13:02:26.228865 12258 ts_tablet_manager.cc:1403] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.007s
I20260709 13:02:26.229236 12259 ts_tablet_manager.cc:1403] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94: Time spent bootstrapping tablet: real 0.053s	user 0.006s	sys 0.008s
I20260709 13:02:26.229621 12260 tablet_bootstrap.cc:654] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.231500 12259 raft_consensus.cc:359] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.232079 12259 raft_consensus.cc:385] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.231961 12258 raft_consensus.cc:359] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.232584 12259 raft_consensus.cc:740] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aeb8ce119f6745168cdf20d825ab6d94, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.232996 12258 raft_consensus.cc:385] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.233424 12258 raft_consensus.cc:740] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.233842 12259 consensus_queue.cc:260] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.234328 12258 consensus_queue.cc:260] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.236166 12260 tablet_bootstrap.cc:492] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634: No bootstrap required, opened a new log
I20260709 13:02:26.236234 12169 heartbeater.cc:499] Master 127.11.44.254:43091 was elected leader, sending a full tablet report...
I20260709 13:02:26.236874 12259 ts_tablet_manager.cc:1434] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:26.236860 12260 ts_tablet_manager.cc:1403] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.005s
I20260709 13:02:26.238050 12259 tablet_bootstrap.cc:492] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94: Bootstrap starting.
I20260709 13:02:26.241231 12260 raft_consensus.cc:359] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } } peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } }
I20260709 13:02:26.242256 12260 raft_consensus.cc:385] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.242628 12260 raft_consensus.cc:740] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0291cd32b58e4e28a40b13ff1b8c9634, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.244355 12259 tablet_bootstrap.cc:654] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.243765 12260 consensus_queue.cc:260] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } } peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } }
I20260709 13:02:26.246733 12094 heartbeater.cc:499] Master 127.11.44.254:43091 was elected leader, sending a full tablet report...
I20260709 13:02:26.247233 12258 ts_tablet_manager.cc:1434] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753: Time spent starting tablet: real 0.018s	user 0.015s	sys 0.004s
I20260709 13:02:26.248142 12258 tablet_bootstrap.cc:492] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753: Bootstrap starting.
I20260709 13:02:26.254812 12258 tablet_bootstrap.cc:654] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.260736 12260 ts_tablet_manager.cc:1434] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.006s
I20260709 13:02:26.261755 12243 heartbeater.cc:499] Master 127.11.44.254:43091 was elected leader, sending a full tablet report...
I20260709 13:02:26.275538 12259 tablet_bootstrap.cc:492] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94: No bootstrap required, opened a new log
I20260709 13:02:26.276063 12260 tablet_bootstrap.cc:492] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634: Bootstrap starting.
I20260709 13:02:26.276130 12259 ts_tablet_manager.cc:1403] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.021s
I20260709 13:02:26.282862 12259 raft_consensus.cc:359] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.283483 12259 raft_consensus.cc:385] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.283728 12259 raft_consensus.cc:740] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aeb8ce119f6745168cdf20d825ab6d94, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.284384 12259 consensus_queue.cc:260] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.286258 12259 ts_tablet_manager.cc:1434] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:26.287210 12259 tablet_bootstrap.cc:492] T f4d15850c4a34c10b3c309fff1dc30b8 P aeb8ce119f6745168cdf20d825ab6d94: Bootstrap starting.
I20260709 13:02:26.288514 12258 tablet_bootstrap.cc:492] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753: No bootstrap required, opened a new log
I20260709 13:02:26.289009 12258 ts_tablet_manager.cc:1403] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.023s
I20260709 13:02:26.291486 12258 raft_consensus.cc:359] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.292027 12258 raft_consensus.cc:385] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.292286 12258 raft_consensus.cc:740] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.292484 12259 tablet_bootstrap.cc:654] T f4d15850c4a34c10b3c309fff1dc30b8 P aeb8ce119f6745168cdf20d825ab6d94: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.293071 12258 consensus_queue.cc:260] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.295083 12258 ts_tablet_manager.cc:1434] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:26.295368 12260 tablet_bootstrap.cc:654] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.296010 12258 tablet_bootstrap.cc:492] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753: Bootstrap starting.
I20260709 13:02:26.303822 12258 tablet_bootstrap.cc:654] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.316006 12258 tablet_bootstrap.cc:492] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753: No bootstrap required, opened a new log
I20260709 13:02:26.316531 12258 ts_tablet_manager.cc:1403] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.009s
I20260709 13:02:26.319600 12258 raft_consensus.cc:359] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.320428 12258 raft_consensus.cc:385] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.320765 12258 raft_consensus.cc:740] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.322054 12265 raft_consensus.cc:493] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.321820 12258 consensus_queue.cc:260] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.322541 12265 raft_consensus.cc:515] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.333382 12265 leader_election.cc:290] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:26.338716 12258 ts_tablet_manager.cc:1434] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753: Time spent starting tablet: real 0.022s	user 0.012s	sys 0.004s
I20260709 13:02:26.339864 12258 tablet_bootstrap.cc:492] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753: Bootstrap starting.
I20260709 13:02:26.355110 12266 raft_consensus.cc:493] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.355737 12266 raft_consensus.cc:515] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } } peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } }
I20260709 13:02:26.358098 12260 tablet_bootstrap.cc:492] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634: No bootstrap required, opened a new log
I20260709 13:02:26.358727 12260 ts_tablet_manager.cc:1403] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634: Time spent bootstrapping tablet: real 0.083s	user 0.027s	sys 0.042s
I20260709 13:02:26.361990 12260 raft_consensus.cc:359] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.362907 12260 raft_consensus.cc:385] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.363107 12266 leader_election.cc:290] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163)
I20260709 13:02:26.363273 12260 raft_consensus.cc:740] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0291cd32b58e4e28a40b13ff1b8c9634, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.364480 12260 consensus_queue.cc:260] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.367070 12260 ts_tablet_manager.cc:1434] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:02:26.369529 12260 tablet_bootstrap.cc:492] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634: Bootstrap starting.
I20260709 13:02:26.369433 12144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1abeea0e34944a5a483d23409d4e963" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94" is_pre_election: true
I20260709 13:02:26.370695 12144 raft_consensus.cc:2468] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 0.
I20260709 13:02:26.373545 12258 tablet_bootstrap.cc:654] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.373279 12069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab463b4fae464214b1a0f42acba1d16b" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc350fb650c74e8696ea2aae28d8a753" is_pre_election: true
W20260709 13:02:26.375150 12181 leader_election.cc:343] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:26.375172 12035 leader_election.cc:304] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aeb8ce119f6745168cdf20d825ab6d94, bc350fb650c74e8696ea2aae28d8a753; no voters: 
I20260709 13:02:26.376929 12265 raft_consensus.cc:2804] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:26.377830 12265 raft_consensus.cc:493] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.378336 12265 raft_consensus.cc:3060] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.380249 12259 tablet_bootstrap.cc:492] T f4d15850c4a34c10b3c309fff1dc30b8 P aeb8ce119f6745168cdf20d825ab6d94: No bootstrap required, opened a new log
I20260709 13:02:26.380688 12259 ts_tablet_manager.cc:1403] T f4d15850c4a34c10b3c309fff1dc30b8 P aeb8ce119f6745168cdf20d825ab6d94: Time spent bootstrapping tablet: real 0.094s	user 0.028s	sys 0.038s
I20260709 13:02:26.383937 12259 raft_consensus.cc:359] T f4d15850c4a34c10b3c309fff1dc30b8 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.384717 12259 raft_consensus.cc:385] T f4d15850c4a34c10b3c309fff1dc30b8 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.384651 12218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1abeea0e34944a5a483d23409d4e963" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" is_pre_election: true
I20260709 13:02:26.385252 12259 raft_consensus.cc:740] T f4d15850c4a34c10b3c309fff1dc30b8 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aeb8ce119f6745168cdf20d825ab6d94, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.386380 12259 consensus_queue.cc:260] T f4d15850c4a34c10b3c309fff1dc30b8 P aeb8ce119f6745168cdf20d825ab6d94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
W20260709 13:02:26.387126 12033 leader_election.cc:343] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:26.389065 12260 tablet_bootstrap.cc:654] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.390714 12259 ts_tablet_manager.cc:1434] T f4d15850c4a34c10b3c309fff1dc30b8 P aeb8ce119f6745168cdf20d825ab6d94: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:02:26.392073 12259 tablet_bootstrap.cc:492] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94: Bootstrap starting.
I20260709 13:02:26.401782 12265 raft_consensus.cc:515] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.404245 12259 tablet_bootstrap.cc:654] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.407307 12144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1abeea0e34944a5a483d23409d4e963" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
I20260709 13:02:26.407931 12144 raft_consensus.cc:3060] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.408986 12218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1abeea0e34944a5a483d23409d4e963" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
W20260709 13:02:26.410425 12033 leader_election.cc:343] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:26.411432 12265 leader_election.cc:290] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 1 election: Requested vote from peers aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:26.414718 12258 tablet_bootstrap.cc:492] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753: No bootstrap required, opened a new log
I20260709 13:02:26.415225 12258 ts_tablet_manager.cc:1403] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.001s
I20260709 13:02:26.415479 12144 raft_consensus.cc:2468] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 1.
I20260709 13:02:26.416666 12035 leader_election.cc:304] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aeb8ce119f6745168cdf20d825ab6d94, bc350fb650c74e8696ea2aae28d8a753; no voters: 0291cd32b58e4e28a40b13ff1b8c9634
I20260709 13:02:26.419308 12260 tablet_bootstrap.cc:492] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634: No bootstrap required, opened a new log
I20260709 13:02:26.419772 12265 raft_consensus.cc:2804] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:26.419795 12260 ts_tablet_manager.cc:1403] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.014s
I20260709 13:02:26.420329 12265 raft_consensus.cc:697] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 1 LEADER]: Becoming Leader. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Running, Role: LEADER
I20260709 13:02:26.421211 12265 consensus_queue.cc:237] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.424952 12258 raft_consensus.cc:359] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.425827 12258 raft_consensus.cc:385] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.426156 12258 raft_consensus.cc:740] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.425118 12260 raft_consensus.cc:359] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.426955 12260 raft_consensus.cc:385] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.427284 12260 raft_consensus.cc:740] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0291cd32b58e4e28a40b13ff1b8c9634, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.427160 12258 consensus_queue.cc:260] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.428134 12260 consensus_queue.cc:260] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.429450 12258 ts_tablet_manager.cc:1434] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 13:02:26.430418 12258 tablet_bootstrap.cc:492] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753: Bootstrap starting.
I20260709 13:02:26.432075 12144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab463b4fae464214b1a0f42acba1d16b" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94" is_pre_election: true
I20260709 13:02:26.432722 12259 tablet_bootstrap.cc:492] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94: No bootstrap required, opened a new log
I20260709 13:02:26.433207 12259 ts_tablet_manager.cc:1403] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.022s
I20260709 13:02:26.435794 12260 ts_tablet_manager.cc:1434] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260709 13:02:26.435248 11964 catalog_manager.cc:5697] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "bc350fb650c74e8696ea2aae28d8a753" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:26.437043 12184 leader_election.cc:343] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:26.437682 12184 leader_election.cc:304] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634; no voters: aeb8ce119f6745168cdf20d825ab6d94, bc350fb650c74e8696ea2aae28d8a753
I20260709 13:02:26.436216 12259 raft_consensus.cc:359] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.436887 12260 tablet_bootstrap.cc:492] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634: Bootstrap starting.
I20260709 13:02:26.437018 12258 tablet_bootstrap.cc:654] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.438436 12266 raft_consensus.cc:2749] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:26.438856 12259 raft_consensus.cc:385] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.439251 12259 raft_consensus.cc:740] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aeb8ce119f6745168cdf20d825ab6d94, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.440330 12259 consensus_queue.cc:260] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.442539 12259 ts_tablet_manager.cc:1434] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:02:26.443455 12259 tablet_bootstrap.cc:492] T 4571992e2e3943b091d962f680812086 P aeb8ce119f6745168cdf20d825ab6d94: Bootstrap starting.
I20260709 13:02:26.448364 12260 tablet_bootstrap.cc:654] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.452157 12259 tablet_bootstrap.cc:654] T 4571992e2e3943b091d962f680812086 P aeb8ce119f6745168cdf20d825ab6d94: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:26.461727 12015 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:26.465128 12258 tablet_bootstrap.cc:492] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753: No bootstrap required, opened a new log
I20260709 13:02:26.465209 12260 tablet_bootstrap.cc:492] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634: No bootstrap required, opened a new log
I20260709 13:02:26.465909 12260 ts_tablet_manager.cc:1403] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.010s
I20260709 13:02:26.467324 12259 tablet_bootstrap.cc:492] T 4571992e2e3943b091d962f680812086 P aeb8ce119f6745168cdf20d825ab6d94: No bootstrap required, opened a new log
I20260709 13:02:26.467758 12259 ts_tablet_manager.cc:1403] T 4571992e2e3943b091d962f680812086 P aeb8ce119f6745168cdf20d825ab6d94: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.012s
I20260709 13:02:26.468276 12260 raft_consensus.cc:359] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.468811 12260 raft_consensus.cc:385] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.469043 12260 raft_consensus.cc:740] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0291cd32b58e4e28a40b13ff1b8c9634, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.469750 12260 consensus_queue.cc:260] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.470021 12259 raft_consensus.cc:359] T 4571992e2e3943b091d962f680812086 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.470652 12259 raft_consensus.cc:385] T 4571992e2e3943b091d962f680812086 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.470898 12259 raft_consensus.cc:740] T 4571992e2e3943b091d962f680812086 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aeb8ce119f6745168cdf20d825ab6d94, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.471745 12260 ts_tablet_manager.cc:1434] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:26.471570 12259 consensus_queue.cc:260] T 4571992e2e3943b091d962f680812086 P aeb8ce119f6745168cdf20d825ab6d94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.472750 12260 tablet_bootstrap.cc:492] T 1e6a832558da4cd2895591a547ff6c11 P 0291cd32b58e4e28a40b13ff1b8c9634: Bootstrap starting.
I20260709 13:02:26.465909 12258 ts_tablet_manager.cc:1403] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.004s
I20260709 13:02:26.473737 12259 ts_tablet_manager.cc:1434] T 4571992e2e3943b091d962f680812086 P aeb8ce119f6745168cdf20d825ab6d94: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:02:26.474951 12259 tablet_bootstrap.cc:492] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94: Bootstrap starting.
I20260709 13:02:26.476491 12258 raft_consensus.cc:359] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.477229 12258 raft_consensus.cc:385] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.477701 12258 raft_consensus.cc:740] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.478411 12258 consensus_queue.cc:260] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.480613 12258 ts_tablet_manager.cc:1434] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:02:26.481447 12259 tablet_bootstrap.cc:654] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.481611 12258 tablet_bootstrap.cc:492] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753: Bootstrap starting.
I20260709 13:02:26.491379 12260 tablet_bootstrap.cc:654] T 1e6a832558da4cd2895591a547ff6c11 P 0291cd32b58e4e28a40b13ff1b8c9634: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.493405 12259 tablet_bootstrap.cc:492] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94: No bootstrap required, opened a new log
I20260709 13:02:26.494007 12259 ts_tablet_manager.cc:1403] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.011s
I20260709 13:02:26.496951 12258 tablet_bootstrap.cc:654] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.496892 12259 raft_consensus.cc:359] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } } peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } }
I20260709 13:02:26.497637 12259 raft_consensus.cc:385] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.497947 12259 raft_consensus.cc:740] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aeb8ce119f6745168cdf20d825ab6d94, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.498623 12259 consensus_queue.cc:260] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } } peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } }
I20260709 13:02:26.499831 12260 tablet_bootstrap.cc:492] T 1e6a832558da4cd2895591a547ff6c11 P 0291cd32b58e4e28a40b13ff1b8c9634: No bootstrap required, opened a new log
I20260709 13:02:26.500468 12260 ts_tablet_manager.cc:1403] T 1e6a832558da4cd2895591a547ff6c11 P 0291cd32b58e4e28a40b13ff1b8c9634: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 13:02:26.500633 12259 ts_tablet_manager.cc:1434] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:26.501699 12259 tablet_bootstrap.cc:492] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94: Bootstrap starting.
I20260709 13:02:26.504705 12260 raft_consensus.cc:359] T 1e6a832558da4cd2895591a547ff6c11 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.505748 12260 raft_consensus.cc:385] T 1e6a832558da4cd2895591a547ff6c11 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.506131 12260 raft_consensus.cc:740] T 1e6a832558da4cd2895591a547ff6c11 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0291cd32b58e4e28a40b13ff1b8c9634, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.507185 12260 consensus_queue.cc:260] T 1e6a832558da4cd2895591a547ff6c11 P 0291cd32b58e4e28a40b13ff1b8c9634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.508004 12259 tablet_bootstrap.cc:654] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.513583 12260 ts_tablet_manager.cc:1434] T 1e6a832558da4cd2895591a547ff6c11 P 0291cd32b58e4e28a40b13ff1b8c9634: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:02:26.515034 12260 tablet_bootstrap.cc:492] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634: Bootstrap starting.
I20260709 13:02:26.519686 12259 tablet_bootstrap.cc:492] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94: No bootstrap required, opened a new log
I20260709 13:02:26.520169 12259 ts_tablet_manager.cc:1403] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:02:26.520138 12264 raft_consensus.cc:493] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.520680 12264 raft_consensus.cc:515] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } } peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } }
I20260709 13:02:26.523459 12260 tablet_bootstrap.cc:654] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.525785 12264 leader_election.cc:290] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353), bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115)
I20260709 13:02:26.532354 12259 raft_consensus.cc:359] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.533119 12259 raft_consensus.cc:385] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.533424 12259 raft_consensus.cc:740] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aeb8ce119f6745168cdf20d825ab6d94, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.538453 12259 consensus_queue.cc:260] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.544656 12258 tablet_bootstrap.cc:492] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753: No bootstrap required, opened a new log
I20260709 13:02:26.545627 12258 ts_tablet_manager.cc:1403] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753: Time spent bootstrapping tablet: real 0.064s	user 0.024s	sys 0.030s
I20260709 13:02:26.549539 12258 raft_consensus.cc:359] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } } peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } }
I20260709 13:02:26.550618 12258 raft_consensus.cc:385] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.551010 12258 raft_consensus.cc:740] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.552121 12258 consensus_queue.cc:260] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } } peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } }
I20260709 13:02:26.554410 12259 ts_tablet_manager.cc:1434] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.003s
I20260709 13:02:26.558279 12259 tablet_bootstrap.cc:492] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94: Bootstrap starting.
I20260709 13:02:26.559002 12258 ts_tablet_manager.cc:1434] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:02:26.560689 12258 tablet_bootstrap.cc:492] T 77ce751ee8a74f3fb9e788ff82aa6e64 P bc350fb650c74e8696ea2aae28d8a753: Bootstrap starting.
I20260709 13:02:26.562021 12218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab463b4fae464214b1a0f42acba1d16b" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" is_pre_election: true
I20260709 13:02:26.562566 12218 raft_consensus.cc:2468] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aeb8ce119f6745168cdf20d825ab6d94 in term 0.
I20260709 13:02:26.563665 12069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab463b4fae464214b1a0f42acba1d16b" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc350fb650c74e8696ea2aae28d8a753" is_pre_election: true
I20260709 13:02:26.563783 12108 leader_election.cc:304] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634, aeb8ce119f6745168cdf20d825ab6d94; no voters: 
I20260709 13:02:26.564379 12069 raft_consensus.cc:2468] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aeb8ce119f6745168cdf20d825ab6d94 in term 0.
I20260709 13:02:26.565062 12264 raft_consensus.cc:2804] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:26.565440 12264 raft_consensus.cc:493] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.565861 12264 raft_consensus.cc:3060] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.567652 12258 tablet_bootstrap.cc:654] T 77ce751ee8a74f3fb9e788ff82aa6e64 P bc350fb650c74e8696ea2aae28d8a753: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.571252 12260 tablet_bootstrap.cc:492] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634: No bootstrap required, opened a new log
I20260709 13:02:26.571810 12260 ts_tablet_manager.cc:1403] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634: Time spent bootstrapping tablet: real 0.057s	user 0.025s	sys 0.023s
I20260709 13:02:26.572870 12259 tablet_bootstrap.cc:654] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.575053 12260 raft_consensus.cc:359] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.576094 12260 raft_consensus.cc:385] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.576553 12260 raft_consensus.cc:740] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0291cd32b58e4e28a40b13ff1b8c9634, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.577765 12260 consensus_queue.cc:260] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.581346 12260 ts_tablet_manager.cc:1434] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:02:26.582515 12260 tablet_bootstrap.cc:492] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634: Bootstrap starting.
I20260709 13:02:26.582885 12264 raft_consensus.cc:515] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } } peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } }
I20260709 13:02:26.587018 12218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab463b4fae464214b1a0f42acba1d16b" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
I20260709 13:02:26.587747 12218 raft_consensus.cc:3060] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.589737 12259 tablet_bootstrap.cc:492] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94: No bootstrap required, opened a new log
I20260709 13:02:26.589936 12258 tablet_bootstrap.cc:492] T 77ce751ee8a74f3fb9e788ff82aa6e64 P bc350fb650c74e8696ea2aae28d8a753: No bootstrap required, opened a new log
I20260709 13:02:26.592799 12258 ts_tablet_manager.cc:1403] T 77ce751ee8a74f3fb9e788ff82aa6e64 P bc350fb650c74e8696ea2aae28d8a753: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.006s
I20260709 13:02:26.595070 12293 raft_consensus.cc:493] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.595593 12293 raft_consensus.cc:515] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.596011 12218 raft_consensus.cc:2468] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aeb8ce119f6745168cdf20d825ab6d94 in term 1.
I20260709 13:02:26.596338 12258 raft_consensus.cc:359] T 77ce751ee8a74f3fb9e788ff82aa6e64 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.597150 12258 raft_consensus.cc:385] T 77ce751ee8a74f3fb9e788ff82aa6e64 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.597534 12258 raft_consensus.cc:740] T 77ce751ee8a74f3fb9e788ff82aa6e64 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.598177 12108 leader_election.cc:304] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634, aeb8ce119f6745168cdf20d825ab6d94; no voters: 
I20260709 13:02:26.598788 12258 consensus_queue.cc:260] T 77ce751ee8a74f3fb9e788ff82aa6e64 P bc350fb650c74e8696ea2aae28d8a753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.600605 12294 raft_consensus.cc:2804] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:26.591899 12260 tablet_bootstrap.cc:654] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.601233 12259 ts_tablet_manager.cc:1403] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.008s
I20260709 13:02:26.601553 12069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f17c2df097349819756cac635ed58fc" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc350fb650c74e8696ea2aae28d8a753" is_pre_election: true
I20260709 13:02:26.602378 12069 raft_consensus.cc:2468] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aeb8ce119f6745168cdf20d825ab6d94 in term 0.
I20260709 13:02:26.606078 12259 raft_consensus.cc:359] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.606582 12107 leader_election.cc:304] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aeb8ce119f6745168cdf20d825ab6d94, bc350fb650c74e8696ea2aae28d8a753; no voters: 
I20260709 13:02:26.608546 12294 raft_consensus.cc:697] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 1 LEADER]: Becoming Leader. State: Replica: aeb8ce119f6745168cdf20d825ab6d94, State: Running, Role: LEADER
I20260709 13:02:26.611007 12295 raft_consensus.cc:2804] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:26.611418 12295 raft_consensus.cc:493] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.611433 12217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f17c2df097349819756cac635ed58fc" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" is_pre_election: true
I20260709 13:02:26.611847 12295 raft_consensus.cc:3060] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.611711 12294 consensus_queue.cc:237] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } } peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } }
I20260709 13:02:26.612321 12217 raft_consensus.cc:2468] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aeb8ce119f6745168cdf20d825ab6d94 in term 0.
I20260709 13:02:26.609747 12258 ts_tablet_manager.cc:1434] T 77ce751ee8a74f3fb9e788ff82aa6e64 P bc350fb650c74e8696ea2aae28d8a753: Time spent starting tablet: real 0.016s	user 0.000s	sys 0.010s
I20260709 13:02:26.618506 12266 raft_consensus.cc:493] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.618752 12258 tablet_bootstrap.cc:492] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753: Bootstrap starting.
I20260709 13:02:26.619282 12266 raft_consensus.cc:515] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.623004 12069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de1e688e3be741f9bbec4ef43ab84b01" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc350fb650c74e8696ea2aae28d8a753" is_pre_election: true
I20260709 13:02:26.623728 12069 raft_consensus.cc:2468] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0291cd32b58e4e28a40b13ff1b8c9634 in term 0.
I20260709 13:02:26.624074 12264 leader_election.cc:290] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 1 election: Requested vote from peers 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353), bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115)
I20260709 13:02:26.610143 12259 raft_consensus.cc:385] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.624807 12259 raft_consensus.cc:740] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aeb8ce119f6745168cdf20d825ab6d94, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.625046 12181 leader_election.cc:304] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634, bc350fb650c74e8696ea2aae28d8a753; no voters: 
I20260709 13:02:26.625798 12259 consensus_queue.cc:260] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.626803 12266 leader_election.cc:290] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163)
I20260709 13:02:26.627314 12266 raft_consensus.cc:2804] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:26.627701 12266 raft_consensus.cc:493] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.628646 12266 raft_consensus.cc:3060] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.627194 12144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de1e688e3be741f9bbec4ef43ab84b01" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94" is_pre_election: true
I20260709 13:02:26.629750 12144 raft_consensus.cc:2468] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0291cd32b58e4e28a40b13ff1b8c9634 in term 0.
I20260709 13:02:26.631275 12069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab463b4fae464214b1a0f42acba1d16b" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
I20260709 13:02:26.630163 12259 ts_tablet_manager.cc:1434] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:02:26.632161 12069 raft_consensus.cc:3060] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.636432 12259 tablet_bootstrap.cc:492] T 36c91f4f816446e592ed36b65caeb73f P aeb8ce119f6745168cdf20d825ab6d94: Bootstrap starting.
I20260709 13:02:26.598361 12293 leader_election.cc:290] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:26.645475 12260 tablet_bootstrap.cc:492] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634: No bootstrap required, opened a new log
I20260709 13:02:26.646281 12260 ts_tablet_manager.cc:1403] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634: Time spent bootstrapping tablet: real 0.064s	user 0.028s	sys 0.020s
I20260709 13:02:26.649509 12260 raft_consensus.cc:359] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.650415 12260 raft_consensus.cc:385] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.650779 12260 raft_consensus.cc:740] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0291cd32b58e4e28a40b13ff1b8c9634, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.651278 12266 raft_consensus.cc:515] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.651836 12260 consensus_queue.cc:260] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.653460 12298 raft_consensus.cc:493] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.654176 12298 raft_consensus.cc:515] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.654945 12259 tablet_bootstrap.cc:654] T 36c91f4f816446e592ed36b65caeb73f P aeb8ce119f6745168cdf20d825ab6d94: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.659094 12144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0872387060684098a1fbe3e1f23a0c8d" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94" is_pre_election: true
I20260709 13:02:26.649266 12069 raft_consensus.cc:2468] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aeb8ce119f6745168cdf20d825ab6d94 in term 1.
I20260709 13:02:26.635056 12258 tablet_bootstrap.cc:654] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:26.661294 12184 leader_election.cc:343] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:26.657147 11965 catalog_manager.cc:5697] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 reported cstate change: term changed from 0 to 1, leader changed from <none> to aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "aeb8ce119f6745168cdf20d825ab6d94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:26.658932 12295 raft_consensus.cc:515] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.669200 12069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de1e688e3be741f9bbec4ef43ab84b01" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
I20260709 13:02:26.670143 12068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f17c2df097349819756cac635ed58fc" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
I20260709 13:02:26.671141 12068 raft_consensus.cc:3060] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.672077 12067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0872387060684098a1fbe3e1f23a0c8d" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc350fb650c74e8696ea2aae28d8a753" is_pre_election: true
W20260709 13:02:26.674621 12181 leader_election.cc:343] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:26.675657 12181 leader_election.cc:304] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634; no voters: aeb8ce119f6745168cdf20d825ab6d94, bc350fb650c74e8696ea2aae28d8a753
I20260709 13:02:26.670156 12069 raft_consensus.cc:3060] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.686378 12295 leader_election.cc:290] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 1 election: Requested vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:26.687139 12298 leader_election.cc:290] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163)
I20260709 13:02:26.688658 12218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f17c2df097349819756cac635ed58fc" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
I20260709 13:02:26.689603 12218 raft_consensus.cc:3060] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.692404 12298 raft_consensus.cc:2749] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:26.698762 12069 raft_consensus.cc:2468] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0291cd32b58e4e28a40b13ff1b8c9634 in term 1.
I20260709 13:02:26.701150 12218 raft_consensus.cc:2468] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aeb8ce119f6745168cdf20d825ab6d94 in term 1.
I20260709 13:02:26.701884 12068 raft_consensus.cc:2468] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aeb8ce119f6745168cdf20d825ab6d94 in term 1.
I20260709 13:02:26.702772 12108 leader_election.cc:304] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634, aeb8ce119f6745168cdf20d825ab6d94; no voters: 
I20260709 13:02:26.703814 12295 raft_consensus.cc:2804] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:26.704456 12295 raft_consensus.cc:697] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [term 1 LEADER]: Becoming Leader. State: Replica: aeb8ce119f6745168cdf20d825ab6d94, State: Running, Role: LEADER
I20260709 13:02:26.705595 12295 consensus_queue.cc:237] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.707238 12265 raft_consensus.cc:493] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.708033 12265 raft_consensus.cc:515] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.709772 12144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de1e688e3be741f9bbec4ef43ab84b01" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
I20260709 13:02:26.710821 12144 raft_consensus.cc:3060] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.713330 12143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d15850c4a34c10b3c309fff1dc30b8" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94" is_pre_election: true
I20260709 13:02:26.715200 12143 raft_consensus.cc:2468] T f4d15850c4a34c10b3c309fff1dc30b8 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 0.
I20260709 13:02:26.715266 12265 leader_election.cc:290] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:26.716646 12035 leader_election.cc:304] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aeb8ce119f6745168cdf20d825ab6d94, bc350fb650c74e8696ea2aae28d8a753; no voters: 
I20260709 13:02:26.718288 12265 raft_consensus.cc:2804] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:26.718664 12265 raft_consensus.cc:493] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.719023 12265 raft_consensus.cc:3060] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.719812 12258 tablet_bootstrap.cc:492] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753: No bootstrap required, opened a new log
I20260709 13:02:26.721697 12266 leader_election.cc:290] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 election: Requested vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163)
I20260709 13:02:26.722710 12258 ts_tablet_manager.cc:1403] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753: Time spent bootstrapping tablet: real 0.104s	user 0.012s	sys 0.003s
I20260709 13:02:26.726595 12258 raft_consensus.cc:359] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.728077 12258 raft_consensus.cc:385] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.728682 12258 raft_consensus.cc:740] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.730798 12258 consensus_queue.cc:260] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.736299 12260 ts_tablet_manager.cc:1434] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634: Time spent starting tablet: real 0.090s	user 0.027s	sys 0.037s
I20260709 13:02:26.741899 12260 tablet_bootstrap.cc:492] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634: Bootstrap starting.
W20260709 13:02:26.725767 12181 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:40115, user_credentials={real_user=slave}} blocked reactor thread for 51209.5us
I20260709 13:02:26.742209 12265 raft_consensus.cc:515] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.742173 12258 ts_tablet_manager.cc:1434] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753: Time spent starting tablet: real 0.019s	user 0.010s	sys 0.000s
I20260709 13:02:26.754890 12258 tablet_bootstrap.cc:492] T 36c91f4f816446e592ed36b65caeb73f P bc350fb650c74e8696ea2aae28d8a753: Bootstrap starting.
I20260709 13:02:26.756318 12265 leader_election.cc:290] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 1 election: Requested vote from peers aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:26.758524 12144 raft_consensus.cc:2468] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0291cd32b58e4e28a40b13ff1b8c9634 in term 1.
I20260709 13:02:26.759955 12184 leader_election.cc:304] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634, aeb8ce119f6745168cdf20d825ab6d94; no voters: 
I20260709 13:02:26.761973 12217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d15850c4a34c10b3c309fff1dc30b8" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
I20260709 13:02:26.762813 12299 raft_consensus.cc:2804] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:02:26.763475 12033 leader_election.cc:343] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:26.765763 12258 tablet_bootstrap.cc:654] T 36c91f4f816446e592ed36b65caeb73f P bc350fb650c74e8696ea2aae28d8a753: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.761909 12218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d15850c4a34c10b3c309fff1dc30b8" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" is_pre_election: true
I20260709 13:02:26.766011 12299 raft_consensus.cc:697] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 LEADER]: Becoming Leader. State: Replica: 0291cd32b58e4e28a40b13ff1b8c9634, State: Running, Role: LEADER
I20260709 13:02:26.767259 12143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d15850c4a34c10b3c309fff1dc30b8" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
I20260709 13:02:26.768226 12259 tablet_bootstrap.cc:492] T 36c91f4f816446e592ed36b65caeb73f P aeb8ce119f6745168cdf20d825ab6d94: No bootstrap required, opened a new log
I20260709 13:02:26.768400 12294 raft_consensus.cc:493] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.768741 12259 ts_tablet_manager.cc:1403] T 36c91f4f816446e592ed36b65caeb73f P aeb8ce119f6745168cdf20d825ab6d94: Time spent bootstrapping tablet: real 0.133s	user 0.053s	sys 0.054s
I20260709 13:02:26.768889 12294 raft_consensus.cc:515] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.770591 12301 raft_consensus.cc:493] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.771277 12301 raft_consensus.cc:515] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.772239 12260 tablet_bootstrap.cc:654] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.772508 12259 raft_consensus.cc:359] T 36c91f4f816446e592ed36b65caeb73f P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.773659 12259 raft_consensus.cc:385] T 36c91f4f816446e592ed36b65caeb73f P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.774091 12259 raft_consensus.cc:740] T 36c91f4f816446e592ed36b65caeb73f P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aeb8ce119f6745168cdf20d825ab6d94, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.774891 12259 consensus_queue.cc:260] T 36c91f4f816446e592ed36b65caeb73f P aeb8ce119f6745168cdf20d825ab6d94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.776065 12301 leader_election.cc:290] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163)
I20260709 13:02:26.767663 12299 consensus_queue.cc:237] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.777132 12259 ts_tablet_manager.cc:1434] T 36c91f4f816446e592ed36b65caeb73f P aeb8ce119f6745168cdf20d825ab6d94: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:02:26.778303 12259 tablet_bootstrap.cc:492] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94: Bootstrap starting.
I20260709 13:02:26.784271 12068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ce751ee8a74f3fb9e788ff82aa6e64" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc350fb650c74e8696ea2aae28d8a753" is_pre_election: true
I20260709 13:02:26.786964 12260 tablet_bootstrap.cc:492] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634: No bootstrap required, opened a new log
I20260709 13:02:26.786769 12218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ce751ee8a74f3fb9e788ff82aa6e64" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" is_pre_election: true
I20260709 13:02:26.787595 12218 raft_consensus.cc:2468] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aeb8ce119f6745168cdf20d825ab6d94 in term 0.
I20260709 13:02:26.788187 12259 tablet_bootstrap.cc:654] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.786703 12294 leader_election.cc:290] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:26.789101 12260 ts_tablet_manager.cc:1403] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.003s
I20260709 13:02:26.789703 12108 leader_election.cc:304] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634, aeb8ce119f6745168cdf20d825ab6d94; no voters: 
I20260709 13:02:26.791633 12144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ce751ee8a74f3fb9e788ff82aa6e64" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94" is_pre_election: true
I20260709 13:02:26.792274 12144 raft_consensus.cc:2468] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0291cd32b58e4e28a40b13ff1b8c9634 in term 0.
I20260709 13:02:26.791859 12260 raft_consensus.cc:359] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.793922 12260 raft_consensus.cc:385] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.795140 12260 raft_consensus.cc:740] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0291cd32b58e4e28a40b13ff1b8c9634, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.796236 12265 raft_consensus.cc:493] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.796504 12068 raft_consensus.cc:2468] T 77ce751ee8a74f3fb9e788ff82aa6e64 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aeb8ce119f6745168cdf20d825ab6d94 in term 0.
I20260709 13:02:26.796774 12265 raft_consensus.cc:515] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.796463 12260 consensus_queue.cc:260] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.799042 12265 leader_election.cc:290] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:26.800040 12144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571992e2e3943b091d962f680812086" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94" is_pre_election: true
I20260709 13:02:26.800431 12184 leader_election.cc:304] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634, aeb8ce119f6745168cdf20d825ab6d94; no voters: 
I20260709 13:02:26.800913 12144 raft_consensus.cc:2468] T 4571992e2e3943b091d962f680812086 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 0.
I20260709 13:02:26.801172 12260 ts_tablet_manager.cc:1434] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.002s
I20260709 13:02:26.801932 12294 raft_consensus.cc:2804] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:26.802153 12035 leader_election.cc:304] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aeb8ce119f6745168cdf20d825ab6d94, bc350fb650c74e8696ea2aae28d8a753; no voters: 
W20260709 13:02:26.767390 12033 leader_election.cc:343] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:26.803009 12260 tablet_bootstrap.cc:492] T 4571992e2e3943b091d962f680812086 P 0291cd32b58e4e28a40b13ff1b8c9634: Bootstrap starting.
I20260709 13:02:26.804726 12068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ce751ee8a74f3fb9e788ff82aa6e64" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc350fb650c74e8696ea2aae28d8a753" is_pre_election: true
I20260709 13:02:26.805356 12068 raft_consensus.cc:2468] T 77ce751ee8a74f3fb9e788ff82aa6e64 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0291cd32b58e4e28a40b13ff1b8c9634 in term 0.
I20260709 13:02:26.806181 12259 tablet_bootstrap.cc:492] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94: No bootstrap required, opened a new log
I20260709 13:02:26.806618 12259 ts_tablet_manager.cc:1403] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.009s
I20260709 13:02:26.803005 12265 raft_consensus.cc:2804] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:26.807274 12265 raft_consensus.cc:493] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.807647 12265 raft_consensus.cc:3060] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.807081 11966 catalog_manager.cc:5697] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 reported cstate change: term changed from 0 to 1, leader changed from <none> to aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "aeb8ce119f6745168cdf20d825ab6d94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:26.809170 12295 raft_consensus.cc:493] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.809463 12259 raft_consensus.cc:359] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.802313 12294 raft_consensus.cc:493] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.806432 12218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571992e2e3943b091d962f680812086" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" is_pre_election: true
I20260709 13:02:26.809808 12295 raft_consensus.cc:515] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.810277 12259 raft_consensus.cc:385] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.810678 12259 raft_consensus.cc:740] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aeb8ce119f6745168cdf20d825ab6d94, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.811360 12294 raft_consensus.cc:3060] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.812080 12295 leader_election.cc:290] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:26.811755 12259 consensus_queue.cc:260] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.812354 12260 tablet_bootstrap.cc:654] T 4571992e2e3943b091d962f680812086 P 0291cd32b58e4e28a40b13ff1b8c9634: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.814718 12259 ts_tablet_manager.cc:1434] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:26.815608 12218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e6a832558da4cd2895591a547ff6c11" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" is_pre_election: true
I20260709 13:02:26.767887 12143 raft_consensus.cc:3060] T f4d15850c4a34c10b3c309fff1dc30b8 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.816262 12218 raft_consensus.cc:2468] T 1e6a832558da4cd2895591a547ff6c11 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aeb8ce119f6745168cdf20d825ab6d94 in term 0.
I20260709 13:02:26.818353 12260 tablet_bootstrap.cc:492] T 4571992e2e3943b091d962f680812086 P 0291cd32b58e4e28a40b13ff1b8c9634: No bootstrap required, opened a new log
I20260709 13:02:26.818859 12260 ts_tablet_manager.cc:1403] T 4571992e2e3943b091d962f680812086 P 0291cd32b58e4e28a40b13ff1b8c9634: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.002s
I20260709 13:02:26.818953 12108 leader_election.cc:304] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634, aeb8ce119f6745168cdf20d825ab6d94; no voters: 
I20260709 13:02:26.819796 12295 raft_consensus.cc:2804] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:26.820179 12295 raft_consensus.cc:493] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.820533 12295 raft_consensus.cc:3060] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.801362 12299 raft_consensus.cc:2804] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:26.821904 12299 raft_consensus.cc:493] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.822396 12299 raft_consensus.cc:3060] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.822453 12260 raft_consensus.cc:359] T 4571992e2e3943b091d962f680812086 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.823283 12260 raft_consensus.cc:385] T 4571992e2e3943b091d962f680812086 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.823596 12260 raft_consensus.cc:740] T 4571992e2e3943b091d962f680812086 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0291cd32b58e4e28a40b13ff1b8c9634, State: Initialized, Role: FOLLOWER
W20260709 13:02:26.817330 12033 leader_election.cc:343] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:26.824613 12260 consensus_queue.cc:260] T 4571992e2e3943b091d962f680812086 P 0291cd32b58e4e28a40b13ff1b8c9634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.827636 12260 ts_tablet_manager.cc:1434] T 4571992e2e3943b091d962f680812086 P 0291cd32b58e4e28a40b13ff1b8c9634: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:26.827379 12265 raft_consensus.cc:515] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.828801 12260 tablet_bootstrap.cc:492] T f4d15850c4a34c10b3c309fff1dc30b8 P 0291cd32b58e4e28a40b13ff1b8c9634: Bootstrap starting.
I20260709 13:02:26.828591 12295 raft_consensus.cc:515] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.830349 12144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571992e2e3943b091d962f680812086" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
I20260709 13:02:26.831125 12144 raft_consensus.cc:3060] T 4571992e2e3943b091d962f680812086 P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.831533 12069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e6a832558da4cd2895591a547ff6c11" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
I20260709 13:02:26.832093 12069 raft_consensus.cc:3060] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.835633 12260 tablet_bootstrap.cc:654] T f4d15850c4a34c10b3c309fff1dc30b8 P 0291cd32b58e4e28a40b13ff1b8c9634: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:26.836398 12068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e6a832558da4cd2895591a547ff6c11" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc350fb650c74e8696ea2aae28d8a753" is_pre_election: true
I20260709 13:02:26.839295 12069 raft_consensus.cc:2468] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aeb8ce119f6745168cdf20d825ab6d94 in term 1.
I20260709 13:02:26.844596 12260 tablet_bootstrap.cc:492] T f4d15850c4a34c10b3c309fff1dc30b8 P 0291cd32b58e4e28a40b13ff1b8c9634: No bootstrap required, opened a new log
I20260709 13:02:26.845031 12260 ts_tablet_manager.cc:1403] T f4d15850c4a34c10b3c309fff1dc30b8 P 0291cd32b58e4e28a40b13ff1b8c9634: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 13:02:26.847620 12260 raft_consensus.cc:359] T f4d15850c4a34c10b3c309fff1dc30b8 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.848006 12107 leader_election.cc:304] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aeb8ce119f6745168cdf20d825ab6d94, bc350fb650c74e8696ea2aae28d8a753; no voters: 
I20260709 13:02:26.848280 12260 raft_consensus.cc:385] T f4d15850c4a34c10b3c309fff1dc30b8 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.839295 12144 raft_consensus.cc:2468] T 4571992e2e3943b091d962f680812086 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 1.
I20260709 13:02:26.848865 12293 raft_consensus.cc:2804] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:26.849758 12035 leader_election.cc:304] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aeb8ce119f6745168cdf20d825ab6d94, bc350fb650c74e8696ea2aae28d8a753; no voters: 
I20260709 13:02:26.849428 12293 raft_consensus.cc:697] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 LEADER]: Becoming Leader. State: Replica: aeb8ce119f6745168cdf20d825ab6d94, State: Running, Role: LEADER
I20260709 13:02:26.850759 12272 raft_consensus.cc:2804] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:26.849387 12295 leader_election.cc:290] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 1 election: Requested vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:26.838937 11965 catalog_manager.cc:5697] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:26.841176 12218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4571992e2e3943b091d962f680812086" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
I20260709 13:02:26.841478 12217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e6a832558da4cd2895591a547ff6c11" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
I20260709 13:02:26.841678 12265 leader_election.cc:290] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 1 election: Requested vote from peers aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:26.848562 12260 raft_consensus.cc:740] T f4d15850c4a34c10b3c309fff1dc30b8 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0291cd32b58e4e28a40b13ff1b8c9634, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.849459 12299 raft_consensus.cc:515] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.863320 12217 raft_consensus.cc:3060] T 1e6a832558da4cd2895591a547ff6c11 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.863001 12260 consensus_queue.cc:260] T f4d15850c4a34c10b3c309fff1dc30b8 P 0291cd32b58e4e28a40b13ff1b8c9634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.864921 12260 ts_tablet_manager.cc:1434] T f4d15850c4a34c10b3c309fff1dc30b8 P 0291cd32b58e4e28a40b13ff1b8c9634: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.004s
I20260709 13:02:26.866521 12143 raft_consensus.cc:2468] T f4d15850c4a34c10b3c309fff1dc30b8 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 1.
I20260709 13:02:26.867967 12035 leader_election.cc:304] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: aeb8ce119f6745168cdf20d825ab6d94, bc350fb650c74e8696ea2aae28d8a753; no voters: 0291cd32b58e4e28a40b13ff1b8c9634
I20260709 13:02:26.865815 12218 raft_consensus.cc:3060] T 4571992e2e3943b091d962f680812086 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.870555 12216 raft_consensus.cc:3060] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.850152 12294 raft_consensus.cc:515] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.851589 12293 consensus_queue.cc:237] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.875598 12069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ce751ee8a74f3fb9e788ff82aa6e64" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
I20260709 13:02:26.882547 12069 raft_consensus.cc:3060] T 77ce751ee8a74f3fb9e788ff82aa6e64 P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.872144 12265 raft_consensus.cc:2804] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:26.884400 12265 raft_consensus.cc:697] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 [term 1 LEADER]: Becoming Leader. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Running, Role: LEADER
I20260709 13:02:26.874452 12217 raft_consensus.cc:2468] T 1e6a832558da4cd2895591a547ff6c11 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aeb8ce119f6745168cdf20d825ab6d94 in term 1.
I20260709 13:02:26.885651 12301 raft_consensus.cc:493] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:26.885257 12265 consensus_queue.cc:237] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.887177 12299 leader_election.cc:290] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 election: Requested vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163)
I20260709 13:02:26.886127 12301 raft_consensus.cc:515] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.887796 12272 raft_consensus.cc:697] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753 [term 1 LEADER]: Becoming Leader. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Running, Role: LEADER
I20260709 13:02:26.888698 12272 consensus_queue.cc:237] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.889268 12143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ce751ee8a74f3fb9e788ff82aa6e64" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
I20260709 13:02:26.889477 12301 leader_election.cc:290] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163)
I20260709 13:02:26.890417 12068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c91f4f816446e592ed36b65caeb73f" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc350fb650c74e8696ea2aae28d8a753" is_pre_election: true
I20260709 13:02:26.891441 12144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c91f4f816446e592ed36b65caeb73f" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94" is_pre_election: true
I20260709 13:02:26.892053 12144 raft_consensus.cc:2468] T 36c91f4f816446e592ed36b65caeb73f P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0291cd32b58e4e28a40b13ff1b8c9634 in term 0.
I20260709 13:02:26.893344 12184 leader_election.cc:304] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634, aeb8ce119f6745168cdf20d825ab6d94; no voters: 
I20260709 13:02:26.894269 12301 raft_consensus.cc:2804] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:26.894724 12301 raft_consensus.cc:493] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:26.896380 12143 raft_consensus.cc:2393] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0291cd32b58e4e28a40b13ff1b8c9634 in current term 1: Already voted for candidate aeb8ce119f6745168cdf20d825ab6d94 in this term.
I20260709 13:02:26.895133 12301 raft_consensus.cc:3060] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.901250 12309 consensus_queue.cc:1048] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:26.903678 12218 raft_consensus.cc:2468] T 4571992e2e3943b091d962f680812086 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 1.
I20260709 13:02:26.912756 12068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ce751ee8a74f3fb9e788ff82aa6e64" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
W20260709 13:02:26.909118 12181 leader_election.cc:343] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:26.931368 11964 catalog_manager.cc:5697] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 reported cstate change: term changed from 0 to 1, leader changed from <none> to aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "aeb8ce119f6745168cdf20d825ab6d94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:26.928387 12301 raft_consensus.cc:515] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.936368 12301 leader_election.cc:290] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 election: Requested vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163)
I20260709 13:02:26.941828 12069 raft_consensus.cc:2468] T 77ce751ee8a74f3fb9e788ff82aa6e64 P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0291cd32b58e4e28a40b13ff1b8c9634 in term 1.
I20260709 13:02:26.942003 12143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c91f4f816446e592ed36b65caeb73f" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
I20260709 13:02:26.943320 12143 raft_consensus.cc:3060] T 36c91f4f816446e592ed36b65caeb73f P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:26.944058 12069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c91f4f816446e592ed36b65caeb73f" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
I20260709 13:02:26.944342 12181 leader_election.cc:304] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634, bc350fb650c74e8696ea2aae28d8a753; no voters: aeb8ce119f6745168cdf20d825ab6d94
W20260709 13:02:26.945765 12181 leader_election.cc:343] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:26.945886 12301 raft_consensus.cc:2804] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:26.948989 12301 raft_consensus.cc:697] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 LEADER]: Becoming Leader. State: Replica: 0291cd32b58e4e28a40b13ff1b8c9634, State: Running, Role: LEADER
I20260709 13:02:26.953058 12216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ce751ee8a74f3fb9e788ff82aa6e64" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
I20260709 13:02:26.950202 12294 leader_election.cc:290] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 1 election: Requested vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:26.955499 12108 leader_election.cc:304] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aeb8ce119f6745168cdf20d825ab6d94; no voters: 0291cd32b58e4e28a40b13ff1b8c9634, bc350fb650c74e8696ea2aae28d8a753
I20260709 13:02:26.957177 12294 raft_consensus.cc:2749] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:26.959033 12258 tablet_bootstrap.cc:492] T 36c91f4f816446e592ed36b65caeb73f P bc350fb650c74e8696ea2aae28d8a753: No bootstrap required, opened a new log
I20260709 13:02:26.959690 12258 ts_tablet_manager.cc:1403] T 36c91f4f816446e592ed36b65caeb73f P bc350fb650c74e8696ea2aae28d8a753: Time spent bootstrapping tablet: real 0.205s	user 0.007s	sys 0.011s
I20260709 13:02:26.959196 11964 catalog_manager.cc:5697] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "bc350fb650c74e8696ea2aae28d8a753" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:26.962236 12301 consensus_queue.cc:237] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.964356 12311 consensus_queue.cc:1048] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260709 13:02:26.965950 12143 raft_consensus.cc:2468] T 36c91f4f816446e592ed36b65caeb73f P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0291cd32b58e4e28a40b13ff1b8c9634 in term 1.
I20260709 13:02:26.966070 11964 catalog_manager.cc:5697] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "bc350fb650c74e8696ea2aae28d8a753" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:26.968698 12258 raft_consensus.cc:359] T 36c91f4f816446e592ed36b65caeb73f P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.969132 12184 leader_election.cc:304] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634, aeb8ce119f6745168cdf20d825ab6d94; no voters: bc350fb650c74e8696ea2aae28d8a753
I20260709 13:02:26.969537 12258 raft_consensus.cc:385] T 36c91f4f816446e592ed36b65caeb73f P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:26.969938 12299 raft_consensus.cc:2804] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:26.972049 12299 raft_consensus.cc:697] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 LEADER]: Becoming Leader. State: Replica: 0291cd32b58e4e28a40b13ff1b8c9634, State: Running, Role: LEADER
I20260709 13:02:26.973318 12299 consensus_queue.cc:237] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.981412 12258 raft_consensus.cc:740] T 36c91f4f816446e592ed36b65caeb73f P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Initialized, Role: FOLLOWER
I20260709 13:02:26.982674 12258 consensus_queue.cc:260] T 36c91f4f816446e592ed36b65caeb73f P bc350fb650c74e8696ea2aae28d8a753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:26.985128 12258 ts_tablet_manager.cc:1434] T 36c91f4f816446e592ed36b65caeb73f P bc350fb650c74e8696ea2aae28d8a753: Time spent starting tablet: real 0.025s	user 0.001s	sys 0.005s
I20260709 13:02:26.982564 11966 catalog_manager.cc:5697] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:26.995694 12258 tablet_bootstrap.cc:492] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753: Bootstrap starting.
I20260709 13:02:27.001212 12258 tablet_bootstrap.cc:654] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:27.011183 12258 tablet_bootstrap.cc:492] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753: No bootstrap required, opened a new log
I20260709 13:02:27.011657 12258 ts_tablet_manager.cc:1403] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:02:27.012981 11966 catalog_manager.cc:5697] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:27.014446 12258 raft_consensus.cc:359] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:27.015182 12258 raft_consensus.cc:385] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:27.015487 12258 raft_consensus.cc:740] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Initialized, Role: FOLLOWER
I20260709 13:02:27.016264 12258 consensus_queue.cc:260] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:27.018236 12258 ts_tablet_manager.cc:1434] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:02:27.040822 12294 consensus_queue.cc:1048] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.051122 12294 consensus_queue.cc:1048] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:27.082736 12272 raft_consensus.cc:493] T 36c91f4f816446e592ed36b65caeb73f P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.083277 12272 raft_consensus.cc:515] T 36c91f4f816446e592ed36b65caeb73f P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:27.084978 12272 leader_election.cc:290] T 36c91f4f816446e592ed36b65caeb73f P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:27.085983 12143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c91f4f816446e592ed36b65caeb73f" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94" is_pre_election: true
I20260709 13:02:27.086055 12218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c91f4f816446e592ed36b65caeb73f" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" is_pre_election: true
I20260709 13:02:27.086742 12143 raft_consensus.cc:2393] T 36c91f4f816446e592ed36b65caeb73f P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc350fb650c74e8696ea2aae28d8a753 in current term 1: Already voted for candidate 0291cd32b58e4e28a40b13ff1b8c9634 in this term.
I20260709 13:02:27.088089 12035 leader_election.cc:304] T 36c91f4f816446e592ed36b65caeb73f P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc350fb650c74e8696ea2aae28d8a753; no voters: 0291cd32b58e4e28a40b13ff1b8c9634, aeb8ce119f6745168cdf20d825ab6d94
I20260709 13:02:27.088976 12272 raft_consensus.cc:3060] T 36c91f4f816446e592ed36b65caeb73f P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.092864 12299 raft_consensus.cc:493] T f4d15850c4a34c10b3c309fff1dc30b8 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.093343 12299 raft_consensus.cc:515] T f4d15850c4a34c10b3c309fff1dc30b8 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:27.093797 12311 raft_consensus.cc:493] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:27.094480 12272 raft_consensus.cc:2749] T 36c91f4f816446e592ed36b65caeb73f P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:27.094273 12311 raft_consensus.cc:515] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:27.095368 12299 leader_election.cc:290] T f4d15850c4a34c10b3c309fff1dc30b8 P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163)
I20260709 13:02:27.096454 12311 leader_election.cc:290] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:27.096498 12143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d15850c4a34c10b3c309fff1dc30b8" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94" is_pre_election: true
I20260709 13:02:27.097086 12144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0872387060684098a1fbe3e1f23a0c8d" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94" is_pre_election: true
I20260709 13:02:27.097404 12143 raft_consensus.cc:2393] T f4d15850c4a34c10b3c309fff1dc30b8 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0291cd32b58e4e28a40b13ff1b8c9634 in current term 1: Already voted for candidate bc350fb650c74e8696ea2aae28d8a753 in this term.
I20260709 13:02:27.097707 12144 raft_consensus.cc:2468] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 0.
I20260709 13:02:27.097748 12069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4d15850c4a34c10b3c309fff1dc30b8" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc350fb650c74e8696ea2aae28d8a753" is_pre_election: true
I20260709 13:02:27.097796 12218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0872387060684098a1fbe3e1f23a0c8d" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" is_pre_election: true
I20260709 13:02:27.098690 12218 raft_consensus.cc:2468] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 0.
I20260709 13:02:27.098970 12035 leader_election.cc:304] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aeb8ce119f6745168cdf20d825ab6d94, bc350fb650c74e8696ea2aae28d8a753; no voters: 
I20260709 13:02:27.099670 12311 raft_consensus.cc:2804] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:27.100039 12311 raft_consensus.cc:493] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:27.100095 12181 leader_election.cc:304] T f4d15850c4a34c10b3c309fff1dc30b8 P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634; no voters: aeb8ce119f6745168cdf20d825ab6d94, bc350fb650c74e8696ea2aae28d8a753
I20260709 13:02:27.100637 12311 raft_consensus.cc:3060] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.101423 12299 raft_consensus.cc:3060] T f4d15850c4a34c10b3c309fff1dc30b8 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.106310 12299 raft_consensus.cc:2749] T f4d15850c4a34c10b3c309fff1dc30b8 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:27.106179 12311 raft_consensus.cc:515] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:27.107915 12311 leader_election.cc:290] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 1 election: Requested vote from peers aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:27.109025 12144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0872387060684098a1fbe3e1f23a0c8d" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
I20260709 13:02:27.109054 12218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0872387060684098a1fbe3e1f23a0c8d" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
I20260709 13:02:27.109758 12218 raft_consensus.cc:3060] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.109730 12144 raft_consensus.cc:3060] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:27.115226 12218 raft_consensus.cc:2468] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 1.
I20260709 13:02:27.115321 12144 raft_consensus.cc:2468] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 1.
I20260709 13:02:27.116559 12035 leader_election.cc:304] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aeb8ce119f6745168cdf20d825ab6d94, bc350fb650c74e8696ea2aae28d8a753; no voters: 
I20260709 13:02:27.117306 12311 raft_consensus.cc:2804] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:27.117784 12311 raft_consensus.cc:697] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 1 LEADER]: Becoming Leader. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Running, Role: LEADER
I20260709 13:02:27.118618 12311 consensus_queue.cc:237] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:27.127045 12294 consensus_queue.cc:1048] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.126963 11965 catalog_manager.cc:5697] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "bc350fb650c74e8696ea2aae28d8a753" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:27.139720 12264 consensus_queue.cc:1048] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.168493 12299 consensus_queue.cc:1048] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.180166 12299 consensus_queue.cc:1048] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.213994 12144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab463b4fae464214b1a0f42acba1d16b"
dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
mode: GRACEFUL
new_leader_uuid: "bc350fb650c74e8696ea2aae28d8a753"
 from {username='slave'} at 127.0.0.1:56976
I20260709 13:02:27.214617 12144 raft_consensus.cc:606] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 1 LEADER]: Received request to transfer leadership to TS bc350fb650c74e8696ea2aae28d8a753
I20260709 13:02:27.228413 12144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e6a832558da4cd2895591a547ff6c11"
dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
mode: GRACEFUL
new_leader_uuid: "bc350fb650c74e8696ea2aae28d8a753"
 from {username='slave'} at 127.0.0.1:56976
I20260709 13:02:27.228981 12144 raft_consensus.cc:606] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 LEADER]: Received request to transfer leadership to TS bc350fb650c74e8696ea2aae28d8a753
I20260709 13:02:27.244814 12218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de1e688e3be741f9bbec4ef43ab84b01"
dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
mode: GRACEFUL
new_leader_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
 from {username='slave'} at 127.0.0.1:43218
I20260709 13:02:27.245329 12218 raft_consensus.cc:606] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 LEADER]: Received request to transfer leadership to TS aeb8ce119f6745168cdf20d825ab6d94
I20260709 13:02:27.259261 12069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0872387060684098a1fbe3e1f23a0c8d"
dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
mode: GRACEFUL
new_leader_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
 from {username='slave'} at 127.0.0.1:35672
I20260709 13:02:27.259789 12069 raft_consensus.cc:606] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 1 LEADER]: Received request to transfer leadership to TS aeb8ce119f6745168cdf20d825ab6d94
I20260709 13:02:27.264814 12218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77ce751ee8a74f3fb9e788ff82aa6e64"
dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
mode: GRACEFUL
new_leader_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
 from {username='slave'} at 127.0.0.1:43218
I20260709 13:02:27.265430 12218 raft_consensus.cc:606] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 LEADER]: Received request to transfer leadership to TS aeb8ce119f6745168cdf20d825ab6d94
I20260709 13:02:27.276737 12311 consensus_queue.cc:1048] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.287608 12265 consensus_queue.cc:1048] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.355083 12311 consensus_queue.cc:1048] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.367552 12311 consensus_queue.cc:1048] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.418504 12299 consensus_queue.cc:1048] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.428284 12301 consensus_queue.cc:1048] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.431002 12264 consensus_queue.cc:1048] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.443426 12264 raft_consensus.cc:993] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94: : Instructing follower bc350fb650c74e8696ea2aae28d8a753 to start an election
I20260709 13:02:27.443848 12264 raft_consensus.cc:1081] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 LEADER]: Signalling peer bc350fb650c74e8696ea2aae28d8a753 to start an election
I20260709 13:02:27.446431 12068 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e6a832558da4cd2895591a547ff6c11"
dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
 from {username='slave'} at 127.0.0.1:35662
I20260709 13:02:27.447741 12068 raft_consensus.cc:493] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:27.448169 12068 raft_consensus.cc:3060] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.449102 12293 consensus_queue.cc:1048] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.457139 12068 raft_consensus.cc:515] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:27.466812 12068 leader_election.cc:290] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 2 election: Requested vote from peers aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:27.467644 12143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e6a832558da4cd2895591a547ff6c11" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
I20260709 13:02:27.468310 12143 raft_consensus.cc:3055] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:27.468642 12143 raft_consensus.cc:740] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aeb8ce119f6745168cdf20d825ab6d94, State: Running, Role: LEADER
I20260709 13:02:27.469496 12143 consensus_queue.cc:260] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:27.470489 12216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e6a832558da4cd2895591a547ff6c11" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
I20260709 13:02:27.470821 12143 raft_consensus.cc:3060] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.471129 12216 raft_consensus.cc:3060] T 1e6a832558da4cd2895591a547ff6c11 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.477263 12143 raft_consensus.cc:2468] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 2.
I20260709 13:02:27.477481 12216 raft_consensus.cc:2468] T 1e6a832558da4cd2895591a547ff6c11 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 2.
I20260709 13:02:27.478889 12035 leader_election.cc:304] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aeb8ce119f6745168cdf20d825ab6d94, bc350fb650c74e8696ea2aae28d8a753; no voters: 
I20260709 13:02:27.480206 12265 raft_consensus.cc:2804] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:27.480754 12265 raft_consensus.cc:697] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [term 2 LEADER]: Becoming Leader. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Running, Role: LEADER
I20260709 13:02:27.481614 12265 consensus_queue.cc:237] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:27.492635 11965 catalog_manager.cc:5697] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 reported cstate change: term changed from 1 to 2, leader changed from aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194) to bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "bc350fb650c74e8696ea2aae28d8a753" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:27.548048 12301 consensus_queue.cc:1048] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.555467 12299 raft_consensus.cc:993] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634: : Instructing follower aeb8ce119f6745168cdf20d825ab6d94 to start an election
I20260709 13:02:27.556041 12299 raft_consensus.cc:1081] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 LEADER]: Signalling peer aeb8ce119f6745168cdf20d825ab6d94 to start an election
I20260709 13:02:27.557374 12298 consensus_queue.cc:1048] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.558362 12144 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77ce751ee8a74f3fb9e788ff82aa6e64"
dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
 from {username='slave'} at 127.0.0.1:56964
I20260709 13:02:27.558986 12144 raft_consensus.cc:493] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:27.559401 12144 raft_consensus.cc:3060] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.567322 12144 raft_consensus.cc:515] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:27.569747 12144 leader_election.cc:290] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 2 election: Requested vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:27.570617 12068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ce751ee8a74f3fb9e788ff82aa6e64" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
I20260709 13:02:27.571416 12068 raft_consensus.cc:3060] T 77ce751ee8a74f3fb9e788ff82aa6e64 P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.570612 12216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77ce751ee8a74f3fb9e788ff82aa6e64" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
I20260709 13:02:27.572386 12216 raft_consensus.cc:3055] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:27.572763 12216 raft_consensus.cc:740] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0291cd32b58e4e28a40b13ff1b8c9634, State: Running, Role: LEADER
I20260709 13:02:27.573966 12216 consensus_queue.cc:260] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:27.576138 12216 raft_consensus.cc:3060] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.579789 12068 raft_consensus.cc:2468] T 77ce751ee8a74f3fb9e788ff82aa6e64 P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aeb8ce119f6745168cdf20d825ab6d94 in term 2.
I20260709 13:02:27.581183 12107 leader_election.cc:304] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aeb8ce119f6745168cdf20d825ab6d94, bc350fb650c74e8696ea2aae28d8a753; no voters: 
I20260709 13:02:27.582067 12264 raft_consensus.cc:2804] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:27.582501 12264 raft_consensus.cc:697] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [term 2 LEADER]: Becoming Leader. State: Replica: aeb8ce119f6745168cdf20d825ab6d94, State: Running, Role: LEADER
I20260709 13:02:27.583168 12264 consensus_queue.cc:237] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:27.583336 12216 raft_consensus.cc:2468] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aeb8ce119f6745168cdf20d825ab6d94 in term 2.
I20260709 13:02:27.589546 11965 catalog_manager.cc:5697] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 reported cstate change: term changed from 1 to 2, leader changed from 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195) to aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194). New cstate: current_term: 2 leader_uuid: "aeb8ce119f6745168cdf20d825ab6d94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:27.599908 12293 raft_consensus.cc:993] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94: : Instructing follower bc350fb650c74e8696ea2aae28d8a753 to start an election
I20260709 13:02:27.600334 12293 raft_consensus.cc:1081] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 1 LEADER]: Signalling peer bc350fb650c74e8696ea2aae28d8a753 to start an election
I20260709 13:02:27.601902 12068 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab463b4fae464214b1a0f42acba1d16b"
dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
 from {username='slave'} at 127.0.0.1:35662
I20260709 13:02:27.602421 12068 raft_consensus.cc:493] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:27.602772 12068 raft_consensus.cc:3060] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.607635 12068 raft_consensus.cc:515] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } } peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } }
I20260709 13:02:27.609300 12068 leader_election.cc:290] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 2 election: Requested vote from peers 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353), aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163)
I20260709 13:02:27.610312 12216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab463b4fae464214b1a0f42acba1d16b" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
I20260709 13:02:27.610584 12144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab463b4fae464214b1a0f42acba1d16b" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
I20260709 13:02:27.610831 12216 raft_consensus.cc:3060] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.611228 12144 raft_consensus.cc:3055] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:27.611543 12144 raft_consensus.cc:740] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aeb8ce119f6745168cdf20d825ab6d94, State: Running, Role: LEADER
I20260709 13:02:27.612293 12144 consensus_queue.cc:260] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } } peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } }
I20260709 13:02:27.613286 12144 raft_consensus.cc:3060] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.615859 12216 raft_consensus.cc:2468] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 2.
I20260709 13:02:27.617090 12033 leader_election.cc:304] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634, bc350fb650c74e8696ea2aae28d8a753; no voters: 
I20260709 13:02:27.618023 12265 raft_consensus.cc:2804] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:27.618492 12265 raft_consensus.cc:697] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 2 LEADER]: Becoming Leader. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Running, Role: LEADER
I20260709 13:02:27.618930 12144 raft_consensus.cc:2468] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 2.
I20260709 13:02:27.619246 12265 consensus_queue.cc:237] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } } peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } }
I20260709 13:02:27.624320 12311 consensus_queue.cc:1048] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.626489 11965 catalog_manager.cc:5697] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 reported cstate change: term changed from 1 to 2, leader changed from aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194) to bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "bc350fb650c74e8696ea2aae28d8a753" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:27.633904 12265 raft_consensus.cc:993] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753: : Instructing follower aeb8ce119f6745168cdf20d825ab6d94 to start an election
I20260709 13:02:27.634387 12265 raft_consensus.cc:1081] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 1 LEADER]: Signalling peer aeb8ce119f6745168cdf20d825ab6d94 to start an election
I20260709 13:02:27.636336 12143 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0872387060684098a1fbe3e1f23a0c8d"
dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
 from {username='slave'} at 127.0.0.1:56960
I20260709 13:02:27.637648 12143 raft_consensus.cc:493] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:27.638161 12143 raft_consensus.cc:3060] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.643800 12265 consensus_queue.cc:1048] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:27.644140 12143 raft_consensus.cc:515] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:27.646919 12143 leader_election.cc:290] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 2 election: Requested vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:27.648195 12068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0872387060684098a1fbe3e1f23a0c8d" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
I20260709 13:02:27.649066 12068 raft_consensus.cc:3055] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:27.649513 12068 raft_consensus.cc:740] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Running, Role: LEADER
I20260709 13:02:27.650394 12068 consensus_queue.cc:260] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:27.651479 12068 raft_consensus.cc:3060] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.648363 12218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0872387060684098a1fbe3e1f23a0c8d" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
I20260709 13:02:27.655241 12218 raft_consensus.cc:3060] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.658331 12068 raft_consensus.cc:2468] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aeb8ce119f6745168cdf20d825ab6d94 in term 2.
I20260709 13:02:27.659492 12107 leader_election.cc:304] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aeb8ce119f6745168cdf20d825ab6d94, bc350fb650c74e8696ea2aae28d8a753; no voters: 
I20260709 13:02:27.660354 12293 raft_consensus.cc:2804] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:27.660831 12293 raft_consensus.cc:697] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [term 2 LEADER]: Becoming Leader. State: Replica: aeb8ce119f6745168cdf20d825ab6d94, State: Running, Role: LEADER
I20260709 13:02:27.661339 12218 raft_consensus.cc:2468] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aeb8ce119f6745168cdf20d825ab6d94 in term 2.
I20260709 13:02:27.661613 12293 consensus_queue.cc:237] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:27.668535 11965 catalog_manager.cc:5697] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 reported cstate change: term changed from 1 to 2, leader changed from bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193) to aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194). New cstate: current_term: 2 leader_uuid: "aeb8ce119f6745168cdf20d825ab6d94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:27.766920 12301 raft_consensus.cc:993] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634: : Instructing follower aeb8ce119f6745168cdf20d825ab6d94 to start an election
I20260709 13:02:27.767381 12266 raft_consensus.cc:1081] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 LEADER]: Signalling peer aeb8ce119f6745168cdf20d825ab6d94 to start an election
I20260709 13:02:27.768838 12143 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de1e688e3be741f9bbec4ef43ab84b01"
dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
 from {username='slave'} at 127.0.0.1:56964
I20260709 13:02:27.769376 12143 raft_consensus.cc:493] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:27.769779 12143 raft_consensus.cc:3060] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.774727 12143 raft_consensus.cc:515] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:27.776414 12143 leader_election.cc:290] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 2 election: Requested vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:27.777362 12068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de1e688e3be741f9bbec4ef43ab84b01" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
I20260709 13:02:27.777395 12218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de1e688e3be741f9bbec4ef43ab84b01" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
I20260709 13:02:27.778123 12068 raft_consensus.cc:3060] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.778205 12218 raft_consensus.cc:3055] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:27.778693 12218 raft_consensus.cc:740] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0291cd32b58e4e28a40b13ff1b8c9634, State: Running, Role: LEADER
I20260709 13:02:27.779429 12218 consensus_queue.cc:260] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:27.780334 12218 raft_consensus.cc:3060] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.783180 12068 raft_consensus.cc:2468] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aeb8ce119f6745168cdf20d825ab6d94 in term 2.
I20260709 13:02:27.784549 12107 leader_election.cc:304] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aeb8ce119f6745168cdf20d825ab6d94, bc350fb650c74e8696ea2aae28d8a753; no voters: 
I20260709 13:02:27.785419 12293 raft_consensus.cc:2804] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:27.785514 12218 raft_consensus.cc:2468] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aeb8ce119f6745168cdf20d825ab6d94 in term 2.
I20260709 13:02:27.786018 12293 raft_consensus.cc:697] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [term 2 LEADER]: Becoming Leader. State: Replica: aeb8ce119f6745168cdf20d825ab6d94, State: Running, Role: LEADER
I20260709 13:02:27.786913 12293 consensus_queue.cc:237] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:27.793067 11965 catalog_manager.cc:5697] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 reported cstate change: term changed from 1 to 2, leader changed from 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195) to aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194). New cstate: current_term: 2 leader_uuid: "aeb8ce119f6745168cdf20d825ab6d94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:27.863730 12218 raft_consensus.cc:1275] T 1e6a832558da4cd2895591a547ff6c11 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Refusing update from remote peer bc350fb650c74e8696ea2aae28d8a753: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:27.865269 12265 consensus_queue.cc:1048] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:27.873206 12143 raft_consensus.cc:1275] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 2 FOLLOWER]: Refusing update from remote peer bc350fb650c74e8696ea2aae28d8a753: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:27.874763 12272 consensus_queue.cc:1048] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:28.018445 12143 raft_consensus.cc:1275] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 2 FOLLOWER]: Refusing update from remote peer bc350fb650c74e8696ea2aae28d8a753: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:28.019802 12272 consensus_queue.cc:1048] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:28.028926 12218 raft_consensus.cc:1275] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Refusing update from remote peer bc350fb650c74e8696ea2aae28d8a753: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:28.030922 12311 consensus_queue.cc:1048] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:28.130914 12218 raft_consensus.cc:1275] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Refusing update from remote peer aeb8ce119f6745168cdf20d825ab6d94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:28.132452 12293 consensus_queue.cc:1048] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:28.142262 12068 raft_consensus.cc:1275] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Refusing update from remote peer aeb8ce119f6745168cdf20d825ab6d94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:28.144153 12264 consensus_queue.cc:1048] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:28.186120 12218 raft_consensus.cc:1275] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Refusing update from remote peer aeb8ce119f6745168cdf20d825ab6d94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:28.187376 12264 consensus_queue.cc:1048] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:28.191951 12068 raft_consensus.cc:1275] T 77ce751ee8a74f3fb9e788ff82aa6e64 P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Refusing update from remote peer aeb8ce119f6745168cdf20d825ab6d94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:28.193764 12346 consensus_queue.cc:1048] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:28.239759 12068 raft_consensus.cc:1275] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Refusing update from remote peer aeb8ce119f6745168cdf20d825ab6d94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:28.241262 12264 consensus_queue.cc:1048] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:28.251250 12218 raft_consensus.cc:1275] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Refusing update from remote peer aeb8ce119f6745168cdf20d825ab6d94: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:28.252976 12346 consensus_queue.cc:1048] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:30.307283 11443 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:02:30.308028 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:30.324139 12068 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab463b4fae464214b1a0f42acba1d16b"
dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
mode: GRACEFUL
new_leader_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
 from {username='slave'} at 127.0.0.1:35674
I20260709 13:02:30.324795 12068 raft_consensus.cc:606] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 2 LEADER]: Received request to transfer leadership to TS 0291cd32b58e4e28a40b13ff1b8c9634
I20260709 13:02:30.327507 12068 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1abeea0e34944a5a483d23409d4e963"
dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
mode: GRACEFUL
new_leader_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
 from {username='slave'} at 127.0.0.1:35674
I20260709 13:02:30.328012 12068 raft_consensus.cc:606] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 1 LEADER]: Received request to transfer leadership to TS 0291cd32b58e4e28a40b13ff1b8c9634
I20260709 13:02:30.329077 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:30.329628 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:30.723369 12309 raft_consensus.cc:993] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753: : Instructing follower 0291cd32b58e4e28a40b13ff1b8c9634 to start an election
I20260709 13:02:30.723847 12349 raft_consensus.cc:1081] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 1 LEADER]: Signalling peer 0291cd32b58e4e28a40b13ff1b8c9634 to start an election
I20260709 13:02:30.725255 12216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1abeea0e34944a5a483d23409d4e963"
dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
 from {username='slave'} at 127.0.0.1:43212
I20260709 13:02:30.725865 12216 raft_consensus.cc:493] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:30.726161 12216 raft_consensus.cc:3060] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:30.731056 12216 raft_consensus.cc:515] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:30.732802 12216 leader_election.cc:290] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 2 election: Requested vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163)
I20260709 13:02:30.733675 12068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1abeea0e34944a5a483d23409d4e963" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
I20260709 13:02:30.733958 12144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1abeea0e34944a5a483d23409d4e963" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
I20260709 13:02:30.734216 12068 raft_consensus.cc:3055] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:30.734581 12144 raft_consensus.cc:3060] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:30.734707 12068 raft_consensus.cc:740] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Running, Role: LEADER
I20260709 13:02:30.735457 12068 consensus_queue.cc:260] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:30.736346 12068 raft_consensus.cc:3060] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:30.740157 12144 raft_consensus.cc:2468] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0291cd32b58e4e28a40b13ff1b8c9634 in term 2.
I20260709 13:02:30.741343 12068 raft_consensus.cc:2468] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0291cd32b58e4e28a40b13ff1b8c9634 in term 2.
I20260709 13:02:30.741400 12184 leader_election.cc:304] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634, aeb8ce119f6745168cdf20d825ab6d94; no voters: 
I20260709 13:02:30.742542 12266 raft_consensus.cc:2804] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:30.744057 12266 raft_consensus.cc:697] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 LEADER]: Becoming Leader. State: Replica: 0291cd32b58e4e28a40b13ff1b8c9634, State: Running, Role: LEADER
I20260709 13:02:30.745071 12266 consensus_queue.cc:237] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:30.755897 11964 catalog_manager.cc:5697] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 reported cstate change: term changed from 1 to 2, leader changed from bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193) to 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195). New cstate: current_term: 2 leader_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:30.792089 12309 raft_consensus.cc:993] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753: : Instructing follower 0291cd32b58e4e28a40b13ff1b8c9634 to start an election
I20260709 13:02:30.792650 12349 raft_consensus.cc:1081] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 2 LEADER]: Signalling peer 0291cd32b58e4e28a40b13ff1b8c9634 to start an election
I20260709 13:02:30.794596 12216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab463b4fae464214b1a0f42acba1d16b"
dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
 from {username='slave'} at 127.0.0.1:43212
I20260709 13:02:30.795120 12216 raft_consensus.cc:493] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:30.795439 12216 raft_consensus.cc:3060] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:30.801761 12216 raft_consensus.cc:515] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } } peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } }
I20260709 13:02:30.803383 12216 leader_election.cc:290] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 3 election: Requested vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163)
I20260709 13:02:30.804344 12068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab463b4fae464214b1a0f42acba1d16b" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
I20260709 13:02:30.804622 12144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab463b4fae464214b1a0f42acba1d16b" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
I20260709 13:02:30.804949 12068 raft_consensus.cc:3055] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:30.805132 12144 raft_consensus.cc:3060] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:30.805318 12068 raft_consensus.cc:740] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Running, Role: LEADER
I20260709 13:02:30.806216 12068 consensus_queue.cc:260] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } } peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } }
I20260709 13:02:30.807621 12068 raft_consensus.cc:3060] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:30.812031 12144 raft_consensus.cc:2468] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0291cd32b58e4e28a40b13ff1b8c9634 in term 3.
I20260709 13:02:30.813285 12184 leader_election.cc:304] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634, aeb8ce119f6745168cdf20d825ab6d94; no voters: 
I20260709 13:02:30.814209 12266 raft_consensus.cc:2804] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:30.814106 12068 raft_consensus.cc:2468] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0291cd32b58e4e28a40b13ff1b8c9634 in term 3.
I20260709 13:02:30.814743 12266 raft_consensus.cc:697] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 LEADER]: Becoming Leader. State: Replica: 0291cd32b58e4e28a40b13ff1b8c9634, State: Running, Role: LEADER
I20260709 13:02:30.815476 12266 consensus_queue.cc:237] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } } peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } }
I20260709 13:02:30.822928 11964 catalog_manager.cc:5697] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 reported cstate change: term changed from 2 to 3, leader changed from bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193) to 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195). New cstate: current_term: 3 leader_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.233300 12144 raft_consensus.cc:1275] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 3 FOLLOWER]: Refusing update from remote peer 0291cd32b58e4e28a40b13ff1b8c9634: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:31.234870 12266 consensus_queue.cc:1048] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:31.244787 12068 raft_consensus.cc:1275] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 3 FOLLOWER]: Refusing update from remote peer 0291cd32b58e4e28a40b13ff1b8c9634: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:31.246246 12266 consensus_queue.cc:1048] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:31.253327 12143 raft_consensus.cc:1275] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [term 2 FOLLOWER]: Refusing update from remote peer 0291cd32b58e4e28a40b13ff1b8c9634: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:31.254154 12068 raft_consensus.cc:1275] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Refusing update from remote peer 0291cd32b58e4e28a40b13ff1b8c9634: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:31.255008 12352 consensus_queue.cc:1048] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:31.259435 12266 consensus_queue.cc:1048] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:31.330622 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:31.341845 12216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab463b4fae464214b1a0f42acba1d16b"
dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
mode: GRACEFUL
new_leader_uuid: "bc350fb650c74e8696ea2aae28d8a753"
 from {username='slave'} at 127.0.0.1:43218
I20260709 13:02:31.342367 12216 raft_consensus.cc:606] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 LEADER]: Received request to transfer leadership to TS bc350fb650c74e8696ea2aae28d8a753
I20260709 13:02:31.347595 12216 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1abeea0e34944a5a483d23409d4e963"
dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
mode: GRACEFUL
new_leader_uuid: "bc350fb650c74e8696ea2aae28d8a753"
 from {username='slave'} at 127.0.0.1:43218
I20260709 13:02:31.348136 12216 raft_consensus.cc:606] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 LEADER]: Received request to transfer leadership to TS bc350fb650c74e8696ea2aae28d8a753
I20260709 13:02:31.362510 12144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f17c2df097349819756cac635ed58fc"
dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
mode: GRACEFUL
new_leader_uuid: "bc350fb650c74e8696ea2aae28d8a753"
 from {username='slave'} at 127.0.0.1:56976
I20260709 13:02:31.363243 12144 raft_consensus.cc:606] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [term 1 LEADER]: Received request to transfer leadership to TS bc350fb650c74e8696ea2aae28d8a753
I20260709 13:02:31.368466 12144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de1e688e3be741f9bbec4ef43ab84b01"
dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
mode: GRACEFUL
new_leader_uuid: "bc350fb650c74e8696ea2aae28d8a753"
 from {username='slave'} at 127.0.0.1:56976
I20260709 13:02:31.369036 12144 raft_consensus.cc:606] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [term 2 LEADER]: Received request to transfer leadership to TS bc350fb650c74e8696ea2aae28d8a753
I20260709 13:02:31.374478 12144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0872387060684098a1fbe3e1f23a0c8d"
dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
mode: GRACEFUL
new_leader_uuid: "bc350fb650c74e8696ea2aae28d8a753"
 from {username='slave'} at 127.0.0.1:56976
I20260709 13:02:31.375207 12144 raft_consensus.cc:606] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [term 2 LEADER]: Received request to transfer leadership to TS bc350fb650c74e8696ea2aae28d8a753
I20260709 13:02:31.587811 12368 raft_consensus.cc:993] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94: : Instructing follower bc350fb650c74e8696ea2aae28d8a753 to start an election
I20260709 13:02:31.588287 12293 raft_consensus.cc:1081] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [term 2 LEADER]: Signalling peer bc350fb650c74e8696ea2aae28d8a753 to start an election
I20260709 13:02:31.590168 12069 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0872387060684098a1fbe3e1f23a0c8d"
dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
 from {username='slave'} at 127.0.0.1:35662
I20260709 13:02:31.590723 12069 raft_consensus.cc:493] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:31.591068 12069 raft_consensus.cc:3060] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.596428 12069 raft_consensus.cc:515] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:31.598215 12069 leader_election.cc:290] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 3 election: Requested vote from peers aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:31.599309 12144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0872387060684098a1fbe3e1f23a0c8d" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
I20260709 13:02:31.599309 12216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0872387060684098a1fbe3e1f23a0c8d" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
I20260709 13:02:31.600140 12216 raft_consensus.cc:3060] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.600131 12144 raft_consensus.cc:3055] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:31.600956 12144 raft_consensus.cc:740] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aeb8ce119f6745168cdf20d825ab6d94, State: Running, Role: LEADER
I20260709 13:02:31.601895 12144 consensus_queue.cc:260] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:31.603186 12144 raft_consensus.cc:3060] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.607481 12216 raft_consensus.cc:2468] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 3.
I20260709 13:02:31.608903 12033 leader_election.cc:304] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634, bc350fb650c74e8696ea2aae28d8a753; no voters: 
I20260709 13:02:31.609453 12144 raft_consensus.cc:2468] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 3.
I20260709 13:02:31.609645 12349 raft_consensus.cc:2804] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:31.610888 12349 raft_consensus.cc:697] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 3 LEADER]: Becoming Leader. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Running, Role: LEADER
I20260709 13:02:31.611626 12349 consensus_queue.cc:237] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:31.618590 11966 catalog_manager.cc:5697] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 reported cstate change: term changed from 2 to 3, leader changed from aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194) to bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193). New cstate: current_term: 3 leader_uuid: "bc350fb650c74e8696ea2aae28d8a753" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.699133 12368 raft_consensus.cc:993] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94: : Instructing follower bc350fb650c74e8696ea2aae28d8a753 to start an election
I20260709 13:02:31.699574 12293 raft_consensus.cc:1081] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [term 2 LEADER]: Signalling peer bc350fb650c74e8696ea2aae28d8a753 to start an election
I20260709 13:02:31.701299 12069 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de1e688e3be741f9bbec4ef43ab84b01"
dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
 from {username='slave'} at 127.0.0.1:35662
I20260709 13:02:31.701783 12069 raft_consensus.cc:493] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:31.702136 12069 raft_consensus.cc:3060] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.706667 12069 raft_consensus.cc:515] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:31.708207 12069 leader_election.cc:290] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 3 election: Requested vote from peers aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:31.709081 12144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de1e688e3be741f9bbec4ef43ab84b01" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
I20260709 13:02:31.709451 12216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de1e688e3be741f9bbec4ef43ab84b01" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
I20260709 13:02:31.709693 12144 raft_consensus.cc:3055] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:31.710004 12144 raft_consensus.cc:740] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aeb8ce119f6745168cdf20d825ab6d94, State: Running, Role: LEADER
I20260709 13:02:31.710008 12216 raft_consensus.cc:3060] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.710915 12144 consensus_queue.cc:260] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:31.712132 12144 raft_consensus.cc:3060] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.717185 12216 raft_consensus.cc:2468] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 3.
I20260709 13:02:31.718250 12144 raft_consensus.cc:2468] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 3.
I20260709 13:02:31.718607 12033 leader_election.cc:304] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634, bc350fb650c74e8696ea2aae28d8a753; no voters: 
I20260709 13:02:31.719395 12349 raft_consensus.cc:2804] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:31.719833 12349 raft_consensus.cc:697] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753 [term 3 LEADER]: Becoming Leader. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Running, Role: LEADER
I20260709 13:02:31.720604 12349 consensus_queue.cc:237] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:31.728263 11966 catalog_manager.cc:5697] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753 reported cstate change: term changed from 2 to 3, leader changed from aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194) to bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193). New cstate: current_term: 3 leader_uuid: "bc350fb650c74e8696ea2aae28d8a753" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.751657 12368 raft_consensus.cc:993] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94: : Instructing follower bc350fb650c74e8696ea2aae28d8a753 to start an election
I20260709 13:02:31.752213 12293 raft_consensus.cc:1081] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [term 1 LEADER]: Signalling peer bc350fb650c74e8696ea2aae28d8a753 to start an election
I20260709 13:02:31.754088 12069 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f17c2df097349819756cac635ed58fc"
dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
 from {username='slave'} at 127.0.0.1:35662
I20260709 13:02:31.755335 12069 raft_consensus.cc:493] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:31.756106 12069 raft_consensus.cc:3060] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:31.763242 12069 raft_consensus.cc:515] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:31.764955 12069 leader_election.cc:290] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 2 election: Requested vote from peers aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:31.766094 12144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f17c2df097349819756cac635ed58fc" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
I20260709 13:02:31.766266 12216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f17c2df097349819756cac635ed58fc" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
I20260709 13:02:31.766697 12144 raft_consensus.cc:3055] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:31.766705 12216 raft_consensus.cc:3060] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:31.767151 12144 raft_consensus.cc:740] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aeb8ce119f6745168cdf20d825ab6d94, State: Running, Role: LEADER
I20260709 13:02:31.767912 12144 consensus_queue.cc:260] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:31.769074 12144 raft_consensus.cc:3060] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:31.774075 12216 raft_consensus.cc:2468] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 2.
I20260709 13:02:31.775362 12033 leader_election.cc:304] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634, bc350fb650c74e8696ea2aae28d8a753; no voters: 
I20260709 13:02:31.775453 12144 raft_consensus.cc:2468] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 2.
I20260709 13:02:31.776153 12349 raft_consensus.cc:2804] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:31.776604 12349 raft_consensus.cc:697] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [term 2 LEADER]: Becoming Leader. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Running, Role: LEADER
I20260709 13:02:31.777309 12349 consensus_queue.cc:237] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:31.785276 11966 catalog_manager.cc:5697] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 reported cstate change: term changed from 1 to 2, leader changed from aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194) to bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "bc350fb650c74e8696ea2aae28d8a753" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.834043 12376 raft_consensus.cc:993] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634: : Instructing follower bc350fb650c74e8696ea2aae28d8a753 to start an election
I20260709 13:02:31.834695 12377 raft_consensus.cc:1081] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 LEADER]: Signalling peer bc350fb650c74e8696ea2aae28d8a753 to start an election
I20260709 13:02:31.836372 12069 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab463b4fae464214b1a0f42acba1d16b"
dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:02:31.836993 12069 raft_consensus.cc:493] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:31.837323 12069 raft_consensus.cc:3060] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:31.843009 12069 raft_consensus.cc:515] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } } peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } }
I20260709 13:02:31.844740 12069 leader_election.cc:290] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 4 election: Requested vote from peers 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353), aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163)
I20260709 13:02:31.845710 12216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab463b4fae464214b1a0f42acba1d16b" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
I20260709 13:02:31.845945 12144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab463b4fae464214b1a0f42acba1d16b" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
I20260709 13:02:31.846369 12376 raft_consensus.cc:993] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634: : Instructing follower bc350fb650c74e8696ea2aae28d8a753 to start an election
I20260709 13:02:31.846355 12216 raft_consensus.cc:3055] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:31.846478 12144 raft_consensus.cc:3060] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:31.846889 12216 raft_consensus.cc:740] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0291cd32b58e4e28a40b13ff1b8c9634, State: Running, Role: LEADER
I20260709 13:02:31.847045 12377 raft_consensus.cc:1081] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 LEADER]: Signalling peer bc350fb650c74e8696ea2aae28d8a753 to start an election
I20260709 13:02:31.847829 12216 consensus_queue.cc:260] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } } peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } }
I20260709 13:02:31.848716 12069 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1abeea0e34944a5a483d23409d4e963"
dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
 from {username='slave'} at 127.0.0.1:35660
I20260709 13:02:31.849040 12216 raft_consensus.cc:3060] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:31.849287 12069 raft_consensus.cc:493] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:31.849684 12069 raft_consensus.cc:3060] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.851711 12144 raft_consensus.cc:2468] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 4.
I20260709 13:02:31.852872 12035 leader_election.cc:304] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aeb8ce119f6745168cdf20d825ab6d94, bc350fb650c74e8696ea2aae28d8a753; no voters: 
I20260709 13:02:31.853631 12349 raft_consensus.cc:2804] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:31.854060 12349 raft_consensus.cc:697] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 4 LEADER]: Becoming Leader. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Running, Role: LEADER
I20260709 13:02:31.855012 12349 consensus_queue.cc:237] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } } peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } }
I20260709 13:02:31.859706 12216 raft_consensus.cc:2468] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 4.
I20260709 13:02:31.860630 12069 raft_consensus.cc:515] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:31.862725 12069 leader_election.cc:290] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 3 election: Requested vote from peers aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:31.863358 12144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1abeea0e34944a5a483d23409d4e963" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
I20260709 13:02:31.863729 12216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1abeea0e34944a5a483d23409d4e963" candidate_uuid: "bc350fb650c74e8696ea2aae28d8a753" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
I20260709 13:02:31.863996 12144 raft_consensus.cc:3060] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.863508 11966 catalog_manager.cc:5697] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 reported cstate change: term changed from 3 to 4, leader changed from 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195) to bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193). New cstate: current_term: 4 leader_uuid: "bc350fb650c74e8696ea2aae28d8a753" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.864406 12216 raft_consensus.cc:3055] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:31.864823 12216 raft_consensus.cc:740] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0291cd32b58e4e28a40b13ff1b8c9634, State: Running, Role: LEADER
I20260709 13:02:31.865710 12216 consensus_queue.cc:260] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:31.866807 12216 raft_consensus.cc:3060] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:31.869589 12144 raft_consensus.cc:2468] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 3.
I20260709 13:02:31.870885 12035 leader_election.cc:304] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: aeb8ce119f6745168cdf20d825ab6d94, bc350fb650c74e8696ea2aae28d8a753; no voters: 
I20260709 13:02:31.871871 12349 raft_consensus.cc:2804] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:31.872330 12349 raft_consensus.cc:697] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 3 LEADER]: Becoming Leader. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Running, Role: LEADER
I20260709 13:02:31.873798 12349 consensus_queue.cc:237] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:31.874220 12216 raft_consensus.cc:2468] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc350fb650c74e8696ea2aae28d8a753 in term 3.
I20260709 13:02:31.880565 11966 catalog_manager.cc:5697] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 reported cstate change: term changed from 2 to 3, leader changed from 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195) to bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193). New cstate: current_term: 3 leader_uuid: "bc350fb650c74e8696ea2aae28d8a753" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:32.069489 12144 raft_consensus.cc:1275] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [term 3 FOLLOWER]: Refusing update from remote peer bc350fb650c74e8696ea2aae28d8a753: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:32.070870 12349 consensus_queue.cc:1048] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:32.084177 12216 raft_consensus.cc:1275] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 FOLLOWER]: Refusing update from remote peer bc350fb650c74e8696ea2aae28d8a753: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:32.085783 12381 consensus_queue.cc:1048] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:32.168988 12144 raft_consensus.cc:1275] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [term 2 FOLLOWER]: Refusing update from remote peer bc350fb650c74e8696ea2aae28d8a753: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:32.170478 12381 consensus_queue.cc:1048] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:32.180115 12216 raft_consensus.cc:1275] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Refusing update from remote peer bc350fb650c74e8696ea2aae28d8a753: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:32.183449 12369 consensus_queue.cc:1048] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:32.229420 12144 raft_consensus.cc:1275] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [term 3 FOLLOWER]: Refusing update from remote peer bc350fb650c74e8696ea2aae28d8a753: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:32.230942 12369 consensus_queue.cc:1048] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:32.241025 12216 raft_consensus.cc:1275] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 FOLLOWER]: Refusing update from remote peer bc350fb650c74e8696ea2aae28d8a753: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:32.242431 12349 consensus_queue.cc:1048] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:32.286834 12216 raft_consensus.cc:1275] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 4 FOLLOWER]: Refusing update from remote peer bc350fb650c74e8696ea2aae28d8a753: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:32.288283 12349 consensus_queue.cc:1048] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:32.297031 12144 raft_consensus.cc:1275] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 4 FOLLOWER]: Refusing update from remote peer bc350fb650c74e8696ea2aae28d8a753: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:32.298548 12381 consensus_queue.cc:1048] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:32.360270 12216 raft_consensus.cc:1275] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 FOLLOWER]: Refusing update from remote peer bc350fb650c74e8696ea2aae28d8a753: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:32.361871 12381 consensus_queue.cc:1048] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:32.369987 12144 raft_consensus.cc:1275] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [term 3 FOLLOWER]: Refusing update from remote peer bc350fb650c74e8696ea2aae28d8a753: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:32.371713 12349 consensus_queue.cc:1048] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:34.383986 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:34.393467 12069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0872387060684098a1fbe3e1f23a0c8d"
dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
mode: GRACEFUL
new_leader_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
 from {username='slave'} at 127.0.0.1:35674
I20260709 13:02:34.394562 12069 raft_consensus.cc:606] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 3 LEADER]: Received request to transfer leadership to TS 0291cd32b58e4e28a40b13ff1b8c9634
I20260709 13:02:34.397789 12069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1e6a832558da4cd2895591a547ff6c11"
dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
mode: GRACEFUL
new_leader_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
 from {username='slave'} at 127.0.0.1:35674
I20260709 13:02:34.398445 12069 raft_consensus.cc:606] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [term 2 LEADER]: Received request to transfer leadership to TS aeb8ce119f6745168cdf20d825ab6d94
I20260709 13:02:34.400640 12069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f17c2df097349819756cac635ed58fc"
dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
mode: GRACEFUL
new_leader_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
 from {username='slave'} at 127.0.0.1:35674
I20260709 13:02:34.401125 12069 raft_consensus.cc:606] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [term 2 LEADER]: Received request to transfer leadership to TS 0291cd32b58e4e28a40b13ff1b8c9634
I20260709 13:02:34.403550 12069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1abeea0e34944a5a483d23409d4e963"
dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
mode: GRACEFUL
new_leader_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
 from {username='slave'} at 127.0.0.1:35674
I20260709 13:02:34.404032 12069 raft_consensus.cc:606] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 3 LEADER]: Received request to transfer leadership to TS aeb8ce119f6745168cdf20d825ab6d94
I20260709 13:02:34.405069 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:02:34.405761 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:34.463814 12349 raft_consensus.cc:993] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753: : Instructing follower 0291cd32b58e4e28a40b13ff1b8c9634 to start an election
I20260709 13:02:34.464427 12349 raft_consensus.cc:1081] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 3 LEADER]: Signalling peer 0291cd32b58e4e28a40b13ff1b8c9634 to start an election
I20260709 13:02:34.466193 12216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0872387060684098a1fbe3e1f23a0c8d"
dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
 from {username='slave'} at 127.0.0.1:43212
I20260709 13:02:34.466686 12216 raft_consensus.cc:493] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:34.467044 12216 raft_consensus.cc:3060] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:34.473855 12216 raft_consensus.cc:515] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:34.476135 12216 leader_election.cc:290] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 4 election: Requested vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163)
I20260709 13:02:34.477888 12144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0872387060684098a1fbe3e1f23a0c8d" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
I20260709 13:02:34.477797 12069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0872387060684098a1fbe3e1f23a0c8d" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
I20260709 13:02:34.478711 12069 raft_consensus.cc:3055] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:34.478675 12144 raft_consensus.cc:3060] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:34.479159 12069 raft_consensus.cc:740] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Running, Role: LEADER
I20260709 13:02:34.479935 12069 consensus_queue.cc:260] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:34.480962 12069 raft_consensus.cc:3060] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:34.484349 12144 raft_consensus.cc:2468] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0291cd32b58e4e28a40b13ff1b8c9634 in term 4.
I20260709 13:02:34.485759 12184 leader_election.cc:304] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634, aeb8ce119f6745168cdf20d825ab6d94; no voters: 
I20260709 13:02:34.486210 12069 raft_consensus.cc:2468] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0291cd32b58e4e28a40b13ff1b8c9634 in term 4.
I20260709 13:02:34.487092 12393 raft_consensus.cc:2804] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:34.488379 12393 raft_consensus.cc:697] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [term 4 LEADER]: Becoming Leader. State: Replica: 0291cd32b58e4e28a40b13ff1b8c9634, State: Running, Role: LEADER
I20260709 13:02:34.489500 12393 consensus_queue.cc:237] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:34.497344 11964 catalog_manager.cc:5697] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 reported cstate change: term changed from 3 to 4, leader changed from bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193) to 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195). New cstate: current_term: 4 leader_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:34.629637 12369 raft_consensus.cc:993] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753: : Instructing follower 0291cd32b58e4e28a40b13ff1b8c9634 to start an election
I20260709 13:02:34.630080 12349 raft_consensus.cc:1081] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [term 2 LEADER]: Signalling peer 0291cd32b58e4e28a40b13ff1b8c9634 to start an election
I20260709 13:02:34.631623 12216 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f17c2df097349819756cac635ed58fc"
dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
 from {username='slave'} at 127.0.0.1:43212
I20260709 13:02:34.632086 12216 raft_consensus.cc:493] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:34.632362 12216 raft_consensus.cc:3060] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:34.636533 12216 raft_consensus.cc:515] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:34.637931 12216 leader_election.cc:290] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 3 election: Requested vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163)
I20260709 13:02:34.638833 12069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f17c2df097349819756cac635ed58fc" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
I20260709 13:02:34.638984 12144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f17c2df097349819756cac635ed58fc" candidate_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
I20260709 13:02:34.639389 12069 raft_consensus.cc:3055] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:34.639410 12144 raft_consensus.cc:3060] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:34.639803 12069 raft_consensus.cc:740] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Running, Role: LEADER
I20260709 13:02:34.640540 12069 consensus_queue.cc:260] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:34.641680 12069 raft_consensus.cc:3060] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:34.645869 12144 raft_consensus.cc:2468] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0291cd32b58e4e28a40b13ff1b8c9634 in term 3.
I20260709 13:02:34.646936 12184 leader_election.cc:304] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634, aeb8ce119f6745168cdf20d825ab6d94; no voters: 
I20260709 13:02:34.647328 12069 raft_consensus.cc:2468] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0291cd32b58e4e28a40b13ff1b8c9634 in term 3.
I20260709 13:02:34.647686 12393 raft_consensus.cc:2804] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:34.648173 12393 raft_consensus.cc:697] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 LEADER]: Becoming Leader. State: Replica: 0291cd32b58e4e28a40b13ff1b8c9634, State: Running, Role: LEADER
I20260709 13:02:34.649195 12393 consensus_queue.cc:237] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:34.656591 11964 catalog_manager.cc:5697] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 reported cstate change: term changed from 2 to 3, leader changed from bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193) to 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195). New cstate: current_term: 3 leader_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:34.674661 12349 raft_consensus.cc:993] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753: : Instructing follower aeb8ce119f6745168cdf20d825ab6d94 to start an election
I20260709 13:02:34.675210 12369 raft_consensus.cc:1081] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 3 LEADER]: Signalling peer aeb8ce119f6745168cdf20d825ab6d94 to start an election
I20260709 13:02:34.676991 12144 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1abeea0e34944a5a483d23409d4e963"
dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
 from {username='slave'} at 127.0.0.1:56960
I20260709 13:02:34.677421 12144 raft_consensus.cc:493] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:34.677728 12144 raft_consensus.cc:3060] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:34.681876 12144 raft_consensus.cc:515] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:34.684130 12144 leader_election.cc:290] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 4 election: Requested vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:34.684602 12069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1abeea0e34944a5a483d23409d4e963" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
I20260709 13:02:34.684746 12216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1abeea0e34944a5a483d23409d4e963" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
I20260709 13:02:34.685113 12069 raft_consensus.cc:3055] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:02:34.685299 12216 raft_consensus.cc:3060] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:34.685504 12069 raft_consensus.cc:740] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Running, Role: LEADER
I20260709 13:02:34.686373 12069 consensus_queue.cc:260] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:34.687202 12069 raft_consensus.cc:3060] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:02:34.689931 12216 raft_consensus.cc:2468] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aeb8ce119f6745168cdf20d825ab6d94 in term 4.
I20260709 13:02:34.691285 12108 leader_election.cc:304] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634, aeb8ce119f6745168cdf20d825ab6d94; no voters: 
I20260709 13:02:34.691633 12069 raft_consensus.cc:2468] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aeb8ce119f6745168cdf20d825ab6d94 in term 4.
I20260709 13:02:34.692229 12293 raft_consensus.cc:2804] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:02:34.693579 12293 raft_consensus.cc:697] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [term 4 LEADER]: Becoming Leader. State: Replica: aeb8ce119f6745168cdf20d825ab6d94, State: Running, Role: LEADER
I20260709 13:02:34.694495 12293 consensus_queue.cc:237] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:34.701941 11964 catalog_manager.cc:5697] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 reported cstate change: term changed from 3 to 4, leader changed from bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193) to aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194). New cstate: current_term: 4 leader_uuid: "aeb8ce119f6745168cdf20d825ab6d94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:34.828459 12369 raft_consensus.cc:993] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753: : Instructing follower aeb8ce119f6745168cdf20d825ab6d94 to start an election
I20260709 13:02:34.829169 12401 raft_consensus.cc:1081] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [term 2 LEADER]: Signalling peer aeb8ce119f6745168cdf20d825ab6d94 to start an election
I20260709 13:02:34.831028 12144 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1e6a832558da4cd2895591a547ff6c11"
dest_uuid: "aeb8ce119f6745168cdf20d825ab6d94"
 from {username='slave'} at 127.0.0.1:56960
I20260709 13:02:34.831526 12144 raft_consensus.cc:493] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:34.831794 12144 raft_consensus.cc:3060] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:34.835965 12144 raft_consensus.cc:515] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:34.837343 12144 leader_election.cc:290] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 3 election: Requested vote from peers bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115), 0291cd32b58e4e28a40b13ff1b8c9634 (127.11.44.195:40353)
I20260709 13:02:34.838424 12069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e6a832558da4cd2895591a547ff6c11" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bc350fb650c74e8696ea2aae28d8a753"
I20260709 13:02:34.838486 12216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e6a832558da4cd2895591a547ff6c11" candidate_uuid: "aeb8ce119f6745168cdf20d825ab6d94" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0291cd32b58e4e28a40b13ff1b8c9634"
I20260709 13:02:34.838960 12069 raft_consensus.cc:3055] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:34.839036 12216 raft_consensus.cc:3060] T 1e6a832558da4cd2895591a547ff6c11 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:34.839237 12069 raft_consensus.cc:740] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bc350fb650c74e8696ea2aae28d8a753, State: Running, Role: LEADER
I20260709 13:02:34.839947 12069 consensus_queue.cc:260] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:34.841081 12069 raft_consensus.cc:3060] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:34.844421 12216 raft_consensus.cc:2468] T 1e6a832558da4cd2895591a547ff6c11 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aeb8ce119f6745168cdf20d825ab6d94 in term 3.
I20260709 13:02:34.845624 12108 leader_election.cc:304] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0291cd32b58e4e28a40b13ff1b8c9634, aeb8ce119f6745168cdf20d825ab6d94; no voters: 
I20260709 13:02:34.845744 12069 raft_consensus.cc:2468] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aeb8ce119f6745168cdf20d825ab6d94 in term 3.
I20260709 13:02:34.846442 12293 raft_consensus.cc:2804] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:34.846956 12293 raft_consensus.cc:697] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 3 LEADER]: Becoming Leader. State: Replica: aeb8ce119f6745168cdf20d825ab6d94, State: Running, Role: LEADER
I20260709 13:02:34.847874 12293 consensus_queue.cc:237] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } }
I20260709 13:02:34.857550 11964 catalog_manager.cc:5697] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 reported cstate change: term changed from 2 to 3, leader changed from bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193) to aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194). New cstate: current_term: 3 leader_uuid: "aeb8ce119f6745168cdf20d825ab6d94" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:34.957499 12144 raft_consensus.cc:1275] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [term 4 FOLLOWER]: Refusing update from remote peer 0291cd32b58e4e28a40b13ff1b8c9634: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:34.958897 12393 consensus_queue.cc:1048] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:34.970171 12069 raft_consensus.cc:1275] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 4 FOLLOWER]: Refusing update from remote peer 0291cd32b58e4e28a40b13ff1b8c9634: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:34.972937 12393 consensus_queue.cc:1048] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:35.121528 12069 raft_consensus.cc:1275] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 4 FOLLOWER]: Refusing update from remote peer aeb8ce119f6745168cdf20d825ab6d94: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:35.122844 12293 consensus_queue.cc:1048] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:35.132943 12216 raft_consensus.cc:1275] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 4 FOLLOWER]: Refusing update from remote peer aeb8ce119f6745168cdf20d825ab6d94: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:02:35.134994 12411 consensus_queue.cc:1048] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:35.226817 12069 raft_consensus.cc:1275] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [term 3 FOLLOWER]: Refusing update from remote peer 0291cd32b58e4e28a40b13ff1b8c9634: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:35.228078 12394 consensus_queue.cc:1048] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:35.236936 12068 raft_consensus.cc:1275] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [term 3 FOLLOWER]: Refusing update from remote peer aeb8ce119f6745168cdf20d825ab6d94: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:35.237403 12144 raft_consensus.cc:1275] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [term 3 FOLLOWER]: Refusing update from remote peer 0291cd32b58e4e28a40b13ff1b8c9634: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:35.238790 12411 consensus_queue.cc:1048] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc350fb650c74e8696ea2aae28d8a753" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 40115 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:35.239022 12394 consensus_queue.cc:1048] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aeb8ce119f6745168cdf20d825ab6d94" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:35.253334 12216 raft_consensus.cc:1275] T 1e6a832558da4cd2895591a547ff6c11 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 FOLLOWER]: Refusing update from remote peer aeb8ce119f6745168cdf20d825ab6d94: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:35.254999 12411 consensus_queue.cc:1048] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0291cd32b58e4e28a40b13ff1b8c9634" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 40353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:35.406927 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:35.412905 11443 tablet_server.cc:179] TabletServer@127.11.44.193:0 shutting down...
I20260709 13:02:35.434729 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:35.435752 11443 tablet_replica.cc:333] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753: stopping tablet replica
I20260709 13:02:35.436405 11443 raft_consensus.cc:2243] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.436893 11443 raft_consensus.cc:2272] T 1e6a832558da4cd2895591a547ff6c11 P bc350fb650c74e8696ea2aae28d8a753 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.439370 11443 tablet_replica.cc:333] T 77ce751ee8a74f3fb9e788ff82aa6e64 P bc350fb650c74e8696ea2aae28d8a753: stopping tablet replica
I20260709 13:02:35.439977 11443 raft_consensus.cc:2243] T 77ce751ee8a74f3fb9e788ff82aa6e64 P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.440469 11443 raft_consensus.cc:2272] T 77ce751ee8a74f3fb9e788ff82aa6e64 P bc350fb650c74e8696ea2aae28d8a753 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.442382 11443 tablet_replica.cc:333] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753: stopping tablet replica
I20260709 13:02:35.442931 11443 raft_consensus.cc:2243] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:02:35.443708 11443 raft_consensus.cc:2272] T ab463b4fae464214b1a0f42acba1d16b P bc350fb650c74e8696ea2aae28d8a753 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.445464 11443 tablet_replica.cc:333] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753: stopping tablet replica
I20260709 13:02:35.446076 11443 raft_consensus.cc:2243] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.446519 11443 raft_consensus.cc:2272] T 4f17c2df097349819756cac635ed58fc P bc350fb650c74e8696ea2aae28d8a753 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.448892 11443 tablet_replica.cc:333] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753: stopping tablet replica
I20260709 13:02:35.449456 11443 raft_consensus.cc:2243] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.449990 11443 raft_consensus.cc:2272] T 0872387060684098a1fbe3e1f23a0c8d P bc350fb650c74e8696ea2aae28d8a753 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.452404 11443 tablet_replica.cc:333] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753: stopping tablet replica
I20260709 13:02:35.452996 11443 raft_consensus.cc:2243] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.453454 11443 raft_consensus.cc:2272] T f1abeea0e34944a5a483d23409d4e963 P bc350fb650c74e8696ea2aae28d8a753 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.455965 11443 tablet_replica.cc:333] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753: stopping tablet replica
I20260709 13:02:35.456465 11443 raft_consensus.cc:2243] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:35.457343 11443 raft_consensus.cc:2272] T f4d15850c4a34c10b3c309fff1dc30b8 P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.459227 11443 tablet_replica.cc:333] T 36c91f4f816446e592ed36b65caeb73f P bc350fb650c74e8696ea2aae28d8a753: stopping tablet replica
I20260709 13:02:35.459740 11443 raft_consensus.cc:2243] T 36c91f4f816446e592ed36b65caeb73f P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.460467 11443 raft_consensus.cc:2272] T 36c91f4f816446e592ed36b65caeb73f P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.462623 11443 tablet_replica.cc:333] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753: stopping tablet replica
I20260709 13:02:35.463151 11443 raft_consensus.cc:2243] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:35.464066 11443 raft_consensus.cc:2272] T de1e688e3be741f9bbec4ef43ab84b01 P bc350fb650c74e8696ea2aae28d8a753 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.465951 11443 tablet_replica.cc:333] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753: stopping tablet replica
I20260709 13:02:35.466390 11443 raft_consensus.cc:2243] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:35.467132 11443 raft_consensus.cc:2272] T 4571992e2e3943b091d962f680812086 P bc350fb650c74e8696ea2aae28d8a753 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.497790 11443 tablet_server.cc:196] TabletServer@127.11.44.193:0 shutdown complete.
I20260709 13:02:35.518872 11443 tablet_server.cc:179] TabletServer@127.11.44.194:0 shutting down...
W20260709 13:02:35.530936 12181 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.44.193:40115: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260709 13:02:35.539764 12181 consensus_peers.cc:597] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 -> Peer bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115): Couldn't send request to peer bc350fb650c74e8696ea2aae28d8a753. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:40115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:35.552229 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:35.553149 11443 tablet_replica.cc:333] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94: stopping tablet replica
I20260709 13:02:35.554000 11443 raft_consensus.cc:2243] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:35.554809 11443 raft_consensus.cc:2272] T 77ce751ee8a74f3fb9e788ff82aa6e64 P aeb8ce119f6745168cdf20d825ab6d94 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.556638 11443 tablet_replica.cc:333] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94: stopping tablet replica
I20260709 13:02:35.557451 11443 raft_consensus.cc:2243] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:35.558405 11443 raft_consensus.cc:2272] T 1e6a832558da4cd2895591a547ff6c11 P aeb8ce119f6745168cdf20d825ab6d94 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.561094 11443 tablet_replica.cc:333] T 4571992e2e3943b091d962f680812086 P aeb8ce119f6745168cdf20d825ab6d94: stopping tablet replica
I20260709 13:02:35.561967 11443 raft_consensus.cc:2243] T 4571992e2e3943b091d962f680812086 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.562481 11443 raft_consensus.cc:2272] T 4571992e2e3943b091d962f680812086 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:35.563565 12181 consensus_peers.cc:597] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 -> Peer bc350fb650c74e8696ea2aae28d8a753 (127.11.44.193:40115): Couldn't send request to peer bc350fb650c74e8696ea2aae28d8a753. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:40115: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:35.565220 11443 tablet_replica.cc:333] T 36c91f4f816446e592ed36b65caeb73f P aeb8ce119f6745168cdf20d825ab6d94: stopping tablet replica
I20260709 13:02:35.565858 11443 raft_consensus.cc:2243] T 36c91f4f816446e592ed36b65caeb73f P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.566303 11443 raft_consensus.cc:2272] T 36c91f4f816446e592ed36b65caeb73f P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.568243 11443 tablet_replica.cc:333] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94: stopping tablet replica
I20260709 13:02:35.568780 11443 raft_consensus.cc:2243] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.569191 11443 raft_consensus.cc:2272] T de1e688e3be741f9bbec4ef43ab84b01 P aeb8ce119f6745168cdf20d825ab6d94 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.571013 11443 tablet_replica.cc:333] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94: stopping tablet replica
I20260709 13:02:35.571584 11443 raft_consensus.cc:2243] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.572187 11443 raft_consensus.cc:2272] T 0872387060684098a1fbe3e1f23a0c8d P aeb8ce119f6745168cdf20d825ab6d94 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.574589 11443 tablet_replica.cc:333] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94: stopping tablet replica
I20260709 13:02:35.575239 11443 raft_consensus.cc:2243] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:02:35.576146 11443 raft_consensus.cc:2272] T f1abeea0e34944a5a483d23409d4e963 P aeb8ce119f6745168cdf20d825ab6d94 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.578251 11443 tablet_replica.cc:333] T f4d15850c4a34c10b3c309fff1dc30b8 P aeb8ce119f6745168cdf20d825ab6d94: stopping tablet replica
I20260709 13:02:35.578747 11443 raft_consensus.cc:2243] T f4d15850c4a34c10b3c309fff1dc30b8 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.579092 11443 raft_consensus.cc:2272] T f4d15850c4a34c10b3c309fff1dc30b8 P aeb8ce119f6745168cdf20d825ab6d94 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.580855 11443 tablet_replica.cc:333] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94: stopping tablet replica
I20260709 13:02:35.581336 11443 raft_consensus.cc:2243] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.581785 11443 raft_consensus.cc:2272] T ab463b4fae464214b1a0f42acba1d16b P aeb8ce119f6745168cdf20d825ab6d94 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.583523 11443 tablet_replica.cc:333] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94: stopping tablet replica
I20260709 13:02:35.584000 11443 raft_consensus.cc:2243] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.584455 11443 raft_consensus.cc:2272] T 4f17c2df097349819756cac635ed58fc P aeb8ce119f6745168cdf20d825ab6d94 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.616508 11443 tablet_server.cc:196] TabletServer@127.11.44.194:0 shutdown complete.
I20260709 13:02:35.635541 11443 tablet_server.cc:179] TabletServer@127.11.44.195:0 shutting down...
W20260709 13:02:35.661369 12184 consensus_peers.cc:597] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 -> Peer aeb8ce119f6745168cdf20d825ab6d94 (127.11.44.194:44163): Couldn't send request to peer aeb8ce119f6745168cdf20d825ab6d94. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:44163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:35.670117 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:35.671115 11443 tablet_replica.cc:333] T 4571992e2e3943b091d962f680812086 P 0291cd32b58e4e28a40b13ff1b8c9634: stopping tablet replica
I20260709 13:02:35.672156 11443 raft_consensus.cc:2243] T 4571992e2e3943b091d962f680812086 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.672858 11443 raft_consensus.cc:2272] T 4571992e2e3943b091d962f680812086 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.674829 11443 tablet_replica.cc:333] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634: stopping tablet replica
I20260709 13:02:35.675367 11443 raft_consensus.cc:2243] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.675897 11443 raft_consensus.cc:2272] T 77ce751ee8a74f3fb9e788ff82aa6e64 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.677976 11443 tablet_replica.cc:333] T 1e6a832558da4cd2895591a547ff6c11 P 0291cd32b58e4e28a40b13ff1b8c9634: stopping tablet replica
I20260709 13:02:35.678750 11443 raft_consensus.cc:2243] T 1e6a832558da4cd2895591a547ff6c11 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.679188 11443 raft_consensus.cc:2272] T 1e6a832558da4cd2895591a547ff6c11 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.681300 11443 tablet_replica.cc:333] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634: stopping tablet replica
I20260709 13:02:35.681907 11443 raft_consensus.cc:2243] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.682314 11443 raft_consensus.cc:2272] T ab463b4fae464214b1a0f42acba1d16b P 0291cd32b58e4e28a40b13ff1b8c9634 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.684180 11443 tablet_replica.cc:333] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634: stopping tablet replica
I20260709 13:02:35.684674 11443 raft_consensus.cc:2243] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:35.685390 11443 raft_consensus.cc:2272] T 4f17c2df097349819756cac635ed58fc P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.688234 11443 tablet_replica.cc:333] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634: stopping tablet replica
I20260709 13:02:35.688745 11443 raft_consensus.cc:2243] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:35.689507 11443 raft_consensus.cc:2272] T 36c91f4f816446e592ed36b65caeb73f P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.691359 11443 tablet_replica.cc:333] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634: stopping tablet replica
I20260709 13:02:35.691855 11443 raft_consensus.cc:2243] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.692271 11443 raft_consensus.cc:2272] T de1e688e3be741f9bbec4ef43ab84b01 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.694073 11443 tablet_replica.cc:333] T f4d15850c4a34c10b3c309fff1dc30b8 P 0291cd32b58e4e28a40b13ff1b8c9634: stopping tablet replica
I20260709 13:02:35.694572 11443 raft_consensus.cc:2243] T f4d15850c4a34c10b3c309fff1dc30b8 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.694944 11443 raft_consensus.cc:2272] T f4d15850c4a34c10b3c309fff1dc30b8 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.696579 11443 tablet_replica.cc:333] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634: stopping tablet replica
I20260709 13:02:35.697012 11443 raft_consensus.cc:2243] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:35.697386 11443 raft_consensus.cc:2272] T f1abeea0e34944a5a483d23409d4e963 P 0291cd32b58e4e28a40b13ff1b8c9634 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.699746 11443 tablet_replica.cc:333] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634: stopping tablet replica
I20260709 13:02:35.700217 11443 raft_consensus.cc:2243] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:02:35.700938 11443 raft_consensus.cc:2272] T 0872387060684098a1fbe3e1f23a0c8d P 0291cd32b58e4e28a40b13ff1b8c9634 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.731093 11443 tablet_server.cc:196] TabletServer@127.11.44.195:0 shutdown complete.
I20260709 13:02:35.752107 11443 master.cc:562] Master@127.11.44.254:43091 shutting down...
I20260709 13:02:35.777387 11443 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:35.778041 11443 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:35.778343 11443 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8228c1ca674648ec8fc8de83315fd9fd: stopping tablet replica
I20260709 13:02:35.800040 11443 master.cc:584] Master@127.11.44.254:43091 shutdown complete.
0291cd32b58e4e28a40b13ff1b8c9634  1
aeb8ce119f6745168cdf20d825ab6d94  4
bc350fb650c74e8696ea2aae28d8a753  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10505 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:02:35.842994 11443 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.44.254:44047
I20260709 13:02:35.844060 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:35.849660 12420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:35.849725 12421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:35.852277 12423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:35.852526 11443 server_base.cc:1061] running on GCE node
I20260709 13:02:35.853545 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:35.854113 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:35.854236 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602155854225 us; error 0 us; skew 500 ppm
I20260709 13:02:35.854984 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:35.857925 11443 webserver.cc:533] Webserver started at http://127.11.44.254:36559/ using document root <none> and password file <none>
I20260709 13:02:35.858374 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:35.858523 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:35.858748 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:35.859853 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/master-0-root/instance:
uuid: "78966838052c4dd980a04a5b750887f1"
format_stamp: "Formatted at 2026-07-09 13:02:35 on dist-test-slave-qv7r"
I20260709 13:02:35.864518 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:02:35.868436 12428 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:35.869417 11443 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:02:35.869784 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/master-0-root
uuid: "78966838052c4dd980a04a5b750887f1"
format_stamp: "Formatted at 2026-07-09 13:02:35 on dist-test-slave-qv7r"
I20260709 13:02:35.870043 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:35.914264 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:35.915493 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:35.958024 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.254:44047
I20260709 13:02:35.958122 12479 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.254:44047 every 8 connection(s)
I20260709 13:02:35.962004 12480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:35.972229 12480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1: Bootstrap starting.
I20260709 13:02:35.976811 12480 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:35.981127 12480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1: No bootstrap required, opened a new log
I20260709 13:02:35.983258 12480 raft_consensus.cc:359] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78966838052c4dd980a04a5b750887f1" member_type: VOTER }
I20260709 13:02:35.983647 12480 raft_consensus.cc:385] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:35.983928 12480 raft_consensus.cc:740] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78966838052c4dd980a04a5b750887f1, State: Initialized, Role: FOLLOWER
I20260709 13:02:35.984593 12480 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78966838052c4dd980a04a5b750887f1" member_type: VOTER }
I20260709 13:02:35.985069 12480 raft_consensus.cc:399] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:35.985267 12480 raft_consensus.cc:493] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:35.985546 12480 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:35.989971 12480 raft_consensus.cc:515] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78966838052c4dd980a04a5b750887f1" member_type: VOTER }
I20260709 13:02:35.990523 12480 leader_election.cc:304] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 78966838052c4dd980a04a5b750887f1; no voters: 
I20260709 13:02:35.991755 12480 leader_election.cc:290] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:35.992225 12483 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:35.993682 12483 raft_consensus.cc:697] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1 [term 1 LEADER]: Becoming Leader. State: Replica: 78966838052c4dd980a04a5b750887f1, State: Running, Role: LEADER
I20260709 13:02:35.994378 12483 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78966838052c4dd980a04a5b750887f1" member_type: VOTER }
I20260709 13:02:35.994915 12480 sys_catalog.cc:565] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:35.997326 12484 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "78966838052c4dd980a04a5b750887f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78966838052c4dd980a04a5b750887f1" member_type: VOTER } }
I20260709 13:02:35.997222 12485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78966838052c4dd980a04a5b750887f1. Latest consensus state: current_term: 1 leader_uuid: "78966838052c4dd980a04a5b750887f1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78966838052c4dd980a04a5b750887f1" member_type: VOTER } }
I20260709 13:02:35.997977 12484 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:35.998052 12485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:36.001765 12488 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:36.006654 12488 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:36.011359 11443 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:36.015468 12488 catalog_manager.cc:1383] Generated new cluster ID: fb05f7c9f5734d8e91cce09f68f4b5c5
I20260709 13:02:36.015765 12488 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:36.036192 12488 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:36.037485 12488 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:36.057318 12488 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1: Generated new TSK 0
I20260709 13:02:36.058069 12488 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:36.079109 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:36.085779 12501 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:36.086568 12502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:36.088311 12504 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:36.089015 11443 server_base.cc:1061] running on GCE node
I20260709 13:02:36.089850 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:36.090034 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:36.090220 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602156090206 us; error 0 us; skew 500 ppm
I20260709 13:02:36.090783 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:36.093123 11443 webserver.cc:533] Webserver started at http://127.11.44.193:37415/ using document root <none> and password file <none>
I20260709 13:02:36.093659 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:36.093842 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:36.094126 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:36.095183 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-0-root/instance:
uuid: "a70479a3b4114f3581095e9890f5d653"
format_stamp: "Formatted at 2026-07-09 13:02:36 on dist-test-slave-qv7r"
I20260709 13:02:36.099952 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:02:36.103864 12509 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:36.104792 11443 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:02:36.105146 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-0-root
uuid: "a70479a3b4114f3581095e9890f5d653"
format_stamp: "Formatted at 2026-07-09 13:02:36 on dist-test-slave-qv7r"
I20260709 13:02:36.105477 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:36.119052 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:36.120249 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:36.121902 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:36.124280 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:36.124473 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:36.124660 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:36.124795 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:36.169960 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.193:43307
I20260709 13:02:36.170056 12571 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.193:43307 every 8 connection(s)
I20260709 13:02:36.174983 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:36.183774 12576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:36.184891 12577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:36.188088 12579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:36.188868 11443 server_base.cc:1061] running on GCE node
I20260709 13:02:36.190120 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:36.190380 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:36.190632 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602156190611 us; error 0 us; skew 500 ppm
I20260709 13:02:36.191285 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:36.193714 12572 heartbeater.cc:344] Connected to a master server at 127.11.44.254:44047
I20260709 13:02:36.194198 12572 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:36.194347 11443 webserver.cc:533] Webserver started at http://127.11.44.194:33107/ using document root <none> and password file <none>
I20260709 13:02:36.194962 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:36.195070 12572 heartbeater.cc:507] Master 127.11.44.254:44047 requested a full tablet report, sending...
I20260709 13:02:36.195223 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:36.195564 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:36.196931 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-1-root/instance:
uuid: "a11816c5d72e4d1295a242f3ced09e5f"
format_stamp: "Formatted at 2026-07-09 13:02:36 on dist-test-slave-qv7r"
I20260709 13:02:36.197741 12445 ts_manager.cc:194] Registered new tserver with Master: a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307)
I20260709 13:02:36.199455 12445 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36394
I20260709 13:02:36.202170 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:02:36.206023 12584 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:36.207065 11443 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:02:36.207432 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-1-root
uuid: "a11816c5d72e4d1295a242f3ced09e5f"
format_stamp: "Formatted at 2026-07-09 13:02:36 on dist-test-slave-qv7r"
I20260709 13:02:36.207828 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:36.226230 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:36.227444 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:36.228965 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:36.231205 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:36.231436 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:36.231666 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:36.231835 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:36.275677 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.194:41653
I20260709 13:02:36.275768 12646 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.194:41653 every 8 connection(s)
I20260709 13:02:36.280543 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:36.287189 12650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:36.287815 12651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:36.291424 11443 server_base.cc:1061] running on GCE node
W20260709 13:02:36.291975 12654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:36.293051 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:36.293334 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:36.293556 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602156293516 us; error 0 us; skew 500 ppm
I20260709 13:02:36.293831 12647 heartbeater.cc:344] Connected to a master server at 127.11.44.254:44047
I20260709 13:02:36.294178 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:36.294232 12647 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:36.295166 12647 heartbeater.cc:507] Master 127.11.44.254:44047 requested a full tablet report, sending...
I20260709 13:02:36.297014 11443 webserver.cc:533] Webserver started at http://127.11.44.195:45021/ using document root <none> and password file <none>
I20260709 13:02:36.297511 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:36.297441 12445 ts_manager.cc:194] Registered new tserver with Master: a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:36.297858 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:36.298233 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:36.299232 12445 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36396
I20260709 13:02:36.299314 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-2-root/instance:
uuid: "7ad68e814a7741488971822f2598183a"
format_stamp: "Formatted at 2026-07-09 13:02:36 on dist-test-slave-qv7r"
I20260709 13:02:36.304220 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:02:36.307925 12658 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:36.308808 11443 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:02:36.309053 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-2-root
uuid: "7ad68e814a7741488971822f2598183a"
format_stamp: "Formatted at 2026-07-09 13:02:36 on dist-test-slave-qv7r"
I20260709 13:02:36.309333 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:36.328797 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:36.330075 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:36.331739 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:36.333997 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:36.334178 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:36.334510 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:36.334674 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:36.380697 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.195:34641
I20260709 13:02:36.380767 12720 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.195:34641 every 8 connection(s)
I20260709 13:02:36.397178 12721 heartbeater.cc:344] Connected to a master server at 127.11.44.254:44047
I20260709 13:02:36.397554 12721 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:36.398587 12721 heartbeater.cc:507] Master 127.11.44.254:44047 requested a full tablet report, sending...
I20260709 13:02:36.400863 12445 ts_manager.cc:194] Registered new tserver with Master: 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:36.401656 11443 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017541991s
I20260709 13:02:36.402637 12445 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36398
I20260709 13:02:36.433877 12445 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36410:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:36.440570 12445 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:36.662824 12612 tablet_service.cc:1511] Processing CreateTablet for tablet 8b8383d4233b4ad5871ffc0dc8d82321 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:02:36.663621 12610 tablet_service.cc:1511] Processing CreateTablet for tablet d88c15b898154821b2931e6b0f47833e (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:02:36.664424 12612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b8383d4233b4ad5871ffc0dc8d82321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.664582 12611 tablet_service.cc:1511] Processing CreateTablet for tablet 588a15c12a6c46ab9373c48890191400 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:02:36.665112 12610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88c15b898154821b2931e6b0f47833e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.665961 12611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 588a15c12a6c46ab9373c48890191400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.666761 12609 tablet_service.cc:1511] Processing CreateTablet for tablet 7c94183b9e8b46989e1da72e911d7aee (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:02:36.667294 12607 tablet_service.cc:1511] Processing CreateTablet for tablet b8a1e8bdbd894ee4abb7a463446fe471 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:02:36.668110 12609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c94183b9e8b46989e1da72e911d7aee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.668697 12607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8a1e8bdbd894ee4abb7a463446fe471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.668704 12608 tablet_service.cc:1511] Processing CreateTablet for tablet 5d48be0c79154aa3938113fc3c045740 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:02:36.670140 12608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d48be0c79154aa3938113fc3c045740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.683066 12686 tablet_service.cc:1511] Processing CreateTablet for tablet 8b8383d4233b4ad5871ffc0dc8d82321 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:02:36.684512 12686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b8383d4233b4ad5871ffc0dc8d82321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.686784 12685 tablet_service.cc:1511] Processing CreateTablet for tablet 588a15c12a6c46ab9373c48890191400 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:02:36.688197 12685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 588a15c12a6c46ab9373c48890191400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.688285 12684 tablet_service.cc:1511] Processing CreateTablet for tablet d88c15b898154821b2931e6b0f47833e (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:02:36.689659 12684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88c15b898154821b2931e6b0f47833e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.689292 12608 tablet_service.cc:1511] Processing CreateTablet for tablet 4b253d5a6b42486ba3b3a6e07c59f7ff (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:02:36.690524 12608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b253d5a6b42486ba3b3a6e07c59f7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.694888 12683 tablet_service.cc:1511] Processing CreateTablet for tablet 7c94183b9e8b46989e1da72e911d7aee (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:02:36.696225 12683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c94183b9e8b46989e1da72e911d7aee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.698731 12606 tablet_service.cc:1511] Processing CreateTablet for tablet 0bcff91ac60a48ff97278bdb5c4d21dc (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:02:36.700064 12606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bcff91ac60a48ff97278bdb5c4d21dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.703404 12682 tablet_service.cc:1511] Processing CreateTablet for tablet 5d48be0c79154aa3938113fc3c045740 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:02:36.704802 12682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d48be0c79154aa3938113fc3c045740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.706458 12736 tablet_bootstrap.cc:492] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:36.707470 12681 tablet_service.cc:1511] Processing CreateTablet for tablet b8a1e8bdbd894ee4abb7a463446fe471 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:02:36.709251 12681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8a1e8bdbd894ee4abb7a463446fe471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.711717 12680 tablet_service.cc:1511] Processing CreateTablet for tablet 4b253d5a6b42486ba3b3a6e07c59f7ff (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:02:36.712946 12736 tablet_bootstrap.cc:654] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.714053 12737 tablet_bootstrap.cc:492] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:36.714803 12679 tablet_service.cc:1511] Processing CreateTablet for tablet 0bcff91ac60a48ff97278bdb5c4d21dc (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:02:36.715015 12611 tablet_service.cc:1511] Processing CreateTablet for tablet 39a7784c61d94bd5a03c390c81d48e35 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:02:36.716284 12679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bcff91ac60a48ff97278bdb5c4d21dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.716223 12611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39a7784c61d94bd5a03c390c81d48e35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.719364 12680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b253d5a6b42486ba3b3a6e07c59f7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.721875 12684 tablet_service.cc:1511] Processing CreateTablet for tablet 39a7784c61d94bd5a03c390c81d48e35 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:02:36.723201 12684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39a7784c61d94bd5a03c390c81d48e35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.736502 12679 tablet_service.cc:1511] Processing CreateTablet for tablet 0f7c3aec6a56450cb76aab45d874eff7 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:02:36.737001 12607 tablet_service.cc:1511] Processing CreateTablet for tablet 0f7c3aec6a56450cb76aab45d874eff7 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:02:36.738122 12679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f7c3aec6a56450cb76aab45d874eff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.738792 12607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f7c3aec6a56450cb76aab45d874eff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.754594 12537 tablet_service.cc:1511] Processing CreateTablet for tablet 8b8383d4233b4ad5871ffc0dc8d82321 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:02:36.757056 12532 tablet_service.cc:1511] Processing CreateTablet for tablet b8a1e8bdbd894ee4abb7a463446fe471 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:02:36.759478 12531 tablet_service.cc:1511] Processing CreateTablet for tablet 4b253d5a6b42486ba3b3a6e07c59f7ff (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:02:36.760847 12533 tablet_service.cc:1511] Processing CreateTablet for tablet 5d48be0c79154aa3938113fc3c045740 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:02:36.762182 12534 tablet_service.cc:1511] Processing CreateTablet for tablet 7c94183b9e8b46989e1da72e911d7aee (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:02:36.754904 12535 tablet_service.cc:1511] Processing CreateTablet for tablet d88c15b898154821b2931e6b0f47833e (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:02:36.758600 12530 tablet_service.cc:1511] Processing CreateTablet for tablet 0bcff91ac60a48ff97278bdb5c4d21dc (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:02:36.756054 12536 tablet_service.cc:1511] Processing CreateTablet for tablet 588a15c12a6c46ab9373c48890191400 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:02:36.756088 12537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b8383d4233b4ad5871ffc0dc8d82321. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.768078 12530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bcff91ac60a48ff97278bdb5c4d21dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.770071 12535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88c15b898154821b2931e6b0f47833e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.771057 12532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8a1e8bdbd894ee4abb7a463446fe471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.772017 12533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d48be0c79154aa3938113fc3c045740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.777974 12534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c94183b9e8b46989e1da72e911d7aee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.779069 12529 tablet_service.cc:1511] Processing CreateTablet for tablet 39a7784c61d94bd5a03c390c81d48e35 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:02:36.780562 12529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39a7784c61d94bd5a03c390c81d48e35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.782085 12531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b253d5a6b42486ba3b3a6e07c59f7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.786168 12536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 588a15c12a6c46ab9373c48890191400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.795799 12608 tablet_service.cc:1511] Processing CreateTablet for tablet 5161235af1b440278d598161e1de2453 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:02:36.798377 12608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5161235af1b440278d598161e1de2453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.801551 12528 tablet_service.cc:1511] Processing CreateTablet for tablet 0f7c3aec6a56450cb76aab45d874eff7 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:02:36.803011 12528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f7c3aec6a56450cb76aab45d874eff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.817030 12678 tablet_service.cc:1511] Processing CreateTablet for tablet 5161235af1b440278d598161e1de2453 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:02:36.818506 12678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5161235af1b440278d598161e1de2453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.826366 12737 tablet_bootstrap.cc:654] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.836335 12736 tablet_bootstrap.cc:492] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:36.836845 12736 ts_tablet_manager.cc:1403] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.131s	user 0.017s	sys 0.003s
I20260709 13:02:36.838279 12611 tablet_service.cc:1511] Processing CreateTablet for tablet 44ad8138d0594c32b4590c837a41891e (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:02:36.840063 12611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44ad8138d0594c32b4590c837a41891e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.850605 12535 tablet_service.cc:1511] Processing CreateTablet for tablet 44ad8138d0594c32b4590c837a41891e (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:02:36.853838 12536 tablet_service.cc:1511] Processing CreateTablet for tablet 5161235af1b440278d598161e1de2453 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:02:36.869925 12737 tablet_bootstrap.cc:492] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:36.862040 12535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44ad8138d0594c32b4590c837a41891e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.870456 12737 ts_tablet_manager.cc:1403] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.157s	user 0.009s	sys 0.005s
I20260709 13:02:36.871719 12684 tablet_service.cc:1511] Processing CreateTablet for tablet 44ad8138d0594c32b4590c837a41891e (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:02:36.873183 12684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44ad8138d0594c32b4590c837a41891e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.876118 12736 raft_consensus.cc:359] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:36.876372 12737 raft_consensus.cc:359] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:36.876971 12736 raft_consensus.cc:385] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.877277 12737 raft_consensus.cc:385] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.877731 12737 raft_consensus.cc:740] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.878701 12737 consensus_queue.cc:260] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:36.861855 12740 tablet_bootstrap.cc:492] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:36.882997 12530 tablet_service.cc:1511] Processing CreateTablet for tablet 22a877009d42412fb470ba88a418be05 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:02:36.884156 12530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a877009d42412fb470ba88a418be05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.889014 12608 tablet_service.cc:1511] Processing CreateTablet for tablet 22a877009d42412fb470ba88a418be05 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:02:36.890028 12536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5161235af1b440278d598161e1de2453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.890455 12608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a877009d42412fb470ba88a418be05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.889983 12679 tablet_service.cc:1511] Processing CreateTablet for tablet 22a877009d42412fb470ba88a418be05 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:02:36.893105 12679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a877009d42412fb470ba88a418be05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.886839 12740 tablet_bootstrap.cc:654] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.901262 12607 tablet_service.cc:1511] Processing CreateTablet for tablet 2f072313cdba43b09e842af6e98f0385 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:02:36.902623 12607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f072313cdba43b09e842af6e98f0385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.907644 12680 tablet_service.cc:1511] Processing CreateTablet for tablet 2f072313cdba43b09e842af6e98f0385 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:02:36.908123 12529 tablet_service.cc:1511] Processing CreateTablet for tablet f6ccc9457e2e4aeaac5163b9bb9f13cb (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:02:36.909242 12680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f072313cdba43b09e842af6e98f0385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.901618 12528 tablet_service.cc:1511] Processing CreateTablet for tablet 2f072313cdba43b09e842af6e98f0385 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:02:36.909430 12529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6ccc9457e2e4aeaac5163b9bb9f13cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.917140 12528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f072313cdba43b09e842af6e98f0385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.896055 12736 raft_consensus.cc:740] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.926783 12737 ts_tablet_manager.cc:1434] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.002s
I20260709 13:02:36.928002 12609 tablet_service.cc:1511] Processing CreateTablet for tablet 60708e41894c42b697291e905bff5dc6 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:02:36.928915 12530 tablet_service.cc:1511] Processing CreateTablet for tablet a269dd3f9bbd4e53a58b736c0a5bf8b9 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:02:36.929414 12681 tablet_service.cc:1511] Processing CreateTablet for tablet 60708e41894c42b697291e905bff5dc6 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:02:36.930712 12530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a269dd3f9bbd4e53a58b736c0a5bf8b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.931085 12681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60708e41894c42b697291e905bff5dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.931579 12611 tablet_service.cc:1511] Processing CreateTablet for tablet a269dd3f9bbd4e53a58b736c0a5bf8b9 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:02:36.933471 12721 heartbeater.cc:499] Master 127.11.44.254:44047 was elected leader, sending a full tablet report...
I20260709 13:02:36.933900 12537 tablet_service.cc:1511] Processing CreateTablet for tablet 60708e41894c42b697291e905bff5dc6 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:02:36.920511 12607 tablet_service.cc:1511] Processing CreateTablet for tablet f6ccc9457e2e4aeaac5163b9bb9f13cb (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:02:36.929353 12609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60708e41894c42b697291e905bff5dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.936762 12678 tablet_service.cc:1511] Processing CreateTablet for tablet f6ccc9457e2e4aeaac5163b9bb9f13cb (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:02:36.940629 12737 tablet_bootstrap.cc:492] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:36.941887 12611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a269dd3f9bbd4e53a58b736c0a5bf8b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.944686 12740 tablet_bootstrap.cc:492] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:36.945233 12740 ts_tablet_manager.cc:1403] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.084s	user 0.006s	sys 0.005s
I20260709 13:02:36.948254 12740 raft_consensus.cc:359] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:36.949023 12740 raft_consensus.cc:385] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.935067 12736 consensus_queue.cc:260] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:36.950168 12678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6ccc9457e2e4aeaac5163b9bb9f13cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.952386 12683 tablet_service.cc:1511] Processing CreateTablet for tablet a269dd3f9bbd4e53a58b736c0a5bf8b9 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:02:36.956255 12607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6ccc9457e2e4aeaac5163b9bb9f13cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.957129 12683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a269dd3f9bbd4e53a58b736c0a5bf8b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.935187 12537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60708e41894c42b697291e905bff5dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.949321 12740 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.974042 12535 tablet_service.cc:1511] Processing CreateTablet for tablet dda7dbc055d64c86aedec4299e15f997 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:02:36.975399 12535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda7dbc055d64c86aedec4299e15f997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:36.967797 12740 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:36.988698 12737 tablet_bootstrap.cc:654] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:36.996131 12609 tablet_service.cc:1511] Processing CreateTablet for tablet dda7dbc055d64c86aedec4299e15f997 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:02:36.999178 12736 ts_tablet_manager.cc:1434] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.162s	user 0.014s	sys 0.006s
I20260709 13:02:37.000296 12736 tablet_bootstrap.cc:492] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:37.000329 12682 tablet_service.cc:1511] Processing CreateTablet for tablet dda7dbc055d64c86aedec4299e15f997 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:02:37.001675 12609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda7dbc055d64c86aedec4299e15f997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.004109 12682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda7dbc055d64c86aedec4299e15f997. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:37.006680 12493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:37.000890 12647 heartbeater.cc:499] Master 127.11.44.254:44047 was elected leader, sending a full tablet report...
I20260709 13:02:37.010087 12736 tablet_bootstrap.cc:654] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.022727 12743 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.023409 12743 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.073028 12608 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec4af0b6e774d2986c11b75c9460d83 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:02:37.074695 12608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec4af0b6e774d2986c11b75c9460d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.075646 12684 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec4af0b6e774d2986c11b75c9460d83 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:02:37.076143 12743 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:37.076926 12684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec4af0b6e774d2986c11b75c9460d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.109750 12737 tablet_bootstrap.cc:492] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:37.110311 12737 ts_tablet_manager.cc:1403] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.170s	user 0.021s	sys 0.021s
I20260709 13:02:37.115046 12528 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec4af0b6e774d2986c11b75c9460d83 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:02:37.115388 12537 tablet_service.cc:1511] Processing CreateTablet for tablet 02ea9ad298ab4fa08087d24740b5a13b (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:02:37.116417 12528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec4af0b6e774d2986c11b75c9460d83. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.117036 12537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02ea9ad298ab4fa08087d24740b5a13b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.128475 12736 tablet_bootstrap.cc:492] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:37.129211 12736 ts_tablet_manager.cc:1403] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.129s	user 0.016s	sys 0.008s
I20260709 13:02:37.129428 12529 tablet_service.cc:1511] Processing CreateTablet for tablet df093254fdff40f38b8370a4e884cc5d (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:02:37.130752 12529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df093254fdff40f38b8370a4e884cc5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.131511 12741 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.131978 12741 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.132707 12736 raft_consensus.cc:359] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.133401 12736 raft_consensus.cc:385] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.133709 12736 raft_consensus.cc:740] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.134434 12736 consensus_queue.cc:260] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.137158 12741 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:37.138345 12736 ts_tablet_manager.cc:1434] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:02:37.138585 12609 tablet_service.cc:1511] Processing CreateTablet for tablet 02ea9ad298ab4fa08087d24740b5a13b (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:02:37.139546 12736 tablet_bootstrap.cc:492] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:37.140177 12609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02ea9ad298ab4fa08087d24740b5a13b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.145780 12680 tablet_service.cc:1511] Processing CreateTablet for tablet 02ea9ad298ab4fa08087d24740b5a13b (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:02:37.147051 12680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02ea9ad298ab4fa08087d24740b5a13b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.113391 12737 raft_consensus.cc:359] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.150916 12572 heartbeater.cc:499] Master 127.11.44.254:44047 was elected leader, sending a full tablet report...
I20260709 13:02:37.161480 12736 tablet_bootstrap.cc:654] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.154398 12737 raft_consensus.cc:385] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.171237 12607 tablet_service.cc:1511] Processing CreateTablet for tablet df093254fdff40f38b8370a4e884cc5d (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:02:37.172794 12607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df093254fdff40f38b8370a4e884cc5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.179230 12681 tablet_service.cc:1511] Processing CreateTablet for tablet df093254fdff40f38b8370a4e884cc5d (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:02:37.180583 12681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df093254fdff40f38b8370a4e884cc5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.182731 12740 ts_tablet_manager.cc:1434] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.237s	user 0.018s	sys 0.012s
I20260709 13:02:37.185410 12740 tablet_bootstrap.cc:492] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:37.168742 12737 raft_consensus.cc:740] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.195554 12608 tablet_service.cc:1511] Processing CreateTablet for tablet ee851126f3964a84a26d5d9a400ec3a8 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:02:37.197059 12608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee851126f3964a84a26d5d9a400ec3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.201879 12737 consensus_queue.cc:260] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.206831 12683 tablet_service.cc:1511] Processing CreateTablet for tablet ee851126f3964a84a26d5d9a400ec3a8 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:02:37.208485 12683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee851126f3964a84a26d5d9a400ec3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.209054 12737 ts_tablet_manager.cc:1434] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.098s	user 0.007s	sys 0.000s
I20260709 13:02:37.212402 12535 tablet_service.cc:1511] Processing CreateTablet for tablet 9209cf88e9b140a58be2e0d349b1263b (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:02:37.214103 12535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9209cf88e9b140a58be2e0d349b1263b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.213930 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:02:37.215840 12659 leader_election.cc:343] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.218708 12530 tablet_service.cc:1511] Processing CreateTablet for tablet ee851126f3964a84a26d5d9a400ec3a8 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:02:37.220448 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:37.222126 12588 leader_election.cc:343] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.226315 12737 tablet_bootstrap.cc:492] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:37.232816 12611 tablet_service.cc:1511] Processing CreateTablet for tablet 9209cf88e9b140a58be2e0d349b1263b (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:02:37.234249 12611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9209cf88e9b140a58be2e0d349b1263b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.235756 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:02:37.237493 12587 leader_election.cc:343] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.238015 12587 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:37.239248 12743 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:37.239192 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:37.241398 12662 leader_election.cc:343] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.241899 12662 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:37.242710 12741 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:37.248672 12743 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.249464 12743 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.251776 12743 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:37.253001 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:37.253719 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:37.254040 12740 tablet_bootstrap.cc:654] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:37.254539 12588 leader_election.cc:343] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:37.255164 12587 leader_election.cc:343] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.255465 12587 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:37.256036 12743 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:37.256834 12530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee851126f3964a84a26d5d9a400ec3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.258949 12736 tablet_bootstrap.cc:492] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:37.259503 12736 ts_tablet_manager.cc:1403] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.120s	user 0.010s	sys 0.016s
I20260709 13:02:37.262946 12736 raft_consensus.cc:359] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.263741 12736 raft_consensus.cc:385] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.263797 12682 tablet_service.cc:1511] Processing CreateTablet for tablet 9209cf88e9b140a58be2e0d349b1263b (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:02:37.264235 12736 raft_consensus.cc:740] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.265128 12736 consensus_queue.cc:260] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.268508 12736 ts_tablet_manager.cc:1434] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:02:37.269521 12736 tablet_bootstrap.cc:492] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:37.273011 12740 tablet_bootstrap.cc:492] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:37.273540 12740 ts_tablet_manager.cc:1403] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.088s	user 0.009s	sys 0.002s
I20260709 13:02:37.275807 12736 tablet_bootstrap.cc:654] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.276835 12740 raft_consensus.cc:359] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.277680 12740 raft_consensus.cc:385] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.278002 12740 raft_consensus.cc:740] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.278748 12740 consensus_queue.cc:260] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.281698 12740 ts_tablet_manager.cc:1434] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:02:37.284659 12535 tablet_service.cc:1511] Processing CreateTablet for tablet 1d83186354414170b4775351916c56c2 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:02:37.287246 12535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d83186354414170b4775351916c56c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.291967 12609 tablet_service.cc:1511] Processing CreateTablet for tablet 1d83186354414170b4775351916c56c2 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:02:37.293339 12609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d83186354414170b4775351916c56c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.294201 12737 tablet_bootstrap.cc:654] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.283077 12740 tablet_bootstrap.cc:492] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:37.296855 12680 tablet_service.cc:1511] Processing CreateTablet for tablet 1d83186354414170b4775351916c56c2 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:02:37.265232 12682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9209cf88e9b140a58be2e0d349b1263b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.300616 12680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d83186354414170b4775351916c56c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.306677 12740 tablet_bootstrap.cc:654] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.325167 12737 tablet_bootstrap.cc:492] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:37.325776 12737 ts_tablet_manager.cc:1403] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.100s	user 0.013s	sys 0.021s
I20260709 13:02:37.327716 12740 tablet_bootstrap.cc:492] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:37.328361 12740 ts_tablet_manager.cc:1403] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.001s
I20260709 13:02:37.328078 12529 tablet_service.cc:1511] Processing CreateTablet for tablet 0767462f04d344b5a4fce9de7e885245 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:02:37.328871 12737 raft_consensus.cc:359] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.329707 12529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0767462f04d344b5a4fce9de7e885245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.332554 12609 tablet_service.cc:1511] Processing CreateTablet for tablet 0767462f04d344b5a4fce9de7e885245 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:02:37.333978 12609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0767462f04d344b5a4fce9de7e885245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.336884 12740 raft_consensus.cc:359] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.329684 12737 raft_consensus.cc:385] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.338156 12740 raft_consensus.cc:385] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.338558 12737 raft_consensus.cc:740] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.338704 12740 raft_consensus.cc:740] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.339855 12740 consensus_queue.cc:260] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.343140 12683 tablet_service.cc:1511] Processing CreateTablet for tablet 0767462f04d344b5a4fce9de7e885245 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:02:37.344467 12683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0767462f04d344b5a4fce9de7e885245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.349211 12744 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.349745 12744 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.353963 12535 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0f42b279a3452b8aebddcb497afc9d (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:02:37.355345 12535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0f42b279a3452b8aebddcb497afc9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.355438 12743 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.355989 12743 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.358613 12743 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:37.359583 12736 tablet_bootstrap.cc:492] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:37.359731 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:37.360129 12736 ts_tablet_manager.cc:1403] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.091s	user 0.027s	sys 0.028s
I20260709 13:02:37.361071 12744 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:02:37.361153 12587 leader_election.cc:343] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.361805 12744 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.362308 12744 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.367547 12744 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:37.369092 12736 raft_consensus.cc:359] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.369850 12736 raft_consensus.cc:385] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.370155 12736 raft_consensus.cc:740] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.370898 12736 consensus_queue.cc:260] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.372330 12611 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0f42b279a3452b8aebddcb497afc9d (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:02:37.372745 12740 ts_tablet_manager.cc:1434] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.001s
I20260709 13:02:37.374229 12611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0f42b279a3452b8aebddcb497afc9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.376994 12681 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0f42b279a3452b8aebddcb497afc9d (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:02:37.378399 12681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0f42b279a3452b8aebddcb497afc9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.381307 12740 tablet_bootstrap.cc:492] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:37.382606 12537 tablet_service.cc:1511] Processing CreateTablet for tablet 67b0620b67b94f25ad79a8b18732686a (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:02:37.382920 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:37.383888 12537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67b0620b67b94f25ad79a8b18732686a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.384120 12736 ts_tablet_manager.cc:1434] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
W20260709 13:02:37.384248 12588 leader_election.cc:343] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.384745 12588 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:37.385890 12743 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:37.339844 12737 consensus_queue.cc:260] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.390494 12736 tablet_bootstrap.cc:492] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:37.395058 12737 ts_tablet_manager.cc:1434] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.069s	user 0.004s	sys 0.002s
I20260709 13:02:37.398367 12737 tablet_bootstrap.cc:492] T 588a15c12a6c46ab9373c48890191400 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:37.415010 12608 tablet_service.cc:1511] Processing CreateTablet for tablet 67b0620b67b94f25ad79a8b18732686a (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:02:37.416353 12608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67b0620b67b94f25ad79a8b18732686a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.425503 12736 tablet_bootstrap.cc:654] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.426587 12680 tablet_service.cc:1511] Processing CreateTablet for tablet 67b0620b67b94f25ad79a8b18732686a (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:02:37.427932 12740 tablet_bootstrap.cc:654] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.428004 12680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67b0620b67b94f25ad79a8b18732686a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.434156 12737 tablet_bootstrap.cc:654] T 588a15c12a6c46ab9373c48890191400 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.452733 12684 tablet_service.cc:1511] Processing CreateTablet for tablet 8c94bcdd6f18485cabc0ed14df679880 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:02:37.454074 12684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c94bcdd6f18485cabc0ed14df679880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.457139 12609 tablet_service.cc:1511] Processing CreateTablet for tablet 8c94bcdd6f18485cabc0ed14df679880 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:02:37.458562 12609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c94bcdd6f18485cabc0ed14df679880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.459141 12678 tablet_service.cc:1511] Processing CreateTablet for tablet e396b3164bf5409c9d6b0dd8dc22cd2d (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:02:37.460368 12678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e396b3164bf5409c9d6b0dd8dc22cd2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.464514 12611 tablet_service.cc:1511] Processing CreateTablet for tablet e396b3164bf5409c9d6b0dd8dc22cd2d (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:02:37.465870 12611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e396b3164bf5409c9d6b0dd8dc22cd2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.468909 12528 tablet_service.cc:1511] Processing CreateTablet for tablet bf1f0526c7954a23b36c79f2c2b19122 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:02:37.469619 12530 tablet_service.cc:1511] Processing CreateTablet for tablet e396b3164bf5409c9d6b0dd8dc22cd2d (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:02:37.470229 12528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf1f0526c7954a23b36c79f2c2b19122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.474671 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:37.477314 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:02:37.481593 12510 leader_election.cc:343] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:37.482373 12510 leader_election.cc:343] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.497454 12537 tablet_service.cc:1511] Processing CreateTablet for tablet 8c94bcdd6f18485cabc0ed14df679880 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:02:37.499032 12537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c94bcdd6f18485cabc0ed14df679880. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.499339 12607 tablet_service.cc:1511] Processing CreateTablet for tablet bf1f0526c7954a23b36c79f2c2b19122 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:02:37.505059 12607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf1f0526c7954a23b36c79f2c2b19122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.504968 12536 tablet_service.cc:1511] Processing CreateTablet for tablet 9dbe6a90f99a44fe85d2c7a8bcb7c9ad (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:02:37.508773 12682 tablet_service.cc:1511] Processing CreateTablet for tablet bf1f0526c7954a23b36c79f2c2b19122 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:02:37.510195 12682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf1f0526c7954a23b36c79f2c2b19122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.514101 12536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dbe6a90f99a44fe85d2c7a8bcb7c9ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.515491 12736 tablet_bootstrap.cc:492] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:37.517230 12736 ts_tablet_manager.cc:1403] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.127s	user 0.028s	sys 0.018s
I20260709 13:02:37.520287 12736 raft_consensus.cc:359] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.520987 12736 raft_consensus.cc:385] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.521296 12736 raft_consensus.cc:740] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.522207 12736 consensus_queue.cc:260] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.524628 12759 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.526885 12530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e396b3164bf5409c9d6b0dd8dc22cd2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.526968 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:37.527220 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:37.527806 12696 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 0.
I20260709 13:02:37.525104 12759 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.531224 12610 tablet_service.cc:1511] Processing CreateTablet for tablet 9dbe6a90f99a44fe85d2c7a8bcb7c9ad (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:02:37.532660 12610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dbe6a90f99a44fe85d2c7a8bcb7c9ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.532927 12759 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:37.533923 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:37.535059 12621 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 0.
I20260709 13:02:37.536638 12510 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:37.538102 12759 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:37.538859 12759 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.539453 12759 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.538180 12512 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:37.543213 12744 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:37.543632 12744 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.544155 12740 tablet_bootstrap.cc:492] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:37.544728 12740 ts_tablet_manager.cc:1403] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.164s	user 0.009s	sys 0.014s
I20260709 13:02:37.544106 12744 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.547889 12681 tablet_service.cc:1511] Processing CreateTablet for tablet 9dbe6a90f99a44fe85d2c7a8bcb7c9ad (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:02:37.549190 12606 tablet_service.cc:1511] Processing CreateTablet for tablet ac31a22d7aa245e385188a5ff4068842 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:02:37.550535 12606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac31a22d7aa245e385188a5ff4068842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.551121 12535 tablet_service.cc:1511] Processing CreateTablet for tablet ac31a22d7aa245e385188a5ff4068842 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:02:37.551936 12740 raft_consensus.cc:359] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.552661 12740 raft_consensus.cc:385] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.552841 12535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac31a22d7aa245e385188a5ff4068842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.552964 12740 raft_consensus.cc:740] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.549383 12681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dbe6a90f99a44fe85d2c7a8bcb7c9ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.557922 12740 consensus_queue.cc:260] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:02:37.559150 12512 leader_election.cc:343] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.566295 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:37.566922 12683 tablet_service.cc:1511] Processing CreateTablet for tablet ac31a22d7aa245e385188a5ff4068842 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:02:37.571225 12683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac31a22d7aa245e385188a5ff4068842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.568969 12736 ts_tablet_manager.cc:1434] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 13:02:37.577230 12529 tablet_service.cc:1511] Processing CreateTablet for tablet fb1007aec88948499b3c20c4e58bba2f (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:02:37.585153 12612 tablet_service.cc:1511] Processing CreateTablet for tablet fb1007aec88948499b3c20c4e58bba2f (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:02:37.586521 12612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb1007aec88948499b3c20c4e58bba2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.586716 12737 tablet_bootstrap.cc:492] T 588a15c12a6c46ab9373c48890191400 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:37.587277 12737 ts_tablet_manager.cc:1403] T 588a15c12a6c46ab9373c48890191400 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.190s	user 0.011s	sys 0.010s
I20260709 13:02:37.590145 12741 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.590600 12741 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.592012 12678 tablet_service.cc:1511] Processing CreateTablet for tablet fb1007aec88948499b3c20c4e58bba2f (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:02:37.592582 12741 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:37.593423 12678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb1007aec88948499b3c20c4e58bba2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.594385 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:02:37.596081 12659 leader_election.cc:343] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.585160 12529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb1007aec88948499b3c20c4e58bba2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.597231 12737 raft_consensus.cc:359] T 588a15c12a6c46ab9373c48890191400 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.597858 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:37.599339 12662 leader_election.cc:343] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.599758 12662 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:37.600896 12741 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:37.605844 12736 tablet_bootstrap.cc:492] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:37.606721 12528 tablet_service.cc:1511] Processing CreateTablet for tablet 69bd963c45b34a92981b6663666fc7eb (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:02:37.598097 12737 raft_consensus.cc:385] T 588a15c12a6c46ab9373c48890191400 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:37.618208 12684 tablet_service.cc:1511] Processing CreateTablet for tablet 69bd963c45b34a92981b6663666fc7eb (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:02:37.619709 12684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69bd963c45b34a92981b6663666fc7eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.620301 12740 ts_tablet_manager.cc:1434] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.075s	user 0.012s	sys 0.004s
I20260709 13:02:37.618417 12763 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:37.610833 12737 raft_consensus.cc:740] T 588a15c12a6c46ab9373c48890191400 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:37.577807 12744 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.640547 12740 tablet_bootstrap.cc:492] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:37.642367 12528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69bd963c45b34a92981b6663666fc7eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.662875 12609 tablet_service.cc:1511] Processing CreateTablet for tablet 69bd963c45b34a92981b6663666fc7eb (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:02:37.664753 12609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69bd963c45b34a92981b6663666fc7eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.677846 12741 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.678573 12741 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.680647 12741 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:37.681447 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:37.683357 12662 leader_election.cc:343] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.683367 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:02:37.685230 12659 leader_election.cc:343] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.685679 12659 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:37.686825 12759 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.688972 12759 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:37.689620 12741 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:37.691323 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:37.691919 12621 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.694330 12736 tablet_bootstrap.cc:654] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.694756 12744 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:37.694984 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:02:37.696547 12510 leader_election.cc:343] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.696090 12737 consensus_queue.cc:260] T 588a15c12a6c46ab9373c48890191400 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.698128 12532 tablet_service.cc:1511] Processing CreateTablet for tablet 4432abbae9994c048d249abe3143fa09 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:02:37.699436 12532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4432abbae9994c048d249abe3143fa09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.700902 12737 ts_tablet_manager.cc:1434] T 588a15c12a6c46ab9373c48890191400 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.112s	user 0.009s	sys 0.002s
I20260709 13:02:37.701887 12737 tablet_bootstrap.cc:492] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
W20260709 13:02:37.703043 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 157973us
I20260709 13:02:37.703841 12621 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:02:37.705418 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:37.706966 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:37.707559 12694 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.706135 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:37.707491 12695 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 0.
I20260709 13:02:37.710728 12510 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:37.714764 12744 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:37.715358 12744 raft_consensus.cc:697] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:02:37.716308 12744 consensus_queue.cc:237] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.718757 12740 tablet_bootstrap.cc:654] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.728300 12679 tablet_service.cc:1511] Processing CreateTablet for tablet 789704b18a5945318724c3ba1ca5b6e5 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:02:37.729648 12679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 789704b18a5945318724c3ba1ca5b6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.746800 12608 tablet_service.cc:1511] Processing CreateTablet for tablet 789704b18a5945318724c3ba1ca5b6e5 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:02:37.746706 12681 tablet_service.cc:1511] Processing CreateTablet for tablet d00b21d8b1e5471b8bf4e449c8b98cd7 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:02:37.750371 12608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 789704b18a5945318724c3ba1ca5b6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.750406 12681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d00b21d8b1e5471b8bf4e449c8b98cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.752216 12534 tablet_service.cc:1511] Processing CreateTablet for tablet ddff67072e694e36addbc3b673b008d0 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:02:37.740195 12529 tablet_service.cc:1511] Processing CreateTablet for tablet d00b21d8b1e5471b8bf4e449c8b98cd7 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:02:37.754034 12534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddff67072e694e36addbc3b673b008d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.756390 12611 tablet_service.cc:1511] Processing CreateTablet for tablet d00b21d8b1e5471b8bf4e449c8b98cd7 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:02:37.763305 12605 tablet_service.cc:1511] Processing CreateTablet for tablet ddff67072e694e36addbc3b673b008d0 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:02:37.764478 12680 tablet_service.cc:1511] Processing CreateTablet for tablet ddff67072e694e36addbc3b673b008d0 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:02:37.764892 12605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddff67072e694e36addbc3b673b008d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.766948 12533 tablet_service.cc:1511] Processing CreateTablet for tablet 5589ff6a0b984c84a050ecad03db5a87 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:02:37.768508 12533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5589ff6a0b984c84a050ecad03db5a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.777231 12680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddff67072e694e36addbc3b673b008d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.783402 12531 tablet_service.cc:1511] Processing CreateTablet for tablet eb9d67599bec471cb17398de70b43841 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:02:37.784938 12686 tablet_service.cc:1511] Processing CreateTablet for tablet 5589ff6a0b984c84a050ecad03db5a87 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:02:37.785228 12685 tablet_service.cc:1511] Processing CreateTablet for tablet eb9d67599bec471cb17398de70b43841 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:02:37.786072 12743 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.786419 12686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5589ff6a0b984c84a050ecad03db5a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.786512 12743 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.788677 12743 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:37.791975 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:02:37.793427 12587 leader_election.cc:343] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.793988 12682 tablet_service.cc:1511] Processing CreateTablet for tablet 4432abbae9994c048d249abe3143fa09 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:02:37.794401 12537 tablet_service.cc:1511] Processing CreateTablet for tablet 789704b18a5945318724c3ba1ca5b6e5 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:02:37.794857 12685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb9d67599bec471cb17398de70b43841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.796144 12611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d00b21d8b1e5471b8bf4e449c8b98cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.795892 12607 tablet_service.cc:1511] Processing CreateTablet for tablet 4432abbae9994c048d249abe3143fa09 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:02:37.775137 12694 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:02:37.808041 12512 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:37.809216 12759 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:37.809856 12759 raft_consensus.cc:697] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:02:37.810925 12759 consensus_queue.cc:237] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.832747 12607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4432abbae9994c048d249abe3143fa09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.840031 12529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d00b21d8b1e5471b8bf4e449c8b98cd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.841296 12606 tablet_service.cc:1511] Processing CreateTablet for tablet 5589ff6a0b984c84a050ecad03db5a87 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:02:37.843927 12535 tablet_service.cc:1511] Processing CreateTablet for tablet 6542f7c6287d4310b225c3c8479d4eca (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:02:37.845639 12535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6542f7c6287d4310b225c3c8479d4eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.838685 12682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4432abbae9994c048d249abe3143fa09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.857674 12606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5589ff6a0b984c84a050ecad03db5a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.858824 12681 tablet_service.cc:1511] Processing CreateTablet for tablet 6542f7c6287d4310b225c3c8479d4eca (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:02:37.860596 12681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6542f7c6287d4310b225c3c8479d4eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.863413 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:37.865258 12588 leader_election.cc:343] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.865760 12588 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:37.866981 12743 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:37.871902 12530 tablet_service.cc:1511] Processing CreateTablet for tablet 7d31111d98c04e47baff178e562510a8 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:02:37.881290 12743 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:37.881904 12743 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.893181 12743 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:37.894802 12531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb9d67599bec471cb17398de70b43841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.895280 12612 tablet_service.cc:1511] Processing CreateTablet for tablet eb9d67599bec471cb17398de70b43841 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:02:37.895601 12683 tablet_service.cc:1511] Processing CreateTablet for tablet 7d31111d98c04e47baff178e562510a8 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:02:37.896679 12612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb9d67599bec471cb17398de70b43841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.898767 12445 catalog_manager.cc:5697] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 0 to 1, leader changed from <none> to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:37.897547 12683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d31111d98c04e47baff178e562510a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.899586 12604 tablet_service.cc:1511] Processing CreateTablet for tablet 6542f7c6287d4310b225c3c8479d4eca (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:02:37.900974 12604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6542f7c6287d4310b225c3c8479d4eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.901955 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:37.902609 12547 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 0.
I20260709 13:02:37.904459 12588 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:37.905272 12537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 789704b18a5945318724c3ba1ca5b6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.905416 12743 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:37.905810 12743 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:37.906188 12743 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.917277 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:02:37.918964 12587 leader_election.cc:343] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.923447 12532 tablet_service.cc:1511] Processing CreateTablet for tablet ab3ccbaad6d445c580a75e6a739a1422 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:02:37.929804 12530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d31111d98c04e47baff178e562510a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.930580 12532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab3ccbaad6d445c580a75e6a739a1422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.937752 12609 tablet_service.cc:1511] Processing CreateTablet for tablet 7d31111d98c04e47baff178e562510a8 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:02:37.938969 12609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d31111d98c04e47baff178e562510a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.939847 12677 tablet_service.cc:1511] Processing CreateTablet for tablet ab3ccbaad6d445c580a75e6a739a1422 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:02:37.941165 12677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab3ccbaad6d445c580a75e6a739a1422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.946944 12743 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:37.950155 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:37.950783 12547 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.951512 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:02:37.953068 12587 leader_election.cc:343] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:37.953706 12743 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:37.964136 12737 tablet_bootstrap.cc:654] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:37.967393 12547 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 1.
I20260709 13:02:37.969014 12588 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:02:37.974017 12743 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:37.997380 12609 tablet_service.cc:1511] Processing CreateTablet for tablet ab3ccbaad6d445c580a75e6a739a1422 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:02:37.998332 12740 tablet_bootstrap.cc:492] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:37.995741 12534 tablet_service.cc:1511] Processing CreateTablet for tablet dd40576623a84072be59a32d23cda14b (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:02:37.998840 12740 ts_tablet_manager.cc:1403] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.378s	user 0.016s	sys 0.031s
I20260709 13:02:37.999471 12534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd40576623a84072be59a32d23cda14b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.002796 12609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab3ccbaad6d445c580a75e6a739a1422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:37.995741 12684 tablet_service.cc:1511] Processing CreateTablet for tablet d21e2686d5e84f6495f1b6f8a9b68dca (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:02:38.005988 12736 tablet_bootstrap.cc:492] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:38.014128 12736 ts_tablet_manager.cc:1403] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.411s	user 0.024s	sys 0.045s
I20260709 13:02:38.008060 12678 tablet_service.cc:1511] Processing CreateTablet for tablet dd40576623a84072be59a32d23cda14b (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:02:38.026278 12740 raft_consensus.cc:359] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.027100 12740 raft_consensus.cc:385] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.027526 12740 raft_consensus.cc:740] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.017369 12736 raft_consensus.cc:359] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.028803 12736 raft_consensus.cc:385] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.029898 12736 raft_consensus.cc:740] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.030174 12603 tablet_service.cc:1511] Processing CreateTablet for tablet dd40576623a84072be59a32d23cda14b (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:02:38.030763 12736 consensus_queue.cc:260] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.031708 12603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd40576623a84072be59a32d23cda14b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.032399 12740 consensus_queue.cc:260] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.037263 12536 tablet_service.cc:1511] Processing CreateTablet for tablet d21e2686d5e84f6495f1b6f8a9b68dca (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:02:38.038414 12737 tablet_bootstrap.cc:492] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:38.038822 12536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d21e2686d5e84f6495f1b6f8a9b68dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.038947 12737 ts_tablet_manager.cc:1403] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.337s	user 0.019s	sys 0.008s
I20260709 13:02:38.039671 12604 tablet_service.cc:1511] Processing CreateTablet for tablet d21e2686d5e84f6495f1b6f8a9b68dca (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
W20260709 13:02:38.043042 12493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:38.041375 12604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d21e2686d5e84f6495f1b6f8a9b68dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.060308 12740 ts_tablet_manager.cc:1434] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.001s
I20260709 13:02:38.070019 12740 tablet_bootstrap.cc:492] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:38.069728 12678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd40576623a84072be59a32d23cda14b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.092519 12535 tablet_service.cc:1511] Processing CreateTablet for tablet f7bf456f0b724194a6e042403ee0b730 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:02:38.093897 12535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7bf456f0b724194a6e042403ee0b730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.062579 12743 raft_consensus.cc:697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:02:38.094488 12759 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.098927 12606 tablet_service.cc:1511] Processing CreateTablet for tablet f7bf456f0b724194a6e042403ee0b730 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:02:38.099850 12759 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.100823 12606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7bf456f0b724194a6e042403ee0b730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.102181 12759 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:38.102085 12737 raft_consensus.cc:359] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.103034 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:38.103255 12684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d21e2686d5e84f6495f1b6f8a9b68dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.092156 12736 ts_tablet_manager.cc:1434] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.078s	user 0.013s	sys 0.003s
I20260709 13:02:38.105969 12736 tablet_bootstrap.cc:492] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
W20260709 13:02:38.106751 12510 leader_election.cc:343] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.103758 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:38.110411 12694 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 0.
I20260709 13:02:38.111580 12512 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:38.112421 12759 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:38.112843 12759 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.113346 12759 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.114439 12531 tablet_service.cc:1511] Processing CreateTablet for tablet fb8ee8ee1a2c43cc9dc422f32773a55b (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:02:38.115752 12531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8ee8ee1a2c43cc9dc422f32773a55b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.117115 12612 tablet_service.cc:1511] Processing CreateTablet for tablet fb8ee8ee1a2c43cc9dc422f32773a55b (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:02:38.118424 12612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8ee8ee1a2c43cc9dc422f32773a55b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.112834 12736 tablet_bootstrap.cc:654] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.122586 12610 tablet_service.cc:1511] Processing CreateTablet for tablet 7724ca15b4534948997fc02e3fe5445a (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:02:38.123348 12759 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.123920 12610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7724ca15b4534948997fc02e3fe5445a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.124017 12537 tablet_service.cc:1511] Processing CreateTablet for tablet 7724ca15b4534948997fc02e3fe5445a (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:02:38.127198 12686 tablet_service.cc:1511] Processing CreateTablet for tablet fb8ee8ee1a2c43cc9dc422f32773a55b (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:02:38.129086 12680 tablet_service.cc:1511] Processing CreateTablet for tablet 7724ca15b4534948997fc02e3fe5445a (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:02:38.130419 12680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7724ca15b4534948997fc02e3fe5445a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.131259 12609 tablet_service.cc:1511] Processing CreateTablet for tablet 7de7740d60cf417e8f6867a7d23f010f (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:02:38.132164 12609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7de7740d60cf417e8f6867a7d23f010f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.103035 12737 raft_consensus.cc:385] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.130535 12529 tablet_service.cc:1511] Processing CreateTablet for tablet 7de7740d60cf417e8f6867a7d23f010f (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:02:38.143641 12677 tablet_service.cc:1511] Processing CreateTablet for tablet 7de7740d60cf417e8f6867a7d23f010f (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:02:38.143582 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:38.138181 12737 raft_consensus.cc:740] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
W20260709 13:02:38.146114 12510 leader_election.cc:343] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.150509 12737 consensus_queue.cc:260] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.146813 12740 tablet_bootstrap.cc:654] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.147611 12685 tablet_service.cc:1511] Processing CreateTablet for tablet f7bf456f0b724194a6e042403ee0b730 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:02:38.161158 12537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7724ca15b4534948997fc02e3fe5445a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.162945 12529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7de7740d60cf417e8f6867a7d23f010f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.169890 12759 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:38.176425 12533 tablet_service.cc:1511] Processing CreateTablet for tablet d24f57e3f5524b1c8e167aff853a0218 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:02:38.177510 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:38.177722 12686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb8ee8ee1a2c43cc9dc422f32773a55b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.177752 12533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d24f57e3f5524b1c8e167aff853a0218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.178236 12695 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.153795 12737 ts_tablet_manager.cc:1434] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.114s	user 0.010s	sys 0.001s
I20260709 13:02:38.177627 12694 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.187839 12677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7de7740d60cf417e8f6867a7d23f010f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.187623 12608 tablet_service.cc:1511] Processing CreateTablet for tablet d24f57e3f5524b1c8e167aff853a0218 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:02:38.210088 12608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d24f57e3f5524b1c8e167aff853a0218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.200181 12679 tablet_service.cc:1511] Processing CreateTablet for tablet d24f57e3f5524b1c8e167aff853a0218 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:02:38.217509 12682 tablet_service.cc:1511] Processing CreateTablet for tablet e64b5865b31f48158abb124846961f72 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:02:38.218890 12682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e64b5865b31f48158abb124846961f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.222254 12679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d24f57e3f5524b1c8e167aff853a0218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.222194 12533 tablet_service.cc:1511] Processing CreateTablet for tablet e64b5865b31f48158abb124846961f72 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:02:38.223817 12533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e64b5865b31f48158abb124846961f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.231163 12604 tablet_service.cc:1511] Processing CreateTablet for tablet e64b5865b31f48158abb124846961f72 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:02:38.232571 12604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e64b5865b31f48158abb124846961f72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.205293 12695 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:02:38.238430 12512 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:38.239547 12759 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:38.239174 12743 consensus_queue.cc:237] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.240026 12759 raft_consensus.cc:697] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:02:38.240860 12759 consensus_queue.cc:237] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.242879 12772 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.243436 12772 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.245224 12764 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:38.247866 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:38.249493 12588 leader_election.cc:343] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.257619 12685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7bf456f0b724194a6e042403ee0b730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.253468 12772 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:38.264302 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:38.264708 12764 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:38.265784 12694 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 0.
I20260709 13:02:38.267284 12587 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:38.268726 12772 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:38.269207 12772 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.269672 12772 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.278831 12537 tablet_service.cc:1511] Processing CreateTablet for tablet 8dcafb50fd3c47afbf475b1da51b147a (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:02:38.280258 12537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dcafb50fd3c47afbf475b1da51b147a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.280103 12678 tablet_service.cc:1511] Processing CreateTablet for tablet 8dcafb50fd3c47afbf475b1da51b147a (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:02:38.281438 12678 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dcafb50fd3c47afbf475b1da51b147a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.274317 12737 tablet_bootstrap.cc:492] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:38.296909 12533 tablet_service.cc:1511] Processing CreateTablet for tablet d57d5dfad8e146a193ef43ffcbaac5ad (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:02:38.298563 12533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d57d5dfad8e146a193ef43ffcbaac5ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.308286 12736 tablet_bootstrap.cc:492] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:38.309233 12736 ts_tablet_manager.cc:1403] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.203s	user 0.014s	sys 0.053s
I20260709 13:02:38.308320 12606 tablet_service.cc:1511] Processing CreateTablet for tablet 8dcafb50fd3c47afbf475b1da51b147a (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:02:38.311666 12606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dcafb50fd3c47afbf475b1da51b147a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.323321 12736 raft_consensus.cc:359] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.324180 12736 raft_consensus.cc:385] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.324504 12736 raft_consensus.cc:740] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.342676 12604 tablet_service.cc:1511] Processing CreateTablet for tablet d57d5dfad8e146a193ef43ffcbaac5ad (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:02:38.346390 12604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d57d5dfad8e146a193ef43ffcbaac5ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.357173 12607 tablet_service.cc:1511] Processing CreateTablet for tablet f2abdbdc67164b32bd58bfe3763a4183 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:02:38.358623 12607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2abdbdc67164b32bd58bfe3763a4183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.359889 12740 tablet_bootstrap.cc:492] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:38.360391 12740 ts_tablet_manager.cc:1403] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.299s	user 0.026s	sys 0.005s
W20260709 13:02:38.361116 12510 consensus_peers.cc:597] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:38.361789 12608 tablet_service.cc:1511] Processing CreateTablet for tablet ba3a2645bcdf4ca5b8e0a2133dd93114 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:02:38.362989 12608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba3a2645bcdf4ca5b8e0a2133dd93114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.325441 12736 consensus_queue.cc:260] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.401944 12737 tablet_bootstrap.cc:654] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.378065 12759 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 13:02:38.412997 12537 tablet_service.cc:1511] Processing CreateTablet for tablet f2abdbdc67164b32bd58bfe3763a4183 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:02:38.413750 12533 tablet_service.cc:1511] Processing CreateTablet for tablet ba3a2645bcdf4ca5b8e0a2133dd93114 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:02:38.414319 12537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2abdbdc67164b32bd58bfe3763a4183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.414969 12533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba3a2645bcdf4ca5b8e0a2133dd93114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.419796 12444 catalog_manager.cc:5697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 0 to 1, leader changed from <none> to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:38.424590 12531 tablet_service.cc:1511] Processing CreateTablet for tablet a059fe8e339d4b8f8fd0c9f18705f015 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:02:38.424805 12529 tablet_service.cc:1511] Processing CreateTablet for tablet f46dfbe6726b4cdd862263f711c7d5d9 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:02:38.426084 12531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a059fe8e339d4b8f8fd0c9f18705f015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.426548 12685 tablet_service.cc:1511] Processing CreateTablet for tablet ba3a2645bcdf4ca5b8e0a2133dd93114 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:02:38.427043 12680 tablet_service.cc:1511] Processing CreateTablet for tablet f2abdbdc67164b32bd58bfe3763a4183 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:02:38.427979 12685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba3a2645bcdf4ca5b8e0a2133dd93114. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.430661 12683 tablet_service.cc:1511] Processing CreateTablet for tablet f46dfbe6726b4cdd862263f711c7d5d9 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:02:38.431408 12530 tablet_service.cc:1511] Processing CreateTablet for tablet 6cba1eecd7bd4c2b913bcfdaa3c7c88c (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:02:38.432060 12683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f46dfbe6726b4cdd862263f711c7d5d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.432637 12530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cba1eecd7bd4c2b913bcfdaa3c7c88c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.434134 12529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f46dfbe6726b4cdd862263f711c7d5d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.434588 12736 ts_tablet_manager.cc:1434] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.121s	user 0.008s	sys 0.000s
I20260709 13:02:38.434737 12681 tablet_service.cc:1511] Processing CreateTablet for tablet 6cba1eecd7bd4c2b913bcfdaa3c7c88c (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:02:38.435750 12736 tablet_bootstrap.cc:492] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:38.436045 12681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cba1eecd7bd4c2b913bcfdaa3c7c88c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.438807 12536 tablet_service.cc:1511] Processing CreateTablet for tablet ec9f14432c254d7a84f0c763fabd3d34 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:02:38.439106 12740 raft_consensus.cc:359] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.440105 12740 raft_consensus.cc:385] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.440336 12536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec9f14432c254d7a84f0c763fabd3d34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.442633 12603 tablet_service.cc:1511] Processing CreateTablet for tablet f46dfbe6726b4cdd862263f711c7d5d9 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:02:38.444087 12603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f46dfbe6726b4cdd862263f711c7d5d9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.404384 12682 tablet_service.cc:1511] Processing CreateTablet for tablet d57d5dfad8e146a193ef43ffcbaac5ad (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:02:38.429112 12684 tablet_service.cc:1511] Processing CreateTablet for tablet a059fe8e339d4b8f8fd0c9f18705f015 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:02:38.440477 12740 raft_consensus.cc:740] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.447929 12740 consensus_queue.cc:260] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.448765 12772 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.450873 12740 ts_tablet_manager.cc:1434] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.090s	user 0.005s	sys 0.005s
I20260709 13:02:38.451990 12740 tablet_bootstrap.cc:492] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:38.452055 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:02:38.453755 12588 leader_election.cc:343] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.455614 12680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2abdbdc67164b32bd58bfe3763a4183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.456000 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:38.456634 12695 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.457662 12772 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:38.459019 12604 tablet_service.cc:1511] Processing CreateTablet for tablet a059fe8e339d4b8f8fd0c9f18705f015 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:02:38.459472 12610 tablet_service.cc:1511] Processing CreateTablet for tablet 6cba1eecd7bd4c2b913bcfdaa3c7c88c (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:02:38.460559 12604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a059fe8e339d4b8f8fd0c9f18705f015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.461877 12772 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.462376 12772 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.464416 12695 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 1.
I20260709 13:02:38.465476 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:38.465863 12587 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:38.467092 12682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d57d5dfad8e146a193ef43ffcbaac5ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.467088 12743 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:38.469627 12608 tablet_service.cc:1511] Processing CreateTablet for tablet ec9f14432c254d7a84f0c763fabd3d34 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:02:38.481382 12741 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.482079 12741 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.484045 12684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a059fe8e339d4b8f8fd0c9f18705f015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.478247 12743 raft_consensus.cc:697] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:02:38.486852 12743 consensus_queue.cc:237] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.484691 12610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cba1eecd7bd4c2b913bcfdaa3c7c88c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.504284 12608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec9f14432c254d7a84f0c763fabd3d34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.505175 12737 tablet_bootstrap.cc:492] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:38.502122 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:38.514206 12696 raft_consensus.cc:2393] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 1: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:02:38.503705 12772 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:38.519945 12679 tablet_service.cc:1511] Processing CreateTablet for tablet ec9f14432c254d7a84f0c763fabd3d34 (DEFAULT_TABLE table=test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:02:38.521414 12679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec9f14432c254d7a84f0c763fabd3d34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:38.525024 12740 tablet_bootstrap.cc:654] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.531615 12737 ts_tablet_manager.cc:1403] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.282s	user 0.017s	sys 0.001s
I20260709 13:02:38.543623 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:38.545145 12662 leader_election.cc:343] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.551399 12736 tablet_bootstrap.cc:654] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.553804 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:38.554746 12621 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:38.556470 12659 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:38.552163 12741 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:38.530019 12587 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:38.568603 12443 catalog_manager.cc:5697] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 0 to 1, leader changed from <none> to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:38.575515 12743 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.585427 12737 raft_consensus.cc:359] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.586252 12737 raft_consensus.cc:385] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.586568 12737 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.587432 12737 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.570436 12741 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:38.589891 12741 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.590049 12737 ts_tablet_manager.cc:1434] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260709 13:02:38.590416 12741 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.591143 12737 tablet_bootstrap.cc:492] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:38.599458 12443 catalog_manager.cc:5697] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 0 to 1, leader changed from <none> to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:38.622319 12737 tablet_bootstrap.cc:654] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:38.642632 12587 consensus_peers.cc:597] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:38.620081 12743 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:38.648664 12740 tablet_bootstrap.cc:492] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:38.649219 12740 ts_tablet_manager.cc:1403] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.197s	user 0.012s	sys 0.003s
I20260709 13:02:38.650543 12764 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.651024 12764 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.655453 12783 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:38.656541 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:38.656961 12764 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:38.657255 12621 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 0.
W20260709 13:02:38.622617 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 66308.7us
I20260709 13:02:38.656697 12740 raft_consensus.cc:359] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.658327 12740 raft_consensus.cc:385] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.658679 12740 raft_consensus.cc:740] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.659680 12740 consensus_queue.cc:260] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.645473 12741 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.662582 12510 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:38.662586 12741 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:38.664049 12783 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:38.664448 12783 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.664793 12783 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.666275 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:38.667166 12547 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.676491 12740 ts_tablet_manager.cc:1434] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.004s
I20260709 13:02:38.678269 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:38.682466 12736 tablet_bootstrap.cc:492] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:38.683158 12736 ts_tablet_manager.cc:1403] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.248s	user 0.026s	sys 0.016s
I20260709 13:02:38.684355 12740 tablet_bootstrap.cc:492] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
W20260709 13:02:38.684978 12512 leader_election.cc:343] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.687955 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:38.688876 12622 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.695777 12737 tablet_bootstrap.cc:492] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:38.696103 12783 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.698197 12783 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:38.698649 12547 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:38.699098 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:38.699736 12620 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.700490 12764 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.700670 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:38.700976 12764 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:02:38.701844 12512 leader_election.cc:343] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.703871 12622 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:38.705065 12659 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:38.705890 12741 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:38.706377 12741 raft_consensus.cc:697] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:38.706543 12764 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:38.707250 12741 consensus_queue.cc:237] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.709937 12620 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:02:38.707553 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:38.711287 12619 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:02:38.711311 12510 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:02:38.713161 12740 tablet_bootstrap.cc:654] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.713776 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:38.688324 12736 raft_consensus.cc:359] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.716697 12764 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:38.717141 12736 raft_consensus.cc:385] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.717495 12736 raft_consensus.cc:740] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.717867 12782 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:38.718276 12782 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.718640 12782 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.720312 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:38.722040 12445 catalog_manager.cc:5697] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 0 to 1, leader changed from <none> to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:38.718688 12764 raft_consensus.cc:697] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:02:38.726703 12782 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.726642 12764 consensus_queue.cc:237] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.718619 12737 ts_tablet_manager.cc:1403] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.128s	user 0.016s	sys 0.022s
I20260709 13:02:38.731266 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:38.732518 12737 raft_consensus.cc:359] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.733253 12737 raft_consensus.cc:385] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.733879 12736 consensus_queue.cc:260] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.743532 12736 ts_tablet_manager.cc:1434] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 13:02:38.744724 12736 tablet_bootstrap.cc:492] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:38.749681 12737 raft_consensus.cc:740] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.751582 12737 consensus_queue.cc:260] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.742271 12764 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:02:38.738698 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:38.739820 12782 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:38.757493 12737 ts_tablet_manager.cc:1434] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:02:38.758199 12622 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.765287 12736 tablet_bootstrap.cc:654] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.751305 12442 catalog_manager.cc:5697] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 0 to 1, leader changed from <none> to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:38.766697 12737 tablet_bootstrap.cc:492] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:38.771818 12740 tablet_bootstrap.cc:492] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:38.772327 12740 ts_tablet_manager.cc:1403] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.088s	user 0.009s	sys 0.004s
I20260709 13:02:38.777695 12622 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:02:38.778332 12737 tablet_bootstrap.cc:654] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.781344 12740 raft_consensus.cc:359] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.782584 12740 raft_consensus.cc:385] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.783073 12740 raft_consensus.cc:740] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.777261 12443 catalog_manager.cc:5697] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:38.784371 12740 consensus_queue.cc:260] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.786975 12759 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.787062 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:02:38.788910 12782 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:38.789656 12782 raft_consensus.cc:697] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:02:38.791046 12782 consensus_queue.cc:237] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.803058 12736 tablet_bootstrap.cc:492] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:38.803556 12736 ts_tablet_manager.cc:1403] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.016s
I20260709 13:02:38.803978 12759 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.806185 12736 raft_consensus.cc:359] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.806942 12736 raft_consensus.cc:385] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.807238 12736 raft_consensus.cc:740] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.807924 12736 consensus_queue.cc:260] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.809087 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:38.811431 12740 ts_tablet_manager.cc:1434] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 13:02:38.813318 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:38.815275 12694 raft_consensus.cc:2393] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 1: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:02:38.813751 12736 ts_tablet_manager.cc:1434] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:02:38.816656 12512 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:38.817418 12736 tablet_bootstrap.cc:492] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:38.817554 12783 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.823500 12736 tablet_bootstrap.cc:654] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.824756 12783 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:38.826442 12740 tablet_bootstrap.cc:492] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:38.814246 12759 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:38.839031 12743 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:38.842360 12736 tablet_bootstrap.cc:492] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:38.843114 12736 ts_tablet_manager.cc:1403] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.006s
I20260709 13:02:38.847062 12736 raft_consensus.cc:359] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.848270 12736 raft_consensus.cc:385] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.848722 12736 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.849823 12736 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.852725 12736 ts_tablet_manager.cc:1434] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:38.848735 12442 catalog_manager.cc:5697] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:38.857254 12740 tablet_bootstrap.cc:654] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.857476 12736 tablet_bootstrap.cc:492] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:38.862869 12737 tablet_bootstrap.cc:492] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:38.863346 12737 ts_tablet_manager.cc:1403] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.097s	user 0.028s	sys 0.035s
I20260709 13:02:38.864616 12736 tablet_bootstrap.cc:654] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.865911 12737 raft_consensus.cc:359] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.866868 12737 raft_consensus.cc:385] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.867125 12737 raft_consensus.cc:740] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.867843 12737 consensus_queue.cc:260] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.870002 12737 ts_tablet_manager.cc:1434] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:02:38.871289 12736 tablet_bootstrap.cc:492] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:38.871596 12737 tablet_bootstrap.cc:492] T b8a1e8bdbd894ee4abb7a463446fe471 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:38.871912 12736 ts_tablet_manager.cc:1403] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.007s
I20260709 13:02:38.874938 12736 raft_consensus.cc:359] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.875789 12736 raft_consensus.cc:385] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.876173 12736 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.876981 12736 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.879272 12736 ts_tablet_manager.cc:1434] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:38.880215 12736 tablet_bootstrap.cc:492] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:38.880754 12737 tablet_bootstrap.cc:654] T b8a1e8bdbd894ee4abb7a463446fe471 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.886301 12736 tablet_bootstrap.cc:654] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.886636 12740 tablet_bootstrap.cc:492] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:38.887887 12740 ts_tablet_manager.cc:1403] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.001s
I20260709 13:02:38.896605 12737 tablet_bootstrap.cc:492] T b8a1e8bdbd894ee4abb7a463446fe471 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:38.898002 12740 raft_consensus.cc:359] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.898734 12740 raft_consensus.cc:385] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.899096 12740 raft_consensus.cc:740] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.898898 12743 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:38.899786 12740 consensus_queue.cc:260] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.900166 12736 tablet_bootstrap.cc:492] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:38.897552 12737 ts_tablet_manager.cc:1403] T b8a1e8bdbd894ee4abb7a463446fe471 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.002s
I20260709 13:02:38.900746 12736 ts_tablet_manager.cc:1403] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.007s
I20260709 13:02:38.903257 12740 ts_tablet_manager.cc:1434] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:02:38.903367 12737 raft_consensus.cc:359] T b8a1e8bdbd894ee4abb7a463446fe471 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.903607 12736 raft_consensus.cc:359] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.904043 12737 raft_consensus.cc:385] T b8a1e8bdbd894ee4abb7a463446fe471 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.904304 12736 raft_consensus.cc:385] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.904356 12737 raft_consensus.cc:740] T b8a1e8bdbd894ee4abb7a463446fe471 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.904469 12740 tablet_bootstrap.cc:492] T 0f7c3aec6a56450cb76aab45d874eff7 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:38.904692 12736 raft_consensus.cc:740] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.905294 12737 consensus_queue.cc:260] T b8a1e8bdbd894ee4abb7a463446fe471 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.905474 12736 consensus_queue.cc:260] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.911509 12740 tablet_bootstrap.cc:654] T 0f7c3aec6a56450cb76aab45d874eff7 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.914650 12737 ts_tablet_manager.cc:1434] T b8a1e8bdbd894ee4abb7a463446fe471 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:02:38.915616 12737 tablet_bootstrap.cc:492] T 5161235af1b440278d598161e1de2453 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:38.918020 12743 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.918685 12743 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.921027 12736 ts_tablet_manager.cc:1434] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 13:02:38.922055 12736 tablet_bootstrap.cc:492] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:38.921939 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:38.923328 12588 leader_election.cc:343] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.927114 12743 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:38.928445 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:02:38.930214 12587 leader_election.cc:343] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.930656 12587 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:38.931326 12737 tablet_bootstrap.cc:654] T 5161235af1b440278d598161e1de2453 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.931742 12743 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:38.932102 12741 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.932557 12741 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.934945 12741 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:38.936388 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:38.936939 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:38.937021 12622 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:38.937433 12621 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.938237 12740 tablet_bootstrap.cc:492] T 0f7c3aec6a56450cb76aab45d874eff7 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
W20260709 13:02:38.938372 12662 leader_election.cc:343] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:38.938704 12740 ts_tablet_manager.cc:1403] T 0f7c3aec6a56450cb76aab45d874eff7 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.001s
I20260709 13:02:38.938951 12659 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:38.940814 12741 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:38.936618 12736 tablet_bootstrap.cc:654] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:38.941181 12741 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.941250 12740 raft_consensus.cc:359] T 0f7c3aec6a56450cb76aab45d874eff7 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.941733 12741 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.942054 12740 raft_consensus.cc:385] T 0f7c3aec6a56450cb76aab45d874eff7 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.941812 12772 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:38.942341 12740 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.943055 12740 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.945132 12740 ts_tablet_manager.cc:1434] T 0f7c3aec6a56450cb76aab45d874eff7 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:38.946128 12759 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.946293 12740 tablet_bootstrap.cc:492] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:38.946774 12759 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.948760 12759 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:38.949764 12741 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.950397 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:38.951064 12695 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 0.
I20260709 13:02:38.952431 12512 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:38.953702 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:38.954391 12622 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.954644 12759 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:38.955166 12759 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:38.955571 12759 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.962666 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:38.954418 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:38.961936 12737 tablet_bootstrap.cc:492] T 5161235af1b440278d598161e1de2453 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:38.968470 12546 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.969070 12737 ts_tablet_manager.cc:1403] T 5161235af1b440278d598161e1de2453 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.002s
I20260709 13:02:38.973554 12737 raft_consensus.cc:359] T 5161235af1b440278d598161e1de2453 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.974474 12737 raft_consensus.cc:385] T 5161235af1b440278d598161e1de2453 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:38.974722 12792 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:38.974786 12737 raft_consensus.cc:740] T 5161235af1b440278d598161e1de2453 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:38.975891 12792 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.974335 12741 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:38.978034 12737 consensus_queue.cc:260] T 5161235af1b440278d598161e1de2453 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.980273 12737 ts_tablet_manager.cc:1434] T 5161235af1b440278d598161e1de2453 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:02:38.980909 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:38.968472 12619 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 0.
I20260709 13:02:38.981282 12737 tablet_bootstrap.cc:492] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:38.984695 12759 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:38.987267 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:38.991214 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:38.991870 12620 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.983556 12792 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:38.994258 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:38.988768 12546 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:38.996169 12662 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:38.996984 12741 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:38.997877 12741 raft_consensus.cc:697] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:38.998689 12741 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.001722 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:38.996417 12792 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.002565 12695 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:38.982616 12622 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:39.003209 12620 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:02:39.004580 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:39.002307 12740 tablet_bootstrap.cc:654] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.005306 12782 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.006114 12782 raft_consensus.cc:697] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:02:39.007071 12782 consensus_queue.cc:237] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.011611 12792 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.005748 12759 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:39.015647 12695 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:02:39.012149 12792 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.021006 12792 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:39.021286 12736 tablet_bootstrap.cc:492] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:39.021229 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:39.021986 12736 ts_tablet_manager.cc:1403] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.100s	user 0.024s	sys 0.014s
I20260709 13:02:39.025496 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:39.026700 12620 raft_consensus.cc:2393] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 1: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:02:39.026613 12445 catalog_manager.cc:5697] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 0 to 1, leader changed from <none> to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.028074 12659 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:39.028569 12737 tablet_bootstrap.cc:654] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.032232 12736 raft_consensus.cc:359] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.032833 12736 raft_consensus.cc:385] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.033061 12736 raft_consensus.cc:740] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.032302 12792 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.039184 12442 catalog_manager.cc:5697] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.041476 12792 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.044036 12736 consensus_queue.cc:260] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.046150 12736 ts_tablet_manager.cc:1434] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.002s
I20260709 13:02:39.047142 12736 tablet_bootstrap.cc:492] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:39.049249 12737 tablet_bootstrap.cc:492] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:39.049939 12737 ts_tablet_manager.cc:1403] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.069s	user 0.004s	sys 0.012s
I20260709 13:02:39.052609 12737 raft_consensus.cc:359] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.053073 12736 tablet_bootstrap.cc:654] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.053432 12737 raft_consensus.cc:385] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:02:39.053792 12493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:39.053805 12737 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.055755 12737 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.058919 12737 ts_tablet_manager.cc:1434] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.002s
I20260709 13:02:39.059317 12736 tablet_bootstrap.cc:492] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:39.059748 12736 ts_tablet_manager.cc:1403] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.005s
I20260709 13:02:39.059828 12737 tablet_bootstrap.cc:492] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:39.062077 12740 tablet_bootstrap.cc:492] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:39.062609 12740 ts_tablet_manager.cc:1403] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.117s	user 0.012s	sys 0.005s
I20260709 13:02:39.062834 12736 raft_consensus.cc:359] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.063598 12736 raft_consensus.cc:385] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.063871 12736 raft_consensus.cc:740] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.064640 12736 consensus_queue.cc:260] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.066039 12737 tablet_bootstrap.cc:654] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.065940 12740 raft_consensus.cc:359] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.066630 12736 ts_tablet_manager.cc:1434] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:02:39.067356 12743 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.067828 12743 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.070829 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:39.071125 12736 tablet_bootstrap.cc:492] T 22a877009d42412fb470ba88a418be05 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
W20260709 13:02:39.073094 12588 leader_election.cc:343] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.074131 12743 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:39.075202 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:39.075857 12695 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 0.
I20260709 13:02:39.077128 12587 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:39.066810 12740 raft_consensus.cc:385] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.078058 12740 raft_consensus.cc:740] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.079154 12740 consensus_queue.cc:260] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.080049 12736 tablet_bootstrap.cc:654] T 22a877009d42412fb470ba88a418be05 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.081488 12740 ts_tablet_manager.cc:1434] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.002s
I20260709 13:02:39.082512 12740 tablet_bootstrap.cc:492] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:39.088325 12740 tablet_bootstrap.cc:654] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.091509 12737 tablet_bootstrap.cc:492] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:39.092001 12737 ts_tablet_manager.cc:1403] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.012s
I20260709 13:02:39.095140 12743 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.095530 12743 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.095836 12743 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.095763 12737 raft_consensus.cc:359] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.096863 12737 raft_consensus.cc:385] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.097240 12737 raft_consensus.cc:740] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.098189 12737 consensus_queue.cc:260] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.101089 12737 ts_tablet_manager.cc:1434] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:02:39.104238 12736 tablet_bootstrap.cc:492] T 22a877009d42412fb470ba88a418be05 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:39.103706 12743 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.104904 12736 ts_tablet_manager.cc:1403] T 22a877009d42412fb470ba88a418be05 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.004s
I20260709 13:02:39.107020 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:02:39.108397 12588 leader_election.cc:343] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.109268 12743 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:39.109375 12736 raft_consensus.cc:359] T 22a877009d42412fb470ba88a418be05 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.110288 12736 raft_consensus.cc:385] T 22a877009d42412fb470ba88a418be05 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.110546 12736 raft_consensus.cc:740] T 22a877009d42412fb470ba88a418be05 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.110474 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:39.110986 12737 tablet_bootstrap.cc:492] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:39.111172 12695 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.111358 12736 consensus_queue.cc:260] T 22a877009d42412fb470ba88a418be05 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.113379 12736 ts_tablet_manager.cc:1434] T 22a877009d42412fb470ba88a418be05 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.002s
I20260709 13:02:39.114833 12736 tablet_bootstrap.cc:492] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:39.117075 12737 tablet_bootstrap.cc:654] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.120059 12695 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 1.
I20260709 13:02:39.121120 12736 tablet_bootstrap.cc:654] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.121390 12587 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:39.122206 12772 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.122682 12772 raft_consensus.cc:697] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:02:39.123488 12772 consensus_queue.cc:237] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.125929 12792 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.126042 12771 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.126451 12792 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.126492 12771 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.128486 12792 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:39.130125 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:39.130725 12546 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:39.132795 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:39.133530 12620 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:39.134994 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:39.135284 12740 tablet_bootstrap.cc:492] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:39.135713 12740 ts_tablet_manager.cc:1403] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.008s
I20260709 13:02:39.128485 12771 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:39.137346 12792 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.138202 12792 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.138732 12792 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.139187 12740 raft_consensus.cc:359] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.139859 12740 raft_consensus.cc:385] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.140148 12740 raft_consensus.cc:740] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.140810 12740 consensus_queue.cc:260] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.143028 12740 ts_tablet_manager.cc:1434] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:39.144342 12740 tablet_bootstrap.cc:492] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:39.147743 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:39.150193 12740 tablet_bootstrap.cc:654] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.161749 12740 tablet_bootstrap.cc:492] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:39.162292 12740 ts_tablet_manager.cc:1403] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:02:39.162947 12620 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:39.165202 12740 raft_consensus.cc:359] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.165205 12741 consensus_queue.cc:1059] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:39.166249 12740 raft_consensus.cc:385] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.166621 12740 raft_consensus.cc:740] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.166818 12741 raft_consensus.cc:3055] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:39.167346 12741 raft_consensus.cc:740] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:39.168530 12741 consensus_queue.cc:260] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.172533 12694 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.167915 12740 consensus_queue.cc:260] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.153481 12792 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.176203 12695 raft_consensus.cc:2393] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 1: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:02:39.178211 12741 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.182467 12792 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:39.183492 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:39.183039 12444 catalog_manager.cc:5697] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 0 to 1, leader changed from <none> to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.184305 12546 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.188032 12737 tablet_bootstrap.cc:492] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:39.188633 12737 ts_tablet_manager.cc:1403] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.078s	user 0.033s	sys 0.029s
I20260709 13:02:39.190394 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:39.190992 12620 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.191964 12737 raft_consensus.cc:359] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.192785 12737 raft_consensus.cc:385] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.193202 12737 raft_consensus.cc:740] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.194157 12737 consensus_queue.cc:260] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.196509 12737 ts_tablet_manager.cc:1434] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:39.196467 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:39.197229 12736 tablet_bootstrap.cc:492] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:39.197533 12740 ts_tablet_manager.cc:1434] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 13:02:39.197682 12736 ts_tablet_manager.cc:1403] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.083s	user 0.020s	sys 0.013s
I20260709 13:02:39.198544 12740 tablet_bootstrap.cc:492] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:39.200341 12736 raft_consensus.cc:359] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.201011 12736 raft_consensus.cc:385] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.201269 12736 raft_consensus.cc:740] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.201952 12736 consensus_queue.cc:260] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.202901 12737 tablet_bootstrap.cc:492] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:39.204742 12782 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.205273 12782 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.206507 12546 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:39.206682 12588 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:39.207911 12782 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:39.210438 12737 tablet_bootstrap.cc:654] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.210783 12620 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:39.212345 12659 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:39.213869 12828 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.214004 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:39.214668 12736 ts_tablet_manager.cc:1434] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:02:39.215018 12695 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 0.
I20260709 13:02:39.215299 12741 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.215616 12736 tablet_bootstrap.cc:492] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:39.215974 12741 raft_consensus.cc:697] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:39.216816 12741 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.218705 12512 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:39.222251 12736 tablet_bootstrap.cc:654] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.223033 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:39.223166 12782 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.223733 12620 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 0.
I20260709 13:02:39.223747 12782 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.226118 12782 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.230543 12759 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:39.240125 12695 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:02:39.240723 12695 pending_rounds.cc:85] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 0
I20260709 13:02:39.241160 12695 pending_rounds.cc:107] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:02:39.241611 12695 raft_consensus.cc:2889] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:39.244129 12759 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:39.253687 12736 tablet_bootstrap.cc:492] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:39.254196 12736 ts_tablet_manager.cc:1403] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.002s
I20260709 13:02:39.256171 12782 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.257268 12736 raft_consensus.cc:359] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.257783 12622 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:39.258009 12736 raft_consensus.cc:385] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.258339 12736 raft_consensus.cc:740] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.263213 12783 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:39.265271 12736 consensus_queue.cc:260] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.273298 12783 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:39.275736 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:39.276540 12621 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.278362 12736 ts_tablet_manager.cc:1434] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:02:39.279309 12736 tablet_bootstrap.cc:492] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:39.283820 12621 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:02:39.285072 12510 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:39.285956 12759 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.286340 12782 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:39.287297 12759 raft_consensus.cc:697] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:02:39.268513 12445 catalog_manager.cc:5697] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.292243 12828 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.292789 12828 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.295034 12828 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:39.295220 12736 tablet_bootstrap.cc:654] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.288573 12759 consensus_queue.cc:237] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.302263 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:39.303045 12546 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 0.
I20260709 13:02:39.304462 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:39.305402 12828 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.305835 12828 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.306239 12828 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.321383 12772 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.322199 12772 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.326352 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:02:39.328421 12587 leader_election.cc:343] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.328506 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:39.329088 12694 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.329188 12772 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:39.339833 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:39.340886 12696 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 0.
I20260709 13:02:39.349613 12694 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:02:39.354378 12740 tablet_bootstrap.cc:654] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.358981 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:39.345048 12828 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.365293 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:39.366187 12696 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.370048 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:39.370877 12546 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:39.378098 12588 leader_election.cc:343] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.378755 12588 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:39.379745 12772 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.379691 12828 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:39.387228 12442 catalog_manager.cc:5697] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 0 to 1, leader changed from <none> to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.433524 12696 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 1.
I20260709 13:02:39.434999 12587 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:39.435648 12782 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.437417 12736 tablet_bootstrap.cc:492] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:39.437348 12828 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.438119 12736 ts_tablet_manager.cc:1403] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.159s	user 0.050s	sys 0.071s
I20260709 13:02:39.439996 12740 tablet_bootstrap.cc:492] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:39.440440 12740 ts_tablet_manager.cc:1403] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.242s	user 0.007s	sys 0.007s
I20260709 13:02:39.440714 12736 raft_consensus.cc:359] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.441396 12736 raft_consensus.cc:385] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.441697 12736 raft_consensus.cc:740] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.442339 12736 consensus_queue.cc:260] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.442919 12737 tablet_bootstrap.cc:492] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:39.438465 12828 raft_consensus.cc:697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:02:39.443426 12737 ts_tablet_manager.cc:1403] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.241s	user 0.064s	sys 0.116s
I20260709 13:02:39.444331 12736 ts_tablet_manager.cc:1434] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:02:39.444060 12828 consensus_queue.cc:237] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.445225 12736 tablet_bootstrap.cc:492] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:39.445254 12743 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.442961 12740 raft_consensus.cc:359] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.446113 12743 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.449417 12743 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:39.451141 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:39.446280 12737 raft_consensus.cc:359] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.453022 12736 tablet_bootstrap.cc:654] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.450966 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:39.453457 12737 raft_consensus.cc:385] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.453812 12737 raft_consensus.cc:740] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
W20260709 13:02:39.454413 12588 leader_election.cc:343] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:39.454907 12587 leader_election.cc:343] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.454564 12737 consensus_queue.cc:260] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.446163 12740 raft_consensus.cc:385] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.455513 12740 raft_consensus.cc:740] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.455391 12587 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:39.456252 12771 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.456967 12737 ts_tablet_manager.cc:1434] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:02:39.457828 12740 consensus_queue.cc:260] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.459677 12740 ts_tablet_manager.cc:1434] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:02:39.465602 12740 tablet_bootstrap.cc:492] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:39.458293 12737 tablet_bootstrap.cc:492] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:39.472465 12741 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.487924 12741 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.488638 12771 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.489259 12801 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.489105 12771 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.489787 12801 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.490271 12741 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:39.491310 12771 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:39.492115 12801 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:39.493184 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:39.493912 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:39.494889 12620 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:39.495126 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:39.495712 12622 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 0.
I20260709 13:02:39.497500 12510 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:39.498307 12801 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.498260 12659 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:02:39.498562 12588 leader_election.cc:343] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.498829 12801 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.499217 12801 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.500327 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:39.463290 12546 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 1.
W20260709 13:02:39.503155 12587 leader_election.cc:343] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.503650 12587 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:39.504725 12771 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.506338 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:39.506901 12792 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.507367 12792 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.507710 12792 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.499409 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:39.516409 12792 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.516664 12783 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.517678 12694 raft_consensus.cc:2393] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 1: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:02:39.519047 12741 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.525211 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:39.530696 12736 tablet_bootstrap.cc:492] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:39.531235 12736 ts_tablet_manager.cc:1403] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.086s	user 0.042s	sys 0.007s
I20260709 13:02:39.533634 12771 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.534134 12771 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.536216 12771 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:39.538038 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:39.538287 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:39.538916 12736 raft_consensus.cc:359] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.539605 12736 raft_consensus.cc:385] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.539893 12736 raft_consensus.cc:740] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.539146 12445 catalog_manager.cc:5697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 0 to 1, leader changed from <none> to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:39.540577 12736 consensus_queue.cc:260] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.526890 12801 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.543326 12801 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:39.544380 12737 tablet_bootstrap.cc:654] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:39.546854 12587 leader_election.cc:343] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.547942 12547 raft_consensus.cc:2393] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 1: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:02:39.550686 12736 ts_tablet_manager.cc:1434] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
W20260709 13:02:39.558967 12588 leader_election.cc:343] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.564743 12736 tablet_bootstrap.cc:492] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:39.550046 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:39.548393 12792 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:39.564541 12588 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:39.568434 12771 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.561092 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:39.569425 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:39.570147 12621 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.570340 12696 raft_consensus.cc:2393] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 1: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:02:39.572961 12512 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:39.574366 12801 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.577118 12740 tablet_bootstrap.cc:654] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.584496 12828 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.585371 12792 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.586228 12736 tablet_bootstrap.cc:654] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.590839 12621 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:39.592971 12659 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:39.594755 12792 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.595396 12792 raft_consensus.cc:697] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:39.596482 12792 consensus_queue.cc:237] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.598024 12737 tablet_bootstrap.cc:492] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:39.598506 12737 ts_tablet_manager.cc:1403] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.140s	user 0.009s	sys 0.007s
I20260709 13:02:39.617309 12546 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.619073 12736 tablet_bootstrap.cc:492] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:39.619658 12736 ts_tablet_manager.cc:1403] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.004s
I20260709 13:02:39.628062 12736 raft_consensus.cc:359] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.628831 12736 raft_consensus.cc:385] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.629175 12736 raft_consensus.cc:740] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.630038 12736 consensus_queue.cc:260] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.632375 12736 ts_tablet_manager.cc:1434] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:02:39.633323 12736 tablet_bootstrap.cc:492] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:39.633051 12737 raft_consensus.cc:359] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.633741 12737 raft_consensus.cc:385] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.634022 12737 raft_consensus.cc:740] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.635143 12737 consensus_queue.cc:260] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.637625 12737 ts_tablet_manager.cc:1434] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.001s
I20260709 13:02:39.638551 12737 tablet_bootstrap.cc:492] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:39.641968 12736 tablet_bootstrap.cc:654] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.642782 12828 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:39.648276 12828 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.648917 12828 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.652560 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:39.652773 12828 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:02:39.654016 12588 leader_election.cc:343] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.657356 12737 tablet_bootstrap.cc:654] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.658576 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:02:39.660333 12587 leader_election.cc:343] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.660877 12587 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:39.662906 12828 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.671249 12740 tablet_bootstrap.cc:492] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:39.671803 12740 ts_tablet_manager.cc:1403] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.206s	user 0.021s	sys 0.030s
I20260709 13:02:39.673097 12737 tablet_bootstrap.cc:492] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:39.673532 12737 ts_tablet_manager.cc:1403] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.005s
I20260709 13:02:39.676360 12445 catalog_manager.cc:5697] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.682104 12792 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.683949 12737 raft_consensus.cc:359] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.684623 12737 raft_consensus.cc:385] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.684934 12737 raft_consensus.cc:740] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.685891 12737 consensus_queue.cc:260] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.688107 12737 ts_tablet_manager.cc:1434] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:02:39.688794 12737 tablet_bootstrap.cc:492] T 60708e41894c42b697291e905bff5dc6 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:39.693784 12740 raft_consensus.cc:359] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.694356 12736 tablet_bootstrap.cc:492] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:39.694633 12740 raft_consensus.cc:385] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.694847 12736 ts_tablet_manager.cc:1403] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.013s
I20260709 13:02:39.694993 12740 raft_consensus.cc:740] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.695741 12740 consensus_queue.cc:260] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.700495 12736 raft_consensus.cc:359] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.701216 12736 raft_consensus.cc:385] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.701490 12736 raft_consensus.cc:740] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.702356 12740 ts_tablet_manager.cc:1434] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 13:02:39.703287 12740 tablet_bootstrap.cc:492] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:39.698503 12737 tablet_bootstrap.cc:654] T 60708e41894c42b697291e905bff5dc6 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.705996 12801 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.709360 12737 tablet_bootstrap.cc:492] T 60708e41894c42b697291e905bff5dc6 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:39.709861 12737 ts_tablet_manager.cc:1403] T 60708e41894c42b697291e905bff5dc6 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.004s
I20260709 13:02:39.711737 12792 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.712039 12740 tablet_bootstrap.cc:654] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.712234 12792 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.713680 12737 raft_consensus.cc:359] T 60708e41894c42b697291e905bff5dc6 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.714372 12737 raft_consensus.cc:385] T 60708e41894c42b697291e905bff5dc6 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.714634 12737 raft_consensus.cc:740] T 60708e41894c42b697291e905bff5dc6 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.715062 12792 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:39.715281 12737 consensus_queue.cc:260] T 60708e41894c42b697291e905bff5dc6 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.717303 12737 ts_tablet_manager.cc:1434] T 60708e41894c42b697291e905bff5dc6 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:02:39.718181 12737 tablet_bootstrap.cc:492] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:39.730247 12737 tablet_bootstrap.cc:654] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.730547 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:39.731429 12621 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:39.738692 12736 consensus_queue.cc:260] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.739262 12659 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:39.740439 12791 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.740828 12791 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.741171 12791 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.745527 12801 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.746034 12737 tablet_bootstrap.cc:492] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:39.746511 12737 ts_tablet_manager.cc:1403] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.003s
I20260709 13:02:39.749034 12737 raft_consensus.cc:359] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.749819 12737 raft_consensus.cc:385] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.750093 12737 raft_consensus.cc:740] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.750679 12737 consensus_queue.cc:260] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.752758 12737 ts_tablet_manager.cc:1434] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:39.753688 12737 tablet_bootstrap.cc:492] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:39.758486 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:39.760079 12662 leader_election.cc:343] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.763057 12792 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:39.765821 12737 tablet_bootstrap.cc:654] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.778791 12791 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.784981 12736 ts_tablet_manager.cc:1434] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.000s
I20260709 13:02:39.786347 12736 tablet_bootstrap.cc:492] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:39.791937 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:02:39.793613 12662 leader_election.cc:343] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.796196 12791 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:39.802278 12736 tablet_bootstrap.cc:654] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.805686 12743 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.806329 12743 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.809058 12743 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:39.813452 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:02:39.815595 12587 leader_election.cc:343] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.817317 12736 tablet_bootstrap.cc:492] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:39.818063 12736 ts_tablet_manager.cc:1403] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.012s
I20260709 13:02:39.822118 12736 raft_consensus.cc:359] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.823112 12736 raft_consensus.cc:385] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.823423 12736 raft_consensus.cc:740] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.824134 12736 consensus_queue.cc:260] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.826433 12736 ts_tablet_manager.cc:1434] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:02:39.827086 12801 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.827742 12801 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.830618 12801 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:39.833423 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:39.836519 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:02:39.836932 12588 leader_election.cc:343] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:39.837430 12622 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 0.
I20260709 13:02:39.837754 12588 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:39.839607 12772 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:39.845700 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:39.846948 12696 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 0.
I20260709 13:02:39.847867 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:39.848627 12622 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.852034 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:39.853533 12801 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.854169 12801 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.854635 12801 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.857674 12736 tablet_bootstrap.cc:492] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:39.857860 12772 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:39.872179 12736 tablet_bootstrap.cc:654] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.873417 12791 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:39.874433 12737 tablet_bootstrap.cc:492] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:39.874114 12791 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.874903 12737 ts_tablet_manager.cc:1403] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.121s	user 0.023s	sys 0.072s
I20260709 13:02:39.876533 12791 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:39.877293 12740 tablet_bootstrap.cc:492] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:39.877812 12740 ts_tablet_manager.cc:1403] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.175s	user 0.049s	sys 0.102s
I20260709 13:02:39.877697 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:39.877635 12737 raft_consensus.cc:359] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.878420 12737 raft_consensus.cc:385] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.878468 12621 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:39.878769 12737 raft_consensus.cc:740] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.879763 12737 consensus_queue.cc:260] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.880088 12659 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:39.881016 12792 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:39.881722 12740 raft_consensus.cc:359] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.882277 12737 ts_tablet_manager.cc:1434] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:39.882450 12740 raft_consensus.cc:385] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.882849 12740 raft_consensus.cc:740] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.881387 12792 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:39.884684 12792 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.884330 12740 consensus_queue.cc:260] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.883528 12737 tablet_bootstrap.cc:492] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:39.892375 12740 ts_tablet_manager.cc:1434] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.004s
I20260709 13:02:39.893065 12737 tablet_bootstrap.cc:654] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.894368 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:39.894645 12740 tablet_bootstrap.cc:492] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:39.895048 12546 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:39.898586 12801 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.901919 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:39.902480 12696 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.902670 12740 tablet_bootstrap.cc:654] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:39.913400 12622 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:39.914600 12792 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.914861 12659 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:39.915397 12696 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:02:39.915655 12740 tablet_bootstrap.cc:492] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:39.916201 12740 ts_tablet_manager.cc:1403] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.001s
I20260709 13:02:39.916615 12512 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:39.917579 12759 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.918062 12759 raft_consensus.cc:697] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:02:39.918699 12791 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:39.919230 12791 raft_consensus.cc:697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:39.919581 12740 raft_consensus.cc:359] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.920046 12801 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:39.920495 12740 raft_consensus.cc:385] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.920125 12791 consensus_queue.cc:237] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.920799 12740 raft_consensus.cc:740] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.921482 12740 consensus_queue.cc:260] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.918895 12759 consensus_queue.cc:237] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.923684 12740 ts_tablet_manager.cc:1434] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:39.924165 12736 tablet_bootstrap.cc:492] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:39.924515 12740 tablet_bootstrap.cc:492] T dda7dbc055d64c86aedec4299e15f997 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:39.924574 12736 ts_tablet_manager.cc:1403] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.067s	user 0.009s	sys 0.001s
I20260709 13:02:39.926406 12792 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:39.929668 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:39.930290 12621 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.934060 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:39.934739 12546 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:39.935988 12736 raft_consensus.cc:359] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.936659 12736 raft_consensus.cc:385] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:39.936919 12736 raft_consensus.cc:740] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:39.937667 12736 consensus_queue.cc:260] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:39.970582 12736 ts_tablet_manager.cc:1434] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:02:39.976809 12621 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:02:39.980147 12736 tablet_bootstrap.cc:492] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:40.006580 12740 tablet_bootstrap.cc:654] T dda7dbc055d64c86aedec4299e15f997 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.008044 12737 tablet_bootstrap.cc:492] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:40.084820 12737 ts_tablet_manager.cc:1403] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.201s	user 0.014s	sys 0.008s
I20260709 13:02:40.087438 12737 raft_consensus.cc:359] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.088258 12737 raft_consensus.cc:385] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.088754 12737 raft_consensus.cc:740] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.089422 12737 consensus_queue.cc:260] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.092123 12737 ts_tablet_manager.cc:1434] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:40.092531 12736 tablet_bootstrap.cc:654] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.037109 12546 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:40.044620 12772 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.096438 12737 tablet_bootstrap.cc:492] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:40.098531 12736 tablet_bootstrap.cc:492] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:40.099092 12736 ts_tablet_manager.cc:1403] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.119s	user 0.011s	sys 0.001s
I20260709 13:02:40.061790 12791 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:39.977169 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:02:40.071880 12493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:40.077916 12771 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.101965 12771 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.103075 12737 tablet_bootstrap.cc:654] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.102826 12736 raft_consensus.cc:359] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.103438 12736 raft_consensus.cc:385] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.103675 12736 raft_consensus.cc:740] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.104105 12771 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:40.104225 12736 consensus_queue.cc:260] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.101471 12622 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.106534 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:40.106845 12736 ts_tablet_manager.cc:1434] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:02:40.107764 12736 tablet_bootstrap.cc:492] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:40.112816 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:40.113690 12736 tablet_bootstrap.cc:654] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.114521 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:40.115742 12741 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.116255 12741 raft_consensus.cc:697] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:40.117213 12741 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.125146 12736 tablet_bootstrap.cc:492] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:40.125653 12736 ts_tablet_manager.cc:1403] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.003s
I20260709 13:02:40.128036 12736 raft_consensus.cc:359] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.128662 12736 raft_consensus.cc:385] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.128921 12736 raft_consensus.cc:740] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.129546 12736 consensus_queue.cc:260] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.131825 12736 ts_tablet_manager.cc:1434] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:40.131620 12792 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.132198 12792 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.132714 12736 tablet_bootstrap.cc:492] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:40.134305 12792 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:40.135223 12442 catalog_manager.cc:5697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.138172 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:40.138836 12621 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:40.142027 12659 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:02:40.144969 12587 leader_election.cc:343] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.145669 12736 tablet_bootstrap.cc:654] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.145906 12772 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.146335 12772 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.149848 12772 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:40.154184 12792 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.154763 12792 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.155189 12792 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.156808 12736 tablet_bootstrap.cc:492] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:40.157371 12736 ts_tablet_manager.cc:1403] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.002s
I20260709 13:02:40.181304 12622 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:40.195258 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:40.196161 12546 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:40.197614 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:40.201988 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:02:40.203733 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 61803.2us
I20260709 13:02:40.219729 12792 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.221627 12792 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:40.222697 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:40.223361 12622 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.224859 12740 tablet_bootstrap.cc:492] T dda7dbc055d64c86aedec4299e15f997 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:40.225319 12740 ts_tablet_manager.cc:1403] T dda7dbc055d64c86aedec4299e15f997 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.301s	user 0.014s	sys 0.001s
I20260709 13:02:40.229630 12740 raft_consensus.cc:359] T dda7dbc055d64c86aedec4299e15f997 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.230352 12740 raft_consensus.cc:385] T dda7dbc055d64c86aedec4299e15f997 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.230401 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:40.230690 12740 raft_consensus.cc:740] T dda7dbc055d64c86aedec4299e15f997 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.231068 12545 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.231585 12740 consensus_queue.cc:260] T dda7dbc055d64c86aedec4299e15f997 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.230571 12791 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.235204 12740 ts_tablet_manager.cc:1434] T dda7dbc055d64c86aedec4299e15f997 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:02:40.229949 12622 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:40.236577 12791 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.237411 12659 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:40.239056 12791 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:40.239562 12791 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.239970 12791 raft_consensus.cc:697] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:40.240768 12791 consensus_queue.cc:237] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.242996 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:40.243664 12547 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:40.244009 12736 raft_consensus.cc:359] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.244655 12736 raft_consensus.cc:385] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.244922 12736 raft_consensus.cc:740] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.247371 12737 tablet_bootstrap.cc:492] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
W20260709 13:02:40.247562 12587 leader_election.cc:343] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.247834 12737 ts_tablet_manager.cc:1403] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.152s	user 0.038s	sys 0.042s
I20260709 13:02:40.249105 12743 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.250056 12662 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:40.251194 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:40.251839 12622 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:40.253826 12737 raft_consensus.cc:359] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.254073 12791 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.254542 12737 raft_consensus.cc:385] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.254705 12791 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:02:40.255339 12588 leader_election.cc:343] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.255280 12736 consensus_queue.cc:260] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.255918 12588 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:40.257970 12736 ts_tablet_manager.cc:1434] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.100s	user 0.012s	sys 0.000s
I20260709 13:02:40.255324 12791 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.257401 12771 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.258926 12736 tablet_bootstrap.cc:492] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:40.259460 12743 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.261498 12743 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:40.236460 12740 tablet_bootstrap.cc:492] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:40.263335 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:02:40.266039 12587 leader_election.cc:343] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:40.257798 12588 leader_election.cc:343] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.266782 12588 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:40.267567 12772 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.254874 12737 raft_consensus.cc:740] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.269116 12737 consensus_queue.cc:260] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.269698 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:40.270641 12737 ts_tablet_manager.cc:1434] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:02:40.271334 12737 tablet_bootstrap.cc:492] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
W20260709 13:02:40.271701 12588 leader_election.cc:343] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.272172 12588 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:40.272930 12772 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.277092 12740 tablet_bootstrap.cc:654] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.277371 12545 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:40.279384 12442 catalog_manager.cc:5697] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.300396 12736 tablet_bootstrap.cc:654] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.296612 12791 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.311991 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:40.312423 12737 tablet_bootstrap.cc:654] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.312640 12621 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.313720 12791 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:40.314755 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:40.314842 12876 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:02:40.315570 12547 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.317085 12445 catalog_manager.cc:5697] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 0 to 1, leader changed from <none> to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.329538 12740 tablet_bootstrap.cc:492] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:40.333380 12442 catalog_manager.cc:5697] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.330051 12740 ts_tablet_manager.cc:1403] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.094s	user 0.013s	sys 0.018s
I20260709 13:02:40.333257 12621 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:40.338001 12659 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:40.339345 12791 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.341089 12772 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.341485 12791 raft_consensus.cc:697] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:40.342044 12772 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.344995 12772 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:40.344606 12791 consensus_queue.cc:237] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.345876 12547 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:40.351119 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:40.350319 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:02:40.355648 12587 leader_election.cc:343] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:40.357153 12588 leader_election.cc:343] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.352993 12737 tablet_bootstrap.cc:492] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:40.357631 12588 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:40.358067 12737 ts_tablet_manager.cc:1403] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.087s	user 0.007s	sys 0.006s
W20260709 13:02:40.358037 12662 consensus_peers.cc:597] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:40.358548 12759 consensus_queue.cc:1048] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.360435 12772 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.357187 12740 raft_consensus.cc:359] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.364768 12740 raft_consensus.cc:385] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.361547 12737 raft_consensus.cc:359] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.365710 12737 raft_consensus.cc:385] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.366026 12737 raft_consensus.cc:740] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.366832 12737 consensus_queue.cc:260] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.368782 12737 ts_tablet_manager.cc:1434] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:02:40.369678 12737 tablet_bootstrap.cc:492] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:40.372198 12740 raft_consensus.cc:740] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.373643 12740 consensus_queue.cc:260] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.376538 12782 consensus_queue.cc:1048] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.383147 12736 tablet_bootstrap.cc:492] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:40.385164 12740 ts_tablet_manager.cc:1434] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:02:40.385246 12736 ts_tablet_manager.cc:1403] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.127s	user 0.012s	sys 0.002s
I20260709 13:02:40.386227 12740 tablet_bootstrap.cc:492] T df093254fdff40f38b8370a4e884cc5d P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:40.388062 12736 raft_consensus.cc:359] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.388716 12736 raft_consensus.cc:385] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.389010 12736 raft_consensus.cc:740] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.389819 12736 consensus_queue.cc:260] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.390172 12445 catalog_manager.cc:5697] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.392046 12740 tablet_bootstrap.cc:654] T df093254fdff40f38b8370a4e884cc5d P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.392160 12736 ts_tablet_manager.cc:1434] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:02:40.393069 12736 tablet_bootstrap.cc:492] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:40.396163 12772 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.396687 12772 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.398581 12737 tablet_bootstrap.cc:654] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.399058 12772 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:40.401903 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:40.403401 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:40.403401 12587 leader_election.cc:343] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:40.405305 12588 leader_election.cc:343] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.405755 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:40.406917 12772 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.407631 12736 tablet_bootstrap.cc:654] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.409086 12740 tablet_bootstrap.cc:492] T df093254fdff40f38b8370a4e884cc5d P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:40.409621 12740 ts_tablet_manager.cc:1403] T df093254fdff40f38b8370a4e884cc5d P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.000s
I20260709 13:02:40.416603 12740 raft_consensus.cc:359] T df093254fdff40f38b8370a4e884cc5d P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.417441 12740 raft_consensus.cc:385] T df093254fdff40f38b8370a4e884cc5d P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.417809 12740 raft_consensus.cc:740] T df093254fdff40f38b8370a4e884cc5d P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.418514 12740 consensus_queue.cc:260] T df093254fdff40f38b8370a4e884cc5d P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.420964 12740 ts_tablet_manager.cc:1434] T df093254fdff40f38b8370a4e884cc5d P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:02:40.421873 12740 tablet_bootstrap.cc:492] T 02ea9ad298ab4fa08087d24740b5a13b P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:40.424055 12737 tablet_bootstrap.cc:492] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:40.424548 12737 ts_tablet_manager.cc:1403] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.006s
I20260709 13:02:40.427194 12737 raft_consensus.cc:359] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.427913 12737 raft_consensus.cc:385] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.428181 12737 raft_consensus.cc:740] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.428563 12740 tablet_bootstrap.cc:654] T 02ea9ad298ab4fa08087d24740b5a13b P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.429636 12736 tablet_bootstrap.cc:492] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:40.428959 12737 consensus_queue.cc:260] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.430258 12736 ts_tablet_manager.cc:1403] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.007s
I20260709 13:02:40.433583 12736 raft_consensus.cc:359] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.434614 12736 raft_consensus.cc:385] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.435039 12736 raft_consensus.cc:740] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.436089 12736 consensus_queue.cc:260] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.439118 12736 ts_tablet_manager.cc:1434] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:40.439239 12737 ts_tablet_manager.cc:1434] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:02:40.440315 12737 tablet_bootstrap.cc:492] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:40.440949 12736 tablet_bootstrap.cc:492] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:40.441672 12791 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.442127 12791 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.444278 12791 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:40.446013 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:40.446732 12547 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:40.447736 12736 tablet_bootstrap.cc:654] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.448570 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:40.449251 12619 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:40.451022 12662 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:40.450500 12737 tablet_bootstrap.cc:654] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.453037 12791 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.453668 12791 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.454205 12791 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.460264 12740 tablet_bootstrap.cc:492] T 02ea9ad298ab4fa08087d24740b5a13b P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:40.461069 12740 ts_tablet_manager.cc:1403] T 02ea9ad298ab4fa08087d24740b5a13b P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.003s
I20260709 13:02:40.464497 12737 tablet_bootstrap.cc:492] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:40.464188 12740 raft_consensus.cc:359] T 02ea9ad298ab4fa08087d24740b5a13b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.464960 12737 ts_tablet_manager.cc:1403] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:02:40.464975 12740 raft_consensus.cc:385] T 02ea9ad298ab4fa08087d24740b5a13b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.465487 12740 raft_consensus.cc:740] T 02ea9ad298ab4fa08087d24740b5a13b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.466379 12740 consensus_queue.cc:260] T 02ea9ad298ab4fa08087d24740b5a13b P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.467730 12737 raft_consensus.cc:359] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.468411 12737 raft_consensus.cc:385] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.468470 12740 ts_tablet_manager.cc:1434] T 02ea9ad298ab4fa08087d24740b5a13b P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:02:40.468739 12737 raft_consensus.cc:740] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.469431 12737 consensus_queue.cc:260] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.470314 12740 tablet_bootstrap.cc:492] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:40.472046 12791 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.474925 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:40.475543 12547 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.477242 12736 tablet_bootstrap.cc:492] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:40.477658 12740 tablet_bootstrap.cc:654] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.477743 12736 ts_tablet_manager.cc:1403] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.037s	user 0.018s	sys 0.012s
I20260709 13:02:40.481714 12736 raft_consensus.cc:359] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.482569 12736 raft_consensus.cc:385] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.482868 12736 raft_consensus.cc:740] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.483484 12737 ts_tablet_manager.cc:1434] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:02:40.483525 12736 consensus_queue.cc:260] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.486099 12736 ts_tablet_manager.cc:1434] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:40.487035 12791 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:40.488008 12737 tablet_bootstrap.cc:492] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:40.488260 12736 tablet_bootstrap.cc:492] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:40.488253 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:40.489014 12619 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.492550 12772 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.493165 12772 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.494659 12737 tablet_bootstrap.cc:654] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.495409 12772 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:40.495656 12736 tablet_bootstrap.cc:654] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.497700 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:02:40.501346 12587 leader_election.cc:343] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.501390 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:40.501745 12791 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.502347 12791 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:02:40.502838 12588 leader_election.cc:343] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.503296 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:40.504340 12772 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.504604 12791 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:40.506184 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:40.506903 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:40.507627 12621 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
W20260709 13:02:40.507843 12662 leader_election.cc:343] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.508364 12547 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:40.509677 12662 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:40.509837 12619 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:40.510864 12791 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.511392 12791 raft_consensus.cc:697] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:40.512241 12791 consensus_queue.cc:237] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.512792 12759 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.509696 12659 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:40.513295 12759 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.515021 12741 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.515415 12741 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.515769 12741 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.515838 12759 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:40.522943 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:40.523886 12621 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 1: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:02:40.524081 12741 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.527783 12875 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:40.530354 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:40.534165 12741 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:40.540398 12512 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:40.542068 12740 tablet_bootstrap.cc:492] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:40.542785 12740 ts_tablet_manager.cc:1403] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.073s	user 0.008s	sys 0.010s
I20260709 13:02:40.543946 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:40.544370 12782 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.544991 12619 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.559237 12740 raft_consensus.cc:359] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.561339 12740 raft_consensus.cc:385] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.561647 12740 raft_consensus.cc:740] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.562018 12737 tablet_bootstrap.cc:492] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:40.562463 12737 ts_tablet_manager.cc:1403] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.075s	user 0.027s	sys 0.037s
I20260709 13:02:40.564456 12619 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:40.565413 12740 consensus_queue.cc:260] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.565749 12741 consensus_queue.cc:1048] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:40.567808 12740 ts_tablet_manager.cc:1434] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 13:02:40.568970 12740 tablet_bootstrap.cc:492] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:40.569358 12737 raft_consensus.cc:359] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.570124 12737 raft_consensus.cc:385] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.570366 12737 raft_consensus.cc:740] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.570952 12737 consensus_queue.cc:260] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.573446 12737 ts_tablet_manager.cc:1434] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:02:40.574365 12737 tablet_bootstrap.cc:492] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:40.575596 12740 tablet_bootstrap.cc:654] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.580683 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:40.580883 12737 tablet_bootstrap.cc:654] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.583314 12741 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.584297 12740 tablet_bootstrap.cc:492] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:40.597391 12740 ts_tablet_manager.cc:1403] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.000s
I20260709 13:02:40.600205 12740 raft_consensus.cc:359] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.585700 12659 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:40.600917 12740 raft_consensus.cc:385] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.601400 12740 raft_consensus.cc:740] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
W20260709 13:02:40.601671 12662 leader_election.cc:343] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.602164 12740 consensus_queue.cc:260] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.605784 12772 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.606245 12772 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.608249 12741 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.608716 12772 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:40.608903 12741 raft_consensus.cc:697] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:40.610196 12741 consensus_queue.cc:237] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.612450 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:02:40.614351 12587 leader_election.cc:343] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.615443 12740 ts_tablet_manager.cc:1434] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:02:40.607084 12782 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.627045 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:40.628297 12588 leader_election.cc:343] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.628708 12588 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:40.629736 12772 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.632172 12792 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.632812 12792 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.635845 12792 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:40.643043 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:40.645263 12662 leader_election.cc:343] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.649899 12740 tablet_bootstrap.cc:492] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:40.660863 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:40.661778 12622 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:40.665462 12736 tablet_bootstrap.cc:492] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:40.666000 12736 ts_tablet_manager.cc:1403] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.178s	user 0.018s	sys 0.049s
I20260709 13:02:40.668807 12736 raft_consensus.cc:359] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.669507 12736 raft_consensus.cc:385] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.669860 12736 raft_consensus.cc:740] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.673009 12740 tablet_bootstrap.cc:654] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.671411 12736 consensus_queue.cc:260] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.675609 12736 ts_tablet_manager.cc:1434] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:02:40.680555 12736 tablet_bootstrap.cc:492] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:40.694013 12445 catalog_manager.cc:5697] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.696585 12736 tablet_bootstrap.cc:654] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.717195 12876 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.717890 12772 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.718691 12772 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.721153 12772 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:40.721889 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:40.727326 12588 leader_election.cc:343] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.728940 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:40.722556 12876 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.745275 12694 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 0.
I20260709 13:02:40.746690 12659 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:40.748343 12791 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.748899 12791 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.749338 12791 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.751202 12587 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:40.752542 12772 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.753093 12772 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.754060 12772 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.757066 12741 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.765779 12792 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.767792 12792 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.768137 12876 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:40.769407 12792 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:40.776940 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:40.771878 12445 catalog_manager.cc:5697] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.777602 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:40.778410 12546 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
W20260709 13:02:40.785079 12662 leader_election.cc:343] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.786137 12662 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:40.788177 12772 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.789167 12792 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.789573 12792 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.789938 12792 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.794235 12876 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.771173 12741 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.800056 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:40.806635 12546 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:40.808212 12662 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:40.796327 12741 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:40.809252 12876 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.813426 12876 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.816250 12876 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.817689 12737 tablet_bootstrap.cc:492] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:40.818255 12737 ts_tablet_manager.cc:1403] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.244s	user 0.055s	sys 0.047s
I20260709 13:02:40.816205 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:02:40.824505 12588 leader_election.cc:343] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.824541 12736 tablet_bootstrap.cc:492] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:40.825706 12736 ts_tablet_manager.cc:1403] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.149s	user 0.031s	sys 0.021s
I20260709 13:02:40.829476 12740 tablet_bootstrap.cc:492] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:40.829978 12740 ts_tablet_manager.cc:1403] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.180s	user 0.025s	sys 0.023s
I20260709 13:02:40.834152 12736 raft_consensus.cc:359] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.834925 12736 raft_consensus.cc:385] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.835208 12736 raft_consensus.cc:740] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.836125 12737 raft_consensus.cc:359] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.836819 12737 raft_consensus.cc:385] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.836815 12876 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.837381 12737 raft_consensus.cc:740] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:40.838266 12737 consensus_queue.cc:260] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.839869 12736 consensus_queue.cc:260] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.841741 12737 ts_tablet_manager.cc:1434] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:02:40.841523 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:40.842674 12621 raft_consensus.cc:2393] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 1: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:02:40.842908 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:40.843509 12546 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.845222 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:40.845897 12621 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:40.846145 12876 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:40.842701 12737 tablet_bootstrap.cc:492] T 0767462f04d344b5a4fce9de7e885245 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:40.853003 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:40.853652 12694 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.854195 12736 ts_tablet_manager.cc:1434] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:02:40.855177 12736 tablet_bootstrap.cc:492] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:40.856805 12772 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:40.830140 12791 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.865082 12791 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:40.865114 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:40.851293 12792 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.868640 12792 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:40.870087 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:40.870849 12621 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:40.870946 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:40.871511 12544 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.871176 12740 raft_consensus.cc:359] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.871970 12740 raft_consensus.cc:385] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:40.872232 12740 raft_consensus.cc:740] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
W20260709 13:02:40.876096 12662 leader_election.cc:343] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.877032 12771 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.877538 12771 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.879626 12771 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:40.880121 12694 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 1.
I20260709 13:02:40.884172 12546 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:40.884202 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:40.884713 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:40.885331 12619 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:40.886426 12587 leader_election.cc:343] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.882253 12659 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:40.888904 12544 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:40.884294 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:40.890257 12622 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.890647 12740 consensus_queue.cc:260] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.890892 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:40.891650 12621 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.892262 12619 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:40.895031 12662 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:40.896356 12662 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:40.898838 12622 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:40.899577 12904 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.900032 12741 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.895812 12876 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.903378 12904 raft_consensus.cc:697] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:40.904929 12737 tablet_bootstrap.cc:654] T 0767462f04d344b5a4fce9de7e885245 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.904384 12904 consensus_queue.cc:237] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.910753 12587 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:40.906908 12876 raft_consensus.cc:697] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:40.912670 12876 consensus_queue.cc:237] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.913435 12743 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.915726 12771 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.916272 12771 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.917315 12875 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.918273 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:40.922586 12740 ts_tablet_manager.cc:1434] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.002s
I20260709 13:02:40.934227 12771 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:40.937880 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:40.901252 12621 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
W20260709 13:02:40.939285 12588 leader_election.cc:343] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.946964 12743 raft_consensus.cc:697] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:02:40.948577 12740 tablet_bootstrap.cc:492] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:40.956692 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:40.957347 12694 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 0.
W20260709 13:02:40.953774 12588 leader_election.cc:343] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:40.956915 12743 consensus_queue.cc:237] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.968834 12783 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:40.970125 12875 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:40.970523 12783 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:40.961803 12588 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:40.973683 12783 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:40.978380 12910 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:40.963510 12587 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:40.982402 12910 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:40.982857 12910 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:40.983246 12910 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:40.984666 12736 tablet_bootstrap.cc:654] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:40.986197 12443 catalog_manager.cc:5697] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.986140 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:40.988202 12621 raft_consensus.cc:2393] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 1: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:02:40.993451 12659 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:40.997192 12875 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:40.997702 12875 raft_consensus.cc:697] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:40.998518 12875 consensus_queue.cc:237] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.005204 12910 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.008455 12791 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.008854 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:41.009716 12696 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.010392 12910 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:41.010531 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:41.011201 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:02:41.012331 12588 leader_election.cc:343] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.013772 12512 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:41.015309 12740 tablet_bootstrap.cc:654] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.015720 12759 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.018065 12904 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.019162 12910 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.025815 12910 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.023020 12783 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.027501 12444 catalog_manager.cc:5697] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 0 to 1, leader changed from <none> to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.025208 12904 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:02:41.029161 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:41.030601 12588 leader_election.cc:343] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.034751 12783 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.054318 12737 tablet_bootstrap.cc:492] T 0767462f04d344b5a4fce9de7e885245 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:41.055202 12737 ts_tablet_manager.cc:1403] T 0767462f04d344b5a4fce9de7e885245 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.213s	user 0.009s	sys 0.006s
I20260709 13:02:41.054538 12910 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:41.070389 12736 tablet_bootstrap.cc:492] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:41.071502 12736 ts_tablet_manager.cc:1403] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.217s	user 0.023s	sys 0.016s
I20260709 13:02:41.075099 12759 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:41.077239 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:41.075127 12783 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:41.068781 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:02:41.080017 12512 leader_election.cc:343] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.081435 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:41.082103 12619 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 0.
I20260709 13:02:41.083588 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:02:41.090116 12740 tablet_bootstrap.cc:492] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:41.090718 12740 ts_tablet_manager.cc:1403] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.142s	user 0.015s	sys 0.012s
W20260709 13:02:41.090986 12587 leader_election.cc:343] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.091446 12587 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:41.092511 12743 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:41.093578 12740 raft_consensus.cc:359] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.094551 12740 raft_consensus.cc:385] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.089277 12759 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.094899 12740 raft_consensus.cc:740] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.095153 12759 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.095492 12759 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.095583 12740 consensus_queue.cc:260] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.097767 12740 ts_tablet_manager.cc:1434] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:41.098601 12740 tablet_bootstrap.cc:492] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:41.098052 12444 catalog_manager.cc:5697] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:41.100406 12444 catalog_manager.cc:5697] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:41.105042 12737 raft_consensus.cc:359] T 0767462f04d344b5a4fce9de7e885245 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.105652 12737 raft_consensus.cc:385] T 0767462f04d344b5a4fce9de7e885245 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.105950 12737 raft_consensus.cc:740] T 0767462f04d344b5a4fce9de7e885245 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.108295 12737 consensus_queue.cc:260] T 0767462f04d344b5a4fce9de7e885245 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.112058 12904 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.119949 12736 raft_consensus.cc:359] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.120683 12736 raft_consensus.cc:385] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.120966 12736 raft_consensus.cc:740] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.124349 12737 ts_tablet_manager.cc:1434] T 0767462f04d344b5a4fce9de7e885245 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.000s
I20260709 13:02:41.124049 12736 consensus_queue.cc:260] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.125350 12737 tablet_bootstrap.cc:492] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:41.126502 12736 ts_tablet_manager.cc:1434] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.002s
I20260709 13:02:41.109279 12696 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 1.
I20260709 13:02:41.129109 12587 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:41.129988 12910 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.130541 12910 raft_consensus.cc:697] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:02:41.131456 12910 consensus_queue.cc:237] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.130131 12759 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.133796 12759 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:41.138542 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:41.139222 12622 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.139654 12736 tablet_bootstrap.cc:492] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:41.135293 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:02:41.142635 12512 leader_election.cc:343] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.143515 12740 tablet_bootstrap.cc:654] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.146951 12736 tablet_bootstrap.cc:654] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.159027 12622 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:02:41.160789 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:02:41.165105 12759 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.165645 12759 raft_consensus.cc:697] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:02:41.166482 12759 consensus_queue.cc:237] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.168305 12876 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.183238 12736 tablet_bootstrap.cc:492] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:41.183696 12736 ts_tablet_manager.cc:1403] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.005s
W20260709 13:02:41.184664 12643 debug-util.cc:398] Leaking SignalData structure 0x7b08001fcd00 after lost signal to thread 11446
I20260709 13:02:41.185045 12737 tablet_bootstrap.cc:654] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:41.185634 12643 debug-util.cc:398] Leaking SignalData structure 0x7b08001fd400 after lost signal to thread 12479
W20260709 13:02:41.186874 12643 debug-util.cc:398] Leaking SignalData structure 0x7b080009de60 after lost signal to thread 12571
W20260709 13:02:41.187260 12493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:41.191684 12737 tablet_bootstrap.cc:492] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:41.192189 12737 ts_tablet_manager.cc:1403] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.000s
I20260709 13:02:41.194491 12737 raft_consensus.cc:359] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.195174 12737 raft_consensus.cc:385] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.195425 12737 raft_consensus.cc:740] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.196096 12737 consensus_queue.cc:260] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.197999 12737 ts_tablet_manager.cc:1434] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:02:41.199244 12737 tablet_bootstrap.cc:492] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:41.200021 12445 catalog_manager.cc:5697] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 0 to 1, leader changed from <none> to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:41.187913 12643 debug-util.cc:398] Leaking SignalData structure 0x7b0800207e60 after lost signal to thread 12646
W20260709 13:02:41.202374 12643 debug-util.cc:398] Leaking SignalData structure 0x7b080023d140 after lost signal to thread 12720
I20260709 13:02:41.183389 12740 tablet_bootstrap.cc:492] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:41.205552 12740 ts_tablet_manager.cc:1403] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.006s
I20260709 13:02:41.208262 12740 raft_consensus.cc:359] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.208905 12740 raft_consensus.cc:385] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.209178 12740 raft_consensus.cc:740] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.209759 12737 tablet_bootstrap.cc:654] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.210000 12740 consensus_queue.cc:260] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.186877 12736 raft_consensus.cc:359] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.211429 12736 raft_consensus.cc:385] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.211687 12736 raft_consensus.cc:740] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.212313 12736 consensus_queue.cc:260] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.214416 12736 ts_tablet_manager.cc:1434] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:02:41.214901 12737 tablet_bootstrap.cc:492] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:41.215312 12736 tablet_bootstrap.cc:492] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:41.215409 12737 ts_tablet_manager.cc:1403] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.016s	user 0.001s	sys 0.009s
I20260709 13:02:41.218298 12740 ts_tablet_manager.cc:1434] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:02:41.218115 12737 raft_consensus.cc:359] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.218856 12737 raft_consensus.cc:385] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.219188 12737 raft_consensus.cc:740] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.219209 12740 tablet_bootstrap.cc:492] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:41.221300 12736 tablet_bootstrap.cc:654] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.223492 12443 catalog_manager.cc:5697] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 0 to 1, leader changed from <none> to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.223618 12737 consensus_queue.cc:260] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.226569 12737 ts_tablet_manager.cc:1434] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 13:02:41.231366 12737 tablet_bootstrap.cc:492] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:41.230072 12740 tablet_bootstrap.cc:654] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.242244 12736 tablet_bootstrap.cc:492] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:41.242813 12736 ts_tablet_manager.cc:1403] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.003s
I20260709 13:02:41.245961 12737 tablet_bootstrap.cc:654] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.245740 12736 raft_consensus.cc:359] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.246452 12736 raft_consensus.cc:385] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.246771 12736 raft_consensus.cc:740] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.247717 12736 consensus_queue.cc:260] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.251346 12736 ts_tablet_manager.cc:1434] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:02:41.252488 12736 tablet_bootstrap.cc:492] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:41.258083 12736 tablet_bootstrap.cc:654] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.259786 12783 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.260308 12783 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.273126 12783 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:41.274701 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:41.275269 12696 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 0.
I20260709 13:02:41.276324 12512 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:41.277792 12910 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.278034 12736 tablet_bootstrap.cc:492] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:41.278548 12736 ts_tablet_manager.cc:1403] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.012s
I20260709 13:02:41.278285 12910 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.279978 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:41.280639 12622 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 0.
I20260709 13:02:41.281426 12740 tablet_bootstrap.cc:492] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:41.281932 12740 ts_tablet_manager.cc:1403] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.063s	user 0.020s	sys 0.005s
I20260709 13:02:41.282657 12910 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:41.284024 12759 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.283941 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:41.286099 12737 tablet_bootstrap.cc:492] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
W20260709 13:02:41.285477 12587 leader_election.cc:343] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.286175 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:41.286922 12737 ts_tablet_manager.cc:1403] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.007s
I20260709 13:02:41.287463 12736 raft_consensus.cc:359] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.288157 12736 raft_consensus.cc:385] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.288421 12736 raft_consensus.cc:740] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.289551 12737 raft_consensus.cc:359] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.290319 12737 raft_consensus.cc:385] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.290607 12737 raft_consensus.cc:740] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.284499 12740 raft_consensus.cc:359] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.291775 12740 raft_consensus.cc:385] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.292085 12740 raft_consensus.cc:740] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.292860 12740 consensus_queue.cc:260] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:02:41.293413 12588 leader_election.cc:343] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.293928 12588 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:41.294984 12910 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:41.284444 12759 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.295588 12740 ts_tablet_manager.cc:1434] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:02:41.295825 12759 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.296581 12740 tablet_bootstrap.cc:492] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:41.296350 12736 consensus_queue.cc:260] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.298332 12736 ts_tablet_manager.cc:1434] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:02:41.299171 12736 tablet_bootstrap.cc:492] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:41.300242 12737 consensus_queue.cc:260] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.302354 12737 ts_tablet_manager.cc:1434] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:02:41.305721 12737 tablet_bootstrap.cc:492] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:41.308774 12736 tablet_bootstrap.cc:654] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.310412 12740 tablet_bootstrap.cc:654] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.315237 12737 tablet_bootstrap.cc:654] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.327447 12737 tablet_bootstrap.cc:492] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:41.327957 12737 ts_tablet_manager.cc:1403] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:02:41.328658 12876 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.330793 12737 raft_consensus.cc:359] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.331511 12737 raft_consensus.cc:385] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.331765 12737 raft_consensus.cc:740] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.332829 12876 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.332907 12737 consensus_queue.cc:260] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.335171 12737 ts_tablet_manager.cc:1434] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:41.336371 12737 tablet_bootstrap.cc:492] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:41.340284 12759 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.348759 12737 tablet_bootstrap.cc:654] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.370762 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:41.371393 12696 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.373498 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:41.374241 12621 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.383920 12740 tablet_bootstrap.cc:492] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:41.384590 12740 ts_tablet_manager.cc:1403] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.088s	user 0.009s	sys 0.003s
I20260709 13:02:41.381595 12759 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:41.392367 12904 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.393291 12904 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.398819 12696 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:02:41.400444 12512 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:41.402210 12621 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:02:41.388427 12876 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.066s
I20260709 13:02:41.427567 12792 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.467012 12792 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.468818 12736 tablet_bootstrap.cc:492] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:41.469098 12737 tablet_bootstrap.cc:492] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:41.469328 12736 ts_tablet_manager.cc:1403] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.170s	user 0.004s	sys 0.033s
I20260709 13:02:41.469606 12737 ts_tablet_manager.cc:1403] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.133s	user 0.017s	sys 0.004s
I20260709 13:02:41.471459 12740 raft_consensus.cc:359] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.472177 12740 raft_consensus.cc:385] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.472142 12736 raft_consensus.cc:359] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.472602 12740 raft_consensus.cc:740] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.474359 12736 raft_consensus.cc:385] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.474674 12736 raft_consensus.cc:740] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.474995 12740 consensus_queue.cc:260] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.475325 12736 consensus_queue.cc:260] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.476505 12740 ts_tablet_manager.cc:1434] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.091s	user 0.013s	sys 0.017s
I20260709 13:02:41.477124 12736 ts_tablet_manager.cc:1434] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:02:41.477389 12740 tablet_bootstrap.cc:492] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:41.473699 12737 raft_consensus.cc:359] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.457186 12759 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.478173 12737 raft_consensus.cc:385] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.478499 12759 raft_consensus.cc:697] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:02:41.478711 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 74900.7us
I20260709 13:02:41.479501 12759 consensus_queue.cc:237] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.478016 12736 tablet_bootstrap.cc:492] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:41.478515 12737 raft_consensus.cc:740] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.482124 12737 consensus_queue.cc:260] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.477656 12792 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:41.484167 12737 ts_tablet_manager.cc:1434] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.002s
I20260709 13:02:41.485076 12737 tablet_bootstrap.cc:492] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:41.491470 12740 tablet_bootstrap.cc:654] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.493708 12743 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.494222 12743 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.498342 12772 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:41.506018 12876 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.508054 12737 tablet_bootstrap.cc:654] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.557868 12904 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:41.559455 12736 tablet_bootstrap.cc:654] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.561857 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:41.563150 12621 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:41.570240 12743 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:41.570958 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:02:41.572690 12587 leader_election.cc:343] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.561152 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:41.574684 12588 consensus_peers.cc:597] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:41.567507 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:41.589646 12545 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:41.592833 12743 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.596987 12782 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.597483 12782 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.598480 12740 tablet_bootstrap.cc:492] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:41.599007 12740 ts_tablet_manager.cc:1403] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.122s	user 0.019s	sys 0.010s
I20260709 13:02:41.600163 12737 tablet_bootstrap.cc:492] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:41.600775 12737 ts_tablet_manager.cc:1403] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.116s	user 0.009s	sys 0.009s
I20260709 13:02:41.602741 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:41.604346 12743 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.604390 12782 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:41.604806 12743 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.624143 12743 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:41.624306 12910 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.624858 12910 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.625917 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:41.626760 12621 raft_consensus.cc:2393] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 1: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:02:41.626811 12910 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:41.627179 12876 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.627628 12876 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.631043 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:02:41.639333 12587 leader_election.cc:343] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.639281 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:41.619210 12875 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.607077 12662 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:02:41.641199 12587 leader_election.cc:343] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.640692 12875 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.642009 12904 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.642457 12904 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.642834 12904 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.643368 12875 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:41.643309 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:41.644469 12621 raft_consensus.cc:2393] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 1: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:02:41.645145 12588 leader_election.cc:343] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.645678 12588 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:41.647035 12444 catalog_manager.cc:5697] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 0 to 1, leader changed from <none> to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.647882 12771 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:41.650970 12904 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.651561 12876 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:41.652926 12904 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:41.659054 12659 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:41.660017 12740 raft_consensus.cc:359] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.661522 12740 raft_consensus.cc:385] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.662062 12740 raft_consensus.cc:740] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.661479 12875 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.662725 12792 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:41.661788 12759 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.664908 12759 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.667585 12759 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:41.668325 12910 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.668835 12910 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.670655 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:41.671277 12695 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 0.
I20260709 13:02:41.675177 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:41.672963 12910 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:02:41.677419 12587 leader_election.cc:343] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.677995 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:41.679435 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:41.680210 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:41.686610 12740 consensus_queue.cc:260] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.695129 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:41.705821 12737 raft_consensus.cc:359] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.724289 12737 raft_consensus.cc:385] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.707515 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:41.712148 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:41.728333 12621 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:41.724542 12737 raft_consensus.cc:740] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.730019 12737 consensus_queue.cc:260] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.733484 12737 ts_tablet_manager.cc:1434] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.132s	user 0.008s	sys 0.000s
I20260709 13:02:41.734696 12737 tablet_bootstrap.cc:492] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:41.736279 12740 ts_tablet_manager.cc:1434] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.137s	user 0.003s	sys 0.004s
I20260709 13:02:41.737334 12740 tablet_bootstrap.cc:492] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:41.742616 12783 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:41.744268 12875 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:41.744531 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:41.745142 12621 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.746152 12512 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:41.750491 12759 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.751134 12759 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.751456 12759 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:41.755038 12659 leader_election.cc:343] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:41.740630 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 48344.1us
I20260709 13:02:41.761049 12759 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.763425 12659 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:41.768240 12740 tablet_bootstrap.cc:654] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.768489 12736 tablet_bootstrap.cc:492] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:41.768671 12875 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.770311 12875 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.770876 12875 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.768906 12736 ts_tablet_manager.cc:1403] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.291s	user 0.009s	sys 0.003s
I20260709 13:02:41.769416 12759 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:41.769683 12737 tablet_bootstrap.cc:654] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.776713 12736 raft_consensus.cc:359] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.781087 12736 raft_consensus.cc:385] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.781390 12736 raft_consensus.cc:740] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.782164 12736 consensus_queue.cc:260] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.784309 12736 ts_tablet_manager.cc:1434] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:02:41.785279 12736 tablet_bootstrap.cc:492] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:41.772994 12510 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:41.803953 12759 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.803959 12736 tablet_bootstrap.cc:654] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:41.809639 12621 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
W20260709 13:02:41.807677 12588 leader_election.cc:343] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.811180 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:41.812613 12875 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:02:41.813035 12588 consensus_peers.cc:597] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:41.813745 12910 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:41.814603 12588 leader_election.cc:343] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.814929 12875 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:41.815092 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:41.817837 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:41.818490 12621 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 0.
I20260709 13:02:41.820508 12910 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:41.821300 12588 leader_election.cc:343] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.823431 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:41.823863 12659 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:41.828193 12588 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:41.835100 12737 tablet_bootstrap.cc:492] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:41.835807 12910 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:41.836328 12771 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.836946 12771 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.838086 12875 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:41.828982 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:41.835685 12737 ts_tablet_manager.cc:1403] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.101s	user 0.025s	sys 0.012s
I20260709 13:02:41.843883 12904 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:41.847635 12759 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:41.844620 12904 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.869969 12875 raft_consensus.cc:697] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:41.873945 12875 consensus_queue.cc:237] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.880604 12546 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 1: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:02:41.892261 12771 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:41.896981 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:41.896353 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:41.903604 12696 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 1: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:02:41.904650 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:41.905236 12619 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.908810 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:41.946723 12947 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:02:41.909379 12541 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 1: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:02:41.899190 12904 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:02:41.906235 12662 leader_election.cc:343] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:41.951273 12662 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:41.947938 12740 tablet_bootstrap.cc:492] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:41.952379 12740 ts_tablet_manager.cc:1403] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.215s	user 0.027s	sys 0.035s
I20260709 13:02:41.948036 12736 tablet_bootstrap.cc:492] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:41.929270 12619 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:02:41.953352 12737 raft_consensus.cc:359] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.954171 12737 raft_consensus.cc:385] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.954536 12737 raft_consensus.cc:740] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.953843 12736 ts_tablet_manager.cc:1403] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.169s	user 0.018s	sys 0.002s
I20260709 13:02:41.956277 12904 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:41.956441 12737 consensus_queue.cc:260] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.918375 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:41.953105 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:41.956245 12544 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.961663 12737 ts_tablet_manager.cc:1434] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.122s	user 0.002s	sys 0.011s
I20260709 13:02:41.964262 12737 tablet_bootstrap.cc:492] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:41.965165 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:02:41.958789 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 52604.2us
I20260709 13:02:41.968832 12617 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:41.972685 12740 raft_consensus.cc:359] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.973249 12740 raft_consensus.cc:385] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:41.973485 12740 raft_consensus.cc:740] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:41.977447 12659 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:41.978345 12904 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:41.978668 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:41.978945 12904 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:41.978277 12445 catalog_manager.cc:5697] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:41.979346 12904 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:41.974241 12622 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 1: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:02:41.988559 12740 consensus_queue.cc:260] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:41.987753 12876 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:02:41.992216 12662 leader_election.cc:343] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.000030 12740 ts_tablet_manager.cc:1434] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:02:42.001636 12740 tablet_bootstrap.cc:492] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:42.006095 12510 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:02:42.007871 12659 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:42.010169 12783 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:42.011060 12783 raft_consensus.cc:697] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:02:42.011616 12876 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:42.011900 12783 consensus_queue.cc:237] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.008702 12544 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
W20260709 13:02:42.008846 12587 leader_election.cc:343] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.001595 12904 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.023171 12904 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:42.024657 12737 tablet_bootstrap.cc:654] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.024812 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:42.025987 12618 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.035804 12618 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:42.037295 12659 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:42.037532 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:42.038321 12904 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:42.038964 12904 raft_consensus.cc:697] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:42.039776 12904 consensus_queue.cc:237] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.044425 12736 raft_consensus.cc:359] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.045076 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:42.045318 12736 raft_consensus.cc:385] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.045727 12736 raft_consensus.cc:740] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
W20260709 13:02:42.046355 12588 leader_election.cc:343] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:42.046835 12662 leader_election.cc:343] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.046877 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:42.047842 12791 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.047886 12743 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:42.048434 12791 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.050475 12791 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:42.052043 12947 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:42.054031 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:42.054744 12622 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:42.046509 12736 consensus_queue.cc:260] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.061455 12736 ts_tablet_manager.cc:1434] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.105s	user 0.005s	sys 0.002s
I20260709 13:02:42.062278 12740 tablet_bootstrap.cc:654] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.062443 12736 tablet_bootstrap.cc:492] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:42.061120 12659 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:42.064957 12876 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:42.065364 12876 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.065771 12876 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.076349 12947 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:42.115474 12545 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.135104 12876 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.145359 12737 tablet_bootstrap.cc:492] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:42.145844 12737 ts_tablet_manager.cc:1403] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.182s	user 0.016s	sys 0.007s
I20260709 13:02:42.148065 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:42.150290 12737 raft_consensus.cc:359] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.150969 12737 raft_consensus.cc:385] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.151026 12740 tablet_bootstrap.cc:492] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:42.151280 12737 raft_consensus.cc:740] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.152007 12740 ts_tablet_manager.cc:1403] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.151s	user 0.013s	sys 0.023s
I20260709 13:02:42.152032 12737 consensus_queue.cc:260] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.162783 12947 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:02:42.167884 12737 ts_tablet_manager.cc:1434] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:02:42.169078 12737 tablet_bootstrap.cc:492] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:42.175596 12443 catalog_manager.cc:5697] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 0 to 1, leader changed from <none> to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:42.174657 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 82338.2us
I20260709 13:02:42.163585 12947 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:02:42.177194 12662 leader_election.cc:343] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.191756 12736 tablet_bootstrap.cc:654] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.203847 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:42.204664 12876 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:42.205885 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:42.206594 12622 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.208076 12947 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:42.210278 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:02:42.209836 12662 leader_election.cc:343] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.216322 12740 raft_consensus.cc:359] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.217098 12740 raft_consensus.cc:385] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.223218 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:42.217397 12740 raft_consensus.cc:740] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.226451 12512 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:42.227078 12740 consensus_queue.cc:260] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.228567 12783 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:42.230759 12622 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:42.231592 12740 ts_tablet_manager.cc:1434] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.078s	user 0.005s	sys 0.000s
I20260709 13:02:42.240691 12740 tablet_bootstrap.cc:492] T e396b3164bf5409c9d6b0dd8dc22cd2d P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:42.245761 12963 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.246484 12963 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.234241 12737 tablet_bootstrap.cc:654] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.250501 12445 catalog_manager.cc:5697] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:42.252048 12659 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:42.259872 12792 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:42.260497 12792 raft_consensus.cc:697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:42.261422 12792 consensus_queue.cc:237] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.265425 12963 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:42.271896 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:42.276611 12619 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 0.
I20260709 13:02:42.278192 12510 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:42.279686 12910 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.279980 12759 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:42.280357 12759 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.280227 12910 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.280707 12759 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.286034 12759 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.288143 12910 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:42.290115 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:42.290835 12695 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 0.
I20260709 13:02:42.292362 12587 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:42.295444 12736 tablet_bootstrap.cc:492] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:42.295642 12771 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:42.295938 12736 ts_tablet_manager.cc:1403] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.234s	user 0.023s	sys 0.031s
I20260709 13:02:42.296123 12771 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.296276 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:42.297905 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:42.296572 12771 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.295610 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:42.299266 12619 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.298573 12694 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 0.
I20260709 13:02:42.301843 12736 raft_consensus.cc:359] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.302510 12736 raft_consensus.cc:385] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.302853 12736 raft_consensus.cc:740] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.303592 12736 consensus_queue.cc:260] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.305140 12736 ts_tablet_manager.cc:1434] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.002s
I20260709 13:02:42.306041 12736 tablet_bootstrap.cc:492] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
W20260709 13:02:42.308398 12588 leader_election.cc:343] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.309976 12759 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:42.324296 12445 catalog_manager.cc:5697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:42.328256 12771 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.331923 12740 tablet_bootstrap.cc:654] T e396b3164bf5409c9d6b0dd8dc22cd2d P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.332996 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:42.333220 12792 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.333667 12695 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.342113 12771 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:42.345736 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:42.345835 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:42.347189 12694 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.333868 12792 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:02:42.347688 12588 leader_election.cc:343] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.349277 12792 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:42.350057 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:42.355209 12876 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:42.357424 12662 leader_election.cc:343] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.358680 12736 tablet_bootstrap.cc:654] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.336562 12619 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:02:42.365217 12695 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:02:42.367825 12737 tablet_bootstrap.cc:492] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:42.367595 12510 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:42.368510 12963 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:42.369177 12963 raft_consensus.cc:697] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:02:42.370051 12792 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:42.370844 12694 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 1.
I20260709 13:02:42.370048 12963 consensus_queue.cc:237] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.368291 12737 ts_tablet_manager.cc:1403] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.199s	user 0.015s	sys 0.004s
I20260709 13:02:42.380009 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:42.380824 12619 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:42.381389 12587 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:42.382124 12737 raft_consensus.cc:359] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.382839 12737 raft_consensus.cc:385] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.383131 12737 raft_consensus.cc:740] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.383273 12736 tablet_bootstrap.cc:492] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:42.383455 12771 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:42.383703 12736 ts_tablet_manager.cc:1403] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.078s	user 0.007s	sys 0.005s
I20260709 13:02:42.384001 12737 consensus_queue.cc:260] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.386162 12737 ts_tablet_manager.cc:1434] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:02:42.387066 12737 tablet_bootstrap.cc:492] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:42.386969 12771 raft_consensus.cc:697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:02:42.391181 12659 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:42.387917 12771 consensus_queue.cc:237] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.393674 12876 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:42.394048 12876 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.397526 12876 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.409255 12910 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.410120 12910 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.437665 12876 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.442235 12740 tablet_bootstrap.cc:492] T e396b3164bf5409c9d6b0dd8dc22cd2d P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:42.442744 12740 ts_tablet_manager.cc:1403] T e396b3164bf5409c9d6b0dd8dc22cd2d P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.202s	user 0.011s	sys 0.004s
I20260709 13:02:42.443203 12736 raft_consensus.cc:359] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.444058 12736 raft_consensus.cc:385] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.444394 12736 raft_consensus.cc:740] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.447311 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:02:42.448623 12662 leader_election.cc:343] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:42.453773 12493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:42.456749 12736 consensus_queue.cc:260] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.463780 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:42.463639 12963 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:42.464042 12737 tablet_bootstrap.cc:654] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.464172 12445 catalog_manager.cc:5697] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 0 to 1, leader changed from <none> to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:42.466558 12588 leader_election.cc:343] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.467706 12736 ts_tablet_manager.cc:1434] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.084s	user 0.013s	sys 0.002s
I20260709 13:02:42.468740 12736 tablet_bootstrap.cc:492] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:42.465586 12876 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:42.472389 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:02:42.474138 12587 leader_election.cc:343] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.474654 12587 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:42.477389 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:42.478000 12622 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.487900 12740 raft_consensus.cc:359] T e396b3164bf5409c9d6b0dd8dc22cd2d P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.489142 12740 raft_consensus.cc:385] T e396b3164bf5409c9d6b0dd8dc22cd2d P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.489518 12740 raft_consensus.cc:740] T e396b3164bf5409c9d6b0dd8dc22cd2d P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.481506 12910 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:42.495134 12975 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:42.495754 12622 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:42.505527 12659 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:42.510143 12949 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:42.510805 12949 raft_consensus.cc:697] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:42.502290 12740 consensus_queue.cc:260] T e396b3164bf5409c9d6b0dd8dc22cd2d P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.511904 12949 consensus_queue.cc:237] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.524279 12740 ts_tablet_manager.cc:1434] T e396b3164bf5409c9d6b0dd8dc22cd2d P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.001s
I20260709 13:02:42.525643 12740 tablet_bootstrap.cc:492] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:42.520483 12445 catalog_manager.cc:5697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 0 to 1, leader changed from <none> to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:42.555459 12740 tablet_bootstrap.cc:654] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.565670 12736 tablet_bootstrap.cc:654] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.618180 12545 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.636190 12736 tablet_bootstrap.cc:492] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:42.639297 12736 ts_tablet_manager.cc:1403] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.169s	user 0.006s	sys 0.013s
I20260709 13:02:42.678339 12737 tablet_bootstrap.cc:492] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:42.680950 12737 ts_tablet_manager.cc:1403] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.294s	user 0.021s	sys 0.012s
I20260709 13:02:42.737226 12737 raft_consensus.cc:359] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.742934 12736 raft_consensus.cc:359] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.748672 12736 raft_consensus.cc:385] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.748986 12736 raft_consensus.cc:740] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.755653 12736 consensus_queue.cc:260] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.757651 12737 raft_consensus.cc:385] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.757998 12737 raft_consensus.cc:740] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.770982 12541 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.771348 12740 tablet_bootstrap.cc:492] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:42.772115 12740 ts_tablet_manager.cc:1403] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.247s	user 0.034s	sys 0.028s
I20260709 13:02:42.775561 12740 raft_consensus.cc:359] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.776204 12740 raft_consensus.cc:385] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.776636 12740 raft_consensus.cc:740] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.777679 12737 consensus_queue.cc:260] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.781793 12736 ts_tablet_manager.cc:1434] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.100s	user 0.009s	sys 0.005s
I20260709 13:02:42.782752 12947 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.777267 12740 consensus_queue.cc:260] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.783371 12947 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.784837 12736 tablet_bootstrap.cc:492] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:42.788251 12740 ts_tablet_manager.cc:1434] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.004s
I20260709 13:02:42.791594 12910 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.792243 12910 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.797219 12737 ts_tablet_manager.cc:1434] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.116s	user 0.006s	sys 0.008s
I20260709 13:02:42.806917 12910 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:42.809986 12759 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.810611 12759 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.809986 12792 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.813331 12904 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:42.814132 12792 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:42.816726 12792 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:42.828404 12791 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:42.822439 12783 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:02:42.849040 12737 tablet_bootstrap.cc:492] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:42.851197 12947 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:42.854888 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:42.866602 12759 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:42.913125 12740 tablet_bootstrap.cc:492] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:42.910575 12949 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:42.869390 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:42.925244 12949 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:02:42.926177 12512 leader_election.cc:343] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.927222 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:42.879338 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:42.936487 12949 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:42.943152 12737 tablet_bootstrap.cc:654] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.947979 12986 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:42.948902 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:42.949159 12619 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:42.950233 12618 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:42.958998 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:42.960599 12659 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:42.968612 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:42.969537 12659 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:42.973987 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:42.974828 12736 tablet_bootstrap.cc:654] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.976142 12985 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:42.976533 12985 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:42.976886 12985 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.979197 12740 tablet_bootstrap.cc:654] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.982149 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:42.977186 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:42.986728 12445 catalog_manager.cc:5697] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:42.988188 12588 leader_election.cc:343] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:42.991554 12662 leader_election.cc:343] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:42.975633 12986 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:02:42.994975 12662 consensus_peers.cc:597] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.995146 12989 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:02:42.995620 12662 leader_election.cc:343] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:43.005688 12662 consensus_peers.cc:597] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.992712 12986 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.010658 12986 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.029774 12737 tablet_bootstrap.cc:492] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:43.030217 12737 ts_tablet_manager.cc:1403] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.182s	user 0.019s	sys 0.015s
W20260709 13:02:43.043983 12587 leader_election.cc:343] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.044516 12587 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:43.049955 12771 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:43.054211 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 49761.4us
I20260709 13:02:43.056416 12910 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:43.065078 12737 raft_consensus.cc:359] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.065984 12737 raft_consensus.cc:385] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.066279 12737 raft_consensus.cc:740] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.067003 12737 consensus_queue.cc:260] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:02:43.067411 12510 leader_election.cc:343] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.068091 12510 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:43.069402 12989 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:43.069579 12737 ts_tablet_manager.cc:1434] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:02:43.070806 12737 tablet_bootstrap.cc:492] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:43.074743 12985 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.080421 12985 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:43.082472 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:43.083117 12618 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.090919 12618 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:43.092224 12659 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:43.093144 12985 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:43.093897 12985 raft_consensus.cc:697] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:43.094895 12985 consensus_queue.cc:237] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.095461 12737 tablet_bootstrap.cc:654] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.096707 12510 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:43.097906 12759 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:43.102061 12588 consensus_peers.cc:597] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:43.110316 12737 tablet_bootstrap.cc:492] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:43.110975 12737 ts_tablet_manager.cc:1403] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.006s
I20260709 13:02:43.113103 12737 raft_consensus.cc:359] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.113657 12737 raft_consensus.cc:385] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.113906 12737 raft_consensus.cc:740] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.114673 12737 consensus_queue.cc:260] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.116863 12737 ts_tablet_manager.cc:1434] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:02:43.117892 12737 tablet_bootstrap.cc:492] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:43.124622 12737 tablet_bootstrap.cc:654] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.126205 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:02:43.129920 12662 leader_election.cc:343] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.121677 12986 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.139163 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:43.139792 12618 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.142143 12989 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:43.146857 12618 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:43.148097 12659 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:43.149037 12985 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:43.149158 12910 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.149669 12985 raft_consensus.cc:697] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:43.149811 12910 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.150743 12985 consensus_queue.cc:237] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.149637 12986 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:43.151937 12910 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:43.153707 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:43.154284 12736 tablet_bootstrap.cc:492] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:43.154764 12736 ts_tablet_manager.cc:1403] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.370s	user 0.018s	sys 0.006s
W20260709 13:02:43.154896 12662 leader_election.cc:343] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.157301 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:43.157401 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:43.158712 12740 tablet_bootstrap.cc:492] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:43.159168 12740 ts_tablet_manager.cc:1403] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.246s	user 0.020s	sys 0.026s
W20260709 13:02:43.159198 12587 leader_election.cc:343] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.159075 12736 raft_consensus.cc:359] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.159894 12736 raft_consensus.cc:385] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:02:43.159987 12588 leader_election.cc:343] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.160164 12736 raft_consensus.cc:740] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.160396 12588 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:43.163281 12736 consensus_queue.cc:260] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.163764 12740 raft_consensus.cc:359] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.165443 12740 raft_consensus.cc:385] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.165762 12740 raft_consensus.cc:740] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.166546 12740 consensus_queue.cc:260] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.169171 12737 tablet_bootstrap.cc:492] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:43.170101 12743 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:43.175866 12736 ts_tablet_manager.cc:1434] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.002s
I20260709 13:02:43.177627 12736 tablet_bootstrap.cc:492] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:43.181429 12737 ts_tablet_manager.cc:1403] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.064s	user 0.008s	sys 0.021s
I20260709 13:02:43.196043 12740 ts_tablet_manager.cc:1434] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 13:02:43.200701 12791 consensus_queue.cc:1048] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:43.202008 12986 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.202486 12986 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.202811 12737 raft_consensus.cc:359] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.204116 12737 raft_consensus.cc:385] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.204397 12737 raft_consensus.cc:740] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.205227 12740 tablet_bootstrap.cc:492] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:43.206312 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:43.206985 12541 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:43.208516 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:43.209801 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:02:43.214846 12659 leader_election.cc:343] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.213804 12986 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:43.220291 12736 tablet_bootstrap.cc:654] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.216351 12737 consensus_queue.cc:260] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.215044 12985 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:43.222638 12985 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.222987 12985 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.229432 12737 ts_tablet_manager.cc:1434] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 13:02:43.230896 12737 tablet_bootstrap.cc:492] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:43.232911 12740 tablet_bootstrap.cc:654] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.240964 12985 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.258718 12737 tablet_bootstrap.cc:654] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.259189 12736 tablet_bootstrap.cc:492] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:43.259711 12736 ts_tablet_manager.cc:1403] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.015s
I20260709 13:02:43.262490 12985 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:43.264338 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:43.264457 12736 raft_consensus.cc:359] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.265075 12541 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.265192 12736 raft_consensus.cc:385] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.265803 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:43.265507 12736 raft_consensus.cc:740] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.268007 12736 consensus_queue.cc:260] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:02:43.268376 12659 leader_election.cc:343] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.274369 12736 ts_tablet_manager.cc:1434] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.005s
I20260709 13:02:43.275588 12736 tablet_bootstrap.cc:492] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:43.277637 12541 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:43.279177 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:43.280277 12949 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:43.280759 12949 raft_consensus.cc:697] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:43.281601 12949 consensus_queue.cc:237] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.286435 12736 tablet_bootstrap.cc:654] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.295879 12904 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.296563 12904 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.301074 12904 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:43.302165 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:43.303021 12621 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:43.304593 12659 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:43.307204 12904 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:43.307694 12904 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.308079 12904 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.326977 12443 catalog_manager.cc:5697] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:43.318053 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:43.330185 12541 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:43.332329 12443 catalog_manager.cc:5697] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:43.344372 12736 tablet_bootstrap.cc:492] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:43.334406 12740 tablet_bootstrap.cc:492] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:43.344956 12736 ts_tablet_manager.cc:1403] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.070s	user 0.020s	sys 0.028s
I20260709 13:02:43.345538 12740 ts_tablet_manager.cc:1403] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.141s	user 0.004s	sys 0.021s
I20260709 13:02:43.347934 12736 raft_consensus.cc:359] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.348716 12736 raft_consensus.cc:385] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.349025 12736 raft_consensus.cc:740] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.349826 12736 consensus_queue.cc:260] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.351960 12736 ts_tablet_manager.cc:1434] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.007s
I20260709 13:02:43.353057 12736 tablet_bootstrap.cc:492] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:43.352506 12904 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.356389 12740 raft_consensus.cc:359] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.357366 12740 raft_consensus.cc:385] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.357779 12740 raft_consensus.cc:740] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.359745 12740 consensus_queue.cc:260] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.363408 12740 ts_tablet_manager.cc:1434] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 13:02:43.365077 12737 tablet_bootstrap.cc:492] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:43.366667 12737 ts_tablet_manager.cc:1403] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.136s	user 0.047s	sys 0.047s
I20260709 13:02:43.366205 12736 tablet_bootstrap.cc:654] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.375072 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:43.375350 12737 raft_consensus.cc:359] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.375767 12541 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.376055 12737 raft_consensus.cc:385] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.376325 12737 raft_consensus.cc:740] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.379277 12740 tablet_bootstrap.cc:492] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:43.380345 12737 consensus_queue.cc:260] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.382977 12737 ts_tablet_manager.cc:1434] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:02:43.383958 12737 tablet_bootstrap.cc:492] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:43.383894 12904 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:43.385936 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:43.386577 12621 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.392130 12737 tablet_bootstrap.cc:654] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.400826 12740 tablet_bootstrap.cc:654] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.402161 12621 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:43.403609 12659 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:43.405282 12736 tablet_bootstrap.cc:492] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:43.405766 12949 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:43.407836 12736 ts_tablet_manager.cc:1403] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.055s	user 0.024s	sys 0.002s
I20260709 13:02:43.408887 12910 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.409629 12910 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.411907 12910 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:43.412350 12443 catalog_manager.cc:5697] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:43.413926 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:43.414433 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:43.408977 12949 raft_consensus.cc:697] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:02:43.418272 12587 leader_election.cc:343] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.418896 12949 consensus_queue.cc:237] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.415616 12910 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.421792 12547 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:43.421945 12588 leader_election.cc:343] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.422441 12588 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:43.423463 12743 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:43.415747 12736 raft_consensus.cc:359] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.425429 12736 raft_consensus.cc:385] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.425737 12736 raft_consensus.cc:740] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.427793 12910 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.429095 12736 consensus_queue.cc:260] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.434342 12736 ts_tablet_manager.cc:1434] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:02:43.435439 12736 tablet_bootstrap.cc:492] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:43.442793 12736 tablet_bootstrap.cc:654] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.448735 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:43.447938 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:43.450392 12587 leader_election.cc:343] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:43.450945 12588 leader_election.cc:343] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.451036 12910 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:43.451357 12588 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:43.454200 12910 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:43.480218 12740 tablet_bootstrap.cc:492] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:43.480772 12740 ts_tablet_manager.cc:1403] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.102s	user 0.010s	sys 0.006s
I20260709 13:02:43.483438 12736 tablet_bootstrap.cc:492] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:43.484035 12736 ts_tablet_manager.cc:1403] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.049s	user 0.023s	sys 0.003s
I20260709 13:02:43.483516 12740 raft_consensus.cc:359] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.486220 12740 raft_consensus.cc:385] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.486712 12740 raft_consensus.cc:740] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.487708 12736 raft_consensus.cc:359] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.488775 12736 raft_consensus.cc:385] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.487746 12740 consensus_queue.cc:260] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.489284 12736 raft_consensus.cc:740] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.496399 12736 consensus_queue.cc:260] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.498788 12736 ts_tablet_manager.cc:1434] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:02:43.495919 12740 ts_tablet_manager.cc:1434] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.015s	user 0.001s	sys 0.004s
I20260709 13:02:43.500123 12740 tablet_bootstrap.cc:492] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:43.427384 12541 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:43.502295 12736 tablet_bootstrap.cc:492] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:43.512099 12442 catalog_manager.cc:5697] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:43.520464 12740 tablet_bootstrap.cc:654] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.529280 12736 tablet_bootstrap.cc:654] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.532181 12737 tablet_bootstrap.cc:492] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:43.532734 12737 ts_tablet_manager.cc:1403] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.149s	user 0.034s	sys 0.043s
I20260709 13:02:43.534363 12910 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.534864 12910 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.536991 12737 raft_consensus.cc:359] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.537909 12737 raft_consensus.cc:385] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.538138 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:43.538329 12737 raft_consensus.cc:740] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.538975 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:43.539772 12541 raft_consensus.cc:2393] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 1: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:02:43.539312 12737 consensus_queue.cc:260] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.537012 12910 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:43.542824 12588 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:43.543187 12737 ts_tablet_manager.cc:1434] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.001s
I20260709 13:02:43.543871 12910 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.544768 12737 tablet_bootstrap.cc:492] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:43.545207 12904 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.548770 12904 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.552343 12737 tablet_bootstrap.cc:654] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.566114 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:43.567101 12621 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:43.568267 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:43.571130 12662 leader_election.cc:343] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.574805 12659 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:43.576787 12910 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:43.576741 12985 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:43.578648 12985 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:43.559306 12904 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:43.579048 12985 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.589272 12740 tablet_bootstrap.cc:492] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:43.589835 12740 ts_tablet_manager.cc:1403] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.090s	user 0.013s	sys 0.010s
I20260709 13:02:43.585155 12985 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.602144 12737 tablet_bootstrap.cc:492] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:43.602675 12737 ts_tablet_manager.cc:1403] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.024s
I20260709 13:02:43.604806 12736 tablet_bootstrap.cc:492] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:43.607956 12740 raft_consensus.cc:359] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.608722 12740 raft_consensus.cc:385] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.609006 12740 raft_consensus.cc:740] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.605309 12736 ts_tablet_manager.cc:1403] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.103s	user 0.020s	sys 0.009s
W20260709 13:02:43.610252 12493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:43.613688 12736 raft_consensus.cc:359] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.614488 12736 raft_consensus.cc:385] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.614774 12736 raft_consensus.cc:740] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.615520 12736 consensus_queue.cc:260] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.615937 12737 raft_consensus.cc:359] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.616655 12737 raft_consensus.cc:385] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.616919 12737 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.617334 12740 consensus_queue.cc:260] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.618818 12737 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.621892 12736 ts_tablet_manager.cc:1434] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:02:43.622881 12736 tablet_bootstrap.cc:492] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:43.624370 12985 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.628846 12740 ts_tablet_manager.cc:1434] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.003s
I20260709 13:02:43.630007 12740 tablet_bootstrap.cc:492] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:43.638518 12544 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.638973 12986 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.638521 12737 ts_tablet_manager.cc:1434] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.002s
I20260709 13:02:43.639497 12986 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.641199 12737 tablet_bootstrap.cc:492] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:43.642388 12986 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:43.646246 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:43.668612 12736 tablet_bootstrap.cc:654] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.677817 12985 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:43.681739 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:43.682636 12621 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:43.683970 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:43.693590 12620 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.685736 12659 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:02:43.695791 12662 leader_election.cc:343] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.698403 12986 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:43.698860 12986 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.699209 12986 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.702083 12743 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.702641 12743 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.704921 12743 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:43.707121 12986 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.708190 12987 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.708666 12987 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.709573 12986 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:43.710354 12740 tablet_bootstrap.cc:654] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.711726 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:43.710875 12987 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:43.713367 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:43.714998 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:43.716147 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:43.718595 12621 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.720672 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:43.721329 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:02:43.723047 12587 leader_election.cc:343] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.725900 12545 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.727085 12910 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:43.731073 12662 leader_election.cc:343] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:43.733091 12588 leader_election.cc:343] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.733654 12588 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:43.734570 12743 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:43.729030 12985 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:02:43.727974 12910 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.735020 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:43.718081 12986 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:02:43.758085 12986 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.758404 12985 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.758684 12986 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.758984 12985 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.760943 12986 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:43.761030 12985 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:43.763587 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:43.763855 12620 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:43.764346 12619 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:43.765058 12737 tablet_bootstrap.cc:654] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.765203 12659 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:43.765899 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:43.767249 12659 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:43.768316 12904 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:43.768525 12736 tablet_bootstrap.cc:492] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:43.769093 12736 ts_tablet_manager.cc:1403] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.146s	user 0.017s	sys 0.001s
I20260709 13:02:43.768426 12792 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:43.770277 12792 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.770655 12792 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.768854 12904 raft_consensus.cc:697] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:43.771757 12904 consensus_queue.cc:237] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.772425 12736 raft_consensus.cc:359] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.773284 12736 raft_consensus.cc:385] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.773617 12736 raft_consensus.cc:740] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.774605 12736 consensus_queue.cc:260] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.776844 12736 ts_tablet_manager.cc:1434] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:43.779347 12621 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:43.781929 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:43.783052 12910 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:02:43.784368 12659 leader_election.cc:343] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:43.784526 12587 leader_election.cc:343] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.787572 12740 tablet_bootstrap.cc:492] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:43.795764 12740 ts_tablet_manager.cc:1403] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.166s	user 0.007s	sys 0.017s
I20260709 13:02:43.791043 12659 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:43.792901 12510 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:43.794526 12736 tablet_bootstrap.cc:492] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
W20260709 13:02:43.790642 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 57600.5us
I20260709 13:02:43.798252 12792 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.803351 12947 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:43.808570 12792 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:43.811807 12986 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:43.811398 12442 catalog_manager.cc:5697] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:43.811964 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:43.814791 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:43.818183 12791 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:43.820067 12662 leader_election.cc:343] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:43.821156 12662 leader_election.cc:343] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.821069 12791 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:43.821592 12662 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:02:43.822594 12662 leader_election.cc:343] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.824462 12989 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.824182 12986 raft_consensus.cc:697] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:43.826865 12989 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.827646 12986 consensus_queue.cc:237] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.829588 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:43.830700 12989 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:43.831228 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:43.834908 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:43.842707 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:43.825759 12791 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:43.848299 12662 leader_election.cc:343] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:43.870126 12588 leader_election.cc:343] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.870636 12588 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:43.864141 12743 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.873083 12910 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:43.867364 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:43.878893 12512 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:43.876082 12743 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.883385 12743 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:43.884018 12620 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.885543 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:43.901191 12740 raft_consensus.cc:359] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.901912 12740 raft_consensus.cc:385] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.902151 12740 raft_consensus.cc:740] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
W20260709 13:02:43.902631 12587 leader_election.cc:343] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.903069 12740 consensus_queue.cc:260] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.905529 12736 tablet_bootstrap.cc:654] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.906306 12737 tablet_bootstrap.cc:492] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:43.906908 12737 ts_tablet_manager.cc:1403] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.266s	user 0.020s	sys 0.009s
I20260709 13:02:43.913636 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:43.916008 12588 leader_election.cc:343] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:43.916620 12588 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:43.917922 12740 ts_tablet_manager.cc:1434] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.118s	user 0.007s	sys 0.000s
I20260709 13:02:43.920368 12975 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:43.923825 12737 raft_consensus.cc:359] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.924810 12737 raft_consensus.cc:385] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.925200 12737 raft_consensus.cc:740] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.925726 12620 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:43.931416 12740 tablet_bootstrap.cc:492] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:43.933003 12737 consensus_queue.cc:260] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.939742 12659 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:43.943511 12792 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:43.944031 12792 raft_consensus.cc:697] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:43.942901 12904 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:43.944802 12792 consensus_queue.cc:237] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:43.949880 12737 ts_tablet_manager.cc:1434] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:02:43.953642 12737 tablet_bootstrap.cc:492] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:43.968716 12949 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:43.968367 12442 catalog_manager.cc:5697] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:43.967948 12987 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:44.014673 12740 tablet_bootstrap.cc:654] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.020684 12443 catalog_manager.cc:5697] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.030769 12736 tablet_bootstrap.cc:492] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:44.031245 12736 ts_tablet_manager.cc:1403] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.237s	user 0.025s	sys 0.008s
I20260709 13:02:44.042621 12736 raft_consensus.cc:359] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.043453 12736 raft_consensus.cc:385] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.043790 12736 raft_consensus.cc:740] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.044580 12736 consensus_queue.cc:260] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.047004 12736 ts_tablet_manager.cc:1434] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.002s
I20260709 13:02:44.048060 12736 tablet_bootstrap.cc:492] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:44.043090 12737 tablet_bootstrap.cc:654] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.058665 12743 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.059233 12740 tablet_bootstrap.cc:492] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:44.059842 12740 ts_tablet_manager.cc:1403] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.129s	user 0.006s	sys 0.007s
I20260709 13:02:44.059221 12743 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.051635 12985 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:02:44.063742 12743 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:44.063720 12740 raft_consensus.cc:359] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.064882 12740 raft_consensus.cc:385] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.065131 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:02:44.066874 12587 leader_election.cc:343] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.065176 12740 raft_consensus.cc:740] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.071555 12736 tablet_bootstrap.cc:654] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.080227 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:44.082077 12588 leader_election.cc:343] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.082522 12588 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:44.067996 12740 consensus_queue.cc:260] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.083665 12743 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:44.084533 12740 ts_tablet_manager.cc:1434] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 13:02:44.085500 12740 tablet_bootstrap.cc:492] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:44.099303 12740 tablet_bootstrap.cc:654] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.114387 12737 tablet_bootstrap.cc:492] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:44.114907 12737 ts_tablet_manager.cc:1403] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.162s	user 0.015s	sys 0.010s
I20260709 13:02:44.130816 12737 raft_consensus.cc:359] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.131354 12737 raft_consensus.cc:385] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.131690 12737 raft_consensus.cc:740] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.137841 12737 consensus_queue.cc:260] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.142655 12736 tablet_bootstrap.cc:492] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:44.143200 12736 ts_tablet_manager.cc:1403] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.095s	user 0.025s	sys 0.008s
I20260709 13:02:44.157763 12737 ts_tablet_manager.cc:1434] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:02:44.158860 12737 tablet_bootstrap.cc:492] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:44.162479 12736 raft_consensus.cc:359] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.163297 12736 raft_consensus.cc:385] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.163782 12736 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.164897 12737 tablet_bootstrap.cc:654] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.169147 12736 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.171783 12736 ts_tablet_manager.cc:1434] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:02:44.172876 12736 tablet_bootstrap.cc:492] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:44.175885 12740 tablet_bootstrap.cc:492] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:44.176373 12740 ts_tablet_manager.cc:1403] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.091s	user 0.017s	sys 0.022s
I20260709 13:02:44.178768 12987 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.179224 12987 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.179286 12740 raft_consensus.cc:359] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.180047 12740 raft_consensus.cc:385] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.180332 12740 raft_consensus.cc:740] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.181185 12987 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:44.181013 12740 consensus_queue.cc:260] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.183494 12740 ts_tablet_manager.cc:1434] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:44.183594 12736 tablet_bootstrap.cc:654] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.183535 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:44.184360 12621 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 1: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:02:44.184640 12740 tablet_bootstrap.cc:492] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:44.189158 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:44.191653 12740 tablet_bootstrap.cc:654] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.192940 12510 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:44.194073 12989 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.196374 12737 tablet_bootstrap.cc:492] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:44.196856 12737 ts_tablet_manager.cc:1403] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.006s
I20260709 13:02:44.207408 12737 raft_consensus.cc:359] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.208463 12737 raft_consensus.cc:385] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.208824 12737 raft_consensus.cc:740] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.215214 12989 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:44.217595 12737 consensus_queue.cc:260] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.220728 12737 ts_tablet_manager.cc:1434] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:02:44.222114 12737 tablet_bootstrap.cc:492] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:44.236137 12736 tablet_bootstrap.cc:492] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:44.236744 12736 ts_tablet_manager.cc:1403] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.021s
I20260709 13:02:44.238548 12541 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.239677 12740 tablet_bootstrap.cc:492] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:44.240213 12740 ts_tablet_manager.cc:1403] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.006s
I20260709 13:02:44.239758 12736 raft_consensus.cc:359] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.241099 12736 raft_consensus.cc:385] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.241325 12736 raft_consensus.cc:740] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.241926 12736 consensus_queue.cc:260] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.247308 12737 tablet_bootstrap.cc:654] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.249200 12736 ts_tablet_manager.cc:1434] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:02:44.258786 12736 tablet_bootstrap.cc:492] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:44.256767 12740 raft_consensus.cc:359] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:02:44.269905 12662 consensus_peers.cc:597] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.270475 12737 tablet_bootstrap.cc:492] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:44.271588 12736 tablet_bootstrap.cc:654] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.271739 12737 ts_tablet_manager.cc:1403] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.003s
I20260709 13:02:44.275099 12737 raft_consensus.cc:359] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.275947 12737 raft_consensus.cc:385] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.276315 12737 raft_consensus.cc:740] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.277267 12737 consensus_queue.cc:260] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.269912 12740 raft_consensus.cc:385] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.288199 12740 raft_consensus.cc:740] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.288923 12740 consensus_queue.cc:260] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.291891 12740 ts_tablet_manager.cc:1434] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.001s
I20260709 13:02:44.293226 12740 tablet_bootstrap.cc:492] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:44.298545 12541 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.300655 12737 ts_tablet_manager.cc:1434] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:02:44.313392 12740 tablet_bootstrap.cc:654] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.326385 12737 tablet_bootstrap.cc:492] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:44.335299 12904 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.336000 12904 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.336663 12736 tablet_bootstrap.cc:492] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:44.339208 12987 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.339864 12987 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.340479 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:44.340790 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:44.341387 12620 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:44.341991 12987 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:44.342567 12904 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:02:44.343467 12662 leader_election.cc:343] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.344170 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:44.337144 12736 ts_tablet_manager.cc:1403] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.079s	user 0.024s	sys 0.022s
I20260709 13:02:44.346858 12659 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:44.348086 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:44.348939 12620 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 1: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:02:44.349996 12510 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:44.350379 12737 tablet_bootstrap.cc:654] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.351401 12987 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.351581 12736 raft_consensus.cc:359] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.352420 12736 raft_consensus.cc:385] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.352728 12736 raft_consensus.cc:740] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.353611 12736 consensus_queue.cc:260] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.359902 12791 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.360625 12791 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.363085 12792 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:44.363348 12791 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:44.365991 12985 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:44.366573 12985 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.367075 12985 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.382759 12987 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:44.384085 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:44.387123 12662 leader_election.cc:343] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.387290 12986 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:44.391326 12736 ts_tablet_manager.cc:1434] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:02:44.397518 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:44.398218 12621 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:44.398813 12736 tablet_bootstrap.cc:492] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:44.400794 12659 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:44.403432 12986 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:44.406574 12986 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.406961 12986 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.387109 12985 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.412331 12737 tablet_bootstrap.cc:492] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:44.412900 12737 ts_tablet_manager.cc:1403] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.087s	user 0.011s	sys 0.036s
I20260709 13:02:44.415825 12737 raft_consensus.cc:359] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.416555 12737 raft_consensus.cc:385] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.416863 12737 raft_consensus.cc:740] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.419904 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:44.422602 12740 tablet_bootstrap.cc:492] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:44.423095 12740 ts_tablet_manager.cc:1403] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.130s	user 0.021s	sys 0.025s
W20260709 13:02:44.423269 12662 leader_election.cc:343] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.425472 12986 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.425647 12740 raft_consensus.cc:359] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.439585 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:44.440171 12740 raft_consensus.cc:385] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.440400 12621 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.438103 12737 consensus_queue.cc:260] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.442499 12737 ts_tablet_manager.cc:1434] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:02:44.444351 12737 tablet_bootstrap.cc:492] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:44.445422 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:44.440503 12740 raft_consensus.cc:740] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.434597 12736 tablet_bootstrap.cc:654] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.450065 12743 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.450596 12743 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.453856 12743 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:44.454363 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:44.454797 12740 consensus_queue.cc:260] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:02:44.456688 12662 leader_election.cc:343] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.455073 12694 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 0.
I20260709 13:02:44.457291 12737 tablet_bootstrap.cc:654] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.437811 12985 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:44.458611 12587 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:44.460163 12743 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:44.460485 12743 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.460769 12743 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.463146 12621 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:44.465394 12740 ts_tablet_manager.cc:1434] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.002s
I20260709 13:02:44.466612 12659 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:44.471122 12949 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:44.471702 12949 raft_consensus.cc:697] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:44.472637 12949 consensus_queue.cc:237] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.474078 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:44.475477 12986 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:02:44.475553 12588 leader_election.cc:343] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.488597 12736 tablet_bootstrap.cc:492] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:44.489115 12736 ts_tablet_manager.cc:1403] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.091s	user 0.010s	sys 0.001s
I20260709 13:02:44.491859 12736 raft_consensus.cc:359] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.492574 12736 raft_consensus.cc:385] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.492851 12736 raft_consensus.cc:740] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.493994 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:44.494758 12620 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.497159 12736 consensus_queue.cc:260] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.499442 12736 ts_tablet_manager.cc:1434] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 13:02:44.500505 12736 tablet_bootstrap.cc:492] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:44.501065 12740 tablet_bootstrap.cc:492] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:44.499758 12743 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.506255 12975 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.506896 12975 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.510759 12975 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:44.513167 12736 tablet_bootstrap.cc:654] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.517891 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:44.519130 12743 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:02:44.519145 12587 leader_election.cc:343] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.519268 12975 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.523686 12975 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.524753 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:44.525350 12694 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.525697 12975 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:44.520275 12544 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.527285 12740 tablet_bootstrap.cc:654] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.522347 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:44.522341 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:44.530062 12620 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:44.530258 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:44.533749 12986 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:44.535183 12587 leader_election.cc:343] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:44.536001 12588 leader_election.cc:343] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:44.537184 12588 leader_election.cc:343] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.537695 12588 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:44.563496 12694 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 1.
I20260709 13:02:44.540371 12975 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:44.560390 12659 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:44.577517 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:44.568161 12985 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:44.581005 12987 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.589483 12587 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:44.589957 12987 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.575577 12986 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:44.591008 12986 raft_consensus.cc:697] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:44.591387 12975 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:44.591876 12975 raft_consensus.cc:697] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:02:44.592242 12987 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:44.592674 12975 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.593446 12791 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:44.596410 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:02:44.596622 12588 leader_election.cc:343] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.597227 12588 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:44.598001 12743 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:44.591897 12986 consensus_queue.cc:237] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.604261 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:44.605741 12619 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:02:44.609899 12510 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:02:44.614099 12947 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:44.614511 12947 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.614838 12947 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.617511 12736 tablet_bootstrap.cc:492] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:44.618304 12736 ts_tablet_manager.cc:1403] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.118s	user 0.021s	sys 0.014s
I20260709 13:02:44.633412 12740 tablet_bootstrap.cc:492] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:44.634024 12740 ts_tablet_manager.cc:1403] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.150s	user 0.011s	sys 0.008s
I20260709 13:02:44.636940 12740 raft_consensus.cc:359] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.637466 12740 raft_consensus.cc:385] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.638468 12740 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.638978 12740 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.639983 12876 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.645522 12876 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.647356 12737 tablet_bootstrap.cc:492] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:44.647883 12737 ts_tablet_manager.cc:1403] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.204s	user 0.021s	sys 0.014s
I20260709 13:02:44.650682 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:44.652204 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:44.653021 12618 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:44.654378 12442 catalog_manager.cc:5697] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:44.658342 12662 leader_election.cc:343] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.659839 12659 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:44.660647 12792 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:44.661019 12792 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.661578 12792 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.662578 12949 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.647907 12876 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:44.663033 12949 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.665015 12949 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:44.667029 12737 raft_consensus.cc:359] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.667861 12737 raft_consensus.cc:385] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.668152 12737 raft_consensus.cc:740] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.669096 12737 consensus_queue.cc:260] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.675825 12740 ts_tablet_manager.cc:1434] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.000s
I20260709 13:02:44.676837 12740 tablet_bootstrap.cc:492] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:44.670877 12736 raft_consensus.cc:359] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.681169 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:44.681974 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:44.682772 12947 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.687152 12736 raft_consensus.cc:385] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.692421 12736 raft_consensus.cc:740] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.693926 12736 consensus_queue.cc:260] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.699276 12792 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:02:44.717927 12493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:44.718755 12620 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:44.721751 12975 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.722450 12975 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.723574 12792 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:44.724169 12947 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:44.725039 12547 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:02:44.752141 12659 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:44.764197 12986 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.764914 12986 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.768210 12792 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:44.768656 12792 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.768981 12792 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.725867 12975 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:44.777139 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:44.783241 12740 tablet_bootstrap.cc:654] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.788291 12737 ts_tablet_manager.cc:1434] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.140s	user 0.009s	sys 0.001s
I20260709 13:02:44.788524 12792 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.792315 12736 ts_tablet_manager.cc:1434] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.174s	user 0.005s	sys 0.027s
I20260709 13:02:44.796932 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:44.797284 12986 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:44.800002 12737 tablet_bootstrap.cc:492] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:44.804685 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:44.803900 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:44.805397 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:44.807746 12620 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.808802 12736 tablet_bootstrap.cc:492] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:44.811018 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:44.812680 12792 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:44.813163 12622 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
W20260709 13:02:44.813773 12587 leader_election.cc:343] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.814313 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:44.816797 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:44.817433 12618 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.820902 12620 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:44.830224 12659 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:44.842408 13061 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.842991 13061 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.844362 12618 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:44.845337 12792 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:44.845692 12659 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:44.847064 12792 raft_consensus.cc:697] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:02:44.848030 12662 leader_election.cc:343] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:44.848924 12588 leader_election.cc:343] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:44.849089 12662 leader_election.cc:343] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.849309 12588 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:44.847633 12876 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:44.851198 12876 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:44.850698 12975 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:44.851593 12876 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.853739 12904 consensus_queue.cc:1059] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:44.854553 12949 raft_consensus.cc:3055] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:44.854892 12949 raft_consensus.cc:740] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:44.856415 12659 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:44.858613 12510 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:44.857664 13061 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:44.846283 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:44.858062 12792 consensus_queue.cc:237] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.861159 12443 catalog_manager.cc:5697] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 0 to 1, leader changed from <none> to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.862731 12985 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:44.863040 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:44.866240 12695 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 1: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:02:44.867331 12985 raft_consensus.cc:697] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:44.868193 12985 consensus_queue.cc:237] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.860227 12987 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:44.864281 12949 consensus_queue.cc:260] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.880100 12949 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.880568 12740 tablet_bootstrap.cc:492] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:44.881080 12740 ts_tablet_manager.cc:1403] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.204s	user 0.014s	sys 0.009s
I20260709 13:02:44.884737 12737 tablet_bootstrap.cc:654] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:44.885390 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:44.888792 12662 leader_election.cc:343] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.887974 12876 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.890328 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:44.891155 13055 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:44.899842 12662 leader_election.cc:343] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.906723 12510 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:44.909116 12759 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.912981 12876 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:44.920347 12740 raft_consensus.cc:359] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.921934 12740 raft_consensus.cc:385] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:44.922271 12740 raft_consensus.cc:740] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:44.926815 12759 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:44.905722 13055 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.927963 12740 consensus_queue.cc:260] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.929302 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:44.930436 12740 ts_tablet_manager.cc:1434] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.003s
I20260709 13:02:44.938092 12740 tablet_bootstrap.cc:492] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:44.940960 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:44.941660 12620 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.945972 12736 tablet_bootstrap.cc:654] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:44.949625 12662 leader_election.cc:343] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:44.966959 12985 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:44.979225 12759 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:44.979913 12759 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:44.997793 12620 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:45.017359 12659 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:45.021301 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:45.027236 12904 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.029454 12904 raft_consensus.cc:697] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:45.031068 12904 consensus_queue.cc:237] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.032552 12740 tablet_bootstrap.cc:654] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.014364 12541 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.034479 12759 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:45.035969 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:45.036042 12975 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:45.130002 12512 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:45.138654 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:45.139263 12621 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:45.125154 12910 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.128535 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:45.146837 12910 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:02:45.148145 12662 leader_election.cc:343] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.149006 12910 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:45.161303 12443 catalog_manager.cc:5697] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:45.136315 13055 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:45.164063 12736 tablet_bootstrap.cc:492] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:45.163781 12443 catalog_manager.cc:5697] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:45.164559 12736 ts_tablet_manager.cc:1403] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.356s	user 0.034s	sys 0.056s
I20260709 13:02:45.168768 12737 tablet_bootstrap.cc:492] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:45.169312 12737 ts_tablet_manager.cc:1403] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.376s	user 0.016s	sys 0.017s
I20260709 13:02:45.151979 12910 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 13:02:45.173990 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:45.174312 12737 raft_consensus.cc:359] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.174047 12736 raft_consensus.cc:359] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.175046 12737 raft_consensus.cc:385] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.176008 12737 raft_consensus.cc:740] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.177225 12740 tablet_bootstrap.cc:492] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
W20260709 13:02:45.177729 12588 leader_election.cc:343] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.175495 12736 raft_consensus.cc:385] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.178399 12736 raft_consensus.cc:740] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.179245 12736 consensus_queue.cc:260] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.177863 12740 ts_tablet_manager.cc:1403] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.240s	user 0.016s	sys 0.013s
I20260709 13:02:45.181478 12736 ts_tablet_manager.cc:1434] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:02:45.182559 12736 tablet_bootstrap.cc:492] T 8dcafb50fd3c47afbf475b1da51b147a P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:45.182752 13065 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:45.176687 12737 consensus_queue.cc:260] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.192613 12737 ts_tablet_manager.cc:1434] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:02:45.196266 12740 raft_consensus.cc:359] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.200592 12740 raft_consensus.cc:385] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.200902 12740 raft_consensus.cc:740] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.202883 12740 consensus_queue.cc:260] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.204258 12986 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:45.205703 12659 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:45.207919 12740 ts_tablet_manager.cc:1434] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
W20260709 13:02:45.193310 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 60604.3us
I20260709 13:02:45.210054 12986 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.210482 12986 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.211615 12986 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.222723 12910 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.223306 12910 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.226531 12740 tablet_bootstrap.cc:492] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:45.239418 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:45.241782 12737 tablet_bootstrap.cc:492] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:45.225495 12910 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:45.243263 13055 consensus_queue.cc:1048] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:45.259413 12443 catalog_manager.cc:5697] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:45.262362 12443 catalog_manager.cc:5697] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:45.264907 12662 consensus_peers.cc:597] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.267855 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:45.272423 12588 leader_election.cc:343] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:45.280079 12662 consensus_peers.cc:597] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.283087 12736 tablet_bootstrap.cc:654] T 8dcafb50fd3c47afbf475b1da51b147a P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.289287 12740 tablet_bootstrap.cc:654] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.295341 12986 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.298102 12986 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:45.307695 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:45.316527 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:45.317173 12617 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:45.317314 12662 leader_election.cc:343] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.331707 12737 tablet_bootstrap.cc:654] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.309548 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:45.353852 12986 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:02:45.369190 13070 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:02:45.387164 12617 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:45.415583 12659 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
W20260709 13:02:45.417166 12648 tablet.cc:2406] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:02:45.419046 12876 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.430827 12876 raft_consensus.cc:697] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:45.431775 12876 consensus_queue.cc:237] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.435516 12740 tablet_bootstrap.cc:492] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:45.436045 12740 ts_tablet_manager.cc:1403] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.210s	user 0.015s	sys 0.014s
I20260709 13:02:45.444285 12736 tablet_bootstrap.cc:492] T 8dcafb50fd3c47afbf475b1da51b147a P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:45.445000 12736 ts_tablet_manager.cc:1403] T 8dcafb50fd3c47afbf475b1da51b147a P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.263s	user 0.017s	sys 0.016s
I20260709 13:02:45.454799 12737 tablet_bootstrap.cc:492] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:45.455324 12737 ts_tablet_manager.cc:1403] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.214s	user 0.023s	sys 0.009s
I20260709 13:02:45.460155 12740 raft_consensus.cc:359] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.460855 12740 raft_consensus.cc:385] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.461133 12740 raft_consensus.cc:740] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.461814 12740 consensus_queue.cc:260] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:02:45.463528 12587 leader_election.cc:343] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.463964 12740 ts_tablet_manager.cc:1434] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 13:02:45.464004 12587 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:45.465821 13077 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:45.466665 12541 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.467178 12740 tablet_bootstrap.cc:492] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:45.467074 12737 raft_consensus.cc:359] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.467784 12737 raft_consensus.cc:385] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.468108 12737 raft_consensus.cc:740] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.468762 12737 consensus_queue.cc:260] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.480854 13070 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.482929 13070 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.487110 13070 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:45.488499 12737 ts_tablet_manager.cc:1434] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.001s
I20260709 13:02:45.488947 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:45.489699 12619 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:45.491492 12659 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:45.492412 12740 tablet_bootstrap.cc:654] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.492465 13070 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.492992 13070 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.489706 12737 tablet_bootstrap.cc:492] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:45.493546 13070 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:45.496901 12587 leader_election.cc:343] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.497385 12587 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:02:45.502936 13077 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:45.505927 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:45.506647 12547 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
W20260709 13:02:45.506700 12662 consensus_peers.cc:597] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:45.508605 12736 raft_consensus.cc:359] T 8dcafb50fd3c47afbf475b1da51b147a P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.509976 12736 raft_consensus.cc:385] T 8dcafb50fd3c47afbf475b1da51b147a P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.510350 12736 raft_consensus.cc:740] T 8dcafb50fd3c47afbf475b1da51b147a P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.513053 12949 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:45.520315 12736 consensus_queue.cc:260] T 8dcafb50fd3c47afbf475b1da51b147a P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:02:45.488999 13086 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:02:45.529335 12736 ts_tablet_manager.cc:1434] T 8dcafb50fd3c47afbf475b1da51b147a P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.002s
I20260709 13:02:45.541649 12445 catalog_manager.cc:5697] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:45.544646 13070 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.549901 13070 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:45.553303 12736 tablet_bootstrap.cc:492] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:45.555226 12740 tablet_bootstrap.cc:492] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:45.555737 12740 ts_tablet_manager.cc:1403] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.089s	user 0.012s	sys 0.008s
I20260709 13:02:45.557274 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:45.557900 12617 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.564347 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:45.564946 12543 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.565604 12737 tablet_bootstrap.cc:654] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.574004 12543 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:45.577243 12740 raft_consensus.cc:359] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.578521 12740 raft_consensus.cc:385] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.578768 12740 raft_consensus.cc:740] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.579371 12740 consensus_queue.cc:260] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.586100 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:45.589359 12740 ts_tablet_manager.cc:1434] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.002s
I20260709 13:02:45.590677 12740 tablet_bootstrap.cc:492] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:45.591935 13070 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.592478 13070 raft_consensus.cc:697] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:45.593291 13070 consensus_queue.cc:237] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.599265 12617 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:45.599781 12876 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:45.617709 12736 tablet_bootstrap.cc:654] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.620688 12442 catalog_manager.cc:5697] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:45.639303 12740 tablet_bootstrap.cc:654] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.643637 12737 tablet_bootstrap.cc:492] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:45.644202 12737 ts_tablet_manager.cc:1403] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.155s	user 0.013s	sys 0.009s
I20260709 13:02:45.656216 13070 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.656773 13070 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.658861 13070 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:45.659821 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:45.660442 12620 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:45.661922 12659 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:45.662909 13070 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.663326 13070 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.663684 13070 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.664870 12737 raft_consensus.cc:359] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.665581 12737 raft_consensus.cc:385] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.665855 12737 raft_consensus.cc:740] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.666591 12737 consensus_queue.cc:260] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.665247 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:45.676712 12662 leader_election.cc:343] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.680120 12737 ts_tablet_manager.cc:1434] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 13:02:45.680248 13070 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.681173 12737 tablet_bootstrap.cc:492] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:45.683811 12736 tablet_bootstrap.cc:492] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:45.684327 12736 ts_tablet_manager.cc:1403] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.152s	user 0.009s	sys 0.006s
I20260709 13:02:45.691093 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:45.691396 12740 tablet_bootstrap.cc:492] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:45.691905 12740 ts_tablet_manager.cc:1403] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.101s	user 0.010s	sys 0.006s
W20260709 13:02:45.692324 12662 leader_election.cc:343] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.694510 12736 raft_consensus.cc:359] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.695178 12736 raft_consensus.cc:385] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.696084 12740 raft_consensus.cc:359] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.696731 12740 raft_consensus.cc:385] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.697007 12740 raft_consensus.cc:740] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.697613 12740 consensus_queue.cc:260] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.700852 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:45.701402 12621 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.704165 12740 ts_tablet_manager.cc:1434] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:02:45.705173 12740 tablet_bootstrap.cc:492] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:45.707451 12737 tablet_bootstrap.cc:654] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.707916 12621 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:45.709085 12659 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:45.709937 12949 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.710382 12949 raft_consensus.cc:697] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:45.710999 13065 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.711180 12949 consensus_queue.cc:237] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.711589 13065 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.714143 13065 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:45.715498 12740 tablet_bootstrap.cc:654] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.716306 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:45.718752 12545 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.721805 12737 tablet_bootstrap.cc:492] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:45.722234 12737 ts_tablet_manager.cc:1403] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.000s
I20260709 13:02:45.723591 13070 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:45.725385 12736 raft_consensus.cc:740] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.725119 12737 raft_consensus.cc:359] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.725972 12737 raft_consensus.cc:385] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.726231 12737 raft_consensus.cc:740] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.726485 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:45.726925 12737 consensus_queue.cc:260] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.728040 12736 consensus_queue.cc:260] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.729067 12737 ts_tablet_manager.cc:1434] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:45.730248 12736 ts_tablet_manager.cc:1434] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 13:02:45.731528 12736 tablet_bootstrap.cc:492] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:45.733743 12737 tablet_bootstrap.cc:492] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:45.739591 12740 tablet_bootstrap.cc:492] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:45.740084 12740 ts_tablet_manager.cc:1403] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.000s
I20260709 13:02:45.747435 12736 tablet_bootstrap.cc:654] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.728866 12510 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:45.749118 12740 raft_consensus.cc:359] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.749888 12740 raft_consensus.cc:385] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.750188 12740 raft_consensus.cc:740] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.750845 12740 consensus_queue.cc:260] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.752079 13065 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:45.752888 12740 ts_tablet_manager.cc:1434] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:02:45.753877 12740 tablet_bootstrap.cc:492] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:45.759934 12740 tablet_bootstrap.cc:654] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.790747 12543 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.748441 12737 tablet_bootstrap.cc:654] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.801607 12736 tablet_bootstrap.cc:492] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:45.802057 12736 ts_tablet_manager.cc:1403] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.005s
I20260709 13:02:45.806154 12740 tablet_bootstrap.cc:492] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:45.806643 12740 ts_tablet_manager.cc:1403] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.007s
I20260709 13:02:45.811677 12740 raft_consensus.cc:359] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.812377 12740 raft_consensus.cc:385] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.812667 12740 raft_consensus.cc:740] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.813241 12736 raft_consensus.cc:359] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.813916 12736 raft_consensus.cc:385] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.814267 12736 raft_consensus.cc:740] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.814864 12736 consensus_queue.cc:260] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.816223 12740 consensus_queue.cc:260] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.823324 12740 ts_tablet_manager.cc:1434] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:02:45.824162 12736 ts_tablet_manager.cc:1434] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:02:45.824378 12740 tablet_bootstrap.cc:492] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:45.825223 12736 tablet_bootstrap.cc:492] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f: Bootstrap starting.
I20260709 13:02:45.831087 12740 tablet_bootstrap.cc:654] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.833206 12443 catalog_manager.cc:5697] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:45.849268 12736 tablet_bootstrap.cc:654] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.860749 12737 tablet_bootstrap.cc:492] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:45.861267 12737 ts_tablet_manager.cc:1403] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.128s	user 0.034s	sys 0.019s
I20260709 13:02:45.865273 12737 raft_consensus.cc:359] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.869278 12737 raft_consensus.cc:385] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.869590 12737 raft_consensus.cc:740] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.870240 12737 consensus_queue.cc:260] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.872752 12737 ts_tablet_manager.cc:1434] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:02:45.874115 12949 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.874612 12949 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.876662 12949 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:45.878369 12737 tablet_bootstrap.cc:492] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:45.878322 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:45.878947 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:45.879209 12621 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
W20260709 13:02:45.880219 12662 leader_election.cc:343] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.882434 12659 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:45.883538 12986 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.883900 12986 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.884191 12740 tablet_bootstrap.cc:492] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:45.884248 12986 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.884809 12740 ts_tablet_manager.cc:1403] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.010s
I20260709 13:02:45.887346 12740 raft_consensus.cc:359] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.888000 12740 raft_consensus.cc:385] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.888263 12740 raft_consensus.cc:740] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.884291 12736 tablet_bootstrap.cc:492] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f: No bootstrap required, opened a new log
I20260709 13:02:45.889008 12736 ts_tablet_manager.cc:1403] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.008s
I20260709 13:02:45.888865 12740 consensus_queue.cc:260] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.891026 12740 ts_tablet_manager.cc:1434] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:45.913291 12737 tablet_bootstrap.cc:654] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.924597 12740 tablet_bootstrap.cc:492] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:45.891222 12986 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.928237 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:02:45.902891 12493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:02:45.929661 12662 leader_election.cc:343] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:45.893030 12736 raft_consensus.cc:359] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.930619 12736 raft_consensus.cc:385] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.930882 12736 raft_consensus.cc:740] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.931525 12736 consensus_queue.cc:260] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.932214 12949 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:45.932559 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:45.933261 12621 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.931506 12986 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:45.944643 12737 tablet_bootstrap.cc:492] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:45.945163 12737 ts_tablet_manager.cc:1403] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.003s
I20260709 13:02:45.950318 12543 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.953867 13065 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.954399 13065 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.956785 13065 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:45.958575 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:45.959300 12695 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 0.
I20260709 13:02:45.959642 12736 ts_tablet_manager.cc:1434] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f: Time spent starting tablet: real 0.070s	user 0.009s	sys 0.002s
I20260709 13:02:45.961217 12512 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:45.962855 12989 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:45.963243 12989 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:45.963586 12989 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.967757 12621 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:45.984457 12659 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:45.975054 12989 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.978122 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:45.985821 12949 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.986059 12617 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 0.
I20260709 13:02:45.986406 12949 raft_consensus.cc:697] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:45.987237 12949 consensus_queue.cc:237] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.989961 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:45.990639 12695 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.991693 12989 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:45.996361 12737 raft_consensus.cc:359] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:45.997606 12737 raft_consensus.cc:385] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.004136 13070 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:46.010033 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:46.010782 12620 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.011727 12543 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.027813 12620 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:02:46.067678 12740 tablet_bootstrap.cc:654] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.092415 12510 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:46.039948 12695 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:02:45.997978 12737 raft_consensus.cc:740] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.070142 12986 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:46.095144 12737 consensus_queue.cc:260] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.080852 12949 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.096626 12737 ts_tablet_manager.cc:1434] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.151s	user 0.008s	sys 0.001s
I20260709 13:02:46.105825 12949 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.110656 12737 tablet_bootstrap.cc:492] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:46.110561 13111 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.109040 12443 catalog_manager.cc:5697] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.115595 12949 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:46.115203 13111 raft_consensus.cc:697] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:02:46.118045 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:46.118830 12621 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:46.118521 13111 consensus_queue.cc:237] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.121248 12740 tablet_bootstrap.cc:492] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:46.123474 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:46.120517 12659 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:46.149389 12740 ts_tablet_manager.cc:1403] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.226s	user 0.017s	sys 0.012s
I20260709 13:02:46.150799 13070 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.151219 13070 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.151566 13070 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.157207 12740 raft_consensus.cc:359] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.157474 12949 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:46.160230 12662 leader_election.cc:343] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.168295 12737 tablet_bootstrap.cc:654] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.161269 13070 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.171366 13070 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:46.158155 12740 raft_consensus.cc:385] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.175290 12740 raft_consensus.cc:740] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.176410 12740 consensus_queue.cc:260] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.177062 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:46.177788 12621 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.179628 12989 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.181007 12989 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.187619 12989 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:46.190356 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:02:46.191499 12512 leader_election.cc:343] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.194867 12621 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:46.196239 12659 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:46.199781 12949 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.200258 12949 raft_consensus.cc:697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:46.200492 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:46.201121 12949 consensus_queue.cc:237] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:02:46.210328 12662 leader_election.cc:343] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.213464 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:46.214175 12620 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 0.
I20260709 13:02:46.217757 12510 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:02:46.219830 12740 ts_tablet_manager.cc:1434] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.000s
I20260709 13:02:46.219957 12989 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.220373 12989 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.220715 12989 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.220927 12740 tablet_bootstrap.cc:492] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:46.225293 12986 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.226814 12443 catalog_manager.cc:5697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.233517 12737 tablet_bootstrap.cc:492] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:46.234025 12737 ts_tablet_manager.cc:1403] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.124s	user 0.011s	sys 0.005s
I20260709 13:02:46.236996 13077 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.237516 13077 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.237396 12989 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.242199 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:46.286294 12737 raft_consensus.cc:359] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.278685 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:46.287802 12737 raft_consensus.cc:385] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.288184 12737 raft_consensus.cc:740] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
W20260709 13:02:46.264043 12662 consensus_peers.cc:597] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:46.289544 12740 tablet_bootstrap.cc:654] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:46.295006 12588 leader_election.cc:343] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.297688 12737 consensus_queue.cc:260] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.299739 12695 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 0.
I20260709 13:02:46.300774 12910 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:02:46.301306 12910 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.285208 13070 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.257623 13077 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:46.305519 12910 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:46.306106 13070 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.310271 12737 ts_tablet_manager.cc:1434] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.076s	user 0.013s	sys 0.015s
I20260709 13:02:46.313436 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:46.317860 12621 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.318630 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:46.306604 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:46.321904 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:46.322520 12696 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:02:46.322588 12543 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 2: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:02:46.323607 12512 leader_election.cc:343] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.317190 12989 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:46.327750 12621 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:02:46.329125 12510 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:02:46.330039 12587 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:46.330745 12910 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:46.331033 12910 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:02:46.331399 12910 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.333953 12737 tablet_bootstrap.cc:492] T a059fe8e339d4b8f8fd0c9f18705f015 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:46.333676 13111 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.338634 13111 raft_consensus.cc:697] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:02:46.339602 13111 consensus_queue.cc:237] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.341547 13070 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:46.347054 12910 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.356509 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:46.358307 12620 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:46.355146 12445 catalog_manager.cc:5697] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 0 to 1, leader changed from <none> to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.365866 12659 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:46.366849 12949 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.367331 12949 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.367688 12949 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.368049 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:46.368908 12543 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 2: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:02:46.375463 12949 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.397805 12737 tablet_bootstrap.cc:654] T a059fe8e339d4b8f8fd0c9f18705f015 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.412694 12587 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:46.413698 13077 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.417289 13077 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.419958 13077 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:46.420706 13077 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.421082 13077 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.421507 13077 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.421653 13069 consensus_queue.cc:1048] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:46.422363 12737 tablet_bootstrap.cc:492] T a059fe8e339d4b8f8fd0c9f18705f015 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:46.422818 12737 ts_tablet_manager.cc:1403] T a059fe8e339d4b8f8fd0c9f18705f015 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.094s	user 0.010s	sys 0.002s
I20260709 13:02:46.424082 12949 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:46.425247 12737 raft_consensus.cc:359] T a059fe8e339d4b8f8fd0c9f18705f015 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.426242 12737 raft_consensus.cc:385] T a059fe8e339d4b8f8fd0c9f18705f015 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.426652 12737 raft_consensus.cc:740] T a059fe8e339d4b8f8fd0c9f18705f015 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.427639 12737 consensus_queue.cc:260] T a059fe8e339d4b8f8fd0c9f18705f015 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.430809 12737 ts_tablet_manager.cc:1434] T a059fe8e339d4b8f8fd0c9f18705f015 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:02:46.432497 12737 tablet_bootstrap.cc:492] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:46.447863 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:46.454120 12910 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:46.460669 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:46.461328 12695 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 0.
I20260709 13:02:46.462466 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:46.462678 12587 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:46.477128 12695 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:02:46.483021 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:46.484709 13077 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.486744 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:02:46.490420 12662 leader_election.cc:343] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.490458 12740 tablet_bootstrap.cc:492] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:46.492741 12740 ts_tablet_manager.cc:1403] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.272s	user 0.039s	sys 0.035s
W20260709 13:02:46.499181 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 64495.2us
W20260709 13:02:46.500696 12588 leader_election.cc:343] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.502910 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:46.503687 12621 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.513335 12621 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:46.521984 12910 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.522555 12910 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.522997 12910 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:46.552495 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 60899.1us
W20260709 13:02:46.562769 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 100166us
W20260709 13:02:46.564293 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 62460.2us
I20260709 13:02:46.568698 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:02:46.570228 12588 leader_election.cc:343] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.579180 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:46.579890 12696 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:46.582140 12662 leader_election.cc:343] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:46.582890 12662 consensus_peers.cc:597] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:46.585009 12587 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:46.560325 13077 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:46.602670 13133 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:46.627003 12737 tablet_bootstrap.cc:654] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.631695 12910 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.638758 12910 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:46.613235 13133 raft_consensus.cc:697] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:02:46.641852 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:02:46.643896 12694 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:46.642062 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 52644us
I20260709 13:02:46.650998 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:02:46.653576 12588 leader_election.cc:343] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.656627 12740 raft_consensus.cc:359] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.657625 12740 raft_consensus.cc:385] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.657980 12740 raft_consensus.cc:740] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.666851 12740 consensus_queue.cc:260] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.673314 12694 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 1.
I20260709 13:02:46.680029 12587 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:46.683534 12659 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:46.699330 12740 ts_tablet_manager.cc:1434] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.206s	user 0.006s	sys 0.002s
I20260709 13:02:46.706929 12740 tablet_bootstrap.cc:492] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:46.700568 13070 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:02:46.718461 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 52028.6us
I20260709 13:02:46.703663 13140 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.714324 13070 raft_consensus.cc:697] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:46.712162 13133 consensus_queue.cc:237] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.724345 13070 consensus_queue.cc:237] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.728047 13140 raft_consensus.cc:697] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:02:46.729192 13140 consensus_queue.cc:237] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:02:46.735635 13137 log.cc:927] Time spent T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.169s	user 0.000s	sys 0.006s
I20260709 13:02:46.738284 12696 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 1.
I20260709 13:02:46.739945 12587 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:02:46.740484 12445 catalog_manager.cc:5697] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 0 to 1, leader changed from <none> to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.742985 13125 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.755079 13125 raft_consensus.cc:697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:02:46.757266 12740 tablet_bootstrap.cc:654] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.756125 13125 consensus_queue.cc:237] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:02:46.761721 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 75474us
I20260709 13:02:46.798738 12737 tablet_bootstrap.cc:492] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:46.799422 12737 ts_tablet_manager.cc:1403] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.367s	user 0.012s	sys 0.016s
W20260709 13:02:46.829399 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 243597us
I20260709 13:02:46.846131 12545 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.878163 12737 raft_consensus.cc:359] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.878942 12737 raft_consensus.cc:385] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.879268 12737 raft_consensus.cc:740] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.867130 13135 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 13:02:46.931196 12740 tablet_bootstrap.cc:492] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:46.931779 12740 ts_tablet_manager.cc:1403] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.229s	user 0.025s	sys 0.029s
I20260709 13:02:46.941668 12444 catalog_manager.cc:5697] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 2 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.936547 12740 raft_consensus.cc:359] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.950253 12740 raft_consensus.cc:385] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.950608 12740 raft_consensus.cc:740] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.961127 12740 consensus_queue.cc:260] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:46.965183 12740 ts_tablet_manager.cc:1434] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.002s
I20260709 13:02:46.966269 12740 tablet_bootstrap.cc:492] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:46.977298 13135 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:02:46.997344 12662 consensus_peers.cc:597] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:47.007676 12740 tablet_bootstrap.cc:654] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.007803 12737 consensus_queue.cc:260] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:47.018429 12737 ts_tablet_manager.cc:1434] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.219s	user 0.009s	sys 0.004s
I20260709 13:02:47.018085 13131 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:02:47.042510 12737 tablet_bootstrap.cc:492] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a: Bootstrap starting.
I20260709 13:02:47.077206 13141 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.077795 13141 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:47.079914 13141 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:47.080370 13141 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.094508 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:47.097218 12695 raft_consensus.cc:2410] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
W20260709 13:02:47.107971 12512 consensus_peers.cc:597] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:47.114713 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:47.116623 12740 tablet_bootstrap.cc:492] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:47.117112 12740 ts_tablet_manager.cc:1403] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.151s	user 0.006s	sys 0.012s
I20260709 13:02:47.122061 12512 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:47.126127 13142 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:47.124743 12443 catalog_manager.cc:5697] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:47.137615 13077 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:47.173650 12737 tablet_bootstrap.cc:654] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.184564 12740 raft_consensus.cc:359] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:47.185416 12740 raft_consensus.cc:385] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.193643 12740 raft_consensus.cc:740] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.197381 12740 consensus_queue.cc:260] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:47.203809 12740 ts_tablet_manager.cc:1434] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.086s	user 0.009s	sys 0.000s
I20260709 13:02:47.206570 12737 tablet_bootstrap.cc:492] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a: No bootstrap required, opened a new log
I20260709 13:02:47.207113 12737 ts_tablet_manager.cc:1403] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a: Time spent bootstrapping tablet: real 0.180s	user 0.009s	sys 0.004s
I20260709 13:02:47.208484 13077 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:47.217535 12444 catalog_manager.cc:5697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 0 to 1, leader changed from <none> to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.219372 12444 catalog_manager.cc:5697] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 0 to 1, leader changed from <none> to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:47.222937 12588 consensus_peers.cc:597] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:47.229395 12740 tablet_bootstrap.cc:492] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:47.235008 12737 raft_consensus.cc:359] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:47.235828 12737 raft_consensus.cc:385] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.236131 12737 raft_consensus.cc:740] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.243430 12540 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.265143 12949 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.266479 12538 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:47.268000 12737 consensus_queue.cc:260] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:47.275987 13133 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:47.277832 13155 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.278398 13155 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:47.292364 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:47.291071 13143 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:02:47.295671 13155 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:47.297359 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:47.299393 12512 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:47.304802 12737 ts_tablet_manager.cc:1434] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a: Time spent starting tablet: real 0.097s	user 0.008s	sys 0.000s
I20260709 13:02:47.309994 13147 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:47.320083 12493 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:47.325387 12692 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:47.328104 12740 tablet_bootstrap.cc:654] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.338884 13128 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:02:47.356899 12588 consensus_peers.cc:597] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:47.384124 12740 tablet_bootstrap.cc:492] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:47.384658 12740 ts_tablet_manager.cc:1403] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.156s	user 0.015s	sys 0.005s
I20260709 13:02:47.387658 12740 raft_consensus.cc:359] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:47.388518 12740 raft_consensus.cc:385] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.388830 12740 raft_consensus.cc:740] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.389636 12740 consensus_queue.cc:260] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:47.397821 12740 ts_tablet_manager.cc:1434] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:02:47.398952 12740 tablet_bootstrap.cc:492] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:47.402477 13156 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.403090 13156 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:47.405409 13156 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:47.410116 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:02:47.412313 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:47.413024 12613 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 0.
I20260709 13:02:47.415673 12659 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:02:47.417619 13156 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:47.418015 13156 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:47.418383 13156 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.418841 12740 tablet_bootstrap.cc:654] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:47.421038 12662 leader_election.cc:343] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:47.431867 12740 tablet_bootstrap.cc:492] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:47.432441 12740 ts_tablet_manager.cc:1403] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.000s
I20260709 13:02:47.435487 12740 raft_consensus.cc:359] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:47.436349 12740 raft_consensus.cc:385] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.436663 12740 raft_consensus.cc:740] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.440124 12740 consensus_queue.cc:260] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:47.458668 12740 ts_tablet_manager.cc:1434] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.001s
I20260709 13:02:47.464069 13156 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:47.464890 12740 tablet_bootstrap.cc:492] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:47.473181 12740 tablet_bootstrap.cc:654] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.477380 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:02:47.478186 12540 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.490887 13156 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:47.495847 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:02:47.496692 12613 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.500552 12540 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:47.502070 12662 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:02:47.503902 12949 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:47.504433 12949 raft_consensus.cc:697] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:02:47.505330 12949 consensus_queue.cc:237] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:47.507463 12692 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.523903 12613 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:02:47.540194 12740 tablet_bootstrap.cc:492] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:47.540886 12740 ts_tablet_manager.cc:1403] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.010s
I20260709 13:02:47.543831 12740 raft_consensus.cc:359] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:47.544612 12740 raft_consensus.cc:385] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.544916 12740 raft_consensus.cc:740] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.554358 12740 consensus_queue.cc:260] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:47.575292 12740 ts_tablet_manager.cc:1434] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.004s
I20260709 13:02:47.576617 12740 tablet_bootstrap.cc:492] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653: Bootstrap starting.
I20260709 13:02:47.573387 12443 catalog_manager.cc:5697] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:47.590837 12740 tablet_bootstrap.cc:654] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:47.605310 12740 tablet_bootstrap.cc:492] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653: No bootstrap required, opened a new log
I20260709 13:02:47.605912 12740 ts_tablet_manager.cc:1403] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.002s
I20260709 13:02:47.612355 12740 raft_consensus.cc:359] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:47.614899 12740 raft_consensus.cc:385] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:47.615248 12740 raft_consensus.cc:740] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Initialized, Role: FOLLOWER
I20260709 13:02:47.615957 12740 consensus_queue.cc:260] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:47.618356 12740 ts_tablet_manager.cc:1434] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:02:47.619189 12540 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.632855 12546 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.718866 12540 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:47.824688 13065 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:47.825194 13065 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:02:47.827644 13065 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:47.828550 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:02:47.829259 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:02:47.830907 12512 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:02:47.831552 13065 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:47.976709 12546 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:48.082541 12876 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:48.101794 12876 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:48.761871 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:48.771241 13188 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:48.776715 13189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:48.786865 11443 server_base.cc:1061] running on GCE node
W20260709 13:02:48.786697 13191 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:48.789849 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:48.790120 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:48.790340 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602168790320 us; error 0 us; skew 500 ppm
I20260709 13:02:48.790961 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:48.795038 11443 webserver.cc:533] Webserver started at http://127.11.44.196:39007/ using document root <none> and password file <none>
I20260709 13:02:48.795581 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:48.795946 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:48.796412 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:48.798529 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-3-root/instance:
uuid: "66750b8bbd4c4b3a9695951d0ede3372"
format_stamp: "Formatted at 2026-07-09 13:02:48 on dist-test-slave-qv7r"
I20260709 13:02:48.806958 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.003s
I20260709 13:02:48.814043 13196 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:48.819188 11443 fs_manager.cc:730] Time spent opening block manager: real 0.009s	user 0.003s	sys 0.001s
I20260709 13:02:48.819598 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-3-root
uuid: "66750b8bbd4c4b3a9695951d0ede3372"
format_stamp: "Formatted at 2026-07-09 13:02:48 on dist-test-slave-qv7r"
I20260709 13:02:48.820035 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:48.863555 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:48.865170 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:48.867370 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:48.870471 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:48.870844 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
I20260709 13:02:48.871184 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:48.871411 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:49.058377 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.196:33997
I20260709 13:02:49.058485 13259 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.196:33997 every 8 connection(s)
I20260709 13:02:49.070185 11443 auto_leader_rebalancer-test.cc:384] add a tserver: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:02:49.118685 13260 heartbeater.cc:344] Connected to a master server at 127.11.44.254:44047
I20260709 13:02:49.119172 13260 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:49.120115 13260 heartbeater.cc:507] Master 127.11.44.254:44047 requested a full tablet report, sending...
I20260709 13:02:49.122493 12443 ts_manager.cc:194] Registered new tserver with Master: 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:02:49.124202 12443 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50014
I20260709 13:02:49.476508 12540 consensus_queue.cc:237] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:49.503444 12619 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:49.505200 13142 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:49.522164 12692 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:49.523841 13142 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:02:49.530977 12513 consensus_peers.cc:597] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b8a1e8bdbd894ee4abb7a463446fe471. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:49.543082 13147 raft_consensus.cc:2955] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:49.551297 12696 raft_consensus.cc:2955] T b8a1e8bdbd894ee4abb7a463446fe471 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:49.569164 12615 raft_consensus.cc:2955] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:49.579262 12443 catalog_manager.cc:5697] T b8a1e8bdbd894ee4abb7a463446fe471 P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:49.613794 12692 consensus_queue.cc:237] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:49.727475 12615 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:49.732100 12546 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:49.732532 12949 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:49.755879 12876 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:49.758356 12949 raft_consensus.cc:2955] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:49.761010 12622 raft_consensus.cc:2955] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
W20260709 13:02:49.780167 12662 consensus_peers.cc:597] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5589ff6a0b984c84a050ecad03db5a87. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:49.798878 12694 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:49.802736 12445 catalog_manager.cc:5697] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:49.813143 12540 raft_consensus.cc:2955] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
W20260709 13:02:49.851123 12662 consensus_peers.cc:597] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0f7c3aec6a56450cb76aab45d874eff7. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:49.858970 12617 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:49.861977 13278 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:49.861790 12540 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:49.867657 13278 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:49.880992 13156 raft_consensus.cc:2955] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:49.888525 12617 raft_consensus.cc:2955] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:49.893651 12540 raft_consensus.cc:2955] T 0f7c3aec6a56450cb76aab45d874eff7 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:49.915405 12445 catalog_manager.cc:5697] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:49.924464 12694 consensus_queue.cc:237] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:49.933473 13291 ts_tablet_manager.cc:933] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307)
I20260709 13:02:49.951586 13291 tablet_copy_client.cc:323] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.193:43307
I20260709 13:02:49.956584 12540 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:49.958655 13143 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:49.962589 12662 consensus_peers.cc:597] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dda7dbc055d64c86aedec4299e15f997. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:49.962647 12615 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:49.968272 13143 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:49.975742 12557 tablet_copy_service.cc:140] P a70479a3b4114f3581095e9890f5d653: Received BeginTabletCopySession request for tablet b8a1e8bdbd894ee4abb7a463446fe471 from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:35624)
I20260709 13:02:49.976610 12557 tablet_copy_service.cc:161] P a70479a3b4114f3581095e9890f5d653: Beginning new tablet copy session on tablet b8a1e8bdbd894ee4abb7a463446fe471 from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:35624: session id = 66750b8bbd4c4b3a9695951d0ede3372-b8a1e8bdbd894ee4abb7a463446fe471
I20260709 13:02:50.002005 12557 tablet_copy_source_session.cc:215] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:50.007181 13291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8a1e8bdbd894ee4abb7a463446fe471. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.011170 13278 raft_consensus.cc:2955] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:50.014751 12538 raft_consensus.cc:2955] T dda7dbc055d64c86aedec4299e15f997 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:50.029292 12615 raft_consensus.cc:2955] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:50.045244 12444 catalog_manager.cc:5697] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:50.041620 13291 tablet_copy_client.cc:806] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:50.049976 13291 tablet_copy_client.cc:670] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:50.057421 13291 tablet_copy_client.cc:538] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:50.080246 13291 tablet_bootstrap.cc:492] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:02:50.108311 13291 tablet_bootstrap.cc:492] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:50.115824 13291 tablet_bootstrap.cc:492] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:02:50.116770 13291 ts_tablet_manager.cc:1403] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.009s
I20260709 13:02:50.119689 13291 raft_consensus.cc:359] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:50.123472 13291 raft_consensus.cc:740] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:02:50.124192 13291 consensus_queue.cc:260] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:50.126713 13260 heartbeater.cc:499] Master 127.11.44.254:44047 was elected leader, sending a full tablet report...
I20260709 13:02:50.145980 13291 ts_tablet_manager.cc:1434] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.003s
I20260709 13:02:50.150820 12557 tablet_copy_service.cc:342] P a70479a3b4114f3581095e9890f5d653: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-b8a1e8bdbd894ee4abb7a463446fe471 received from {username='slave'} at 127.0.0.1:35624
I20260709 13:02:50.151358 12557 tablet_copy_service.cc:434] P a70479a3b4114f3581095e9890f5d653: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-b8a1e8bdbd894ee4abb7a463446fe471 on tablet b8a1e8bdbd894ee4abb7a463446fe471 with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:02:50.268045 13291 ts_tablet_manager.cc:933] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:50.270107 13291 tablet_copy_client.cc:323] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.195:34641
I20260709 13:02:50.286098 13301 ts_tablet_manager.cc:933] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:50.285890 12706 tablet_copy_service.cc:140] P 7ad68e814a7741488971822f2598183a: Received BeginTabletCopySession request for tablet 5589ff6a0b984c84a050ecad03db5a87 from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:46988)
I20260709 13:02:50.286880 12706 tablet_copy_service.cc:161] P 7ad68e814a7741488971822f2598183a: Beginning new tablet copy session on tablet 5589ff6a0b984c84a050ecad03db5a87 from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:46988: session id = 66750b8bbd4c4b3a9695951d0ede3372-5589ff6a0b984c84a050ecad03db5a87
I20260709 13:02:50.294714 13301 tablet_copy_client.cc:323] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.195:34641
I20260709 13:02:50.301669 12706 tablet_copy_source_session.cc:215] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:50.311183 12706 tablet_copy_service.cc:140] P 7ad68e814a7741488971822f2598183a: Received BeginTabletCopySession request for tablet 0f7c3aec6a56450cb76aab45d874eff7 from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:46988)
I20260709 13:02:50.311846 12706 tablet_copy_service.cc:161] P 7ad68e814a7741488971822f2598183a: Beginning new tablet copy session on tablet 0f7c3aec6a56450cb76aab45d874eff7 from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:46988: session id = 66750b8bbd4c4b3a9695951d0ede3372-0f7c3aec6a56450cb76aab45d874eff7
I20260709 13:02:50.321545 12706 tablet_copy_source_session.cc:215] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:50.326107 13301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f7c3aec6a56450cb76aab45d874eff7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.340445 13291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5589ff6a0b984c84a050ecad03db5a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.353034 13301 tablet_copy_client.cc:806] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:50.357983 13301 tablet_copy_client.cc:670] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:50.365694 13301 tablet_copy_client.cc:538] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:50.367166 13291 tablet_copy_client.cc:806] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:50.367835 13291 tablet_copy_client.cc:670] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:50.371554 13291 tablet_copy_client.cc:538] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:50.383937 13301 tablet_bootstrap.cc:492] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:02:50.387960 13291 tablet_bootstrap.cc:492] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:02:50.423266 13235 raft_consensus.cc:1217] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:50.451053 13301 tablet_bootstrap.cc:492] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:50.452459 13301 tablet_bootstrap.cc:492] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:02:50.453599 13301 ts_tablet_manager.cc:1403] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.070s	user 0.019s	sys 0.009s
I20260709 13:02:50.456838 13301 raft_consensus.cc:359] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:50.457793 13301 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:02:50.458493 13301 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:50.460819 13301 ts_tablet_manager.cc:1434] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 13:02:50.463654 12706 tablet_copy_service.cc:342] P 7ad68e814a7741488971822f2598183a: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-0f7c3aec6a56450cb76aab45d874eff7 received from {username='slave'} at 127.0.0.1:46988
I20260709 13:02:50.464156 12706 tablet_copy_service.cc:434] P 7ad68e814a7741488971822f2598183a: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-0f7c3aec6a56450cb76aab45d874eff7 on tablet 0f7c3aec6a56450cb76aab45d874eff7 with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:02:50.482846 13291 tablet_bootstrap.cc:492] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:50.483954 13291 tablet_bootstrap.cc:492] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:02:50.484745 13291 ts_tablet_manager.cc:1403] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.097s	user 0.022s	sys 0.019s
I20260709 13:02:50.488003 13291 raft_consensus.cc:359] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:50.488979 13291 raft_consensus.cc:740] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:02:50.489717 13291 consensus_queue.cc:260] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:50.499270 13291 ts_tablet_manager.cc:1434] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.002s
I20260709 13:02:50.505236 12706 tablet_copy_service.cc:342] P 7ad68e814a7741488971822f2598183a: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-5589ff6a0b984c84a050ecad03db5a87 received from {username='slave'} at 127.0.0.1:46988
I20260709 13:02:50.505751 12706 tablet_copy_service.cc:434] P 7ad68e814a7741488971822f2598183a: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-5589ff6a0b984c84a050ecad03db5a87 on tablet 5589ff6a0b984c84a050ecad03db5a87 with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:02:50.545130 13291 ts_tablet_manager.cc:933] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:50.554453 13291 tablet_copy_client.cc:323] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.195:34641
I20260709 13:02:50.556125 12706 tablet_copy_service.cc:140] P 7ad68e814a7741488971822f2598183a: Received BeginTabletCopySession request for tablet dda7dbc055d64c86aedec4299e15f997 from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:46988)
I20260709 13:02:50.556741 12706 tablet_copy_service.cc:161] P 7ad68e814a7741488971822f2598183a: Beginning new tablet copy session on tablet dda7dbc055d64c86aedec4299e15f997 from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:46988: session id = 66750b8bbd4c4b3a9695951d0ede3372-dda7dbc055d64c86aedec4299e15f997
I20260709 13:02:50.565234 12706 tablet_copy_source_session.cc:215] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:50.569212 13291 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dda7dbc055d64c86aedec4299e15f997. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.586323 13291 tablet_copy_client.cc:806] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:50.587389 13291 tablet_copy_client.cc:670] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:50.592537 13291 tablet_copy_client.cc:538] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:50.608506 13291 tablet_bootstrap.cc:492] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:02:50.637987 13291 tablet_bootstrap.cc:492] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:50.638988 13291 tablet_bootstrap.cc:492] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:02:50.639676 13291 ts_tablet_manager.cc:1403] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.012s
I20260709 13:02:50.644004 13291 raft_consensus.cc:359] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:50.644899 13291 raft_consensus.cc:740] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:02:50.645522 13291 consensus_queue.cc:260] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:50.648212 13291 ts_tablet_manager.cc:1434] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:50.655118 13235 raft_consensus.cc:1217] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:50.688043 12706 tablet_copy_service.cc:342] P 7ad68e814a7741488971822f2598183a: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-dda7dbc055d64c86aedec4299e15f997 received from {username='slave'} at 127.0.0.1:46988
I20260709 13:02:50.705539 12706 tablet_copy_service.cc:434] P 7ad68e814a7741488971822f2598183a: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-dda7dbc055d64c86aedec4299e15f997 on tablet dda7dbc055d64c86aedec4299e15f997 with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:02:50.741117 13235 raft_consensus.cc:1217] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:50.880290 13272 raft_consensus.cc:1064] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:02:50.883296 13272 consensus_queue.cc:237] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:50.902885 13235 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:50.907393 12694 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:50.908495 13279 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:50.909801 12617 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:50.918895 13280 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:50.921283 13280 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:50.983845 13235 raft_consensus.cc:1217] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:02:51.015642 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 45951.1us
I20260709 13:02:51.018791 13308 raft_consensus.cc:2955] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.020761 13235 raft_consensus.cc:2955] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.038901 12443 catalog_manager.cc:5697] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.053092 12692 raft_consensus.cc:2955] T b8a1e8bdbd894ee4abb7a463446fe471 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.065230 12617 raft_consensus.cc:2955] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.168507 12538 consensus_queue.cc:237] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:51.176213 13235 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:51.178854 13308 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:51.188331 12617 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:51.196153 13280 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:51.197199 13279 raft_consensus.cc:2955] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.203294 12617 raft_consensus.cc:2955] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.212142 13235 raft_consensus.cc:2955] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.224323 12876 raft_consensus.cc:1064] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:02:51.226585 12876 consensus_queue.cc:237] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:51.227946 12432 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b8a1e8bdbd894ee4abb7a463446fe471 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:51.243853 12445 catalog_manager.cc:5697] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.274092 12682 tablet_service.cc:1558] Processing DeleteTablet for tablet b8a1e8bdbd894ee4abb7a463446fe471 with delete_type TABLET_DATA_TOMBSTONED (TS 7ad68e814a7741488971822f2598183a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37280
I20260709 13:02:51.289676 12622 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:51.290318 13235 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:51.290614 12546 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:51.291669 13319 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:51.308874 13143 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:51.310084 13277 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:51.330327 13321 tablet_replica.cc:333] T b8a1e8bdbd894ee4abb7a463446fe471 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:02:51.331651 13321 raft_consensus.cc:2243] T b8a1e8bdbd894ee4abb7a463446fe471 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:51.336279 13321 raft_consensus.cc:2272] T b8a1e8bdbd894ee4abb7a463446fe471 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:51.352384 13321 ts_tablet_manager.cc:1916] T b8a1e8bdbd894ee4abb7a463446fe471 P 7ad68e814a7741488971822f2598183a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:02:51.353502 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 56167.2us
I20260709 13:02:51.362217 13322 raft_consensus.cc:1064] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:02:51.382876 13322 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:51.395567 13321 ts_tablet_manager.cc:1929] T b8a1e8bdbd894ee4abb7a463446fe471 P 7ad68e814a7741488971822f2598183a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:51.401180 13143 raft_consensus.cc:1064] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:02:51.403513 13143 consensus_queue.cc:237] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:51.409463 12876 raft_consensus.cc:2955] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.396134 13321 log.cc:1199] T b8a1e8bdbd894ee4abb7a463446fe471 P 7ad68e814a7741488971822f2598183a: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-2-root/wals/b8a1e8bdbd894ee4abb7a463446fe471
I20260709 13:02:51.424078 12431 catalog_manager.cc:5028] TS 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): tablet b8a1e8bdbd894ee4abb7a463446fe471 (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:02:51.427001 13234 raft_consensus.cc:2955] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.435631 13233 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:51.444659 13156 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:51.445310 12617 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:51.460733 12540 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:51.476730 13319 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:51.491719 12617 raft_consensus.cc:2955] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.500330 13319 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:51.515225 12546 raft_consensus.cc:2955] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.517894 12442 catalog_manager.cc:5697] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.531893 13143 raft_consensus.cc:2955] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.533504 12613 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:51.536983 13234 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:51.545617 12613 raft_consensus.cc:2955] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.558982 13319 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:51.566327 12538 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:51.566720 13156 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:51.571887 12445 catalog_manager.cc:5697] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:51.578277 13234 raft_consensus.cc:2955] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.602330 13319 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:51.615664 12695 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:51.615664 12696 consensus_queue.cc:237] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:51.634274 12617 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:51.637241 12546 raft_consensus.cc:2955] T 0f7c3aec6a56450cb76aab45d874eff7 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.637223 13319 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:02:51.665900 13234 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:51.667004 13233 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:51.671991 12546 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:51.675079 13156 raft_consensus.cc:2955] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.677443 13277 raft_consensus.cc:2955] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.679653 12617 raft_consensus.cc:2955] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.701962 12442 catalog_manager.cc:5697] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.718969 12622 raft_consensus.cc:2955] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.728085 13277 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:51.732656 13234 raft_consensus.cc:2955] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.736284 12531 tablet_service.cc:1558] Processing DeleteTablet for tablet 0f7c3aec6a56450cb76aab45d874eff7 with delete_type TABLET_DATA_TOMBSTONED (TS a70479a3b4114f3581095e9890f5d653 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42444
I20260709 13:02:51.739190 12444 catalog_manager.cc:5697] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:51.747864 12431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0f7c3aec6a56450cb76aab45d874eff7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:51.747514 12546 raft_consensus.cc:2955] T dda7dbc055d64c86aedec4299e15f997 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.754266 12876 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:51.755404 13277 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:51.761458 13337 tablet_replica.cc:333] T 0f7c3aec6a56450cb76aab45d874eff7 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:02:51.766863 13233 raft_consensus.cc:2955] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.790258 13322 raft_consensus.cc:2955] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.792025 13337 raft_consensus.cc:2243] T 0f7c3aec6a56450cb76aab45d874eff7 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:51.794724 13337 raft_consensus.cc:2272] T 0f7c3aec6a56450cb76aab45d874eff7 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:51.800403 12546 raft_consensus.cc:2955] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.804661 13337 ts_tablet_manager.cc:1916] T 0f7c3aec6a56450cb76aab45d874eff7 P a70479a3b4114f3581095e9890f5d653: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:51.805953 13233 raft_consensus.cc:2955] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.815492 12695 consensus_queue.cc:237] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:51.831115 12445 catalog_manager.cc:5697] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.839201 12431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5589ff6a0b984c84a050ecad03db5a87 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:51.849063 12617 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:51.850922 13322 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:51.860845 13335 raft_consensus.cc:2955] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.863773 12622 raft_consensus.cc:2955] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.867136 12604 tablet_service.cc:1558] Processing DeleteTablet for tablet 5589ff6a0b984c84a050ecad03db5a87 with delete_type TABLET_DATA_TOMBSTONED (TS a11816c5d72e4d1295a242f3ced09e5f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41074
I20260709 13:02:51.856642 13233 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:51.888121 13337 ts_tablet_manager.cc:1929] T 0f7c3aec6a56450cb76aab45d874eff7 P a70479a3b4114f3581095e9890f5d653: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:51.891737 12876 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:51.897887 13337 log.cc:1199] T 0f7c3aec6a56450cb76aab45d874eff7 P a70479a3b4114f3581095e9890f5d653: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-0-root/wals/0f7c3aec6a56450cb76aab45d874eff7
I20260709 13:02:51.902130 12432 catalog_manager.cc:5028] TS a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): tablet 0f7c3aec6a56450cb76aab45d874eff7 (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:02:51.916007 13338 tablet_replica.cc:333] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:02:51.917244 13338 raft_consensus.cc:2243] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:51.919440 12443 catalog_manager.cc:5697] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:51.978042 13233 raft_consensus.cc:2955] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:51.980439 13338 raft_consensus.cc:2272] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:51.983667 12531 tablet_service.cc:1558] Processing DeleteTablet for tablet dda7dbc055d64c86aedec4299e15f997 with delete_type TABLET_DATA_TOMBSTONED (TS a70479a3b4114f3581095e9890f5d653 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42444
I20260709 13:02:51.984670 13337 tablet_replica.cc:333] T dda7dbc055d64c86aedec4299e15f997 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:02:51.985823 13337 raft_consensus.cc:2243] T dda7dbc055d64c86aedec4299e15f997 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:51.986457 13337 raft_consensus.cc:2272] T dda7dbc055d64c86aedec4299e15f997 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:51.987326 13338 ts_tablet_manager.cc:1916] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:51.989892 13337 ts_tablet_manager.cc:1916] T dda7dbc055d64c86aedec4299e15f997 P a70479a3b4114f3581095e9890f5d653: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:51.998226 12431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dda7dbc055d64c86aedec4299e15f997 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:52.008083 13338 ts_tablet_manager.cc:1929] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:52.009099 13338 log.cc:1199] T 5589ff6a0b984c84a050ecad03db5a87 P a11816c5d72e4d1295a242f3ced09e5f: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-1-root/wals/5589ff6a0b984c84a050ecad03db5a87
I20260709 13:02:52.010794 12429 catalog_manager.cc:5028] TS a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): tablet 5589ff6a0b984c84a050ecad03db5a87 (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:02:52.016088 13337 ts_tablet_manager.cc:1929] T dda7dbc055d64c86aedec4299e15f997 P a70479a3b4114f3581095e9890f5d653: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:52.016682 13337 log.cc:1199] T dda7dbc055d64c86aedec4299e15f997 P a70479a3b4114f3581095e9890f5d653: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-0-root/wals/dda7dbc055d64c86aedec4299e15f997
I20260709 13:02:52.018412 12432 catalog_manager.cc:5028] TS a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): tablet dda7dbc055d64c86aedec4299e15f997 (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:02:53.084472 12695 consensus_queue.cc:237] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:53.093843 12617 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:53.094666 12539 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:53.095965 13343 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:02:53.097632 12662 consensus_peers.cc:597] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee851126f3964a84a26d5d9a400ec3a8. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:53.097851 13344 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:53.120185 13335 raft_consensus.cc:2955] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:53.125905 12622 raft_consensus.cc:2955] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:53.134480 12546 raft_consensus.cc:2955] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:53.147897 12444 catalog_manager.cc:5697] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:53.159545 12539 consensus_queue.cc:237] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
W20260709 13:02:53.193168 12513 consensus_peers.cc:597] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 60708e41894c42b697291e905bff5dc6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:53.195581 12696 raft_consensus.cc:1275] T 60708e41894c42b697291e905bff5dc6 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:53.205474 13310 consensus_queue.cc:1048] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:53.227027 12622 raft_consensus.cc:1275] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:53.227947 12696 raft_consensus.cc:2955] T 60708e41894c42b697291e905bff5dc6 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:53.226567 13351 raft_consensus.cc:2955] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:53.230988 13308 consensus_queue.cc:1048] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:53.268497 12695 consensus_queue.cc:237] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:53.269263 12622 raft_consensus.cc:2955] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
W20260709 13:02:53.302018 12662 consensus_peers.cc:597] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 789704b18a5945318724c3ba1ca5b6e5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:53.305649 12539 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:53.317263 13345 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:53.313272 12445 catalog_manager.cc:5697] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:53.327893 12622 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:53.329332 13345 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:53.371646 13156 raft_consensus.cc:2955] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:53.378243 12539 raft_consensus.cc:2955] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:53.392002 12622 raft_consensus.cc:2955] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:53.444691 12443 catalog_manager.cc:5697] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:53.495090 12622 consensus_queue.cc:237] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:53.519225 12695 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:53.521788 13341 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:53.528214 12538 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:53.534725 13341 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:53.548381 13363 raft_consensus.cc:2955] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:53.550908 12539 raft_consensus.cc:2955] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:53.564385 12695 raft_consensus.cc:2955] T 5161235af1b440278d598161e1de2453 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:53.584918 13369 ts_tablet_manager.cc:933] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:53.582901 12443 catalog_manager.cc:5697] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:53.596664 13369 tablet_copy_client.cc:323] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.195:34641
I20260709 13:02:53.599740 12706 tablet_copy_service.cc:140] P 7ad68e814a7741488971822f2598183a: Received BeginTabletCopySession request for tablet ee851126f3964a84a26d5d9a400ec3a8 from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:46988)
I20260709 13:02:53.600466 12706 tablet_copy_service.cc:161] P 7ad68e814a7741488971822f2598183a: Beginning new tablet copy session on tablet ee851126f3964a84a26d5d9a400ec3a8 from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:46988: session id = 66750b8bbd4c4b3a9695951d0ede3372-ee851126f3964a84a26d5d9a400ec3a8
W20260709 13:02:53.607131 12588 consensus_peers.cc:597] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5161235af1b440278d598161e1de2453. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:53.622720 12706 tablet_copy_source_session.cc:215] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:53.629984 13369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee851126f3964a84a26d5d9a400ec3a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.655980 13371 ts_tablet_manager.cc:933] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307)
I20260709 13:02:53.661834 13371 tablet_copy_client.cc:323] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.193:43307
I20260709 13:02:53.664176 12557 tablet_copy_service.cc:140] P a70479a3b4114f3581095e9890f5d653: Received BeginTabletCopySession request for tablet 60708e41894c42b697291e905bff5dc6 from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:35624)
I20260709 13:02:53.664844 12557 tablet_copy_service.cc:161] P a70479a3b4114f3581095e9890f5d653: Beginning new tablet copy session on tablet 60708e41894c42b697291e905bff5dc6 from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:35624: session id = 66750b8bbd4c4b3a9695951d0ede3372-60708e41894c42b697291e905bff5dc6
I20260709 13:02:53.673677 12557 tablet_copy_source_session.cc:215] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:53.679092 13371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60708e41894c42b697291e905bff5dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.694145 13369 tablet_copy_client.cc:806] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:53.694932 13369 tablet_copy_client.cc:670] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:53.701882 13371 tablet_copy_client.cc:806] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:53.702500 13371 tablet_copy_client.cc:670] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:53.710055 13371 tablet_copy_client.cc:538] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:53.702827 13369 tablet_copy_client.cc:538] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:53.721735 13371 tablet_bootstrap.cc:492] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:02:53.723021 13369 tablet_bootstrap.cc:492] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:02:53.788161 13369 tablet_bootstrap.cc:492] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:53.789290 13369 tablet_bootstrap.cc:492] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:02:53.791231 13371 tablet_bootstrap.cc:492] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:53.794744 13371 tablet_bootstrap.cc:492] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:02:53.795538 13371 ts_tablet_manager.cc:1403] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.074s	user 0.020s	sys 0.016s
I20260709 13:02:53.793162 13375 ts_tablet_manager.cc:933] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:53.796294 13369 ts_tablet_manager.cc:1403] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.073s	user 0.015s	sys 0.018s
I20260709 13:02:53.800172 13371 raft_consensus.cc:359] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:53.802835 13369 raft_consensus.cc:359] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:53.803860 13369 raft_consensus.cc:740] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:02:53.803565 13371 raft_consensus.cc:740] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:02:53.805032 13369 consensus_queue.cc:260] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:53.807636 13375 tablet_copy_client.cc:323] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.195:34641
I20260709 13:02:53.810513 12706 tablet_copy_service.cc:140] P 7ad68e814a7741488971822f2598183a: Received BeginTabletCopySession request for tablet 789704b18a5945318724c3ba1ca5b6e5 from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:46988)
I20260709 13:02:53.811056 12706 tablet_copy_service.cc:161] P 7ad68e814a7741488971822f2598183a: Beginning new tablet copy session on tablet 789704b18a5945318724c3ba1ca5b6e5 from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:46988: session id = 66750b8bbd4c4b3a9695951d0ede3372-789704b18a5945318724c3ba1ca5b6e5
I20260709 13:02:53.812788 13369 ts_tablet_manager.cc:1434] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 13:02:53.818044 12705 tablet_copy_service.cc:342] P 7ad68e814a7741488971822f2598183a: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-ee851126f3964a84a26d5d9a400ec3a8 received from {username='slave'} at 127.0.0.1:46988
I20260709 13:02:53.818634 12705 tablet_copy_service.cc:434] P 7ad68e814a7741488971822f2598183a: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-ee851126f3964a84a26d5d9a400ec3a8 on tablet ee851126f3964a84a26d5d9a400ec3a8 with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:02:53.829185 12706 tablet_copy_source_session.cc:215] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:53.832832 13375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 789704b18a5945318724c3ba1ca5b6e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:53.806455 13371 consensus_queue.cc:260] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:53.846143 13371 ts_tablet_manager.cc:1434] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260709 13:02:53.860230 12557 tablet_copy_service.cc:342] P a70479a3b4114f3581095e9890f5d653: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-60708e41894c42b697291e905bff5dc6 received from {username='slave'} at 127.0.0.1:35624
I20260709 13:02:53.860750 12557 tablet_copy_service.cc:434] P a70479a3b4114f3581095e9890f5d653: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-60708e41894c42b697291e905bff5dc6 on tablet 60708e41894c42b697291e905bff5dc6 with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:02:53.873020 13375 tablet_copy_client.cc:806] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:53.886307 13375 tablet_copy_client.cc:670] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:53.890291 13375 tablet_copy_client.cc:538] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:53.898898 13375 tablet_bootstrap.cc:492] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:02:53.935305 13375 tablet_bootstrap.cc:492] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:53.936244 13375 tablet_bootstrap.cc:492] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:02:53.937095 13375 ts_tablet_manager.cc:1403] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.021s
I20260709 13:02:53.940464 13375 raft_consensus.cc:359] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:53.941309 13375 raft_consensus.cc:740] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:02:53.942108 13375 consensus_queue.cc:260] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:53.944505 13375 ts_tablet_manager.cc:1434] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:02:53.946920 12706 tablet_copy_service.cc:342] P 7ad68e814a7741488971822f2598183a: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-789704b18a5945318724c3ba1ca5b6e5 received from {username='slave'} at 127.0.0.1:46988
I20260709 13:02:53.947355 12706 tablet_copy_service.cc:434] P 7ad68e814a7741488971822f2598183a: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-789704b18a5945318724c3ba1ca5b6e5 on tablet 789704b18a5945318724c3ba1ca5b6e5 with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:02:54.410418 13233 raft_consensus.cc:1217] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:54.531754 13234 raft_consensus.cc:1217] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:54.686486 13398 ts_tablet_manager.cc:933] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:02:54.698001 13398 tablet_copy_client.cc:323] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.194:41653
I20260709 13:02:54.750178 13388 raft_consensus.cc:1064] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:02:54.750319 12632 tablet_copy_service.cc:140] P a11816c5d72e4d1295a242f3ced09e5f: Received BeginTabletCopySession request for tablet 5161235af1b440278d598161e1de2453 from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:60170)
I20260709 13:02:54.750972 12632 tablet_copy_service.cc:161] P a11816c5d72e4d1295a242f3ced09e5f: Beginning new tablet copy session on tablet 5161235af1b440278d598161e1de2453 from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:60170: session id = 66750b8bbd4c4b3a9695951d0ede3372-5161235af1b440278d598161e1de2453
I20260709 13:02:54.752612 13388 consensus_queue.cc:237] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:54.758967 12632 tablet_copy_source_session.cc:215] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:54.765038 13398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5161235af1b440278d598161e1de2453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:54.765501 12620 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:54.767143 13388 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:54.770792 13234 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:54.793809 13234 raft_consensus.cc:1217] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:54.803834 13388 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:54.804414 13398 tablet_copy_client.cc:806] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:54.809491 12547 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:54.805008 13398 tablet_copy_client.cc:670] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:54.876031 13398 tablet_copy_client.cc:538] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:54.885892 13398 tablet_bootstrap.cc:492] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
W20260709 13:02:54.887684 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:02:54.891407 13405 log.cc:927] Time spent T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.076s	user 0.007s	sys 0.011s
I20260709 13:02:54.894471 13388 raft_consensus.cc:2955] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:54.910655 12618 raft_consensus.cc:2955] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:54.916741 13398 tablet_bootstrap.cc:492] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:54.920922 13398 tablet_bootstrap.cc:492] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:02:54.921717 13398 ts_tablet_manager.cc:1403] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.036s	user 0.024s	sys 0.004s
I20260709 13:02:54.925230 13398 raft_consensus.cc:359] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:54.926198 13398 raft_consensus.cc:740] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:02:54.926926 13398 consensus_queue.cc:260] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:54.944154 13344 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:54.946605 13235 raft_consensus.cc:2955] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:54.956748 13398 ts_tablet_manager.cc:1434] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 13:02:54.958125 13234 raft_consensus.cc:1217] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:54.956537 12445 catalog_manager.cc:5697] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:54.960508 12632 tablet_copy_service.cc:342] P a11816c5d72e4d1295a242f3ced09e5f: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-5161235af1b440278d598161e1de2453 received from {username='slave'} at 127.0.0.1:60170
I20260709 13:02:54.967288 12632 tablet_copy_service.cc:434] P a11816c5d72e4d1295a242f3ced09e5f: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-5161235af1b440278d598161e1de2453 on tablet 5161235af1b440278d598161e1de2453 with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:02:54.979115 12545 raft_consensus.cc:2955] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:02:55.062966 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 84984.5us
I20260709 13:02:55.113870 13335 raft_consensus.cc:1064] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:02:55.141896 13335 consensus_queue.cc:237] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:55.171258 13234 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:55.173584 13343 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:55.176903 12615 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:55.178355 13335 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:55.194198 12540 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:55.196069 13343 raft_consensus.cc:2955] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.197413 13388 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:55.200273 12615 raft_consensus.cc:2955] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.210479 12547 raft_consensus.cc:2955] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.216323 13235 raft_consensus.cc:2955] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.229852 12442 catalog_manager.cc:5697] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.260025 13403 raft_consensus.cc:1064] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:02:55.261936 13403 consensus_queue.cc:237] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:55.268438 12688 raft_consensus.cc:1275] T 60708e41894c42b697291e905bff5dc6 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:55.269101 12615 raft_consensus.cc:1275] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:55.268975 13235 raft_consensus.cc:1275] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:55.269837 13395 consensus_queue.cc:1048] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:55.271029 13310 consensus_queue.cc:1048] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:55.274917 13310 consensus_queue.cc:1048] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:55.291098 13403 raft_consensus.cc:2955] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.294313 13235 raft_consensus.cc:2955] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.295055 12615 raft_consensus.cc:2955] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.307276 12688 raft_consensus.cc:2955] T 60708e41894c42b697291e905bff5dc6 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.312582 12444 catalog_manager.cc:5697] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.338932 12547 consensus_queue.cc:237] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:55.343770 13235 raft_consensus.cc:1275] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:55.344983 13310 consensus_queue.cc:1048] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:55.346547 12615 raft_consensus.cc:1275] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:55.348279 13310 consensus_queue.cc:1048] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:55.352720 13394 raft_consensus.cc:2955] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.354331 13235 raft_consensus.cc:2955] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.361176 12432 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 60708e41894c42b697291e905bff5dc6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:55.364064 12615 raft_consensus.cc:2955] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.372458 12442 catalog_manager.cc:5697] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.384865 12682 tablet_service.cc:1558] Processing DeleteTablet for tablet 60708e41894c42b697291e905bff5dc6 with delete_type TABLET_DATA_TOMBSTONED (TS 7ad68e814a7741488971822f2598183a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37280
I20260709 13:02:55.389245 13421 tablet_replica.cc:333] T 60708e41894c42b697291e905bff5dc6 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:02:55.390532 13421 raft_consensus.cc:2243] T 60708e41894c42b697291e905bff5dc6 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:55.391381 13421 raft_consensus.cc:2272] T 60708e41894c42b697291e905bff5dc6 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:55.395571 13421 ts_tablet_manager.cc:1916] T 60708e41894c42b697291e905bff5dc6 P 7ad68e814a7741488971822f2598183a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:55.412273 13421 ts_tablet_manager.cc:1929] T 60708e41894c42b697291e905bff5dc6 P 7ad68e814a7741488971822f2598183a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:55.412782 13421 log.cc:1199] T 60708e41894c42b697291e905bff5dc6 P 7ad68e814a7741488971822f2598183a: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-2-root/wals/60708e41894c42b697291e905bff5dc6
I20260709 13:02:55.415766 12431 catalog_manager.cc:5028] TS 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): tablet 60708e41894c42b697291e905bff5dc6 (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:02:55.478039 13393 raft_consensus.cc:1064] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:02:55.480609 13393 consensus_queue.cc:237] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:55.488129 12688 consensus_queue.cc:237] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:55.494428 13235 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:55.496438 13335 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:55.498070 12547 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:55.500344 13335 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:55.532774 13343 raft_consensus.cc:2955] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.536410 12547 raft_consensus.cc:2955] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.538028 13235 raft_consensus.cc:2955] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.547101 13234 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:55.548676 12688 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:55.549300 13392 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:55.556010 13391 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:55.560683 12431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ee851126f3964a84a26d5d9a400ec3a8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:02:55.571434 12643 debug-util.cc:398] Leaking SignalData structure 0x7b080023d920 after lost signal to thread 11446
W20260709 13:02:55.605242 12643 debug-util.cc:398] Leaking SignalData structure 0x7b080023d220 after lost signal to thread 12479
W20260709 13:02:55.606510 12643 debug-util.cc:398] Leaking SignalData structure 0x7b0800133800 after lost signal to thread 12571
W20260709 13:02:55.608281 12643 debug-util.cc:398] Leaking SignalData structure 0x7b08002efe00 after lost signal to thread 12720
I20260709 13:02:55.610399 12540 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:02:55.620445 12643 debug-util.cc:398] Leaking SignalData structure 0x7b0800306720 after lost signal to thread 13259
I20260709 13:02:55.623167 12444 catalog_manager.cc:5697] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.650344 12604 tablet_service.cc:1558] Processing DeleteTablet for tablet ee851126f3964a84a26d5d9a400ec3a8 with delete_type TABLET_DATA_TOMBSTONED (TS a11816c5d72e4d1295a242f3ced09e5f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41074
I20260709 13:02:55.650229 13390 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:02:55.665596 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 104388us
I20260709 13:02:55.675089 13426 tablet_replica.cc:333] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:02:55.675406 13393 raft_consensus.cc:2955] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.677388 13426 raft_consensus.cc:2243] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:55.678282 13426 raft_consensus.cc:2272] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:55.698119 13426 ts_tablet_manager.cc:1916] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:55.697139 13235 raft_consensus.cc:2955] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.701196 12688 raft_consensus.cc:2955] T 5161235af1b440278d598161e1de2453 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.708076 12444 catalog_manager.cc:5697] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.730235 13426 ts_tablet_manager.cc:1929] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:55.730901 13426 log.cc:1199] T ee851126f3964a84a26d5d9a400ec3a8 P a11816c5d72e4d1295a242f3ced09e5f: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-1-root/wals/ee851126f3964a84a26d5d9a400ec3a8
I20260709 13:02:55.732579 12429 catalog_manager.cc:5028] TS a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): tablet ee851126f3964a84a26d5d9a400ec3a8 (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:02:55.793758 12620 consensus_queue.cc:237] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:55.812492 12545 raft_consensus.cc:2955] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.835301 13235 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:55.837131 13391 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:55.844484 12540 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:55.849013 13393 raft_consensus.cc:2955] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.851831 12689 consensus_queue.cc:237] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:55.855432 13390 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:55.862908 13234 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:55.865006 13379 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:55.869663 12429 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5161235af1b440278d598161e1de2453 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:55.872337 12545 raft_consensus.cc:2955] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.875309 13343 raft_consensus.cc:2955] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.887208 13235 raft_consensus.cc:2955] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.890558 13234 raft_consensus.cc:2955] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.896166 12540 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:55.894447 12442 catalog_manager.cc:5697] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.897886 13383 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:02:55.912634 12540 raft_consensus.cc:2955] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:55.917079 12431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 789704b18a5945318724c3ba1ca5b6e5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:55.932475 12445 catalog_manager.cc:5697] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.933223 12682 tablet_service.cc:1558] Processing DeleteTablet for tablet 5161235af1b440278d598161e1de2453 with delete_type TABLET_DATA_TOMBSTONED (TS 7ad68e814a7741488971822f2598183a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37280
I20260709 13:02:55.957355 12604 tablet_service.cc:1558] Processing DeleteTablet for tablet 789704b18a5945318724c3ba1ca5b6e5 with delete_type TABLET_DATA_TOMBSTONED (TS a11816c5d72e4d1295a242f3ced09e5f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41074
I20260709 13:02:55.958379 13426 tablet_replica.cc:333] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:02:55.959558 13426 raft_consensus.cc:2243] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:55.960359 13426 raft_consensus.cc:2272] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:55.969230 13426 ts_tablet_manager.cc:1916] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:55.972944 13430 tablet_replica.cc:333] T 5161235af1b440278d598161e1de2453 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:02:55.974071 13430 raft_consensus.cc:2243] T 5161235af1b440278d598161e1de2453 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:55.974886 13430 raft_consensus.cc:2272] T 5161235af1b440278d598161e1de2453 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:55.983600 13430 ts_tablet_manager.cc:1916] T 5161235af1b440278d598161e1de2453 P 7ad68e814a7741488971822f2598183a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:55.991753 13426 ts_tablet_manager.cc:1929] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:55.992268 13426 log.cc:1199] T 789704b18a5945318724c3ba1ca5b6e5 P a11816c5d72e4d1295a242f3ced09e5f: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-1-root/wals/789704b18a5945318724c3ba1ca5b6e5
I20260709 13:02:55.993803 12429 catalog_manager.cc:5028] TS a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): tablet 789704b18a5945318724c3ba1ca5b6e5 (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:02:56.003259 13430 ts_tablet_manager.cc:1929] T 5161235af1b440278d598161e1de2453 P 7ad68e814a7741488971822f2598183a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:56.003674 13430 log.cc:1199] T 5161235af1b440278d598161e1de2453 P 7ad68e814a7741488971822f2598183a: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-2-root/wals/5161235af1b440278d598161e1de2453
I20260709 13:02:56.005666 12431 catalog_manager.cc:5028] TS 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): tablet 5161235af1b440278d598161e1de2453 (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:02:57.035898 12689 consensus_queue.cc:237] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:57.041980 12615 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:02:57.042526 12662 consensus_peers.cc:597] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: df093254fdff40f38b8370a4e884cc5d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:57.043187 13335 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:57.043471 12540 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:57.044646 13379 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:57.054241 13383 raft_consensus.cc:2955] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:57.056002 12544 raft_consensus.cc:2955] T df093254fdff40f38b8370a4e884cc5d P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:57.057178 12615 raft_consensus.cc:2955] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:57.074620 12692 consensus_queue.cc:237] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:57.093134 12445 catalog_manager.cc:5697] T df093254fdff40f38b8370a4e884cc5d P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
W20260709 13:02:57.099875 12662 consensus_peers.cc:597] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d24f57e3f5524b1c8e167aff853a0218. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:57.102602 12615 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:57.103729 12545 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:57.104206 13383 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:57.106068 13379 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:57.117789 13379 raft_consensus.cc:2955] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:57.120330 12615 raft_consensus.cc:2955] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:57.130565 12545 raft_consensus.cc:2955] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:57.140810 12692 consensus_queue.cc:237] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:57.142382 12443 catalog_manager.cc:5697] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:57.156797 12662 consensus_peers.cc:597] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 02ea9ad298ab4fa08087d24740b5a13b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:57.157817 12620 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:57.159106 13383 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:57.170432 12545 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:57.171801 13383 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:57.174672 13335 raft_consensus.cc:2955] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:57.180540 12620 raft_consensus.cc:2955] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:57.183600 12544 raft_consensus.cc:2955] T 02ea9ad298ab4fa08087d24740b5a13b P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:57.190778 12545 consensus_queue.cc:237] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
W20260709 13:02:57.207876 12513 consensus_peers.cc:597] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d88c15b898154821b2931e6b0f47833e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:57.206398 12445 catalog_manager.cc:5697] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:57.208160 12620 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:57.212769 13310 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:57.224327 12689 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:02:57.226384 13402 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:57.237213 13310 raft_consensus.cc:2955] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:57.238385 12620 raft_consensus.cc:2955] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:57.255733 12443 catalog_manager.cc:5697] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:57.257750 12689 raft_consensus.cc:2955] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:02:57.476821 13450 ts_tablet_manager.cc:933] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:57.478817 13450 tablet_copy_client.cc:323] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.195:34641
I20260709 13:02:57.480494 12706 tablet_copy_service.cc:140] P 7ad68e814a7741488971822f2598183a: Received BeginTabletCopySession request for tablet df093254fdff40f38b8370a4e884cc5d from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:46988)
I20260709 13:02:57.481051 12706 tablet_copy_service.cc:161] P 7ad68e814a7741488971822f2598183a: Beginning new tablet copy session on tablet df093254fdff40f38b8370a4e884cc5d from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:46988: session id = 66750b8bbd4c4b3a9695951d0ede3372-df093254fdff40f38b8370a4e884cc5d
I20260709 13:02:57.488955 12706 tablet_copy_source_session.cc:215] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:57.491952 13450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df093254fdff40f38b8370a4e884cc5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.508561 13450 tablet_copy_client.cc:806] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:57.509202 13450 tablet_copy_client.cc:670] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:57.512689 13450 tablet_copy_client.cc:538] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:57.521765 13450 tablet_bootstrap.cc:492] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:02:57.549928 13453 ts_tablet_manager.cc:933] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:57.552335 13453 tablet_copy_client.cc:323] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.195:34641
I20260709 13:02:57.554263 12706 tablet_copy_service.cc:140] P 7ad68e814a7741488971822f2598183a: Received BeginTabletCopySession request for tablet d24f57e3f5524b1c8e167aff853a0218 from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:46988)
I20260709 13:02:57.554777 12706 tablet_copy_service.cc:161] P 7ad68e814a7741488971822f2598183a: Beginning new tablet copy session on tablet d24f57e3f5524b1c8e167aff853a0218 from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:46988: session id = 66750b8bbd4c4b3a9695951d0ede3372-d24f57e3f5524b1c8e167aff853a0218
I20260709 13:02:57.561455 12706 tablet_copy_source_session.cc:215] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:57.568794 13453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d24f57e3f5524b1c8e167aff853a0218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.573426 13450 tablet_bootstrap.cc:492] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:57.574827 13450 tablet_bootstrap.cc:492] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:02:57.575610 13450 ts_tablet_manager.cc:1403] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.054s	user 0.030s	sys 0.024s
I20260709 13:02:57.578713 13450 raft_consensus.cc:359] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:57.579535 13450 raft_consensus.cc:740] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:02:57.580155 13450 consensus_queue.cc:260] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:57.583913 13453 tablet_copy_client.cc:806] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:57.584419 13453 tablet_copy_client.cc:670] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:57.584856 13450 ts_tablet_manager.cc:1434] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:02:57.592593 12706 tablet_copy_service.cc:342] P 7ad68e814a7741488971822f2598183a: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-df093254fdff40f38b8370a4e884cc5d received from {username='slave'} at 127.0.0.1:46988
I20260709 13:02:57.593015 12706 tablet_copy_service.cc:434] P 7ad68e814a7741488971822f2598183a: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-df093254fdff40f38b8370a4e884cc5d on tablet df093254fdff40f38b8370a4e884cc5d with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:02:57.594959 13453 tablet_copy_client.cc:538] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:57.605315 13453 tablet_bootstrap.cc:492] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:02:57.630400 13453 tablet_bootstrap.cc:492] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:57.631217 13453 tablet_bootstrap.cc:492] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:02:57.631804 13453 ts_tablet_manager.cc:1403] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.007s
I20260709 13:02:57.634699 13453 raft_consensus.cc:359] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:57.635527 13453 raft_consensus.cc:740] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:02:57.636296 13453 consensus_queue.cc:260] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:57.641417 13453 ts_tablet_manager.cc:1434] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:02:57.644436 12706 tablet_copy_service.cc:342] P 7ad68e814a7741488971822f2598183a: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-d24f57e3f5524b1c8e167aff853a0218 received from {username='slave'} at 127.0.0.1:46988
I20260709 13:02:57.644902 12706 tablet_copy_service.cc:434] P 7ad68e814a7741488971822f2598183a: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-d24f57e3f5524b1c8e167aff853a0218 on tablet d24f57e3f5524b1c8e167aff853a0218 with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:02:57.701855 13453 ts_tablet_manager.cc:933] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:02:57.703492 13453 tablet_copy_client.cc:323] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.195:34641
I20260709 13:02:57.705292 12706 tablet_copy_service.cc:140] P 7ad68e814a7741488971822f2598183a: Received BeginTabletCopySession request for tablet 02ea9ad298ab4fa08087d24740b5a13b from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:46988)
I20260709 13:02:57.705789 12706 tablet_copy_service.cc:161] P 7ad68e814a7741488971822f2598183a: Beginning new tablet copy session on tablet 02ea9ad298ab4fa08087d24740b5a13b from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:46988: session id = 66750b8bbd4c4b3a9695951d0ede3372-02ea9ad298ab4fa08087d24740b5a13b
I20260709 13:02:57.711683 12706 tablet_copy_source_session.cc:215] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:57.714572 13453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02ea9ad298ab4fa08087d24740b5a13b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.736284 13453 tablet_copy_client.cc:806] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:57.736815 13453 tablet_copy_client.cc:670] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:57.741336 13453 tablet_copy_client.cc:538] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:57.751005 13453 tablet_bootstrap.cc:492] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:02:57.777689 13453 tablet_bootstrap.cc:492] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:57.778609 13453 tablet_bootstrap.cc:492] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:02:57.779311 13453 ts_tablet_manager.cc:1403] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.029s	user 0.022s	sys 0.000s
I20260709 13:02:57.782248 13453 raft_consensus.cc:359] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:57.783125 13453 raft_consensus.cc:740] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:02:57.783764 13453 consensus_queue.cc:260] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:57.791493 13453 ts_tablet_manager.cc:1434] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:02:57.802306 13450 ts_tablet_manager.cc:933] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307)
I20260709 13:02:57.805063 13450 tablet_copy_client.cc:323] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.193:43307
I20260709 13:02:57.806535 12706 tablet_copy_service.cc:342] P 7ad68e814a7741488971822f2598183a: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-02ea9ad298ab4fa08087d24740b5a13b received from {username='slave'} at 127.0.0.1:46988
I20260709 13:02:57.807075 12706 tablet_copy_service.cc:434] P 7ad68e814a7741488971822f2598183a: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-02ea9ad298ab4fa08087d24740b5a13b on tablet 02ea9ad298ab4fa08087d24740b5a13b with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:02:57.808817 12557 tablet_copy_service.cc:140] P a70479a3b4114f3581095e9890f5d653: Received BeginTabletCopySession request for tablet d88c15b898154821b2931e6b0f47833e from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:35624)
I20260709 13:02:57.809433 12557 tablet_copy_service.cc:161] P a70479a3b4114f3581095e9890f5d653: Beginning new tablet copy session on tablet d88c15b898154821b2931e6b0f47833e from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:35624: session id = 66750b8bbd4c4b3a9695951d0ede3372-d88c15b898154821b2931e6b0f47833e
I20260709 13:02:57.831090 12557 tablet_copy_source_session.cc:215] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:02:57.834169 13450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d88c15b898154821b2931e6b0f47833e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:57.859627 13450 tablet_copy_client.cc:806] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:02:57.860265 13450 tablet_copy_client.cc:670] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:02:57.864463 13450 tablet_copy_client.cc:538] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:02:57.871861 13450 tablet_bootstrap.cc:492] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:02:57.890288 13450 tablet_bootstrap.cc:492] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:57.891196 13450 tablet_bootstrap.cc:492] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:02:57.892706 13450 ts_tablet_manager.cc:1403] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.008s
I20260709 13:02:57.897330 13450 raft_consensus.cc:359] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:57.898247 13450 raft_consensus.cc:740] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:02:57.898775 13450 consensus_queue.cc:260] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:02:57.900838 13450 ts_tablet_manager.cc:1434] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:02:57.903229 12557 tablet_copy_service.cc:342] P a70479a3b4114f3581095e9890f5d653: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-d88c15b898154821b2931e6b0f47833e received from {username='slave'} at 127.0.0.1:35624
I20260709 13:02:57.903654 12557 tablet_copy_service.cc:434] P a70479a3b4114f3581095e9890f5d653: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-d88c15b898154821b2931e6b0f47833e on tablet d88c15b898154821b2931e6b0f47833e with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:02:57.942355 13234 raft_consensus.cc:1217] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:57.944736 13234 raft_consensus.cc:1217] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:58.096149 13234 raft_consensus.cc:1217] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:58.265491 13235 raft_consensus.cc:1217] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:02:58.319381 13461 raft_consensus.cc:1064] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:02:58.322017 13461 consensus_queue.cc:237] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:58.328933 13235 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:58.328975 12620 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:58.330504 12540 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:58.331435 13461 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:58.332379 13460 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:58.333197 13383 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:58.350963 13461 raft_consensus.cc:2955] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.353158 13235 raft_consensus.cc:2955] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.358165 12547 raft_consensus.cc:2955] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.367959 12619 raft_consensus.cc:2955] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.370751 12442 catalog_manager.cc:5697] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:58.418377 12689 consensus_queue.cc:237] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:58.428345 13235 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:58.428541 12547 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:58.430342 13461 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:58.432209 13460 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:58.439370 13383 raft_consensus.cc:2955] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.441067 12547 raft_consensus.cc:2955] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.441414 13235 raft_consensus.cc:2955] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.448693 12431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d24f57e3f5524b1c8e167aff853a0218 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:58.458184 12445 catalog_manager.cc:5697] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:58.470623 12604 tablet_service.cc:1558] Processing DeleteTablet for tablet d24f57e3f5524b1c8e167aff853a0218 with delete_type TABLET_DATA_TOMBSTONED (TS a11816c5d72e4d1295a242f3ced09e5f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41074
I20260709 13:02:58.479158 13471 tablet_replica.cc:333] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:02:58.480195 13471 raft_consensus.cc:2243] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:58.480907 13471 raft_consensus.cc:2272] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:58.484645 13471 ts_tablet_manager.cc:1916] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:58.502285 13471 ts_tablet_manager.cc:1929] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:58.502755 13471 log.cc:1199] T d24f57e3f5524b1c8e167aff853a0218 P a11816c5d72e4d1295a242f3ced09e5f: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-1-root/wals/d24f57e3f5524b1c8e167aff853a0218
I20260709 13:02:58.505607 12429 catalog_manager.cc:5028] TS a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): tablet d24f57e3f5524b1c8e167aff853a0218 (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:02:58.546623 13383 raft_consensus.cc:1064] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:02:58.548244 13383 consensus_queue.cc:237] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:58.553853 13235 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:58.554423 12620 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:58.555321 12545 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:58.555454 13460 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:58.556383 13461 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:58.557523 13383 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:58.575141 13460 raft_consensus.cc:2955] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.577236 13235 raft_consensus.cc:2955] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.586112 12547 raft_consensus.cc:2955] T df093254fdff40f38b8370a4e884cc5d P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.588167 12620 raft_consensus.cc:2955] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.594998 12443 catalog_manager.cc:5697] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:58.617462 12689 consensus_queue.cc:237] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:58.623273 12620 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:58.623307 13235 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:58.624814 13379 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:58.625722 13460 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:58.634871 13447 raft_consensus.cc:2955] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.638932 12619 raft_consensus.cc:2955] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.639716 13235 raft_consensus.cc:2955] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.647763 12431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet df093254fdff40f38b8370a4e884cc5d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:58.654947 12444 catalog_manager.cc:5697] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.669310 13310 raft_consensus.cc:1064] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:02:58.671612 13310 consensus_queue.cc:237] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:58.674883 12531 tablet_service.cc:1558] Processing DeleteTablet for tablet df093254fdff40f38b8370a4e884cc5d with delete_type TABLET_DATA_TOMBSTONED (TS a70479a3b4114f3581095e9890f5d653 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42444
I20260709 13:02:58.676784 13477 tablet_replica.cc:333] T df093254fdff40f38b8370a4e884cc5d P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:02:58.679642 13477 raft_consensus.cc:2243] T df093254fdff40f38b8370a4e884cc5d P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:58.680464 13477 raft_consensus.cc:2272] T df093254fdff40f38b8370a4e884cc5d P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:58.688453 13477 ts_tablet_manager.cc:1916] T df093254fdff40f38b8370a4e884cc5d P a70479a3b4114f3581095e9890f5d653: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:58.705744 13235 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:58.707299 13431 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:58.717195 13477 ts_tablet_manager.cc:1929] T df093254fdff40f38b8370a4e884cc5d P a70479a3b4114f3581095e9890f5d653: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:58.717758 13477 log.cc:1199] T df093254fdff40f38b8370a4e884cc5d P a70479a3b4114f3581095e9890f5d653: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-0-root/wals/df093254fdff40f38b8370a4e884cc5d
I20260709 13:02:58.719156 12689 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:58.719405 12432 catalog_manager.cc:5028] TS a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): tablet df093254fdff40f38b8370a4e884cc5d (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:02:58.723133 13310 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:58.725350 13461 raft_consensus.cc:1064] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:02:58.727917 13461 consensus_queue.cc:237] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:58.733318 12619 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:58.748265 13310 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:58.764536 12619 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:58.765276 13235 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:58.766841 13460 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:58.774458 13383 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:58.780709 13478 raft_consensus.cc:2955] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.785794 12689 raft_consensus.cc:2955] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.792443 12620 raft_consensus.cc:2955] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.796680 12547 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:02:58.807936 13235 raft_consensus.cc:2955] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.811103 12444 catalog_manager.cc:5697] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.815577 13460 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
W20260709 13:02:58.845531 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 52215.3us
I20260709 13:02:58.855902 13460 raft_consensus.cc:2955] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.868860 12547 raft_consensus.cc:2955] T 02ea9ad298ab4fa08087d24740b5a13b P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.877944 12540 consensus_queue.cc:237] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:58.884994 13235 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:58.885007 12620 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:58.888229 12444 catalog_manager.cc:5697] T 02ea9ad298ab4fa08087d24740b5a13b P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.888353 13478 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:02:58.894217 13431 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:58.894330 12620 raft_consensus.cc:2955] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.903281 13478 raft_consensus.cc:2955] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.910213 13233 raft_consensus.cc:2955] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.917802 12432 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d88c15b898154821b2931e6b0f47833e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:58.918671 13235 raft_consensus.cc:2955] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.923739 12444 catalog_manager.cc:5697] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:02:58.953972 12682 tablet_service.cc:1558] Processing DeleteTablet for tablet d88c15b898154821b2931e6b0f47833e with delete_type TABLET_DATA_TOMBSTONED (TS 7ad68e814a7741488971822f2598183a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37280
I20260709 13:02:58.943661 12620 raft_consensus.cc:2955] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:58.971487 13488 tablet_replica.cc:333] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:02:58.983754 12689 consensus_queue.cc:237] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:02:58.990036 13488 raft_consensus.cc:2243] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:58.990849 13488 raft_consensus.cc:2272] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:58.994576 13488 ts_tablet_manager.cc:1916] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:59.001291 12620 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:59.001597 13233 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:02:59.003543 13379 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:59.005133 13379 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:59.008579 13488 ts_tablet_manager.cc:1929] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:59.009117 13488 log.cc:1199] T d88c15b898154821b2931e6b0f47833e P 7ad68e814a7741488971822f2598183a: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-2-root/wals/d88c15b898154821b2931e6b0f47833e
I20260709 13:02:59.011569 12431 catalog_manager.cc:5028] TS 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): tablet d88c15b898154821b2931e6b0f47833e (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:02:59.015111 13461 raft_consensus.cc:2955] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:59.016582 12620 raft_consensus.cc:2955] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:59.021086 13233 raft_consensus.cc:2955] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:59.026157 12431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 02ea9ad298ab4fa08087d24740b5a13b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:02:59.032955 12442 catalog_manager.cc:5697] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:02:59.050817 12531 tablet_service.cc:1558] Processing DeleteTablet for tablet 02ea9ad298ab4fa08087d24740b5a13b with delete_type TABLET_DATA_TOMBSTONED (TS a70479a3b4114f3581095e9890f5d653 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42444
I20260709 13:02:59.051793 13477 tablet_replica.cc:333] T 02ea9ad298ab4fa08087d24740b5a13b P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:02:59.052858 13477 raft_consensus.cc:2243] T 02ea9ad298ab4fa08087d24740b5a13b P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:59.053500 13477 raft_consensus.cc:2272] T 02ea9ad298ab4fa08087d24740b5a13b P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:59.059700 13477 ts_tablet_manager.cc:1916] T 02ea9ad298ab4fa08087d24740b5a13b P a70479a3b4114f3581095e9890f5d653: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:02:59.074527 13477 ts_tablet_manager.cc:1929] T 02ea9ad298ab4fa08087d24740b5a13b P a70479a3b4114f3581095e9890f5d653: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:02:59.075143 13477 log.cc:1199] T 02ea9ad298ab4fa08087d24740b5a13b P a70479a3b4114f3581095e9890f5d653: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-0-root/wals/02ea9ad298ab4fa08087d24740b5a13b
I20260709 13:02:59.076603 12432 catalog_manager.cc:5028] TS a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): tablet 02ea9ad298ab4fa08087d24740b5a13b (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:00.126739 12619 consensus_queue.cc:237] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:00.134680 12689 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:00.138131 13485 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:00.146554 12540 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:03:00.147627 12588 consensus_peers.cc:597] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e396b3164bf5409c9d6b0dd8dc22cd2d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:00.149643 13485 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:00.149339 13493 raft_consensus.cc:2955] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:00.151134 12688 raft_consensus.cc:2955] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:00.155341 12540 raft_consensus.cc:2955] T e396b3164bf5409c9d6b0dd8dc22cd2d P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:00.163209 12619 consensus_queue.cc:237] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:00.166520 12444 catalog_manager.cc:5697] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:00.182657 12688 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:03:00.183677 12588 consensus_peers.cc:597] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9dbe6a90f99a44fe85d2c7a8bcb7c9ad. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:00.185807 12540 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:00.185949 13493 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:00.188060 13494 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:00.198968 13493 raft_consensus.cc:2955] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:00.209592 12692 raft_consensus.cc:2955] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:00.214284 12547 raft_consensus.cc:2955] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:00.233909 12692 consensus_queue.cc:237] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:00.245491 12444 catalog_manager.cc:5697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
W20260709 13:03:00.252337 12662 consensus_peers.cc:597] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4432abbae9994c048d249abe3143fa09. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:00.253506 12620 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:00.254515 12547 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:00.255402 13460 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:00.256198 13461 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:00.275019 13383 raft_consensus.cc:2955] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:00.277726 12547 raft_consensus.cc:2955] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:00.278301 12619 raft_consensus.cc:2955] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:00.292968 12619 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:00.293897 12442 catalog_manager.cc:5697] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:00.301680 12547 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:00.301887 12692 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:03:00.303015 12588 consensus_peers.cc:597] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dd40576623a84072be59a32d23cda14b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:00.303371 13494 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:00.304978 13493 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:00.327312 13494 raft_consensus.cc:2955] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:00.329172 12692 raft_consensus.cc:2955] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:00.332998 12547 raft_consensus.cc:2955] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:00.343621 12442 catalog_manager.cc:5697] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:00.595194 13511 ts_tablet_manager.cc:933] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:00.597112 13511 tablet_copy_client.cc:323] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.194:41653
I20260709 13:03:00.598740 12632 tablet_copy_service.cc:140] P a11816c5d72e4d1295a242f3ced09e5f: Received BeginTabletCopySession request for tablet 9dbe6a90f99a44fe85d2c7a8bcb7c9ad from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:60170)
I20260709 13:03:00.599320 12632 tablet_copy_service.cc:161] P a11816c5d72e4d1295a242f3ced09e5f: Beginning new tablet copy session on tablet 9dbe6a90f99a44fe85d2c7a8bcb7c9ad from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:60170: session id = 66750b8bbd4c4b3a9695951d0ede3372-9dbe6a90f99a44fe85d2c7a8bcb7c9ad
I20260709 13:03:00.612214 12632 tablet_copy_source_session.cc:215] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:00.616096 13511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dbe6a90f99a44fe85d2c7a8bcb7c9ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:00.630985 13511 tablet_copy_client.cc:806] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:00.631852 13511 tablet_copy_client.cc:670] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:00.636720 13511 tablet_copy_client.cc:538] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:00.644582 13511 tablet_bootstrap.cc:492] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:00.661739 13513 ts_tablet_manager.cc:933] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:00.792263 13518 ts_tablet_manager.cc:933] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:00.800279 13518 tablet_copy_client.cc:323] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.195:34641
I20260709 13:03:00.823150 12706 tablet_copy_service.cc:140] P 7ad68e814a7741488971822f2598183a: Received BeginTabletCopySession request for tablet 4432abbae9994c048d249abe3143fa09 from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:46988)
I20260709 13:03:00.823935 12706 tablet_copy_service.cc:161] P 7ad68e814a7741488971822f2598183a: Beginning new tablet copy session on tablet 4432abbae9994c048d249abe3143fa09 from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:46988: session id = 66750b8bbd4c4b3a9695951d0ede3372-4432abbae9994c048d249abe3143fa09
I20260709 13:03:00.846269 12706 tablet_copy_source_session.cc:215] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:03:00.861811 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 45913us
I20260709 13:03:00.891155 13520 ts_tablet_manager.cc:933] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:00.908181 13518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4432abbae9994c048d249abe3143fa09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:00.908084 13520 tablet_copy_client.cc:323] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.194:41653
I20260709 13:03:00.909961 12632 tablet_copy_service.cc:140] P a11816c5d72e4d1295a242f3ced09e5f: Received BeginTabletCopySession request for tablet dd40576623a84072be59a32d23cda14b from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:60170)
I20260709 13:03:00.910524 12632 tablet_copy_service.cc:161] P a11816c5d72e4d1295a242f3ced09e5f: Beginning new tablet copy session on tablet dd40576623a84072be59a32d23cda14b from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:60170: session id = 66750b8bbd4c4b3a9695951d0ede3372-dd40576623a84072be59a32d23cda14b
I20260709 13:03:00.919186 13513 tablet_copy_client.cc:323] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.194:41653
I20260709 13:03:00.919711 12632 tablet_copy_source_session.cc:215] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:00.921833 12631 tablet_copy_service.cc:140] P a11816c5d72e4d1295a242f3ced09e5f: Received BeginTabletCopySession request for tablet e396b3164bf5409c9d6b0dd8dc22cd2d from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:60170)
I20260709 13:03:00.922384 12631 tablet_copy_service.cc:161] P a11816c5d72e4d1295a242f3ced09e5f: Beginning new tablet copy session on tablet e396b3164bf5409c9d6b0dd8dc22cd2d from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:60170: session id = 66750b8bbd4c4b3a9695951d0ede3372-e396b3164bf5409c9d6b0dd8dc22cd2d
I20260709 13:03:00.928685 13520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd40576623a84072be59a32d23cda14b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:00.937633 13518 tablet_copy_client.cc:806] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:00.938313 13518 tablet_copy_client.cc:670] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:00.940478 12631 tablet_copy_source_session.cc:215] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:03:00.940737 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 60107.6us
I20260709 13:03:00.948001 13511 tablet_bootstrap.cc:492] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:00.949028 13511 tablet_bootstrap.cc:492] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:00.949756 13511 ts_tablet_manager.cc:1403] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.306s	user 0.093s	sys 0.159s
I20260709 13:03:00.942262 13518 tablet_copy_client.cc:538] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:00.952718 13511 raft_consensus.cc:359] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:00.953289 13520 tablet_copy_client.cc:806] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:00.953642 13511 raft_consensus.cc:740] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:00.954102 13520 tablet_copy_client.cc:670] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:00.954509 13511 consensus_queue.cc:260] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:00.958178 13513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e396b3164bf5409c9d6b0dd8dc22cd2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:00.966815 13511 ts_tablet_manager.cc:1434] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:03:00.968556 12631 tablet_copy_service.cc:342] P a11816c5d72e4d1295a242f3ced09e5f: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-9dbe6a90f99a44fe85d2c7a8bcb7c9ad received from {username='slave'} at 127.0.0.1:60170
I20260709 13:03:00.968963 12631 tablet_copy_service.cc:434] P a11816c5d72e4d1295a242f3ced09e5f: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-9dbe6a90f99a44fe85d2c7a8bcb7c9ad on tablet 9dbe6a90f99a44fe85d2c7a8bcb7c9ad with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:00.971414 13520 tablet_copy_client.cc:538] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:00.979875 13513 tablet_copy_client.cc:806] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:00.980501 13513 tablet_copy_client.cc:670] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:00.992244 13518 tablet_bootstrap.cc:492] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:01.015158 13513 tablet_copy_client.cc:538] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:01.019207 13233 raft_consensus.cc:1217] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:01.037045 13513 tablet_bootstrap.cc:492] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:01.037133 13518 tablet_bootstrap.cc:492] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:01.038486 13518 tablet_bootstrap.cc:492] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:01.039340 13518 ts_tablet_manager.cc:1403] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.016s
I20260709 13:03:01.041504 13520 tablet_bootstrap.cc:492] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:01.042867 13518 raft_consensus.cc:359] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:01.044010 13518 raft_consensus.cc:740] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:01.044871 13518 consensus_queue.cc:260] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:01.050613 13518 ts_tablet_manager.cc:1434] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:03:01.052685 12706 tablet_copy_service.cc:342] P 7ad68e814a7741488971822f2598183a: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-4432abbae9994c048d249abe3143fa09 received from {username='slave'} at 127.0.0.1:46988
I20260709 13:03:01.053169 12706 tablet_copy_service.cc:434] P 7ad68e814a7741488971822f2598183a: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-4432abbae9994c048d249abe3143fa09 on tablet 4432abbae9994c048d249abe3143fa09 with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:01.079587 13513 tablet_bootstrap.cc:492] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:01.080943 13513 tablet_bootstrap.cc:492] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:01.088321 13513 ts_tablet_manager.cc:1403] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.053s	user 0.024s	sys 0.006s
I20260709 13:03:01.093963 13513 raft_consensus.cc:359] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:01.094841 13513 raft_consensus.cc:740] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:01.095441 13513 consensus_queue.cc:260] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:01.097757 13513 ts_tablet_manager.cc:1434] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:03:01.100392 12631 tablet_copy_service.cc:342] P a11816c5d72e4d1295a242f3ced09e5f: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-e396b3164bf5409c9d6b0dd8dc22cd2d received from {username='slave'} at 127.0.0.1:60170
I20260709 13:03:01.100811 12631 tablet_copy_service.cc:434] P a11816c5d72e4d1295a242f3ced09e5f: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-e396b3164bf5409c9d6b0dd8dc22cd2d on tablet e396b3164bf5409c9d6b0dd8dc22cd2d with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:01.119865 13520 tablet_bootstrap.cc:492] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:01.120882 13520 tablet_bootstrap.cc:492] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:01.121627 13520 ts_tablet_manager.cc:1403] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.080s	user 0.031s	sys 0.009s
I20260709 13:03:01.124969 13520 raft_consensus.cc:359] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:01.125866 13520 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:01.126482 13520 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:01.132325 13520 ts_tablet_manager.cc:1434] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 13:03:01.133872 12631 tablet_copy_service.cc:342] P a11816c5d72e4d1295a242f3ced09e5f: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-dd40576623a84072be59a32d23cda14b received from {username='slave'} at 127.0.0.1:60170
I20260709 13:03:01.134292 12631 tablet_copy_service.cc:434] P a11816c5d72e4d1295a242f3ced09e5f: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-dd40576623a84072be59a32d23cda14b on tablet dd40576623a84072be59a32d23cda14b with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:01.192499 13233 raft_consensus.cc:1217] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:01.212579 13233 raft_consensus.cc:1217] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:01.340210 13233 raft_consensus.cc:1217] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:01.538327 13494 raft_consensus.cc:1064] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:01.540838 13494 consensus_queue.cc:237] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:01.548533 12689 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:01.548733 12540 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:01.548825 13233 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:01.550239 13528 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:01.551260 13485 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:01.552690 13494 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:01.569406 13528 raft_consensus.cc:2955] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:01.576931 12689 raft_consensus.cc:2955] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:01.576880 13235 raft_consensus.cc:2955] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:01.585795 12547 raft_consensus.cc:2955] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:01.594741 12442 catalog_manager.cc:5697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:01.622095 13494 raft_consensus.cc:1064] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:01.624905 13494 consensus_queue.cc:237] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:01.646832 13233 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:01.649354 13494 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:03:01.649631 12540 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:01.663247 13528 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:01.648039 12689 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:01.666262 13494 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:01.678074 12615 consensus_queue.cc:237] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:01.700856 13517 raft_consensus.cc:1064] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:01.715773 13517 consensus_queue.cc:237] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:01.723084 13528 raft_consensus.cc:2955] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:01.726440 12540 raft_consensus.cc:2955] T e396b3164bf5409c9d6b0dd8dc22cd2d P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:01.730664 13233 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:01.732656 12544 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:01.749205 13485 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:01.751287 13494 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:01.760072 12689 raft_consensus.cc:2955] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:01.775599 13493 raft_consensus.cc:1064] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:01.781095 13493 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:01.803246 13494 raft_consensus.cc:2955] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:01.820986 12444 catalog_manager.cc:5697] T e396b3164bf5409c9d6b0dd8dc22cd2d P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:03:01.839540 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 43880.9us
I20260709 13:03:01.872342 13233 raft_consensus.cc:2955] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:01.898458 12443 catalog_manager.cc:5697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:01.899439 12429 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9dbe6a90f99a44fe85d2c7a8bcb7c9ad with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:03:01.900132 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 52012.3us
I20260709 13:03:01.928016 12682 tablet_service.cc:1558] Processing DeleteTablet for tablet 9dbe6a90f99a44fe85d2c7a8bcb7c9ad with delete_type TABLET_DATA_TOMBSTONED (TS 7ad68e814a7741488971822f2598183a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37280
I20260709 13:03:01.939524 12622 consensus_queue.cc:237] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:01.952214 13548 tablet_replica.cc:333] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:03:01.956496 12689 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:01.957464 13548 raft_consensus.cc:2243] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:01.958518 13547 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:01.961072 13548 raft_consensus.cc:2272] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:01.973088 13548 ts_tablet_manager.cc:1916] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:01.973623 13494 raft_consensus.cc:2955] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:03:01.978139 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 65416.5us
I20260709 13:03:01.979113 12689 raft_consensus.cc:2955] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:02.026058 12444 catalog_manager.cc:5697] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:02.033416 12689 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:02.037140 13493 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:02.045025 13233 raft_consensus.cc:2955] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:02.050829 13234 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:02.053776 12429 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e396b3164bf5409c9d6b0dd8dc22cd2d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:02.060434 13485 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:02.067198 13548 ts_tablet_manager.cc:1929] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:02.067744 13548 log.cc:1199] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 7ad68e814a7741488971822f2598183a: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-2-root/wals/9dbe6a90f99a44fe85d2c7a8bcb7c9ad
I20260709 13:03:02.069701 12431 catalog_manager.cc:5028] TS 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): tablet 9dbe6a90f99a44fe85d2c7a8bcb7c9ad (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:02.072786 13235 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:02.079663 13493 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:02.087661 12622 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:02.088721 13234 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:02.090476 13549 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:02.091022 13485 raft_consensus.cc:2955] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:02.092571 13549 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:02.094992 12531 tablet_service.cc:1558] Processing DeleteTablet for tablet e396b3164bf5409c9d6b0dd8dc22cd2d with delete_type TABLET_DATA_TOMBSTONED (TS a70479a3b4114f3581095e9890f5d653 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42444
I20260709 13:03:02.102897 13233 raft_consensus.cc:2955] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:02.109102 12544 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:02.107511 12538 raft_consensus.cc:2955] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:02.126791 12545 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:02.131935 13555 tablet_replica.cc:333] T e396b3164bf5409c9d6b0dd8dc22cd2d P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:03:02.133672 13234 raft_consensus.cc:2955] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:02.141367 13383 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:02.144474 13545 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:02.147994 12442 catalog_manager.cc:5697] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:02.133198 13555 raft_consensus.cc:2243] T e396b3164bf5409c9d6b0dd8dc22cd2d P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.164878 13555 raft_consensus.cc:2272] T e396b3164bf5409c9d6b0dd8dc22cd2d P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.185930 12692 raft_consensus.cc:2955] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:02.223029 13555 ts_tablet_manager.cc:1916] T e396b3164bf5409c9d6b0dd8dc22cd2d P a70479a3b4114f3581095e9890f5d653: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:02.227424 12619 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:02.227555 13549 raft_consensus.cc:2955] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:02.232165 12538 raft_consensus.cc:2955] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:02.239622 12622 raft_consensus.cc:2955] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:03:02.241232 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 44914.4us
I20260709 13:03:02.285521 13555 ts_tablet_manager.cc:1929] T e396b3164bf5409c9d6b0dd8dc22cd2d P a70479a3b4114f3581095e9890f5d653: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:02.291208 13555 log.cc:1199] T e396b3164bf5409c9d6b0dd8dc22cd2d P a70479a3b4114f3581095e9890f5d653: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-0-root/wals/e396b3164bf5409c9d6b0dd8dc22cd2d
I20260709 13:03:02.293606 12432 catalog_manager.cc:5028] TS a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): tablet e396b3164bf5409c9d6b0dd8dc22cd2d (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:02.308223 13234 raft_consensus.cc:2955] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:02.330439 12547 raft_consensus.cc:2955] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:02.350394 13233 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:02.354926 12444 catalog_manager.cc:5697] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:02.370328 12692 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:02.376730 13493 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:02.380838 13544 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:02.389643 13528 raft_consensus.cc:2955] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:02.391654 13233 raft_consensus.cc:2955] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:02.447659 12442 catalog_manager.cc:5697] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:02.457394 12692 consensus_queue.cc:237] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:02.459218 12531 tablet_service.cc:1558] Processing DeleteTablet for tablet dd40576623a84072be59a32d23cda14b with delete_type TABLET_DATA_TOMBSTONED (TS a70479a3b4114f3581095e9890f5d653 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42444
I20260709 13:03:02.467545 12688 raft_consensus.cc:2955] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:02.475597 12429 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dd40576623a84072be59a32d23cda14b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:02.478412 13235 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:02.481309 13549 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:02.483671 13555 tablet_replica.cc:333] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:03:02.485162 13555 raft_consensus.cc:2243] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.486161 13555 raft_consensus.cc:2272] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.489717 13555 ts_tablet_manager.cc:1916] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:02.495765 13517 raft_consensus.cc:2955] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:02.498487 13235 raft_consensus.cc:2955] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:02.519735 12538 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:02.529711 13555 ts_tablet_manager.cc:1929] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:02.530375 13555 log.cc:1199] T dd40576623a84072be59a32d23cda14b P a70479a3b4114f3581095e9890f5d653: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-0-root/wals/dd40576623a84072be59a32d23cda14b
I20260709 13:03:02.531980 12432 catalog_manager.cc:5028] TS a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): tablet dd40576623a84072be59a32d23cda14b (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:02.533021 12431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4432abbae9994c048d249abe3143fa09 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:02.538115 12442 catalog_manager.cc:5697] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:02.543372 13383 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:02.555260 12547 raft_consensus.cc:2955] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:02.557236 12604 tablet_service.cc:1558] Processing DeleteTablet for tablet 4432abbae9994c048d249abe3143fa09 with delete_type TABLET_DATA_TOMBSTONED (TS a11816c5d72e4d1295a242f3ced09e5f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41074
I20260709 13:03:02.572908 13562 tablet_replica.cc:333] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:03:02.574251 13562 raft_consensus.cc:2243] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:02.575178 13562 raft_consensus.cc:2272] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:02.580500 13562 ts_tablet_manager.cc:1916] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:02.600606 13562 ts_tablet_manager.cc:1929] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:02.601099 13562 log.cc:1199] T 4432abbae9994c048d249abe3143fa09 P a11816c5d72e4d1295a242f3ced09e5f: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-1-root/wals/4432abbae9994c048d249abe3143fa09
I20260709 13:03:02.602785 12429 catalog_manager.cc:5028] TS a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): tablet 4432abbae9994c048d249abe3143fa09 (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:03.631443 12622 consensus_queue.cc:237] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
W20260709 13:03:03.639251 12588 consensus_peers.cc:597] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 39a7784c61d94bd5a03c390c81d48e35. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:03.639628 12538 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:03.639595 12688 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:03.641701 13547 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:03.642762 13566 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:03.655946 13547 raft_consensus.cc:2955] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:03.661477 12688 raft_consensus.cc:2955] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:03.666468 12538 raft_consensus.cc:2955] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:03.675966 12442 catalog_manager.cc:5697] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:03.679415 12692 consensus_queue.cc:237] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:03.701776 12622 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:03:03.703431 12662 consensus_peers.cc:597] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8dcafb50fd3c47afbf475b1da51b147a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:03.704011 13517 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:03.707772 12538 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:03.712010 13383 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:03.726706 13383 raft_consensus.cc:2955] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:03.730611 12615 raft_consensus.cc:2955] T 8dcafb50fd3c47afbf475b1da51b147a P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:03.742807 12538 raft_consensus.cc:2955] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:03.755034 12540 consensus_queue.cc:237] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:03.762959 12692 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:03:03.764940 12513 consensus_peers.cc:597] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bf1f0526c7954a23b36c79f2c2b19122. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:03.765831 12615 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:03.767335 13564 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:03.768600 13561 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:03.772517 12442 catalog_manager.cc:5697] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:03.784888 13564 raft_consensus.cc:2955] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:03.787487 12615 raft_consensus.cc:2955] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:03.852453 12538 consensus_queue.cc:237] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:03.854043 12443 catalog_manager.cc:5697] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
W20260709 13:03:03.870106 12513 consensus_peers.cc:597] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67b0620b67b94f25ad79a8b18732686a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:03.871353 12692 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:03.872529 12615 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:03.871554 12688 raft_consensus.cc:2955] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:03.874495 13561 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:03.875466 13564 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:03.901819 13561 raft_consensus.cc:2955] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:03.903683 12618 raft_consensus.cc:2955] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:03.904829 12692 raft_consensus.cc:2955] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:03.920254 12443 catalog_manager.cc:5697] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:04.169656 13585 ts_tablet_manager.cc:933] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307)
I20260709 13:03:04.172065 13585 tablet_copy_client.cc:323] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.193:43307
I20260709 13:03:04.174335 12557 tablet_copy_service.cc:140] P a70479a3b4114f3581095e9890f5d653: Received BeginTabletCopySession request for tablet bf1f0526c7954a23b36c79f2c2b19122 from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:35624)
I20260709 13:03:04.175000 12557 tablet_copy_service.cc:161] P a70479a3b4114f3581095e9890f5d653: Beginning new tablet copy session on tablet bf1f0526c7954a23b36c79f2c2b19122 from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:35624: session id = 66750b8bbd4c4b3a9695951d0ede3372-bf1f0526c7954a23b36c79f2c2b19122
I20260709 13:03:04.180785 12557 tablet_copy_source_session.cc:215] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:04.185137 13585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf1f0526c7954a23b36c79f2c2b19122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.201893 13585 tablet_copy_client.cc:806] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:04.202546 13585 tablet_copy_client.cc:670] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:04.206667 13585 tablet_copy_client.cc:538] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:04.215773 13585 tablet_bootstrap.cc:492] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:04.231259 13587 ts_tablet_manager.cc:933] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:04.234666 13587 tablet_copy_client.cc:323] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.195:34641
I20260709 13:03:04.237363 12706 tablet_copy_service.cc:140] P 7ad68e814a7741488971822f2598183a: Received BeginTabletCopySession request for tablet 8dcafb50fd3c47afbf475b1da51b147a from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:46988)
I20260709 13:03:04.237977 12706 tablet_copy_service.cc:161] P 7ad68e814a7741488971822f2598183a: Beginning new tablet copy session on tablet 8dcafb50fd3c47afbf475b1da51b147a from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:46988: session id = 66750b8bbd4c4b3a9695951d0ede3372-8dcafb50fd3c47afbf475b1da51b147a
I20260709 13:03:04.246420 12706 tablet_copy_source_session.cc:215] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:04.249208 13590 ts_tablet_manager.cc:933] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:04.251611 13587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dcafb50fd3c47afbf475b1da51b147a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.252009 13585 tablet_bootstrap.cc:492] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:04.253021 13585 tablet_bootstrap.cc:492] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:04.253814 13585 ts_tablet_manager.cc:1403] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.008s
I20260709 13:03:04.257126 13585 raft_consensus.cc:359] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:04.258124 13585 raft_consensus.cc:740] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:04.258921 13585 consensus_queue.cc:260] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:04.322845 13590 tablet_copy_client.cc:323] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.194:41653
I20260709 13:03:04.337117 12631 tablet_copy_service.cc:140] P a11816c5d72e4d1295a242f3ced09e5f: Received BeginTabletCopySession request for tablet 39a7784c61d94bd5a03c390c81d48e35 from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:60170)
I20260709 13:03:04.337698 12631 tablet_copy_service.cc:161] P a11816c5d72e4d1295a242f3ced09e5f: Beginning new tablet copy session on tablet 39a7784c61d94bd5a03c390c81d48e35 from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:60170: session id = 66750b8bbd4c4b3a9695951d0ede3372-39a7784c61d94bd5a03c390c81d48e35
I20260709 13:03:04.349273 12631 tablet_copy_source_session.cc:215] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:04.352908 13585 ts_tablet_manager.cc:1434] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.099s	user 0.009s	sys 0.010s
I20260709 13:03:04.364203 12557 tablet_copy_service.cc:342] P a70479a3b4114f3581095e9890f5d653: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-bf1f0526c7954a23b36c79f2c2b19122 received from {username='slave'} at 127.0.0.1:35624
I20260709 13:03:04.364699 12557 tablet_copy_service.cc:434] P a70479a3b4114f3581095e9890f5d653: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-bf1f0526c7954a23b36c79f2c2b19122 on tablet bf1f0526c7954a23b36c79f2c2b19122 with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:04.365356 13590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39a7784c61d94bd5a03c390c81d48e35. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.372458 13585 ts_tablet_manager.cc:933] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307)
I20260709 13:03:04.384004 13585 tablet_copy_client.cc:323] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.193:43307
I20260709 13:03:04.384203 13587 tablet_copy_client.cc:806] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:04.384954 13587 tablet_copy_client.cc:670] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:04.386456 12557 tablet_copy_service.cc:140] P a70479a3b4114f3581095e9890f5d653: Received BeginTabletCopySession request for tablet 67b0620b67b94f25ad79a8b18732686a from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:35624)
I20260709 13:03:04.386999 12557 tablet_copy_service.cc:161] P a70479a3b4114f3581095e9890f5d653: Beginning new tablet copy session on tablet 67b0620b67b94f25ad79a8b18732686a from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:35624: session id = 66750b8bbd4c4b3a9695951d0ede3372-67b0620b67b94f25ad79a8b18732686a
I20260709 13:03:04.390244 13587 tablet_copy_client.cc:538] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:04.399538 13587 tablet_bootstrap.cc:492] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:04.410887 12557 tablet_copy_source_session.cc:215] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:04.414413 13585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67b0620b67b94f25ad79a8b18732686a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:04.415834 13590 tablet_copy_client.cc:806] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:04.416523 13590 tablet_copy_client.cc:670] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:04.426614 13590 tablet_copy_client.cc:538] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:04.448545 13590 tablet_bootstrap.cc:492] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:04.455343 13585 tablet_copy_client.cc:806] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:04.456058 13585 tablet_copy_client.cc:670] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:04.462759 13585 tablet_copy_client.cc:538] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:04.468636 13587 tablet_bootstrap.cc:492] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:04.469694 13587 tablet_bootstrap.cc:492] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:04.470474 13587 ts_tablet_manager.cc:1403] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.071s	user 0.024s	sys 0.004s
I20260709 13:03:04.473544 13587 raft_consensus.cc:359] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:04.474685 13587 raft_consensus.cc:740] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:04.475292 13585 tablet_bootstrap.cc:492] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:04.475746 13587 consensus_queue.cc:260] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:04.478446 13587 ts_tablet_manager.cc:1434] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:03:04.484354 12706 tablet_copy_service.cc:342] P 7ad68e814a7741488971822f2598183a: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-8dcafb50fd3c47afbf475b1da51b147a received from {username='slave'} at 127.0.0.1:46988
I20260709 13:03:04.484803 12706 tablet_copy_service.cc:434] P 7ad68e814a7741488971822f2598183a: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-8dcafb50fd3c47afbf475b1da51b147a on tablet 8dcafb50fd3c47afbf475b1da51b147a with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:04.513094 13585 tablet_bootstrap.cc:492] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:04.515050 13585 tablet_bootstrap.cc:492] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:04.515811 13585 ts_tablet_manager.cc:1403] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.041s	user 0.027s	sys 0.004s
I20260709 13:03:04.517629 13590 tablet_bootstrap.cc:492] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:04.518520 13590 tablet_bootstrap.cc:492] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:04.519198 13590 ts_tablet_manager.cc:1403] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.071s	user 0.026s	sys 0.000s
I20260709 13:03:04.520094 13585 raft_consensus.cc:359] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:04.520977 13585 raft_consensus.cc:740] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:04.521749 13585 consensus_queue.cc:260] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:04.522318 13590 raft_consensus.cc:359] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:04.523140 13590 raft_consensus.cc:740] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:04.523779 13590 consensus_queue.cc:260] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:04.525183 13585 ts_tablet_manager.cc:1434] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:03:04.527168 13590 ts_tablet_manager.cc:1434] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:04.528390 12557 tablet_copy_service.cc:342] P a70479a3b4114f3581095e9890f5d653: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-67b0620b67b94f25ad79a8b18732686a received from {username='slave'} at 127.0.0.1:35624
I20260709 13:03:04.528836 12557 tablet_copy_service.cc:434] P a70479a3b4114f3581095e9890f5d653: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-67b0620b67b94f25ad79a8b18732686a on tablet 67b0620b67b94f25ad79a8b18732686a with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:04.528847 12631 tablet_copy_service.cc:342] P a11816c5d72e4d1295a242f3ced09e5f: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-39a7784c61d94bd5a03c390c81d48e35 received from {username='slave'} at 127.0.0.1:60170
I20260709 13:03:04.529445 12631 tablet_copy_service.cc:434] P a11816c5d72e4d1295a242f3ced09e5f: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-39a7784c61d94bd5a03c390c81d48e35 on tablet 39a7784c61d94bd5a03c390c81d48e35 with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:04.603367 13235 raft_consensus.cc:1217] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:04.647142 13235 raft_consensus.cc:1217] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:04.822140 13235 raft_consensus.cc:1217] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:04.843313 13233 raft_consensus.cc:1217] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:04.997639 13578 raft_consensus.cc:1064] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:04.999624 13578 consensus_queue.cc:237] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:05.006795 13235 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:05.008311 13578 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:05.009171 12615 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:05.009335 12547 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:05.010731 13578 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:05.012444 13517 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:05.032966 13517 raft_consensus.cc:2955] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.039206 12538 raft_consensus.cc:2955] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.059800 12443 catalog_manager.cc:5697] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.060243 13235 raft_consensus.cc:2955] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.069088 12615 raft_consensus.cc:2955] T 8dcafb50fd3c47afbf475b1da51b147a P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.111497 12692 consensus_queue.cc:237] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:05.116824 13235 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:05.117514 12538 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:05.118670 13593 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:05.120520 13593 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:05.127803 13593 raft_consensus.cc:2955] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.129644 13235 raft_consensus.cc:2955] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.134146 12538 raft_consensus.cc:2955] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.141391 12431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8dcafb50fd3c47afbf475b1da51b147a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:05.148260 12444 catalog_manager.cc:5697] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.168386 12604 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dcafb50fd3c47afbf475b1da51b147a with delete_type TABLET_DATA_TOMBSTONED (TS a11816c5d72e4d1295a242f3ced09e5f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41074
I20260709 13:03:05.173280 13596 raft_consensus.cc:1064] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:05.173419 13609 tablet_replica.cc:333] T 8dcafb50fd3c47afbf475b1da51b147a P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:03:05.175946 13596 consensus_queue.cc:237] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:05.189795 13235 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:05.191432 13596 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:05.192430 12620 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:05.192461 12692 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:05.195439 13561 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:05.197172 13564 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:05.204973 13609 raft_consensus.cc:2243] T 8dcafb50fd3c47afbf475b1da51b147a P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.205775 13609 raft_consensus.cc:2272] T 8dcafb50fd3c47afbf475b1da51b147a P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.210898 13609 ts_tablet_manager.cc:1916] T 8dcafb50fd3c47afbf475b1da51b147a P a11816c5d72e4d1295a242f3ced09e5f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:05.214972 12620 raft_consensus.cc:2955] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.213495 13564 raft_consensus.cc:2955] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.220512 12692 raft_consensus.cc:2955] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.280203 12444 catalog_manager.cc:5697] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.284399 13609 ts_tablet_manager.cc:1929] T 8dcafb50fd3c47afbf475b1da51b147a P a11816c5d72e4d1295a242f3ced09e5f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:05.287703 13609 log.cc:1199] T 8dcafb50fd3c47afbf475b1da51b147a P a11816c5d72e4d1295a242f3ced09e5f: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-1-root/wals/8dcafb50fd3c47afbf475b1da51b147a
I20260709 13:03:05.292595 12429 catalog_manager.cc:5028] TS a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): tablet 8dcafb50fd3c47afbf475b1da51b147a (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:05.296072 13547 raft_consensus.cc:1064] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:05.290525 13561 raft_consensus.cc:1064] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:05.304214 13561 consensus_queue.cc:237] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:05.304399 13547 consensus_queue.cc:237] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:05.317531 13235 raft_consensus.cc:2955] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.321702 13233 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:05.323940 13600 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:05.325057 12692 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:05.331607 12540 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:05.333035 13600 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:05.336268 13493 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:05.349483 12538 consensus_queue.cc:237] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:05.364773 12688 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:05.366258 13614 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:05.376724 13615 raft_consensus.cc:2955] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.380383 13234 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:05.380438 12688 raft_consensus.cc:2955] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.389230 13614 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:05.395910 13234 raft_consensus.cc:2955] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.397255 12432 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bf1f0526c7954a23b36c79f2c2b19122 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:05.410326 12689 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:05.413836 13616 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:05.415161 12620 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:05.418744 13493 raft_consensus.cc:2955] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.421708 13233 raft_consensus.cc:2955] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.419739 13561 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:05.424225 13235 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:05.422842 12444 catalog_manager.cc:5697] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.447430 13615 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:05.455277 12689 raft_consensus.cc:2955] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.459884 12604 tablet_service.cc:1558] Processing DeleteTablet for tablet bf1f0526c7954a23b36c79f2c2b19122 with delete_type TABLET_DATA_TOMBSTONED (TS a11816c5d72e4d1295a242f3ced09e5f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41074
I20260709 13:03:05.461094 13609 tablet_replica.cc:333] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:03:05.486871 12544 raft_consensus.cc:2955] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.503882 12442 catalog_manager.cc:5697] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:05.527040 13615 raft_consensus.cc:2955] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.532070 13609 raft_consensus.cc:2243] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.532909 13609 raft_consensus.cc:2272] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.533176 13235 raft_consensus.cc:2955] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.536743 13609 ts_tablet_manager.cc:1916] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:05.557461 12615 raft_consensus.cc:2955] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.569494 12442 catalog_manager.cc:5697] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:05.555670 12689 raft_consensus.cc:2955] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.575516 13609 ts_tablet_manager.cc:1929] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:05.575989 13609 log.cc:1199] T bf1f0526c7954a23b36c79f2c2b19122 P a11816c5d72e4d1295a242f3ced09e5f: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-1-root/wals/bf1f0526c7954a23b36c79f2c2b19122
I20260709 13:03:05.578683 12429 catalog_manager.cc:5028] TS a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): tablet bf1f0526c7954a23b36c79f2c2b19122 (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:05.635597 12620 consensus_queue.cc:237] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:05.635702 12544 consensus_queue.cc:237] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:05.640779 13235 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:05.642264 13614 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:05.648648 13615 raft_consensus.cc:2955] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.651006 13235 raft_consensus.cc:2955] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.661177 12432 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 67b0620b67b94f25ad79a8b18732686a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:05.672039 12617 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:05.677337 13616 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:05.681198 12544 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:05.682600 13234 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:05.685422 12442 catalog_manager.cc:5697] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:05.698879 13625 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:05.699165 12620 raft_consensus.cc:2955] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.701083 13625 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:05.710587 13547 raft_consensus.cc:2955] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.713722 12682 tablet_service.cc:1558] Processing DeleteTablet for tablet 67b0620b67b94f25ad79a8b18732686a with delete_type TABLET_DATA_TOMBSTONED (TS 7ad68e814a7741488971822f2598183a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37280
I20260709 13:03:05.720979 13627 tablet_replica.cc:333] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:03:05.720759 12540 raft_consensus.cc:2955] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.722445 13627 raft_consensus.cc:2243] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.723279 13627 raft_consensus.cc:2272] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.725833 12429 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 39a7784c61d94bd5a03c390c81d48e35 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:05.728544 13627 ts_tablet_manager.cc:1916] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:05.727583 13235 raft_consensus.cc:2955] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:05.753072 12444 catalog_manager.cc:5697] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:05.757290 13627 ts_tablet_manager.cc:1929] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:05.757840 13627 log.cc:1199] T 67b0620b67b94f25ad79a8b18732686a P 7ad68e814a7741488971822f2598183a: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-2-root/wals/67b0620b67b94f25ad79a8b18732686a
I20260709 13:03:05.763150 12431 catalog_manager.cc:5028] TS 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): tablet 67b0620b67b94f25ad79a8b18732686a (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:05.770529 12682 tablet_service.cc:1558] Processing DeleteTablet for tablet 39a7784c61d94bd5a03c390c81d48e35 with delete_type TABLET_DATA_TOMBSTONED (TS 7ad68e814a7741488971822f2598183a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37280
I20260709 13:03:05.771559 13627 tablet_replica.cc:333] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:03:05.785329 13627 raft_consensus.cc:2243] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:05.786228 13627 raft_consensus.cc:2272] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:05.789913 13627 ts_tablet_manager.cc:1916] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:05.804159 13627 ts_tablet_manager.cc:1929] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:05.804454 13627 log.cc:1199] T 39a7784c61d94bd5a03c390c81d48e35 P 7ad68e814a7741488971822f2598183a: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-2-root/wals/39a7784c61d94bd5a03c390c81d48e35
I20260709 13:03:05.806056 12431 catalog_manager.cc:5028] TS 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): tablet 39a7784c61d94bd5a03c390c81d48e35 (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:06.862445 12689 consensus_queue.cc:237] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:06.870209 12619 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:06.872105 12540 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:06.872107 13631 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:03:06.874940 12662 consensus_peers.cc:597] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ac31a22d7aa245e385188a5ff4068842. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:06.875717 13631 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:06.882478 13631 raft_consensus.cc:2955] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:06.884294 12619 raft_consensus.cc:2955] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:06.886940 12540 raft_consensus.cc:2955] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:06.905917 12442 catalog_manager.cc:5697] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:06.908798 12692 consensus_queue.cc:237] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
W20260709 13:03:06.917073 12662 consensus_peers.cc:597] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d21e2686d5e84f6495f1b6f8a9b68dca. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:06.918588 12619 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:06.920182 12540 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:06.920341 13631 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:06.922794 13549 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:06.935544 13549 raft_consensus.cc:2955] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:06.942929 12540 raft_consensus.cc:2955] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:06.946610 12619 raft_consensus.cc:2955] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:06.956357 12692 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:06.959394 12444 catalog_manager.cc:5697] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:06.971143 12620 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:03:06.972503 12662 consensus_peers.cc:597] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f072313cdba43b09e842af6e98f0385. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:06.973241 13631 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:06.974479 12544 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:06.976917 13549 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:06.988411 13631 raft_consensus.cc:2955] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:06.991686 12620 raft_consensus.cc:2955] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:06.995520 12540 raft_consensus.cc:2955] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:07.007932 12442 catalog_manager.cc:5697] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:07.017266 12619 consensus_queue.cc:237] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:07.024770 12540 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:07.026290 12692 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:03:07.028990 12588 consensus_peers.cc:597] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a059fe8e339d4b8f8fd0c9f18705f015. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:07.030062 13628 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:07.037645 13493 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:07.055624 13493 raft_consensus.cc:2955] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:07.057344 12540 raft_consensus.cc:2955] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:07.064954 12692 raft_consensus.cc:2955] T a059fe8e339d4b8f8fd0c9f18705f015 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:07.074374 12444 catalog_manager.cc:5697] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:07.297098 13648 ts_tablet_manager.cc:933] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:07.300552 13648 tablet_copy_client.cc:323] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.195:34641
I20260709 13:03:07.302330 12706 tablet_copy_service.cc:140] P 7ad68e814a7741488971822f2598183a: Received BeginTabletCopySession request for tablet ac31a22d7aa245e385188a5ff4068842 from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:46988)
I20260709 13:03:07.302889 12706 tablet_copy_service.cc:161] P 7ad68e814a7741488971822f2598183a: Beginning new tablet copy session on tablet ac31a22d7aa245e385188a5ff4068842 from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:46988: session id = 66750b8bbd4c4b3a9695951d0ede3372-ac31a22d7aa245e385188a5ff4068842
I20260709 13:03:07.308243 12706 tablet_copy_source_session.cc:215] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:07.311384 13648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac31a22d7aa245e385188a5ff4068842. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.324019 13648 tablet_copy_client.cc:806] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:07.324599 13648 tablet_copy_client.cc:670] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:07.328081 13648 tablet_copy_client.cc:538] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:07.339515 13648 tablet_bootstrap.cc:492] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:07.359894 13648 tablet_bootstrap.cc:492] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:07.360781 13648 tablet_bootstrap.cc:492] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:07.361436 13648 ts_tablet_manager.cc:1403] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.006s
I20260709 13:03:07.364452 13648 raft_consensus.cc:359] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:07.365250 13648 raft_consensus.cc:740] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:07.366154 13648 consensus_queue.cc:260] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:07.407914 13652 ts_tablet_manager.cc:933] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:07.411374 13648 ts_tablet_manager.cc:1434] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.050s	user 0.020s	sys 0.025s
I20260709 13:03:07.419088 13652 tablet_copy_client.cc:323] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.195:34641
I20260709 13:03:07.419308 12706 tablet_copy_service.cc:342] P 7ad68e814a7741488971822f2598183a: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-ac31a22d7aa245e385188a5ff4068842 received from {username='slave'} at 127.0.0.1:46988
I20260709 13:03:07.419874 12706 tablet_copy_service.cc:434] P 7ad68e814a7741488971822f2598183a: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-ac31a22d7aa245e385188a5ff4068842 on tablet ac31a22d7aa245e385188a5ff4068842 with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:07.421020 12705 tablet_copy_service.cc:140] P 7ad68e814a7741488971822f2598183a: Received BeginTabletCopySession request for tablet d21e2686d5e84f6495f1b6f8a9b68dca from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:46988)
I20260709 13:03:07.421715 12705 tablet_copy_service.cc:161] P 7ad68e814a7741488971822f2598183a: Beginning new tablet copy session on tablet d21e2686d5e84f6495f1b6f8a9b68dca from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:46988: session id = 66750b8bbd4c4b3a9695951d0ede3372-d21e2686d5e84f6495f1b6f8a9b68dca
I20260709 13:03:07.430274 12705 tablet_copy_source_session.cc:215] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:07.435058 13652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d21e2686d5e84f6495f1b6f8a9b68dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.446494 13652 tablet_copy_client.cc:806] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:07.447042 13652 tablet_copy_client.cc:670] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:07.450675 13652 tablet_copy_client.cc:538] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:07.460721 13652 tablet_bootstrap.cc:492] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:07.483747 13652 tablet_bootstrap.cc:492] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:07.484517 13652 tablet_bootstrap.cc:492] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:07.485061 13652 ts_tablet_manager.cc:1403] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.025s	user 0.023s	sys 0.000s
I20260709 13:03:07.487249 13652 raft_consensus.cc:359] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:07.487855 13652 raft_consensus.cc:740] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:07.488420 13652 consensus_queue.cc:260] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:07.490345 13652 ts_tablet_manager.cc:1434] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:03:07.493510 12705 tablet_copy_service.cc:342] P 7ad68e814a7741488971822f2598183a: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-d21e2686d5e84f6495f1b6f8a9b68dca received from {username='slave'} at 127.0.0.1:46988
I20260709 13:03:07.493996 12705 tablet_copy_service.cc:434] P 7ad68e814a7741488971822f2598183a: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-d21e2686d5e84f6495f1b6f8a9b68dca on tablet d21e2686d5e84f6495f1b6f8a9b68dca with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:07.510093 13652 ts_tablet_manager.cc:933] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:07.511616 13652 tablet_copy_client.cc:323] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.195:34641
I20260709 13:03:07.513091 12705 tablet_copy_service.cc:140] P 7ad68e814a7741488971822f2598183a: Received BeginTabletCopySession request for tablet 2f072313cdba43b09e842af6e98f0385 from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:46988)
I20260709 13:03:07.513659 12705 tablet_copy_service.cc:161] P 7ad68e814a7741488971822f2598183a: Beginning new tablet copy session on tablet 2f072313cdba43b09e842af6e98f0385 from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:46988: session id = 66750b8bbd4c4b3a9695951d0ede3372-2f072313cdba43b09e842af6e98f0385
I20260709 13:03:07.521739 12705 tablet_copy_source_session.cc:215] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:07.524770 13652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f072313cdba43b09e842af6e98f0385. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.541154 13648 ts_tablet_manager.cc:933] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:07.551973 13652 tablet_copy_client.cc:806] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:07.552729 13652 tablet_copy_client.cc:670] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:07.556839 13652 tablet_copy_client.cc:538] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:07.558094 13648 tablet_copy_client.cc:323] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.194:41653
I20260709 13:03:07.559803 12631 tablet_copy_service.cc:140] P a11816c5d72e4d1295a242f3ced09e5f: Received BeginTabletCopySession request for tablet a059fe8e339d4b8f8fd0c9f18705f015 from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:60170)
I20260709 13:03:07.560379 12631 tablet_copy_service.cc:161] P a11816c5d72e4d1295a242f3ced09e5f: Beginning new tablet copy session on tablet a059fe8e339d4b8f8fd0c9f18705f015 from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:60170: session id = 66750b8bbd4c4b3a9695951d0ede3372-a059fe8e339d4b8f8fd0c9f18705f015
I20260709 13:03:07.566326 13652 tablet_bootstrap.cc:492] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:07.570350 12631 tablet_copy_source_session.cc:215] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:07.575044 13648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a059fe8e339d4b8f8fd0c9f18705f015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:07.595273 13652 tablet_bootstrap.cc:492] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:07.596226 13652 tablet_bootstrap.cc:492] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:07.596880 13652 ts_tablet_manager.cc:1403] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.005s
I20260709 13:03:07.600116 13652 raft_consensus.cc:359] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:07.601040 13652 raft_consensus.cc:740] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:07.601754 13652 consensus_queue.cc:260] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:07.603524 13648 tablet_copy_client.cc:806] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:07.604300 13652 ts_tablet_manager.cc:1434] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.004s
I20260709 13:03:07.604171 13648 tablet_copy_client.cc:670] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:07.608420 12705 tablet_copy_service.cc:342] P 7ad68e814a7741488971822f2598183a: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-2f072313cdba43b09e842af6e98f0385 received from {username='slave'} at 127.0.0.1:46988
I20260709 13:03:07.608712 13648 tablet_copy_client.cc:538] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:07.608875 12705 tablet_copy_service.cc:434] P 7ad68e814a7741488971822f2598183a: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-2f072313cdba43b09e842af6e98f0385 on tablet 2f072313cdba43b09e842af6e98f0385 with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:07.619172 13648 tablet_bootstrap.cc:492] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:07.640676 13648 tablet_bootstrap.cc:492] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:07.641621 13648 tablet_bootstrap.cc:492] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:07.642365 13648 ts_tablet_manager.cc:1403] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.008s
I20260709 13:03:07.645318 13648 raft_consensus.cc:359] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:07.646171 13648 raft_consensus.cc:740] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:07.646813 13648 consensus_queue.cc:260] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:07.650734 13648 ts_tablet_manager.cc:1434] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:07.652578 12631 tablet_copy_service.cc:342] P a11816c5d72e4d1295a242f3ced09e5f: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-a059fe8e339d4b8f8fd0c9f18705f015 received from {username='slave'} at 127.0.0.1:60170
I20260709 13:03:07.653028 12631 tablet_copy_service.cc:434] P a11816c5d72e4d1295a242f3ced09e5f: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-a059fe8e339d4b8f8fd0c9f18705f015 on tablet a059fe8e339d4b8f8fd0c9f18705f015 with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:07.746155 13235 raft_consensus.cc:1217] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:07.928627 13234 raft_consensus.cc:1217] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:07.941519 13234 raft_consensus.cc:1217] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:08.161345 13234 raft_consensus.cc:1217] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:08.348007 13629 raft_consensus.cc:1064] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:08.350281 13629 consensus_queue.cc:237] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:08.358022 13234 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:08.358055 12617 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:08.359050 12544 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:08.360790 13631 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:08.362203 13517 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:08.363938 13629 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:08.381434 13234 raft_consensus.cc:2955] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.384202 13629 raft_consensus.cc:2955] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.397681 12617 raft_consensus.cc:2955] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.402333 12540 raft_consensus.cc:2955] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.416949 12445 catalog_manager.cc:5697] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.451251 13629 raft_consensus.cc:1064] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:08.453745 13629 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:08.477061 12689 consensus_queue.cc:237] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:08.484967 12617 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:08.485314 12544 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:08.486129 13631 raft_consensus.cc:1064] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:08.486758 13234 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:08.487331 13235 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:08.491616 13631 consensus_queue.cc:237] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:08.493714 13517 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:08.501300 13517 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:08.503655 13517 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:08.510735 12620 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:08.531179 13629 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:08.570839 13233 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:08.570839 12538 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:08.541654 13660 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 13:03:08.585520 13517 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:08.590235 13517 raft_consensus.cc:2955] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:03:08.630941 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 48766.7us
I20260709 13:03:08.634197 13631 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:03:08.635808 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 93324.8us
I20260709 13:03:08.636727 13235 raft_consensus.cc:2955] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.637290 13675 raft_consensus.cc:2955] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.642167 12617 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:08.646364 12431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ac31a22d7aa245e385188a5ff4068842 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:08.650079 12615 raft_consensus.cc:2955] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.653757 12443 catalog_manager.cc:5697] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.660251 12546 raft_consensus.cc:2955] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.669142 13628 raft_consensus.cc:1064] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:08.674724 13660 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:08.676496 13628 consensus_queue.cc:237] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:08.706488 13671 raft_consensus.cc:2955] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.689328 13235 raft_consensus.cc:2955] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.694439 12531 tablet_service.cc:1558] Processing DeleteTablet for tablet ac31a22d7aa245e385188a5ff4068842 with delete_type TABLET_DATA_TOMBSTONED (TS a70479a3b4114f3581095e9890f5d653 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42444
I20260709 13:03:08.695225 12619 raft_consensus.cc:2955] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.696661 12444 catalog_manager.cc:5697] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.738950 12545 raft_consensus.cc:2955] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.752526 12689 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:08.761065 13234 raft_consensus.cc:2955] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.763674 12443 catalog_manager.cc:5697] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:08.759739 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 54785.4us
I20260709 13:03:08.802039 12545 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:08.811851 13684 tablet_replica.cc:333] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:03:08.819011 13233 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:08.825054 13684 raft_consensus.cc:2243] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:08.854498 13684 raft_consensus.cc:2272] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:08.858306 13233 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:08.826871 13678 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:08.860729 13629 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:08.861603 12689 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:08.864135 13628 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:08.866632 13685 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:08.877161 13684 ts_tablet_manager.cc:1916] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:08.882112 12619 raft_consensus.cc:2955] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.892107 12688 consensus_queue.cc:237] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:08.892591 13678 raft_consensus.cc:2955] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.901365 12619 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:08.903403 13631 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:08.909852 13235 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:08.912542 13675 raft_consensus.cc:2955] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.918169 13684 ts_tablet_manager.cc:1929] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:08.918707 13684 log.cc:1199] T ac31a22d7aa245e385188a5ff4068842 P a70479a3b4114f3581095e9890f5d653: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-0-root/wals/ac31a22d7aa245e385188a5ff4068842
I20260709 13:03:08.919253 13234 raft_consensus.cc:2955] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.920514 12615 raft_consensus.cc:2955] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.922744 12432 catalog_manager.cc:5028] TS a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): tablet ac31a22d7aa245e385188a5ff4068842 (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:08.934093 13671 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:08.941717 12445 catalog_manager.cc:5697] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.945262 12546 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:08.948091 12431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2f072313cdba43b09e842af6e98f0385 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:08.950407 12442 catalog_manager.cc:5697] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.953979 12431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d21e2686d5e84f6495f1b6f8a9b68dca with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:08.959481 13234 raft_consensus.cc:2955] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.960327 12604 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f072313cdba43b09e842af6e98f0385 with delete_type TABLET_DATA_TOMBSTONED (TS a11816c5d72e4d1295a242f3ced09e5f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41074
I20260709 13:03:08.963644 12531 tablet_service.cc:1558] Processing DeleteTablet for tablet d21e2686d5e84f6495f1b6f8a9b68dca with delete_type TABLET_DATA_TOMBSTONED (TS a70479a3b4114f3581095e9890f5d653 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42444
I20260709 13:03:08.966255 13684 tablet_replica.cc:333] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:03:08.967346 13684 raft_consensus.cc:2243] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:08.966919 13628 raft_consensus.cc:2955] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.968072 13684 raft_consensus.cc:2272] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:08.971894 13233 raft_consensus.cc:2955] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:08.983179 13684 ts_tablet_manager.cc:1916] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:08.992723 12689 raft_consensus.cc:2955] T a059fe8e339d4b8f8fd0c9f18705f015 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:09.002071 12443 catalog_manager.cc:5697] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:09.012032 13493 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:09.017140 12546 raft_consensus.cc:2955] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:09.019186 13684 ts_tablet_manager.cc:1929] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:09.019601 13684 log.cc:1199] T d21e2686d5e84f6495f1b6f8a9b68dca P a70479a3b4114f3581095e9890f5d653: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-0-root/wals/d21e2686d5e84f6495f1b6f8a9b68dca
I20260709 13:03:09.021180 12432 catalog_manager.cc:5028] TS a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): tablet d21e2686d5e84f6495f1b6f8a9b68dca (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:09.035061 12539 raft_consensus.cc:2955] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:09.038285 13692 tablet_replica.cc:333] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:03:09.039436 13692 raft_consensus.cc:2243] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.040258 13692 raft_consensus.cc:2272] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.076781 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:09.058218 13692 ts_tablet_manager.cc:1916] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:09.099260 13692 ts_tablet_manager.cc:1929] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:09.099696 13692 log.cc:1199] T 2f072313cdba43b09e842af6e98f0385 P a11816c5d72e4d1295a242f3ced09e5f: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-1-root/wals/2f072313cdba43b09e842af6e98f0385
I20260709 13:03:09.102546 12429 catalog_manager.cc:5028] TS a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): tablet 2f072313cdba43b09e842af6e98f0385 (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:09.167517 12688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:09.168318 12688 raft_consensus.cc:606] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:09.171588 12688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:09.172150 12688 raft_consensus.cc:606] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:09.175055 12688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:09.175627 12688 raft_consensus.cc:606] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:09.178158 12688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:09.178697 12688 raft_consensus.cc:606] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:09.181367 12688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:09.181941 12688 raft_consensus.cc:606] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:09.183022 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:09.184635 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:09.208822 13629 raft_consensus.cc:993] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:09.209400 13675 raft_consensus.cc:1081] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:09.211107 12619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:41084
I20260709 13:03:09.211748 12619 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:09.212064 12619 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.216742 12619 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:09.218230 12619 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:09.219259 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:09.220024 12539 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.219470 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:09.226429 12688 raft_consensus.cc:3055] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:09.226748 12688 raft_consensus.cc:740] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:09.228292 12688 consensus_queue.cc:260] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:09.229420 12688 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.230427 12539 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:09.231882 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:09.233355 13685 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:09.234521 13685 raft_consensus.cc:697] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:09.235810 13685 consensus_queue.cc:237] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:09.240236 12688 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:09.251405 12442 catalog_manager.cc:5697] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 2 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:09.326611 13678 raft_consensus.cc:993] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: : Instructing follower 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:09.327093 13675 raft_consensus.cc:1081] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:09.328783 13233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:60962
I20260709 13:03:09.329339 13233 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:09.329732 13233 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.337208 13233 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:09.340481 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:09.341141 12539 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.345220 13233 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:09.345731 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:09.346347 12688 raft_consensus.cc:3055] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:09.346645 12688 raft_consensus.cc:740] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:09.347337 12688 consensus_queue.cc:260] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:09.348410 12688 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.353231 12539 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:09.353308 12688 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:09.354696 13200 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:09.355666 13651 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:09.358680 13675 raft_consensus.cc:993] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:09.359126 13675 raft_consensus.cc:1081] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:09.363658 12619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:41084
I20260709 13:03:09.365239 13651 raft_consensus.cc:697] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:09.366356 13651 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:09.367817 12619 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:09.368250 12619 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.375320 12619 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:09.377346 12619 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:09.378034 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:09.378312 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:09.378705 12539 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.378930 12688 raft_consensus.cc:3055] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:09.379328 12688 raft_consensus.cc:740] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:09.380043 12688 consensus_queue.cc:260] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:09.380942 12688 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.382035 12442 catalog_manager.cc:5697] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 2 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:09.388602 12688 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:09.389875 12587 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:09.391369 13493 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:09.397770 13493 raft_consensus.cc:697] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:09.398692 13493 consensus_queue.cc:237] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:09.401903 12539 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:09.416997 13631 raft_consensus.cc:993] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:09.417507 13675 raft_consensus.cc:1081] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:09.419767 13631 raft_consensus.cc:993] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a: : Instructing follower 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:09.415903 12442 catalog_manager.cc:5697] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 2 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:09.420311 13675 raft_consensus.cc:1081] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:09.422029 13233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:60962
I20260709 13:03:09.422582 13233 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:09.423632 13233 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.426345 12615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:41084
I20260709 13:03:09.427882 12615 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:09.428252 12615 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.435020 13233 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:09.435266 12615 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:09.437263 13233 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:09.437410 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:09.438038 12539 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.438834 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:09.439371 12540 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.443449 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:09.444255 12688 raft_consensus.cc:3055] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:09.444667 12688 raft_consensus.cc:740] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:09.445655 12688 consensus_queue.cc:260] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:09.446828 12688 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.452826 12540 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:09.456238 12688 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:09.457476 12588 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:09.457666 13199 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:09.458485 13493 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:09.458950 13493 raft_consensus.cc:697] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:09.459128 13651 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:09.459847 12539 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:09.460752 13651 raft_consensus.cc:697] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:09.459794 13493 consensus_queue.cc:237] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:09.459908 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:09.461957 12688 raft_consensus.cc:3055] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:09.462385 12688 raft_consensus.cc:740] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:09.461912 13651 consensus_queue.cc:237] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:09.463231 12688 consensus_queue.cc:260] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:09.464502 12688 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:09.459240 12615 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:09.472689 12688 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:09.479044 12442 catalog_manager.cc:5697] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 2 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:09.481289 12443 catalog_manager.cc:5697] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 2 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:09.637501 12615 consensus_queue.cc:237] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:09.642668 13234 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:09.642935 12540 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:09.644279 13685 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:09.645138 13698 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:09.661958 13628 raft_consensus.cc:2955] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:09.667232 13234 raft_consensus.cc:2955] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:09.673342 12429 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a059fe8e339d4b8f8fd0c9f18705f015 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:09.674412 12540 raft_consensus.cc:2955] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:09.684053 12443 catalog_manager.cc:5697] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:09.697512 12682 tablet_service.cc:1558] Processing DeleteTablet for tablet a059fe8e339d4b8f8fd0c9f18705f015 with delete_type TABLET_DATA_TOMBSTONED (TS 7ad68e814a7741488971822f2598183a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37280
I20260709 13:03:09.700976 12689 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:09.707571 13698 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:09.711028 12540 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:09.712520 13698 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:09.717322 13702 tablet_replica.cc:333] T a059fe8e339d4b8f8fd0c9f18705f015 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:03:09.719851 13702 raft_consensus.cc:2243] T a059fe8e339d4b8f8fd0c9f18705f015 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:09.722206 13702 raft_consensus.cc:2272] T a059fe8e339d4b8f8fd0c9f18705f015 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:09.731323 13702 ts_tablet_manager.cc:1916] T a059fe8e339d4b8f8fd0c9f18705f015 P 7ad68e814a7741488971822f2598183a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:09.764468 13702 ts_tablet_manager.cc:1929] T a059fe8e339d4b8f8fd0c9f18705f015 P 7ad68e814a7741488971822f2598183a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:09.765138 13702 log.cc:1199] T a059fe8e339d4b8f8fd0c9f18705f015 P 7ad68e814a7741488971822f2598183a: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-2-root/wals/a059fe8e339d4b8f8fd0c9f18705f015
I20260709 13:03:09.766990 12431 catalog_manager.cc:5028] TS 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): tablet a059fe8e339d4b8f8fd0c9f18705f015 (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:09.838376 12540 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:09.839756 13651 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:09.842792 12689 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:09.844205 13685 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:09.850257 12688 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:09.852196 13697 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:09.890614 12540 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:09.901079 13493 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:09.905135 12539 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:09.908699 13628 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:09.920357 12689 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:09.924950 13698 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:09.963512 12540 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:09.964825 13651 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:09.978003 12689 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:09.979245 13651 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:10.185866 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:10.227572 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:10.266748 12689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:10.267413 12689 raft_consensus.cc:606] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:10.270701 12689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:10.271260 12689 raft_consensus.cc:606] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:10.273380 13517 raft_consensus.cc:993] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a: : Instructing follower 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:10.273779 12689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:10.273871 13629 raft_consensus.cc:1081] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:10.274328 12689 raft_consensus.cc:606] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:10.275511 13234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:60962
I20260709 13:03:10.276082 13234 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:10.276456 13234 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.277096 12689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:10.277640 12689 raft_consensus.cc:606] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:03:10.280246 12688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:10.280763 12688 raft_consensus.cc:606] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:10.281841 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:10.283357 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:10.283176 13234 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:10.286242 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:10.286873 12615 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.287007 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:10.287608 12688 raft_consensus.cc:3055] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:10.287890 12688 raft_consensus.cc:740] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:10.288594 12688 consensus_queue.cc:260] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:10.289659 12688 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.292586 12615 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:10.293831 13197 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:10.294178 12688 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:10.294266 13234 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:10.295013 13651 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:10.295552 13651 raft_consensus.cc:697] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:10.296365 13651 consensus_queue.cc:237] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:10.308141 12442 catalog_manager.cc:5697] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 2 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:10.317615 13517 raft_consensus.cc:993] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a: : Instructing follower 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:10.318107 13678 raft_consensus.cc:1081] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:10.319780 13234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:60962
I20260709 13:03:10.320302 13234 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:10.320619 13234 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.325902 13234 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:10.328279 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:10.328835 12539 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.329253 13234 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:10.329860 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:10.330431 12688 raft_consensus.cc:3055] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:10.330763 12688 raft_consensus.cc:740] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:10.331444 12688 consensus_queue.cc:260] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:10.335505 12539 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:10.336524 12688 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.336869 13200 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:10.337728 13651 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:10.338210 13651 raft_consensus.cc:697] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:10.339026 13651 consensus_queue.cc:237] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:10.345714 12688 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:10.350806 12442 catalog_manager.cc:5697] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 2 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:10.686546 12688 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:10.688117 13697 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:10.703876 12615 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:10.705330 13651 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:10.734323 13629 raft_consensus.cc:993] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:10.738370 13517 raft_consensus.cc:1081] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:10.741183 12615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:41084
I20260709 13:03:10.741773 12615 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:10.742102 12615 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.751905 12615 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:10.756654 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:10.757268 12540 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.761524 13629 raft_consensus.cc:993] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:10.762077 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:10.762733 13629 raft_consensus.cc:1081] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:10.762799 12688 raft_consensus.cc:3055] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:10.764258 12688 raft_consensus.cc:740] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:10.765075 12688 consensus_queue.cc:260] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:10.766127 12688 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.769755 12617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:41084
I20260709 13:03:10.770327 12617 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:10.770668 12617 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.771854 12540 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:10.776300 12688 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:10.777384 12588 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:10.777535 12615 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:10.778213 13628 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:10.778769 13628 raft_consensus.cc:697] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:10.779611 13628 consensus_queue.cc:237] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:10.781157 13517 raft_consensus.cc:993] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a: : Instructing follower a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:03:10.781649 13517 raft_consensus.cc:1081] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:03:10.782493 12617 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:10.783587 12540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9"
dest_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:42458
I20260709 13:03:10.785915 12540 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:10.786674 12540 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.790557 12617 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:10.792155 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:10.792801 12539 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.798475 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:10.799662 12539 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:10.801237 12588 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:10.802107 13685 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:10.806416 13685 raft_consensus.cc:697] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:10.807281 13685 consensus_queue.cc:237] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:10.806965 12540 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:10.809196 12445 catalog_manager.cc:5697] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 2 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:10.807228 12688 raft_consensus.cc:3055] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:10.810971 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:10.811585 12615 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.811321 12688 raft_consensus.cc:740] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:10.813273 12688 consensus_queue.cc:260] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:10.815548 12688 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.816408 12540 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:10.822453 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:10.823072 12689 raft_consensus.cc:3055] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:10.823350 12689 raft_consensus.cc:740] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:10.824038 12689 consensus_queue.cc:260] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:10.825205 12689 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:10.827382 12617 consensus_queue.cc:237] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:10.834930 12688 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:10.839771 12689 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:10.824355 12615 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:10.841488 12510 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:10.840909 12442 catalog_manager.cc:5697] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 2 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:10.845624 13711 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:10.846148 13711 raft_consensus.cc:697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:10.846967 13711 consensus_queue.cc:237] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:10.850435 12689 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:03:10.851959 12588 consensus_peers.cc:597] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f6ccc9457e2e4aeaac5163b9bb9f13cb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:10.853607 12540 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:10.853760 13728 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:10.860332 13685 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:10.874627 12442 catalog_manager.cc:5697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:10.875555 13728 raft_consensus.cc:2955] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:10.881963 12689 raft_consensus.cc:2955] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:10.894310 12445 catalog_manager.cc:5697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:10.897903 12689 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:10.899711 12546 raft_consensus.cc:2955] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
W20260709 13:03:10.907675 12662 consensus_peers.cc:597] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c94183b9e8b46989e1da72e911d7aee. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:10.907882 12539 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:10.909750 13678 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:10.910774 12615 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:10.912372 13678 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:10.916726 12539 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:10.918273 13651 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:10.937155 12689 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:10.939896 13697 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:10.939517 13629 raft_consensus.cc:2955] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:10.942886 12540 raft_consensus.cc:2955] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:10.950335 12615 raft_consensus.cc:2955] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:10.969605 12688 consensus_queue.cc:237] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:10.984179 12442 catalog_manager.cc:5697] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:10.992774 12615 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:03:10.995820 12662 consensus_peers.cc:597] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f7bf456f0b724194a6e042403ee0b730. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:10.996910 12540 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:10.996973 13629 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:10.999347 13517 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:11.013640 12617 raft_consensus.cc:2955] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:11.012424 13741 raft_consensus.cc:2955] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:11.024778 12540 raft_consensus.cc:2955] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:11.031025 12546 consensus_queue.cc:237] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:11.033519 12443 catalog_manager.cc:5697] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:11.047286 12513 consensus_peers.cc:597] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 22a877009d42412fb470ba88a418be05. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:11.048453 12689 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:11.049969 13745 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:11.055297 12617 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:11.059165 13688 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:11.065181 13688 raft_consensus.cc:2955] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:11.067279 12689 raft_consensus.cc:2955] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:11.069011 12617 raft_consensus.cc:2955] T 22a877009d42412fb470ba88a418be05 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:11.080339 12443 catalog_manager.cc:5697] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:11.240984 12617 raft_consensus.cc:1275] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:11.242756 13711 consensus_queue.cc:1048] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:11.252523 12688 raft_consensus.cc:1275] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:11.255438 13745 consensus_queue.cc:1048] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:11.278728 12546 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:11.281134 13628 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:11.282546 12688 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:11.284209 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:11.289028 13628 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:03:11.332336 12692 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:11.334120 13698 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:11.363605 12546 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:11.364749 13628 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:11.429971 13756 ts_tablet_manager.cc:933] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:11.432245 13757 ts_tablet_manager.cc:933] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:11.461521 13757 tablet_copy_client.cc:323] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.195:34641
I20260709 13:03:11.463363 12705 tablet_copy_service.cc:140] P 7ad68e814a7741488971822f2598183a: Received BeginTabletCopySession request for tablet 7c94183b9e8b46989e1da72e911d7aee from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:46988)
I20260709 13:03:11.463948 12705 tablet_copy_service.cc:161] P 7ad68e814a7741488971822f2598183a: Beginning new tablet copy session on tablet 7c94183b9e8b46989e1da72e911d7aee from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:46988: session id = 66750b8bbd4c4b3a9695951d0ede3372-7c94183b9e8b46989e1da72e911d7aee
I20260709 13:03:11.469882 13756 tablet_copy_client.cc:323] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.194:41653
I20260709 13:03:11.471697 12631 tablet_copy_service.cc:140] P a11816c5d72e4d1295a242f3ced09e5f: Received BeginTabletCopySession request for tablet f6ccc9457e2e4aeaac5163b9bb9f13cb from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:60170)
I20260709 13:03:11.472244 12631 tablet_copy_service.cc:161] P a11816c5d72e4d1295a242f3ced09e5f: Beginning new tablet copy session on tablet f6ccc9457e2e4aeaac5163b9bb9f13cb from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:60170: session id = 66750b8bbd4c4b3a9695951d0ede3372-f6ccc9457e2e4aeaac5163b9bb9f13cb
I20260709 13:03:11.473229 12705 tablet_copy_source_session.cc:215] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:11.478645 13757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c94183b9e8b46989e1da72e911d7aee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.479826 12631 tablet_copy_source_session.cc:215] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:11.486721 13756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f6ccc9457e2e4aeaac5163b9bb9f13cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.510466 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:11.523976 13756 tablet_copy_client.cc:806] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:11.524856 13756 tablet_copy_client.cc:670] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:11.526538 13757 tablet_copy_client.cc:806] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:11.527089 13757 tablet_copy_client.cc:670] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:11.529500 13756 tablet_copy_client.cc:538] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:11.543628 13756 tablet_bootstrap.cc:492] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:11.544962 13757 tablet_copy_client.cc:538] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:11.556519 13757 tablet_bootstrap.cc:492] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:11.571396 13756 tablet_bootstrap.cc:492] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:11.572396 13756 tablet_bootstrap.cc:492] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:11.573108 13756 ts_tablet_manager.cc:1403] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.008s
I20260709 13:03:11.576344 13756 raft_consensus.cc:359] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:11.577212 13756 raft_consensus.cc:740] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:11.577936 13756 consensus_queue.cc:260] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:11.579778 13756 ts_tablet_manager.cc:1434] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:03:11.583083 12631 tablet_copy_service.cc:342] P a11816c5d72e4d1295a242f3ced09e5f: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-f6ccc9457e2e4aeaac5163b9bb9f13cb received from {username='slave'} at 127.0.0.1:60170
I20260709 13:03:11.583499 12631 tablet_copy_service.cc:434] P a11816c5d72e4d1295a242f3ced09e5f: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-f6ccc9457e2e4aeaac5163b9bb9f13cb on tablet f6ccc9457e2e4aeaac5163b9bb9f13cb with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:11.586243 13756 ts_tablet_manager.cc:933] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:11.595830 13756 tablet_copy_client.cc:323] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.195:34641
I20260709 13:03:11.599175 12705 tablet_copy_service.cc:140] P 7ad68e814a7741488971822f2598183a: Received BeginTabletCopySession request for tablet f7bf456f0b724194a6e042403ee0b730 from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:46988)
I20260709 13:03:11.599759 12705 tablet_copy_service.cc:161] P 7ad68e814a7741488971822f2598183a: Beginning new tablet copy session on tablet f7bf456f0b724194a6e042403ee0b730 from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:46988: session id = 66750b8bbd4c4b3a9695951d0ede3372-f7bf456f0b724194a6e042403ee0b730
I20260709 13:03:11.605163 12689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d83186354414170b4775351916c56c2"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:11.605870 12689 raft_consensus.cc:606] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:11.608565 12689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4432abbae9994c048d249abe3143fa09"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:11.609074 12689 raft_consensus.cc:606] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:11.613737 12689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:11.614274 12689 raft_consensus.cc:606] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:11.625550 13757 tablet_bootstrap.cc:492] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:11.627100 13757 tablet_bootstrap.cc:492] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:11.627929 13757 ts_tablet_manager.cc:1403] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.072s	user 0.016s	sys 0.021s
I20260709 13:03:11.630805 13757 raft_consensus.cc:359] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:11.631683 13757 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:11.632572 13757 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:11.635702 13757 ts_tablet_manager.cc:1434] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:03:11.637861 12706 tablet_copy_service.cc:342] P 7ad68e814a7741488971822f2598183a: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-7c94183b9e8b46989e1da72e911d7aee received from {username='slave'} at 127.0.0.1:46988
I20260709 13:03:11.638260 12706 tablet_copy_service.cc:434] P 7ad68e814a7741488971822f2598183a: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-7c94183b9e8b46989e1da72e911d7aee on tablet 7c94183b9e8b46989e1da72e911d7aee with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:11.640667 13757 ts_tablet_manager.cc:933] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307)
I20260709 13:03:11.654343 12705 tablet_copy_source_session.cc:215] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:11.659457 13757 tablet_copy_client.cc:323] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.193:43307
I20260709 13:03:11.659999 13756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7bf456f0b724194a6e042403ee0b730. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.661182 12557 tablet_copy_service.cc:140] P a70479a3b4114f3581095e9890f5d653: Received BeginTabletCopySession request for tablet 22a877009d42412fb470ba88a418be05 from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:35624)
I20260709 13:03:11.661782 12557 tablet_copy_service.cc:161] P a70479a3b4114f3581095e9890f5d653: Beginning new tablet copy session on tablet 22a877009d42412fb470ba88a418be05 from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:35624: session id = 66750b8bbd4c4b3a9695951d0ede3372-22a877009d42412fb470ba88a418be05
I20260709 13:03:11.670920 12557 tablet_copy_source_session.cc:215] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:11.674276 13757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22a877009d42412fb470ba88a418be05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:11.678406 12615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
mode: GRACEFUL
new_leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:54242
I20260709 13:03:11.679013 12615 raft_consensus.cc:606] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Received request to transfer leadership to TS 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:11.679890 13517 raft_consensus.cc:993] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a: : Instructing follower 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:11.680328 13517 raft_consensus.cc:1081] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:11.682010 13234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4432abbae9994c048d249abe3143fa09"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:60962
I20260709 13:03:11.682619 12692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:11.682660 13234 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:11.683329 12692 raft_consensus.cc:606] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:03:11.683358 13234 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.691233 13757 tablet_copy_client.cc:806] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:11.691902 12692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:11.692127 13757 tablet_copy_client.cc:670] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:11.692466 12692 raft_consensus.cc:606] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:03:11.695597 13234 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:11.696535 13757 tablet_copy_client.cc:538] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:11.696636 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:11.698314 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:11.698405 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:11.698971 12539 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.700302 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:11.700830 12692 raft_consensus.cc:3055] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:11.701118 12692 raft_consensus.cc:740] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:11.701824 12692 consensus_queue.cc:260] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:11.702739 13756 tablet_copy_client.cc:806] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:11.703325 12692 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.703370 13756 tablet_copy_client.cc:670] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:11.704084 13234 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:11.708612 12539 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:11.710356 13756 tablet_copy_client.cc:538] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:11.714320 13200 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:11.715169 13697 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:11.715304 12692 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:11.715660 13697 raft_consensus.cc:697] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:11.716500 13697 consensus_queue.cc:237] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:11.718122 13757 tablet_bootstrap.cc:492] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:11.724889 13756 tablet_bootstrap.cc:492] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:11.731233 12442 catalog_manager.cc:5697] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 2 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:11.752566 13757 tablet_bootstrap.cc:492] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:11.753840 13757 tablet_bootstrap.cc:492] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:11.754724 13757 ts_tablet_manager.cc:1403] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.037s	user 0.021s	sys 0.010s
I20260709 13:03:11.758342 13629 raft_consensus.cc:993] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:11.758833 13629 raft_consensus.cc:1081] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:11.758299 13757 raft_consensus.cc:359] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:11.761706 13757 raft_consensus.cc:740] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:11.762324 13757 consensus_queue.cc:260] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:11.763823 12615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d83186354414170b4775351916c56c2"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:41084
I20260709 13:03:11.764367 12615 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:11.764712 12615 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.764750 13757 ts_tablet_manager.cc:1434] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:03:11.767143 12557 tablet_copy_service.cc:342] P a70479a3b4114f3581095e9890f5d653: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-22a877009d42412fb470ba88a418be05 received from {username='slave'} at 127.0.0.1:35624
I20260709 13:03:11.767575 12557 tablet_copy_service.cc:434] P a70479a3b4114f3581095e9890f5d653: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-22a877009d42412fb470ba88a418be05 on tablet 22a877009d42412fb470ba88a418be05 with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:11.785853 13756 tablet_bootstrap.cc:492] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:11.785528 12615 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:11.786801 13756 tablet_bootstrap.cc:492] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:11.787475 13756 ts_tablet_manager.cc:1403] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.024s
I20260709 13:03:11.788269 12615 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:11.790381 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:11.790934 12689 raft_consensus.cc:3055] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:11.791226 12689 raft_consensus.cc:740] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:11.791117 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:11.791811 12539 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.792045 12689 consensus_queue.cc:260] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:11.793267 12689 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.800022 12689 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:11.790342 13756 raft_consensus.cc:359] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:11.801466 13756 raft_consensus.cc:740] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:11.803930 12587 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:11.806155 13685 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:11.806805 13685 raft_consensus.cc:697] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:11.802146 13756 consensus_queue.cc:260] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:11.808012 13685 consensus_queue.cc:237] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:11.811672 13756 ts_tablet_manager.cc:1434] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 13:03:11.819685 12705 tablet_copy_service.cc:342] P 7ad68e814a7741488971822f2598183a: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-f7bf456f0b724194a6e042403ee0b730 received from {username='slave'} at 127.0.0.1:46988
I20260709 13:03:11.820175 12705 tablet_copy_service.cc:434] P 7ad68e814a7741488971822f2598183a: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-f7bf456f0b724194a6e042403ee0b730 on tablet f7bf456f0b724194a6e042403ee0b730 with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:11.829165 12539 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:11.853586 12444 catalog_manager.cc:5697] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 2 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:11.850181 13234 raft_consensus.cc:1217] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:11.908710 13234 raft_consensus.cc:1217] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:11.954149 13629 raft_consensus.cc:993] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:11.954661 13517 raft_consensus.cc:1081] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:11.957607 12615 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:41084
I20260709 13:03:11.959192 12615 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:11.959650 12615 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.964924 12615 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:11.966984 12615 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:11.967532 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:11.968118 12688 raft_consensus.cc:3055] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:11.968410 12688 raft_consensus.cc:740] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:11.969108 12688 consensus_queue.cc:260] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:11.970182 12688 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.971626 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:11.972551 12539 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.987526 12539 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:11.992519 12588 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:11.993781 13728 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:11.994338 13728 raft_consensus.cc:697] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:11.994837 12688 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:11.995271 13728 consensus_queue.cc:237] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:12.010407 12445 catalog_manager.cc:5697] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 2 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:12.051435 13628 raft_consensus.cc:993] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f: : Instructing follower 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:12.051870 13628 raft_consensus.cc:1081] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Signalling peer 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:12.054220 13234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:57404
I20260709 13:03:12.054719 13234 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:12.055032 13234 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.065491 13234 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:12.067845 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:12.068074 13234 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:12.068619 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:12.069192 12615 raft_consensus.cc:3055] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:12.068418 12539 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.069491 12615 raft_consensus.cc:740] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:12.070272 12615 consensus_queue.cc:260] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:12.071261 12615 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.075253 12539 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:12.076509 13200 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:12.077211 13697 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:12.077734 13697 raft_consensus.cc:697] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:12.077996 12615 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:12.078510 13697 consensus_queue.cc:237] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:12.082304 13234 raft_consensus.cc:1217] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:12.097256 12444 catalog_manager.cc:5697] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 1 to 2, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 2 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:12.129822 13629 raft_consensus.cc:993] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a: : Instructing follower a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:03:12.130348 13774 raft_consensus.cc:1081] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:03:12.131879 12546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9"
dest_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:42458
I20260709 13:03:12.132438 12546 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:12.132766 12546 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.137753 12546 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:12.139904 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:12.139962 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:12.140304 12615 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.140601 12688 raft_consensus.cc:3055] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:12.140967 12688 raft_consensus.cc:740] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:12.141959 12546 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:12.141768 12688 consensus_queue.cc:260] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:12.143111 12688 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.149324 12615 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:12.150275 12510 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:12.150429 12688 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:12.150959 13688 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:12.151414 13688 raft_consensus.cc:697] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:12.152453 13688 consensus_queue.cc:237] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:12.164743 12444 catalog_manager.cc:5697] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:12.167198 12546 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:12.169540 13697 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:12.175879 12688 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:12.178275 13697 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:12.188306 13234 raft_consensus.cc:1217] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:12.197023 13629 raft_consensus.cc:993] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a: : Instructing follower a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:03:12.197731 13774 raft_consensus.cc:1081] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:03:12.204182 12546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0"
dest_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:42458
I20260709 13:03:12.204730 12546 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:12.205071 12546 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.220244 12546 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:12.226092 12546 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:12.226257 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:12.226868 12615 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.228528 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:12.229140 12688 raft_consensus.cc:3055] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:12.229869 12688 raft_consensus.cc:740] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:12.230794 12688 consensus_queue.cc:260] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:12.233744 12688 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:12.235610 12615 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:12.236832 12510 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:12.237792 13688 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:12.238235 13688 raft_consensus.cc:697] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:12.239037 13688 consensus_queue.cc:237] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:12.252188 12688 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:12.273411 12539 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:12.275061 13728 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:12.278157 12444 catalog_manager.cc:5697] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:12.336789 12688 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:12.341526 13755 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:12.356971 13517 raft_consensus.cc:1064] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:12.359649 13517 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:12.412132 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 119430us
I20260709 13:03:12.418777 12620 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:12.422788 13517 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:12.424060 13755 raft_consensus.cc:1064] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:12.425347 12540 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:12.427512 13774 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:12.431509 13234 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:12.431622 13755 consensus_queue.cc:237] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:12.433089 13774 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:12.446326 13678 raft_consensus.cc:2955] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:12.450838 12688 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:12.450198 12615 raft_consensus.cc:2955] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:12.458655 13628 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:12.458499 13234 raft_consensus.cc:2955] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:12.468695 12689 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:12.470038 13233 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:12.471143 13628 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:12.482599 13685 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:12.487717 12546 raft_consensus.cc:2955] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:12.493925 12445 catalog_manager.cc:5697] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:12.501910 12540 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:12.508046 13728 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:12.512190 12540 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:12.530618 13755 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:12.537918 13775 raft_consensus.cc:1064] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:12.560962 12688 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:12.540827 13775 consensus_queue.cc:237] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:12.583648 13233 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:12.584817 12615 raft_consensus.cc:1275] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:12.587505 12540 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:12.587293 13774 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:12.591166 13233 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:12.592697 13745 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:12.593868 13688 consensus_queue.cc:1048] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:12.593657 13728 raft_consensus.cc:2955] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:12.597637 12617 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:12.598695 13678 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:12.600584 13234 raft_consensus.cc:2955] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:12.606797 12688 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:12.611009 12547 raft_consensus.cc:2955] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:12.612529 13711 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:12.615335 12444 catalog_manager.cc:5697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:12.619495 13629 raft_consensus.cc:2955] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:12.623688 13711 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:12.626116 13678 raft_consensus.cc:1064] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:12.631451 13678 consensus_queue.cc:237] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:12.641458 13235 raft_consensus.cc:2955] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:12.647719 12617 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:12.653761 13697 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:12.680264 12547 raft_consensus.cc:2955] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:12.682991 12431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7c94183b9e8b46989e1da72e911d7aee with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:12.696386 12547 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:03:12.714845 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 54587.4us
I20260709 13:03:12.714928 13697 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:12.682379 12688 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:12.714241 12689 raft_consensus.cc:2955] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:12.725922 13688 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:12.728785 12688 raft_consensus.cc:1275] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:12.730345 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:12.735828 12615 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:12.748165 13235 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:12.769197 12615 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:12.775630 12442 catalog_manager.cc:5697] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:12.779974 13808 log.cc:927] Time spent T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.003s
W20260709 13:03:12.787984 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 53312.9us
I20260709 13:03:12.788303 13815 consensus_queue.cc:1048] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:03:12.799489 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 60761.7us
I20260709 13:03:12.802954 13745 raft_consensus.cc:2955] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:12.814018 13711 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:12.804180 13810 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:03:12.836481 13517 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:12.851908 13233 raft_consensus.cc:2955] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:03:12.940351 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 138643us
I20260709 13:03:12.953634 12604 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c94183b9e8b46989e1da72e911d7aee with delete_type TABLET_DATA_TOMBSTONED (TS a11816c5d72e4d1295a242f3ced09e5f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41074
I20260709 13:03:12.965346 12619 raft_consensus.cc:2955] T 22a877009d42412fb470ba88a418be05 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:13.030866 12689 raft_consensus.cc:2955] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:13.090595 13827 tablet_replica.cc:333] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:03:13.087633 13517 raft_consensus.cc:2955] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:13.113925 13827 raft_consensus.cc:2243] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.115491 13827 raft_consensus.cc:2272] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.096623 12622 consensus_queue.cc:237] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:13.114029 13235 raft_consensus.cc:2955] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:13.150254 12441 catalog_manager.cc:5697] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:13.186493 12615 raft_consensus.cc:2955] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:13.212424 12540 consensus_queue.cc:237] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:13.200258 13232 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:13.220222 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:13.225782 13827 ts_tablet_manager.cc:1916] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:13.242359 13797 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:03:13.250590 12445 catalog_manager.cc:5697] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:13.251863 13728 raft_consensus.cc:2955] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:13.271342 13232 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:13.267716 13235 raft_consensus.cc:2955] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:13.275363 13828 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:03:13.287923 12691 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:13.296360 13711 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:03:13.303884 12540 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:13.317050 12540 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:13.333938 13826 raft_consensus.cc:2955] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:13.344444 12445 catalog_manager.cc:5697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:13.340557 13235 raft_consensus.cc:2955] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:03:13.363323 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.371317 12688 raft_consensus.cc:2955] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:13.386459 12429 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f6ccc9457e2e4aeaac5163b9bb9f13cb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:13.393852 12682 tablet_service.cc:1558] Processing DeleteTablet for tablet f6ccc9457e2e4aeaac5163b9bb9f13cb with delete_type TABLET_DATA_TOMBSTONED (TS 7ad68e814a7741488971822f2598183a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37280
I20260709 13:03:13.396956 13728 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:03:13.404408 12445 catalog_manager.cc:5697] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:13.412886 12692 consensus_queue.cc:237] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:13.428406 12622 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:03:13.434247 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:13.435230 13517 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:13.437466 13235 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:13.447212 12604 tablet_service.cc:1558] Processing DeleteTablet for tablet 22a877009d42412fb470ba88a418be05 with delete_type TABLET_DATA_TOMBSTONED (TS a11816c5d72e4d1295a242f3ced09e5f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41074
I20260709 13:03:13.455749 12432 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 22a877009d42412fb470ba88a418be05 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:13.458730 13629 raft_consensus.cc:2955] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:13.478962 13517 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:13.476364 12617 raft_consensus.cc:2955] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:13.497995 13834 tablet_replica.cc:333] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:03:13.499557 13834 raft_consensus.cc:2243] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.528148 13834 raft_consensus.cc:2272] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.544476 13235 raft_consensus.cc:2955] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:13.551622 12431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f7bf456f0b724194a6e042403ee0b730 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:13.555757 12540 raft_consensus.cc:2955] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:13.580528 13834 ts_tablet_manager.cc:1916] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 7ad68e814a7741488971822f2598183a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:13.604485 13827 ts_tablet_manager.cc:1929] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:13.605080 13827 log.cc:1199] T 7c94183b9e8b46989e1da72e911d7aee P a11816c5d72e4d1295a242f3ced09e5f: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-1-root/wals/7c94183b9e8b46989e1da72e911d7aee
I20260709 13:03:13.607712 12429 catalog_manager.cc:5028] TS a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): tablet 7c94183b9e8b46989e1da72e911d7aee (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:13.612403 13827 tablet_replica.cc:333] T 22a877009d42412fb470ba88a418be05 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:03:13.613585 13827 raft_consensus.cc:2243] T 22a877009d42412fb470ba88a418be05 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.619297 13827 raft_consensus.cc:2272] T 22a877009d42412fb470ba88a418be05 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.638573 13827 ts_tablet_manager.cc:1916] T 22a877009d42412fb470ba88a418be05 P a11816c5d72e4d1295a242f3ced09e5f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:13.638711 12443 catalog_manager.cc:5697] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:13.682906 12531 tablet_service.cc:1558] Processing DeleteTablet for tablet f7bf456f0b724194a6e042403ee0b730 with delete_type TABLET_DATA_TOMBSTONED (TS a70479a3b4114f3581095e9890f5d653 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42444
I20260709 13:03:13.691870 13834 ts_tablet_manager.cc:1929] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 7ad68e814a7741488971822f2598183a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:13.692502 13834 log.cc:1199] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 7ad68e814a7741488971822f2598183a: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-2-root/wals/f6ccc9457e2e4aeaac5163b9bb9f13cb
I20260709 13:03:13.692945 12546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc"
dest_uuid: "a70479a3b4114f3581095e9890f5d653"
mode: GRACEFUL
new_leader_uuid: "7ad68e814a7741488971822f2598183a"
 from {username='slave'} at 127.0.0.1:51504
I20260709 13:03:13.693724 12546 raft_consensus.cc:606] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Received request to transfer leadership to TS 7ad68e814a7741488971822f2598183a
I20260709 13:03:13.695643 12431 catalog_manager.cc:5028] TS 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): tablet f6ccc9457e2e4aeaac5163b9bb9f13cb (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:13.696964 12692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:13.697690 12692 raft_consensus.cc:606] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:13.700953 12617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
mode: GRACEFUL
new_leader_uuid: "7ad68e814a7741488971822f2598183a"
 from {username='slave'} at 127.0.0.1:54242
I20260709 13:03:13.701592 12617 raft_consensus.cc:606] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Received request to transfer leadership to TS 7ad68e814a7741488971822f2598183a
I20260709 13:03:13.703922 13827 ts_tablet_manager.cc:1929] T 22a877009d42412fb470ba88a418be05 P a11816c5d72e4d1295a242f3ced09e5f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:13.705292 12692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:13.705816 13827 log.cc:1199] T 22a877009d42412fb470ba88a418be05 P a11816c5d72e4d1295a242f3ced09e5f: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-1-root/wals/22a877009d42412fb470ba88a418be05
I20260709 13:03:13.705919 12692 raft_consensus.cc:606] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:13.708263 12429 catalog_manager.cc:5028] TS a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): tablet 22a877009d42412fb470ba88a418be05 (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:13.709398 13839 tablet_replica.cc:333] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:03:13.709465 12692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e64b5865b31f48158abb124846961f72"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:13.710567 12692 raft_consensus.cc:606] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:03:13.711098 13839 raft_consensus.cc:2243] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.712633 13839 raft_consensus.cc:2272] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.713124 12692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:13.713742 12692 raft_consensus.cc:606] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:13.715109 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:03:13.715663 13839 ts_tablet_manager.cc:1916] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:13.716807 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:13.728773 13839 ts_tablet_manager.cc:1929] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20260709 13:03:13.729177 13839 log.cc:1199] T f7bf456f0b724194a6e042403ee0b730 P a70479a3b4114f3581095e9890f5d653: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-0-root/wals/f7bf456f0b724194a6e042403ee0b730
I20260709 13:03:13.731401 12432 catalog_manager.cc:5028] TS a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): tablet f7bf456f0b724194a6e042403ee0b730 (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:13.801141 13816 raft_consensus.cc:993] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a: : Instructing follower 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:13.801949 13816 raft_consensus.cc:1081] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:13.803565 13235 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:60962
I20260709 13:03:13.804190 13235 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:13.804514 13235 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:13.809695 13235 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:13.813023 13235 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:13.813169 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:13.813897 12540 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:13.814317 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:13.814901 12688 raft_consensus.cc:3055] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:13.815210 12688 raft_consensus.cc:740] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:13.816110 12688 consensus_queue.cc:260] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:13.817483 12688 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:13.819506 12540 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:13.820641 13200 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:13.821679 13651 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:13.822104 13651 raft_consensus.cc:697] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:13.822849 13651 consensus_queue.cc:237] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:13.823827 12688 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:13.831962 12441 catalog_manager.cc:5697] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 2 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:13.857208 13811 raft_consensus.cc:993] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a: : Instructing follower 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:13.857753 13816 raft_consensus.cc:1081] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:13.859198 13235 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:60962
I20260709 13:03:13.859715 13235 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:13.860060 13235 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:13.866004 13235 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:13.867871 13235 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:13.869249 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:13.869426 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:13.869810 12688 raft_consensus.cc:3055] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:13.870142 12617 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:13.870146 12688 raft_consensus.cc:740] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:13.871258 12688 consensus_queue.cc:260] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:13.872375 12688 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:13.877831 12617 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:13.878722 12688 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:13.880419 13811 raft_consensus.cc:993] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a: : Instructing follower a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:03:13.880864 13811 raft_consensus.cc:1081] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:03:13.879232 13197 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:13.881927 13651 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:13.882404 13651 raft_consensus.cc:697] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:13.883363 13651 consensus_queue.cc:237] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:13.884811 12540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e64b5865b31f48158abb124846961f72"
dest_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:42458
I20260709 13:03:13.885383 12540 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:13.885784 12540 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:13.901546 12540 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:13.906025 12540 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:13.906517 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:13.907123 12692 raft_consensus.cc:3055] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:13.907434 12692 raft_consensus.cc:740] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:13.908237 12692 consensus_queue.cc:260] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:13.909231 12692 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:13.910102 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:13.910715 12617 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:13.921113 12617 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:13.921236 12692 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:13.922032 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:13.922859 13828 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:13.923309 13828 raft_consensus.cc:697] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:13.924021 13828 consensus_queue.cc:237] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:13.930162 12441 catalog_manager.cc:5697] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 2 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:13.934020 12445 catalog_manager.cc:5697] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:13.957453 13685 raft_consensus.cc:993] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f: : Instructing follower 7ad68e814a7741488971822f2598183a to start an election
I20260709 13:03:13.958005 13685 raft_consensus.cc:1081] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Signalling peer 7ad68e814a7741488971822f2598183a to start an election
I20260709 13:03:13.960378 12692 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f"
dest_uuid: "7ad68e814a7741488971822f2598183a"
 from {username='slave'} at 127.0.0.1:37292
I20260709 13:03:13.960887 12692 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:13.961215 12692 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:13.963562 13835 raft_consensus.cc:993] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: : Instructing follower 7ad68e814a7741488971822f2598183a to start an election
I20260709 13:03:13.964118 13835 raft_consensus.cc:1081] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Signalling peer 7ad68e814a7741488971822f2598183a to start an election
I20260709 13:03:13.965755 12688 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc"
dest_uuid: "7ad68e814a7741488971822f2598183a"
 from {username='slave'} at 127.0.0.1:37308
I20260709 13:03:13.967453 12688 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:13.967789 12688 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:13.969753 12692 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:13.971230 12692 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:13.972105 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:13.972631 12619 raft_consensus.cc:3055] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:13.972723 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:13.972935 12619 raft_consensus.cc:740] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:13.973318 12540 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:13.973671 12619 consensus_queue.cc:260] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:13.974843 12619 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:13.975200 12688 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:13.977494 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:13.977803 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:13.978031 12538 raft_consensus.cc:3055] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:13.978308 12538 raft_consensus.cc:740] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:13.978339 12617 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:13.979271 12538 consensus_queue.cc:260] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:13.980628 12538 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:13.980857 12619 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:13.982131 12659 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:13.982826 13811 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:13.983292 13811 raft_consensus.cc:697] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:13.983677 12540 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:13.984133 13811 consensus_queue.cc:237] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:13.985265 12688 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:13.986807 12617 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:13.987915 12659 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:13.988612 13816 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:13.989069 13816 raft_consensus.cc:697] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 2 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:13.989280 12538 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:13.990053 13816 consensus_queue.cc:237] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:13.996659 12445 catalog_manager.cc:5697] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 2 to 3, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 3 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:14.012256 12445 catalog_manager.cc:5697] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 1 to 2, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 2 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:14.079483 13811 raft_consensus.cc:993] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: : Instructing follower 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:14.079991 13816 raft_consensus.cc:1081] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:14.081827 13232 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:60962
I20260709 13:03:14.082386 13232 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:14.082751 13232 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:14.088179 13232 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:14.090299 13232 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:14.090975 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:14.091243 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:14.091537 12617 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:14.091867 12688 raft_consensus.cc:3055] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:14.092167 12688 raft_consensus.cc:740] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:14.092763 12688 consensus_queue.cc:260] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:14.093830 12688 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:14.096289 12617 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:14.097309 13197 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:14.098253 13651 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:14.098752 13651 raft_consensus.cc:697] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:14.100795 12688 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:14.099650 13651 consensus_queue.cc:237] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:14.111732 12445 catalog_manager.cc:5697] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 2 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:14.283468 12688 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:14.284703 13651 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:14.287356 12540 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:14.288570 13651 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:14.296856 12619 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:14.298337 13819 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:14.308709 12692 raft_consensus.cc:1275] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:14.311156 13837 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:14.374148 12619 raft_consensus.cc:1275] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:14.377310 13837 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:14.397902 12540 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:14.409626 13816 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:03:14.449874 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 112828us
I20260709 13:03:14.455327 12546 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:14.459106 13811 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:03:14.460947 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 132414us
I20260709 13:03:14.478281 12619 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:14.480875 13811 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:14.492450 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 161425us
I20260709 13:03:14.497660 12688 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:14.500660 13857 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:14.558322 12620 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:14.565634 13810 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:14.582980 12620 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:14.584506 13852 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:14.593290 12688 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:14.596166 13852 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:14.717862 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:14.745750 12540 consensus_queue.cc:237] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
W20260709 13:03:14.759153 12513 consensus_peers.cc:597] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0767462f04d344b5a4fce9de7e885245. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:14.759790 12688 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:14.761410 12619 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:14.761410 13856 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:14.763767 13856 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:14.774920 13837 raft_consensus.cc:2955] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:14.776624 12619 raft_consensus.cc:2955] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:14.777195 12691 raft_consensus.cc:2955] T 0767462f04d344b5a4fce9de7e885245 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:14.779557 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:14.795464 12443 catalog_manager.cc:5697] T 0767462f04d344b5a4fce9de7e885245 P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:14.808384 12691 consensus_queue.cc:237] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
W20260709 13:03:14.833742 12662 consensus_peers.cc:597] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44ad8138d0594c32b4590c837a41891e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:14.838121 12615 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:14.839699 13811 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:14.842069 12546 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:14.847713 13816 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:14.851910 13810 raft_consensus.cc:2955] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:14.859920 12540 raft_consensus.cc:2955] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:14.870762 12620 consensus_queue.cc:237] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:14.870343 12615 raft_consensus.cc:2955] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:14.905772 12688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:14.906379 12688 raft_consensus.cc:606] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:14.909179 12617 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd40576623a84072be59a32d23cda14b"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
mode: GRACEFUL
new_leader_uuid: "7ad68e814a7741488971822f2598183a"
 from {username='slave'} at 127.0.0.1:54242
I20260709 13:03:14.909762 12617 raft_consensus.cc:606] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Received request to transfer leadership to TS 7ad68e814a7741488971822f2598183a
I20260709 13:03:14.914937 12546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f"
dest_uuid: "a70479a3b4114f3581095e9890f5d653"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:51504
I20260709 13:03:14.915516 12546 raft_consensus.cc:606] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:14.917661 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:03:14.919265 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:14.920315 12441 catalog_manager.cc:5697] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
W20260709 13:03:14.944998 12588 consensus_peers.cc:597] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d83186354414170b4775351916c56c2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:14.948377 12688 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:03:14.950497 13797 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:14.953590 12546 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:03:14.956962 13797 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:03:14.978118 13797 raft_consensus.cc:2955] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:14.983012 12546 raft_consensus.cc:2955] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
W20260709 13:03:15.001631 12493 auto_rebalancer.cc:629] Failed to schedule move for tablet fb1007aec88948499b3c20c4e58bba2f: Remote error: Service unavailable: leader transfer in progress
I20260709 13:03:15.000860 12688 raft_consensus.cc:2955] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:15.003162 12443 catalog_manager.cc:5697] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index -1 to 3, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 2 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:15.019152 13797 raft_consensus.cc:993] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f: : Instructing follower 7ad68e814a7741488971822f2598183a to start an election
I20260709 13:03:15.019778 13797 raft_consensus.cc:1081] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Signalling peer 7ad68e814a7741488971822f2598183a to start an election
I20260709 13:03:15.021203 12692 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd40576623a84072be59a32d23cda14b"
dest_uuid: "7ad68e814a7741488971822f2598183a"
 from {username='slave'} at 127.0.0.1:37292
I20260709 13:03:15.021744 12692 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:15.022063 12692 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:15.046221 12692 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:15.048556 12692 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:15.051518 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:15.052186 13232 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:15.058362 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:15.059139 12615 raft_consensus.cc:3055] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:15.059444 12615 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:15.060392 13232 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:15.060281 12615 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:15.061610 12615 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:15.061712 12662 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:15.062603 13878 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:15.063138 13878 raft_consensus.cc:697] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 2 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:15.064019 13878 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:15.068392 12615 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:15.085078 12442 catalog_manager.cc:5697] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 1 to 2, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 2 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:15.168438 13885 ts_tablet_manager.cc:933] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307)
I20260709 13:03:15.170394 13885 tablet_copy_client.cc:323] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.193:43307
I20260709 13:03:15.172049 12557 tablet_copy_service.cc:140] P a70479a3b4114f3581095e9890f5d653: Received BeginTabletCopySession request for tablet 0767462f04d344b5a4fce9de7e885245 from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:35624)
I20260709 13:03:15.172544 12557 tablet_copy_service.cc:161] P a70479a3b4114f3581095e9890f5d653: Beginning new tablet copy session on tablet 0767462f04d344b5a4fce9de7e885245 from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:35624: session id = 66750b8bbd4c4b3a9695951d0ede3372-0767462f04d344b5a4fce9de7e885245
I20260709 13:03:15.179432 12557 tablet_copy_source_session.cc:215] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:15.184521 13885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0767462f04d344b5a4fce9de7e885245. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.202600 13885 tablet_copy_client.cc:806] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:15.204208 13885 tablet_copy_client.cc:670] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:15.208379 13885 tablet_copy_client.cc:538] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:15.216322 13885 tablet_bootstrap.cc:492] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:15.234254 13885 tablet_bootstrap.cc:492] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:15.235193 13885 tablet_bootstrap.cc:492] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:15.235896 13885 ts_tablet_manager.cc:1403] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.004s
I20260709 13:03:15.238328 13885 raft_consensus.cc:359] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:15.239017 13885 raft_consensus.cc:740] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:15.239531 13885 consensus_queue.cc:260] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:15.242584 13885 ts_tablet_manager.cc:1434] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.008s
I20260709 13:03:15.244923 12557 tablet_copy_service.cc:342] P a70479a3b4114f3581095e9890f5d653: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-0767462f04d344b5a4fce9de7e885245 received from {username='slave'} at 127.0.0.1:35624
I20260709 13:03:15.245414 12557 tablet_copy_service.cc:434] P a70479a3b4114f3581095e9890f5d653: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-0767462f04d344b5a4fce9de7e885245 on tablet 0767462f04d344b5a4fce9de7e885245 with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:15.278218 13885 ts_tablet_manager.cc:933] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:15.281127 13885 tablet_copy_client.cc:323] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.195:34641
I20260709 13:03:15.283326 12705 tablet_copy_service.cc:140] P 7ad68e814a7741488971822f2598183a: Received BeginTabletCopySession request for tablet 44ad8138d0594c32b4590c837a41891e from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:46988)
I20260709 13:03:15.283954 12705 tablet_copy_service.cc:161] P 7ad68e814a7741488971822f2598183a: Beginning new tablet copy session on tablet 44ad8138d0594c32b4590c837a41891e from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:46988: session id = 66750b8bbd4c4b3a9695951d0ede3372-44ad8138d0594c32b4590c837a41891e
I20260709 13:03:15.286141 13816 raft_consensus.cc:993] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a: : Instructing follower 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:15.286785 13816 raft_consensus.cc:1081] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:15.288738 13232 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:60962
I20260709 13:03:15.289783 13232 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:15.292006 13232 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:15.295949 12705 tablet_copy_source_session.cc:215] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:15.298916 13232 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:15.300264 13885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44ad8138d0594c32b4590c837a41891e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.303431 13232 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:15.304405 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:15.314352 12688 raft_consensus.cc:3055] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:15.314803 12688 raft_consensus.cc:740] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:15.315663 12688 consensus_queue.cc:260] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:15.316871 12688 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:15.306731 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:15.317842 12546 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:15.325471 13885 tablet_copy_client.cc:806] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:15.326368 13885 tablet_copy_client.cc:670] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:15.328683 12546 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:15.330735 13200 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:15.331614 13854 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:15.332162 13854 raft_consensus.cc:697] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:15.333141 13854 consensus_queue.cc:237] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:15.337285 12688 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:15.331171 13885 tablet_copy_client.cc:538] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:15.362382 13885 tablet_bootstrap.cc:492] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:15.390930 12442 catalog_manager.cc:5697] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 2 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:15.410915 13828 raft_consensus.cc:993] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:15.411527 13837 raft_consensus.cc:1081] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:15.414340 12620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:41086
I20260709 13:03:15.414934 12620 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:15.415303 12620 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:15.417146 13890 ts_tablet_manager.cc:933] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:15.426630 13890 tablet_copy_client.cc:323] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.194:41653
I20260709 13:03:15.428849 12631 tablet_copy_service.cc:140] P a11816c5d72e4d1295a242f3ced09e5f: Received BeginTabletCopySession request for tablet 1d83186354414170b4775351916c56c2 from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:60170)
I20260709 13:03:15.429530 12631 tablet_copy_service.cc:161] P a11816c5d72e4d1295a242f3ced09e5f: Beginning new tablet copy session on tablet 1d83186354414170b4775351916c56c2 from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:60170: session id = 66750b8bbd4c4b3a9695951d0ede3372-1d83186354414170b4775351916c56c2
I20260709 13:03:15.443338 12620 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:15.446059 12620 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:15.447085 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:15.447487 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:15.447651 12546 raft_consensus.cc:3055] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:15.448077 12546 raft_consensus.cc:740] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:15.448101 12688 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:15.448918 12546 consensus_queue.cc:260] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:15.449828 12631 tablet_copy_source_session.cc:215] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:15.450155 12546 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:15.453639 13890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d83186354414170b4775351916c56c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:15.457947 12546 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:15.459721 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:15.460901 13797 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:15.461364 13797 raft_consensus.cc:697] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:15.462270 13797 consensus_queue.cc:237] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:15.465721 13885 tablet_bootstrap.cc:492] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:15.466732 13885 tablet_bootstrap.cc:492] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:15.467394 13885 ts_tablet_manager.cc:1403] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.115s	user 0.036s	sys 0.049s
I20260709 13:03:15.471419 13885 raft_consensus.cc:359] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:15.472512 13885 raft_consensus.cc:740] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:15.473196 13885 consensus_queue.cc:260] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:15.479043 13885 ts_tablet_manager.cc:1434] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:03:15.480883 12705 tablet_copy_service.cc:342] P 7ad68e814a7741488971822f2598183a: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-44ad8138d0594c32b4590c837a41891e received from {username='slave'} at 127.0.0.1:46988
I20260709 13:03:15.481359 12705 tablet_copy_service.cc:434] P 7ad68e814a7741488971822f2598183a: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-44ad8138d0594c32b4590c837a41891e on tablet 44ad8138d0594c32b4590c837a41891e with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:15.484378 13890 tablet_copy_client.cc:806] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:15.485031 13890 tablet_copy_client.cc:670] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:15.459836 12688 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:15.500594 13890 tablet_copy_client.cc:538] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:15.505468 12445 catalog_manager.cc:5697] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 1 to 2, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 2 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:15.511620 13890 tablet_bootstrap.cc:492] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:15.514552 12620 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:15.518704 13878 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:15.557451 13890 tablet_bootstrap.cc:492] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:15.558432 13890 tablet_bootstrap.cc:492] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:15.559753 13890 ts_tablet_manager.cc:1403] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.048s	user 0.026s	sys 0.014s
I20260709 13:03:15.563390 13890 raft_consensus.cc:359] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:15.564311 13890 raft_consensus.cc:740] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:15.564960 13890 consensus_queue.cc:260] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:15.572242 13890 ts_tablet_manager.cc:1434] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:03:15.573738 12631 tablet_copy_service.cc:342] P a11816c5d72e4d1295a242f3ced09e5f: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-1d83186354414170b4775351916c56c2 received from {username='slave'} at 127.0.0.1:60170
I20260709 13:03:15.574183 12631 tablet_copy_service.cc:434] P a11816c5d72e4d1295a242f3ced09e5f: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-1d83186354414170b4775351916c56c2 on tablet 1d83186354414170b4775351916c56c2 with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:15.588289 13235 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:15.594046 13816 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:15.684075 13232 raft_consensus.cc:1217] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:15.888909 12691 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:15.890758 13854 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:15.900190 13232 raft_consensus.cc:1217] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:15.918068 12540 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:15.919822 13651 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:15.920219 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:15.969117 13232 raft_consensus.cc:1217] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:03:16.039604 12540 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:16.109172 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:16.184466 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 73340.4us
I20260709 13:03:16.187973 13797 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:16.188942 12691 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:16.199277 13797 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:16.222483 13856 raft_consensus.cc:1064] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:16.225419 13856 consensus_queue.cc:237] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:16.287371 13235 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:16.290612 13914 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:16.338547 12691 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:03:16.341271 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 153970us
I20260709 13:03:16.371203 12615 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:16.379695 12688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:16.380275 12688 raft_consensus.cc:606] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:16.387059 12546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22a877009d42412fb470ba88a418be05"
dest_uuid: "a70479a3b4114f3581095e9890f5d653"
mode: GRACEFUL
new_leader_uuid: "7ad68e814a7741488971822f2598183a"
 from {username='slave'} at 127.0.0.1:51504
I20260709 13:03:16.387635 12546 raft_consensus.cc:606] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Received request to transfer leadership to TS 7ad68e814a7741488971822f2598183a
I20260709 13:03:16.388979 13828 raft_consensus.cc:993] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: : Instructing follower 7ad68e814a7741488971822f2598183a to start an election
I20260709 13:03:16.389412 13910 raft_consensus.cc:1081] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Signalling peer 7ad68e814a7741488971822f2598183a to start an election
W20260709 13:03:16.391515 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 232304us
I20260709 13:03:16.393018 13910 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:16.396072 13902 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:16.406440 12688 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:16.408818 12689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22a877009d42412fb470ba88a418be05"
dest_uuid: "7ad68e814a7741488971822f2598183a"
 from {username='slave'} at 127.0.0.1:37308
I20260709 13:03:16.409355 12689 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:16.409677 12689 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:16.407121 12688 raft_consensus.cc:606] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:03:16.415117 13919 raft_consensus.cc:1064] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:16.421502 13810 raft_consensus.cc:993] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: : Instructing follower a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:03:16.422511 13810 raft_consensus.cc:1081] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:03:16.428562 12689 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:16.428768 12620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
mode: GRACEFUL
new_leader_uuid: "7ad68e814a7741488971822f2598183a"
 from {username='slave'} at 127.0.0.1:54242
I20260709 13:03:16.429329 12620 raft_consensus.cc:606] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Received request to transfer leadership to TS 7ad68e814a7741488971822f2598183a
I20260709 13:03:16.432708 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:03:16.429603 13919 consensus_queue.cc:237] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:16.435169 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:16.435375 13899 raft_consensus.cc:1064] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
W20260709 13:03:16.437134 13899 raft_consensus.cc:1068] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: Unable to promote non-voter 66750b8bbd4c4b3a9695951d0ede3372: Service unavailable: leader transfer in progress
I20260709 13:03:16.438002 12539 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e"
dest_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:42458
I20260709 13:03:16.439210 12539 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:16.439939 12539 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:16.445240 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:16.445856 13235 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:16.445988 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:16.446568 12538 raft_consensus.cc:3055] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:16.446838 12538 raft_consensus.cc:740] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:16.447638 12538 consensus_queue.cc:260] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:16.448487 12538 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:16.452298 13235 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:16.454147 12538 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:16.435858 12689 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:16.455797 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:16.467955 13899 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:16.469199 13899 raft_consensus.cc:697] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 2 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:16.470180 13899 consensus_queue.cc:237] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:16.477916 13902 raft_consensus.cc:2955] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:16.485342 12691 raft_consensus.cc:2955] T 0767462f04d344b5a4fce9de7e885245 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:16.506855 13235 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEARNER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:03:16.508669 13908 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:16.519677 12538 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:03:16.519549 12620 raft_consensus.cc:2955] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:16.527962 12539 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:16.530174 12539 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:16.532563 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:16.533145 12689 raft_consensus.cc:3055] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:16.533416 12689 raft_consensus.cc:740] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:16.534250 12689 consensus_queue.cc:260] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:16.535666 12689 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:16.536041 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:16.536626 12622 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:16.538674 13882 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:16.520200 13233 raft_consensus.cc:2955] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:16.543375 12691 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:03:16.543753 13908 raft_consensus.cc:993] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f: : Instructing follower 7ad68e814a7741488971822f2598183a to start an election
I20260709 13:03:16.544317 13908 raft_consensus.cc:1081] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Signalling peer 7ad68e814a7741488971822f2598183a to start an election
I20260709 13:03:16.546657 13882 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:16.547964 12442 catalog_manager.cc:5697] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:16.553470 13918 raft_consensus.cc:993] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:16.554061 13918 raft_consensus.cc:1081] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:16.557302 12619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:41084
I20260709 13:03:16.557902 12619 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:16.558212 12619 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:16.525074 12445 catalog_manager.cc:5697] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 1 to 2, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 2 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:16.563843 12622 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:16.567116 12510 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:16.568223 13910 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:16.570127 13910 raft_consensus.cc:697] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:16.570998 13910 consensus_queue.cc:237] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:16.574309 12619 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:16.599532 12619 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:16.591544 12689 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:16.600715 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:16.602244 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:16.602885 12689 raft_consensus.cc:3055] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:16.603252 12689 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:16.604418 12689 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:16.604522 13907 raft_consensus.cc:2955] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:16.605854 12689 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:16.614221 12692 raft_consensus.cc:2955] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:16.617091 12538 raft_consensus.cc:2955] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:16.602635 13234 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:16.628178 12689 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:16.629638 12587 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:16.632046 13908 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:16.632601 13908 raft_consensus.cc:697] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:16.633533 13908 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:16.596323 12691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff"
dest_uuid: "7ad68e814a7741488971822f2598183a"
 from {username='slave'} at 127.0.0.1:37292
I20260709 13:03:16.645507 12691 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:16.646085 12691 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:16.659498 13234 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:16.664287 13233 raft_consensus.cc:2955] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:16.683017 12691 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:16.686275 12691 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:16.685961 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:16.686933 12538 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:16.689935 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:16.690541 12619 raft_consensus.cc:3055] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:16.690827 12619 raft_consensus.cc:740] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:16.691512 12619 consensus_queue.cc:260] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:16.692638 12619 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:16.697152 12538 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:16.699875 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:16.700683 13878 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:16.701203 13878 raft_consensus.cc:697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 2 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:16.702179 13878 consensus_queue.cc:237] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:16.704658 12619 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:16.729254 12441 catalog_manager.cc:5697] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index 3 to 4, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:16.730840 12441 catalog_manager.cc:5697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 1 to 2, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 2 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:16.731448 12538 consensus_queue.cc:237] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:16.742115 13233 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:16.744261 13910 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:16.747915 12619 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:16.753710 13910 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:16.757730 13828 raft_consensus.cc:2955] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:16.764580 12443 catalog_manager.cc:5697] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:16.774181 13233 raft_consensus.cc:2955] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:16.791815 12432 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0767462f04d344b5a4fce9de7e885245 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:16.794633 12619 raft_consensus.cc:2955] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:16.805687 12441 catalog_manager.cc:5697] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 2 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:16.814607 12538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e"
dest_uuid: "a70479a3b4114f3581095e9890f5d653"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:42444
I20260709 13:03:16.815317 12538 raft_consensus.cc:606] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:03:16.822772 12622 consensus_queue.cc:237] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:16.831354 12538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e"
dest_uuid: "a70479a3b4114f3581095e9890f5d653"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:42444
I20260709 13:03:16.831944 12538 raft_consensus.cc:606] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:03:16.829324 12441 catalog_manager.cc:5697] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:03:16.832980 12432 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 44ad8138d0594c32b4590c837a41891e already in progress [suppressed 2 similar messages]
I20260709 13:03:16.838231 12538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e"
dest_uuid: "a70479a3b4114f3581095e9890f5d653"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:42444
I20260709 13:03:16.839010 12538 raft_consensus.cc:606] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Received request to transfer leadership
I20260709 13:03:16.843377 12691 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:03:16.845484 12493 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:03:16.846181 12493 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 44ad8138d0594c32b4590c837a41891e already in progress
W20260709 13:03:16.846590 12493 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 44ad8138d0594c32b4590c837a41891e already in progress
I20260709 13:03:16.845659 13233 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:16.849504 13882 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:16.854084 13908 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:16.862799 12682 tablet_service.cc:1558] Processing DeleteTablet for tablet 0767462f04d344b5a4fce9de7e885245 with delete_type TABLET_DATA_TOMBSTONED (TS 7ad68e814a7741488971822f2598183a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37280
I20260709 13:03:16.869283 13797 raft_consensus.cc:2955] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:16.879156 12692 raft_consensus.cc:2955] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:16.882632 12429 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1d83186354414170b4775351916c56c2 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:16.887324 13233 raft_consensus.cc:2955] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:16.901081 12538 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:16.902745 13878 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:16.908264 12441 catalog_manager.cc:5697] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index 4 to 5, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New cstate: current_term: 2 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:16.920918 12531 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d83186354414170b4775351916c56c2 with delete_type TABLET_DATA_TOMBSTONED (TS a70479a3b4114f3581095e9890f5d653 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:42444
I20260709 13:03:16.934461 13944 tablet_replica.cc:333] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:03:16.935909 13944 raft_consensus.cc:2243] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:16.936646 13944 raft_consensus.cc:2272] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:16.957373 13942 tablet_replica.cc:333] T 0767462f04d344b5a4fce9de7e885245 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:03:16.966298 13944 ts_tablet_manager.cc:1916] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:16.977411 13233 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:16.981856 13918 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:16.993901 13234 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Advancing to term 2
I20260709 13:03:16.999783 13942 raft_consensus.cc:2243] T 0767462f04d344b5a4fce9de7e885245 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:17.021634 13942 raft_consensus.cc:2272] T 0767462f04d344b5a4fce9de7e885245 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:17.026865 13234 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEARNER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:03:17.028692 13910 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:17.036326 13942 ts_tablet_manager.cc:1916] T 0767462f04d344b5a4fce9de7e885245 P 7ad68e814a7741488971822f2598183a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:17.038997 13944 ts_tablet_manager.cc:1929] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:03:17.039475 13944 log.cc:1199] T 1d83186354414170b4775351916c56c2 P a70479a3b4114f3581095e9890f5d653: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-0-root/wals/1d83186354414170b4775351916c56c2
I20260709 13:03:17.041260 12432 catalog_manager.cc:5028] TS a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): tablet 1d83186354414170b4775351916c56c2 (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:17.056058 13910 raft_consensus.cc:1064] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
W20260709 13:03:17.056485 13910 raft_consensus.cc:1068] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653: Unable to promote non-voter 66750b8bbd4c4b3a9695951d0ede3372: Service unavailable: leader transfer in progress
I20260709 13:03:17.065186 12622 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:03:17.067746 13828 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:17.068486 13942 ts_tablet_manager.cc:1929] T 0767462f04d344b5a4fce9de7e885245 P 7ad68e814a7741488971822f2598183a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:17.069010 13942 log.cc:1199] T 0767462f04d344b5a4fce9de7e885245 P 7ad68e814a7741488971822f2598183a: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-2-root/wals/0767462f04d344b5a4fce9de7e885245
I20260709 13:03:17.070744 12431 catalog_manager.cc:5028] TS 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): tablet 0767462f04d344b5a4fce9de7e885245 (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:17.074898 13910 raft_consensus.cc:993] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:17.075443 13910 raft_consensus.cc:1081] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:17.077255 12619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:41086
I20260709 13:03:17.081539 12692 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:03:17.081916 13828 raft_consensus.cc:1064] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
W20260709 13:03:17.082350 13828 raft_consensus.cc:1068] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653: Unable to promote non-voter 66750b8bbd4c4b3a9695951d0ede3372: Service unavailable: leader transfer in progress
I20260709 13:03:17.084141 13856 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:17.092752 12538 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:17.099105 13949 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:17.131937 12620 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:17.133463 13878 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:17.169039 12619 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:17.169466 12619 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:17.176203 12619 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:17.180354 12689 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:17.180708 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:17.181303 12546 raft_consensus.cc:3055] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:17.181631 12546 raft_consensus.cc:740] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:17.181704 13908 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:17.182054 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:17.182703 12692 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:17.182428 12546 consensus_queue.cc:260] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:17.184620 12546 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:17.193795 12619 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:17.194136 12546 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:17.195199 12692 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:17.196173 12587 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:17.197006 13908 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:17.197719 13908 raft_consensus.cc:697] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:17.198770 13908 consensus_queue.cc:237] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:17.211622 13234 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:17.212891 13908 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:17.216900 12443 catalog_manager.cc:5697] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 2 to 3, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 3 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:17.437698 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:17.504400 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:17.547315 12619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
mode: GRACEFUL
new_leader_uuid: "7ad68e814a7741488971822f2598183a"
 from {username='slave'} at 127.0.0.1:54242
I20260709 13:03:17.548039 12619 raft_consensus.cc:606] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Received request to transfer leadership to TS 7ad68e814a7741488971822f2598183a
I20260709 13:03:17.550849 12692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:17.551318 12692 raft_consensus.cc:606] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 2 LEADER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:03:17.553700 12619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
mode: GRACEFUL
new_leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:54242
I20260709 13:03:17.554347 12619 raft_consensus.cc:606] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Received request to transfer leadership to TS 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:17.556680 12692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:17.557215 12692 raft_consensus.cc:606] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:03:17.558737 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:03:17.559993 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:17.623049 13878 raft_consensus.cc:993] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a: : Instructing follower a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:03:17.623843 13878 raft_consensus.cc:1081] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 2 LEADER]: Signalling peer a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:03:17.625386 12546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff"
dest_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:42458
I20260709 13:03:17.625941 12546 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:17.626250 12546 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:17.631625 12546 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:17.633085 12546 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:17.633659 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:17.634128 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:17.634534 12619 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:17.634881 12694 raft_consensus.cc:3055] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:17.635178 12694 raft_consensus.cc:740] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:17.636023 12694 consensus_queue.cc:260] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:17.637131 12694 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:17.641103 12619 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:17.642426 12510 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:17.643219 13828 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:17.643348 12694 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:17.643612 13828 raft_consensus.cc:697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:17.644438 13828 consensus_queue.cc:237] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:17.654278 12443 catalog_manager.cc:5697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 2 to 3, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 3 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:17.658023 12694 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:17.659268 13882 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:17.667286 13907 raft_consensus.cc:993] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: : Instructing follower 7ad68e814a7741488971822f2598183a to start an election
I20260709 13:03:17.667804 13907 raft_consensus.cc:1081] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Signalling peer 7ad68e814a7741488971822f2598183a to start an election
I20260709 13:03:17.671669 13234 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEARNER]: Advancing to term 3
I20260709 13:03:17.673537 12692 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e"
dest_uuid: "7ad68e814a7741488971822f2598183a"
 from {username='slave'} at 127.0.0.1:37292
I20260709 13:03:17.674098 12692 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:17.674439 12692 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:17.678926 13234 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEARNER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:17.680687 13908 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:17.682150 12546 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:17.681083 12692 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:17.685617 13908 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:17.699239 13918 raft_consensus.cc:993] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a: : Instructing follower a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:03:17.699714 13949 raft_consensus.cc:1081] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:03:17.703251 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:17.703763 12538 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:17.708324 12692 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:17.710366 12546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7"
dest_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:42458
I20260709 13:03:17.711009 12546 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:17.711341 12546 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:17.714735 12538 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:17.715868 12662 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:17.716799 13949 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:17.717267 13949 raft_consensus.cc:697] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:17.718147 13949 consensus_queue.cc:237] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:17.721028 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:17.721637 12622 raft_consensus.cc:3055] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:17.721899 12622 raft_consensus.cc:740] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:17.722592 12622 consensus_queue.cc:260] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:17.723893 12622 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:17.726284 12546 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:17.728626 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:17.729144 12546 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:17.730536 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:17.731082 12694 raft_consensus.cc:3055] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:17.731379 12694 raft_consensus.cc:740] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:17.732065 12694 consensus_queue.cc:260] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:17.729164 12615 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:17.732380 12622 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:17.738302 12694 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:17.742990 12615 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:17.748481 12694 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:17.752360 12512 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:17.754177 13902 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:17.754878 13902 raft_consensus.cc:697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:17.754081 12442 catalog_manager.cc:5697] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 3 to 4, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 4 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:17.755765 13902 consensus_queue.cc:237] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:17.774780 12443 catalog_manager.cc:5697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:17.880796 13908 raft_consensus.cc:993] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f: : Instructing follower 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:17.881239 13907 raft_consensus.cc:1081] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Signalling peer 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:17.882668 13234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:57404
I20260709 13:03:17.883133 13234 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:17.883512 13234 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:17.888095 13234 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:17.889721 13234 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:17.890724 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:17.890923 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:17.891537 12546 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:17.891546 12622 raft_consensus.cc:3055] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:17.892004 12622 raft_consensus.cc:740] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:17.892664 12622 consensus_queue.cc:260] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:17.893673 12622 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:17.896421 12546 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:17.897531 13200 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:17.898363 13920 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:17.899124 12622 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:17.898909 13920 raft_consensus.cc:697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:17.900405 13920 consensus_queue.cc:237] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:17.909787 12443 catalog_manager.cc:5697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 1 to 2, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 2 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:18.564332 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:18.799013 12688 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:18.808494 12622 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:18.814042 13828 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:18.828547 12622 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:18.831981 12694 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:18.832203 12539 consensus_queue.cc:237] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:18.852682 12620 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:03:18.855684 13971 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:18.858090 13971 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:18.860585 13970 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:18.868891 12689 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:18.878189 13963 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:18.897886 12620 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:03:18.902933 12513 consensus_peers.cc:597] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 588a15c12a6c46ab9373c48890191400. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:18.905056 13229 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEARNER]: Advancing to term 4
I20260709 13:03:18.907969 13854 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:18.912457 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:18.930433 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 78465.6us
I20260709 13:03:18.951172 13229 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:03:18.952497 13918 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:18.965090 12539 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:18.967971 13918 raft_consensus.cc:1064] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:18.970362 13918 consensus_queue.cc:237] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:18.978492 13920 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:18.977164 13963 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:03:18.986965 12620 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:18.993180 13878 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:18.999718 12617 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:19.035147 13229 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:19.042372 12547 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:03:19.045660 13980 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:19.046198 12547 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:19.058185 13980 raft_consensus.cc:2955] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 2 to 6, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:19.059890 13878 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:19.060309 13828 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:19.080490 13967 raft_consensus.cc:2955] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:19.089166 12694 raft_consensus.cc:2955] T 588a15c12a6c46ab9373c48890191400 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:19.101676 12547 raft_consensus.cc:2955] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 2 to 6, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:19.102314 12619 consensus_queue.cc:237] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:19.107913 13234 raft_consensus.cc:2955] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 2 to 6, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:19.111789 12620 raft_consensus.cc:2955] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
W20260709 13:03:19.137382 12588 consensus_peers.cc:597] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6cba1eecd7bd4c2b913bcfdaa3c7c88c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:19.137619 12694 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:19.139060 13907 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:19.138660 12441 catalog_manager.cc:5697] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.140421 12441 catalog_manager.cc:5697] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index 2 to 6, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:19.147948 12547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7"
dest_uuid: "a70479a3b4114f3581095e9890f5d653"
mode: GRACEFUL
new_leader_uuid: "7ad68e814a7741488971822f2598183a"
 from {username='slave'} at 127.0.0.1:51504
I20260709 13:03:19.148548 12547 raft_consensus.cc:606] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Received request to transfer leadership to TS 7ad68e814a7741488971822f2598183a
I20260709 13:03:19.147531 12619 raft_consensus.cc:2955] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 2 to 6, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:19.151379 12691 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:19.151945 12691 raft_consensus.cc:606] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:19.155184 12539 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e"
dest_uuid: "a70479a3b4114f3581095e9890f5d653"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:51504
I20260709 13:03:19.155702 12539 raft_consensus.cc:606] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:19.156589 12547 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:19.157891 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:03:19.159616 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:19.160811 13907 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:19.163033 13968 raft_consensus.cc:2955] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:19.171983 12694 raft_consensus.cc:2955] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:19.180837 12547 consensus_queue.cc:237] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
W20260709 13:03:19.272640 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 87741.7us
I20260709 13:03:19.274719 12694 consensus_queue.cc:237] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:19.290855 13229 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:03:19.294337 13980 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:19.283658 12445 catalog_manager.cc:5697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:19.304522 12619 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:03:19.304953 13969 raft_consensus.cc:2955] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:19.307837 13234 raft_consensus.cc:2955] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:19.325659 13975 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:19.332221 12431 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 44ad8138d0594c32b4590c837a41891e with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:03:19.338470 12643 debug-util.cc:398] Leaking SignalData structure 0x7b08002e84a0 after lost signal to thread 11446
W20260709 13:03:19.339491 12643 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8f60 after lost signal to thread 12479
W20260709 13:03:19.340570 12643 debug-util.cc:398] Leaking SignalData structure 0x7b080012bce0 after lost signal to thread 12571
W20260709 13:03:19.341543 12643 debug-util.cc:398] Leaking SignalData structure 0x7b080023d6e0 after lost signal to thread 12646
W20260709 13:03:19.350245 12643 debug-util.cc:398] Leaking SignalData structure 0x7b08002a3b60 after lost signal to thread 12720
W20260709 13:03:19.351269 12643 debug-util.cc:398] Leaking SignalData structure 0x7b0800367f60 after lost signal to thread 13259
I20260709 13:03:19.353600 12619 raft_consensus.cc:2955] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Committing config change with OpId 4.7: config changed from index 6 to 7, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:19.372525 12443 catalog_manager.cc:5697] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index 6 to 7, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New cstate: current_term: 4 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:19.403352 12694 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:03:19.410029 12513 consensus_peers.cc:597] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5d48be0c79154aa3938113fc3c045740. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:19.419785 13967 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:19.423480 12531 tablet_service.cc:1558] Processing DeleteTablet for tablet 44ad8138d0594c32b4590c837a41891e with delete_type TABLET_DATA_TOMBSTONED (TS a70479a3b4114f3581095e9890f5d653 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:42444
I20260709 13:03:19.444548 12620 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:03:19.446960 13963 raft_consensus.cc:993] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:19.448078 13828 raft_consensus.cc:1081] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:19.455510 14007 tablet_replica.cc:333] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:03:19.456408 13967 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:19.457942 14007 raft_consensus.cc:2243] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:19.466615 12620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:41086
I20260709 13:03:19.478080 12620 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:19.478509 12620 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.478199 12691 raft_consensus.cc:2955] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:19.468061 12539 raft_consensus.cc:2955] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:19.475272 13828 raft_consensus.cc:2955] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:19.497977 12620 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:19.502177 12620 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:19.502775 13963 raft_consensus.cc:993] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653: : Instructing follower 7ad68e814a7741488971822f2598183a to start an election
I20260709 13:03:19.503242 13967 raft_consensus.cc:1081] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Signalling peer 7ad68e814a7741488971822f2598183a to start an election
I20260709 13:03:19.504225 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:19.504772 12547 raft_consensus.cc:3055] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:19.504823 12691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7"
dest_uuid: "7ad68e814a7741488971822f2598183a"
 from {username='slave'} at 127.0.0.1:37308
I20260709 13:03:19.505128 12547 raft_consensus.cc:740] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:19.505484 12691 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:19.506201 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:19.506045 12546 consensus_queue.cc:237] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:19.505862 12547 consensus_queue.cc:260] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:19.506734 13234 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.507422 12547 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.503615 12445 catalog_manager.cc:5697] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:19.511606 14007 raft_consensus.cc:2272] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:19.516680 13234 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:19.505860 12691 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:19.518162 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:19.519088 13907 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.519547 13907 raft_consensus.cc:697] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:19.520401 13907 consensus_queue.cc:237] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:19.522733 12694 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:19.459841 14009 ts_tablet_manager.cc:933] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307)
I20260709 13:03:19.526961 12691 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:19.527823 14007 ts_tablet_manager.cc:1916] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:19.529654 12547 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
W20260709 13:03:19.529799 12513 consensus_peers.cc:597] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b253d5a6b42486ba3b3a6e07c59f7ff. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:19.530308 13967 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:19.532090 14009 tablet_copy_client.cc:323] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.193:43307
I20260709 13:03:19.533282 12691 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:19.534530 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:19.535123 12617 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:19.535203 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:19.535953 12539 raft_consensus.cc:3055] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:19.536340 12539 raft_consensus.cc:740] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:19.536718 12620 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:19.537489 12539 consensus_queue.cc:260] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:19.539294 12539 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:19.540520 12557 tablet_copy_service.cc:140] P a70479a3b4114f3581095e9890f5d653: Received BeginTabletCopySession request for tablet 588a15c12a6c46ab9373c48890191400 from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:35624)
I20260709 13:03:19.541069 12557 tablet_copy_service.cc:161] P a70479a3b4114f3581095e9890f5d653: Beginning new tablet copy session on tablet 588a15c12a6c46ab9373c48890191400 from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:35624: session id = 66750b8bbd4c4b3a9695951d0ede3372-588a15c12a6c46ab9373c48890191400
I20260709 13:03:19.542088 12620 raft_consensus.cc:2955] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:19.549733 13967 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:19.556152 13963 raft_consensus.cc:2955] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:19.557871 12539 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:19.563292 12662 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:19.564523 13918 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:19.565377 13918 raft_consensus.cc:697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:19.565815 14007 ts_tablet_manager.cc:1929] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.6
I20260709 13:03:19.566243 14007 log.cc:1199] T 44ad8138d0594c32b4590c837a41891e P a70479a3b4114f3581095e9890f5d653: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-0-root/wals/44ad8138d0594c32b4590c837a41891e
I20260709 13:03:19.566267 13918 consensus_queue.cc:237] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:19.569173 12432 catalog_manager.cc:5028] TS a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): tablet 44ad8138d0594c32b4590c837a41891e (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:19.570528 12694 raft_consensus.cc:2955] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:19.579069 12445 catalog_manager.cc:5697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 2 to 3, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 3 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:19.580401 13975 raft_consensus.cc:993] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:19.580873 13975 raft_consensus.cc:1081] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:19.583613 12620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:41084
I20260709 13:03:19.584693 12620 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:19.585350 12620 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.592041 12619 raft_consensus.cc:2955] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:19.598677 12620 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:19.601858 12620 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:19.603042 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:19.603658 12687 raft_consensus.cc:3055] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:19.604000 12687 raft_consensus.cc:740] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:19.606472 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:19.607085 13232 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.604871 12687 consensus_queue.cc:260] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:19.617697 14013 ts_tablet_manager.cc:933] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:19.618022 12687 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:19.620288 12557 tablet_copy_source_session.cc:215] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:19.613413 13232 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:19.627592 12588 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:19.627959 12617 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:19.628494 13961 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:19.628985 13961 raft_consensus.cc:697] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:19.629878 13961 consensus_queue.cc:237] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:19.635497 12445 catalog_manager.cc:5697] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 1 to 2, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 2 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.639958 12443 catalog_manager.cc:5697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index -1 to 4, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 3 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.642323 14013 tablet_copy_client.cc:323] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.194:41653
I20260709 13:03:19.644042 12687 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:19.644706 14009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 588a15c12a6c46ab9373c48890191400. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:19.645236 12631 tablet_copy_service.cc:140] P a11816c5d72e4d1295a242f3ced09e5f: Received BeginTabletCopySession request for tablet 6cba1eecd7bd4c2b913bcfdaa3c7c88c from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:60170)
I20260709 13:03:19.645951 12631 tablet_copy_service.cc:161] P a11816c5d72e4d1295a242f3ced09e5f: Beginning new tablet copy session on tablet 6cba1eecd7bd4c2b913bcfdaa3c7c88c from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:60170: session id = 66750b8bbd4c4b3a9695951d0ede3372-6cba1eecd7bd4c2b913bcfdaa3c7c88c
I20260709 13:03:19.676841 12631 tablet_copy_source_session.cc:215] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:19.679502 14009 tablet_copy_client.cc:806] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:19.680188 14009 tablet_copy_client.cc:670] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:19.683437 14013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cba1eecd7bd4c2b913bcfdaa3c7c88c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:19.684849 14009 tablet_copy_client.cc:538] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:19.703500 12443 catalog_manager.cc:5697] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 2 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:19.706749 14009 tablet_bootstrap.cc:492] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:19.712805 14013 tablet_copy_client.cc:806] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:19.721498 14013 tablet_copy_client.cc:670] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:19.728354 14013 tablet_copy_client.cc:538] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:19.744436 14013 tablet_bootstrap.cc:492] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:19.773450 14009 tablet_bootstrap.cc:492] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:19.774844 14009 tablet_bootstrap.cc:492] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:19.775810 14009 ts_tablet_manager.cc:1403] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.021s
I20260709 13:03:19.783205 14009 raft_consensus.cc:359] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:19.784243 14009 raft_consensus.cc:740] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:19.784970 14009 consensus_queue.cc:260] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:19.796411 14009 ts_tablet_manager.cc:1434] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.002s
I20260709 13:03:19.798261 12557 tablet_copy_service.cc:342] P a70479a3b4114f3581095e9890f5d653: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-588a15c12a6c46ab9373c48890191400 received from {username='slave'} at 127.0.0.1:35624
I20260709 13:03:19.798785 12557 tablet_copy_service.cc:434] P a70479a3b4114f3581095e9890f5d653: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-588a15c12a6c46ab9373c48890191400 on tablet 588a15c12a6c46ab9373c48890191400 with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:19.818442 13234 raft_consensus.cc:1217] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:19.820400 14013 tablet_bootstrap.cc:492] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:19.821442 14013 tablet_bootstrap.cc:492] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:19.822280 14013 ts_tablet_manager.cc:1403] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.078s	user 0.015s	sys 0.011s
I20260709 13:03:19.825851 14013 raft_consensus.cc:359] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:19.826880 14013 raft_consensus.cc:740] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:19.827579 14013 consensus_queue.cc:260] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:19.830754 14013 ts_tablet_manager.cc:1434] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 13:03:19.832773 12631 tablet_copy_service.cc:342] P a11816c5d72e4d1295a242f3ced09e5f: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-6cba1eecd7bd4c2b913bcfdaa3c7c88c received from {username='slave'} at 127.0.0.1:60170
I20260709 13:03:19.833276 12631 tablet_copy_service.cc:434] P a11816c5d72e4d1295a242f3ced09e5f: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-6cba1eecd7bd4c2b913bcfdaa3c7c88c on tablet 6cba1eecd7bd4c2b913bcfdaa3c7c88c with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:19.963181 14013 ts_tablet_manager.cc:933] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307)
I20260709 13:03:19.965914 14013 tablet_copy_client.cc:323] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.193:43307
I20260709 13:03:19.968072 12557 tablet_copy_service.cc:140] P a70479a3b4114f3581095e9890f5d653: Received BeginTabletCopySession request for tablet 4b253d5a6b42486ba3b3a6e07c59f7ff from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:35624)
I20260709 13:03:19.968612 12557 tablet_copy_service.cc:161] P a70479a3b4114f3581095e9890f5d653: Beginning new tablet copy session on tablet 4b253d5a6b42486ba3b3a6e07c59f7ff from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:35624: session id = 66750b8bbd4c4b3a9695951d0ede3372-4b253d5a6b42486ba3b3a6e07c59f7ff
I20260709 13:03:19.969316 12539 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:19.972342 13980 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:19.977458 12557 tablet_copy_source_session.cc:215] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:19.981385 14013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b253d5a6b42486ba3b3a6e07c59f7ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:19.987459 14009 ts_tablet_manager.cc:933] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307)
I20260709 13:03:20.020844 12617 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:20.021734 14013 tablet_copy_client.cc:806] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:20.022455 14013 tablet_copy_client.cc:670] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:20.022464 13975 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:20.025887 14009 tablet_copy_client.cc:323] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.193:43307
I20260709 13:03:20.027688 12556 tablet_copy_service.cc:140] P a70479a3b4114f3581095e9890f5d653: Received BeginTabletCopySession request for tablet 5d48be0c79154aa3938113fc3c045740 from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:35624)
I20260709 13:03:20.028446 12556 tablet_copy_service.cc:161] P a70479a3b4114f3581095e9890f5d653: Beginning new tablet copy session on tablet 5d48be0c79154aa3938113fc3c045740 from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:35624: session id = 66750b8bbd4c4b3a9695951d0ede3372-5d48be0c79154aa3938113fc3c045740
I20260709 13:03:20.034520 14013 tablet_copy_client.cc:538] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:20.038626 12556 tablet_copy_source_session.cc:215] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:20.044143 14009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d48be0c79154aa3938113fc3c045740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:20.054440 14013 tablet_bootstrap.cc:492] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:20.061362 14009 tablet_copy_client.cc:806] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:20.062150 14009 tablet_copy_client.cc:670] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:20.066241 14009 tablet_copy_client.cc:538] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:20.079938 14009 tablet_bootstrap.cc:492] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:20.083117 12539 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:20.084625 13962 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:20.089859 13232 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:20.098119 13962 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:20.129236 12687 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:20.132134 13962 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:20.136526 13234 raft_consensus.cc:1217] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:20.137950 14013 tablet_bootstrap.cc:492] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:20.138865 14013 tablet_bootstrap.cc:492] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:20.139534 14013 ts_tablet_manager.cc:1403] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.085s	user 0.022s	sys 0.013s
I20260709 13:03:20.142431 14013 raft_consensus.cc:359] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:20.143337 14013 raft_consensus.cc:740] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:20.154786 14013 consensus_queue.cc:260] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:20.160569 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:20.162835 14013 ts_tablet_manager.cc:1434] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:03:20.166646 12556 tablet_copy_service.cc:342] P a70479a3b4114f3581095e9890f5d653: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-4b253d5a6b42486ba3b3a6e07c59f7ff received from {username='slave'} at 127.0.0.1:35624
I20260709 13:03:20.167075 12556 tablet_copy_service.cc:434] P a70479a3b4114f3581095e9890f5d653: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-4b253d5a6b42486ba3b3a6e07c59f7ff on tablet 4b253d5a6b42486ba3b3a6e07c59f7ff with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:20.205185 14009 tablet_bootstrap.cc:492] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:20.206226 14009 tablet_bootstrap.cc:492] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:20.206950 14009 ts_tablet_manager.cc:1403] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.127s	user 0.058s	sys 0.029s
I20260709 13:03:20.209939 14009 raft_consensus.cc:359] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:20.211910 14009 raft_consensus.cc:740] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:20.215040 14009 consensus_queue.cc:260] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:20.217964 14009 ts_tablet_manager.cc:1434] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:03:20.219551 12556 tablet_copy_service.cc:342] P a70479a3b4114f3581095e9890f5d653: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-5d48be0c79154aa3938113fc3c045740 received from {username='slave'} at 127.0.0.1:35624
I20260709 13:03:20.219967 12556 tablet_copy_service.cc:434] P a70479a3b4114f3581095e9890f5d653: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-5d48be0c79154aa3938113fc3c045740 on tablet 5d48be0c79154aa3938113fc3c045740 with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:20.227028 13232 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:20.249327 13961 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:20.384770 13234 raft_consensus.cc:1217] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:03:20.400491 13828 raft_consensus.cc:1064] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:20.403389 13828 consensus_queue.cc:237] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:20.421320 13232 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:20.422391 12617 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:20.422978 13828 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:20.424542 12694 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:20.426133 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:20.425308 13828 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:03:20.429738 13963 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:20.457906 13963 raft_consensus.cc:2955] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:20.463505 13234 raft_consensus.cc:2955] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:20.471310 12617 raft_consensus.cc:2955] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:20.479984 12687 raft_consensus.cc:2955] T 588a15c12a6c46ab9373c48890191400 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:20.495885 12622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
mode: GRACEFUL
new_leader_uuid: "7ad68e814a7741488971822f2598183a"
 from {username='slave'} at 127.0.0.1:54242
I20260709 13:03:20.496595 12622 raft_consensus.cc:606] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Received request to transfer leadership to TS 7ad68e814a7741488971822f2598183a
I20260709 13:03:20.498935 12443 catalog_manager.cc:5697] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:20.503778 14029 raft_consensus.cc:1064] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:20.507278 12622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
mode: GRACEFUL
new_leader_uuid: "7ad68e814a7741488971822f2598183a"
 from {username='slave'} at 127.0.0.1:54242
I20260709 13:03:20.507946 12622 raft_consensus.cc:606] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Received request to transfer leadership to TS 7ad68e814a7741488971822f2598183a
I20260709 13:03:20.509656 13234 raft_consensus.cc:1217] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 13:03:20.512188 12694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:20.512784 12694 raft_consensus.cc:606] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:03:20.516942 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:03:20.518757 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:20.515642 14029 consensus_queue.cc:237] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:20.548408 12539 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:20.549785 13232 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:20.553335 12687 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:20.554533 13907 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:20.556659 13962 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:20.557978 14030 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:20.575732 12546 consensus_queue.cc:237] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:20.587333 13907 raft_consensus.cc:2955] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:20.590747 12539 raft_consensus.cc:2955] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:20.594357 12694 raft_consensus.cc:2955] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:20.601131 13232 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:20.602841 14034 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:20.606511 12617 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:20.608035 13828 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:20.610275 14034 raft_consensus.cc:2955] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:20.617115 13232 raft_consensus.cc:2955] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:20.618045 12617 raft_consensus.cc:2955] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:20.624065 13234 raft_consensus.cc:2955] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:20.632472 12432 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 588a15c12a6c46ab9373c48890191400 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:20.638609 12445 catalog_manager.cc:5697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:20.660975 12617 consensus_queue.cc:237] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:20.667253 12442 catalog_manager.cc:5697] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index 3 to 4, VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195) evicted. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:20.672184 12694 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:20.672184 13232 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:20.674502 14029 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:20.676374 14030 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:20.686510 13908 raft_consensus.cc:2955] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:20.688545 12691 raft_consensus.cc:2955] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:20.693158 13234 raft_consensus.cc:2955] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:20.706797 12682 tablet_service.cc:1558] Processing DeleteTablet for tablet 588a15c12a6c46ab9373c48890191400 with delete_type TABLET_DATA_TOMBSTONED (TS 7ad68e814a7741488971822f2598183a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37280
I20260709 13:03:20.717851 12429 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6cba1eecd7bd4c2b913bcfdaa3c7c88c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:20.726277 13980 raft_consensus.cc:993] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a: : Instructing follower a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:03:20.726763 13980 raft_consensus.cc:1081] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:03:20.726903 12443 catalog_manager.cc:5697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index 3 to 4, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New cstate: current_term: 1 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:20.731999 12546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34"
dest_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:42458
I20260709 13:03:20.732610 12546 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:20.732961 12546 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:20.740980 12531 tablet_service.cc:1558] Processing DeleteTablet for tablet 6cba1eecd7bd4c2b913bcfdaa3c7c88c with delete_type TABLET_DATA_TOMBSTONED (TS a70479a3b4114f3581095e9890f5d653 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:42444
I20260709 13:03:20.747952 12546 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:20.758430 14045 tablet_replica.cc:333] T 588a15c12a6c46ab9373c48890191400 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:03:20.759200 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:20.759809 12617 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:20.759598 14045 raft_consensus.cc:2243] T 588a15c12a6c46ab9373c48890191400 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:20.760855 14045 raft_consensus.cc:2272] T 588a15c12a6c46ab9373c48890191400 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:20.764858 14045 ts_tablet_manager.cc:1916] T 588a15c12a6c46ab9373c48890191400 P 7ad68e814a7741488971822f2598183a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:20.782157 12546 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:20.784116 14046 tablet_replica.cc:333] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:03:20.785554 12617 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:20.800801 14046 raft_consensus.cc:2243] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:20.801627 14046 raft_consensus.cc:2272] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:20.804381 12510 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:20.805284 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:20.805963 12691 raft_consensus.cc:3055] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:20.806957 14045 ts_tablet_manager.cc:1929] T 588a15c12a6c46ab9373c48890191400 P 7ad68e814a7741488971822f2598183a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:20.806778 14034 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:20.807910 14034 raft_consensus.cc:697] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:20.808892 14034 consensus_queue.cc:237] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:20.806349 12691 raft_consensus.cc:740] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:20.812482 14045 log.cc:1199] T 588a15c12a6c46ab9373c48890191400 P 7ad68e814a7741488971822f2598183a: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-2-root/wals/588a15c12a6c46ab9373c48890191400
I20260709 13:03:20.813465 12691 consensus_queue.cc:260] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:20.814069 14046 ts_tablet_manager.cc:1916] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:20.814541 12431 catalog_manager.cc:5028] TS 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): tablet 588a15c12a6c46ab9373c48890191400 (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:20.814960 12691 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:20.835665 12691 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:20.836309 14046 ts_tablet_manager.cc:1929] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:20.836782 14046 log.cc:1199] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a70479a3b4114f3581095e9890f5d653: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-0-root/wals/6cba1eecd7bd4c2b913bcfdaa3c7c88c
I20260709 13:03:20.838601 12432 catalog_manager.cc:5028] TS a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): tablet 6cba1eecd7bd4c2b913bcfdaa3c7c88c (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:20.842904 12445 catalog_manager.cc:5697] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:20.925493 13963 raft_consensus.cc:1064] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:20.927889 13963 consensus_queue.cc:237] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:20.934919 12691 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:20.934934 12617 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:20.935534 13234 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 LEARNER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:03:20.936784 13828 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:20.937676 13967 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:20.941689 14034 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:20.962538 13908 raft_consensus.cc:993] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: : Instructing follower 7ad68e814a7741488971822f2598183a to start an election
I20260709 13:03:20.964326 14030 raft_consensus.cc:1081] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Signalling peer 7ad68e814a7741488971822f2598183a to start an election
I20260709 13:03:20.966210 12694 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880"
dest_uuid: "7ad68e814a7741488971822f2598183a"
 from {username='slave'} at 127.0.0.1:37292
I20260709 13:03:20.967024 12694 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:20.967445 12694 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:20.971321 13828 raft_consensus.cc:2955] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:20.971998 12617 raft_consensus.cc:2955] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:20.981851 12694 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:20.985529 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:20.986114 12622 raft_consensus.cc:3055] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:20.986397 12622 raft_consensus.cc:740] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:20.986542 13967 raft_consensus.cc:1064] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:20.987071 12622 consensus_queue.cc:260] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:20.988122 12622 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:20.990262 13967 consensus_queue.cc:237] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:20.990901 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:20.991616 12546 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:20.994705 13234 raft_consensus.cc:2955] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:21.010342 12546 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:21.013291 12694 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:21.012375 12622 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:21.013026 12691 raft_consensus.cc:2955] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:21.014001 12445 catalog_manager.cc:5697] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index 2 to 3, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:21.014070 12662 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:21.018123 13980 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:21.019279 13980 raft_consensus.cc:697] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 2 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:21.020134 13980 consensus_queue.cc:237] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:21.036000 13232 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEARNER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:21.037451 13963 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:21.047241 12617 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:21.049306 13967 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:21.059902 12546 consensus_queue.cc:237] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:21.048877 12443 catalog_manager.cc:5697] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 1 to 2, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 2 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:21.065038 12691 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:21.067557 13967 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:21.078675 14030 raft_consensus.cc:993] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f: : Instructing follower 7ad68e814a7741488971822f2598183a to start an election
I20260709 13:03:21.079283 14030 raft_consensus.cc:1081] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Signalling peer 7ad68e814a7741488971822f2598183a to start an election
I20260709 13:03:21.081502 13232 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:21.083274 13967 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:21.089999 13963 raft_consensus.cc:2955] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:21.091171 14034 raft_consensus.cc:2955] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:21.094703 12691 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d"
dest_uuid: "7ad68e814a7741488971822f2598183a"
 from {username='slave'} at 127.0.0.1:37292
I20260709 13:03:21.095475 12691 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:21.095950 12691 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:21.104076 13232 raft_consensus.cc:2955] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:21.107210 12694 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:03:21.108932 12687 raft_consensus.cc:2955] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:21.109447 12617 raft_consensus.cc:2955] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:21.114615 13828 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:21.116726 12691 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:21.119216 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:21.119769 12546 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:21.124231 12691 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:21.127200 12546 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:21.128539 12662 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:21.132576 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:21.132035 12691 raft_consensus.cc:2955] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:21.133163 12620 raft_consensus.cc:3055] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:21.133498 12620 raft_consensus.cc:740] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:21.134338 12620 consensus_queue.cc:260] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:21.135762 12620 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:21.146631 14052 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:21.147197 14052 raft_consensus.cc:697] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:21.148025 14052 consensus_queue.cc:237] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:21.156769 13234 raft_consensus.cc:2955] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:21.157792 12620 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:21.164408 12443 catalog_manager.cc:5697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index 4 to 5, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:21.171314 12432 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5d48be0c79154aa3938113fc3c045740 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:21.207686 12546 consensus_queue.cc:237] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:21.203583 12445 catalog_manager.cc:5697] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 2 to 3, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 3 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:21.212877 12445 catalog_manager.cc:5697] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index 3 to 4, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New cstate: current_term: 1 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:21.218611 13234 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:21.220475 12687 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:21.220535 14034 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:21.223227 13963 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:21.228076 12604 tablet_service.cc:1558] Processing DeleteTablet for tablet 5d48be0c79154aa3938113fc3c045740 with delete_type TABLET_DATA_TOMBSTONED (TS a11816c5d72e4d1295a242f3ced09e5f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:41074
I20260709 13:03:21.231711 13963 raft_consensus.cc:2955] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:21.233510 12691 raft_consensus.cc:2955] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:21.246109 14059 tablet_replica.cc:333] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:03:21.247225 14059 raft_consensus.cc:2243] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:21.258507 12687 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:21.260505 13967 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:21.263701 14059 raft_consensus.cc:2272] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:21.248286 13235 raft_consensus.cc:2955] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:21.267707 14059 ts_tablet_manager.cc:1916] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:21.280580 12432 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4b253d5a6b42486ba3b3a6e07c59f7ff with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:03:21.287875 12445 catalog_manager.cc:5697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index 5 to 6, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New cstate: current_term: 3 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:21.299775 14059 ts_tablet_manager.cc:1929] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:03:21.300276 14059 log.cc:1199] T 5d48be0c79154aa3938113fc3c045740 P a11816c5d72e4d1295a242f3ced09e5f: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-1-root/wals/5d48be0c79154aa3938113fc3c045740
I20260709 13:03:21.302930 12429 catalog_manager.cc:5028] TS a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): tablet 5d48be0c79154aa3938113fc3c045740 (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:21.303231 12620 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:21.309206 13963 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:21.313129 12604 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b253d5a6b42486ba3b3a6e07c59f7ff with delete_type TABLET_DATA_TOMBSTONED (TS a11816c5d72e4d1295a242f3ced09e5f not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:41074
I20260709 13:03:21.315063 14059 tablet_replica.cc:333] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:03:21.320960 14059 raft_consensus.cc:2243] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:21.321659 14059 raft_consensus.cc:2272] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:21.325939 14059 ts_tablet_manager.cc:1916] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:03:21.343530 14059 ts_tablet_manager.cc:1929] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:03:21.343937 14059 log.cc:1199] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a11816c5d72e4d1295a242f3ced09e5f: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-1-root/wals/4b253d5a6b42486ba3b3a6e07c59f7ff
I20260709 13:03:21.345449 12429 catalog_manager.cc:5028] TS a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): tablet 4b253d5a6b42486ba3b3a6e07c59f7ff (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:03:21.472673 12539 raft_consensus.cc:1275] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:21.475118 13980 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:21.488492 12620 raft_consensus.cc:1275] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:21.489710 14052 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:21.519625 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:21.568719 12617 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:21.570011 14052 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:21.578881 12539 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:21.580356 13975 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:21.814271 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:21.854890 12687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:21.855598 12687 raft_consensus.cc:606] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:21.858111 12546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad"
dest_uuid: "a70479a3b4114f3581095e9890f5d653"
mode: GRACEFUL
new_leader_uuid: "7ad68e814a7741488971822f2598183a"
 from {username='slave'} at 127.0.0.1:51504
I20260709 13:03:21.858661 12546 raft_consensus.cc:606] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Received request to transfer leadership to TS 7ad68e814a7741488971822f2598183a
I20260709 13:03:21.861182 12687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:21.861776 12687 raft_consensus.cc:606] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:21.862859 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:03:21.864604 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:21.880007 13967 raft_consensus.cc:993] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653: : Instructing follower 7ad68e814a7741488971822f2598183a to start an election
I20260709 13:03:21.880600 14034 raft_consensus.cc:1081] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Signalling peer 7ad68e814a7741488971822f2598183a to start an election
I20260709 13:03:21.882297 12687 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad"
dest_uuid: "7ad68e814a7741488971822f2598183a"
 from {username='slave'} at 127.0.0.1:37308
I20260709 13:03:21.882838 12687 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:21.883160 12687 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.890260 12687 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:21.892189 12687 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:21.892885 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:21.893191 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:21.893486 12539 raft_consensus.cc:3055] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:21.893771 12620 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.893889 12539 raft_consensus.cc:740] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:21.894620 12539 consensus_queue.cc:260] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:21.895632 12539 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:21.898778 12620 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:21.899879 12659 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:21.900790 13975 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:21.901357 13975 raft_consensus.cc:697] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 2 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:21.900813 12539 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:21.902245 13975 consensus_queue.cc:237] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:21.914028 12445 catalog_manager.cc:5697] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 1 to 2, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 2 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.003265 13980 raft_consensus.cc:993] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a: : Instructing follower 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:22.003885 13975 raft_consensus.cc:1081] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer 66750b8bbd4c4b3a9695951d0ede3372 to start an election
I20260709 13:03:22.005627 13234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
 from {username='slave'} at 127.0.0.1:60962
I20260709 13:03:22.006155 13234 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:22.006464 13234 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:22.012574 13234 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:22.014891 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:22.015202 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:22.015458 12539 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:22.015841 12687 raft_consensus.cc:3055] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:22.016192 12687 raft_consensus.cc:740] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:22.016957 12687 consensus_queue.cc:260] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:22.018119 12687 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:22.021131 12539 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:22.022100 13200 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:22.023032 14069 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:22.023526 14069 raft_consensus.cc:697] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:22.024358 14069 consensus_queue.cc:237] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:22.024776 12687 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:22.014700 13234 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:22.034801 12443 catalog_manager.cc:5697] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 2 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:22.036643 13980 raft_consensus.cc:993] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:22.037130 13975 raft_consensus.cc:1081] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:22.038651 12620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:41084
I20260709 13:03:22.039084 12620 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:22.039368 12620 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:22.045663 12620 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:22.047329 12620 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:22.048031 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:22.048370 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:22.048642 12539 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:22.049266 12687 raft_consensus.cc:3055] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:22.049652 12687 raft_consensus.cc:740] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:22.050817 12687 consensus_queue.cc:260] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:22.052197 12687 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:22.056406 12539 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:22.057425 12588 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:22.058224 14029 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:22.058545 12687 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:22.058729 14029 raft_consensus.cc:697] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:22.059629 14029 consensus_queue.cc:237] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:22.074079 12443 catalog_manager.cc:5697] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 2 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:22.297283 12539 raft_consensus.cc:1275] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:22.298630 14052 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:22.309278 12620 raft_consensus.cc:1275] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:22.317888 13980 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:22.402961 12620 consensus_queue.cc:237] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:22.408545 12691 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:03:22.408545 12539 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:03:22.408664 12588 consensus_peers.cc:597] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fb1007aec88948499b3c20c4e58bba2f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:22.410409 13908 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:22.411188 14070 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:22.421612 13908 raft_consensus.cc:2955] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:22.427122 12694 raft_consensus.cc:2955] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:22.432963 12539 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:22.435355 13979 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:22.441684 12546 raft_consensus.cc:2955] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:22.453425 12445 catalog_manager.cc:5697] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index -1 to 3, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 2 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:22.460752 12620 consensus_queue.cc:237] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
W20260709 13:03:22.475107 12588 consensus_peers.cc:597] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7724ca15b4534948997fc02e3fe5445a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:22.475299 12539 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:03:22.475180 12687 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:03:22.477105 14086 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:22.490839 14086 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:22.502223 14087 raft_consensus.cc:2955] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:22.505115 12687 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:22.506496 13979 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:22.509303 12691 raft_consensus.cc:2955] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:22.528394 12546 consensus_queue.cc:237] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:22.533142 12547 raft_consensus.cc:2955] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:22.538318 12444 catalog_manager.cc:5697] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index -1 to 3, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 2 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:03:22.541689 12513 consensus_peers.cc:597] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ddff67072e694e36addbc3b673b008d0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:22.547806 12691 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:03:22.548017 12620 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:03:22.549453 13967 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:22.551422 14034 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:22.561141 14082 raft_consensus.cc:2955] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:22.570988 12539 raft_consensus.cc:1275] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:22.572903 14086 consensus_queue.cc:1048] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:22.575941 12691 raft_consensus.cc:2955] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:22.577718 12620 raft_consensus.cc:2955] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:22.584517 12617 consensus_queue.cc:237] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:22.609732 12445 catalog_manager.cc:5697] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index -1 to 3, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 2 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:22.616128 12539 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:03:22.617398 12588 consensus_peers.cc:597] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f -> Peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Couldn't send request to peer 66750b8bbd4c4b3a9695951d0ede3372. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f2abdbdc67164b32bd58bfe3763a4183. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:22.618371 12691 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:03:22.618376 14086 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:22.620325 14087 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:22.629805 12694 raft_consensus.cc:1275] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:22.632654 13908 consensus_queue.cc:1048] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:22.641621 14086 raft_consensus.cc:2955] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:22.647632 12539 raft_consensus.cc:2955] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:22.668591 12443 catalog_manager.cc:5697] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: config changed from index -1 to 3, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New cstate: current_term: 2 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:22.684652 12687 raft_consensus.cc:2955] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:22.880126 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:22.973050 14103 ts_tablet_manager.cc:933] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:22.975281 14103 tablet_copy_client.cc:323] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.194:41653
I20260709 13:03:22.977169 12631 tablet_copy_service.cc:140] P a11816c5d72e4d1295a242f3ced09e5f: Received BeginTabletCopySession request for tablet fb1007aec88948499b3c20c4e58bba2f from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:60170)
I20260709 13:03:22.977808 12631 tablet_copy_service.cc:161] P a11816c5d72e4d1295a242f3ced09e5f: Beginning new tablet copy session on tablet fb1007aec88948499b3c20c4e58bba2f from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:60170: session id = 66750b8bbd4c4b3a9695951d0ede3372-fb1007aec88948499b3c20c4e58bba2f
I20260709 13:03:22.986122 12631 tablet_copy_source_session.cc:215] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:22.990476 14103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb1007aec88948499b3c20c4e58bba2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:23.009902 14103 tablet_copy_client.cc:806] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:23.010560 14103 tablet_copy_client.cc:670] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:23.089318 14103 tablet_copy_client.cc:538] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:23.128654 14103 tablet_bootstrap.cc:492] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:23.147863 14109 ts_tablet_manager.cc:933] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:23.183892 14107 ts_tablet_manager.cc:933] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307)
I20260709 13:03:23.215107 14108 ts_tablet_manager.cc:933] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:23.240168 14109 tablet_copy_client.cc:323] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.194:41653
I20260709 13:03:23.243479 12631 tablet_copy_service.cc:140] P a11816c5d72e4d1295a242f3ced09e5f: Received BeginTabletCopySession request for tablet f2abdbdc67164b32bd58bfe3763a4183 from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:60170)
I20260709 13:03:23.244304 12631 tablet_copy_service.cc:161] P a11816c5d72e4d1295a242f3ced09e5f: Beginning new tablet copy session on tablet f2abdbdc67164b32bd58bfe3763a4183 from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:60170: session id = 66750b8bbd4c4b3a9695951d0ede3372-f2abdbdc67164b32bd58bfe3763a4183
I20260709 13:03:23.286551 14107 tablet_copy_client.cc:323] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.193:43307
I20260709 13:03:23.287175 14108 tablet_copy_client.cc:323] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Beginning tablet copy session from remote peer at address 127.11.44.194:41653
I20260709 13:03:23.288982 12632 tablet_copy_service.cc:140] P a11816c5d72e4d1295a242f3ced09e5f: Received BeginTabletCopySession request for tablet 7724ca15b4534948997fc02e3fe5445a from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:60170)
I20260709 13:03:23.289040 12556 tablet_copy_service.cc:140] P a70479a3b4114f3581095e9890f5d653: Received BeginTabletCopySession request for tablet ddff67072e694e36addbc3b673b008d0 from peer 66750b8bbd4c4b3a9695951d0ede3372 ({username='slave'} at 127.0.0.1:35624)
I20260709 13:03:23.289469 12632 tablet_copy_service.cc:161] P a11816c5d72e4d1295a242f3ced09e5f: Beginning new tablet copy session on tablet 7724ca15b4534948997fc02e3fe5445a from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:60170: session id = 66750b8bbd4c4b3a9695951d0ede3372-7724ca15b4534948997fc02e3fe5445a
I20260709 13:03:23.289819 12556 tablet_copy_service.cc:161] P a70479a3b4114f3581095e9890f5d653: Beginning new tablet copy session on tablet ddff67072e694e36addbc3b673b008d0 from peer 66750b8bbd4c4b3a9695951d0ede3372 at {username='slave'} at 127.0.0.1:35624: session id = 66750b8bbd4c4b3a9695951d0ede3372-ddff67072e694e36addbc3b673b008d0
I20260709 13:03:23.301443 12632 tablet_copy_source_session.cc:215] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:23.307050 14108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7724ca15b4534948997fc02e3fe5445a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:23.310299 12631 tablet_copy_source_session.cc:215] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:23.318616 12556 tablet_copy_source_session.cc:215] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:03:23.325929 14107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddff67072e694e36addbc3b673b008d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:23.328097 14109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2abdbdc67164b32bd58bfe3763a4183. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:23.383811 14109 tablet_copy_client.cc:806] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:23.385663 14109 tablet_copy_client.cc:670] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:23.391741 14109 tablet_copy_client.cc:538] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:23.409284 14103 tablet_bootstrap.cc:492] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:23.414731 14103 tablet_bootstrap.cc:492] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:23.416148 14109 tablet_bootstrap.cc:492] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:23.421629 14107 tablet_copy_client.cc:806] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:23.422458 14107 tablet_copy_client.cc:670] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:23.413515 14108 tablet_copy_client.cc:806] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 0 data blocks...
I20260709 13:03:23.424352 14108 tablet_copy_client.cc:670] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Starting download of 1 WAL segments...
I20260709 13:03:23.432089 14108 tablet_copy_client.cc:538] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:23.433712 14107 tablet_copy_client.cc:538] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:03:23.434767 14103 ts_tablet_manager.cc:1403] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.307s	user 0.022s	sys 0.015s
I20260709 13:03:23.442651 14108 tablet_bootstrap.cc:492] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:23.453330 14103 raft_consensus.cc:359] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:23.461237 14103 raft_consensus.cc:740] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:23.481220 14103 consensus_queue.cc:260] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:24.391965 14103 ts_tablet_manager.cc:1434] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.952s	user 0.013s	sys 0.000s
W20260709 13:03:24.392251 14103 ts_tablet_manager.cc:1467] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372: Tablet startup took 952ms
W20260709 13:03:24.392489 14103 ts_tablet_manager.cc:1469] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372: Trace:
0709 13:03:22.970784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:22.970923 (+   139us) service_pool.cc:224] Handling call
0709 13:03:22.973461 (+  2538us) ts_tablet_manager.cc:934] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
0709 13:03:22.989099 (+ 15638us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:03:23.000125 (+ 11026us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:23.000366 (+   241us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:03:23.008418 (+  8052us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:03:23.008758 (+   340us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:23.009129 (+   371us) ts_tablet_manager.cc:989] Replica registered.
0709 13:03:23.009223 (+    94us) inbound_call.cc:177] Queueing success response
0709 13:03:23.113832 (+104609us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:03:23.440270 (+326438us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:03:23.440936 (+   666us) tablet_replica.cc:261] Starting instrumentation
0709 13:03:23.441660 (+   724us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":280,"tablet-copy.queue_time_us":1514,"tablet-download-pool.queue_time_us":1040,"tablet-download-pool.run_cpu_time_us":1946,"tablet-download-pool.run_wall_time_us":76679,"thread_start_us":2012,"threads_started":2}
W20260709 13:03:24.412842 14109 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.007s	sys 0.004s
W20260709 13:03:24.430328 14109 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.009s	sys 0.005s
I20260709 13:03:24.428731 14108 tablet_bootstrap.cc:492] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:24.431666 14108 tablet_bootstrap.cc:492] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:24.432408 14108 ts_tablet_manager.cc:1403] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 0.990s	user 0.021s	sys 0.016s
I20260709 13:03:24.435768 14108 raft_consensus.cc:359] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:24.436646 14108 raft_consensus.cc:740] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:24.437304 14108 consensus_queue.cc:260] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:24.446784 14108 ts_tablet_manager.cc:1434] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:03:24.457405 14109 tablet_bootstrap.cc:492] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:24.458837 14109 tablet_bootstrap.cc:492] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:24.459930 14109 ts_tablet_manager.cc:1403] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 1.044s	user 0.036s	sys 0.006s
I20260709 13:03:23.479758 14107 tablet_bootstrap.cc:492] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap starting.
I20260709 13:03:24.470417 14125 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:24.471139 14125 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:24.480808 14119 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:24.481544 14119 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:24.490278 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:24.492624 14119 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:24.493257 12568 debug-util.cc:398] Leaking SignalData structure 0x7b0800170ce0 after lost signal to thread 11446
I20260709 13:03:24.493847 14122 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:24.494454 14125 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:24.496739 14121 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:24.494475 14122 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:24.502375 14119 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:24.497335 14121 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:24.503118 14119 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:24.506299 14119 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:24.506222 14118 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:24.506983 14118 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:24.510731 14118 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:24.511688 14121 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:24.516510 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:24.517901 14122 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:24.522763 13979 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:24.523402 13979 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:24.526202 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:24.530282 13979 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:24.545230 14123 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:24.545825 14109 raft_consensus.cc:359] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:24.546919 14109 raft_consensus.cc:740] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:24.546389 14123 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:24.559758 14123 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:24.561653 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:24.546857 13979 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:24.571921 14125 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:24.588003 14034 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:24.599958 14115 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:24.601234 14127 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:24.602242 14126 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:24.609112 14120 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:24.611415 14122 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:24.626534 14119 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:24.627379 14117 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:24.732892 14118 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:24.787478 14118 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:24.790505 14136 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:24.779877 14116 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:24.794896 14116 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:24.797184 14116 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:24.797832 14116 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:24.798542 14116 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:24.801107 14116 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:24.782919 14087 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:24.792250 14118 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:24.771937 14125 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:24.803833 14116 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:24.754338 13975 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:24.753906 14086 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:24.791750 14139 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:24.739939 14123 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:24.646173 14121 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:24.739487 14052 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:24.809074 14119 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:24.734983 14130 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:24.556217 14109 consensus_queue.cc:260] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:24.815965 14118 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:24.805150 14122 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:24.822691 14117 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:24.892052 14128 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:24.894701 14117 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:24.820948 14115 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:24.918524 14115 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:24.810814 14126 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:24.824144 13979 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:24.831705 14127 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:24.943425 14127 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:24.814258 14034 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:24.894002 14128 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:24.959154 14128 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:24.821795 14087 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:24.896175 14117 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:24.994904 14135 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:24.921283 12631 tablet_copy_service.cc:342] P a11816c5d72e4d1295a242f3ced09e5f: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-fb1007aec88948499b3c20c4e58bba2f received from {username='slave'} at 127.0.0.1:60170
I20260709 13:03:24.863058 14121 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:24.858139 14123 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:24.853996 13975 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:24.860750 14086 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:24.888913 14052 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:24.895836 14118 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:24.897296 14116 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:24.863289 14139 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:24.961732 14130 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:24.823356 14120 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.047310 14117 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:25.079774 12631 tablet_copy_service.cc:434] P a11816c5d72e4d1295a242f3ced09e5f: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-fb1007aec88948499b3c20c4e58bba2f on tablet fb1007aec88948499b3c20c4e58bba2f with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:25.100765 14130 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:24.821213 14136 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.111500 14145 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:25.109472 14137 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:25.128392 14136 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:25.129948 14149 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:25.129176 14136 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:25.132098 14136 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.134960 14136 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:25.090683 14135 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:25.140825 14135 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:25.130733 14149 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.143980 14149 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:25.113368 14130 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:25.102375 14133 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:03:25.101655 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 129432us
I20260709 13:03:25.136632 14136 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:25.152527 14115 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:25.158670 14127 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:25.160626 12632 tablet_copy_service.cc:342] P a11816c5d72e4d1295a242f3ced09e5f: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-7724ca15b4534948997fc02e3fe5445a received from {username='slave'} at 127.0.0.1:60170
I20260709 13:03:25.154621 14135 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:25.156867 14119 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:25.147193 14141 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:25.191453 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2289) took 1621 ms. Trace:
I20260709 13:03:25.193161 12617 rpcz_store.cc:276] 0709 13:03:23.481356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.102162 (+1620806us) service_pool.cc:224] Handling call
0709 13:03:25.102481 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:25.102638 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:25.102665 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:25.102706 (+    41us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:25.102734 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:25.102779 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:25.102887 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:25.180179 14125 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:25.180771 14034 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:25.192587 12632 tablet_copy_service.cc:434] P a11816c5d72e4d1295a242f3ced09e5f: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-7724ca15b4534948997fc02e3fe5445a on tablet 7724ca15b4534948997fc02e3fe5445a with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:25.191737 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:25.188742 14122 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:25.185276 14128 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:25.192431 14115 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.209031 14154 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:25.196247 14029 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:25.179646 14136 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.219159 14139 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:25.197983 13979 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:25.165166 14130 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.197576 14087 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:25.197211 14149 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:25.197717 14126 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:25.213980 14151 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:25.208315 14125 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:25.214828 14123 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:25.197227 14135 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:25.217145 14086 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:25.197690 14127 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.161710 14137 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.164638 14145 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.187414 14133 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.220150 14141 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:25.234166 14116 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:25.380991 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:25.414760 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:25.372496 14126 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:25.381161 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:25.220453 14122 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:25.335533 13235 raft_consensus.cc:1217] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:03:25.464414 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:25.443807 14142 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:25.444415 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:25.412011 14132 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:25.466780 13234 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:25.377005 14115 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:25.430438 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:25.221318 14146 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:25.228331 14131 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:25.286634 13975 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:25.342526 14156 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:25.515543 14156 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.409420 14138 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:25.308121 14149 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.517355 14138 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.337371 14106 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:25.316799 14139 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:25.409847 14148 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:25.308858 14117 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:25.457036 12568 debug-util.cc:398] Leaking SignalData structure 0x7b08000d71e0 after lost signal to thread 12479
I20260709 13:03:25.526125 14144 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:25.335418 14087 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:25.287364 14118 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:25.224700 14128 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.639873 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:25.640282 14128 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:25.323856 14129 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:25.398336 14109 ts_tablet_manager.cc:1434] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.938s	user 0.010s	sys 0.041s
I20260709 13:03:25.415007 14150 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:25.415367 13979 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:25.513346 12617 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 1.
I20260709 13:03:25.228919 14052 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:25.373687 14120 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:25.376423 14147 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:25.341991 14155 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:25.381156 14157 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:25.358484 14119 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:25.388437 14143 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:25.532143 14132 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.445773 14160 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:25.376569 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:25.625605 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:25.626217 14127 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:25.477443 14123 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:25.227459 14029 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:25.475545 12542 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:25.476333 14126 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.234809 14154 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:25.335394 14151 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:25.342173 14153 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:25.323505 14159 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:25.527664 14122 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:25.655843 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:25.641981 14109 ts_tablet_manager.cc:1467] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: Tablet startup took 1181ms
I20260709 13:03:25.514520 14125 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:25.660159 12661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.015s	sys 0.087s
W20260709 13:03:25.731985 12661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.016s	sys 0.087s
I20260709 13:03:25.592759 14139 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.657732 14116 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:25.660604 13229 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 1.
I20260709 13:03:25.660218 14119 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:25.728508 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:25.652953 13979 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.670243 14136 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:25.627821 14106 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:25.675834 12662 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.002s	sys 0.017s
W20260709 13:03:25.758515 12662 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.004s	sys 0.017s
I20260709 13:03:25.647500 14087 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:25.758338 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:25.734575 13232 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 1.
W20260709 13:03:25.669386 12568 debug-util.cc:398] Leaking SignalData structure 0x7b080031afe0 after lost signal to thread 12571
I20260709 13:03:25.669849 14134 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:25.534503 14142 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:25.766832 14163 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:25.648501 14131 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.629493 14146 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:25.769984 14151 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:25.674917 14149 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:25.776286 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:25.679461 14107 log.cc:927] Time spent T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 13:03:25.676091 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:25.748914 14173 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:25.777257 12615 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 1.
I20260709 13:03:25.667945 14123 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.719717 14145 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:25.776245 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:25.747906 14135 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:25.660411 14143 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:25.771366 14127 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:25.797005 12695 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 1.
I20260709 13:03:25.756604 14116 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:25.676326 14157 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.805416 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:25.665815 14150 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:25.649319 14129 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:25.663756 14148 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:25.784582 14133 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:25.810770 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:25.806228 12692 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
W20260709 13:03:25.804984 12568 debug-util.cc:398] Leaking SignalData structure 0x7b080032be00 after lost signal to thread 12646
I20260709 13:03:25.670177 14144 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:25.814081 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:25.802052 14135 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:25.796326 14052 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:25.818768 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:25.819510 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:25.664197 14147 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:25.805509 14167 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:25.801687 14151 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:25.817984 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:25.820789 14162 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:25.819527 12689 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:25.668107 14155 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:25.806180 14118 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:03:25.815264 12568 debug-util.cc:398] Leaking SignalData structure 0x7b0800350600 after lost signal to thread 12647
I20260709 13:03:25.829542 14125 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:25.829895 14119 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:25.820932 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:25.830626 14123 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:25.828348 12695 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:25.676397 14160 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.830987 14087 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:25.787870 14159 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.826109 14152 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:25.840760 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:25.794270 14163 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:25.825737 14052 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.771926 14153 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.821393 14127 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:25.853072 12617 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 1.
W20260709 13:03:25.853696 12588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.074s	sys 0.131s
W20260709 13:03:25.854151 12588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.075s	sys 0.131s
I20260709 13:03:25.855032 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:25.837213 14145 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:25.836699 14137 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:25.856092 13233 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:25.844586 14141 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:25.831705 14135 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.833977 14118 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:25.831072 14166 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:25.871922 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:25.857848 14126 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:25.870649 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:25.850343 14156 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:25.850823 14132 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:25.843863 14151 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:25.808022 14173 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:25.875748 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:25.830643 14167 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.803643 14134 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.873804 14029 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:25.893987 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:25.860329 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:25.877488 13979 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:25.838922 14162 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:25.864233 14152 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:25.879407 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:25.894656 12692 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:26.046553 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:25.996160 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.051446 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:26.051347 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:25.894976 12691 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
W20260709 13:03:25.733474 14109 ts_tablet_manager.cc:1469] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: Trace:
0709 13:03:23.075304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.079708 (+  4404us) service_pool.cc:224] Handling call
0709 13:03:23.161441 (+ 81733us) ts_tablet_manager.cc:934] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
0709 13:03:23.323339 (+161898us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:03:23.362475 (+ 39136us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:23.362590 (+   115us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:03:23.382455 (+ 19865us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:03:23.382873 (+   418us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:23.383262 (+   389us) ts_tablet_manager.cc:989] Replica registered.
0709 13:03:23.383322 (+    60us) inbound_call.cc:177] Queueing success response
0709 13:03:23.415775 (+ 32453us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:03:24.460424 (+1044649us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:03:24.528051 (+ 67627us) tablet_replica.cc:261] Starting instrumentation
0709 13:03:24.528721 (+   670us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":3660,"mutex_wait_us":210998,"raft.queue_time_us":247212,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":230,"tablet-copy.queue_time_us":66886,"tablet-download-pool.queue_time_us":273,"tablet-download-pool.run_cpu_time_us":1221,"tablet-download-pool.run_wall_time_us":4194,"thread_start_us":159972,"threads_started":3}
I20260709 13:03:25.887465 14139 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:26.052956 12616 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:26.061322 14148 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:26.062000 14052 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:26.062096 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:26.067734 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 175982us
I20260709 13:03:26.046738 14170 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:25.987067 14125 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:25.868098 14145 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:26.076766 14153 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:26.076758 14127 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:26.078653 14155 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:26.011355 14118 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:26.063560 14142 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:25.939896 14150 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:26.086711 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:26.052713 14157 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:26.016299 14134 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:25.999094 14131 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:25.934827 14129 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:25.947451 14144 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:26.097748 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.101897 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:26.108644 12547 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 1.
I20260709 13:03:25.947667 14171 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:26.120721 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:25.889264 14166 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:26.129422 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:26.130193 12543 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:26.130381 14145 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:26.130570 14166 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:26.128136 12568 debug-util.cc:398] Leaking SignalData structure 0x7b08002e5d20 after lost signal to thread 12720
I20260709 13:03:26.120159 14151 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:26.110379 14159 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:26.139125 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.140269 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:26.141377 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:26.141757 12547 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 1.
I20260709 13:03:26.123502 14163 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:26.147361 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.109592 14125 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:26.150871 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 292016us
I20260709 13:03:26.151917 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:26.119639 14170 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:26.137722 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:26.178933 14160 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:26.179087 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:26.144562 12568 debug-util.cc:398] Leaking SignalData structure 0x7b08000ba6c0 after lost signal to thread 13259
I20260709 13:03:26.179826 14173 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:26.182896 12542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 228) took 1621 ms (client timeout 1760 ms). Trace:
I20260709 13:03:26.185984 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:26.153330 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:26.179831 12543 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:26.127914 14147 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:26.201783 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:26.218487 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:26.219816 13197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.000s	sys 0.031s
W20260709 13:03:26.220216 13197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.000s	sys 0.031s
W20260709 13:03:26.220551 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 747344us
I20260709 13:03:26.141222 14171 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:26.183435 12542 rpcz_store.cc:269] 0709 13:03:24.561497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.095316 (+533819us) service_pool.cc:224] Handling call
0709 13:03:26.182666 (+1087350us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54000a5ad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:26.182800 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":562320128}
I20260709 13:03:26.223943 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:26.225870 13197 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:26.226398 14107 tablet_bootstrap.cc:492] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:03:26.229902 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:26.227679 12539 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:26.237785 13979 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:26.238336 13979 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:26.238844 13979 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:26.239074 14130 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:26.178579 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.250371 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.252915 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:26.253526 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 52677.3us
I20260709 13:03:26.258512 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.260140 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:26.260479 13226 raft_consensus.cc:1217] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:03:26.261435 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 221) took 1692 ms. Trace:
I20260709 13:03:26.261683 14122 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:26.263424 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:26.264495 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.261891 12546 rpcz_store.cc:276] 0709 13:03:24.559346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.456357 (+897011us) service_pool.cc:224] Handling call
0709 13:03:25.456672 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:25.920873 (+464201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:25.920917 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:25.920972 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:25.921026 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.251939 (+330913us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b5400228654. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:26.251982 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.252104 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1067123456}
I20260709 13:03:26.261427 12632 tablet_copy_service.cc:342] P a11816c5d72e4d1295a242f3ced09e5f: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-f2abdbdc67164b32bd58bfe3763a4183 received from {username='slave'} at 127.0.0.1:60170
I20260709 13:03:26.265789 12632 tablet_copy_service.cc:434] P a11816c5d72e4d1295a242f3ced09e5f: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-f2abdbdc67164b32bd58bfe3763a4183 on tablet f2abdbdc67164b32bd58bfe3763a4183 with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:26.266180 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.267364 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.267515 14143 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:26.267741 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1130) took 1774 ms. Trace:
I20260709 13:03:26.268455 14107 tablet_bootstrap.cc:492] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372: Bootstrap complete.
I20260709 13:03:26.268150 12687 rpcz_store.cc:276] 0709 13:03:24.495055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.568268 (+ 73213us) service_pool.cc:224] Handling call
0709 13:03:24.759277 (+191009us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:25.090246 (+330969us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:25.090284 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:25.090328 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:25.090365 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.267402 (+1177037us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54000c85d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:26.267455 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.267571 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":760635648}
I20260709 13:03:26.269441 14107 ts_tablet_manager.cc:1403] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent bootstrapping tablet: real 2.807s	user 0.045s	sys 0.078s
I20260709 13:03:26.268455 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.275138 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.281086 12513 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:26.281855 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 366) took 1048 ms. Trace:
W20260709 13:03:26.287556 13200 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.027s	sys 0.058s
I20260709 13:03:26.287580 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:26.289091 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.289949 12620 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 1.
W20260709 13:03:26.287976 13200 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.027s	sys 0.058s
I20260709 13:03:26.290477 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.284211 13232 rpcz_store.cc:276] 0709 13:03:25.233062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.299788 (+ 66726us) service_pool.cc:224] Handling call
0709 13:03:26.274905 (+975117us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b5400571a54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:26.275013 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644643072}
I20260709 13:03:26.272979 14116 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:26.290613 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 554393us
I20260709 13:03:26.272372 14170 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:26.295328 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:26.293800 14163 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:26.296207 14163 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:26.296576 14163 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:26.295439 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:26.297662 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:26.299403 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:26.297287 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:26.301586 14171 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:26.291221 12688 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:26.305406 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:26.306526 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:26.307322 14150 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:26.307857 14150 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:26.311544 12588 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:26.312315 14171 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:26.312678 14171 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:26.303674 13197 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:26.317454 14173 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:26.317860 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.330350 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:26.313689 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.312920 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:26.382808 14178 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:26.383363 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.383466 14178 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:26.385946 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 141) took 1353 ms. Trace:
I20260709 13:03:26.386698 12659 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:26.329980 14173 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:26.389058 14173 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:26.389802 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:26.390183 14142 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:26.390618 14142 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:26.390983 14142 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:26.391544 14162 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:26.331035 14171 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:26.723349 14107 raft_consensus.cc:359] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:26.724256 14163 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:26.577033 14116 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:26.586906 14172 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:26.726920 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:26.600652 13200 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.760s (SENT)
I20260709 13:03:26.317653 14177 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:26.579002 14152 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:26.728595 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:26.495249 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 182366us
I20260709 13:03:26.452662 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.771065 12688 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:26.330339 14146 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:26.771988 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.772128 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.434909 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:26.773089 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:26.627653 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 239512us
I20260709 13:03:26.774737 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.776726 12659 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:26.381348 14130 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:26.777168 12588 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:26.736810 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:26.741209 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:26.741796 14162 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:03:26.765892 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 178122us
I20260709 13:03:26.773130 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.386386 12622 rpcz_store.cc:276] 0709 13:03:24.939728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.965761 (+ 26033us) service_pool.cc:224] Handling call
0709 13:03:25.067767 (+102006us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:25.091573 (+ 23806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:25.091614 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:25.091666 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:25.091719 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.293016 (+1201297us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b54003d0ed4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:26.293070 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.293191 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":54241024}
I20260709 13:03:26.600714 14121 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:26.731963 14125 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:26.777771 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.781810 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:26.784051 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.785193 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.786047 14150 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:26.786520 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.765044 14116 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:26.745677 14107 raft_consensus.cc:740] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Initialized, Role: LEARNER
I20260709 13:03:26.790375 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:26.785346 14162 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:26.745200 14178 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:26.782292 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:26.783293 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.793421 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.785982 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.799808 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:26.796060 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.803460 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:26.826296 12622 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:03:26.827286 12545 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 1.
I20260709 13:03:26.828202 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.828754 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.829262 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.830143 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.791364 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 1140) took 1063 ms. Trace:
I20260709 13:03:26.831696 14162 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:26.832000 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.824633 12688 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:26.790899 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.789465 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 273) took 1056 ms. Trace:
I20260709 13:03:26.832118 12689 rpcz_store.cc:276] 0709 13:03:25.727599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.727822 (+   223us) service_pool.cc:224] Handling call
0709 13:03:26.791169 (+1063347us) spinlock_profiling.cc:243] Waited 56.6 ms on lock 0x7b54002ca454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:26.791283 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130183040}
I20260709 13:03:26.825420 13235 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:03:26.778779 14130 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:26.803531 14135 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:26.842140 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.842375 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.844851 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.843468 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.818192 14163 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:26.824285 14166 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:26.847473 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.826850 14116 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:26.787904 14152 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:26.847956 12620 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 1.
I20260709 13:03:26.780613 14172 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:26.856236 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.856612 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:26.853521 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:26.857689 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.857704 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.842401 14130 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:26.858974 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.861234 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.861280 12621 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:26.788774 14177 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:26.863011 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.864735 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.846885 14150 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:26.867489 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.867833 12659 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:26.867849 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.854212 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:26.868541 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.871156 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.857048 14152 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:26.838176 12693 rpcz_store.cc:276] 0709 13:03:25.732607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.122450 (+389843us) service_pool.cc:224] Handling call
0709 13:03:26.128886 (+  6436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:26.137017 (+  8131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:26.138132 (+  1115us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:26.143172 (+  5040us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:26.144469 (+  1297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.789118 (+644649us) spinlock_profiling.cc:243] Waited 2.54 ms on lock 0x7b540009d154. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:26.789171 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.789288 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5832960}
I20260709 13:03:26.874393 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:26.874536 14166 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:26.862630 14171 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:26.900166 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:26.897329 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.900234 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.849303 14107 consensus_queue.cc:260] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:26.902803 12512 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:26.896564 14152 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:26.904069 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 83115.7us
I20260709 13:03:26.906605 13234 raft_consensus.cc:1217] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:03:26.898975 14166 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:03:26.909107 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 250632us
I20260709 13:03:26.875334 14150 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:26.905386 14147 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:26.931125 14147 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:26.931645 14147 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:26.934022 12691 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:26.935272 14150 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:26.910295 14166 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:26.919942 12619 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:26.947273 14179 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:26.949012 14125 raft_consensus.cc:3055] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:26.949400 14125 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:26.950595 14107 ts_tablet_manager.cc:1434] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent starting tablet: real 0.681s	user 0.015s	sys 0.042s
I20260709 13:03:26.950268 14125 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:26.951016 14107 ts_tablet_manager.cc:1467] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372: Tablet startup took 681ms
W20260709 13:03:26.922199 14142 consensus_meta.cc:287] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.531s	user 0.010s	sys 0.000s
I20260709 13:03:26.923075 14171 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:26.930007 14152 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:26.956440 14152 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:26.957442 14138 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:26.957156 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:26.959461 14177 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:26.919739 13979 consensus_meta.cc:287] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.680s	user 0.009s	sys 0.003s
I20260709 13:03:26.976940 14147 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:26.965071 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:26.965978 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1051) took 1112 ms. Trace:
I20260709 13:03:26.967197 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 151) took 1312 ms. Trace:
I20260709 13:03:26.967531 14172 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:26.987658 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.999694 12617 rpcz_store.cc:276] 0709 13:03:25.650847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.655580 (+  4733us) service_pool.cc:224] Handling call
0709 13:03:26.962901 (+1307321us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b5400104ad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:26.963012 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279283456}
I20260709 13:03:26.967669 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:26.968221 14167 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:26.998965 12538 rpcz_store.cc:276] 0709 13:03:25.853447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.853625 (+   178us) service_pool.cc:224] Handling call
0709 13:03:25.864114 (+ 10489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:26.067443 (+203329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:26.067490 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:26.067555 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:26.067604 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.965655 (+898051us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b540018cc54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:26.965698 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:26.965804 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467075840}
I20260709 13:03:26.970711 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.971537 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:26.968839 12587 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:26.973927 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:27.010601 12587 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:26.974663 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:26.975203 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:27.011502 14159 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:26.975294 12615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 147) took 1557 ms (client timeout 1757 ms). Trace:
I20260709 13:03:27.012274 14159 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:27.012706 14125 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.012913 13231 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:26.962414 14154 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:26.977595 14142 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:27.013538 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 631) took 1136 ms. Trace:
I20260709 13:03:27.016156 13231 rpcz_store.cc:276] 0709 13:03:25.877142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.959081 (+1081939us) service_pool.cc:224] Handling call
0709 13:03:27.013484 (+ 54403us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:27.017130 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:26.965368 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:26.963519 12512 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:27.004711 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:27.018337 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 54870.1us
I20260709 13:03:27.019107 12512 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:27.017627 14142 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:27.021734 14141 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:27.024118 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:27.025224 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:27.026489 14141 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:27.026945 14141 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.027379 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:27.028960 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:27.029536 13234 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:26.989908 14166 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:26.991153 14116 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:26.992951 13979 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:26.995478 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:27.001976 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:27.005812 13197 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:03:27.040149 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 50006.5us
I20260709 13:03:27.041857 13197 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:27.022122 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:26.988454 14106 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:27.046270 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:27.012439 12615 rpcz_store.cc:269] 0709 13:03:25.417491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.417769 (+   278us) service_pool.cc:224] Handling call
0709 13:03:26.975141 (+1557372us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b54001ea0d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:26.975243 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":699033472}
I20260709 13:03:27.034559 13200 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:27.044173 12587 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:27.050581 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:27.055352 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:27.055626 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:27.056069 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:26.951469 14107 ts_tablet_manager.cc:1469] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372: Trace:
0709 13:03:23.144666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:23.145008 (+   342us) service_pool.cc:224] Handling call
0709 13:03:23.193839 (+ 48831us) ts_tablet_manager.cc:934] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372: Initiating tablet copy from peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307)
0709 13:03:23.324351 (+130512us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:03:23.391045 (+ 66694us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:23.391174 (+   129us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:03:23.420174 (+ 29000us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:03:23.420461 (+   287us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:23.420782 (+   321us) ts_tablet_manager.cc:989] Replica registered.
0709 13:03:23.420846 (+    64us) inbound_call.cc:177] Queueing success response
0709 13:03:23.462469 (+ 41623us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:03:26.270028 (+2807559us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:03:26.311988 (+ 41960us) tablet_replica.cc:261] Starting instrumentation
0709 13:03:26.312599 (+   611us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":652,"raft.queue_time_us":3031,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":1043,"tablet-copy.queue_time_us":36268,"tablet-download-pool.queue_time_us":224,"tablet-download-pool.run_cpu_time_us":1167,"tablet-download-pool.run_wall_time_us":6999,"thread_start_us":92795,"threads_started":2}
I20260709 13:03:27.057261 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:27.057705 12538 raft_consensus.cc:1240] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:27.012297 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:27.055408 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:27.056821 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:27.030300 14177 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:27.015530 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:27.012706 14159 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:27.073468 14159 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.073868 13227 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:27.013844 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2294) took 1136 ms. Trace:
I20260709 13:03:27.060654 13199 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:27.077297 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:27.077667 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:27.078665 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:27.063956 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:27.058867 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:27.081199 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:27.081684 13228 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:27.065971 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:27.062047 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:27.086124 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:27.087926 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:27.067000 14176 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:27.067617 14147 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:27.067672 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:27.068109 14123 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:27.069300 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:27.071775 14171 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:27.060344 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:27.070807 13200 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:27.071841 12622 raft_consensus.cc:1240] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:27.072624 13197 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:27.099345 12541 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:27.076753 12659 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:27.080258 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:27.051208 14138 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:27.084434 12546 raft_consensus.cc:2393] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 3: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:27.094730 12662 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:27.087568 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:27.082196 14130 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:27.089939 13199 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:27.110543 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:27.089078 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:27.080123 14177 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:27.117851 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:03:27.112515 12692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 277) took 1301 ms (client timeout 1609 ms). Trace:
I20260709 13:03:27.127863 14184 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:27.128562 14184 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:27.091089 14120 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:03:27.125416 12692 rpcz_store.cc:269] 0709 13:03:25.810814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.812020 (+  1206us) service_pool.cc:224] Handling call
0709 13:03:27.112319 (+1300299us) spinlock_profiling.cc:243] Waited 74.5 ms on lock 0x7b540018bd54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:27.112454 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171295488}
I20260709 13:03:27.090934 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1030) took 1154 ms. Trace:
I20260709 13:03:27.126017 14126 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:27.129892 12513 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:27.135722 12588 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:27.115571 14170 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.133903 12443 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36396 (request call id 349) took 2575 ms. Trace:
I20260709 13:03:27.137075 12662 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:27.131096 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:27.111050 14123 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:27.140125 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:27.138763 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:27.126185 14177 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.114317 14138 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:27.141852 12662 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:27.138166 12443 rpcz_store.cc:276] 0709 13:03:24.519893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.522475 (+  2582us) service_pool.cc:224] Handling call
0709 13:03:27.095372 (+2572897us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":833360,"reported_tablets":1}
I20260709 13:03:27.143923 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:27.144315 14123 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:27.144584 14182 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:27.144754 14121 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:27.145181 14106 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:27.145277 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:27.159336 12692 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:27.162497 12588 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:03:27.165666 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 95047.2us
I20260709 13:03:27.145702 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1031) took 1095 ms. Trace:
I20260709 13:03:27.146451 14116 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:27.146401 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:27.166705 12694 rpcz_store.cc:276] 0709 13:03:26.049984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.282325 (+232341us) service_pool.cc:224] Handling call
0709 13:03:27.112484 (+830159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:27.112731 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:27.112777 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:27.112836 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:27.112889 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.112962 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.145435 (+ 32473us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b540018bd50. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:27.145533 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1900039552}
I20260709 13:03:27.147184 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:27.147511 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:27.147828 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:27.134295 12690 rpcz_store.cc:276] 0709 13:03:25.935345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.130496 (+195151us) service_pool.cc:224] Handling call
0709 13:03:26.130811 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:26.222883 (+ 92072us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:26.227143 (+  4260us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:26.233004 (+  5861us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:26.233048 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.076637 (+843589us) spinlock_profiling.cc:243] Waited 85.1 ms on lock 0x7b540009f454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:27.076679 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.088866 (+ 12187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195720576}
I20260709 13:03:27.167930 14117 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:27.170948 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1294) took 1062 ms. Trace:
I20260709 13:03:27.171036 14117 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:27.171646 14117 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:27.171402 12622 rpcz_store.cc:276] 0709 13:03:26.108569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.875761 (+767192us) service_pool.cc:224] Handling call
0709 13:03:26.899304 (+ 23543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:27.098444 (+199140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:27.170702 (+ 72258us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54001e8cd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:27.170866 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396317056}
I20260709 13:03:27.148577 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:27.132480 14120 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:27.149887 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:27.150573 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:27.151027 14130 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:27.090755 14176 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:27.153409 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:27.147567 13979 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:27.146962 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:27.158102 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:27.179194 12692 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:27.148928 12695 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:27.173915 12662 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:27.137715 14126 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:27.174309 12588 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:27.140440 14132 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:03:27.177222 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 87371.8us
I20260709 13:03:27.119817 14162 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.152284 14163 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:27.178758 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 106176us
I20260709 13:03:27.158245 14142 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:27.164825 14182 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:27.180986 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:27.190624 13200 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:27.083505 12614 rpcz_store.cc:276] 0709 13:03:25.877322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.882074 (+  4752us) service_pool.cc:224] Handling call
0709 13:03:26.964295 (+1082221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:26.964498 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:26.964524 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:26.964564 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:26.964598 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:26.964655 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:27.013669 (+ 49014us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400104ad0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:27.013787 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2350741376}
I20260709 13:03:27.195704 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:27.164392 14138 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:27.151258 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:27.182957 13199 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:27.166532 14121 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:27.168025 13230 raft_consensus.cc:1240] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 1. Current term is 2. Ops: []
W20260709 13:03:27.192875 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.197438 12444 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36394 (request call id 334) took 2703 ms. Trace:
W20260709 13:03:27.193768 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 91487.9us
I20260709 13:03:27.177750 14120 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.198971 12588 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:27.181668 14126 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:27.174685 14155 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:27.178048 14172 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:27.202950 12444 rpcz_store.cc:276] 0709 13:03:24.470373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:24.470534 (+   161us) service_pool.cc:224] Handling call
0709 13:03:27.173363 (+2702829us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":815389,"reported_tablets":4}
I20260709 13:03:27.182296 14132 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:27.180150 14176 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:27.189859 14116 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:27.179311 14154 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.193598 14170 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:27.204427 13199 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:27.209959 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:27.198143 14152 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:27.209836 14172 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:27.202260 14121 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.193994 14142 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:27.213411 13908 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:27.198760 14182 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:27.178166 14106 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:27.243440 13199 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:27.260954 13199 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:27.213006 14132 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.278645 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:27.282189 13908 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:27.283735 13908 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:27.284098 13908 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:27.220587 14164 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:27.214208 14116 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:27.213591 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:03:27.286484 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 87586.4us
I20260709 13:03:27.244632 14184 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:27.212690 14183 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.251799 14172 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.292894 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:27.306164 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:27.292632 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:27.293807 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:27.294003 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:27.276638 14166 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:27.295452 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:27.254652 14142 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.294847 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:27.283077 14130 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.308928 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:27.291298 14116 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:27.308997 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:27.309237 12512 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:27.212967 14155 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:27.313970 14143 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.316211 13199 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:27.320365 13199 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:03:27.320585 12662 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:27.321475 13199 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:27.322618 12512 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:27.323673 12512 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:27.321106 12616 raft_consensus.cc:2393] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 2: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:27.327313 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:27.319631 14162 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.316542 13979 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:27.331888 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:27.332290 14147 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.316530 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:27.324848 14184 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:27.324739 14143 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.337198 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:27.328537 14188 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.327520 14175 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:27.370244 14175 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:27.370816 14175 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:27.329048 14166 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.330999 14130 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:27.367383 12445 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50014 (request call id 219) took 1924 ms. Trace:
W20260709 13:03:27.367887 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 208471us
I20260709 13:03:27.375458 13908 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:27.329130 14146 consensus_queue.cc:1059] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
W20260709 13:03:27.404153 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 76084.7us
I20260709 13:03:27.410439 12510 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:27.411149 12445 rpcz_store.cc:276] 0709 13:03:25.381339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.386195 (+  4856us) service_pool.cc:224] Handling call
0709 13:03:27.305635 (+1919440us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1701488,"reported_tablets":2}
I20260709 13:03:27.413120 13908 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:27.412998 13199 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:27.420747 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:27.408663 14187 raft_consensus.cc:1064] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:27.382344 14130 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:27.440228 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:27.470944 14146 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.474522 14155 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:27.427675 14184 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:27.428146 14188 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.381979 14162 consensus_queue.cc:1059] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 13:03:27.506453 14143 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:27.507803 14162 raft_consensus.cc:3055] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:27.487082 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:27.516141 14143 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:27.514953 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:27.453513 14130 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:27.519918 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 329354us
I20260709 13:03:27.529044 13200 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:27.530087 14183 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:27.532945 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 112277us
I20260709 13:03:27.535992 14172 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:27.537226 14135 consensus_queue.cc:1059] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:27.534799 12510 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:27.539005 14163 raft_consensus.cc:3055] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:27.539399 14163 raft_consensus.cc:740] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:27.540287 14163 consensus_queue.cc:260] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:27.541515 14163 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:27.544263 14193 raft_consensus.cc:3055] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:27.544866 14193 raft_consensus.cc:740] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:27.453084 14191 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.521245 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:27.546967 13235 raft_consensus.cc:2393] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 2: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:27.550043 13200 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:27.550170 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:27.552323 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:27.551059 14135 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:27.561807 12618 raft_consensus.cc:1240] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:27.563767 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 123679us
I20260709 13:03:27.563786 12510 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:27.565212 12510 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:27.566416 12510 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:27.566970 14126 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:27.568702 14126 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:03:27.563021 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 358406us
I20260709 13:03:27.570746 12587 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:03:27.519279 14162 raft_consensus.cc:740] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:27.573354 12662 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:27.575167 12662 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:03:27.575328 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 251711us
I20260709 13:03:27.572281 12510 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:27.576009 12512 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:27.576251 12662 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:27.576988 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:27.559990 13979 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.573999 12587 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:27.579890 13200 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:27.561106 14106 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:27.581466 12587 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:27.572631 14122 raft_consensus.cc:1064] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:27.583195 12512 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:27.569634 14135 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.571964 14147 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:27.578349 13227 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:27.571741 14178 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:27.600394 14178 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:27.600829 14178 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:27.601408 12512 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:27.610868 14178 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:27.585305 14052 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.614512 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:27.598400 12587 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:03:27.581182 14191 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:27.583068 14188 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:27.613333 12614 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:27.580667 14152 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:27.583220 14170 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.622880 14171 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:27.590099 14155 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.645843 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:27.594810 14197 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.585374 14192 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:27.636740 14200 consensus_queue.cc:1059] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:03:27.638548 14188 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:27.651674 12442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36398 (request call id 350) took 2005 ms. Trace:
I20260709 13:03:27.654042 14122 consensus_queue.cc:237] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:27.655441 14116 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:27.638065 14147 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.585147 14184 consensus_queue.cc:1059] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:03:27.634739 14172 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:27.683784 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 97533.2us
W20260709 13:03:27.685009 14125 consensus_meta.cc:287] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.672s	user 0.004s	sys 0.017s
I20260709 13:03:27.686889 14143 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:27.688437 14123 consensus_meta.cc:287] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.512s	user 0.000s	sys 0.018s
I20260709 13:03:27.644358 14152 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:03:27.664572 14141 consensus_meta.cc:287] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.637s	user 0.021s	sys 0.006s
I20260709 13:03:27.614624 14150 consensus_queue.cc:1059] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:03:27.688817 14142 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:27.623932 14193 consensus_queue.cc:260] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:27.682047 12442 rpcz_store.cc:276] 0709 13:03:25.628328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.641685 (+ 13357us) service_pool.cc:224] Handling call
0709 13:03:27.633920 (+1992235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1378789,"reported_tablets":2}
W20260709 13:03:27.693678 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 83857.6us
I20260709 13:03:27.588951 14190 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.692795 14188 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.662910 14191 consensus_queue.cc:1059] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:03:27.679347 14162 consensus_queue.cc:260] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:27.707748 14152 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.723605 14178 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:27.717041 13228 consensus_meta.cc:287] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.635s	user 0.011s	sys 0.007s
I20260709 13:03:27.710358 14207 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:27.742777 14193 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.743278 14191 raft_consensus.cc:3055] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:27.743652 14191 raft_consensus.cc:740] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:03:27.730983 14159 consensus_meta.cc:287] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.657s	user 0.006s	sys 0.009s
I20260709 13:03:27.751959 12510 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:27.709899 14141 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:27.765290 12510 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:27.742345 14207 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:27.710585 14123 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:27.745111 13228 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:27.748680 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:03:27.775767 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.744467 14191 consensus_queue.cc:260] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:27.781950 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 232037us
W20260709 13:03:27.780804 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 182506us
I20260709 13:03:27.804126 12696 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:27.772392 14178 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:27.750751 14176 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:27.882014 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 115041us
I20260709 13:03:27.761857 14159 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:27.773533 14207 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.803264 14164 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:27.843030 12588 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:03:27.892568 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 49658us
I20260709 13:03:27.839135 14147 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.903736 12662 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:27.905119 12662 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:27.805838 14162 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:27.808594 14143 raft_consensus.cc:3055] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:03:27.877295 14182 consensus_meta.cc:287] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.602s	user 0.007s	sys 0.014s
W20260709 13:03:27.763850 14200 consensus_queue.cc:1175] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a11816c5d72e4d1295a242f3ced09e5f" responder_term: 1 status { last_received { term: 1 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 1 index: 4 } }
W20260709 13:03:27.958020 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:27.775207 14175 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:27.963551 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 198338us
I20260709 13:03:27.957050 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:27.961849 13234 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:27.877357 13231 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 1. Current term is 2. Ops: []
W20260709 13:03:27.902638 14117 consensus_meta.cc:287] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.722s	user 0.010s	sys 0.011s
W20260709 13:03:27.904438 14138 consensus_meta.cc:287] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.704s	user 0.009s	sys 0.010s
I20260709 13:03:27.964656 12510 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:27.905779 14177 consensus_meta.cc:287] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.734s	user 0.011s	sys 0.000s
W20260709 13:03:27.966660 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 61632.4us
I20260709 13:03:27.934666 14154 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.838462 14173 consensus_queue.cc:1059] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.127s
I20260709 13:03:27.903879 14205 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:27.968839 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:27.753793 12690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22a877009d42412fb470ba88a418be05"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:27.933485 14191 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:27.880811 14130 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:27.932075 14208 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:27.956179 14143 raft_consensus.cc:740] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:27.934155 14155 consensus_queue.cc:1059] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:03:27.967851 13229 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:27.972384 14179 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.963830 14182 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:27.985487 14116 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:27.992738 14132 consensus_meta.cc:287] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.700s	user 0.003s	sys 0.021s
I20260709 13:03:28.013346 13230 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:27.998047 13226 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:27.998406 12690 raft_consensus.cc:606] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:03:28.016376 14175 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:28.017743 14212 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:27.994570 14205 raft_consensus.cc:697] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:28.019987 14182 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:28.020967 12617 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:27.827325 14187 consensus_queue.cc:237] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:27.972872 14117 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:28.030020 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:27.985750 14138 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:28.055788 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:28.007081 14142 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:28.037333 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 72788.3us
I20260709 13:03:28.043493 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:27.987624 14177 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:28.057224 12510 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:28.060389 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:28.064245 12510 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:28.065032 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1062) took 1094 ms. Trace:
I20260709 13:03:28.035405 12690 raft_consensus.cc:614] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:28.068204 12696 rpcz_store.cc:276] 0709 13:03:26.970930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:26.974434 (+  3504us) service_pool.cc:224] Handling call
0709 13:03:28.064820 (+1090386us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b5400405454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:28.064959 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1619280128}
I20260709 13:03:28.071951 12510 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:28.072595 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:28.054047 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:27.993798 14208 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:28.086167 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:28.088944 12544 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:28.060892 14117 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:28.021545 14132 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:28.093511 12510 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:28.061798 14141 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:28.089751 13232 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:28.061491 12556 tablet_copy_service.cc:342] P a70479a3b4114f3581095e9890f5d653: Request end of tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-ddff67072e694e36addbc3b673b008d0 received from {username='slave'} at 127.0.0.1:35624
I20260709 13:03:28.091209 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:28.087442 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:28.097646 13200 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:28.077713 14123 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:28.109086 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:28.086014 14135 raft_consensus.cc:3055] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:03:28.096220 14121 consensus_meta.cc:287] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.819s	user 0.016s	sys 0.005s
I20260709 13:03:28.113809 14126 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:28.123965 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 640) took 1108 ms. Trace:
I20260709 13:03:28.107324 14163 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.121477 13228 raft_consensus.cc:1217] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:03:28.080552 14214 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:28.115296 14135 raft_consensus.cc:740] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:28.098846 14210 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:28.054047 14143 consensus_queue.cc:260] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:28.091928 14215 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.163347 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:28.121472 14176 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:28.134944 13234 rpcz_store.cc:276] 0709 13:03:27.008231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.060728 (+ 52497us) service_pool.cc:224] Handling call
0709 13:03:27.095961 (+ 35233us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b58000f6398. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:03:27.096132 (+   171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:27.966213 (+870081us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.116772 (+150559us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b54001dfe54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:28.116938 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1980886272}
I20260709 13:03:28.113008 14159 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:28.153117 14132 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:28.157092 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:28.154505 14130 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:28.163403 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:28.116592 12556 tablet_copy_service.cc:434] P a70479a3b4114f3581095e9890f5d653: ending tablet copy session 66750b8bbd4c4b3a9695951d0ede3372-ddff67072e694e36addbc3b673b008d0 on tablet ddff67072e694e36addbc3b673b008d0 with peer 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:28.167615 14152 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:28.168917 14190 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.168757 14188 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:28.171058 14120 consensus_meta.cc:287] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.952s	user 0.014s	sys 0.011s
I20260709 13:03:28.172142 14138 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:28.148069 14205 consensus_queue.cc:237] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:28.122166 14121 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:28.185602 14126 raft_consensus.cc:697] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:28.186431 14177 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:28.191067 13200 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:28.191468 14208 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:28.180626 14135 consensus_queue.cc:260] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:28.236923 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:28.266772 12614 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:28.271130 14126 consensus_queue.cc:237] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:28.275501 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 84573.1us
I20260709 13:03:28.274847 14188 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:28.278118 14138 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:28.276929 13200 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:28.278687 14121 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:28.279789 14138 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:28.248858 14207 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:28.251291 13235 raft_consensus.cc:1240] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:28.253038 14152 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:28.232529 14120 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:28.288297 14120 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:28.289300 12547 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:28.291266 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:28.291631 14207 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:28.292156 12692 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 3: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:03:28.255805 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 136056us
I20260709 13:03:28.331701 13199 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:28.333097 14126 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:03:28.351279 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.352373 14182 raft_consensus.cc:1064] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:28.361431 14182 consensus_queue.cc:237] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:28.413645 13200 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:28.416738 14138 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:28.417099 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:03:28.418427 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 94081us
I20260709 13:03:28.419693 13200 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:28.421161 14130 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:03:28.421430 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.421813 14130 raft_consensus.cc:697] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:28.422891 14130 consensus_queue.cc:237] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:28.427341 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:28.428196 12692 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:28.439297 14154 raft_consensus.cc:3055] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:28.439723 13197 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:28.440299 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:28.440946 12621 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:28.443086 14120 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:03:28.445678 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.439847 14154 raft_consensus.cc:740] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:03:28.449038 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 354350us
I20260709 13:03:28.449041 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:28.448961 14154 consensus_queue.cc:260] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:28.450384 14154 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:28.450877 12510 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:28.451953 12510 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:28.453212 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:28.454008 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.453909 14162 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.454845 14178 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.454953 14162 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:28.454766 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:28.456202 12621 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:28.457129 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:28.461033 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:28.461791 12542 raft_consensus.cc:2393] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 2: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:28.462529 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:28.462574 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:28.463658 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:28.464712 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:28.458397 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:28.465612 13228 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEARNER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:03:28.466187 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:28.466521 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:28.467083 14179 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:28.467530 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:28.468653 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:28.469024 12662 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:28.458675 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:28.469621 12692 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:28.469738 14179 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.470417 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:28.471028 13228 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEARNER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:03:28.471457 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:28.472430 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:28.472577 12443 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36394 (request call id 335) took 1169 ms. Trace:
I20260709 13:03:28.473107 12662 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:28.459120 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:28.474036 14179 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.472951 12443 rpcz_store.cc:276] 0709 13:03:27.302994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.303155 (+   161us) service_pool.cc:224] Handling call
0709 13:03:28.472519 (+1169364us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":576244,"reported_tablets":1}
I20260709 13:03:28.475041 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:28.475237 12662 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:28.475649 12545 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:28.475932 14179 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.459322 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:28.478040 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:28.476559 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:28.478856 12545 raft_consensus.cc:2393] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 2: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:28.479135 12613 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:28.459582 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:28.481043 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:28.481328 12541 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:03:28.482533 12541 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:28.483950 14185 consensus_queue.cc:1059] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:28.485630 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:28.481408 12543 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:28.486964 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:28.487166 14135 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:28.489039 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:28.473397 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:28.492174 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:28.493791 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:28.496286 12588 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:28.497985 12619 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:28.500279 14172 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:28.511610 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 620699us
I20260709 13:03:28.512892 12587 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:28.515053 13908 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:28.515611 13908 raft_consensus.cc:697] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:28.517446 14188 consensus_queue.cc:1059] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:28.518330 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:28.516564 12690 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:28.518517 14188 raft_consensus.cc:3055] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:28.520776 14188 raft_consensus.cc:740] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:28.521972 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:28.521734 14188 consensus_queue.cc:260] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:28.522523 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:28.522953 14188 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:28.524133 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:28.525466 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:28.528699 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:28.530460 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:28.531036 12512 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:28.532181 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:28.532461 12513 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:28.531064 14183 raft_consensus.cc:3055] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:28.533289 14183 raft_consensus.cc:740] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:28.534231 14183 consensus_queue.cc:260] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:28.535543 14183 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:28.537340 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:28.537685 14162 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:28.538337 14162 raft_consensus.cc:697] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:28.539891 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:28.539464 14162 consensus_queue.cc:237] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:28.541658 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:28.541447 13908 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:28.542518 12694 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 3: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:28.542883 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 389) took 1219 ms. Trace:
I20260709 13:03:28.543270 13232 rpcz_store.cc:276] 0709 13:03:27.323905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.324093 (+   188us) service_pool.cc:224] Handling call
0709 13:03:27.324410 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.100269 (+775859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.542650 (+442381us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b54007c01d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:28.542825 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1745512704}
I20260709 13:03:28.544219 12694 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:03:28.530501 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:28.545804 13228 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:28.549360 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 638) took 1541 ms. Trace:
I20260709 13:03:28.549865 13231 rpcz_store.cc:276] 0709 13:03:27.007719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.039295 (+ 31576us) service_pool.cc:224] Handling call
0709 13:03:27.066499 (+ 27204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:27.974132 (+907633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.549073 (+574941us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b5400740254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:28.549289 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1753473280}
I20260709 13:03:28.552496 12547 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 3: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:28.554908 12619 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:28.555377 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:28.556566 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:28.557403 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:28.558809 12621 raft_consensus.cc:1240] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:28.561218 12694 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:28.562276 14135 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.562640 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2338) took 1001 ms. Trace:
I20260709 13:03:28.562987 12617 rpcz_store.cc:276] 0709 13:03:27.561590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:27.561696 (+   106us) service_pool.cc:224] Handling call
0709 13:03:27.561963 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.050917 (+488954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.562436 (+511519us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b540007b7d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:28.562585 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1055111424}
I20260709 13:03:28.564119 12694 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:28.563863 14178 consensus_queue.cc:1059] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:28.565306 14200 raft_consensus.cc:3055] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:28.565739 14200 raft_consensus.cc:740] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:28.566748 14200 consensus_queue.cc:260] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:28.568159 12618 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:54242
I20260709 13:03:28.568794 12618 raft_consensus.cc:606] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:03:28.570454 14143 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:28.571426 12544 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:28.574113 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:28.575192 14200 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:28.575913 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:28.578101 12617 raft_consensus.cc:1240] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:28.577857 14125 consensus_queue.cc:1059] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:28.579232 14052 raft_consensus.cc:3055] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:28.579627 14052 raft_consensus.cc:740] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:28.580679 14052 consensus_queue.cc:260] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:28.575682 14147 raft_consensus.cc:3055] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:28.585654 14147 raft_consensus.cc:740] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:28.585759 14166 consensus_queue.cc:1059] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:28.586818 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 627) took 2725 ms. Trace:
I20260709 13:03:28.587004 14166 raft_consensus.cc:3055] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:28.586776 14147 consensus_queue.cc:260] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:28.587554 14166 raft_consensus.cc:740] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:28.587424 13229 rpcz_store.cc:276] 0709 13:03:25.861092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:25.863047 (+  1955us) service_pool.cc:224] Handling call
0709 13:03:27.090053 (+1227006us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b58000f6398. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:03:27.803409 (+713356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.014277 (+210868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:28.538162 (+523885us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5400571a54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:28.586584 (+ 48422us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b5400571a50. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:28.586743 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1891296256}
I20260709 13:03:28.588326 14147 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:28.588661 14166 consensus_queue.cc:260] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:28.594291 14166 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:28.600611 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:28.601436 12540 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 3: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:28.593092 14172 consensus_queue.cc:1059] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:28.590147 12544 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:28.596284 14142 consensus_queue.cc:1059] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:28.590332 12587 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:28.603531 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:28.611426 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:28.612488 14143 consensus_queue.cc:1059] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:28.612816 12690 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:28.613685 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:28.615885 12662 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:28.618322 13197 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:28.596290 12443 catalog_manager.cc:5697] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 1 to 2, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 2 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.621866 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:28.622687 13197 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:03:28.624563 14052 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:28.591925 12542 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:28.626401 14164 consensus_queue.cc:1059] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:28.626976 14176 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.628192 12587 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:28.630348 12692 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:28.631670 12443 catalog_manager.cc:5697] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 1 to 2, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 2 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:28.644431 14150 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:03:28.675583 14144 raft_consensus.cc:3055] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:28.676039 14144 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:28.676936 14144 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:28.678253 14144 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:28.634984 14164 raft_consensus.cc:3055] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:28.646167 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:28.635258 14201 raft_consensus.cc:3055] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:28.683846 12539 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:28.682670 14164 raft_consensus.cc:740] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:03:28.645335 14122 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.011s	sys 0.033s
I20260709 13:03:28.642143 14106 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.640352 14186 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:28.640575 14152 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:28.645114 14126 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:28.707170 12662 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:28.641028 14207 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:03:28.685534 14201 raft_consensus.cc:740] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:28.713500 14201 consensus_queue.cc:260] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:28.714843 14201 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:28.642904 14187 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
W20260709 13:03:28.696197 14122 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.012s	sys 0.033s
I20260709 13:03:28.644866 14123 consensus_queue.cc:1059] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:03:28.643177 14182 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:03:28.719538 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:28.715973 14150 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.720445 14126 raft_consensus.cc:697] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:28.728681 14126 consensus_queue.cc:237] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:28.737032 14162 consensus_queue.cc:1059] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:28.735842 12510 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:28.730789 14182 raft_consensus.cc:3055] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:03:28.735827 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 104099us
I20260709 13:03:28.722855 14202 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:28.748984 12662 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:28.756064 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:28.755739 12510 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:28.738059 14188 raft_consensus.cc:3055] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:28.760362 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:28.731350 14172 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:03:28.749087 14182 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:28.763499 12662 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:28.748005 14162 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.766638 12662 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:28.766933 12510 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:28.758701 14125 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:28.767755 14150 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.762727 14193 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.770311 12587 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:28.771103 13908 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:28.758903 14106 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.771548 13908 raft_consensus.cc:697] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:28.759809 14188 raft_consensus.cc:740] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:28.773492 12662 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:28.769400 14178 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:28.776805 14132 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:28.780494 14132 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:28.780972 14132 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:28.774374 13228 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:28.785410 13229 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:28.785887 14220 consensus_queue.cc:1059] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:28.786980 14220 raft_consensus.cc:3055] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:28.772713 14193 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.787220 13908 consensus_queue.cc:237] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:28.765924 14231 consensus_queue.cc:1059] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:03:28.788837 14231 raft_consensus.cc:3055] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:28.734054 14164 consensus_queue.cc:260] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:28.789180 14231 raft_consensus.cc:740] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:03:28.789971 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:28.787781 14220 raft_consensus.cc:740] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:28.786170 14116 raft_consensus.cc:3055] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:28.772830 14198 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:28.791519 12662 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:28.786954 14188 consensus_queue.cc:260] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:28.815840 14188 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:28.792493 14164 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:28.818671 14143 raft_consensus.cc:3055] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:28.819100 14143 raft_consensus.cc:740] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:28.819928 14143 consensus_queue.cc:260] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:28.821241 14143 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:28.792912 14220 consensus_queue.cc:260] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:28.804634 14185 raft_consensus.cc:3055] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:28.821974 14185 raft_consensus.cc:740] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:28.822867 14185 consensus_queue.cc:260] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:28.824216 14185 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:28.828606 12618 raft_consensus.cc:1275] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:28.808614 14125 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:28.800613 14132 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:28.802258 14116 raft_consensus.cc:740] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:28.811817 14106 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:28.790109 14231 consensus_queue.cc:260] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:28.844177 14138 consensus_queue.cc:1048] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:29.093138 14218 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:29.104691 14202 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:29.113909 14106 raft_consensus.cc:697] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:29.300997 14218 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:29.105003 14201 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:29.268728 14208 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:29.371563 14202 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:29.400810 14126 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.010s	sys 0.039s
I20260709 13:03:29.369647 14201 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:29.372483 14106 consensus_queue.cc:237] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:29.408808 14126 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.011s	sys 0.039s
I20260709 13:03:29.375213 14116 consensus_queue.cc:260] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:29.400730 14208 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:29.408118 14202 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:29.427242 14132 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:29.515549 14126 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:29.516193 14126 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:29.518893 14126 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:29.515743 14188 consensus_meta.cc:287] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.699s	user 0.009s	sys 0.000s
I20260709 13:03:29.531917 14208 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:29.483819 14116 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:29.600987 14201 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:29.606990 14202 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:29.581988 14218 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:03:29.642758 14185 consensus_meta.cc:287] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.818s	user 0.008s	sys 0.003s
W20260709 13:03:29.703567 14143 consensus_meta.cc:287] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.876s	user 0.009s	sys 0.001s
I20260709 13:03:29.878602 14176 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.879381 14176 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:29.882237 14176 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:29.878643 14185 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.928282 14185 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:29.963332 14176 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:29.964705 14176 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:29.968868 14176 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:29.987141 14237 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:29.987895 14237 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:29.991005 14237 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:30.024971 14106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.009s	sys 0.006s
W20260709 13:03:30.025537 14106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.009s	sys 0.006s
I20260709 13:03:30.127396 14176 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:30.128293 14176 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.130725 14176 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.140901 14185 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.142236 14242 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:30.146660 14242 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.144942 14244 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:30.144044 14162 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:03:30.149351 14233 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.003s	sys 0.007s
I20260709 13:03:30.149545 14244 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.152418 14244 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:30.149767 14233 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.003s	sys 0.007s
I20260709 13:03:30.159896 12620 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:30.163101 14244 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:30.163980 14244 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.163285 14246 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:30.165716 14246 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.168048 14244 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:30.168624 14244 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:30.168728 14246 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.169137 14244 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.149896 14162 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.163182 14116 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:30.172855 14241 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:30.175459 14241 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.175892 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:30.178161 14241 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.178697 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:30.180119 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:30.180727 14116 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.191241 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:30.192250 14250 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:30.189599 14116 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.191828 14242 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.192826 14250 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.193324 14242 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.194300 14242 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.196877 14242 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:30.189613 14162 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.197796 14250 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.198635 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 405) took 1557 ms. Trace:
I20260709 13:03:30.199056 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:30.199024 13229 rpcz_store.cc:276] 0709 13:03:28.641609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.644657 (+  3048us) service_pool.cc:224] Handling call
0709 13:03:28.785184 (+140527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:28.785873 (+   689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:30.198427 (+1412554us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400511b50. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:30.198570 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249712384}
I20260709 13:03:30.199864 12613 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 1.
I20260709 13:03:30.201805 13197 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:30.204072 14123 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:30.197388 14242 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:30.186872 14251 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:30.178681 14241 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
W20260709 13:03:30.206535 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.204617 14123 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.209060 14123 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:30.213604 13229 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEARNER]: Advancing to term 3
I20260709 13:03:30.214036 14162 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:30.214897 14162 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.217713 14250 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.218240 14250 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.218799 14162 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.219594 14162 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:30.220351 14250 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.220240 14162 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.220953 14250 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:30.221472 14250 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.205984 14242 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.247259 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:30.248342 14245 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:30.222138 14252 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:30.246054 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:30.261823 13228 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:30.265161 14241 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:03:30.267370 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 1.51734e+06us
I20260709 13:03:30.271013 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:30.271765 13235 raft_consensus.cc:2393] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 2: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:30.267841 14245 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.274232 14245 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.286793 14250 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.206564 14251 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.270684 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:30.270426 12588 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:30.295814 14116 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:30.297374 12513 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:30.269613 14256 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:30.298784 14256 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.300786 13229 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEARNER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:30.301031 14256 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.294298 14245 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.270563 14252 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.301992 14245 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.303434 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:30.307548 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:30.294301 14162 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.308312 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:30.269531 14241 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.308566 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:30.309037 12620 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 1.
I20260709 13:03:30.309294 14252 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.304134 14245 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.308367 14250 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:30.309262 13229 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:30.310353 14241 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:30.310534 13197 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:30.309224 14116 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:30.307952 14256 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:30.311800 12513 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:30.312489 14254 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:30.312953 14254 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:03:30.313023 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.313066 14250 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:30.311650 14256 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:30.314113 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:30.267047 14242 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:30.314397 12588 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:30.268667 14253 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.324501 14253 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.307370 14251 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:30.315073 14254 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:30.308454 13228 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:30.316597 14241 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.535825 14241 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.538224 14241 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.316987 12588 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:03:30.539284 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 222401us
I20260709 13:03:30.540122 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:30.313735 14250 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.317745 14256 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:30.542526 14250 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:30.270812 14255 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.545737 13908 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:30.546437 13908 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:30.545946 14255 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.319499 14162 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:30.549942 14162 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.552166 14162 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.552716 14162 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.344480 14252 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.553984 14252 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.556380 14252 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.315766 14116 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:30.352250 14253 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.360334 14258 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.561605 14258 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.562105 14146 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:30.562637 14146 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.564041 14258 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.360994 14245 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:30.375867 14259 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:30.564692 14245 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:30.414810 12661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.151s	user 0.013s	sys 0.035s
I20260709 13:03:30.559672 14256 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:30.565788 12661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.302s	user 0.014s	sys 0.035s
I20260709 13:03:30.418313 14254 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.566919 14245 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.567152 14106 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:30.568008 14254 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:30.567117 14256 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.420056 14260 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:30.569815 14260 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.570426 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:30.571059 12619 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 1.
I20260709 13:03:30.571528 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:30.435053 14262 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:30.575264 14262 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.541229 12588 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:30.576781 13197 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:30.577523 14262 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.436074 14263 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.442443 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:30.577988 12588 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:30.446290 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:30.580013 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:30.447216 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:30.580531 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:30.445127 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:30.581007 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:30.581988 14152 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:30.582072 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:30.449625 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:30.455057 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:30.583050 14152 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:30.460029 14220 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:30.583050 12540 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:30.586344 12540 raft_consensus.cc:1275] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:30.581342 12619 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:30.481742 14150 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:30.589671 12588 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:30.589869 14150 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.592597 14150 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.593139 14150 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.481316 14052 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.598151 14052 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.600487 14052 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.503233 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:30.601393 12688 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 3: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:30.602725 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:30.603055 13199 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:30.504915 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:30.604019 12693 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:30.604256 14235 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:30.605511 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:30.606376 12693 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:30.607559 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:30.608283 12693 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:30.506012 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:30.609858 12694 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:30.612113 13199 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:30.506567 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:30.612957 14183 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:30.613209 12689 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:30.507556 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:30.508654 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:30.614722 14183 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.615181 12687 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 1.
I20260709 13:03:30.615392 14183 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:30.622382 14150 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.623979 14182 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.510829 14144 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:30.517426 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:30.518195 14126 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.628925 14144 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.629890 14126 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.630779 12688 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 1.
I20260709 13:03:30.523469 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:30.631753 14144 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.632099 12615 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:30.632411 14182 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:30.529227 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:30.632596 14150 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:30.633674 13197 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:30.635246 14190 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:30.635769 14190 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:30.636137 14190 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:30.636739 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.532657 12618 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:30.548552 14255 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.558295 12539 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:30.631800 14126 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.642865 12542 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 1.
I20260709 13:03:30.405237 14251 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.647562 14251 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.648700 14245 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:30.649235 14245 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.651173 14245 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.652745 14126 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.564752 14259 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.653267 14126 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.572031 14260 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.425894 12622 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:30.433938 14261 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:30.655324 14261 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.655601 14126 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.657445 14126 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.574335 14244 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:30.662019 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:30.578251 14263 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.578676 14243 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:30.585129 12545 raft_consensus.cc:2393] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 2: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:30.482316 14193 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:30.482874 14170 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:30.495954 14264 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.678786 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:30.580943 12546 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:30.648159 12618 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:30.657639 14261 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.633034 14052 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:30.567724 14106 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.614147 13199 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:30.553210 14162 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:30.664448 14245 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:30.657485 12513 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:03:30.700435 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 86356.1us
I20260709 13:03:30.701655 13199 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:30.674778 14260 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:30.578356 12541 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 1.
I20260709 13:03:30.669943 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:30.669406 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:30.674957 14252 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:30.675064 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:30.593361 14269 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:30.684568 12539 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:30.568892 14146 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:30.688498 14264 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.747366 14183 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.671941 14116 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:30.752558 14116 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:30.753172 14116 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:30.662317 14262 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:30.754086 14183 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.671130 14243 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:30.659076 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 74475.4us
I20260709 13:03:30.754459 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:30.754783 14243 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:30.755206 12588 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:30.756086 14122 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:30.756709 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:30.674647 14150 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.674487 14258 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:30.757829 14150 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.758008 14258 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.759826 14150 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:30.760277 14150 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:30.760733 14150 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.707482 14273 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:30.761497 14273 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:30.679548 14255 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.761911 14273 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:30.762308 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:30.682698 14256 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.708885 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:30.763466 14256 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.765424 14256 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.767267 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:30.768944 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:30.769609 13228 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:30.770244 12588 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:30.770998 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:30.771258 14182 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:30.774019 14152 raft_consensus.cc:993] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f: : Instructing follower a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:03:30.774582 14152 raft_consensus.cc:1081] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Signalling peer a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:03:30.775918 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:30.776527 14152 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:30.777361 13908 consensus_queue.cc:1059] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:30.777738 14248 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:30.778119 12588 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:30.779973 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:30.779819 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:30.780861 12691 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 1.
I20260709 13:03:30.781138 14182 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:30.666601 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:30.781754 14182 raft_consensus.cc:697] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:30.782119 12540 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 1.
I20260709 13:03:30.782858 14182 consensus_queue.cc:237] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:30.784308 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:30.708602 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:30.686954 14170 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.789824 13230 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:03:30.780750 14152 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:30.735937 14251 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.690812 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:30.792850 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:30.786549 14281 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:30.793433 14170 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.791730 14273 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.793781 14281 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.794718 14170 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.795629 14273 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.796094 14281 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.796196 14273 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.735834 14106 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:30.789041 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:30.798899 14282 raft_consensus.cc:1064] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:30.799010 12620 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 3: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:30.688453 14266 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.686964 12544 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:30.738194 14259 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.738910 14244 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:30.671660 14126 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.739612 14162 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:30.806025 14282 raft_consensus.cc:1068] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Unable to promote non-voter 66750b8bbd4c4b3a9695951d0ede3372: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:30.740797 14146 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:30.875285 14146 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.694882 14052 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.742930 14235 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:30.742774 14190 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.718907 13229 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:30.682927 14193 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.881353 14190 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.882035 14146 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:30.881414 14052 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.883085 14193 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:30.691908 14261 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.883796 14261 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.744458 14252 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.737500 14263 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.745700 14250 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.721515 14260 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.893682 12543 raft_consensus.cc:2393] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 5: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:30.662739 14144 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.895228 14144 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.895514 14260 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.749101 14264 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.747490 14269 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.897708 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:30.898080 14144 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:30.898332 12688 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:30.899080 14269 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.753947 14262 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.900393 12688 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:30.900862 14262 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.901434 12695 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 1.
I20260709 13:03:30.679715 14220 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.902271 14220 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.903534 14252 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.904255 14220 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.762068 14255 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.906196 14255 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.906762 12545 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:30.907032 14250 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.785492 14116 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.737387 14241 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:30.736702 14267 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:30.661545 12619 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:30.909061 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:30.804939 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 73873.7us
I20260709 13:03:30.915329 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:30.915531 13199 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:30.916759 13199 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:30.708218 14245 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.796692 14281 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:30.810459 14106 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.787300 12442 catalog_manager.cc:5697] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 2 to 3, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 3 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:30.796756 14273 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.814261 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:30.932874 12691 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:30.815455 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:30.808554 14244 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.805862 14122 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:30.816363 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:30.817946 14126 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.818343 14150 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:30.808219 14266 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.820905 14142 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.831496 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:30.839237 12689 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 13:03:30.760749 14258 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.795228 14170 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.843124 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:30.878496 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 179363us
W20260709 13:03:30.891603 14123 consensus_meta.cc:287] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.681s	user 0.005s	sys 0.009s
I20260709 13:03:30.892148 14261 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.892573 14282 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:30.804098 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 119289us
W20260709 13:03:30.910316 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 230626us
I20260709 13:03:30.922019 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:30.923194 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:30.924293 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 142270us
I20260709 13:03:30.969496 13232 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:30.961262 14235 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:30.970445 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:30.971207 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:30.924381 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:30.924810 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:30.961781 14244 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:30.926683 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:30.977892 12538 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:30.978803 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:30.980033 12443 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50014 (request call id 220) took 2462 ms. Trace:
I20260709 13:03:30.928925 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:30.929512 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:30.846321 14243 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.981211 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:30.981369 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:30.982436 14243 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.916076 12688 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:30.944191 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:30.945266 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:30.983424 12444 catalog_manager.cc:5697] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 2 to 3, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 3 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:30.946343 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:30.947132 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:30.947803 14281 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.986889 14281 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:30.951319 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:30.964705 14242 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:30.956168 13199 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:30.957257 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:30.942762 14106 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:31.002025 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.002651 12621 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:31.003293 14106 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:31.004431 12696 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:31.005257 14268 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:30.953163 14245 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.920603 14144 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.006479 13228 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:31.011025 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:31.011369 14144 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:31.000758 14242 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:30.968019 14142 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:31.012638 14242 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:30.989315 14235 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.013844 14144 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:30.963138 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:31.014261 14142 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:31.014599 12544 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:30.913775 14241 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:30.965999 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:31.015539 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:31.015829 12689 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:30.918290 14269 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.968163 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:31.017233 12547 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:30.972355 12540 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:30.926091 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:31.020226 12546 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:30.969432 13234 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:03:30.973480 14282 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:30.973855 14116 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:30.973964 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:31.026535 14241 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:31.033586 14287 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:30.974351 12542 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.034212 14287 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:31.036470 14287 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:31.039276 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.039268 14269 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:31.043048 14269 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:31.045591 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:31.046468 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:30.976979 14123 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:30.979959 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:30.927318 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:30.950516 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:30.987346 12541 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:30.988233 12513 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:30.990083 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:30.976567 13232 raft_consensus.cc:2393] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 3: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:30.955822 14231 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:31.001065 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 45016.2us
I20260709 13:03:30.958189 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:31.001116 12545 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:30.998032 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:31.059477 12614 raft_consensus.cc:2393] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 2: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:31.059734 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:30.976527 14170 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:31.062212 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:31.047324 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:31.063233 12694 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:31.013916 14235 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:31.063598 12542 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:31.064105 14258 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.064692 14258 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:31.065785 12538 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.066473 14123 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:31.066753 12691 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:31.067636 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:31.068430 14258 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:31.068815 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:30.965876 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.025941 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:31.027729 13908 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:31.070979 13908 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:31.071622 12544 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:31.028832 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:31.029912 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:31.072734 14282 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:31.072757 12544 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:31.073638 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:31.074376 12544 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:31.074707 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:31.073071 12692 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:31.075292 12696 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:31.010145 14268 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:31.030191 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:31.075965 14268 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.076152 14122 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:31.031631 12619 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:31.076686 14122 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:31.077277 12543 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:31.045758 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:31.078253 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 90101.4us
I20260709 13:03:31.078477 12695 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:30.977205 12687 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:31.078316 14256 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:31.045634 12688 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:31.006989 14273 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:31.031184 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:31.078992 14122 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:31.079027 12513 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:31.080657 14273 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:31.072762 13908 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:31.081053 14273 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:31.081540 14273 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.075906 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:31.082114 12692 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:31.079401 14256 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.082870 14256 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:31.065914 12545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35"
dest_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:42446
I20260709 13:03:31.083786 12545 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:30.989308 12443 rpcz_store.cc:276] 0709 13:03:28.517454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:28.517639 (+   185us) service_pool.cc:224] Handling call
0709 13:03:30.979977 (+2462338us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:28.801722 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:28.809695 (+  7973us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:28.809755 (+    60us) write_op.cc:435] Acquired schema lock
0709 13:03:28.809794 (+    39us) tablet.cc:662] Decoding operations
0709 13:03:28.810589 (+   795us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:28.810689 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:28.810812 (+   123us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:03:29.406656 (+595844us) tablet.cc:701] Row locks acquired
0709 13:03:29.412178 (+  5522us) write_op.cc:260] PREPARE: finished
0709 13:03:29.419166 (+  6988us) write_op.cc:270] Start()
0709 13:03:29.425493 (+  6327us) write_op.cc:276] Timestamp: P: 1783602209415498 usec, L: 0
0709 13:03:29.452303 (+ 26810us) op_driver.cc:348] REPLICATION: starting
0709 13:03:29.592062 (+139759us) log.cc:844] Serialized 919 byte log entry
0709 13:03:30.157798 (+565736us) op_driver.cc:464] REPLICATION: finished
0709 13:03:30.262282 (+104484us) write_op.cc:301] APPLY: starting
0709 13:03:30.269065 (+  6783us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:30.293839 (+ 24774us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:30.295821 (+  1982us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:30.296724 (+   903us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:30.296974 (+   250us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:03:30.297017 (+    43us) write_op.cc:312] APPLY: finished
0709 13:03:30.297298 (+   281us) log.cc:844] Serialized 29 byte log entry
0709 13:03:30.298078 (+   780us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:30.298164 (+    86us) write_op.cc:454] Released schema lock
0709 13:03:30.298216 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:30.298547 (+   331us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:30.298573 (+    26us) write_op.cc:454] Released schema lock
0709 13:03:30.395322 (+ 96749us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b5400235fd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957632a 00007fc3a94fbf14 00007fc3a94fbec3 00007fc3a94fbe38 00007fc3a94fbdf3 00007fc3a94fb0dc 00007fc3a9524e16 00007fc3a950ccbb 00007fc3a94f739d 00007fc3a94fad75
Metrics: {"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":83787,"apply.run_cpu_time_us":2419,"apply.run_wall_time_us":52095,"num_ops":2,"prepare.queue_time_us":79535,"prepare.run_cpu_time_us":15542,"prepare.run_wall_time_us":1355940,"raft.queue_time_us":8657,"raft.run_cpu_time_us":31524,"raft.run_wall_time_us":241191,"replication_time_us":705276,"spinlock_wait_cycles":7353728,"thread_start_us":660486,"threads_started":4,"wal-append.queue_time_us":551002}]]}
I20260709 13:03:31.084120 12545 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.085404 12692 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:31.085482 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:31.086089 12687 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:03:31.047528 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:31.075150 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 102689us
I20260709 13:03:31.088454 13979 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:31.088506 13200 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:31.088954 13979 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:31.089296 13979 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.064060 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:31.091215 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:31.091840 13234 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.092432 12546 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:31.093362 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:31.007534 13197 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:03:31.114274 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 106825us
I20260709 13:03:31.116160 12694 raft_consensus.cc:2393] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 3: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:31.116633 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:31.117168 14164 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:31.117753 14164 raft_consensus.cc:697] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:31.118613 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:31.120080 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:31.116384 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:31.120903 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:31.121619 13235 raft_consensus.cc:2393] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 3: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:31.123481 12621 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 13:03:31.123862 12621 pending_rounds.cc:85] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 3
I20260709 13:03:31.124099 12621 pending_rounds.cc:107] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260709 13:03:31.124271 13197 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:31.124446 12621 raft_consensus.cc:2917] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260709 13:03:31.124871 12621 raft_consensus.cc:2889] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:31.126178 14176 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:31.126544 14176 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.126873 14176 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:31.127635 12545 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:31.129704 12690 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:31.118693 14164 consensus_queue.cc:237] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:31.135633 14176 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:31.140038 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:31.140820 12613 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.147706 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:31.148839 12615 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.150691 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:31.151399 12688 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:31.152648 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:31.153124 12687 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:03:31.153290 13232 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:31.153960 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.154309 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:31.154912 12695 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:31.155129 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:31.155939 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 67503.3us
I20260709 13:03:31.156929 13200 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:31.084139 14258 consensus_queue.cc:1059] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:03:31.158810 12617 raft_consensus.cc:2393] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 3: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:03:31.158987 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 99365.9us
I20260709 13:03:31.159560 12539 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:31.159745 13199 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:03:31.156111 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:31.160516 14237 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:31.151050 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:31.160876 14237 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:31.161528 14237 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.161927 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:31.162516 13228 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.163100 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.164916 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.166575 12513 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:31.129467 12545 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:31.160880 12696 raft_consensus.cc:2393] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 3: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:31.170747 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.171921 13234 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:31.173955 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.171591 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.174383 14261 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:31.174467 14253 raft_consensus.cc:2764] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:03:31.174882 14261 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.175274 14261 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:31.176651 12587 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:31.179804 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:31.181634 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:31.182284 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.182842 12619 raft_consensus.cc:2393] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 3: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:31.183622 13979 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:31.184290 12513 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:31.185786 13234 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEARNER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 13:03:31.194410 13232 raft_consensus.cc:2368] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3.
I20260709 13:03:31.197894 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.199013 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.199347 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.200040 12617 raft_consensus.cc:2393] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:31.201634 13979 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:31.204284 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 47430.2us
I20260709 13:03:31.205269 13200 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:31.178851 14123 consensus_queue.cc:1048] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:03:31.202221 14116 consensus_queue.cc:1059] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:03:31.206667 14116 raft_consensus.cc:3055] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:31.207011 14116 raft_consensus.cc:740] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:31.208027 13226 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:31.207842 14116 consensus_queue.cc:260] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:31.209760 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:31.210445 12614 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:31.210453 14268 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:31.212980 14268 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:31.215956 12613 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:31.222612 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.224063 12613 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:31.223423 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:31.226920 14267 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.229800 13200 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:31.222481 12587 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:31.225752 13197 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:31.214833 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.200835 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:31.209280 14116 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.167814 14242 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:31.215314 14258 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:31.240233 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.241065 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.242067 12613 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:31.242985 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:31.222014 14248 consensus_queue.cc:1059] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:03:31.251305 14245 raft_consensus.cc:3055] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:31.251984 14245 raft_consensus.cc:740] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:31.236622 14280 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:31.252732 14280 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:31.239550 14256 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:31.256275 14266 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:31.195473 14122 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:03:31.262450 14258 raft_consensus.cc:697] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:31.263957 14258 consensus_queue.cc:237] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:31.234576 14176 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:31.240963 14276 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:03:31.293469 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 60994.8us
I20260709 13:03:31.253335 14280 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:31.294255 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 55987.4us
I20260709 13:03:31.301765 12615 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:31.295722 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.302459 13908 raft_consensus.cc:2764] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:03:31.296886 13200 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:31.238803 14187 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:31.234784 14241 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:31.218081 14199 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:03:31.319386 13233 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:31.275247 14182 raft_consensus.cc:3055] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:03:31.324234 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 361160us
I20260709 13:03:31.323724 13197 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:31.327519 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:31.329873 12662 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:31.330202 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.331634 13230 raft_consensus.cc:2393] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 4: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:31.331362 12662 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:31.318149 13229 raft_consensus.cc:2393] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 2: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:31.304291 14187 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.336388 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.324921 13200 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:31.253311 14245 consensus_queue.cc:260] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:31.315640 14256 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:31.333709 12662 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:31.297049 14235 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:31.326582 14182 raft_consensus.cc:740] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:31.348308 12662 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:31.333727 14170 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:31.335621 14176 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:31.332432 14276 raft_consensus.cc:697] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:31.355820 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.343798 14144 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:31.355268 12662 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:31.342201 14187 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.349905 14123 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:31.359807 12662 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:31.346244 14164 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:03:31.351352 12717 debug-util.cc:398] Leaking SignalData structure 0x7b08000a3420 after lost signal to thread 11446
I20260709 13:03:31.367969 12662 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:31.350627 14142 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:03:31.371193 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.370893 12662 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:31.373057 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.355023 14170 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.358639 14193 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:31.378063 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:31.359251 14176 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.395707 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.396064 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:31.396312 12621 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:31.396657 12545 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:03:31.394398 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:31.366570 14245 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.394299 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:31.358855 14144 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:31.395090 12539 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:03:31.358873 14284 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:31.372933 14242 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:31.369426 14123 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.391170 14164 raft_consensus.cc:697] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:31.395733 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:31.370927 14273 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:31.366575 14106 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:31.435532 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:31.436126 12619 raft_consensus.cc:3055] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:31.436409 12619 raft_consensus.cc:740] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:31.391861 14244 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:31.450085 12510 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:31.408881 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 83988.3us
I20260709 13:03:31.374877 14146 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:31.410323 12687 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:31.411527 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:31.469142 12696 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:31.413698 12694 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:31.414794 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:03:31.417514 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.373003 14142 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:31.392257 14170 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:31.437119 12619 consensus_queue.cc:260] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:31.479962 12619 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:31.411064 12662 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:31.420337 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.394512 14281 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:31.372159 14269 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:31.414885 14284 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:31.395720 14176 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.392690 14193 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:31.367579 14279 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:31.428073 12717 debug-util.cc:398] Leaking SignalData structure 0x7b08000a33a0 after lost signal to thread 12479
I20260709 13:03:31.414469 14144 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.472163 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:31.475102 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:31.419113 14182 consensus_queue.cc:260] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:31.495344 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:31.534317 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.512099 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.502117 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:31.535404 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:31.536099 12689 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:31.536233 12687 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:31.484071 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:31.484777 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:31.536936 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:31.401362 14283 consensus_queue.cc:1059] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.194s
I20260709 13:03:31.485981 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:31.468281 14106 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.511459 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:31.430948 14123 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:31.559508 12622 raft_consensus.cc:2393] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 3: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:31.489117 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:31.400323 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.533856 12544 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.560969 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.524266 12619 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:31.562322 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.563164 12619 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:31.564080 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.563927 12512 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:31.541358 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.467620 14146 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.485127 14142 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.575269 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:31.578022 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.518234 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:31.578856 12588 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:31.579751 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:31.504429 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.581409 12620 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:31.487133 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.481951 12543 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:31.543026 14193 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.508126 14241 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:31.509112 14235 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:31.533757 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.550686 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:31.610658 13235 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:31.551326 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:31.551973 13234 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:31.559348 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:31.612183 13232 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:31.538050 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:31.612632 12696 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.519960 14273 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:31.566054 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:31.516148 12513 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:31.567063 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:31.567440 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:31.488809 14294 log.cc:927] Time spent T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:03:31.482808 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:31.494436 14296 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:03:31.479908 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:31.544029 12538 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:31.580596 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 243130us
I20260709 13:03:31.544457 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:31.851004 12541 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 1.
I20260709 13:03:31.582664 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.851967 12622 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:31.852841 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.854156 13234 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:31.855728 13234 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:31.523547 14052 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:31.493633 14284 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.856854 14052 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:31.857266 14052 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:31.485263 14281 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:31.857759 14281 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.583813 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.586172 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:31.862151 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 247249us
I20260709 13:03:31.545344 12539 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:31.587380 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:31.588042 12687 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:31.567587 14106 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:31.565979 12615 raft_consensus.cc:2393] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 3: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:31.526814 13228 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:31.867955 13228 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:31.686316 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:31.869635 12694 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:31.686854 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.687093 12544 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
W20260709 13:03:31.632304 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 221335us
I20260709 13:03:31.871702 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:31.871838 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:31.872798 14190 raft_consensus.cc:2764] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:03:31.573945 14146 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:31.566425 12614 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:31.873750 13226 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEARNER]: Advancing to term 3
W20260709 13:03:31.695854 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 179799us
I20260709 13:03:31.559319 14279 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:31.876680 14279 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:31.585542 14267 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:31.710130 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.877789 13231 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
W20260709 13:03:31.710933 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:31.879655 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.880940 13234 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:31.881235 13229 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:31.709692 14269 raft_consensus.cc:697] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:31.882458 13229 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:31.882364 14269 consensus_queue.cc:237] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:31.571341 14261 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:31.712931 12717 debug-util.cc:398] Leaking SignalData structure 0x7b0800391d00 after lost signal to thread 12571
W20260709 13:03:31.888003 12717 debug-util.cc:398] Leaking SignalData structure 0x7b0800391940 after lost signal to thread 12646
I20260709 13:03:31.888484 14261 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:31.889137 12717 debug-util.cc:398] Leaking SignalData structure 0x7b08003a4420 after lost signal to thread 12720
I20260709 13:03:31.712590 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:31.890626 12546 raft_consensus.cc:2368] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4.
I20260709 13:03:31.891769 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:31.892189 12717 debug-util.cc:398] Leaking SignalData structure 0x7b0800381020 after lost signal to thread 13259
I20260709 13:03:31.892478 12538 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:31.892659 14176 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:31.839996 14280 consensus_meta.cc:287] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.005s
I20260709 13:03:31.467581 14276 consensus_queue.cc:237] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:31.840993 14116 consensus_meta.cc:287] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.601s	user 0.009s	sys 0.009s
I20260709 13:03:31.841826 14273 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:31.900609 14052 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:31.843995 14142 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:31.697517 14266 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:03:31.525758 14164 consensus_queue.cc:237] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:31.616374 12616 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
W20260709 13:03:31.846575 14237 consensus_meta.cc:287] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.685s	user 0.007s	sys 0.007s
I20260709 13:03:31.686122 13227 raft_consensus.cc:2393] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:31.586591 14282 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:31.886009 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 285065us
I20260709 13:03:31.845461 12696 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
W20260709 13:03:31.878206 14187 consensus_meta.cc:287] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.504s	user 0.007s	sys 0.007s
I20260709 13:03:31.903528 12621 raft_consensus.cc:2410] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:03:31.894006 14280 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:31.905989 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 342149us
I20260709 13:03:31.901475 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:31.909310 14273 raft_consensus.cc:697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:31.911350 13197 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:03:31.914229 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 355795us
I20260709 13:03:31.915315 12513 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:31.945832 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:31.917091 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 45473.9us
I20260709 13:03:31.946779 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:31.843677 14244 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:31.949819 12622 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:31.951078 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:31.951934 12510 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:31.940403 12512 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:31.938902 12659 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:31.912803 13228 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:31.910481 13199 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:31.958161 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:31.958271 12513 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:03:31.958463 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 48090.6us
I20260709 13:03:31.959862 13199 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:31.961333 13199 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:31.911157 14283 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:31.910048 14281 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:31.911795 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 333050us
I20260709 13:03:31.953933 13230 raft_consensus.cc:2393] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 3: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:31.911019 14116 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:03:31.949885 14267 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:03:31.991292 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.918877 14293 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:32.045533 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:31.935431 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:32.046416 14052 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:32.023033 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 71187.1us
I20260709 13:03:32.023619 12694 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 4: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:32.047412 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:31.949807 12614 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:32.048640 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:32.023355 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 83076.5us
W20260709 13:03:32.023960 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 62752.9us
I20260709 13:03:32.050083 13199 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:32.050938 14267 raft_consensus.cc:697] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:32.051249 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:32.051819 14267 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:32.052326 13199 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:31.906057 12690 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:31.901624 14284 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:32.054888 12690 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:32.055872 14284 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:32.056695 14284 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:32.030367 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 72214.2us
I20260709 13:03:32.057121 12690 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:32.050072 12512 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:32.058300 12695 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:32.058831 13979 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:31.945384 14255 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:32.058452 14236 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:31.955128 13226 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEARNER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:31.953433 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:32.061131 12687 raft_consensus.cc:2393] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 5: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:03:32.035167 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 88477.4us
I20260709 13:03:32.035470 14261 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:32.061803 14261 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:32.061960 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:32.062228 14261 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:32.063311 12662 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:32.064556 12662 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:31.963601 14282 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:32.069893 13197 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:32.075762 13979 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:31.921042 14237 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:32.031174 14299 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.047037 14052 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.031625 14258 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:32.066968 12689 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:32.076309 13979 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.091590 13979 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:32.076562 13908 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:32.093261 13908 consensus_queue.cc:1059] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:32.026830 14279 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:32.073706 12588 leader_election.cc:400] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3.
W20260709 13:03:32.094835 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 60830.7us
I20260709 13:03:31.946861 14187 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:31.914760 14306 consensus_queue.cc:1059] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.111s
I20260709 13:03:32.037792 14245 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:32.033453 14253 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:32.100486 12619 raft_consensus.cc:2393] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 3: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:32.098946 14306 raft_consensus.cc:3055] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:32.116482 13235 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:32.037106 14256 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:32.104588 14187 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:32.129997 14275 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:32.130264 14187 raft_consensus.cc:3055] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:32.130679 14275 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:32.130945 14187 raft_consensus.cc:740] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:32.131300 14275 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:32.058295 14242 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:32.087178 14284 consensus_queue.cc:1059] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:03:32.084105 14231 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:03:32.114398 14303 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.104580 14301 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.138659 14297 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
W20260709 13:03:32.143703 14289 log.cc:927] Time spent T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:03:32.112349 14245 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:32.067768 14307 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:03:32.113067 14253 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.086949 14250 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:32.157027 12442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36394 (request call id 336) took 1793 ms. Trace:
I20260709 13:03:32.102954 14293 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:32.091251 14258 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.089850 14282 raft_consensus.cc:697] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:32.076021 14287 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.120087 14309 raft_consensus.cc:1064] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:32.135419 14187 consensus_queue.cc:260] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:32.145138 14284 raft_consensus.cc:3055] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:32.115912 14306 raft_consensus.cc:740] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:03:32.156105 14144 consensus_meta.cc:287] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.584s	user 0.010s	sys 0.000s
I20260709 13:03:32.087471 14123 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:32.163836 13979 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:32.157498 12442 rpcz_store.cc:276] 0709 13:03:30.363355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.363548 (+   193us) service_pool.cc:224] Handling call
0709 13:03:32.156948 (+1793400us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:31.186607 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:31.187163 (+   556us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:31.187187 (+    24us) write_op.cc:435] Acquired schema lock
0709 13:03:31.187206 (+    19us) tablet.cc:662] Decoding operations
0709 13:03:31.187484 (+   278us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:31.187540 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:31.187568 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:03:31.187714 (+   146us) tablet.cc:701] Row locks acquired
0709 13:03:31.187726 (+    12us) write_op.cc:260] PREPARE: finished
0709 13:03:31.187831 (+   105us) write_op.cc:270] Start()
0709 13:03:31.187916 (+    85us) write_op.cc:276] Timestamp: P: 1783602211187794 usec, L: 0
0709 13:03:31.187932 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:03:31.188608 (+   676us) log.cc:844] Serialized 599 byte log entry
0709 13:03:31.431303 (+242695us) op_driver.cc:464] REPLICATION: finished
0709 13:03:31.847847 (+416544us) write_op.cc:301] APPLY: starting
0709 13:03:31.887087 (+ 39240us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:31.887189 (+   102us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:31.887310 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:31.887565 (+   255us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:31.887757 (+   192us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:03:31.887831 (+    74us) write_op.cc:312] APPLY: finished
0709 13:03:31.888082 (+   251us) log.cc:844] Serialized 23 byte log entry
0709 13:03:31.888259 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:31.888354 (+    95us) write_op.cc:454] Released schema lock
0709 13:03:31.888397 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:31.905183 (+ 16786us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:31.911190 (+  6007us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":322458,"reported_tablets":1,"spinlock_wait_cycles":75008,"child_traces":[["op",{"apply.queue_time_us":403643,"apply.run_cpu_time_us":1850,"apply.run_wall_time_us":54006,"num_ops":1,"prepare.queue_time_us":199429,"prepare.run_cpu_time_us":2354,"prepare.run_wall_time_us":2359,"replication_time_us":206368,"thread_start_us":320977,"threads_started":2}]]}
I20260709 13:03:32.155086 14245 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:32.161844 14170 consensus_meta.cc:287] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.631s	user 0.004s	sys 0.007s
I20260709 13:03:32.160012 14253 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:32.160820 14250 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.135107 14193 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:32.186054 13979 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:32.160398 14303 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:32.166884 14258 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:32.116355 14273 consensus_queue.cc:237] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:32.183923 14123 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:32.184476 13233 raft_consensus.cc:2368] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4.
I20260709 13:03:32.175582 14144 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:32.193946 14282 consensus_queue.cc:237] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:32.185125 14250 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:32.171442 14284 raft_consensus.cc:740] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:32.187389 12694 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:32.173764 14176 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:32.189906 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:03:32.182163 14309 raft_consensus.cc:1068] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Unable to promote non-voter 66750b8bbd4c4b3a9695951d0ede3372: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:32.172528 14287 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:32.194693 14303 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.181536 14170 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:32.202896 14142 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:32.215605 14144 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:32.219213 14122 raft_consensus.cc:3055] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:32.219625 14306 consensus_queue.cc:260] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:32.194156 14193 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:32.203819 14280 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:32.223182 14306 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.222688 14284 consensus_queue.cc:260] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:32.223459 14308 log.cc:927] Time spent T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:03:32.222016 14122 raft_consensus.cc:740] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:32.223815 14287 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:32.228396 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:32.217722 14281 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:32.231228 14261 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:32.217690 12616 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:32.239142 14284 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:32.238931 14146 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:32.232136 14250 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:32.214896 14283 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:32.243633 12696 raft_consensus.cc:2393] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 4: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:32.256578 14237 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:32.260324 14275 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:32.263886 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 185832us
W20260709 13:03:32.271155 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 331705us
I20260709 13:03:32.243471 14106 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:32.281030 12659 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:32.272163 14309 consensus_queue.cc:1059] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:03:32.284744 14170 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:32.285128 12693 raft_consensus.cc:2393] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:32.286463 14275 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:32.284772 12688 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:03:32.288997 12659 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:03:32.289950 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:32.304471 12695 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:32.293653 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.298732 14309 raft_consensus.cc:3055] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:32.272392 14283 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:32.285151 14250 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:32.306901 14309 raft_consensus.cc:740] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:32.307544 14261 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:32.307641 12690 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:32.301321 14269 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:32.317817 12691 raft_consensus.cc:2393] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 3: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:32.310163 12659 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:32.319588 12444 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36398 (request call id 352) took 1502 ms. Trace:
I20260709 13:03:32.265235 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:32.333948 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:32.315866 14170 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:32.338608 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:32.340343 14309 consensus_queue.cc:260] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:32.341174 14106 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:32.341641 14309 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.341805 14170 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.343801 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:32.342216 14170 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:32.346130 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:32.351150 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:32.352707 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:32.353616 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:32.354249 12617 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:32.332930 14150 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:32.357643 12620 raft_consensus.cc:2393] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 3: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:32.365800 12613 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 3: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:32.332624 14231 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:03:32.332435 14287 consensus_queue.cc:1059] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:03:32.355353 14106 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:32.380690 14106 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:32.383234 14293 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:32.383504 14106 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:32.387233 14283 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:32.388060 14245 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:32.389945 14231 raft_consensus.cc:3055] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:32.390466 14253 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:32.393110 14253 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:32.403450 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 338917us
I20260709 13:03:32.406805 12617 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
W20260709 13:03:32.354157 13227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 425) took 1230 ms (client timeout 1617 ms). Trace:
I20260709 13:03:32.409809 12695 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:32.404664 12662 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:32.413846 12662 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:32.417984 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:32.435832 12617 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:32.419327 14146 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:32.328413 12444 rpcz_store.cc:276] 0709 13:03:30.816996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:30.818359 (+  1363us) service_pool.cc:224] Handling call
0709 13:03:32.319511 (+1501152us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:31.189079 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:31.190636 (+  1557us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:31.190681 (+    45us) write_op.cc:435] Acquired schema lock
0709 13:03:31.190710 (+    29us) tablet.cc:662] Decoding operations
0709 13:03:31.191183 (+   473us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:31.191271 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:31.191319 (+    48us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:03:31.191589 (+   270us) tablet.cc:701] Row locks acquired
0709 13:03:31.191613 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:03:31.191808 (+   195us) write_op.cc:270] Start()
0709 13:03:31.191929 (+   121us) write_op.cc:276] Timestamp: P: 1783602211191740 usec, L: 0
0709 13:03:31.191950 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:03:31.192848 (+   898us) log.cc:844] Serialized 536 byte log entry
0709 13:03:31.839061 (+646213us) op_driver.cc:464] REPLICATION: finished
0709 13:03:31.922357 (+ 83296us) write_op.cc:301] APPLY: starting
0709 13:03:31.942976 (+ 20619us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:31.950440 (+  7464us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:32.031225 (+ 80785us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:32.091012 (+ 59787us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:32.120895 (+ 29883us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:03:32.135957 (+ 15062us) write_op.cc:312] APPLY: finished
0709 13:03:32.158690 (+ 22733us) log.cc:844] Serialized 23 byte log entry
0709 13:03:32.167883 (+  9193us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:32.172195 (+  4312us) write_op.cc:454] Released schema lock
0709 13:03:32.174405 (+  2210us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:32.200345 (+ 25940us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:32.204071 (+  3726us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":159395,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":77396,"apply.run_cpu_time_us":2630,"apply.run_wall_time_us":262214,"num_ops":1,"prepare.queue_time_us":182870,"prepare.run_cpu_time_us":3776,"prepare.run_wall_time_us":4101,"replication_time_us":502001,"thread_start_us":114403,"threads_started":1}]]}
I20260709 13:03:32.409452 14122 consensus_queue.cc:260] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:32.440371 14122 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:32.441471 12662 leader_election.cc:400] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4.
W20260709 13:03:32.441612 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.441792 12662 leader_election.cc:403] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:32.442637 14303 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:32.442517 12443 catalog_manager.cc:5697] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 1 to 2, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 2 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:32.410387 13227 rpcz_store.cc:269] 0709 13:03:31.113667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.119797 (+  6130us) service_pool.cc:224] Handling call
0709 13:03:32.334123 (+1214326us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b5400468554. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:32.342598 (+  8475us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1009190656}
I20260709 13:03:32.444810 14303 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:32.434635 12659 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:32.448968 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:32.449218 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:32.449810 12617 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:32.444203 12443 catalog_manager.cc:5697] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 1 to 2, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 2 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:32.451391 13235 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:32.452718 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:32.454082 12659 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:32.454185 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:32.455566 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:32.447933 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:32.466056 13233 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:32.467320 13234 raft_consensus.cc:2393] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 4: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:32.390465 14231 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:32.481031 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:32.469726 14293 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:03:32.441174 14281 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:32.500402 12587 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:03:32.486131 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 412335us
I20260709 13:03:32.445448 14106 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.511317 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:32.512825 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:32.516332 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:32.513324 12617 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:32.510357 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:32.536636 12694 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:32.539781 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.540088 12659 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:32.408073 14258 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:32.464012 14146 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:32.469913 14303 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:32.472779 14150 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:32.486547 14283 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:32.553215 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:32.549842 14144 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:32.511274 14281 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.595273 13233 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:32.596803 12662 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:32.551903 14150 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.550782 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1097) took 1143 ms. Trace:
I20260709 13:03:32.609984 12692 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:32.611186 12588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.030s	sys 0.031s
I20260709 13:03:32.588574 13227 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:32.587412 14303 raft_consensus.cc:697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:03:32.617345 12510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.027s	sys 0.088s
I20260709 13:03:32.592442 14281 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:32.625190 12510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.028s	sys 0.088s
W20260709 13:03:32.627369 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 580049us
I20260709 13:03:32.564320 14146 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:32.613909 12588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.030s	sys 0.031s
I20260709 13:03:32.631492 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:32.632217 13233 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:32.616639 14142 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:32.612900 14150 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:32.587962 14283 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:32.614840 14144 raft_consensus.cc:697] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:03:32.631584 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 535906us
I20260709 13:03:32.625187 14322 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:32.647753 14295 raft_consensus.cc:3055] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:32.648206 14295 raft_consensus.cc:740] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:32.649047 14295 consensus_queue.cc:260] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:32.650250 14295 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:32.655262 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:32.634159 14245 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:32.633455 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:32.615149 14170 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:32.668416 14318 consensus_queue.cc:1059] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:03:32.627182 14287 consensus_queue.cc:1059] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:03:32.672076 12510 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:32.677353 13233 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:32.678506 12545 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:32.678828 12513 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:32.679559 14309 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:32.679919 14258 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:32.680586 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:32.681173 12546 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:32.679972 14309 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:32.643616 14142 raft_consensus.cc:697] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:32.685303 12617 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:32.691373 13235 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 13:03:32.691732 13235 pending_rounds.cc:85] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: Aborting all ops after (but not including) 3
I20260709 13:03:32.691948 13235 pending_rounds.cc:107] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
W20260709 13:03:32.685812 12512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.018s	sys 0.041s
I20260709 13:03:32.690439 12545 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:32.611989 12693 rpcz_store.cc:276] 0709 13:03:31.404005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.406429 (+  2424us) service_pool.cc:224] Handling call
0709 13:03:31.891640 (+485211us) spinlock_profiling.cc:243] Waited 45.5 ms on lock 0x7b5800210698. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454eee 0000000000375939 00007fc3ae4c81e0 00007fc3ae5910c4 00007fc3ae591131 00007fc3ae53f0a0 00007fc3ae53e984 00007fc3a7ab96d4 00007fc3a7ab9662
0709 13:03:32.499819 (+608179us) spinlock_profiling.cc:243] Waited 392 ms on lock 0x7b54002373d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:32.547632 (+ 47813us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1007263744}
I20260709 13:03:32.692289 13235 raft_consensus.cc:2917] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
I20260709 13:03:32.693023 13979 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:03:32.694842 13235 raft_consensus.cc:2889] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:32.693315 12512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.018s	sys 0.041s
W20260709 13:03:32.697798 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 647788us
I20260709 13:03:32.698612 12512 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:32.699008 12694 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:32.699817 12512 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:32.697001 12540 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.015s	sys 0.080s
I20260709 13:03:32.665531 12616 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
W20260709 13:03:32.704480 12540 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.016s	sys 0.080s
I20260709 13:03:32.708173 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:32.714514 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:32.710739 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:32.715217 12545 raft_consensus.cc:2393] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 4: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:32.711550 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:32.716737 12512 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:32.717507 12544 raft_consensus.cc:2368] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4.
I20260709 13:03:32.718514 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:32.719697 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:32.721221 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:32.721634 12546 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:32.721803 12544 raft_consensus.cc:2393] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 4: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:32.721803 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 301) took 1252 ms. Trace:
I20260709 13:03:32.722280 12621 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:32.705499 13229 raft_consensus.cc:2393] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:32.724880 13197 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:32.691408 14309 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:32.693539 14250 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:32.734579 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:32.733404 12539 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:32.722389 12540 rpcz_store.cc:276] 0709 13:03:31.469239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.535841 (+ 66602us) service_pool.cc:224] Handling call
0709 13:03:31.536096 (+   255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:31.536395 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:31.536422 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:31.560025 (+ 23603us) log.cc:844] Serialized 26 byte log entry
0709 13:03:31.953432 (+393407us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:32.713612 (+760180us) log.cc:844] Serialized 14 byte log entry
0709 13:03:32.721505 (+  7893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:32.721592 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:32.721631 (+    39us) raft_consensus.cc:1685] finished
0709 13:03:32.721641 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:32.721751 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7605,"prepare.queue_time_us":85974,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":2276,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":30128,"thread_start_us":949034,"threads_started":2,"wal-append.queue_time_us":529685}
I20260709 13:03:32.750433 12692 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:32.762648 12512 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:03:32.763389 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 117829us
I20260709 13:03:32.704793 14261 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:32.765620 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:32.764803 12512 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:32.724460 14275 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:32.724944 14245 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:32.733891 14266 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:32.674504 14303 consensus_queue.cc:237] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:32.763737 14276 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:32.725183 14146 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:32.766567 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:32.767582 14250 raft_consensus.cc:697] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:32.775844 14302 raft_consensus.cc:2764] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:03:32.773746 14275 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:03:32.786089 12614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.029s	sys 0.049s
I20260709 13:03:32.813644 14275 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:32.815433 14231 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:32.817811 14301 raft_consensus.cc:3055] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:32.821630 14182 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:32.734869 14144 consensus_queue.cc:237] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:32.822506 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:32.823098 14250 consensus_queue.cc:237] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:32.824215 14284 consensus_meta.cc:287] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.000s
I20260709 13:03:32.777541 14142 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:32.825672 13230 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:32.828169 14152 consensus_queue.cc:1059] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:03:32.829365 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.809437 14261 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:32.822542 14283 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:32.812543 14276 raft_consensus.cc:697] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:03:32.787649 14116 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.016s	sys 0.004s
I20260709 13:03:32.825726 14325 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:32.857992 12614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.030s	sys 0.049s
I20260709 13:03:32.783151 14324 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:32.858992 14106 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:03:32.881006 12510 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.633s (SENT) [suppressed 17 similar messages]
I20260709 13:03:32.788544 14123 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:32.902300 12687 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.020s	sys 0.028s
W20260709 13:03:33.041105 12687 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.021s	sys 0.028s
I20260709 13:03:33.041425 12691 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 1. Current term is 2. Ops: []
W20260709 13:03:32.903853 12689 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.009s	sys 0.011s
I20260709 13:03:32.909323 12547 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:03:33.042634 12689 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.010s	sys 0.012s
W20260709 13:03:32.912190 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:32.917631 12688 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.000s	sys 0.020s
W20260709 13:03:32.918567 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.919471 12694 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 1. Current term is 2. Ops: []
W20260709 13:03:33.043394 12688 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.000s	sys 0.021s
W20260709 13:03:33.043413 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:32.923126 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 188605us
W20260709 13:03:32.935606 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:32.904970 14301 raft_consensus.cc:740] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:32.906067 14122 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
W20260709 13:03:33.004487 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 239787us
W20260709 13:03:33.016180 14116 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.017s	sys 0.017s
I20260709 13:03:32.959014 14322 raft_consensus.cc:697] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:33.002364 14152 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:33.002337 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:33.000061 14261 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.045058 12662 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:03:33.017037 12443 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.003s	sys 0.017s
I20260709 13:03:33.050324 12512 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:33.154500 12443 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.003s	sys 0.017s
W20260709 13:03:33.153849 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 108879us
W20260709 13:03:33.167790 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 117565us
I20260709 13:03:33.167725 12662 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:33.034376 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 270188us
W20260709 13:03:33.053471 14293 consensus_meta.cc:287] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.000s
W20260709 13:03:33.144970 14329 log.cc:927] Time spent T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 13:03:33.150511 14331 log.cc:927] Time spent T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:03:33.143940 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 55906.1us
I20260709 13:03:33.094766 12547 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:33.168784 12512 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:33.181593 12512 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:33.049077 14273 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
W20260709 13:03:33.152045 14316 log.cc:927] Time spent T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:03:33.171486 12662 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:33.142079 14326 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.049443 14123 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.154203 14261 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:33.151662 14342 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:33.200701 14342 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:33.201685 14333 log.cc:927] Time spent T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:03:33.202829 14284 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:33.203171 14342 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:33.203285 14284 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:33.203790 14284 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:33.204001 14150 consensus_meta.cc:287] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.552s	user 0.015s	sys 0.000s
I20260709 13:03:33.204224 14250 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:33.204483 14150 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:33.204684 14322 consensus_queue.cc:237] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:33.207355 14150 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:33.166491 14106 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:33.189260 14276 consensus_queue.cc:237] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.196648 14287 consensus_queue.cc:1059] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:03:33.149394 14309 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:33.211951 12543 raft_consensus.cc:2393] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 3: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:33.212688 14309 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:33.195026 12662 leader_election.cc:400] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4.
I20260709 13:03:33.196382 14326 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.185448 14324 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:33.180182 14293 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4.
I20260709 13:03:33.046535 14325 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.223169 14339 consensus_queue.cc:1059] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:33.224254 14339 raft_consensus.cc:3055] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:33.224618 14339 raft_consensus.cc:740] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:33.225183 14325 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:33.144142 14152 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:33.207522 14123 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:33.177778 14303 raft_consensus.cc:2764] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:03:33.216856 12662 leader_election.cc:400] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4.
I20260709 13:03:33.221020 14326 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:33.184656 14266 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:33.191270 14301 consensus_queue.cc:260] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:33.253125 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 350346us
W20260709 13:03:33.255882 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 74445.8us
I20260709 13:03:33.256821 12512 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:33.257946 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:33.229947 12662 leader_election.cc:403] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 13:03:33.237607 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 86696.9us
W20260709 13:03:33.262130 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 45472.6us
I20260709 13:03:33.250835 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:33.265295 12512 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:33.263204 14323 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:33.270830 14326 raft_consensus.cc:2764] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:03:33.258741 14344 raft_consensus.cc:3055] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.259390 14301 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:33.279217 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:33.274933 14324 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:33.277506 14170 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:33.225489 14339 consensus_queue.cc:260] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.261416 12696 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:33.263461 14266 raft_consensus.cc:2764] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:03:33.281806 14256 raft_consensus.cc:1064] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:33.283558 14152 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:33.272490 12662 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:33.256088 14342 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:03:33.312297 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:33.312791 14170 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:33.261322 14287 consensus_queue.cc:1059] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:03:33.313055 12616 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:33.278752 14344 raft_consensus.cc:740] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:03:33.313225 14256 raft_consensus.cc:1068] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Unable to promote non-voter 66750b8bbd4c4b3a9695951d0ede3372: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:33.263504 14335 consensus_queue.cc:1059] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:03:33.314494 12662 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:33.262245 14325 consensus_queue.cc:1059] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:03:33.313898 14287 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.326254 14295 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.330025 14295 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.331053 14284 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:33.334671 14287 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.336160 14275 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:33.336910 14287 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:33.326480 14281 consensus_meta.cc:287] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.001s
I20260709 13:03:33.327068 14152 raft_consensus.cc:3055] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.343411 14152 raft_consensus.cc:740] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:33.340654 14281 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:33.345363 14348 log.cc:927] Time spent T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:03:33.337538 14339 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:33.348927 14281 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:33.340515 14323 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4.
I20260709 13:03:33.350720 14342 consensus_queue.cc:1059] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
W20260709 13:03:33.387998 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 130032us
W20260709 13:03:33.308647 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 44857.4us
I20260709 13:03:33.402123 12588 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:03:33.393289 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 78690.1us
I20260709 13:03:33.393782 12618 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:33.396708 12690 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 4: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:33.411281 14256 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:33.412077 13197 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:33.412745 14256 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.415174 14116 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.349772 14152 consensus_queue.cc:260] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.415606 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:33.415208 14142 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:33.419276 12542 raft_consensus.cc:2393] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 3: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:33.418885 12692 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:03:33.424397 14244 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:33.424588 14187 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:33.425197 14244 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.425824 14244 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:33.426095 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:33.427539 13230 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 4: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:33.429193 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:33.430032 14152 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.430254 14256 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:33.430651 13228 raft_consensus.cc:2393] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 2: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:33.431133 14256 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:33.431587 14256 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:33.432047 14256 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.434032 14309 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:33.434450 14275 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:33.435170 14309 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.436451 14284 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:33.437597 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:33.438370 14309 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:33.439393 14306 consensus_meta.cc:287] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 1.202s	user 0.013s	sys 0.000s
W20260709 13:03:33.391687 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 112683us
I20260709 13:03:33.421257 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2382) took 1858 ms. Trace:
I20260709 13:03:33.437139 14275 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:33.446631 14106 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.447474 14248 raft_consensus.cc:3055] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:33.446767 14261 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:33.448087 14248 raft_consensus.cc:740] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:33.447916 14106 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.450978 14261 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:33.434329 14122 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.451584 14248 consensus_queue.cc:260] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:33.452940 14122 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.456436 13230 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:33.456091 14275 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.462476 14122 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:33.463369 14248 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:33.464164 12512 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:03:33.468647 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.470028 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:33.471117 14261 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:33.441329 12618 rpcz_store.cc:276] 0709 13:03:31.562961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.709720 (+146759us) service_pool.cc:224] Handling call
0709 13:03:33.420951 (+1711231us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54003af2d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:33.421139 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3485686144}
I20260709 13:03:33.478904 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:33.480037 12690 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:33.482170 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:33.483135 12689 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:33.488641 14142 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:33.491291 14340 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:33.492585 14340 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.494099 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:33.495267 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.499933 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:33.502894 12662 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:33.504304 14144 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.507521 12587 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:33.507742 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:33.508735 12688 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:33.511902 14340 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:33.504855 14106 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:33.513826 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 112057us
I20260709 13:03:33.514117 12587 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:33.514850 14116 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:33.514940 12588 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:33.515389 14360 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.517311 14122 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:33.518054 14122 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:33.518556 14122 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:33.522527 14287 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:33.523111 14287 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:33.523741 14287 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:33.528365 12587 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:33.531631 12693 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: []
W20260709 13:03:33.529867 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 65942.4us
I20260709 13:03:33.532998 12512 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:33.530576 14231 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:33.517391 14360 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:33.497915 14275 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:33.512053 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:33.540110 14360 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:33.534641 14116 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:33.545683 14357 raft_consensus.cc:3055] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.547947 14335 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:33.555709 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:33.560920 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:03:33.561767 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.561836 14106 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:33.561038 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:33.563410 12542 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 4: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:33.566041 14335 raft_consensus.cc:697] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:33.548836 14116 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.581393 13230 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:33.583027 12696 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:33.586081 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:33.587343 12542 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:33.587604 12614 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 13:03:33.587762 13235 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:33.588074 12614 pending_rounds.cc:85] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 3
I20260709 13:03:33.588343 12614 pending_rounds.cc:107] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260709 13:03:33.588765 12614 raft_consensus.cc:2917] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
W20260709 13:03:33.588843 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 74124.2us
I20260709 13:03:33.589742 14258 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:33.590479 12618 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:33.593675 14344 consensus_queue.cc:260] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.552394 14357 raft_consensus.cc:740] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:33.548501 14261 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:33.595425 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 62670.1us
I20260709 13:03:33.598739 14344 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.585287 13199 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:33.605367 12544 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:33.606714 14164 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:33.609701 14106 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.551097 14360 consensus_queue.cc:1059] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:03:33.576728 14116 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:33.615327 14106 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:33.619436 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:33.620007 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:33.620949 12622 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:33.621373 14106 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:33.589464 12614 raft_consensus.cc:2889] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:33.626300 14297 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.626639 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:33.627287 12613 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:33.626940 14297 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.619462 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:33.637857 12588 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:03:33.642365 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 130461us
W20260709 13:03:33.643939 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 59032.5us
W20260709 13:03:33.651932 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 150228us
I20260709 13:03:33.652590 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:33.654235 14326 raft_consensus.cc:1064] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
W20260709 13:03:33.654706 14326 raft_consensus.cc:1068] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Unable to promote non-voter 66750b8bbd4c4b3a9695951d0ede3372: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:33.655401 14326 raft_consensus.cc:1064] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
W20260709 13:03:33.658222 14326 raft_consensus.cc:1068] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Unable to promote non-voter 66750b8bbd4c4b3a9695951d0ede3372: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:03:33.659766 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 50368.6us
I20260709 13:03:33.647608 14106 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.650736 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:33.656827 14164 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:33.671945 14341 raft_consensus.cc:3055] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:33.672857 14297 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:33.617255 14335 consensus_queue.cc:237] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:33.677755 14106 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.685160 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:33.685619 12693 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:33.685672 14341 raft_consensus.cc:740] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:33.698501 14357 consensus_queue.cc:260] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.699373 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:33.700503 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:33.700246 14341 consensus_queue.cc:260] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.686213 14295 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:33.688155 12618 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:33.701319 12615 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:33.682648 12692 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:33.703959 14106 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:33.688196 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 75387.3us
I20260709 13:03:33.690043 14299 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.705025 14299 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.692224 12622 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:33.697870 14164 raft_consensus.cc:697] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:33.704048 14357 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.687860 14349 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
W20260709 13:03:33.707921 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 72550.2us
I20260709 13:03:33.708025 12613 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:33.683691 14360 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:33.698851 14256 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.713191 12662 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:33.715246 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:33.716529 12587 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:33.717824 12689 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 4: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:33.718621 12659 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:33.720309 14295 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:33.724351 14295 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.724154 14322 consensus_queue.cc:1059] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:33.724881 14295 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:33.725063 14293 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:33.725808 14293 raft_consensus.cc:697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:33.725723 14339 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:03:33.721700 13199 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:33.738617 14170 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:33.739331 13908 raft_consensus.cc:3055] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:33.738451 13199 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:33.739882 13908 raft_consensus.cc:740] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:33.722223 14341 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:33.742775 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:33.747957 12622 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
W20260709 13:03:33.750726 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.747934 13908 consensus_queue.cc:260] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:33.759001 13908 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:33.763638 14237 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:03:33.765995 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 55369.4us
I20260709 13:03:33.766932 14231 raft_consensus.cc:3055] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:33.767397 14231 raft_consensus.cc:740] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:33.769003 14339 consensus_queue.cc:1059] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:03:33.769817 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 120270us
I20260709 13:03:33.770161 12588 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:33.771859 14281 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:33.772598 12662 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:33.772291 14122 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:33.775152 14337 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.727051 14293 consensus_queue.cc:237] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:33.769038 12659 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:33.777275 14323 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:33.768505 14231 consensus_queue.cc:260] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.786561 14231 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:33.788501 12659 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:33.789779 13979 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:33.790001 14164 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.794641 14325 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.795365 14325 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:33.797849 14302 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:33.798265 14302 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.798614 14302 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:33.784178 12512 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:33.803375 13979 raft_consensus.cc:697] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:33.806847 12621 raft_consensus.cc:2393] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 3: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:03:33.813663 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 77342.9us
W20260709 13:03:33.809549 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 53244.5us
W20260709 13:03:33.823729 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:33.842237 12659 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:33.822634 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:33.885211 12620 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:33.886475 13197 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:03:33.887358 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 69822.5us
I20260709 13:03:33.824223 14283 raft_consensus.cc:3055] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:33.889274 14283 raft_consensus.cc:740] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:33.811023 13979 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.893143 12617 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:33.809809 14281 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:33.809352 14152 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.825138 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:33.811400 14237 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.820729 14261 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.809058 14342 raft_consensus.cc:2764] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:03:33.808591 14326 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:33.822103 14256 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:33.821643 14299 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:33.910175 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 137709us
I20260709 13:03:33.804983 14244 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.887372 14170 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:33.914939 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:33.915479 12688 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:03:33.916448 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:33.916853 12512 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:33.818216 14123 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 13:03:33.918596 12512 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:33.921897 14282 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:33.922777 14282 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:33.925787 14301 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:33.926878 14353 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:33.927469 14353 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:33.927922 14353 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:33.929741 12512 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:33.897262 14323 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:33.820550 14337 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.898108 14325 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:33.882006 14287 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:33.905057 14152 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:33.940660 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 113666us
W20260709 13:03:33.945786 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 52242.9us
I20260709 13:03:33.912990 14326 raft_consensus.cc:697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:33.917327 12693 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:33.946359 12659 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:33.952435 14337 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:33.929214 14281 raft_consensus.cc:697] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:33.932193 14237 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.935537 14193 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:33.953294 13228 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:33.946934 14301 raft_consensus.cc:697] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:33.930629 14261 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.950718 14170 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:33.959813 14371 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.204s	user 0.002s	sys 0.000s
I20260709 13:03:33.972805 12662 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:33.970839 14266 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:33.973780 14301 consensus_queue.cc:237] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.948642 14116 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.968045 14273 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:33.976899 14144 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:33.977052 14326 consensus_queue.cc:237] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.978894 14287 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:33.978974 14375 log.cc:927] Time spent T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.093s	user 0.003s	sys 0.001s
I20260709 13:03:33.979350 14269 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:33.980142 14152 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:33.980252 12619 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:33.985090 14281 consensus_queue.cc:237] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:33.988276 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:34.000514 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:33.975126 14372 log.cc:927] Time spent T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:03:33.981452 12512 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:33.991106 14237 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:33.966634 14193 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.992697 14361 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:33.995714 14295 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:34.040072 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:34.040205 14361 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.996290 14122 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:34.041826 14295 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:33.997140 14273 raft_consensus.cc:697] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 4 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:34.043433 14273 consensus_queue.cc:237] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:34.045158 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:33.998252 12616 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:34.045787 12689 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:34.045855 14377 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.074s	user 0.003s	sys 0.000s
I20260709 13:03:34.049995 14275 raft_consensus.cc:1064] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:34.049880 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:34.050568 14275 raft_consensus.cc:1068] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Unable to promote non-voter 66750b8bbd4c4b3a9695951d0ede3372: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:34.050966 12692 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 1.
I20260709 13:03:34.054261 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:34.054904 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:34.055752 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:34.056167 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:34.056401 12545 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:34.006320 14256 consensus_queue.cc:1059] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:34.056928 12547 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:34.005869 14340 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:34.057484 14340 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.057515 14256 raft_consensus.cc:3055] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:34.058143 14340 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:33.999375 14269 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.011270 14144 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:33.988729 14266 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:34.013553 12512 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:33.997887 14116 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:34.002004 14261 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:34.015304 14255 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:34.016464 14283 consensus_queue.cc:260] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:34.023003 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.025913 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:34.027076 14170 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:34.028539 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:34.030256 12544 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:03:34.030378 12620 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:34.035316 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:03:34.037518 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.038242 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:34.039597 14193 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:33.997867 14123 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.054453 14244 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:34.055135 12694 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:34.013922 12691 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:03:34.044104 14353 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:33.988001 12659 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:34.076200 12545 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
W20260709 13:03:34.083447 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 70044.2us
I20260709 13:03:34.118342 12689 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:34.066267 14269 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:34.128746 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:34.129325 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:34.058168 14256 raft_consensus.cc:740] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:34.345664 14378 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:34.396234 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.074337 14255 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.397606 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:03:34.398967 14383 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.267s	user 0.003s	sys 0.000s
I20260709 13:03:34.399719 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:34.333631 14123 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:34.404085 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:03:34.405321 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:34.406008 12619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2387) took 2062 ms (client timeout 1707 ms). Trace:
I20260709 13:03:34.418812 14340 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:34.131659 12691 pending_rounds.cc:85] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 5
I20260709 13:03:34.474238 12691 pending_rounds.cc:107] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:03:34.433185 14295 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:34.474573 12691 raft_consensus.cc:2889] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:34.433883 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.434443 14342 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.476730 14295 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:34.477241 14342 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:34.479267 14342 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:34.442186 14323 raft_consensus.cc:1064] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:34.479666 14295 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:34.480335 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:34.480726 12587 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:34.474524 14378 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:34.483731 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:34.484293 14380 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.231s	user 0.000s	sys 0.003s
I20260709 13:03:34.484670 12691 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:34.061465 14361 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:34.131795 14261 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:34.134541 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 99634.6us
I20260709 13:03:34.130582 13228 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:34.450817 14176 consensus_queue.cc:1059] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:34.494542 13199 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:34.453203 12443 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50014 (request call id 221) took 2766 ms. Trace:
I20260709 13:03:34.453898 12442 catalog_manager.cc:5697] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 2 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:34.453617 14283 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:34.454519 14242 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:03:34.451941 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 319302us
I20260709 13:03:34.458076 12620 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:34.461158 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.464466 14255 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:34.464740 13230 raft_consensus.cc:2393] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 6: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:34.470999 12692 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:34.468323 12695 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
W20260709 13:03:34.470330 12619 rpcz_store.cc:269] 0709 13:03:32.343377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.343543 (+   166us) service_pool.cc:224] Handling call
0709 13:03:34.258134 (+1914591us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54000997d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:34.405889 (+147755us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3569946880}
W20260709 13:03:34.479897 14323 raft_consensus.cc:1068] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a: Unable to promote non-voter 66750b8bbd4c4b3a9695951d0ede3372: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:34.486393 12587 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:34.065681 14302 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:34.507443 14144 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:34.507625 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 530997us
W20260709 13:03:34.508373 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 46235.1us
I20260709 13:03:34.510067 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:34.476073 12694 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:34.519136 12618 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:03:34.489547 14342 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:34.495021 14261 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.519534 12618 pending_rounds.cc:85] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 5
I20260709 13:03:34.524786 12618 pending_rounds.cc:107] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:03:34.525040 12618 raft_consensus.cc:2889] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:34.523038 12442 catalog_manager.cc:5697] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 2 to 3, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 3 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:34.512494 14242 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.529201 14261 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:34.519484 14164 raft_consensus.cc:3055] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:34.513232 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:34.519814 14295 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:03:34.613577 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.509150 14302 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:34.519356 14193 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:03:34.620597 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.625252 14243 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:34.625778 14243 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.626158 14243 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:34.626399 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:34.626811 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:34.630942 12546 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:34.631600 13235 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:34.518576 14176 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:03:34.530223 14357 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.518849 14122 consensus_queue.cc:1059] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.087s
I20260709 13:03:34.580729 14242 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:34.520924 14323 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.111s
I20260709 13:03:34.677100 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:34.629222 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:34.597339 14164 raft_consensus.cc:740] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:34.712684 12541 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:34.713581 14164 consensus_queue.cc:260] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:34.715217 14164 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:34.718221 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:34.605930 14342 raft_consensus.cc:697] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:34.606482 14295 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:34.712620 12540 raft_consensus.cc:2393] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 2: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:34.631182 14193 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:34.717365 12620 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:34.727573 12442 catalog_manager.cc:5697] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 2 to 3, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 3 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:34.731455 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:34.762459 12538 raft_consensus.cc:2393] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 4: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:34.733449 13229 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 2: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:34.726966 14295 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:34.772205 12621 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:03:34.628508 14269 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:34.729408 14193 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:34.767915 12620 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:34.681121 14237 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:03:34.767987 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:34.770350 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:34.691802 14357 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:34.777835 12622 raft_consensus.cc:2393] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:34.731762 14266 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:34.497243 12443 rpcz_store.cc:276] 0709 13:03:31.687390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:31.698120 (+ 10730us) service_pool.cc:224] Handling call
0709 13:03:32.300620 (+602500us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b5400235fd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e3090 00007fc3a9581f3a 00007fc3af3381cc 00007fc3af43637e 00007fc3ad8f72a4 00007fc3ad8f7232 00007fc3ad8f7161 00007fc3ad8f70dc 00007fc3ad8f6392 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:34.452957 (+2152337us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:33.017537 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:33.018393 (+   856us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:33.018447 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:03:33.018478 (+    31us) tablet.cc:662] Decoding operations
0709 13:03:33.019080 (+   602us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:33.019194 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:33.019239 (+    45us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:03:33.019719 (+   480us) tablet.cc:701] Row locks acquired
0709 13:03:33.019746 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:03:33.019985 (+   239us) write_op.cc:270] Start()
0709 13:03:33.020152 (+   167us) write_op.cc:276] Timestamp: P: 1783602213019923 usec, L: 0
0709 13:03:33.020188 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:03:33.217538 (+197350us) log.cc:844] Serialized 919 byte log entry
0709 13:03:33.616186 (+398648us) spinlock_profiling.cc:243] Waited 81.8 ms on lock 0x7b5400235e28. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af9359e1 00007fc3af93464c 00007fc3acfb03bb 00007fc3acfb271a 00007fc3acfb26a8 00007fc3acfb2628 00007fc3acfb25e3 00007fc3acfb17fc 00007fc3af3e4626 00007fc3af3dedd8 00007fc3a9585310
0709 13:03:33.616402 (+   216us) op_driver.cc:464] REPLICATION: finished
0709 13:03:33.989175 (+372773us) write_op.cc:301] APPLY: starting
0709 13:03:34.004914 (+ 15739us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:34.005109 (+   195us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:34.005159 (+    50us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:34.005714 (+   555us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:34.006011 (+   297us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:03:34.006075 (+    64us) write_op.cc:312] APPLY: finished
0709 13:03:34.006456 (+   381us) log.cc:844] Serialized 29 byte log entry
0709 13:03:34.007994 (+  1538us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:34.008122 (+   128us) write_op.cc:454] Released schema lock
0709 13:03:34.008185 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:34.223363 (+215178us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:34.247194 (+ 23831us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":19083,"reported_tablets":3,"spinlock_wait_cycles":663753088,"child_traces":[["op",{"apply.queue_time_us":349677,"apply.run_cpu_time_us":2860,"apply.run_wall_time_us":154717,"mutex_wait_us":8753,"num_ops":2,"prepare.queue_time_us":533511,"prepare.run_cpu_time_us":13026,"prepare.run_wall_time_us":308858,"raft.queue_time_us":5125,"raft.run_cpu_time_us":121212,"raft.run_wall_time_us":587361,"replication_time_us":339941,"spinlock_wait_cycles":188104960,"thread_start_us":1059236,"threads_started":4,"wal-append.queue_time_us":122016}]]}
I20260709 13:03:34.786934 14269 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:34.732971 14255 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:34.789552 14255 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:34.790482 12542 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 4: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:34.767132 14353 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:34.795885 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:34.800644 14378 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:34.802062 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:03:34.797665 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 279869us
I20260709 13:03:34.781891 12442 catalog_manager.cc:5697] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 2 to 3, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 3 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:34.781498 14340 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:34.807493 12687 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
W20260709 13:03:34.806381 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 336846us
I20260709 13:03:34.808822 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:34.814500 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:34.818004 12687 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:34.834105 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:34.838914 12540 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:34.843134 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:34.843822 12540 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:34.845878 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:34.848040 12546 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:34.848893 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:34.849933 12618 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:34.780925 12689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:34.814317 14123 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:34.814322 14269 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:34.859824 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:34.870639 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.880257 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:34.852631 12689 raft_consensus.cc:606] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:03:34.883709 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:34.843070 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:34.894918 12662 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:34.901191 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:34.897807 12622 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:34.903714 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:34.904117 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:34.904626 12695 raft_consensus.cc:2393] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:34.898888 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:34.906005 12692 raft_consensus.cc:2393] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:34.923478 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:34.924178 12621 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:03:34.925707 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:34.932709 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:34.933331 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:34.933552 12544 raft_consensus.cc:2376] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4. Re-sending same reply.
I20260709 13:03:34.923693 12614 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:34.934000 12546 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:34.934062 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:34.936167 12613 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:34.937804 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:34.932797 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:34.938915 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:34.939621 12692 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:34.893986 14340 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:34.947005 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:34.949081 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:34.949177 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:34.949717 12613 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:34.949956 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:34.950565 12547 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:34.975471 12615 raft_consensus.cc:1275] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:34.851797 14342 consensus_queue.cc:237] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:34.977144 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:34.975075 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:34.977927 12687 raft_consensus.cc:2393] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 3: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:34.987066 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:34.991290 12622 raft_consensus.cc:2410] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:03:35.015033 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:35.016395 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:34.927690 14269 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:35.021158 12547 raft_consensus.cc:2393] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 2: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:34.973085 14122 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.022655 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:35.025949 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:35.026708 12689 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 3: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:35.027469 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:35.028519 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:35.029173 12622 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:35.023886 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:35.032199 12544 raft_consensus.cc:2393] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 4: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:35.032894 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:35.032261 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:35.035430 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:35.036283 12543 raft_consensus.cc:2393] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 4: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:35.038996 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:35.040220 12618 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 3: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:35.018250 14357 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:34.972398 14243 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:35.043073 12692 raft_consensus.cc:2393] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:03:35.043272 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.054141 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:35.054769 12541 raft_consensus.cc:2376] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2. Re-sending same reply.
I20260709 13:03:35.062510 12621 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:03:35.064083 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:35.065295 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:35.065919 12618 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:35.066761 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:35.067289 14255 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:35.067873 14255 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:35.071453 12693 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:03:35.075337 12587 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:35.076583 12587 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:35.077656 14341 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:35.083042 12618 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:03:35.084810 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.084055 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:35.093488 12544 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:03:35.103083 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:35.126461 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.144800 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:35.145780 12622 raft_consensus.cc:2410] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
W20260709 13:03:35.076036 14283 consensus_meta.cc:287] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.578s	user 0.007s	sys 0.003s
I20260709 13:03:35.156595 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:35.158154 12613 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:35.159126 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:35.159714 12621 raft_consensus.cc:2376] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2. Re-sending same reply.
W20260709 13:03:35.162029 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 267190us
I20260709 13:03:35.023841 14340 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:35.031226 14122 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:35.183106 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:35.075784 14193 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:35.185874 12687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:03:35.186889 12687 raft_consensus.cc:606] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 2 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:35.348806 12618 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:35.233953 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:35.379730 12544 raft_consensus.cc:2376] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3. Re-sending same reply.
I20260709 13:03:35.235008 12689 raft_consensus.cc:2368] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 2. Current term is 3.
W20260709 13:03:35.317904 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 241363us
I20260709 13:03:35.388603 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:35.389353 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 220104us
I20260709 13:03:35.200109 12621 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:35.393333 12620 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:35.235751 14255 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:35.395581 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:35.395673 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:35.340426 13228 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:03:35.339738 14243 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:35.397933 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:35.235705 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:35.348704 14193 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:35.347105 14382 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.938s	user 0.011s	sys 0.025s
W20260709 13:03:35.337719 14261 consensus_meta.cc:287] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.659s	user 0.008s	sys 0.002s
I20260709 13:03:35.401403 14353 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.183446 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:35.187340 14283 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:03:35.388367 14164 consensus_meta.cc:287] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.673s	user 0.013s	sys 0.000s
I20260709 13:03:35.443071 12687 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:03:35.337620 14116 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:03:35.448935 12659 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.008s	sys 0.033s
I20260709 13:03:35.267975 14357 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.182336 12693 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:35.449469 12659 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.008s	sys 0.033s
W20260709 13:03:35.461100 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 523192us
I20260709 13:03:35.466305 12512 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:35.438040 14243 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.468708 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:35.188163 14404 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:35.469352 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:35.473529 12692 raft_consensus.cc:2393] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 6: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:35.470503 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:35.479915 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:35.488178 12539 raft_consensus.cc:2393] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 4: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:35.448777 14261 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:35.491897 13229 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:35.451025 14353 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:35.492954 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:35.493474 12687 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:35.493858 13233 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:03:35.493803 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:35.494670 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:35.515502 13232 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:35.495538 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:35.504400 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:35.505939 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.491825 14407 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:35.519284 13979 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:35.401367 14193 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:03:35.451292 14341 raft_consensus.cc:697] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:35.465463 14116 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:35.518924 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:35.522147 13979 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:35.502040 13228 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:35.510026 14293 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.483338 14357 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:35.526518 12541 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 4: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:35.525209 13199 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:03:35.541168 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 43921us
I20260709 13:03:35.509362 14122 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:35.512264 14395 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.523883 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:35.544860 12546 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
W20260709 13:03:35.510807 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.514485 14269 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:35.524531 12543 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:35.576954 12539 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:35.580204 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:35.518196 14283 raft_consensus.cc:697] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:35.521499 14146 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:35.476761 14243 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:35.523479 14408 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:35.522809 14255 consensus_queue.cc:1059] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:03:35.518577 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:35.527776 14404 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:35.625850 14242 consensus_meta.cc:287] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.880s	user 0.010s	sys 0.000s
W20260709 13:03:35.681813 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 150266us
I20260709 13:03:35.540331 14402 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.132s
I20260709 13:03:35.665294 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:35.619560 14399 log.cc:927] Time spent T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:03:35.627537 13979 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:03:35.684226 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.578663 14378 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:35.704523 14261 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:35.705842 14116 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:35.616693 14122 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:35.705696 14341 consensus_queue.cc:237] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:35.694185 14146 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:35.707530 14283 consensus_queue.cc:237] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:35.590407 14269 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:35.708144 14243 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:35.708530 14361 raft_consensus.cc:3055] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:35.708575 14404 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:35.528175 14407 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:35.618800 14412 consensus_queue.cc:1059] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.174s
I20260709 13:03:35.710152 14351 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:35.710988 13232 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:03:35.712132 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:35.713665 14393 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.516s	user 0.000s	sys 0.001s
I20260709 13:03:35.710400 14144 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.581434 14340 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:35.578910 14398 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:35.699213 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:35.627815 14405 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.700695 13200 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:35.617084 14414 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:03:35.765337 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 187687us
I20260709 13:03:35.743991 14378 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:35.756533 14406 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:03:35.709285 14415 consensus_queue.cc:1059] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:35.754696 14122 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:35.744596 14423 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:35.778069 12691 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
W20260709 13:03:35.805964 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 357357us
I20260709 13:03:35.808804 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:35.756047 14116 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:35.757947 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:35.813884 14394 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:35.814128 13228 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 2: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:35.815254 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:35.815702 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:35.816623 13234 raft_consensus.cc:2410] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEARNER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:03:35.816751 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:35.629086 14293 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:35.699589 14242 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:35.759604 14361 raft_consensus.cc:740] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:35.581020 14395 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:35.790006 14261 raft_consensus.cc:3055] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:35.775344 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2338) took 1724 ms. Trace:
W20260709 13:03:35.794009 12614 consensus_meta.cc:287] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.859s	user 0.010s	sys 0.000s
W20260709 13:03:35.795311 14295 consensus_meta.cc:287] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 1.015s	user 0.006s	sys 0.003s
I20260709 13:03:35.759354 14269 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:35.796204 13229 raft_consensus.cc:2410] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:35.796521 14255 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:35.797000 14412 raft_consensus.cc:3055] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:03:35.773104 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 145717us
I20260709 13:03:35.856292 12510 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:35.695006 14408 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:35.801301 14378 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:35.809999 12512 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:35.812065 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 113405us
I20260709 13:03:35.812211 12587 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:35.858238 14413 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:35.858144 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 46001.6us
I20260709 13:03:35.858801 14413 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:35.859177 14413 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:35.771665 14342 consensus_queue.cc:1059] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:03:35.817389 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:35.836560 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:35.860484 12691 raft_consensus.cc:2410] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:35.860870 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:35.846029 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2412) took 1317 ms. Trace:
W20260709 13:03:35.819811 14396 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.352s	user 0.000s	sys 0.000s
I20260709 13:03:35.805984 14420 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:03:35.867671 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 167091us
I20260709 13:03:35.868134 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:35.854115 14269 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:35.798363 14351 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:35.819124 14293 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:35.861728 12619 rpcz_store.cc:276] 0709 13:03:34.509429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.509608 (+   179us) service_pool.cc:224] Handling call
0709 13:03:34.510059 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:34.510446 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:34.510471 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:34.510924 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:03:34.976611 (+465687us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:34.976646 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.976706 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:35.826302 (+849596us) raft_consensus.cc:1685] finished
0709 13:03:35.826330 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:35.826502 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1197,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":142,"thread_start_us":465352,"threads_started":1,"wal-append.queue_time_us":643054}
W20260709 13:03:35.864914 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.801633 14144 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:35.865743 12513 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:03:35.883128 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 76182.9us
I20260709 13:03:35.833391 14116 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:35.866751 14424 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:35.886545 12510 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:35.849092 12614 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:35.820551 14353 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:35.820519 14357 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:35.872058 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 62271.5us
I20260709 13:03:35.833177 14261 raft_consensus.cc:740] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:35.811187 14340 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:03:35.876603 13200 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:03:35.879091 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:35.855386 14416 raft_consensus.cc:3055] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:35.851429 14415 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.883812 12691 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:35.855769 14412 raft_consensus.cc:740] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:35.851320 14295 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:35.924314 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 118844us
I20260709 13:03:35.888091 14432 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:35.888532 14424 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:35.889665 14408 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:35.848541 14428 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:35.864120 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:35.798411 14398 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:35.897773 12613 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:03:35.963771 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 67052.7us
I20260709 13:03:35.812331 14414 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:35.866907 14146 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:35.846870 12542 rpcz_store.cc:276] 0709 13:03:34.034905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.037877 (+  2972us) service_pool.cc:224] Handling call
0709 13:03:35.752646 (+1714769us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b54000690d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:35.759038 (+  6392us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1529737984}
I20260709 13:03:35.804056 14405 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:35.877794 13231 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 1. Current term is 3. Ops: []
I20260709 13:03:35.945487 12659 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:35.945740 12587 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:35.901173 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:35.869205 14255 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:35.950449 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:35.951392 14381 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 1.431s	user 0.010s	sys 0.016s
I20260709 13:03:35.834278 14423 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:35.951834 14242 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:35.874531 14420 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:35.953361 14418 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:35.954350 12692 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:35.955454 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:35.951537 13197 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:03:35.962194 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2344) took 1108 ms. Trace:
I20260709 13:03:35.926177 14427 consensus_queue.cc:1059] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:03:35.996786 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:35.997815 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 46391.6us
I20260709 13:03:35.998557 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:35.999168 12622 raft_consensus.cc:2376] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3. Re-sending same reply.
I20260709 13:03:35.923763 14261 consensus_queue.cc:260] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:35.923781 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:35.897038 14351 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:03:35.967782 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 81315.1us
I20260709 13:03:36.005935 14351 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.006484 14351 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:36.007105 13197 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:36.008124 13197 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:36.008281 12510 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:36.008837 14243 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:35.897544 14429 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:36.009335 14243 raft_consensus.cc:697] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:36.010006 14429 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:36.012591 14146 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:36.013190 14146 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.013622 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 272) took 1890 ms. Trace:
I20260709 13:03:36.013903 14394 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:36.014743 14394 raft_consensus.cc:697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:36.015303 14146 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:35.947031 14416 raft_consensus.cc:740] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:36.015899 14394 consensus_queue.cc:237] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.016396 14416 consensus_queue.cc:260] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:36.017740 14416 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:35.998332 14418 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:35.978446 12547 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:36.021463 14398 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:35.991874 14353 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:35.964007 14408 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:35.986881 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 118131us
I20260709 13:03:35.966904 14434 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:35.986023 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:35.972878 13227 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:35.987216 13226 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:35.994139 12540 rpcz_store.cc:276] 0709 13:03:34.846428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.846566 (+   138us) service_pool.cc:224] Handling call
0709 13:03:34.880722 (+ 34156us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:34.925732 (+ 45010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:34.925769 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:34.950208 (+ 24439us) log.cc:844] Serialized 26 byte log entry
0709 13:03:35.324382 (+374174us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:35.324441 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.324538 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:35.954969 (+630431us) raft_consensus.cc:1685] finished
0709 13:03:35.954996 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:35.955130 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21683,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":2240,"thread_start_us":291274,"threads_started":1,"wal-append.queue_time_us":452359}
I20260709 13:03:35.974833 14428 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:36.005506 14427 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:35.971696 14281 consensus_queue.cc:1048] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:03:35.983646 14341 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:36.003950 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.004143 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:36.012178 14256 consensus_queue.cc:260] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.012218 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 388) took 2064 ms. Trace:
I20260709 13:03:35.998880 14297 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 13:03:36.014011 12617 rpcz_store.cc:276] 0709 13:03:34.123354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.123572 (+   218us) service_pool.cc:224] Handling call
0709 13:03:34.444888 (+321316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:34.494593 (+ 49705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:34.494645 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:34.498730 (+  4085us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:34.513555 (+ 14825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.013387 (+1499832us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b54001ca054. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:36.013433 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.013548 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96323968}
I20260709 13:03:35.948096 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2413) took 1438 ms. Trace:
I20260709 13:03:35.980140 12546 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:03:35.972604 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 88867.5us
I20260709 13:03:35.900611 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1375) took 1096 ms. Trace:
I20260709 13:03:35.996016 14269 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:35.995349 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:36.059123 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:36.201699 12662 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:36.060000 14255 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:36.060145 14407 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:36.060778 13229 raft_consensus.cc:2410] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:36.000058 14404 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:36.013397 14423 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:35.998919 13228 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:36.022459 14412 consensus_queue.cc:260] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:36.066642 14146 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.067562 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:36.057487 14283 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:36.057786 14353 raft_consensus.cc:697] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:36.069123 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:36.069846 14261 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:35.925410 14122 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:35.906011 14357 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:36.070667 13200 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:36.100858 12692 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:35.984911 14415 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:36.142470 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 107419us
I20260709 13:03:36.240924 12691 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 3: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:36.059643 14144 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:03:36.142527 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.099296 12688 rpcz_store.cc:276] 0709 13:03:33.947986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.953923 (+  5937us) service_pool.cc:224] Handling call
0709 13:03:33.961075 (+  7152us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:33.972339 (+ 11264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:33.972372 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:33.980606 (+  8234us) log.cc:844] Serialized 26 byte log entry
0709 13:03:34.132546 (+151940us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:34.132594 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.132679 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:35.950621 (+1817942us) spinlock_profiling.cc:243] Waited 76.6 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:03:36.011898 (+ 61277us) raft_consensus.cc:1685] finished
0709 13:03:36.011924 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.012143 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7136,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":176,"spinlock_wait_cycles":176074112,"thread_start_us":149838,"threads_started":1,"wal-append.queue_time_us":485591}
I20260709 13:03:36.207826 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:36.103694 14341 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.010488 14429 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.208657 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:36.010551 14243 consensus_queue.cc:237] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.101962 14432 raft_consensus.cc:697] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:36.058081 14408 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.214011 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:36.254855 12622 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:36.219218 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:36.225545 14170 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:36.215922 14256 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:36.209434 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:36.228296 14283 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:36.229720 14353 consensus_queue.cc:237] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.231660 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:36.208408 14394 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.237644 14439 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:36.201321 14436 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.074786 14421 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:36.216967 14255 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:03:36.246554 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.143255 12614 rpcz_store.cc:276] 0709 13:03:34.802431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.803511 (+  1080us) service_pool.cc:224] Handling call
0709 13:03:35.899013 (+1095502us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:36.247380 14438 log.cc:927] Time spent T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:03:36.252334 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 197108us
I20260709 13:03:36.256002 12617 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:36.075878 14434 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.261651 14261 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:36.240391 14116 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:36.208820 14427 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:03:36.245522 14341 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:36.250537 14384 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 1.782s	user 0.020s	sys 0.000s
I20260709 13:03:36.269140 14443 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:36.270429 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:03:36.274549 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 65974.6us
I20260709 13:03:36.216197 14351 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.246572 14357 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:36.314906 14429 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:36.289206 14394 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.315212 14357 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:36.315790 14357 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:36.316277 14283 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:36.302498 14412 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:36.316956 14432 consensus_queue.cc:237] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:36.307862 14442 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:36.318789 14442 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.272605 14299 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:36.244925 14146 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:36.323320 14442 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:36.294209 14439 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:03:36.324348 14146 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:36.294420 14424 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:36.301980 13200 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:36.296945 14414 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:36.309485 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:36.289597 13227 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:36.310761 12622 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:36.326993 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:36.320369 12619 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 1.
I20260709 13:03:36.321182 12544 raft_consensus.cc:2393] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 3: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:36.308517 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:36.328902 13235 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:36.332113 12618 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:36.340890 12617 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 3: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:36.329362 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 384) took 2429 ms. Trace:
I20260709 13:03:36.317307 14394 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:36.303889 14116 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:36.348781 14116 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:36.350867 14116 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:36.351248 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:36.351536 12622 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:36.352011 13233 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 4: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:36.352473 12692 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
W20260709 13:03:36.353925 13230 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 675) took 2314 ms (client timeout 1579 ms). Trace:
W20260709 13:03:36.345403 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 46443.1us
I20260709 13:03:36.290002 14436 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:36.347250 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 428) took 1161 ms. Trace:
I20260709 13:03:36.309957 14255 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:36.347815 14420 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:36.348261 12618 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:03:36.313503 14351 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:36.357944 12588 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:03:36.354405 13230 rpcz_store.cc:269] 0709 13:03:34.039252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.039786 (+   534us) service_pool.cc:224] Handling call
0709 13:03:36.353671 (+2313885us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54006315d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:36.353810 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":973074816}
I20260709 13:03:36.356382 13235 rpcz_store.cc:276] 0709 13:03:35.182175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.182296 (+   121us) service_pool.cc:224] Handling call
0709 13:03:36.328522 (+1146226us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b58000f6398. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:03:36.328722 (+   200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.343623 (+ 14901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.343830 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6330112}
I20260709 13:03:36.366546 12538 raft_consensus.cc:2410] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:36.102632 12616 rpcz_store.cc:276] 0709 13:03:34.509775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.521297 (+ 11522us) service_pool.cc:224] Handling call
0709 13:03:34.694359 (+173062us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:34.776470 (+ 82111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:34.777712 (+  1242us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:34.783435 (+  5723us) log.cc:844] Serialized 26 byte log entry
0709 13:03:35.013984 (+230549us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:35.016253 (+  2269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:35.021709 (+  5456us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:35.819087 (+797378us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:03:35.892558 (+ 73471us) raft_consensus.cc:1685] finished
0709 13:03:35.892581 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:35.945544 (+ 52963us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8683,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":7646,"spinlock_wait_cycles":7459072,"thread_start_us":189868,"threads_started":1,"wal-append.queue_time_us":620030}
W20260709 13:03:36.373991 14444 log.cc:927] Time spent T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:03:36.375782 12620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1373) took 1600 ms (client timeout 1928 ms). Trace:
W20260709 13:03:36.376245 12620 rpcz_store.cc:269] 0709 13:03:34.775654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.778980 (+  3326us) service_pool.cc:224] Handling call
0709 13:03:36.375615 (+1596635us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b54002a7bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:36.375715 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":882261376}
I20260709 13:03:36.355136 14443 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:36.369690 12588 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:36.382061 14283 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:36.387068 14357 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:36.378538 14299 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:36.368793 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:36.387825 14357 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.388909 14434 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:36.391109 14415 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:36.394683 14357 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:36.343889 14414 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:36.341377 12696 rpcz_store.cc:276] 0709 13:03:33.899580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:33.904929 (+  5349us) service_pool.cc:224] Handling call
0709 13:03:33.980698 (+ 75769us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b5800210698. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454eee 0000000000375939 00007fc3ae4c81e0 00007fc3ae5910c4 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:03:33.980847 (+   149us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:33.981224 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:33.981255 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:34.025589 (+ 44334us) log.cc:844] Serialized 26 byte log entry
0709 13:03:34.396443 (+370854us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:34.415098 (+ 18655us) log.cc:844] Serialized 14 byte log entry
0709 13:03:34.415590 (+   492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:34.415667 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:36.077981 (+1662314us) spinlock_profiling.cc:243] Waited 5.39 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:03:36.329089 (+251108us) raft_consensus.cc:1685] finished
0709 13:03:36.329107 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:36.329249 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":47209,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":4195,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":4895,"spinlock_wait_cycles":17882240,"thread_start_us":155345,"threads_started":2,"wal-append.queue_time_us":440349}
I20260709 13:03:36.398756 14299 raft_consensus.cc:697] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:36.400995 14299 consensus_queue.cc:237] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.403141 14408 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:36.396591 12588 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:36.407374 14255 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:36.413496 14387 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 2.013s	user 0.000s	sys 0.025s
I20260709 13:03:36.395349 14116 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:36.387770 14428 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:36.421439 13197 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:36.423110 13197 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:03:36.423827 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.424134 13197 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:36.425907 13979 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:36.432013 13979 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:36.432637 13979 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:36.433490 14176 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:36.434013 14176 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:36.425426 13197 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:36.445108 12692 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:03:36.446056 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 304555us
W20260709 13:03:36.448449 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 306140us
I20260709 13:03:36.417723 14116 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.454962 12691 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:36.416371 14408 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:36.434404 14176 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:36.438155 14378 consensus_meta.cc:287] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.551s	user 0.008s	sys 0.002s
W20260709 13:03:36.443903 14413 consensus_meta.cc:287] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.584s	user 0.011s	sys 0.001s
I20260709 13:03:36.483289 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:36.483799 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:36.461874 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:36.486047 14453 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.486732 14453 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:36.489729 14453 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:36.491039 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:36.435112 14434 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:36.491231 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:36.494666 12692 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:36.494700 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:36.443394 14297 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:36.497318 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:36.497539 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:36.461572 14116 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:36.494714 14255 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.507404 14255 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.611967 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:36.554246 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:36.674911 12540 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
W20260709 13:03:36.600085 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.676539 12512 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:36.584730 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 383088us
W20260709 13:03:36.560577 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 67437.9us
W20260709 13:03:36.665409 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 53288us
I20260709 13:03:36.679790 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:36.508271 14449 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:36.704219 12512 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:36.705798 12512 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:36.711664 13230 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:36.713128 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:36.713737 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 422461us
I20260709 13:03:36.714546 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:36.715938 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:36.718657 14450 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:03:36.718974 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 255725us
I20260709 13:03:36.720294 14451 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:36.720458 14463 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.720933 14451 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.721043 14463 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.721601 14164 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:36.723444 14463 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:36.723476 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:36.724186 12696 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:03:36.724347 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:36.724679 14164 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:36.725884 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:36.727113 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:36.725654 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:36.728407 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:36.729611 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:36.730890 14451 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:36.732187 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:36.733218 12692 raft_consensus.cc:2393] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 3: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:03:36.656762 12690 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.239s	user 0.049s	sys 0.052s
I20260709 13:03:36.736127 12512 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:36.736675 12696 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:36.561305 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:03:36.694942 14433 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.014s	sys 0.023s
I20260709 13:03:36.501538 14351 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.499269 14434 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.756811 13979 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.759097 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:03:36.741922 12690 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.333s	user 0.049s	sys 0.053s
I20260709 13:03:36.707876 14302 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:03:36.759958 14433 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.015s	sys 0.023s
I20260709 13:03:36.591759 14269 raft_consensus.cc:697] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:36.610862 14428 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:36.509538 14255 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:36.631994 14361 consensus_queue.cc:260] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:36.790071 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 54032.4us
I20260709 13:03:36.508396 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:36.610927 14415 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:36.791482 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:36.509745 14436 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:36.493440 14378 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.593173 14295 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:36.494474 14413 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.706745 13227 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:36.767642 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:36.508631 14297 raft_consensus.cc:697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:36.768148 12588 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
W20260709 13:03:36.815862 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 47774.7us
I20260709 13:03:36.816963 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:36.735565 14416 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:36.777717 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:36.778571 13979 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:36.742273 14256 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:36.786967 12661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.035s	sys 0.033s
I20260709 13:03:36.768105 14448 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:36.764917 14423 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:36.792987 12512 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:36.774173 14450 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.777087 14176 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.789876 13229 raft_consensus.cc:2393] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 3: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:36.774317 14407 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:36.773622 14144 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:03:36.845956 12661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.035s	sys 0.033s
I20260709 13:03:36.893797 13233 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:36.707077 14193 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:03:36.784576 14122 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:36.787326 13228 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:36.778281 14467 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.124s
I20260709 13:03:36.792186 14427 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:36.806597 14255 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:36.886602 14295 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:36.912257 14295 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.912671 14295 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:36.766413 14449 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.893867 14432 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:36.768321 14351 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:36.895208 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 102321us
W20260709 13:03:36.894066 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 126507us
I20260709 13:03:36.851084 14408 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:03:36.855394 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:36.847358 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:36.897135 14302 raft_consensus.cc:697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:36.904804 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:36.907251 14395 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:36.896533 14450 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.911486 14421 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:36.911182 14297 consensus_queue.cc:237] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.898120 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:36.847915 14428 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:36.888813 14447 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:36.852407 14415 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.898449 14407 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.902132 14361 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:37.120813 14447 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:36.899874 14146 raft_consensus.cc:2764] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:03:37.002648 12540 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:37.123238 14446 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:37.100950 12617 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.084s	sys 0.117s
W20260709 13:03:37.122682 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 272753us
I20260709 13:03:37.002120 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:37.123886 12689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 1247) took 2165 ms (client timeout 2234 ms). Trace:
W20260709 13:03:37.124284 14412 consensus_meta.cc:287] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.807s	user 0.011s	sys 0.000s
I20260709 13:03:37.122323 14421 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:37.122001 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 197399us
I20260709 13:03:37.124040 14176 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:03:37.077167 14465 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
W20260709 13:03:36.948377 14341 consensus_meta.cc:287] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.601s	user 0.003s	sys 0.007s
W20260709 13:03:37.131333 13197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.005s	sys 0.010s
W20260709 13:03:37.139725 13197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.005s	sys 0.010s
I20260709 13:03:36.942970 12614 raft_consensus.cc:2393] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 4: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:03:37.131945 12617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.084s	sys 0.120s
I20260709 13:03:37.058600 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:37.133540 12587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.002s	sys 0.009s
I20260709 13:03:37.133317 12539 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
W20260709 13:03:37.134038 12538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 319) took 2317 ms (client timeout 1736 ms). Trace:
I20260709 13:03:37.046947 14413 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:37.142014 12538 rpcz_store.cc:269] 0709 13:03:34.808480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.808592 (+   112us) service_pool.cc:224] Handling call
0709 13:03:37.125013 (+2316421us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400410d54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:37.126240 (+  1227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3569693440}
W20260709 13:03:37.057914 14461 log.cc:927] Time spent T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:03:36.898581 14144 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:37.044400 14269 consensus_queue.cc:237] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:37.148156 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.125679 12615 raft_consensus.cc:2393] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 3: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:36.974105 14408 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:37.080461 14434 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:37.079861 14351 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:37.046581 14378 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:37.043128 14449 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:37.047577 14193 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:37.090040 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 165845us
I20260709 13:03:37.136090 12543 raft_consensus.cc:2393] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 3: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:37.170547 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.171274 12543 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:37.172359 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.173094 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.126156 14432 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:37.173547 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.173853 14432 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:37.174224 12543 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:37.175146 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:37.176067 14432 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:37.176251 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.177273 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1237) took 2244 ms. Trace:
I20260709 13:03:37.135959 12693 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:03:37.141821 12587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.003s	sys 0.009s
W20260709 13:03:37.132344 12689 rpcz_store.cc:269] 0709 13:03:34.935538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.027211 (+ 91673us) service_pool.cc:224] Handling call
0709 13:03:37.100203 (+2072992us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54000c67d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:37.100409 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":475686784}
I20260709 13:03:37.131014 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:37.149820 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:37.156175 12541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1128) took 2078 ms (client timeout 1971 ms). Trace:
I20260709 13:03:37.154551 14413 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.164760 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.167299 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.188987 12539 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:37.167846 12512 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:37.169011 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:37.162216 14403 raft_consensus.cc:1064] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:37.156059 14408 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:37.177877 12695 rpcz_store.cc:276] 0709 13:03:34.932644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.938074 (+  5430us) service_pool.cc:224] Handling call
0709 13:03:34.938369 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:35.057075 (+118706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:35.057108 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:35.073614 (+ 16506us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:35.077803 (+  4189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.177037 (+2099234us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b540012e154. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:37.177081 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:37.177195 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230505728}
I20260709 13:03:37.149060 14418 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:37.187829 12541 rpcz_store.cc:269] 0709 13:03:35.077878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.086138 (+  8260us) service_pool.cc:224] Handling call
0709 13:03:37.155872 (+2069734us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54000a5fd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:37.156066 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":840258432}
I20260709 13:03:37.178934 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:37.196067 12662 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:37.176299 14256 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:37.176667 14302 consensus_queue.cc:237] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:37.150172 14427 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:03:37.183921 14449 consensus_queue.cc:1059] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:03:37.201996 14413 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:37.217746 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:37.204929 14421 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:37.243454 14295 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:37.246627 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:37.246989 14116 consensus_meta.cc:287] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.684s	user 0.012s	sys 0.001s
I20260709 13:03:37.247323 13230 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:37.247432 14116 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:37.248438 13230 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEARNER]: Advancing to term 4
I20260709 13:03:37.136427 14446 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:37.155016 14475 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:37.213270 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2427) took 1210 ms. Trace:
I20260709 13:03:37.213356 14448 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:37.218746 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.218750 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:37.221058 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 53283.3us
I20260709 13:03:37.259443 12546 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:37.258015 12617 rpcz_store.cc:276] 0709 13:03:36.002755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.355437 (+352682us) service_pool.cc:224] Handling call
0709 13:03:36.372194 (+ 16757us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:36.384018 (+ 11824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.384044 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:36.399175 (+ 15131us) log.cc:844] Serialized 26 byte log entry
0709 13:03:37.140740 (+741565us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:37.140792 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.140854 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:37.213044 (+ 72190us) raft_consensus.cc:1685] finished
0709 13:03:37.213068 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:37.213204 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11492,"raft.queue_time_us":17012,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":725633,"threads_started":1,"wal-append.queue_time_us":776656}
I20260709 13:03:37.260818 12512 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:37.261106 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1137) took 3133 ms. Trace:
I20260709 13:03:37.261507 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:37.166435 14454 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:03:37.248816 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.142686 14341 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:37.204015 14144 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:37.250659 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.263302 12539 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:37.262398 14454 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:37.264145 14341 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:37.264261 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:37.265089 12539 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 2: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:37.214141 14423 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:37.266014 14423 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:37.157801 14146 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:37.267784 14146 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:37.235014 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:37.268889 13232 raft_consensus.cc:2393] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 3: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:37.268164 14454 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:37.255479 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 59505.2us
I20260709 13:03:37.196702 14193 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:37.236411 14403 consensus_queue.cc:237] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:37.270473 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 185652us
I20260709 13:03:37.262207 12617 raft_consensus.cc:2376] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2. Re-sending same reply.
I20260709 13:03:37.272428 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.269987 14146 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:37.272863 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:37.211324 14450 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:37.273666 12617 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:37.276647 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.273669 12539 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:37.184512 14351 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:03:37.273794 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:37.329722 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.239691 14418 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.249500 14116 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:37.330519 12546 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:37.236395 14405 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:37.341127 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 67420.4us
I20260709 13:03:37.275666 14419 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:37.259466 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 685) took 1452 ms. Trace:
W20260709 13:03:37.343271 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 85609.3us
I20260709 13:03:37.351358 12512 leader_election.cc:400] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 2. Current term is 3.
I20260709 13:03:37.408946 12512 leader_election.cc:403] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:03:37.409092 12662 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:37.323755 14475 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:37.412328 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:37.259829 14421 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:37.413715 12615 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:03:37.414605 12539 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 13:03:37.415117 12539 pending_rounds.cc:85] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 3
I20260709 13:03:37.415443 12539 pending_rounds.cc:107] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 3.4
I20260709 13:03:37.415663 12539 raft_consensus.cc:2889] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:37.413237 14410 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:37.275754 14453 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:03:37.424604 12544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 335) took 1457 ms (client timeout 1684 ms). Trace:
I20260709 13:03:37.326741 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:37.423105 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:37.422079 14410 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:37.426935 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 139917us
W20260709 13:03:37.425160 12544 rpcz_store.cc:269] 0709 13:03:35.966708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.985731 (+ 19023us) service_pool.cc:224] Handling call
0709 13:03:37.424360 (+1438629us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b5400227c54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:37.424529 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":608133376}
I20260709 13:03:37.446960 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.447639 12546 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:37.292043 14456 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:37.436753 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.449086 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.449982 12539 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:37.341203 14446 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:37.325094 14474 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.396993 14193 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:37.435700 14427 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 2. Current term is 3.
I20260709 13:03:37.452838 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:37.342685 14432 consensus_queue.cc:1059] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 13:03:37.385135 14435 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:37.454694 13200 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:37.426448 14269 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:37.445931 14415 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:37.456244 14421 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:37.438438 14428 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:37.454558 12544 raft_consensus.cc:2376] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3. Re-sending same reply.
I20260709 13:03:37.461943 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.441085 14116 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.462882 12544 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:37.447042 14410 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:37.466394 12692 raft_consensus.cc:1275] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:37.463373 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:37.463830 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.464604 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:37.471553 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:37.475062 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:37.464699 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.416106 14418 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:37.457854 14435 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:37.469405 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:37.470024 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:37.496162 12694 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
W20260709 13:03:37.496371 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.448225 14419 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:37.497728 12695 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:37.437412 14453 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:37.496789 12539 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:37.498692 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:37.499207 12546 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:37.411720 13226 rpcz_store.cc:276] 0709 13:03:35.804452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.270419 (+465967us) service_pool.cc:224] Handling call
0709 13:03:36.270758 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:36.271229 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.271260 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:36.271820 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 13:03:36.734645 (+462825us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:36.741745 (+  7100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:36.760391 (+ 18646us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:37.218488 (+458097us) raft_consensus.cc:1685] finished
0709 13:03:37.221528 (+  3040us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:37.256406 (+ 34878us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2464,"raft.queue_time_us":2975,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":4684,"thread_start_us":377307,"threads_started":1,"wal-append.queue_time_us":478538}
I20260709 13:03:37.501487 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:37.472790 14456 raft_consensus.cc:697] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:37.519292 12687 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:37.459517 14295 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:37.501957 14475 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:37.502756 14435 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:37.521494 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:37.522171 14448 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:37.522675 14448 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:37.504411 14468 log.cc:927] Time spent T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.720s	user 0.003s	sys 0.000s
W20260709 13:03:37.505141 14481 log.cc:927] Time spent T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:03:37.505697 14418 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:37.534309 12512 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:37.507941 14479 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:37.510260 14434 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.538168 14434 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:37.498059 14476 log.cc:927] Time spent T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:03:37.514247 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.539573 12544 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:37.539836 12618 raft_consensus.cc:2410] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:37.540567 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.541260 12544 raft_consensus.cc:2393] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 4: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:37.528107 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:37.542057 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:37.462853 14474 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:37.543030 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.543126 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:37.543704 12544 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 4: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:37.544497 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:37.545142 14449 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:37.517513 12588 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:37.545704 14449 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:37.546765 14479 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:37.547149 14479 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:37.547695 14479 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:37.548813 13199 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:37.548954 14449 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:37.506996 14443 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:37.550992 14297 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:37.550980 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 459) took 1039 ms. Trace:
I20260709 13:03:37.552186 14474 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:37.551963 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:37.530874 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:37.554497 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.555670 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:37.474874 14116 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:37.544950 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:37.515909 12617 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:37.546008 14413 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:37.524433 14473 log.cc:927] Time spent T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:03:37.557367 14351 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:37.562976 14351 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.563310 14351 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:37.564054 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 341) took 1070 ms. Trace:
I20260709 13:03:37.564348 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:37.565652 14448 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:37.566105 14447 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:37.559597 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:37.535588 12512 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:37.568195 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:37.569263 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:37.552423 13228 rpcz_store.cc:276] 0709 13:03:36.511713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.566027 (+ 54314us) service_pool.cc:224] Handling call
0709 13:03:36.647624 (+ 81597us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.899871 (+252247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.550721 (+650850us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400597254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:37.550905 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":268643712}
I20260709 13:03:37.570633 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:37.571879 12512 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:37.572175 12513 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:37.564426 12545 rpcz_store.cc:276] 0709 13:03:36.493551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.493705 (+   154us) service_pool.cc:224] Handling call
0709 13:03:36.671732 (+178027us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:36.671985 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.672011 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:36.701869 (+ 29858us) log.cc:844] Serialized 26 byte log entry
0709 13:03:37.123058 (+421189us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:37.131506 (+  8448us) log.cc:844] Serialized 14 byte log entry
0709 13:03:37.131725 (+   219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.131875 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:37.563835 (+431960us) raft_consensus.cc:1685] finished
0709 13:03:37.563866 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:37.563991 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8309,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":78,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":4147,"thread_start_us":335575,"threads_started":1,"wal-append.queue_time_us":457404}
I20260709 13:03:37.519629 14361 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:03:37.561550 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.569638 12546 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:37.573832 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:37.576120 12662 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:37.576169 12617 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:37.577596 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:37.532449 14415 consensus_queue.cc:1048] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:03:37.556807 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:37.570886 14456 consensus_queue.cc:237] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:38.335820 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 758256us
I20260709 13:03:37.865592 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:37.679637 12588 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:41086 dropped due to backpressure: service queue is full with 50 items
I20260709 13:03:38.503281 12621 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
W20260709 13:03:38.331619 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:37.916586 12544 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:38.504704 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:03:38.244056 12615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1399) took 1486 ms (client timeout 1551 ms). Trace:
I20260709 13:03:38.516450 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1153) took 1054 ms. Trace:
I20260709 13:03:38.510756 12510 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:38.174403 14432 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:37.579798 14427 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:37.585181 14448 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:37.613394 14269 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:03:38.516789 13197 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 2.198s (SENT) [suppressed 35 similar messages]
I20260709 13:03:38.520341 14427 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:38.520833 14269 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.521296 14269 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:37.261801 12690 rpcz_store.cc:276] 0709 13:03:34.127284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:34.128229 (+   945us) service_pool.cc:224] Handling call
0709 13:03:34.408678 (+280449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:34.408941 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:36.240751 (+1831810us) spinlock_profiling.cc:243] Waited 38 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a646f0ac 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a6489455 00007fc3acf713c7
0709 13:03:36.788144 (+547393us) log.cc:844] Serialized 14 byte log entry
0709 13:03:37.260619 (+472475us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:37.260684 (+    65us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:37.260745 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.260902 (+   157us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:37.261035 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":39130,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":2233,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":83,"spinlock_wait_cycles":87392128,"thread_start_us":2799857,"threads_started":2,"wal-append.queue_time_us":597717}
W20260709 13:03:37.864065 14486 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.326s	user 0.002s	sys 0.000s
I20260709 13:03:37.613974 14454 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:03:38.185940 14487 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.556s	user 0.001s	sys 0.001s
I20260709 13:03:38.507278 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:38.547461 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1147) took 1101 ms. Trace:
I20260709 13:03:38.548063 12538 rpcz_store.cc:276] 0709 13:03:37.446436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.506967 (+1060531us) service_pool.cc:224] Handling call
0709 13:03:38.547375 (+ 40408us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.503881 12588 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:41086 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 299)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1410)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1404)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2451)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 304)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2441)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2447)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2449)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2430)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 294)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2433)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1391)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1393)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2445)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2450)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 301)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 302)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 303)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 305)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 306)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 307)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1402)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1403)
I20260709 13:03:37.579602 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2423) took 1588 ms. Trace:
W20260709 13:03:37.694938 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:38.462543 12547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.009s	sys 0.022s
W20260709 13:03:38.550949 12547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.010s	sys 0.022s
I20260709 13:03:38.550415 12619 rpcz_store.cc:276] 0709 13:03:35.990885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.991024 (+   139us) service_pool.cc:224] Handling call
0709 13:03:37.579397 (+1588373us) spinlock_profiling.cc:243] Waited 323 ms on lock 0x7b540009a1d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:37.579535 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":742208896}
I20260709 13:03:38.549678 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:38.544713 14142 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:03:37.889206 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:38.542316 14454 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:37.788821 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:38.554199 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 697) took 1279 ms. Trace:
I20260709 13:03:38.553108 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1154) took 1090 ms. Trace:
W20260709 13:03:38.527037 14423 consensus_meta.cc:287] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 1.260s	user 0.013s	sys 0.000s
I20260709 13:03:38.555023 12538 rpcz_store.cc:276] 0709 13:03:37.462342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.549308 (+1086966us) service_pool.cc:224] Handling call
0709 13:03:38.552986 (+  3678us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.555934 14423 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:38.554001 14454 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:38.556782 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:38.558606 14423 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:38.554778 13231 rpcz_store.cc:276] 0709 13:03:37.274512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.888776 (+614264us) service_pool.cc:224] Handling call
0709 13:03:38.554107 (+665331us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:37.612942 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:38.560715 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:38.561645 13229 raft_consensus.cc:2410] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:38.562126 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 450) took 1144 ms. Trace:
I20260709 13:03:38.562794 13227 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 5: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:38.562505 13229 rpcz_store.cc:276] 0709 13:03:37.418194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.565492 (+147298us) service_pool.cc:224] Handling call
0709 13:03:38.562064 (+996572us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.563736 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 287) took 2350 ms. Trace:
I20260709 13:03:38.564124 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:38.564177 12614 rpcz_store.cc:276] 0709 13:03:36.213725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.338474 (+124749us) service_pool.cc:224] Handling call
0709 13:03:38.563487 (+2225013us) spinlock_profiling.cc:243] Waited 501 ms on lock 0x7b54001e91d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:38.563632 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1151925504}
I20260709 13:03:38.565243 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 448) took 1148 ms. Trace:
I20260709 13:03:38.565789 13229 rpcz_store.cc:276] 0709 13:03:37.417380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.563844 (+1146464us) service_pool.cc:224] Handling call
0709 13:03:38.565180 (+  1336us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:38.566484 14484 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 1.028s	user 0.003s	sys 0.000s
I20260709 13:03:38.566949 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:38.567793 13229 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:38.568037 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 695) took 1378 ms. Trace:
I20260709 13:03:37.618238 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:38.570324 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:38.514977 12621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2443) took 1600 ms (client timeout 1859 ms). Trace:
I20260709 13:03:37.604629 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.626758 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:38.112684 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 283) took 2040 ms. Trace:
I20260709 13:03:38.571990 12546 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:38.572789 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1148) took 1112 ms. Trace:
W20260709 13:03:37.928969 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:38.573864 12621 rpcz_store.cc:269] 0709 13:03:36.914961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.865185 (+950224us) service_pool.cc:224] Handling call
0709 13:03:38.514912 (+649727us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.161455 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:38.575277 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 454) took 1151 ms. Trace:
W20260709 13:03:38.159034 12540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2362) took 1404 ms (client timeout 1584 ms). Trace:
W20260709 13:03:38.030426 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.516839 12544 rpcz_store.cc:276] 0709 13:03:37.462104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.544259 (+ 82155us) service_pool.cc:224] Handling call
0709 13:03:38.516393 (+972134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.105741 13233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 457) took 1642 ms. Trace:
W20260709 13:03:38.101908 13230 consensus_meta.cc:287] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.850s	user 0.012s	sys 0.000s
I20260709 13:03:38.572625 12622 rpcz_store.cc:276] 0709 13:03:36.072146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.386182 (+314036us) service_pool.cc:224] Handling call
0709 13:03:36.396160 (+  9978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:37.937639 (+1541479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:37.937684 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:37.937742 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:37.937790 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.112390 (+174600us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54000203d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:38.112452 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.112614 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3541325696}
I20260709 13:03:38.335384 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:37.976346 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:38.517612 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 355) took 1002 ms. Trace:
I20260709 13:03:38.579180 12541 rpcz_store.cc:276] 0709 13:03:37.514727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.504406 (+989679us) service_pool.cc:224] Handling call
0709 13:03:38.517534 (+ 13128us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:38.575852 12540 rpcz_store.cc:269] 0709 13:03:36.755085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.763220 (+  8135us) service_pool.cc:224] Handling call
0709 13:03:38.158758 (+1395538us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b540026b454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:38.158942 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":361208064}
I20260709 13:03:38.579298 12617 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
W20260709 13:03:38.580482 12617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 293) took 2101 ms (client timeout 2198 ms). Trace:
I20260709 13:03:38.580639 12620 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:38.568413 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 700) took 1293 ms. Trace:
W20260709 13:03:38.580955 12617 rpcz_store.cc:269] 0709 13:03:36.478761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.617400 (+1138639us) service_pool.cc:224] Handling call
0709 13:03:38.580418 (+963018us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:37.576270 14452 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:38.516583 12615 rpcz_store.cc:269] 0709 13:03:36.757852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.157974 (+400122us) service_pool.cc:224] Handling call
0709 13:03:38.243789 (+1085815us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54001eaad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:38.243960 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":508604288}
I20260709 13:03:38.111402 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 1249) took 1658 ms. Trace:
I20260709 13:03:38.568504 13232 rpcz_store.cc:276] 0709 13:03:37.189588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.269606 (+ 80018us) service_pool.cc:224] Handling call
0709 13:03:37.269934 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:37.270262 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:37.270289 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:37.270751 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:03:37.387830 (+117079us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:37.387888 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.387975 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:38.565839 (+1177864us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:03:38.567717 (+  1878us) raft_consensus.cc:1685] finished
0709 13:03:38.567753 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.567966 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1076,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":248133376,"thread_start_us":61653,"threads_started":1,"wal-append.queue_time_us":266430}
I20260709 13:03:37.807327 14293 raft_consensus.cc:993] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:38.576115 13233 rpcz_store.cc:276] 0709 13:03:36.463222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.463343 (+   121us) service_pool.cc:224] Handling call
0709 13:03:36.497248 (+ 33905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:36.896642 (+399394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.105370 (+1208728us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b54004e2854. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:38.105649 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":911444864}
I20260709 13:03:38.384421 14434 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:37.574697 14430 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:38.115926 14482 log.cc:927] Time spent T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.592s	user 0.003s	sys 0.000s
I20260709 13:03:37.578593 14193 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:38.568964 14477 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.595117 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:38.593236 14415 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.596058 14415 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:38.596612 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:38.597215 12541 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:03:37.575475 14361 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:37.583732 14449 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:03:38.563135 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 53565.1us
I20260709 13:03:38.554774 13226 raft_consensus.cc:2393] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 3: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:38.568605 12692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1268) took 1097 ms. Trace:
I20260709 13:03:38.576833 14448 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:38.571885 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1159) took 1082 ms. Trace:
I20260709 13:03:38.572023 12545 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 1.
I20260709 13:03:37.967352 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:38.291764 14479 consensus_meta.cc:287] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.744s	user 0.008s	sys 0.003s
I20260709 13:03:38.336400 14419 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:37.703402 14453 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:38.573309 12546 rpcz_store.cc:276] 0709 13:03:37.460778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.604246 (+143468us) service_pool.cc:224] Handling call
0709 13:03:38.572733 (+968487us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:37.621737 14428 consensus_queue.cc:1059] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.883s
I20260709 13:03:38.582552 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:38.583107 12688 rpcz_store.cc:276] 0709 13:03:36.452552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.452701 (+   149us) service_pool.cc:224] Handling call
0709 13:03:38.111130 (+1658429us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b54001b5654. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:38.111316 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2046381952}
I20260709 13:03:37.870100 14256 raft_consensus.cc:3055] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:38.620658 12544 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:38.621405 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1162) took 1045 ms. Trace:
I20260709 13:03:38.621816 12544 rpcz_store.cc:276] 0709 13:03:37.575746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.582260 (+1006514us) service_pool.cc:224] Handling call
0709 13:03:38.621334 (+ 39074us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.605916 14361 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:38.632001 12694 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:38.608724 14449 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:38.590327 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:37.677271 14116 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:38.595002 14477 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:38.597306 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:38.643726 13232 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:38.598089 14415 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:37.898660 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:38.599915 12620 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:37.577544 14443 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:03:37.894002 12618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2431) took 1428 ms (client timeout 1584 ms). Trace:
W20260709 13:03:38.656857 12618 rpcz_store.cc:269] 0709 13:03:36.465504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.494481 (+ 28977us) service_pool.cc:224] Handling call
0709 13:03:37.893693 (+1399212us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400375854. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:37.893912 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2400251648}
I20260709 13:03:38.653816 14427 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:37.836472 14435 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:38.670831 14435 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:38.672626 13232 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:38.673350 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 456) took 1222 ms. Trace:
I20260709 13:03:38.675357 13232 rpcz_store.cc:276] 0709 13:03:37.450906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.597037 (+1146131us) service_pool.cc:224] Handling call
0709 13:03:38.673277 (+ 76240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.578059 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 467) took 1116 ms. Trace:
I20260709 13:03:37.968034 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1389) took 2940 ms. Trace:
I20260709 13:03:38.677732 13231 rpcz_store.cc:276] 0709 13:03:37.445649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.560398 (+1114749us) service_pool.cc:224] Handling call
0709 13:03:38.561518 (+  1120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.677870 12613 rpcz_store.cc:276] 0709 13:03:35.027439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.180810 (+153371us) service_pool.cc:224] Handling call
0709 13:03:35.893496 (+712686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:35.963783 (+ 70287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.967715 (+2003932us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b540031c250. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:37.967921 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1638364928}
I20260709 13:03:38.678926 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:38.679486 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:38.679798 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 453) took 1259 ms. Trace:
I20260709 13:03:38.680435 12613 raft_consensus.cc:2368] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4.
I20260709 13:03:38.681841 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 1270) took 1108 ms. Trace:
I20260709 13:03:38.681123 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1406) took 1109 ms. Trace:
I20260709 13:03:38.611070 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1157) took 1141 ms. Trace:
W20260709 13:03:38.603268 14408 consensus_meta.cc:287] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 1.357s	user 0.010s	sys 0.004s
I20260709 13:03:38.527158 14432 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:38.607327 12692 rpcz_store.cc:276] 0709 13:03:37.471665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.497874 (+ 26209us) service_pool.cc:224] Handling call
0709 13:03:37.498231 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:37.520278 (+ 22047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:37.520307 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:37.520760 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:03:38.238569 (+717809us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b48001b0258. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3ae4a2aa1 00007fc3ae499b37 00007fc3ae4999ca 00007fc3ae59126f 00007fc3ae590f37 00007fc3ae5a555c 00007fc3ae5a5508 00007fc3ae5a5488 00007fc3ae5a5443 00007fc3ae5a46ec 00007fc3ad4cea96
0709 13:03:38.336240 (+ 97671us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:38.336283 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.520241 (+183958us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b540012dc54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:38.520298 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:38.568399 (+ 48101us) raft_consensus.cc:1685] finished
0709 13:03:38.568420 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.568549 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2786,"raft.queue_time_us":2882,"raft.run_wall_time_us":718058,"spinlock_wait_cycles":436667776,"thread_start_us":96452,"threads_started":1,"wal-append.queue_time_us":1045769}
I20260709 13:03:38.591166 14430 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.616793 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 699) took 1341 ms. Trace:
I20260709 13:03:38.617712 12695 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:03:38.601663 14407 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:38.602610 14452 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:38.575729 13234 rpcz_store.cc:276] 0709 13:03:37.424288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.161105 (+736817us) service_pool.cc:224] Handling call
0709 13:03:38.575196 (+414091us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.583624 13229 rpcz_store.cc:276] 0709 13:03:37.275449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.566621 (+1291172us) service_pool.cc:224] Handling call
0709 13:03:38.568329 (+  1708us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.635082 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:38.704562 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:38.705117 12619 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:38.636113 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2348) took 1916 ms. Trace:
I20260709 13:03:38.683504 12613 rpcz_store.cc:276] 0709 13:03:37.571925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.679188 (+1107263us) service_pool.cc:224] Handling call
0709 13:03:38.681052 (+  1864us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.703469 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:38.699559 12541 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:37.731074 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:38.592903 13230 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 13:03:38.609943 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 458) took 1151 ms. Trace:
I20260709 13:03:38.617547 14419 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:38.654603 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:38.709853 12540 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:38.655514 12620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 297) took 1365 ms (client timeout 1631 ms). Trace:
I20260709 13:03:38.528246 14445 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:38.711721 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:38.712783 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:38.713399 12613 raft_consensus.cc:2376] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3. Re-sending same reply.
W20260709 13:03:38.696988 14410 consensus_meta.cc:287] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.198s	user 0.005s	sys 0.006s
I20260709 13:03:38.642383 14448 raft_consensus.cc:697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:38.658215 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:38.629421 14256 raft_consensus.cc:740] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:38.658207 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:38.641857 14449 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:38.711476 12620 rpcz_store.cc:269] 0709 13:03:37.290554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.975973 (+685419us) service_pool.cc:224] Handling call
0709 13:03:38.655429 (+679456us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.731360 12618 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:38.747973 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 296) took 1478 ms. Trace:
I20260709 13:03:38.748631 12618 rpcz_store.cc:276] 0709 13:03:37.269978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.657968 (+1387990us) service_pool.cc:224] Handling call
0709 13:03:38.747906 (+ 89938us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.636849 14193 raft_consensus.cc:1081] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 2 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:38.385807 12585 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:41086 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1401)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 299)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1392)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1410)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1404)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2451)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 304)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2441)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2447)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2449)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2430)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 294)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2433)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1391)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1393)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2445)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2450)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 301)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 302)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 303)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 305)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 306)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 307)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1402)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1403)
I20260709 13:03:38.706043 12543 rpcz_store.cc:276] 0709 13:03:36.734954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.336916 (+601962us) service_pool.cc:224] Handling call
0709 13:03:37.337316 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:37.421281 (+ 83965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:37.421309 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:37.440044 (+ 18735us) log.cc:844] Serialized 26 byte log entry
0709 13:03:37.557405 (+117361us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:37.557431 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:37.557476 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:38.173063 (+615587us) spinlock_profiling.cc:243] Waited 49.5 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:03:38.632197 (+459134us) raft_consensus.cc:1685] finished
0709 13:03:38.632227 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.636030 (+  3803us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12445,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":12456,"spinlock_wait_cycles":113798528,"thread_start_us":93260,"threads_started":1,"wal-append.queue_time_us":179199}
I20260709 13:03:38.682516 12545 rpcz_store.cc:276] 0709 13:03:37.470264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.613064 (+142800us) service_pool.cc:224] Handling call
0709 13:03:38.611004 (+997940us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.619553 14479 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:38.687232 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:38.688999 14477 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:38.689728 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 396) took 3269 ms. Trace:
W20260709 13:03:38.692282 14297 consensus_meta.cc:287] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 1.141s	user 0.009s	sys 0.002s
I20260709 13:03:38.692126 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 340) took 2201 ms. Trace:
W20260709 13:03:38.692926 12616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2440) took 1963 ms (client timeout 2066 ms). Trace:
I20260709 13:03:38.696671 13235 rpcz_store.cc:276] 0709 13:03:37.275147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.966935 (+691788us) service_pool.cc:224] Handling call
0709 13:03:38.616735 (+649800us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.683218 12694 rpcz_store.cc:276] 0709 13:03:37.573695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.574347 (+   652us) service_pool.cc:224] Handling call
0709 13:03:38.681693 (+1107346us) spinlock_profiling.cc:243] Waited 62.4 ms on lock 0x7b540009cc54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:38.681789 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143612800}
I20260709 13:03:38.705749 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 457) took 1254 ms. Trace:
W20260709 13:03:38.790702 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 273083us
I20260709 13:03:38.791064 13232 rpcz_store.cc:276] 0709 13:03:37.451218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.704273 (+1253055us) service_pool.cc:224] Handling call
0709 13:03:38.705693 (+  1420us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.680213 13231 rpcz_store.cc:276] 0709 13:03:37.420792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.678636 (+1257844us) service_pool.cc:224] Handling call
0709 13:03:38.679728 (+  1092us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.714048 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1408) took 1137 ms. Trace:
I20260709 13:03:38.798324 12613 rpcz_store.cc:276] 0709 13:03:37.577004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.706297 (+1129293us) service_pool.cc:224] Handling call
0709 13:03:38.713945 (+  7648us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.723196 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:38.798923 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 274032us
I20260709 13:03:38.702194 14430 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:38.610738 12538 rpcz_store.cc:276] 0709 13:03:37.490045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.564465 (+1074420us) service_pool.cc:224] Handling call
0709 13:03:38.571732 (+  7267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.754523 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:38.755440 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:38.709263 13230 pending_rounds.cc:85] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Aborting all ops after (but not including) 3
I20260709 13:03:38.798986 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:38.800747 12545 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:38.723642 14427 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.805619 12617 raft_consensus.cc:2393] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 3: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:03:38.786077 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 125325us
I20260709 13:03:38.792454 12619 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:38.807417 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2352) took 2069 ms. Trace:
W20260709 13:03:38.807291 12619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 299) took 1512 ms (client timeout 1882 ms). Trace:
W20260709 13:03:38.808094 12619 rpcz_store.cc:269] 0709 13:03:37.295051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.617541 (+1322490us) service_pool.cc:224] Handling call
0709 13:03:38.807242 (+189701us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.808984 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:38.799360 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:38.780043 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:38.780827 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:38.677500 14361 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:38.703971 14408 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:38.809543 12619 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:38.812573 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2355) took 2064 ms. Trace:
I20260709 13:03:38.815402 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1405) took 1248 ms. Trace:
I20260709 13:03:38.815855 12619 rpcz_store.cc:276] 0709 13:03:37.566901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.808767 (+1241866us) service_pool.cc:224] Handling call
0709 13:03:38.815347 (+  6580us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.807806 12541 rpcz_store.cc:276] 0709 13:03:36.738179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.803476 (+2065297us) service_pool.cc:224] Handling call
0709 13:03:38.806592 (+  3116us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.806843 (+   251us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:38.806873 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:38.807012 (+   139us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:38.807057 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.807115 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.807226 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.817342 12618 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:03:38.813205 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:38.710558 14454 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:38.818090 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1404) took 1257 ms. Trace:
I20260709 13:03:38.818737 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2451) took 1069 ms. Trace:
I20260709 13:03:38.815342 12538 rpcz_store.cc:276] 0709 13:03:36.739230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.803340 (+2064110us) service_pool.cc:224] Handling call
0709 13:03:38.803603 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.803756 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:38.803779 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:38.803819 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:38.803852 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.803899 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.803991 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.812664 12620 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 4: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:38.709401 13226 rpcz_store.cc:276] 0709 13:03:37.458943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.703153 (+244210us) service_pool.cc:224] Handling call
0709 13:03:38.609855 (+906702us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.813972 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2359) took 2071 ms. Trace:
I20260709 13:03:38.819070 12618 rpcz_store.cc:276] 0709 13:03:37.560357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.780570 (+1220213us) service_pool.cc:224] Handling call
0709 13:03:38.818033 (+ 37463us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.781890 14443 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.819293 12613 rpcz_store.cc:276] 0709 13:03:37.749914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.799027 (+1049113us) service_pool.cc:224] Handling call
0709 13:03:38.818684 (+ 19657us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.817952 12541 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:38.819993 12543 rpcz_store.cc:276] 0709 13:03:36.742211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.813171 (+2070960us) service_pool.cc:224] Handling call
0709 13:03:38.813450 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.813635 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:38.813669 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:38.813710 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:38.813742 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.813810 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.813918 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.821178 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2363) took 2065 ms. Trace:
W20260709 13:03:38.821645 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 304871us
I20260709 13:03:38.819944 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:38.820408 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:38.821518 12541 rpcz_store.cc:276] 0709 13:03:36.755384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.817197 (+2061813us) service_pool.cc:224] Handling call
0709 13:03:38.817578 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.820833 (+  3255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.821121 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.802837 14302 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.800889 13230 pending_rounds.cc:107] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Aborting uncommitted NO_OP operation due to leader change: 3.4
I20260709 13:03:38.828522 12662 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:38.825510 12545 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:38.866995 12538 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:38.826066 12618 raft_consensus.cc:2393] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 3: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:38.826593 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2448) took 1534 ms. Trace:
I20260709 13:03:38.830930 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 347) took 1318 ms. Trace:
I20260709 13:03:38.798133 14297 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:38.711040 14269 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:38.868909 12620 rpcz_store.cc:276] 0709 13:03:37.291809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.779763 (+1487954us) service_pool.cc:224] Handling call
0709 13:03:38.826544 (+ 46781us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.827957 12540 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:38.829902 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:38.870913 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 304) took 1371 ms. Trace:
I20260709 13:03:38.710608 14452 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:38.868296 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2356) took 2128 ms. Trace:
I20260709 13:03:38.750168 14410 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:38.876044 12618 rpcz_store.cc:276] 0709 13:03:37.499321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.820206 (+1320885us) service_pool.cc:224] Handling call
0709 13:03:38.870851 (+ 50645us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.877074 12622 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:03:38.797969 12616 rpcz_store.cc:269] 0709 13:03:36.729421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.898281 (+1168860us) service_pool.cc:224] Handling call
0709 13:03:38.692854 (+794573us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:38.814002 13228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 469) took 1253 ms (client timeout 1630 ms). Trace:
I20260709 13:03:38.818403 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:38.878432 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:38.878535 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:38.878902 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1271) took 1071 ms. Trace:
I20260709 13:03:38.880275 12545 rpcz_store.cc:276] 0709 13:03:36.739527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.805884 (+2066357us) service_pool.cc:224] Handling call
0709 13:03:38.825353 (+ 19469us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.868004 (+ 42651us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.868232 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.867833 14434 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:38.870014 14435 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:03:38.882371 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:38.905403 12619 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:38.892954 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:38.906263 12619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2436) took 2395 ms (client timeout 3139 ms). Trace:
I20260709 13:03:38.906427 12621 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:38.884804 14193 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:38.885454 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:38.870467 12543 rpcz_store.cc:276] 0709 13:03:37.512178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.830086 (+1317908us) service_pool.cc:224] Handling call
0709 13:03:38.830379 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.830543 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:38.830572 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:38.830619 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:38.830659 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.830723 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.830866 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.786924 12693 rpcz_store.cc:276] 0709 13:03:35.420619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:35.524995 (+104376us) service_pool.cc:224] Handling call
0709 13:03:37.122181 (+1597186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:37.183981 (+ 61800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.689429 (+1505448us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54000c67d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:38.689640 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3392408320}
I20260709 13:03:38.914969 13231 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:03:38.818766 14450 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.544957 12586 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:60170 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1410)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1400)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1394)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1408)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2448)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1404)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2451)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1405)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2436)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 304)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2441)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2447)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2449)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 298)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 291)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2430)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 294)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2432)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2433)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2434)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2435)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2437)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2438)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2442)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1391)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1393)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2444)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2445)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2450)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 301)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 302)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 303)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 305)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 306)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 307)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1402)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1403)
I20260709 13:03:38.915758 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 466) took 1658 ms. Trace:
I20260709 13:03:38.915586 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:38.890236 12622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1394) took 2142 ms (client timeout 2635 ms). Trace:
I20260709 13:03:38.919066 14454 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:38.916967 12622 rpcz_store.cc:269] 0709 13:03:36.747700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.829584 (+2081884us) service_pool.cc:224] Handling call
0709 13:03:38.890175 (+ 60591us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65024}
I20260709 13:03:38.919874 14448 consensus_queue.cc:237] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:38.921166 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:38.922194 12622 raft_consensus.cc:2393] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 5: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:38.742838 14445 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:38.869582 13230 raft_consensus.cc:2889] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:38.867544 14496 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.871469 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:38.875710 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1158) took 1405 ms. Trace:
I20260709 13:03:38.888760 13234 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:38.903635 12695 rpcz_store.cc:276] 0709 13:03:37.807897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.812508 (+  4611us) service_pool.cc:224] Handling call
0709 13:03:37.859838 (+ 47330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:38.702208 (+842370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.878642 (+176434us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b54002c8654. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:38.878839 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1742197120}
W20260709 13:03:38.883347 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 201800us
I20260709 13:03:38.927433 12538 rpcz_store.cc:276] 0709 13:03:37.470847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.828791 (+1357944us) service_pool.cc:224] Handling call
0709 13:03:38.829162 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.868076 (+ 38914us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.875604 (+  7528us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.927444 13197 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:38.929649 13197 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:03:38.829290 14443 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:38.907023 12621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1401) took 1349 ms (client timeout 1543 ms). Trace:
W20260709 13:03:38.906821 12619 rpcz_store.cc:269] 0709 13:03:36.510456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.837007 (+2326551us) service_pool.cc:224] Handling call
0709 13:03:38.906183 (+ 69176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.931281 13197 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:38.932861 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:38.933411 12619 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:03:38.814545 14427 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:38.935305 13197 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:03:38.912365 12618 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:38.886409 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 339) took 2415 ms. Trace:
I20260709 13:03:38.913436 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:38.936245 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2441) took 2206 ms. Trace:
I20260709 13:03:38.917150 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2449) took 1504 ms. Trace:
W20260709 13:03:38.935695 12621 rpcz_store.cc:269] 0709 13:03:37.557698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.881066 (+1323368us) service_pool.cc:224] Handling call
0709 13:03:38.906967 (+ 25901us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.923307 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:38.829952 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:38.937043 12618 rpcz_store.cc:276] 0709 13:03:36.729858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.885186 (+2155328us) service_pool.cc:224] Handling call
0709 13:03:38.936165 (+ 50979us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.938493 12615 raft_consensus.cc:2393] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 3: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:38.891160 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:38.935206 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 352) took 1421 ms. Trace:
I20260709 13:03:38.829454 14116 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
I20260709 13:03:38.939283 12545 rpcz_store.cc:276] 0709 13:03:37.513648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.922758 (+1409110us) service_pool.cc:224] Handling call
0709 13:03:38.934667 (+ 11909us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.934858 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:38.934885 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:38.934928 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:38.934980 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.935035 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.935144 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.953724 12546 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:38.937144 12620 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 4: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:38.955351 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2447) took 1663 ms. Trace:
I20260709 13:03:38.955849 12620 rpcz_store.cc:276] 0709 13:03:37.291506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.894848 (+1603342us) service_pool.cc:224] Handling call
0709 13:03:38.955270 (+ 60422us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:38.956822 12615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1392) took 2209 ms (client timeout 2514 ms). Trace:
W20260709 13:03:38.957360 12615 rpcz_store.cc:269] 0709 13:03:36.747111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.829554 (+2082443us) service_pool.cc:224] Handling call
0709 13:03:38.956747 (+127193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21760}
I20260709 13:03:38.958647 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:38.937983 12622 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:38.941413 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 693) took 1796 ms. Trace:
I20260709 13:03:38.959439 12615 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:38.941928 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:38.934067 14496 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:38.790220 12542 rpcz_store.cc:276] 0709 13:03:36.490731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.496096 (+  5365us) service_pool.cc:224] Handling call
0709 13:03:37.747977 (+1251881us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b5800000c98. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:03:37.748264 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.552109 (+803845us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:38.552153 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:38.552218 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:38.552270 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.691800 (+139530us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b54002cc754. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:38.691876 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.692041 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1834145792}
I20260709 13:03:38.929044 14450 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:38.943789 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:38.914319 14435 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:38.984463 14435 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:38.913105 14498 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:38.985167 14498 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:38.986382 13227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 449) took 1568 ms (client timeout 1732 ms). Trace:
I20260709 13:03:38.987478 14498 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:38.987062 13227 rpcz_store.cc:269] 0709 13:03:37.417815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.553800 (+135985us) service_pool.cc:224] Handling call
0709 13:03:38.986107 (+1432307us) spinlock_profiling.cc:243] Waited 59.2 ms on lock 0x7b540014afd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:38.986294 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136219904}
I20260709 13:03:38.916401 13231 rpcz_store.cc:276] 0709 13:03:37.256987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.825357 (+1568370us) service_pool.cc:224] Handling call
0709 13:03:38.889204 (+ 63847us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:38.915456 (+ 26252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.915696 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.946206 12544 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:38.988596 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:38.988782 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:38.946771 14361 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:38.947300 14445 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:38.947494 14410 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:38.935609 14237 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:38.948797 14408 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:38.949015 14479 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:38.911942 14193 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:38.953115 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:38.826020 14256 consensus_queue.cc:260] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:38.888460 13228 rpcz_store.cc:269] 0709 13:03:37.548800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.686748 (+137948us) service_pool.cc:224] Handling call
0709 13:03:38.802185 (+1115437us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.967708 13197 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:38.968075 12618 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:03:38.970214 14452 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:38.965875 14423 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:38.970474 14456 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:38.966123 14421 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:38.908715 14434 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:38.972577 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:38.965772 14422 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:38.937438 12616 rpcz_store.cc:276] 0709 13:03:37.412543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.912606 (+1500063us) service_pool.cc:224] Handling call
0709 13:03:38.917051 (+  4445us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:38.974010 14432 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:38.976426 12694 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:03:38.965718 14407 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:38.976926 12691 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:38.889765 14302 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:38.978513 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:38.936124 12547 rpcz_store.cc:276] 0709 13:03:36.471284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:36.490515 (+ 19231us) service_pool.cc:224] Handling call
0709 13:03:36.490888 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:36.492063 (+  1175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:36.492108 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:36.498116 (+  6008us) log.cc:844] Serialized 26 byte log entry
0709 13:03:37.743248 (+1245132us) spinlock_profiling.cc:243] Waited 45.7 ms on lock 0x7b180005e600. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:03:38.551403 (+808155us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:38.875361 (+323958us) log.cc:844] Serialized 14 byte log entry
0709 13:03:38.876061 (+   700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.876139 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:38.876180 (+    41us) raft_consensus.cc:1685] finished
0709 13:03:38.881679 (+  5499us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.886311 (+  4632us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5483,"raft.queue_time_us":3923,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":10658,"spinlock_wait_cycles":105172736,"thread_start_us":1131502,"threads_started":2,"wal-append.queue_time_us":2119572}
I20260709 13:03:38.977116 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2430) took 2515 ms. Trace:
I20260709 13:03:38.980031 12619 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:38.970757 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:38.980576 12614 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:38.982177 14443 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:39.040292 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 292) took 2561 ms. Trace:
I20260709 13:03:38.980489 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:03:39.132479 13200 leader_election.cc:336] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.684s (SENT)
W20260709 13:03:39.061465 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:38.994097 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 63298.6us
I20260709 13:03:39.135278 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:39.041360 12544 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:39.136200 12692 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:39.136365 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1161) took 1610 ms. Trace:
I20260709 13:03:39.133338 12621 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:39.137985 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 291) took 2713 ms. Trace:
I20260709 13:03:39.134590 12615 rpcz_store.cc:276] 0709 13:03:36.461332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.976351 (+2515019us) service_pool.cc:224] Handling call
0709 13:03:38.976635 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.976812 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:38.976838 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:38.976876 (+    38us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:38.976910 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.976961 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:38.977060 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:39.015067 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.139503 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:39.111334 12510 leader_election.cc:336] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.928s (SENT)
I20260709 13:03:39.123251 12622 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:39.136937 12544 rpcz_store.cc:276] 0709 13:03:37.526076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.989821 (+1463745us) service_pool.cc:224] Handling call
0709 13:03:39.040984 (+ 51163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.136084 (+ 95100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.136293 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.132755 12620 rpcz_store.cc:276] 0709 13:03:36.478445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.991788 (+2513343us) service_pool.cc:224] Handling call
0709 13:03:39.039595 (+ 47807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.039851 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.039887 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:39.039945 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:39.039992 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.040062 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.040208 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.142136 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 298) took 1851 ms. Trace:
I20260709 13:03:39.138458 12618 rpcz_store.cc:276] 0709 13:03:36.477958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.967601 (+2489643us) service_pool.cc:224] Handling call
0709 13:03:38.967878 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:39.137648 (+169770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.137909 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.141270 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:39.146159 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 274734us
I20260709 13:03:39.142668 12622 rpcz_store.cc:276] 0709 13:03:37.290914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.923045 (+1632131us) service_pool.cc:224] Handling call
0709 13:03:39.142016 (+218971us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.141021 12510 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:39.134215 13200 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:39.146284 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:39.150401 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:38.993752 12545 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
W20260709 13:03:38.975999 14351 consensus_meta.cc:287] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 1.402s	user 0.010s	sys 0.002s
W20260709 13:03:39.156490 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 188842us
I20260709 13:03:39.144678 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:39.179234 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 294) took 2700 ms. Trace:
I20260709 13:03:39.179756 12615 rpcz_store.cc:276] 0709 13:03:36.479061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.159873 (+2680812us) service_pool.cc:224] Handling call
0709 13:03:39.178730 (+ 18857us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.178896 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.178927 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:39.178967 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:39.178998 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.179049 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.179178 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.181979 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 696) took 1991 ms. Trace:
W20260709 13:03:39.182855 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 71586.6us
I20260709 13:03:39.153429 12545 pending_rounds.cc:85] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 5
I20260709 13:03:39.185065 12545 pending_rounds.cc:107] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:03:39.185765 12662 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:39.186213 12545 raft_consensus.cc:2889] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:39.178049 12614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1410) took 1564 ms (client timeout 1726 ms). Trace:
I20260709 13:03:39.185482 12693 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:39.190217 12613 raft_consensus.cc:2410] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:03:39.005367 14269 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:39.185945 12691 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:39.183514 13232 rpcz_store.cc:276] 0709 13:03:37.190936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.801017 (+1610081us) service_pool.cc:224] Handling call
0709 13:03:38.819220 (+ 18203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.819428 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:03:38.933210 (+113782us) log.cc:844] Serialized 14 byte log entry
0709 13:03:39.181669 (+248459us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:39.181719 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:39.181757 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.181819 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.181928 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14683,"prepare.queue_time_us":184834,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"thread_start_us":263454,"threads_started":2,"wal-append.queue_time_us":221037}
I20260709 13:03:39.193656 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 357) took 1622 ms. Trace:
I20260709 13:03:39.253353 12547 rpcz_store.cc:276] 0709 13:03:37.571507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.132865 (+1561358us) service_pool.cc:224] Handling call
0709 13:03:39.192934 (+ 60069us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.193186 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.193227 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:39.193284 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:39.193345 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.193433 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.193583 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:39.024387 14494 log.cc:927] Time spent T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:03:39.216480 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:39.217106 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:39.252187 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:39.218281 14477 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:38.969048 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 698) took 1694 ms. Trace:
W20260709 13:03:39.217226 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 81586.3us
I20260709 13:03:39.185257 14498 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:39.147010 14422 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:39.155268 14407 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:39.216984 14256 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:39.220434 14237 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:39.258603 14497 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:39.260483 14430 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:39.270748 14449 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:39.192063 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 354) took 1677 ms. Trace:
I20260709 13:03:39.005281 13231 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:03:39.225922 12692 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:39.191788 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1163) took 1565 ms. Trace:
I20260709 13:03:38.989328 14427 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:39.141372 14193 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:39.199182 13197 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:39.241847 12687 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:03:39.239976 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:39.147897 14499 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:03:39.244881 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 59167.6us
I20260709 13:03:39.023712 14415 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:39.278157 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:39.245467 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 295) took 2766 ms. Trace:
I20260709 13:03:39.145783 14446 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:39.280112 14302 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:39.356937 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:39.358991 12689 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:39.356554 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:39.247503 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 349) took 1729 ms. Trace:
I20260709 13:03:39.234093 12619 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:03:39.201967 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:39.073379 14506 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260709 13:03:39.255856 12691 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:03:39.218822 14443 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:39.255251 12694 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:39.246833 14507 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:03:39.267393 12659 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:03:38.966698 13230 rpcz_store.cc:276] 0709 13:03:37.144710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.248018 (+103308us) service_pool.cc:224] Handling call
0709 13:03:37.248323 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:38.941103 (+1692780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.941344 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.246865 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:39.194108 14351 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:39.246598 14428 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:39.259392 14477 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.180866 14456 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:39.286268 12545 rpcz_store.cc:276] 0709 13:03:37.514454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.953974 (+1439520us) service_pool.cc:224] Handling call
0709 13:03:38.993283 (+ 39309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.191853 (+198570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.192016 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:39.286473 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 87422.7us
I20260709 13:03:39.287056 12688 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:39.297829 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:03:39.300119 12539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 356) took 1784 ms (client timeout 1684 ms). Trace:
I20260709 13:03:39.285801 12544 rpcz_store.cc:276] 0709 13:03:37.626901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.142280 (+1515379us) service_pool.cc:224] Handling call
0709 13:03:39.191247 (+ 48967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.191467 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.191500 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:39.191545 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:39.191586 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.191639 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.191738 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.290299 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:39.301883 12617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1400) took 1744 ms (client timeout 1791 ms). Trace:
I20260709 13:03:39.308221 12621 rpcz_store.cc:276] 0709 13:03:36.479348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.196370 (+2717022us) service_pool.cc:224] Handling call
0709 13:03:39.244958 (+ 48588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.245131 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.245161 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:39.245201 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:39.245238 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.245297 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.245408 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.334023 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:39.273723 14422 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:39.276149 14496 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:39.276234 14407 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:39.366432 12543 rpcz_store.cc:276] 0709 13:03:37.512864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.912423 (+1399559us) service_pool.cc:224] Handling call
0709 13:03:38.912803 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:38.923460 (+ 10657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:38.923507 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:38.949686 (+ 26179us) log.cc:844] Serialized 26 byte log entry
0709 13:03:38.975812 (+ 26126us) spinlock_profiling.cc:243] Waited 4.92 ms on lock 0x7b18003f7120. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:03:39.182913 (+207101us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:39.182958 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.183033 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:39.184957 (+  1924us) raft_consensus.cc:1685] finished
0709 13:03:39.184983 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.242373 (+ 57390us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1768,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":10321,"spinlock_wait_cycles":11304704,"thread_start_us":206881,"threads_started":1,"wal-append.queue_time_us":233184}
I20260709 13:03:39.369928 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:39.370275 12696 raft_consensus.cc:2393] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 3: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:39.379644 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:39.361780 14423 raft_consensus.cc:697] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:39.374912 12510 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:39.262046 13229 rpcz_store.cc:276] 0709 13:03:37.274859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.723654 (+1448795us) service_pool.cc:224] Handling call
0709 13:03:38.953499 (+229845us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:39.607728 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 340410us
W20260709 13:03:39.378466 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 57837.9us
W20260709 13:03:39.608178 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 238294us
W20260709 13:03:39.400942 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 268464us
I20260709 13:03:39.608610 12622 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
W20260709 13:03:39.507376 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.607213 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:39.609392 12617 rpcz_store.cc:269] 0709 13:03:37.557417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.703106 (+1145689us) service_pool.cc:224] Handling call
0709 13:03:39.301678 (+598572us) spinlock_profiling.cc:243] Waited 98.9 ms on lock 0x7b54003afcd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:39.301820 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227520768}
I20260709 13:03:39.292337 13231 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:39.281880 14497 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.740947 12538 raft_consensus.cc:1240] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:39.618398 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:39.920426 12545 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:39.754120 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:39.923317 12620 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:39.291074 14449 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:39.595182 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:39.429147 12588 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:03:39.836604 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:39.687541 12613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1395) took 2939 ms (client timeout 3208 ms). Trace:
I20260709 13:03:39.960431 12691 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:39.282684 14450 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:39.663313 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2377) took 1057 ms. Trace:
I20260709 13:03:39.449957 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:39.981738 12544 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:39.982045 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:39.982366 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2376) took 1477 ms. Trace:
I20260709 13:03:39.982926 12619 raft_consensus.cc:2393] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 3: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:39.981290 12546 rpcz_store.cc:276] 0709 13:03:38.606403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.753662 (+147259us) service_pool.cc:224] Handling call
0709 13:03:39.663110 (+909448us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b5400079ed4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:39.663241 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353265920}
W20260709 13:03:39.814464 14513 log.cc:927] Time spent T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.262s	user 0.000s	sys 0.001s
I20260709 13:03:39.297943 14237 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:39.532886 14261 raft_consensus.cc:3055] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:39.682154 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:03:39.914220 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 539396us
I20260709 13:03:39.991741 12618 raft_consensus.cc:2376] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4. Re-sending same reply.
I20260709 13:03:39.448990 14361 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.690366 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 703) took 1157 ms. Trace:
I20260709 13:03:39.913524 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:39.606808 12539 rpcz_store.cc:269] 0709 13:03:37.515816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.521246 (+  5430us) service_pool.cc:224] Handling call
0709 13:03:39.299907 (+1778661us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400227c54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:39.300042 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3180192640}
I20260709 13:03:39.779300 12442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36396 (request call id 351) took 7409 ms. Trace:
I20260709 13:03:39.995689 12543 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:03:39.925896 14497 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:39.611203 13197 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:39.685992 12443 catalog_manager.cc:5697] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 2 to 3, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 3 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:03:39.999733 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 388630us
I20260709 13:03:39.991513 14261 raft_consensus.cc:740] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:40.000456 12443 catalog_manager.cc:5697] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 1 to 2, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:39.667210 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:39.996009 12442 rpcz_store.cc:276] 0709 13:03:32.370314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:32.373360 (+  3046us) service_pool.cc:224] Handling call
0709 13:03:39.779139 (+7405779us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:35.502040 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:35.711291 (+209251us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:35.711338 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:03:35.711356 (+    18us) tablet.cc:662] Decoding operations
0709 13:03:35.712013 (+   657us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:35.712092 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:35.712117 (+    25us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:03:35.712639 (+   522us) tablet.cc:701] Row locks acquired
0709 13:03:35.712680 (+    41us) write_op.cc:260] PREPARE: finished
0709 13:03:35.712826 (+   146us) write_op.cc:270] Start()
0709 13:03:35.712963 (+   137us) write_op.cc:276] Timestamp: P: 1783602215712770 usec, L: 0
0709 13:03:35.712983 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:03:35.745260 (+ 32277us) log.cc:844] Serialized 1754 byte log entry
0709 13:03:36.715804 (+970544us) op_driver.cc:464] REPLICATION: finished
0709 13:03:37.206188 (+490384us) write_op.cc:301] APPLY: starting
0709 13:03:37.206292 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:37.206492 (+   200us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:37.206623 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:37.207594 (+   971us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:37.207867 (+   273us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:03:37.207932 (+    65us) write_op.cc:312] APPLY: finished
0709 13:03:37.208234 (+   302us) log.cc:844] Serialized 41 byte log entry
0709 13:03:37.208446 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:37.208568 (+   122us) write_op.cc:454] Released schema lock
0709 13:03:37.208621 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:37.209126 (+   505us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:37.209160 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1039,"reported_tablets":8,"spinlock_wait_cycles":2432,"child_traces":[["op",{"apply.queue_time_us":470655,"apply.run_cpu_time_us":2939,"apply.run_wall_time_us":2938,"num_ops":4,"prepare.queue_time_us":246608,"prepare.run_cpu_time_us":42540,"prepare.run_wall_time_us":385931,"raft.queue_time_us":760959,"raft.run_cpu_time_us":77655,"raft.run_wall_time_us":362322,"replication_time_us":1002617,"thread_start_us":1406501,"threads_started":4,"wal-append.queue_time_us":118153,"wal-append.run_cpu_time_us":40920,"wal-append.run_wall_time_us":2344520}]]}
I20260709 13:03:39.547375 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 468) took 2026 ms. Trace:
W20260709 13:03:39.909705 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 452078us
W20260709 13:03:39.664171 13234 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 702) took 2101 ms (client timeout 2752 ms). Trace:
W20260709 13:03:40.004598 13234 rpcz_store.cc:269] 0709 13:03:37.562437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.704671 (+1142234us) service_pool.cc:224] Handling call
0709 13:03:39.663981 (+959310us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54007c38d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:39.664106 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":405424896}
I20260709 13:03:39.856482 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:39.284611 14430 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:39.925127 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:39.684986 12512 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:39.934697 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 705) took 1059 ms. Trace:
I20260709 13:03:39.668310 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:39.280979 14434 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:39.470542 14297 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.522s
I20260709 13:03:39.358779 14499 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:39.978850 12613 rpcz_store.cc:269] 0709 13:03:36.748069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.874757 (+2126688us) service_pool.cc:224] Handling call
0709 13:03:39.687275 (+812518us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b540024bb54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:39.687462 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576127744}
I20260709 13:03:39.914247 12540 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:39.983770 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:39.456780 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:39.982699 12544 rpcz_store.cc:276] 0709 13:03:38.505109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.914416 (+1409307us) service_pool.cc:224] Handling call
0709 13:03:39.981415 (+ 66999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.982148 (+   733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.982318 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.979710 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:39.918812 14421 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.014s	sys 0.036s
I20260709 13:03:39.278549 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:39.786587 14419 consensus_meta.cc:287] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.070s	user 0.011s	sys 0.000s
W20260709 13:03:39.881927 12695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.021s	sys 0.030s
I20260709 13:03:40.026691 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:39.893906 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:39.448508 12616 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:40.031872 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2433) took 3540 ms. Trace:
I20260709 13:03:39.642081 14293 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:39.621452 14477 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:39.798959 13226 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:39.458009 14479 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:39.842612 14435 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:39.778666 14510 log.cc:927] Time spent T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:03:39.992574 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:40.063282 12618 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:40.064329 12618 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:03:39.991192 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:39.230278 12614 rpcz_store.cc:269] 0709 13:03:37.613930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.922518 (+1308588us) service_pool.cc:224] Handling call
0709 13:03:39.146058 (+223540us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:39.994310 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:39.849916 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:39.987869 12662 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:39.996590 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:39.914635 12659 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:40.075825 12543 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
W20260709 13:03:39.912436 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:39.995335 12510 leader_election.cc:336] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 3.208s (SENT)
I20260709 13:03:40.076689 12510 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:40.076907 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:40.077482 12543 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:39.998009 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2379) took 1125 ms. Trace:
I20260709 13:03:39.995460 13232 rpcz_store.cc:276] 0709 13:03:38.532642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.253007 (+720365us) service_pool.cc:224] Handling call
0709 13:03:39.305764 (+ 52757us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.306127 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.306163 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:39.306210 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:39.306245 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.306308 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.690140 (+383832us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x7b5400468550. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:39.690290 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":442,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":60829,"spinlock_wait_cycles":90954496}
I20260709 13:03:39.923384 14443 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:40.001981 14261 consensus_queue.cc:260] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:40.003750 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:40.051863 14293 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:39.429934 14256 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.565s
I20260709 13:03:39.430371 14452 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.565s
I20260709 13:03:40.004228 13235 rpcz_store.cc:276] 0709 13:03:37.521374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.823187 (+1301813us) service_pool.cc:224] Handling call
0709 13:03:38.874333 (+ 51146us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:38.880814 (+  6481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:38.880849 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:38.886162 (+  5313us) log.cc:844] Serialized 26 byte log entry
0709 13:03:38.932856 (+ 46694us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:38.932905 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:38.932982 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:39.547058 (+614076us) raft_consensus.cc:1685] finished
0709 13:03:39.547090 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.547283 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7317,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":6780,"thread_start_us":8143,"threads_started":1,"wal-append.queue_time_us":28046}
I20260709 13:03:39.427147 14445 consensus_queue.cc:1059] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.568s
I20260709 13:03:40.020030 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:40.029843 14242 consensus_queue.cc:1059] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:03:39.934085 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:40.025087 12545 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:40.024971 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:39.738864 14193 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:39.990866 14237 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:39.368784 14415 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:39.728101 14428 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:40.026948 12695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.023s	sys 0.031s
I20260709 13:03:40.081795 14443 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:39.371066 14408 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:40.027987 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:39.430244 14446 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:40.122893 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:40.100056 14261 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:40.032450 12619 rpcz_store.cc:276] 0709 13:03:36.491728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.031045 (+3539317us) service_pool.cc:224] Handling call
0709 13:03:40.031382 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.031554 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.031583 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.031623 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:40.031661 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.031714 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.031816 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.032473 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:40.036921 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:40.050105 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:40.055609 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 353) took 2541 ms. Trace:
I20260709 13:03:40.024806 14517 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:40.057435 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:40.059108 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:40.109711 14237 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.022609 14427 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:40.065339 12621 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
W20260709 13:03:40.066324 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.029285 14434 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:40.074892 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2435) took 3572 ms. Trace:
W20260709 13:03:40.082626 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 168068us
W20260709 13:03:40.083077 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 95351.8us
I20260709 13:03:40.004281 12443 catalog_manager.cc:5697] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 1 to 3, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 3 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:40.146165 12613 raft_consensus.cc:2368] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4.
I20260709 13:03:40.154485 12443 catalog_manager.cc:5697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:40.052862 14351 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:40.084255 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:40.084108 13233 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:40.079137 12546 rpcz_store.cc:276] 0709 13:03:38.872264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.983659 (+1111395us) service_pool.cc:224] Handling call
0709 13:03:39.997365 (+ 13706us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.997688 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:39.997728 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:39.997772 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:39.997812 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.997862 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:39.997961 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9486,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":8766}
I20260709 13:03:40.117367 14498 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:40.164875 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:40.165514 12689 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:40.119424 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:40.057355 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:40.078989 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2380) took 1206 ms. Trace:
I20260709 13:03:40.179646 12543 rpcz_store.cc:276] 0709 13:03:38.872573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.078238 (+1205665us) service_pool.cc:224] Handling call
0709 13:03:40.078515 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.078676 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.078702 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.078743 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:40.078774 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.078825 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.078939 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.093000 12620 raft_consensus.cc:2368] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4.
W20260709 13:03:40.008322 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 323379us
I20260709 13:03:40.095618 12617 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:40.006705 14361 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:40.018999 13231 rpcz_store.cc:276] 0709 13:03:38.875503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.291800 (+416297us) service_pool.cc:224] Handling call
0709 13:03:39.292127 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.934313 (+642186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.934621 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.103924 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:40.193634 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:40.194649 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:40.101511 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 100713us
I20260709 13:03:40.194964 12620 raft_consensus.cc:2410] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:40.195142 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2444) took 3152 ms. Trace:
I20260709 13:03:40.111137 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:40.032565 14419 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:40.115870 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 410) took 1168 ms. Trace:
I20260709 13:03:40.027310 12540 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.086162 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 701) took 2523 ms. Trace:
I20260709 13:03:40.085973 14521 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:03:40.117942 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 113213us
I20260709 13:03:40.088735 14293 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:40.118290 12539 raft_consensus.cc:1275] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:40.086684 14449 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.074615 14479 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:40.087014 14340 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:40.119812 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2378) took 1513 ms. Trace:
I20260709 13:03:40.239209 12545 rpcz_store.cc:276] 0709 13:03:38.606739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.921400 (+1314661us) service_pool.cc:224] Handling call
0709 13:03:40.022920 (+101520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.101634 (+ 78714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.119621 (+ 17987us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54000690d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:40.119746 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232519936}
I20260709 13:03:40.124642 12692 raft_consensus.cc:2393] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:40.028524 12694 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:40.240695 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1165) took 1167 ms. Trace:
I20260709 13:03:40.241051 12694 rpcz_store.cc:276] 0709 13:03:39.073373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.216864 (+143491us) service_pool.cc:224] Handling call
0709 13:03:40.240631 (+1023767us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.078800 14435 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:40.125459 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1167) took 1033 ms. Trace:
I20260709 13:03:40.247331 12687 rpcz_store.cc:276] 0709 13:03:39.091693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.118812 (+1027119us) service_pool.cc:224] Handling call
0709 13:03:40.125397 (+  6585us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.249236 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 425) took 1274 ms. Trace:
I20260709 13:03:40.249624 12687 rpcz_store.cc:276] 0709 13:03:38.974703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.248310 (+1273607us) service_pool.cc:224] Handling call
0709 13:03:40.248738 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.248922 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.248951 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.248990 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:40.249020 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.249070 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.249183 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:40.026485 14421 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.015s	sys 0.037s
I20260709 13:03:40.251161 14421 raft_consensus.cc:697] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:40.252187 14421 consensus_queue.cc:237] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:40.096391 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1152) took 1115 ms. Trace:
I20260709 13:03:40.253454 12693 rpcz_store.cc:276] 0709 13:03:38.976009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.263734 (+287725us) service_pool.cc:224] Handling call
0709 13:03:40.091410 (+827676us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.254120 14525 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:40.133045 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 348) took 2620 ms. Trace:
I20260709 13:03:40.255211 12541 rpcz_store.cc:276] 0709 13:03:37.512481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.847068 (+1334587us) service_pool.cc:224] Handling call
0709 13:03:38.989992 (+142924us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:39.136974 (+146982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.137023 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:39.191297 (+ 54274us) log.cc:844] Serialized 26 byte log entry
0709 13:03:39.255974 (+ 64677us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:39.256021 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:39.256112 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:40.064847 (+808735us) raft_consensus.cc:1685] finished
0709 13:03:40.064871 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.120482 (+ 55611us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54003bddd0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:40.132949 (+ 12467us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2611,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":36233,"spinlock_wait_cycles":327560576,"thread_start_us":35831,"threads_started":1,"wal-append.queue_time_us":268261}
I20260709 13:03:40.152321 12618 rpcz_store.cc:276] 0709 13:03:36.502050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.063834 (+3561784us) service_pool.cc:224] Handling call
0709 13:03:40.064129 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:40.074607 (+ 10478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.074833 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.256264 14497 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:40.258132 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:40.258802 12618 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:03:40.259785 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:40.153203 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:40.150851 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1393) took 3403 ms. Trace:
I20260709 13:03:40.260850 12621 rpcz_store.cc:276] 0709 13:03:36.747423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.149676 (+3402253us) service_pool.cc:224] Handling call
0709 13:03:40.150107 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.150378 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.150421 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.150486 (+    65us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:40.150542 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.150621 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.150774 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.151348 12538 rpcz_store.cc:276] 0709 13:03:37.514096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.928587 (+1414491us) service_pool.cc:224] Handling call
0709 13:03:38.928875 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:39.919867 (+990992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.055264 (+135397us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b54000a5ad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:40.055520 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1866935040}
I20260709 13:03:40.073873 14423 consensus_queue.cc:237] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:40.087872 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 658758us
I20260709 13:03:40.120045 14443 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:40.194130 14256 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:40.170994 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 44886.5us
W20260709 13:03:40.171561 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 176259us
I20260709 13:03:40.126000 14408 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:40.181432 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2437) took 3670 ms. Trace:
I20260709 13:03:40.289224 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:40.289330 12617 rpcz_store.cc:276] 0709 13:03:36.510766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.080259 (+3569493us) service_pool.cc:224] Handling call
0709 13:03:40.095239 (+ 14980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.181174 (+ 85935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.181354 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.142647 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:40.187628 12689 raft_consensus.cc:2410] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:03:40.299787 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 148326us
I20260709 13:03:40.195614 12613 rpcz_store.cc:276] 0709 13:03:37.042658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.170103 (+3127445us) service_pool.cc:224] Handling call
0709 13:03:40.194678 (+ 24575us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.194857 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.194883 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.194922 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:40.194954 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.195003 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.195093 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.195614 13197 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:40.151922 14427 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:40.301162 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 105617us
I20260709 13:03:40.230759 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:40.302567 12620 raft_consensus.cc:2393] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 3: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:40.231921 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:40.169552 14517 raft_consensus.cc:697] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:03:40.236687 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.243889 12696 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:40.244822 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:40.262662 12588 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:40.273070 12540 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:40.170027 12615 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:40.161324 14448 consensus_queue.cc:1059] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:03:40.229961 12695 rpcz_store.cc:276] 0709 13:03:38.947040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.950530 (+  3490us) service_pool.cc:224] Handling call
0709 13:03:38.970307 (+ 19777us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:39.313585 (+343278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.313632 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:39.357210 (+ 43578us) log.cc:844] Serialized 26 byte log entry
0709 13:03:40.115516 (+758306us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:40.115555 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.115638 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:40.115673 (+    35us) raft_consensus.cc:1685] finished
0709 13:03:40.115684 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.115804 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67784,"raft.queue_time_us":184926,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":30497,"thread_start_us":932880,"threads_started":2,"wal-append.queue_time_us":639328}
I20260709 13:03:40.261924 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2438) took 3732 ms. Trace:
I20260709 13:03:40.297163 12545 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:40.371632 12544 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:40.297803 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:40.299393 12691 raft_consensus.cc:2393] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 3: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:40.304235 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:40.305054 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:40.362567 12587 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:40.372622 12621 raft_consensus.cc:2393] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 3: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:40.373206 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1391) took 3626 ms. Trace:
I20260709 13:03:40.184031 14434 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:40.239871 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:40.244462 14453 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:40.373747 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 111210us
I20260709 13:03:40.373867 12615 rpcz_store.cc:276] 0709 13:03:36.746673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.147212 (+3400539us) service_pool.cc:224] Handling call
0709 13:03:40.169836 (+ 22624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.363609 (+193773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.373146 (+  9537us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.372795 13235 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:40.314591 12694 raft_consensus.cc:1240] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:40.377393 12659 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:40.381098 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:40.398489 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 424) took 1424 ms. Trace:
I20260709 13:03:40.398916 12694 rpcz_store.cc:276] 0709 13:03:38.974411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.263620 (+1289209us) service_pool.cc:224] Handling call
0709 13:03:40.314318 (+ 50698us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.398242 (+ 83924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.398437 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.383668 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:40.228783 13226 rpcz_store.cc:276] 0709 13:03:37.560262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.875108 (+1314846us) service_pool.cc:224] Handling call
0709 13:03:39.753087 (+877979us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b58000f6398. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454eee 0000000000375939 00007fc3ae4c81e0 00007fc3ae5910c4 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:03:39.753353 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.059055 (+305702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.084132 (+ 25077us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4435712}
I20260709 13:03:40.380908 14512 consensus_queue.cc:1059] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:03:40.405172 14512 raft_consensus.cc:3055] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:40.405555 14512 raft_consensus.cc:740] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:40.406796 13235 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:40.406433 14512 consensus_queue.cc:260] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:40.398170 12693 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:40.408113 14512 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:40.409528 14479 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:40.411718 12539 raft_consensus.cc:2393] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 5: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:40.412600 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:40.413386 12539 raft_consensus.cc:2393] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 4: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:40.413801 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:40.414145 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:40.405723 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:40.414760 12539 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:40.415458 14452 consensus_queue.cc:1059] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:40.415462 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:40.363590 14445 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:40.365841 14297 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:40.313622 14427 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.414309 14428 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:40.432318 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:40.433005 12545 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:40.390156 12588 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:40.243943 14449 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:40.316062 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:03:40.417459 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.417666 12618 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:40.416368 14452 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:03:40.377300 14519 log.cc:927] Time spent T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:03:40.429163 12615 raft_consensus.cc:2368] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4.
I20260709 13:03:40.413905 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 475) took 1133 ms. Trace:
I20260709 13:03:40.364724 14340 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:40.432003 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:40.450268 12540 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:40.449831 13235 rpcz_store.cc:276] 0709 13:03:39.280646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.399989 (+1119343us) service_pool.cc:224] Handling call
0709 13:03:40.406465 (+  6476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.413621 (+  7156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.413820 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:40.438956 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 48864.1us
I20260709 13:03:40.376019 14521 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:40.301877 14351 consensus_queue.cc:1059] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
W20260709 13:03:40.418743 12688 consensus_meta.cc:287] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.505s	user 0.006s	sys 0.003s
I20260709 13:03:40.416643 14535 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:40.415865 14517 consensus_queue.cc:237] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:40.440749 13230 raft_consensus.cc:2368] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4.
I20260709 13:03:40.445410 14452 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:40.455521 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 56338.2us
I20260709 13:03:40.455091 12694 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:40.380635 14499 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:40.479274 12538 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:40.477180 12688 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:40.484462 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:40.487671 12617 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:40.443470 14297 raft_consensus.cc:697] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:40.498171 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1164) took 1425 ms. Trace:
I20260709 13:03:40.495838 12659 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:40.496946 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1159) took 1425 ms. Trace:
I20260709 13:03:40.513753 12694 rpcz_store.cc:276] 0709 13:03:39.071752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.420400 (+1348648us) service_pool.cc:224] Handling call
0709 13:03:40.454915 (+ 34515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.495601 (+ 40686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.496889 (+  1288us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.456969 14479 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:40.366389 12614 rpcz_store.cc:276] 0709 13:03:36.511032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.083980 (+3572948us) service_pool.cc:224] Handling call
0709 13:03:40.125307 (+ 41327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.163278 (+ 37971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.169416 (+  6138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.177870 (+  8454us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:40.183619 (+  5749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.233878 (+ 50259us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.243517 (+  9639us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.456820 14528 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:40.477335 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:40.505110 12688 rpcz_store.cc:276] 0709 13:03:39.073102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.157933 (+ 84831us) service_pool.cc:224] Handling call
0709 13:03:40.498090 (+1340157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.477730 14445 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:03:40.488149 14535 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.453445 12588 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:40.432832 14422 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:40.484752 14193 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:40.523270 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2434) took 4028 ms. Trace:
I20260709 13:03:40.524549 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:40.493634 14448 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.520866 14415 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:40.496874 14452 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:40.455022 14340 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:40.597169 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 143805us
W20260709 13:03:40.597743 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:40.529378 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1163) took 1456 ms. Trace:
I20260709 13:03:40.599265 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:40.599102 12694 rpcz_store.cc:276] 0709 13:03:39.072816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.520450 (+1447634us) service_pool.cc:224] Handling call
0709 13:03:40.528845 (+  8395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.529041 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.529065 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.529110 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:40.529148 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.529203 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.529310 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.529475 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:40.497129 14532 raft_consensus.cc:3055] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:40.491979 14237 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:40.526732 12545 raft_consensus.cc:2410] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:40.585384 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:40.584456 12622 rpcz_store.cc:276] 0709 13:03:36.494387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.030357 (+3535970us) service_pool.cc:224] Handling call
0709 13:03:40.030733 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.030999 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:03:40.106662 (+ 75663us) log.cc:844] Serialized 14 byte log entry
0709 13:03:40.522918 (+416256us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.522976 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:40.523024 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.523100 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.523226 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":583,"prepare.queue_time_us":214664,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":3821,"raft.queue_time_us":93884,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":14193,"thread_start_us":467774,"threads_started":3,"wal-append.queue_time_us":378427}
I20260709 13:03:40.529110 14479 raft_consensus.cc:697] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:40.615571 12545 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:40.603217 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:03:40.622148 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 310521us
W20260709 13:03:40.626348 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 473208us
W20260709 13:03:40.626850 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 250601us
I20260709 13:03:40.627264 12662 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:40.628405 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:40.582343 14533 raft_consensus.cc:3055] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:40.662472 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:40.632221 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:40.677467 12688 raft_consensus.cc:2393] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:40.582719 14497 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:40.678675 13234 raft_consensus.cc:2393] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 3: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:40.679039 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:40.586481 14193 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:03:40.680588 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:40.683235 12547 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.025s	sys 0.065s
W20260709 13:03:40.683578 12547 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.025s	sys 0.065s
I20260709 13:03:40.681857 12694 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.596383 14535 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:40.614447 14521 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:40.614045 14361 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:40.584738 14448 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:40.602700 14532 raft_consensus.cc:740] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:03:40.616554 14519 log.cc:927] Time spent T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.089s	user 0.000s	sys 0.004s
I20260709 13:03:40.759076 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2442) took 4028 ms. Trace:
I20260709 13:03:40.772066 12619 rpcz_store.cc:276] 0709 13:03:36.730218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.149412 (+3419194us) service_pool.cc:224] Handling call
0709 13:03:40.149889 (+   477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:40.150356 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.150403 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:40.165072 (+ 14669us) log.cc:844] Serialized 26 byte log entry
0709 13:03:40.366118 (+201046us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:40.366161 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.366230 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:40.758758 (+392528us) raft_consensus.cc:1685] finished
0709 13:03:40.758783 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.758988 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1700,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":21363,"thread_start_us":128724,"threads_started":1,"wal-append.queue_time_us":312981}
I20260709 13:03:40.774180 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:40.775068 12619 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:40.776062 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:40.776276 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 147949us
I20260709 13:03:40.777207 12688 raft_consensus.cc:2410] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 13:03:40.777624 12510 leader_election.cc:336] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.543s (SENT)
W20260709 13:03:40.766462 13233 consensus_meta.cc:287] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.000s
I20260709 13:03:40.778052 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:40.778513 13233 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:40.680732 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:40.780246 14550 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:40.597185 14536 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.780673 12614 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
W20260709 13:03:40.780912 14531 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.252s	user 0.000s	sys 0.000s
I20260709 13:03:40.767894 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:40.660566 14242 consensus_queue.cc:1059] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 13:03:40.781803 12622 raft_consensus.cc:2393] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 4: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:03:40.769197 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:40.782838 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 179713us
I20260709 13:03:40.615705 14499 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:40.681664 14533 raft_consensus.cc:740] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:40.680631 14446 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:40.732316 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:40.779629 13233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 459) took 1169 ms. Trace:
I20260709 13:03:40.662681 13227 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:40.782051 14361 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:40.763245 14497 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:40.770757 14537 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.713228 14435 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:40.755352 14544 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:40.818804 14434 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:40.838217 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:40.838392 14237 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:40.840086 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2445) took 3603 ms. Trace:
I20260709 13:03:40.840710 12622 rpcz_store.cc:276] 0709 13:03:37.236685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.839164 (+3602479us) service_pool.cc:224] Handling call
0709 13:03:40.839451 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.839652 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.839691 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.839764 (+    73us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:40.839808 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.839881 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:40.840013 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.820266 13228 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:40.817487 14445 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:40.686087 14256 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:40.826160 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:40.822839 12662 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:40.823187 12694 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:40.761900 14527 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:03:40.857728 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 74216us
I20260709 13:03:40.818966 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2432) took 4305 ms. Trace:
I20260709 13:03:40.712333 14193 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:40.817437 12510 leader_election.cc:336] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.551s (SENT)
I20260709 13:03:40.871759 12619 raft_consensus.cc:2410] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:40.888773 12510 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:40.885501 12511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.004s	sys 0.011s
W20260709 13:03:40.890231 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 72832.2us
I20260709 13:03:40.875355 14521 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.820217 13233 rpcz_store.cc:276] 0709 13:03:39.609890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.003491 (+393601us) service_pool.cc:224] Handling call
0709 13:03:40.779516 (+776025us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.893107 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:40.817515 14499 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:40.827821 14361 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:40.762665 14297 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:40.884122 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:40.531674 14528 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:40.881122 12588 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:40.914907 12622 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:40.873661 12539 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:40.915551 12588 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:03:40.892222 12510 leader_election.cc:336] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.726s (SENT)
I20260709 13:03:40.839900 14446 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
W20260709 13:03:40.879994 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 57281.2us
I20260709 13:03:40.918843 12588 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:03:40.890260 12511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.004s	sys 0.011s
I20260709 13:03:40.870271 14545 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:40.912262 12694 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:40.917207 12510 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:40.885519 14497 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:40.912806 14512 consensus_meta.cc:287] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.001s
I20260709 13:03:40.828471 14479 consensus_queue.cc:237] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:40.922389 12619 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:40.921351 12588 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:40.851740 14537 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:40.888089 14532 consensus_queue.cc:260] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:40.879683 14256 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:40.886694 14555 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:03:41.117673 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.312429 14545 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.302693 12690 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 5. Ops: [3.3-3.3]
I20260709 13:03:41.318825 14545 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:41.040028 14445 raft_consensus.cc:3055] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:03:40.954149 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 718771us
I20260709 13:03:41.320046 14445 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:41.320168 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1157) took 2249 ms. Trace:
I20260709 13:03:41.321156 14514 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:40.957108 14423 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:41.322091 14517 consensus_queue.cc:1059] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:41.322283 14423 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:41.322804 14514 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:03:40.951330 14456 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:41.323458 14559 raft_consensus.cc:3055] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:41.324245 14559 raft_consensus.cc:740] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:40.990708 14499 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:41.325368 13229 raft_consensus.cc:2410] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:40.887701 14527 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:41.325649 14559 consensus_queue.cc:260] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:41.326440 14537 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:41.326629 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 480) took 1033 ms. Trace:
I20260709 13:03:40.886513 12614 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:41.327359 14559 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:41.327039 13229 rpcz_store.cc:276] 0709 13:03:40.293016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.384776 (+ 91760us) service_pool.cc:224] Handling call
0709 13:03:41.326417 (+941641us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b5400740ed4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:41.326570 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1830555392}
I20260709 13:03:41.320578 12690 rpcz_store.cc:276] 0709 13:03:39.071235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.380302 (+1309067us) service_pool.cc:224] Handling call
0709 13:03:41.273882 (+893580us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:41.319259 (+ 45377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.319954 (+   695us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b54000c85d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:41.320107 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1961080064}
I20260709 13:03:41.328133 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:03:40.957250 14477 consensus_meta.cc:287] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.896s	user 0.006s	sys 0.001s
I20260709 13:03:41.329070 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:41.329357 14477 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:41.244313 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 428) took 2268 ms. Trace:
I20260709 13:03:40.956218 14528 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:40.923360 14497 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:41.330437 12693 rpcz_store.cc:276] 0709 13:03:38.975488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.254602 (+1279114us) service_pool.cc:224] Handling call
0709 13:03:40.362462 (+107860us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.408338 (+ 45876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.244037 (+835699us) spinlock_profiling.cc:243] Waited 60 ms on lock 0x7b54002c9550. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:41.244231 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":137893760}
I20260709 13:03:41.331175 14497 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:41.332226 12693 raft_consensus.cc:1275] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:41.332834 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1171) took 2068 ms. Trace:
W20260709 13:03:41.174108 14443 consensus_meta.cc:287] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.878s	user 0.007s	sys 0.003s
I20260709 13:03:41.229979 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2465) took 1054 ms. Trace:
I20260709 13:03:41.334209 14443 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:41.334456 12617 rpcz_store.cc:276] 0709 13:03:40.175915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.381862 (+205947us) service_pool.cc:224] Handling call
0709 13:03:41.229707 (+847845us) spinlock_profiling.cc:243] Waited 73.1 ms on lock 0x7b54001ca554. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:41.229895 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168215936}
I20260709 13:03:41.336213 12617 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:03:41.336467 14443 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:41.336855 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 303) took 3878 ms. Trace:
I20260709 13:03:41.346827 14527 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:40.979979 14415 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:41.348935 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 427630us
I20260709 13:03:41.181775 14193 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:40.918466 14351 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:41.324225 14456 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:03:41.351032 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:41.289290 14498 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:41.157958 14515 raft_consensus.cc:3055] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:41.353071 14498 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:41.353434 14515 raft_consensus.cc:740] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:41.354271 12690 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:41.354439 14515 consensus_queue.cc:260] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:41.355664 14515 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:41.355773 12690 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:03:41.356467 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1174) took 2033 ms. Trace:
W20260709 13:03:40.983273 14261 consensus_meta.cc:287] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.837s	user 0.007s	sys 0.003s
I20260709 13:03:41.356822 12690 rpcz_store.cc:276] 0709 13:03:39.323498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.355133 (+2031635us) service_pool.cc:224] Handling call
0709 13:03:41.355475 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:41.356206 (+   731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.356415 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:41.273270 14242 consensus_queue.cc:1059] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:03:41.338693 14477 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:41.393033 14477 raft_consensus.cc:3055] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:40.891366 14449 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:41.231040 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.394114 12690 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:41.218384 14535 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:41.396795 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.397106 14535 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:41.229259 14427 consensus_meta.cc:287] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.783s	user 0.001s	sys 0.009s
I20260709 13:03:41.397707 14193 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:41.397904 14427 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:41.398253 14193 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:41.398940 12546 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:41.400220 14193 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:41.393427 14477 raft_consensus.cc:740] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:41.401319 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 358) took 1189 ms. Trace:
I20260709 13:03:41.401679 12546 rpcz_store.cc:276] 0709 13:03:40.211598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.211764 (+   166us) service_pool.cc:224] Handling call
0709 13:03:40.212123 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.399277 (+1187154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.401093 (+  1816us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54003be7d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:41.401256 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2729008512}
I20260709 13:03:41.401786 14477 consensus_queue.cc:260] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:41.243690 14237 raft_consensus.cc:3055] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:41.402849 14237 raft_consensus.cc:740] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:41.403064 14477 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:41.403772 14237 consensus_queue.cc:260] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:41.404791 14237 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:41.274001 14563 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:40.919015 14551 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:40.879779 12616 rpcz_store.cc:276] 0709 13:03:36.483467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.246922 (+2763455us) service_pool.cc:224] Handling call
0709 13:03:39.311167 (+ 64245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.053981 (+742814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.760295 (+706314us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b54003afcd0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:40.788420 (+ 28125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81495296}
I20260709 13:03:41.405977 14551 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:41.405905 14563 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:41.406562 14551 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:41.406644 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:41.406961 12614 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:41.407378 12616 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:41.340860 14555 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:40.953962 14541 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:03:41.049499 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 460) took 1439 ms. Trace:
W20260709 13:03:40.982712 14554 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:03:41.237398 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.411845 13234 rpcz_store.cc:276] 0709 13:03:39.610181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.005422 (+395241us) service_pool.cc:224] Handling call
0709 13:03:41.049255 (+1043833us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b5400750154. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:41.049431 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1286466816}
I20260709 13:03:41.061425 12622 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
W20260709 13:03:41.269019 12692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1172) took 2000 ms (client timeout 1882 ms). Trace:
I20260709 13:03:41.160209 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1176) took 1105 ms. Trace:
I20260709 13:03:41.066954 12620 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:41.410760 14563 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:41.413956 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2450) took 4001 ms. Trace:
I20260709 13:03:41.414368 12620 rpcz_store.cc:276] 0709 13:03:37.412875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.066123 (+3653248us) service_pool.cc:224] Handling call
0709 13:03:41.066516 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.413709 (+347193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.413906 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:41.414995 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2388) took 1109 ms. Trace:
I20260709 13:03:41.415829 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 306) took 3860 ms. Trace:
I20260709 13:03:41.416231 12620 rpcz_store.cc:276] 0709 13:03:37.555655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.415099 (+3859444us) service_pool.cc:224] Handling call
0709 13:03:41.415383 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.415546 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:41.415572 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:41.415612 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:41.415642 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.415691 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:41.415780 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:41.417039 14555 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:41.049692 13226 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:41.068442 12621 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:41.413805 12587 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:41.159634 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 711) took 1240 ms. Trace:
I20260709 13:03:41.071489 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 302) took 3639 ms. Trace:
I20260709 13:03:41.175239 14408 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:41.073235 12659 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:41.057626 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2373) took 2723 ms. Trace:
I20260709 13:03:41.322558 14545 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:40.914040 14521 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:41.045593 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 300) took 3634 ms. Trace:
I20260709 13:03:41.182036 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:40.987701 12538 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:41.413033 12691 rpcz_store.cc:276] 0709 13:03:40.054393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.058677 (+  4284us) service_pool.cc:224] Handling call
0709 13:03:41.159990 (+1101313us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54003ea8d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:41.160151 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353566976}
I20260709 13:03:41.274307 14548 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.072s
W20260709 13:03:40.954519 14543 log.cc:927] Time spent T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 13:03:41.346724 12617 rpcz_store.cc:276] 0709 13:03:37.458425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.335572 (+3877147us) service_pool.cc:224] Handling call
0709 13:03:41.335900 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.336609 (+   709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.336802 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:41.417523 12620 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:41.155079 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 235745us
I20260709 13:03:41.347506 14256 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:41.347615 14452 consensus_meta.cc:287] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.716s	user 0.006s	sys 0.003s
I20260709 13:03:41.427939 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 307) took 3871 ms. Trace:
I20260709 13:03:41.428406 14452 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:41.429466 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 305) took 3896 ms. Trace:
I20260709 13:03:41.418566 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 301) took 3997 ms. Trace:
I20260709 13:03:41.430007 12662 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:41.430540 12621 rpcz_store.cc:276] 0709 13:03:37.421185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.067654 (+3646469us) service_pool.cc:224] Handling call
0709 13:03:41.068023 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.418343 (+350320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.418514 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:41.431521 12662 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:41.431847 12621 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:03:41.432478 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1403) took 3874 ms. Trace:
I20260709 13:03:41.432636 14565 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:41.433763 14564 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:41.432744 14446 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:41.434337 14564 raft_consensus.cc:697] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:41.434505 14446 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:41.435130 14446 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:41.415359 12541 rpcz_store.cc:276] 0709 13:03:40.305429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.417980 (+112551us) service_pool.cc:224] Handling call
0709 13:03:40.418304 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:40.602310 (+184006us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:40.602340 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:40.617308 (+ 14968us) log.cc:844] Serialized 26 byte log entry
0709 13:03:40.757895 (+140587us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:40.757952 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.758058 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:41.414806 (+656748us) raft_consensus.cc:1685] finished
0709 13:03:41.414825 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:41.414942 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34530,"raft.queue_time_us":90394,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":5071,"thread_start_us":153305,"threads_started":2,"wal-append.queue_time_us":103377}
I20260709 13:03:41.352520 12588 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:03:41.436460 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 83996us
I20260709 13:03:41.437129 12588 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:41.437906 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:41.223021 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:41.252499 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.172652 14422 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:41.358137 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2446) took 4121 ms. Trace:
W20260709 13:03:41.365513 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.439479 12512 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:41.439791 12619 rpcz_store.cc:276] 0709 13:03:37.237056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.921838 (+3684782us) service_pool.cc:224] Handling call
0709 13:03:40.922106 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.357919 (+435813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.358086 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:41.440775 12512 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:41.441155 12619 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:41.441756 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 309) took 2522 ms. Trace:
I20260709 13:03:41.418838 12613 rpcz_store.cc:276] 0709 13:03:37.431694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.070552 (+3638858us) service_pool.cc:224] Handling call
0709 13:03:41.070893 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.071094 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:41.071129 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:41.071182 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:41.071224 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.071289 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:41.071419 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:41.442166 12619 rpcz_store.cc:276] 0709 13:03:38.919087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.440594 (+2521507us) service_pool.cc:224] Handling call
0709 13:03:41.440870 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.441505 (+   635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.441704 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:41.443055 12619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:41084
I20260709 13:03:41.443249 12613 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:40.911906 14533 consensus_queue.cc:260] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:41.160703 12687 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:41.443814 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2453) took 2515 ms. Trace:
I20260709 13:03:41.444142 12613 rpcz_store.cc:276] 0709 13:03:38.928622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.442684 (+2514062us) service_pool.cc:224] Handling call
0709 13:03:41.442946 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.443561 (+   615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.443759 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:41.445220 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 426) took 2470 ms. Trace:
I20260709 13:03:41.174641 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 474) took 1930 ms. Trace:
I20260709 13:03:41.445896 14256 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:41.445822 13228 rpcz_store.cc:276] 0709 13:03:39.244770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.298898 (+ 54128us) service_pool.cc:224] Handling call
0709 13:03:39.299238 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.876757 (+1577519us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.174330 (+297573us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b5400597254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:41.174560 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3382263552}
I20260709 13:03:41.446432 14256 raft_consensus.cc:697] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:41.447300 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:41.419114 14408 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:41.448292 14408 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:41.448628 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:41.448949 14408 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:41.196736 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1160) took 3682 ms. Trace:
I20260709 13:03:41.052861 14450 raft_consensus.cc:3055] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:41.450776 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:41.451273 14450 raft_consensus.cc:740] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:41.421213 12618 rpcz_store.cc:276] 0709 13:03:37.410983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.044554 (+3633571us) service_pool.cc:224] Handling call
0709 13:03:41.044937 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.045154 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:41.045191 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:41.045244 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:41.045287 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.045355 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:41.045507 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:41.452219 14450 consensus_queue.cc:260] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:41.452942 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 314) took 1844 ms. Trace:
I20260709 13:03:41.453181 14450 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:41.147454 14552 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.272s
I20260709 13:03:41.418728 13227 rpcz_store.cc:276] 0709 13:03:39.919323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.456576 (+537253us) service_pool.cc:224] Handling call
0709 13:03:40.505881 (+ 49305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.835739 (+329858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.159383 (+323644us) spinlock_profiling.cc:243] Waited 91.1 ms on lock 0x7b540063a954. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:41.159573 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209503488}
I20260709 13:03:41.454806 14552 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:41.454936 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:41.171636 14419 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:40.958483 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:41.162320 14293 consensus_meta.cc:287] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.899s	user 0.006s	sys 0.005s
I20260709 13:03:41.456208 14293 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:41.156924 14448 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:41.459903 14564 consensus_queue.cc:237] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:41.423372 12616 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:03:41.462581 14533 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:41.369982 14498 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:41.361536 14497 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:41.465018 14498 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:41.370561 14566 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:40.994642 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:41.419605 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 346459us
I20260709 13:03:41.467196 12659 leader_election.cc:400] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4.
I20260709 13:03:41.467471 12659 leader_election.cc:403] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:40.955219 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 430) took 1539 ms. Trace:
I20260709 13:03:41.467885 12696 rpcz_store.cc:276] 0709 13:03:39.415337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.031906 (+616569us) service_pool.cc:224] Handling call
0709 13:03:40.955050 (+923144us) spinlock_profiling.cc:243] Waited 98.7 ms on lock 0x7b54000c7bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:40.955157 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227102464}
I20260709 13:03:41.468568 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:03:41.468932 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:41.469238 14419 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4.
I20260709 13:03:41.426187 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:41.453358 12618 rpcz_store.cc:276] 0709 13:03:39.608534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.452212 (+1843678us) service_pool.cc:224] Handling call
0709 13:03:41.452495 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.452650 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:41.452676 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:41.452715 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:41.452746 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.452798 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:41.452891 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:41.429859 12622 rpcz_store.cc:276] 0709 13:03:37.533147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.413114 (+3879967us) service_pool.cc:224] Handling call
0709 13:03:41.429024 (+ 15910us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.429182 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:41.429207 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:41.429245 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:41.429281 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.429331 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:41.429415 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:40.920848 14544 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:41.449332 14408 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:41.422676 12695 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:41.418042 13197 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:41.445643 12687 rpcz_store.cc:276] 0709 13:03:38.974969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.250644 (+1275675us) service_pool.cc:224] Handling call
0709 13:03:41.160341 (+909697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.444059 (+283718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.445045 (+   986us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b54003ea8d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:41.445157 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2091436416}
W20260709 13:03:41.475235 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 57271.7us
W20260709 13:03:41.369755 14562 log.cc:927] Time spent T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:03:41.324402 14423 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:41.373365 14536 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:41.375056 14532 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:41.201234 14340 consensus_meta.cc:287] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.544s	user 0.007s	sys 0.000s
I20260709 13:03:41.375828 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:41.496780 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:41.496873 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:41.376073 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:41.498523 13229 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:41.377084 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:41.500167 14555 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:41.426608 14548 raft_consensus.cc:3055] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:41.501156 14548 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:41.378243 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:41.384954 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:41.321007 14445 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:41.387411 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:41.447316 14256 consensus_queue.cc:237] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:41.391999 14479 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.503793 14479 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:41.504247 14497 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:41.506016 14479 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:41.412917 12692 rpcz_store.cc:269] 0709 13:03:39.268360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.285962 (+ 17602us) service_pool.cc:224] Handling call
0709 13:03:41.268701 (+1982739us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54000c85d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:41.268915 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489424128}
I20260709 13:03:41.449728 12542 rpcz_store.cc:276] 0709 13:03:37.514583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:38.980933 (+1466350us) service_pool.cc:224] Handling call
0709 13:03:39.735619 (+754686us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:39.736206 (+   587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:39.736248 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:39.736939 (+   691us) log.cc:844] Serialized 26 byte log entry
0709 13:03:40.029605 (+292666us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:40.108646 (+ 79041us) log.cc:844] Serialized 14 byte log entry
0709 13:03:40.254301 (+145655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:40.254647 (+   346us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:40.842200 (+587553us) raft_consensus.cc:1685] finished
0709 13:03:40.852259 (+ 10059us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:41.196484 (+344225us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b5400079ed0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:41.196649 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14064,"prepare.queue_time_us":193775,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":121215,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":4928,"spinlock_wait_cycles":1734622464,"thread_start_us":438320,"threads_started":3,"wal-append.queue_time_us":378270}
I20260709 13:03:41.506539 14340 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:41.506959 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:41.508100 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:41.509172 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:41.473703 14544 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:41.509821 12617 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:03:41.509878 14544 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:41.498082 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:41.511446 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1402) took 3953 ms. Trace:
I20260709 13:03:41.511831 12617 rpcz_store.cc:276] 0709 13:03:37.557957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.427494 (+3869537us) service_pool.cc:224] Handling call
0709 13:03:41.427845 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:41.510333 (+ 82488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.511220 (+   887us) spinlock_profiling.cc:243] Waited 81.7 ms on lock 0x7b54003d09d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:41.511391 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187943296}
I20260709 13:03:41.428536 12620 rpcz_store.cc:276] 0709 13:03:37.556298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.417091 (+3860793us) service_pool.cc:224] Handling call
0709 13:03:41.417396 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.427764 (+ 10368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.427899 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:41.511040 13234 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:41.514118 12620 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:03:41.517000 14445 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:41.487319 14422 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:41.518226 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:41.518417 13197 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:41.518637 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:41.348237 14522 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:41.445412 14545 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:41.519901 14515 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:41.520961 14423 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:41.419339 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 478) took 1507 ms. Trace:
W20260709 13:03:41.317715 14525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.015s	sys 0.000s
I20260709 13:03:41.521510 14423 raft_consensus.cc:697] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:41.423305 12614 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:03:41.425679 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:41.469705 12696 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:41.424324 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2384) took 1120 ms. Trace:
I20260709 13:03:40.923063 14434 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:41.419274 12587 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:41.372107 12694 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:40.913604 14361 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:40.923640 12510 leader_election.cc:336] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.870s (SENT)
I20260709 13:03:41.476254 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:41.476666 12618 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:41.527418 12510 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:41.527731 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 108541us
I20260709 13:03:41.528160 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2471) took 1350 ms. Trace:
I20260709 13:03:41.528685 12618 rpcz_store.cc:276] 0709 13:03:40.177505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.471430 (+1293925us) service_pool.cc:224] Handling call
0709 13:03:41.471706 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.527843 (+ 56137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.528089 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:41.422411 14521 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:41.472116 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:41.445250 12613 raft_consensus.cc:1240] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:41.468876 12659 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:41.424612 14427 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:41.481417 14408 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:41.481173 14566 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:41.425583 14551 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:41.492599 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 54760.9us
I20260709 13:03:41.494769 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:41.494714 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:41.543889 12587 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:41.544029 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:41.544564 12689 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:41.502043 14548 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:41.503098 13231 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:41.333148 12693 rpcz_store.cc:276] 0709 13:03:39.264294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.331587 (+2067293us) service_pool.cc:224] Handling call
0709 13:03:41.331915 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.332594 (+   679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.332785 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:41.485646 14498 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:03:41.521832 14422 raft_consensus.cc:697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:41.432813 12621 rpcz_store.cc:276] 0709 13:03:37.558128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.431334 (+3873206us) service_pool.cc:224] Handling call
0709 13:03:41.431636 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:41.432254 (+   618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.432428 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:41.534624 14545 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:41.419739 12547 rpcz_store.cc:276] 0709 13:03:38.334542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:39.260679 (+926137us) service_pool.cc:224] Handling call
0709 13:03:39.275319 (+ 14640us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:40.143300 (+867981us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:40.711713 (+568413us) log.cc:844] Serialized 14 byte log entry
0709 13:03:40.823890 (+112177us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:40.823929 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:40.823963 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.057283 (+233320us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b5400229554. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:41.057341 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:41.057525 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5574,"prepare.queue_time_us":141787,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":58763,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":25217,"spinlock_wait_cycles":1995550080,"thread_start_us":646224,"threads_started":2,"wal-append.queue_time_us":236985}
I20260709 13:03:41.524037 12538 rpcz_store.cc:276] 0709 13:03:40.304170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.304731 (+   561us) service_pool.cc:224] Handling call
0709 13:03:41.424152 (+1119421us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54002b9654. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:41.424268 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245021568}
I20260709 13:03:41.523631 12691 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:41.525187 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:41.526013 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:41.561028 12694 raft_consensus.cc:2376] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4. Re-sending same reply.
I20260709 13:03:41.465907 12688 raft_consensus.cc:2393] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:41.420049 14193 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:41.563938 12619 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:41.564510 12619 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:41.565068 14551 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:41.521528 13226 rpcz_store.cc:276] 0709 13:03:39.912246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.404829 (+492583us) service_pool.cc:224] Handling call
0709 13:03:41.049472 (+644643us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.418342 (+368870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.419111 (+   769us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b5400750150. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:41.419267 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1481702784}
I20260709 13:03:41.566360 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:41.567998 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:41.570307 14422 consensus_queue.cc:237] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:41.573410 12547 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 3. Current term is 4. Ops: []
W20260709 13:03:41.530781 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 607764us
I20260709 13:03:41.573784 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 1277) took 1055 ms. Trace:
I20260709 13:03:41.534435 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 313) took 2582 ms. Trace:
W20260709 13:03:41.534832 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 66036.9us
W20260709 13:03:41.574371 12510 leader_election.cc:336] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.908s (SENT)
I20260709 13:03:41.574371 12613 rpcz_store.cc:276] 0709 13:03:38.952326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.444836 (+2492510us) service_pool.cc:224] Handling call
0709 13:03:41.445100 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.534192 (+ 89092us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:41.534381 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:41.574203 12688 rpcz_store.cc:276] 0709 13:03:40.518601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.222719 (+704118us) service_pool.cc:224] Handling call
0709 13:03:41.573548 (+350829us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b54002c8b54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:41.573712 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61839104}
I20260709 13:03:41.575187 12510 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:41.575737 12617 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:03:41.575858 12659 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:41.578354 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:41.579152 12538 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:41.535742 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:41.517375 14544 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:41.534017 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 61980.4us
I20260709 13:03:41.586802 12622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:41074
I20260709 13:03:41.540920 14566 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:41.594031 12662 leader_election.cc:400] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4.
I20260709 13:03:41.536695 14563 consensus_queue.cc:1059] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:03:41.541947 14340 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:41.544847 12588 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:41.545745 12587 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:41.546767 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:41.606760 12544 raft_consensus.cc:2410] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:03:41.548017 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.548079 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:41.610186 12696 raft_consensus.cc:2393] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:41.530215 14552 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:41.611858 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:41.549878 14521 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:41.536831 14536 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:41.526670 14434 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:41.523253 14423 consensus_queue.cc:237] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:41.555004 14548 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:41.538292 14435 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:41.534958 14479 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:41.556866 12695 raft_consensus.cc:2393] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 7: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:41.523636 12692 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:41.487777 14297 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:03:41.563100 12545 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:03:41.584656 12659 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
W20260709 13:03:41.673782 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 89191.2us
I20260709 13:03:41.674907 12659 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:03:41.524734 14525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.016s	sys 0.000s
I20260709 13:03:41.589367 12689 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
W20260709 13:03:41.589625 12510 leader_election.cc:336] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.791s (SENT)
I20260709 13:03:41.677099 12510 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:41.594551 12543 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:03:41.917488 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 372697us
I20260709 13:03:41.912047 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:41.583649 14427 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:41.596109 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:41.920768 12688 raft_consensus.cc:2376] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4. Re-sending same reply.
I20260709 13:03:41.594241 14293 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:41.559054 14512 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:03:41.597185 14566 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:41.599321 12513 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:41.600394 12541 raft_consensus.cc:2410] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:41.594609 12619 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:41.612681 12546 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:41.614436 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:41.616413 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:41.625052 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.549218 14575 consensus_queue.cc:1059] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:03:41.593834 14450 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:41.626413 12538 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:41.910817 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:41.598104 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:41.636212 13200 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:41.663053 13197 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:41.663753 12662 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:41.668761 14522 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:41.539983 12618 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:41.607372 14532 consensus_queue.cc:1059] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:03:41.637688 14517 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:41.897324 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 351720us
I20260709 13:03:41.998983 12692 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 1.
I20260709 13:03:42.000228 12587 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:41.661327 14551 raft_consensus.cc:3055] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:41.901783 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:42.004805 14551 raft_consensus.cc:740] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:42.005043 12696 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
W20260709 13:03:42.005090 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 341414us
I20260709 13:03:42.005580 14293 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:42.006268 12696 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:41.997074 14522 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:41.598376 14446 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:42.007409 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.901499 12659 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:41.908908 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:42.008864 14446 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:42.009239 12545 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:42.009979 14446 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:42.010473 14446 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:42.010859 14446 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:42.012264 13226 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEARNER]: Advancing to term 5
I20260709 13:03:42.012676 14582 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:41.902623 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:41.626932 14497 consensus_queue.cc:1059] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:03:41.907967 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:41.627664 14237 consensus_queue.cc:1059] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:03:42.017154 14532 raft_consensus.cc:3055] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:41.665230 14535 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:41.672513 14533 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:41.665046 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:41.922839 12688 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:41.665406 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:41.924083 12588 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:41.924355 12540 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:41.926568 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 336969us
I20260709 13:03:42.017381 14521 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:03:42.018986 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 100354us
I20260709 13:03:42.019874 14521 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:42.020208 12619 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:42.020319 14521 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:42.020769 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:41084 (request call id 2454) took 3091 ms. Trace:
I20260709 13:03:42.020841 14521 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:42.020938 12588 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:41.933815 12620 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 2. Current term is 4. Ops: []
I20260709 13:03:41.935201 12687 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:03:41.935391 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 336129us
I20260709 13:03:41.904533 14419 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:03:41.980513 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.025075 12689 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:03:42.046154 12545 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:41.916488 14565 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:41.630432 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:41.982021 12538 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 1. Current term is 2. Ops: []
W20260709 13:03:41.984275 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.920310 14452 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:41.995772 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 359594us
W20260709 13:03:41.996570 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 333616us
I20260709 13:03:41.997287 12546 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:03:42.004025 14524 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:42.006174 14293 raft_consensus.cc:697] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:42.007166 14522 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:42.009897 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 108463us
I20260709 13:03:42.089622 12687 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:42.090096 12659 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
W20260709 13:03:41.911429 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:41.630857 14434 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:42.004568 14559 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:41.595368 12691 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:03:41.985385 14545 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:42.021211 12619 rpcz_store.cc:276] 0709 13:03:38.929198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.442925 (+2513727us) service_pool.cc:224] Handling call
0709 13:03:42.019145 (+576220us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54001ea5d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9570a3d 00007fc3ae540cd0 00007fc3a7ac5254 00007fc3a7ac51e2 00007fc3a7ac5111 00007fc3a7ac508c 00007fc3a7ac4342 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:42.020675 (+  1530us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276681984}
I20260709 13:03:42.050346 12543 pending_rounds.cc:85] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 6
I20260709 13:03:42.095315 12659 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:42.059839 12688 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:41.981032 14256 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:42.017457 14237 raft_consensus.cc:3055] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:42.097831 13199 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:42.104167 12543 pending_rounds.cc:107] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:03:42.103178 12587 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:42.104598 12543 raft_consensus.cc:2889] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:42.049394 14532 raft_consensus.cc:740] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:42.107132 12587 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:42.076570 14536 raft_consensus.cc:3055] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:42.116010 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:42.050272 14419 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:42.014278 12693 raft_consensus.cc:2376] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4. Re-sending same reply.
W20260709 13:03:42.093073 14361 consensus_meta.cc:287] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.001s
I20260709 13:03:42.004078 14517 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:42.119668 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:42.092762 14563 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:42.122089 12688 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:42.124711 12687 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:42.021833 14582 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 13:03:42.094270 14545 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:42.109529 14237 raft_consensus.cc:740] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:42.078276 14583 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 13:03:42.094909 14561 consensus_queue.cc:1059] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 13:03:42.166424 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 68717us
I20260709 13:03:42.168066 12691 raft_consensus.cc:3055] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:42.173215 12619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
mode: GRACEFUL
new_leader_uuid: "7ad68e814a7741488971822f2598183a"
 from {username='slave'} at 127.0.0.1:54242
I20260709 13:03:42.070700 14533 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:42.110016 14497 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:42.115427 14536 raft_consensus.cc:740] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:42.120463 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:42.176424 12619 raft_consensus.cc:606] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Received request to transfer leadership to TS 7ad68e814a7741488971822f2598183a
I20260709 13:03:42.188037 12619 raft_consensus.cc:614] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:42.114663 14340 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:03:42.183538 13228 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:03:42.168905 14577 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
W20260709 13:03:42.204202 12613 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.012s	sys 0.023s
I20260709 13:03:42.109730 14452 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:42.176736 12691 raft_consensus.cc:740] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:42.169356 14545 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:42.118427 14450 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:03:42.172811 14524 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:42.135568 14559 raft_consensus.cc:697] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:42.155156 14544 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:42.119221 14419 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:42.168874 14578 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
W20260709 13:03:42.186882 14408 consensus_meta.cc:287] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.633s	user 0.006s	sys 0.002s
I20260709 13:03:42.126045 14552 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:42.205506 12613 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.012s	sys 0.023s
I20260709 13:03:42.211057 12442 catalog_manager.cc:5697] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 1 to 3, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 3 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:42.187193 14497 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.214915 12691 consensus_queue.cc:260] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:42.195883 14302 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260709 13:03:42.153082 14361 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:42.232823 12618 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:03:42.244274 13232 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.005s	sys 0.040s
W20260709 13:03:42.258754 13232 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.006s	sys 0.040s
I20260709 13:03:42.221762 14563 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:42.220467 14452 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:42.255065 12617 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:03:42.227464 14445 consensus_meta.cc:287] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.000s
I20260709 13:03:42.255787 12691 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:03:42.186586 14565 consensus_queue.cc:1059] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:03:42.223912 14585 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:42.168836 14586 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 13:03:42.176158 14532 consensus_queue.cc:260] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:42.203511 14293 consensus_queue.cc:237] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:42.271459 12618 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:42.276237 12691 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:42.255378 14552 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:42.256253 14497 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:42.238711 14514 consensus_queue.cc:1059] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:03:42.281230 12615 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 5: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:42.269521 14452 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:42.299072 12622 raft_consensus.cc:606] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Received request to transfer leadership
I20260709 13:03:42.252120 14408 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:42.300535 12622 raft_consensus.cc:614] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:42.278275 14585 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:42.278689 14563 raft_consensus.cc:697] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:42.283886 14256 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.261883 14561 consensus_queue.cc:1059] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 13:03:42.320492 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:42.321707 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.323119 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:42.285116 14477 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 13:03:42.300812 14423 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.003s	sys 0.007s
I20260709 13:03:42.289989 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2467) took 2113 ms. Trace:
I20260709 13:03:42.254565 14237 consensus_queue.cc:260] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:42.378149 14548 consensus_meta.cc:287] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.717s	user 0.008s	sys 0.001s
W20260709 13:03:42.312515 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 291610us
I20260709 13:03:42.393059 12588 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:42.324414 12662 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:42.309724 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 196780us
W20260709 13:03:42.325906 12510 leader_election.cc:336] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.923s (SENT)
I20260709 13:03:42.307895 14532 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:42.334847 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 86032.8us
I20260709 13:03:42.309883 14297 raft_consensus.cc:3055] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:03:42.340415 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.310706 14585 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:42.370640 14517 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:42.372406 14408 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:42.378248 14237 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:42.340598 14340 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:03:42.379562 14589 log.cc:927] Time spent T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:03:42.334627 14580 log.cc:927] Time spent T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
I20260709 13:03:42.346112 12616 rpcz_store.cc:276] 0709 13:03:40.176441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.463181 (+1286740us) service_pool.cc:224] Handling call
0709 13:03:41.463513 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:41.465497 (+  1984us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:03:41.494722 (+ 29225us) log.cc:844] Serialized 14 byte log entry
0709 13:03:42.289471 (+794749us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b180005a280. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a91214bc 00007fc3a646f48b 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a6489455 00007fc3a9571060 00007fc3a9583716 00007fc3a9594287
0709 13:03:42.289596 (+   125us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:42.289659 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:42.289710 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.289790 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:42.289924 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9379,"prepare.queue_time_us":29192,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":38915,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":5972,"spinlock_wait_cycles":10210048,"thread_start_us":402198,"threads_started":3,"wal-append.queue_time_us":209185}
I20260709 13:03:42.342043 14422 raft_consensus.cc:3055] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:42.307211 14559 consensus_queue.cc:237] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:42.317946 12690 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:42.389353 14563 consensus_queue.cc:237] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:42.390645 14453 raft_consensus.cc:1064] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:42.396170 12510 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:42.412381 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:42.414361 12588 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:03:42.340162 14423 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.003s	sys 0.009s
W20260709 13:03:42.523597 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 197691us
I20260709 13:03:42.523615 12691 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
W20260709 13:03:42.525049 12510 leader_election.cc:336] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 2.514s (SENT)
W20260709 13:03:42.428153 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 321082us
I20260709 13:03:42.253108 14536 consensus_queue.cc:260] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:42.541196 12587 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
W20260709 13:03:42.433328 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 108984us
I20260709 13:03:42.319527 14256 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:42.448625 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2477) took 1530 ms. Trace:
I20260709 13:03:42.415527 14297 raft_consensus.cc:740] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:42.427438 14535 raft_consensus.cc:697] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:42.428527 14544 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:03:42.527184 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 113039us
I20260709 13:03:42.535740 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:42.540738 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 93642.3us
I20260709 13:03:42.442823 14450 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:42.434177 14340 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:42.577491 12588 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:42.439121 14422 raft_consensus.cc:740] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:03:42.597278 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 158669us
I20260709 13:03:42.598605 13199 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:42.602701 12662 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:42.604388 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:42.548691 12620 rpcz_store.cc:276] 0709 13:03:40.918432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.514833 (+596401us) service_pool.cc:224] Handling call
0709 13:03:41.515136 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:42.050653 (+535517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.441195 (+390542us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b54001ea5d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:42.448533 (+  7338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":962468224}
I20260709 13:03:42.612308 14361 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:42.612968 14361 raft_consensus.cc:2764] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:03:42.613551 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:42.615770 14430 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:42.616386 14593 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:42.607136 14408 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:42.617115 14593 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:42.617419 14408 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:42.576385 14565 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.617880 14593 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:42.618206 14565 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:42.588850 14564 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.034s	user 0.037s	sys 0.018s
W20260709 13:03:42.622232 14564 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.037s	sys 0.018s
W20260709 13:03:42.588980 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 47874.4us
W20260709 13:03:42.571406 14581 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 13:03:42.626061 12587 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:42.616539 14430 raft_consensus.cc:697] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:42.626981 12691 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:03:42.615602 12588 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:03:42.588351 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 63342.2us
W20260709 13:03:42.678333 12510 leader_election.cc:336] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 2.635s (SENT)
I20260709 13:03:42.678812 12510 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:42.679937 12510 leader_election.cc:336] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 2.997s (SENT)
W20260709 13:03:42.682489 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 44850.1us
I20260709 13:03:42.576926 14544 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.590706 14536 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:42.572646 14609 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:42.635589 12587 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:42.597232 14340 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:42.694502 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 324) took 1168 ms. Trace:
W20260709 13:03:42.701323 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.700284 12613 rpcz_store.cc:276] 0709 13:03:41.526305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.585460 (+ 59155us) service_pool.cc:224] Handling call
0709 13:03:41.585953 (+   493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:41.586359 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:41.586390 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:41.633035 (+ 46645us) log.cc:844] Serialized 26 byte log entry
0709 13:03:42.252553 (+619518us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:42.252592 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.252653 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:42.694266 (+441613us) raft_consensus.cc:1685] finished
0709 13:03:42.694288 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:42.694432 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25681,"raft.queue_time_us":641,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":13081,"thread_start_us":590306,"threads_started":1,"wal-append.queue_time_us":622558}
I20260709 13:03:42.556206 14599 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:42.588078 14427 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:42.558346 14592 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:42.702808 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.707798 12687 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:42.623087 14564 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:42.627360 14608 consensus_queue.cc:1059] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:03:42.617899 14408 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:42.755340 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 139854us
I20260709 13:03:42.782795 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:42.676681 14477 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:42.765751 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 432) took 1368 ms. Trace:
I20260709 13:03:42.786033 12689 rpcz_store.cc:276] 0709 13:03:41.396905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.677414 (+280509us) service_pool.cc:224] Handling call
0709 13:03:41.901819 (+224405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:42.045500 (+143681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.765296 (+719796us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54000c67d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:42.765658 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":283208832}
I20260709 13:03:42.698832 14544 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:42.682432 14582 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:42.635914 14450 raft_consensus.cc:697] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:42.779769 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:42.772570 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:42.713366 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.795833 12691 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 3: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:03:42.739204 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:42.797432 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.788182 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:42.797191 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:42.675649 14575 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
I20260709 13:03:42.699440 14609 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.816242 14609 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:42.803778 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:42.805918 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 201619us
I20260709 13:03:42.818379 12687 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:42.802115 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:42.806876 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:42.784859 14545 consensus_meta.cc:287] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.558s	user 0.007s	sys 0.003s
I20260709 13:03:42.697777 14565 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:42.776654 14422 consensus_queue.cc:260] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:42.814482 14566 consensus_meta.cc:287] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.832s	user 0.010s	sys 0.000s
I20260709 13:03:42.815714 14575 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:42.790593 14477 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:42.822984 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:42.819473 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:42.819813 12689 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
W20260709 13:03:42.819264 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 183792us
I20260709 13:03:42.691381 14361 consensus_queue.cc:1059] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.127s
W20260709 13:03:42.840621 14521 consensus_meta.cc:287] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.771s	user 0.010s	sys 0.000s
I20260709 13:03:42.832616 14477 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:42.841192 14521 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:42.843659 14521 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:42.849365 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:42.851075 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:03:42.855672 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:42.858088 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.860778 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:42.818210 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:42.864800 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:42.709654 14297 consensus_queue.cc:260] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:42.818645 14604 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:42.872395 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:42.873009 12539 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:42.874276 12538 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 13:03:42.865599 14419 consensus_meta.cc:287] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.610s	user 0.006s	sys 0.003s
I20260709 13:03:42.787416 14430 consensus_queue.cc:237] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:42.872058 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:03:42.880731 12510 leader_election.cc:336] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.530s (SENT)
I20260709 13:03:42.877339 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:42.865085 14613 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:42.786369 14599 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:42.864943 14422 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:42.918021 13200 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:42.825656 14566 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:42.876902 14512 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:03:42.907387 12540 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:42.912135 14522 consensus_meta.cc:287] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.807s	user 0.015s	sys 0.009s
W20260709 13:03:42.913623 14497 consensus_meta.cc:287] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.606s	user 0.007s	sys 0.007s
I20260709 13:03:42.968014 14522 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:42.916503 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:42.917006 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 499967us
I20260709 13:03:42.917760 12546 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:42.869966 14564 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.970351 12547 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:42.970643 14564 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:42.972816 14564 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:42.872822 14575 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:42.906551 12510 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:42.974186 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 93501.2us
W20260709 13:03:42.974747 12510 leader_election.cc:336] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 2.011s (SENT)
I20260709 13:03:42.975121 12546 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:42.806051 14535 consensus_queue.cc:237] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:42.827536 14545 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:42.927202 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:42.975525 14340 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:42.976552 12694 raft_consensus.cc:1240] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:42.977032 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:42.877629 14617 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:42.877398 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:42.968133 14497 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:42.915659 12539 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:42.969102 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2404) took 1387 ms. Trace:
W20260709 13:03:42.969653 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 44930.9us
I20260709 13:03:42.833680 14597 consensus_queue.cc:1059] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:03:42.883160 14361 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:42.999477 14545 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:42.970368 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:43.003316 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:42.975139 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:42.980319 12621 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:43.004984 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:42.984390 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 201691us
I20260709 13:03:42.989357 12541 rpcz_store.cc:276] 0709 13:03:41.581928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.025632 (+443704us) service_pool.cc:224] Handling call
0709 13:03:42.026008 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:42.259647 (+233639us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:42.259677 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:42.280953 (+ 21276us) log.cc:844] Serialized 26 byte log entry
0709 13:03:42.521658 (+240705us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:42.521694 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.521766 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:42.968833 (+447067us) raft_consensus.cc:1685] finished
0709 13:03:42.968855 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:42.969029 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":67086,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":22597,"thread_start_us":435990,"threads_started":2,"wal-append.queue_time_us":562699}
I20260709 13:03:42.994774 14522 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:42.997399 14614 log.cc:927] Time spent T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:03:43.014686 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:42.882539 14601 consensus_queue.cc:1059] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:03:43.019948 12692 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:03:42.904883 14419 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:42.977242 14619 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:43.012023 12512 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:42.921571 14561 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
W20260709 13:03:43.024355 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 104333us
I20260709 13:03:43.025051 12687 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:43.026026 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:43.026664 13232 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:43.015996 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:43.007372 12588 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:42.978276 14242 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:03:43.018244 14524 consensus_meta.cc:287] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.790s	user 0.006s	sys 0.009s
I20260709 13:03:42.985491 14616 raft_consensus.cc:3055] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:03:43.009133 14610 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
W20260709 13:03:43.015851 12510 leader_election.cc:336] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 2.056s (SENT)
I20260709 13:03:43.030771 12688 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 3: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:42.998178 14361 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:43.032362 12540 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
W20260709 13:03:43.057668 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 45732.1us
I20260709 13:03:42.916458 14450 consensus_queue.cc:237] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:43.018671 14545 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.037480 14522 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:43.055564 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:43.083422 13232 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:43.020691 14548 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.016510 14617 raft_consensus.cc:697] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:43.002308 13226 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:43.056734 12696 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:43.085431 12615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2466) took 2909 ms (client timeout 3102 ms). Trace:
I20260709 13:03:43.037170 14256 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:43.067728 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 323) took 1542 ms. Trace:
I20260709 13:03:43.069084 14419 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:43.057427 14616 raft_consensus.cc:740] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:43.060755 14619 raft_consensus.cc:2764] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:03:43.057770 12510 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:43.073321 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:03:43.095937 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 80107.1us
W20260709 13:03:43.096621 12510 leader_election.cc:336] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 2.227s (SENT)
W20260709 13:03:43.077718 14611 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.388s	user 0.000s	sys 0.000s
W20260709 13:03:43.079555 14452 consensus_meta.cc:287] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.768s	user 0.009s	sys 0.000s
I20260709 13:03:43.017401 14592 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:43.085906 12615 rpcz_store.cc:269] 0709 13:03:40.176191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:40.731957 (+555766us) service_pool.cc:224] Handling call
0709 13:03:43.085241 (+2353284us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54002954d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:43.085375 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3360681856}
I20260709 13:03:42.977633 14615 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.126s
I20260709 13:03:43.088788 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:43.056120 14524 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:43.090019 13235 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
W20260709 13:03:43.074337 14237 consensus_meta.cc:287] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.638s	user 0.015s	sys 0.000s
I20260709 13:03:43.032640 14608 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
W20260709 13:03:43.076190 12588 connection.cc:256] RPC call timeout handler was delayed by -1.9200581560000956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2016s for a response
W20260709 13:03:43.118935 12588 connection.cc:256] RPC call timeout handler was delayed by -1.8930581560000519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2046s for a response
W20260709 13:03:42.597424 14498 consensus_queue.cc:1175] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a11816c5d72e4d1295a242f3ced09e5f" responder_term: 5 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: [4.6-4.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:43.058818 14340 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:43.070449 14193 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.008630 14604 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.097078 12510 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:43.100008 14434 consensus_meta.cc:287] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.990s	user 0.006s	sys 0.006s
W20260709 13:03:43.090816 14552 consensus_meta.cc:287] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.801s	user 0.009s	sys 0.005s
W20260709 13:03:43.131285 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.130862 14434 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
W20260709 13:03:43.131713 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.132622 12616 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:03:43.133322 14434 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:43.093122 14522 raft_consensus.cc:697] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:43.134343 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:43.134514 14522 consensus_queue.cc:237] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:43.135269 12620 raft_consensus.cc:2410] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:03:43.136415 14617 consensus_queue.cc:237] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:43.121980 12443 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36394 (request call id 337) took 5829 ms. Trace:
W20260709 13:03:43.112116 14618 log.cc:927] Time spent T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:03:43.123092 12442 catalog_manager.cc:5697] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 3 to 4, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 4 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:43.024258 14453 consensus_queue.cc:237] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:43.105402 14628 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.126832 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:43.114534 14446 consensus_meta.cc:287] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.103s	user 0.009s	sys 0.003s
I20260709 13:03:43.127331 12613 raft_consensus.cc:1275] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:43.112679 14566 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:43.125149 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:43.131067 14552 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:43.127578 13231 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:43.109025 14619 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:43.140060 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:43.124402 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:43.139742 12442 catalog_manager.cc:5697] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 4 to 6, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 6 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:43.184993 12619 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:43.072445 12512 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:43.146086 14497 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:43.147012 14435 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.186021 12442 catalog_manager.cc:5697] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 2 to 3, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 3 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:03:43.093791 14548 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:43.094630 14256 consensus_queue.cc:1059] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:03:43.143045 14193 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:43.157305 12662 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:43.089726 14545 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:43.169656 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:43.171885 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:43.172101 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:43.177644 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:03:43.178567 14532 consensus_meta.cc:287] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.763s	user 0.011s	sys 0.000s
I20260709 13:03:43.113265 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 725) took 1104 ms. Trace:
I20260709 13:03:43.180156 14237 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.180670 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:43.180995 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:43.181448 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:43.181783 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:43.182478 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:43.106169 14609 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:43.138211 12443 rpcz_store.cc:276] 0709 13:03:37.292154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:37.292332 (+   178us) service_pool.cc:224] Handling call
0709 13:03:43.121884 (+5829552us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:40.584316 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:40.991304 (+406988us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b5c0027fd8c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af76b331 00007fc3af76b221 00007fc3af765f6c 00007fc3acfc3d69 00007fc3acfaf0a6 00007fc3acfaed58 00007fc3acfb39f1 00007fc3acfb39a9 00007fc3acfb3939 00007fc3acfb3901 00007fc3acfb2b2d
0709 13:03:40.991383 (+    79us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:40.991414 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:03:40.991430 (+    16us) tablet.cc:662] Decoding operations
0709 13:03:41.194387 (+202957us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:41.194453 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:41.194488 (+    35us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:03:41.194889 (+   401us) tablet.cc:701] Row locks acquired
0709 13:03:41.194909 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:03:41.195075 (+   166us) write_op.cc:270] Start()
0709 13:03:41.219769 (+ 24694us) write_op.cc:276] Timestamp: P: 1783602221195020 usec, L: 0
0709 13:03:41.219811 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:03:41.316176 (+ 96365us) log.cc:844] Serialized 1686 byte log entry
0709 13:03:41.470396 (+154220us) op_driver.cc:464] REPLICATION: finished
0709 13:03:41.622419 (+152023us) write_op.cc:301] APPLY: starting
0709 13:03:41.622496 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:41.622642 (+   146us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:41.622659 (+    17us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:41.623298 (+   639us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:41.623511 (+   213us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:03:41.623563 (+    52us) write_op.cc:312] APPLY: finished
0709 13:03:41.623820 (+   257us) log.cc:844] Serialized 41 byte log entry
0709 13:03:41.623997 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:41.624101 (+   104us) write_op.cc:454] Released schema lock
0709 13:03:41.624140 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:41.624483 (+   343us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:41.624515 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1160325,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":150578,"apply.run_cpu_time_us":2057,"apply.run_wall_time_us":2063,"num_ops":4,"prepare.queue_time_us":310309,"prepare.run_cpu_time_us":15213,"prepare.run_wall_time_us":857809,"raft.queue_time_us":78692,"raft.run_cpu_time_us":29634,"raft.run_wall_time_us":200603,"replication_time_us":240682,"spinlock_wait_cycles":6100608,"thread_start_us":279478,"threads_started":4,"wal-append.queue_time_us":70284,"wal-append.run_cpu_time_us":4590,"wal-append.run_wall_time_us":1238542}]]}
I20260709 13:03:43.107750 14452 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:43.190457 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:43.189546 12442 catalog_manager.cc:5697] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 2 to 4, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 4 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:43.196098 12662 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:43.168737 14592 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:43.200956 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:43.244283 12442 catalog_manager.cc:5697] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 3 to 4, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 4 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:43.245723 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:43.245148 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:43.201586 12545 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:03:43.199959 12546 raft_consensus.cc:2410] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:43.203044 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:43.243557 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:43.195569 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:43.249651 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:43.250403 12538 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:43.246019 12442 catalog_manager.cc:5697] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:43.196741 14435 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:43.191596 14628 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:43.234467 14237 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:43.205380 14497 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:43.179589 14446 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:43.324771 12547 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:03:43.324831 12619 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:43.254777 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.273319 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:43.328159 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.327965 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:43.328542 12688 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
W20260709 13:03:43.283545 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.257138 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:43.269316 12541 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:43.329982 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.312822 14555 raft_consensus.cc:3055] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:43.338006 14555 raft_consensus.cc:740] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:43.339151 14555 consensus_queue.cc:260] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:43.245813 14613 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:43.164952 14604 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:43.260059 14628 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:43.262127 14237 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:43.257864 14435 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:43.091300 12614 rpcz_store.cc:276] 0709 13:03:41.525513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.572500 (+ 46987us) service_pool.cc:224] Handling call
0709 13:03:41.572856 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:41.987940 (+415084us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:42.033476 (+ 45536us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:42.124857 (+ 91381us) log.cc:844] Serialized 26 byte log entry
0709 13:03:42.388134 (+263277us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:42.388224 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.059698 (+671474us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54003d18d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:43.059763 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:43.059821 (+    58us) raft_consensus.cc:1685] finished
0709 13:03:43.059834 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:43.067661 (+  7827us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9440,"raft.queue_time_us":12488,"raft.run_cpu_time_us":1656,"raft.run_wall_time_us":26512,"spinlock_wait_cycles":298428160,"thread_start_us":104386,"threads_started":1,"wal-append.queue_time_us":208912}
I20260709 13:03:43.253953 14629 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:43.323045 12544 raft_consensus.cc:2410] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:43.347769 12540 raft_consensus.cc:2393] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 2: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:43.348843 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:43.255401 12442 catalog_manager.cc:5697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 1 to 3, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 3 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:43.353180 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:43.353621 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:41074 (request call id 80) took 4408 ms. Trace:
W20260709 13:03:43.358194 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.358772 13199 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:43.259374 14297 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:43.323521 14408 consensus_meta.cc:287] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.002s
I20260709 13:03:43.309548 14533 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:43.381987 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 108609us
I20260709 13:03:43.319257 14615 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:43.382498 12695 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:43.383610 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:43.183626 14477 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:43.385318 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.386473 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:43.394443 12442 catalog_manager.cc:5697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:43.392633 12622 rpcz_store.cc:276] 0709 13:03:38.918740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.577589 (+2658849us) service_pool.cc:224] Handling call
0709 13:03:43.327153 (+1749564us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b54002954d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9573853 00007fc3ae54160a 00007fc3a7ac77d4 00007fc3a7ac7762 00007fc3a7ac7691 00007fc3a7ac760c 00007fc3a7ac68c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:43.327253 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1636708224}
I20260709 13:03:43.355072 14497 raft_consensus.cc:697] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:43.324558 12616 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:43.381135 14514 consensus_queue.cc:1059] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:03:43.425845 12539 raft_consensus.cc:2410] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:43.388705 14555 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:43.412498 14582 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.025s	sys 0.038s
I20260709 13:03:43.383312 14613 raft_consensus.cc:697] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:43.382145 14599 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:43.399114 14361 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:43.390182 14629 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:43.357157 14592 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
W20260709 13:03:43.647716 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 575315us
I20260709 13:03:43.573550 12541 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:43.583668 14552 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:43.662817 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 276411us
I20260709 13:03:43.539058 12689 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 13:03:43.425808 14593 consensus_meta.cc:287] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.802s	user 0.017s	sys 0.000s
I20260709 13:03:43.442957 12617 raft_consensus.cc:2393] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 2: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:03:43.667958 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.414707 14517 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:43.666237 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:43.654814 14632 log.cc:927] Time spent T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.380s	user 0.001s	sys 0.001s
I20260709 13:03:43.618927 14524 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:43.583572 14422 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.548744 14479 raft_consensus.cc:3055] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:03:43.620886 14630 log.cc:927] Time spent T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:03:43.568315 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:43.663357 14563 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:43.672164 14582 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.028s	sys 0.038s
I20260709 13:03:43.690038 14545 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:43.472082 14435 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.663059 14548 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:43.505640 14615 raft_consensus.cc:697] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:43.680163 14629 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:43.699200 14452 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:43.471071 14408 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:43.728539 14613 consensus_queue.cc:237] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:43.634869 14628 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:43.693449 14517 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.696394 14593 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:43.700707 14422 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:43.726001 14640 log.cc:927] Time spent T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:03:43.199945 13229 rpcz_store.cc:276] 0709 13:03:42.008582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.045841 (+ 37259us) service_pool.cc:224] Handling call
0709 13:03:42.165797 (+119956us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:42.195626 (+ 29829us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:42.216336 (+ 20710us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:42.383779 (+167443us) log.cc:844] Serialized 564 byte log entry
0709 13:03:42.571435 (+187656us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:42.576700 (+  5265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.608231 (+ 31531us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:43.096381 (+488150us) raft_consensus.cc:1685] finished
0709 13:03:43.102153 (+  5772us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:43.109980 (+  7827us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":138067,"threads_started":1,"wal-append.queue_time_us":423029}
I20260709 13:03:43.699050 14479 raft_consensus.cc:740] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:43.711352 14582 raft_consensus.cc:697] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:43.697525 14609 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:43.690711 14599 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
W20260709 13:03:43.721172 14633 log.cc:927] Time spent T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 13:03:43.711025 14430 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:43.718991 14634 log.cc:927] Time spent T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:03:43.732268 14517 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:43.714254 14552 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.699919 14524 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:43.722010 14446 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:43.745441 14604 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:43.745640 14408 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:43.731001 14435 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:43.763778 14524 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:43.758216 14615 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:43.733984 14628 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:43.726831 14497 consensus_queue.cc:237] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:43.765637 14479 consensus_queue.cc:260] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:43.757867 14552 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:43.771121 14582 consensus_queue.cc:237] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:43.774319 14585 consensus_meta.cc:287] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 1.337s	user 0.015s	sys 0.000s
I20260709 13:03:43.781463 14593 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:43.667644 12442 catalog_manager.cc:5697] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 1 to 2, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 2 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:43.814586 12442 catalog_manager.cc:5697] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 1 to 3, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 3 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:43.818105 12442 catalog_manager.cc:5697] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 2 to 4, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 4 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:03:43.820293 12442 catalog_manager.cc:5697] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 2 to 4, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 4 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:43.680137 12512 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:03:43.826335 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 146116us
I20260709 13:03:43.831583 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:43.835208 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:43.671325 12513 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:43.440109 12545 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
W20260709 13:03:43.838622 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 167277us
I20260709 13:03:43.841439 12513 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:43.693362 12622 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:43.853396 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:43.855137 12616 raft_consensus.cc:2393] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 3: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:43.855188 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:43.856292 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:43.856853 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:43.694751 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:43.858116 12614 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:43.858239 12617 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
W20260709 13:03:43.861351 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.740530 12688 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:43.863580 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 448) took 1687 ms. Trace:
I20260709 13:03:43.866441 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1207) took 1006 ms. Trace:
W20260709 13:03:43.878626 12510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.015s	sys 0.005s
I20260709 13:03:43.752833 14430 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:43.887219 14256 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:43.886106 14479 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:43.886952 14446 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:43.909175 14446 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:43.895771 14599 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:43.910899 14552 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:43.887616 14592 consensus_queue.cc:1059] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:43.916038 12692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 449) took 1734 ms. Trace:
I20260709 13:03:43.916644 12692 rpcz_store.cc:276] 0709 13:03:42.181220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.185473 (+  4253us) service_pool.cc:224] Handling call
0709 13:03:42.185832 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:43.020565 (+834733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.915300 (+894735us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b54003ea8d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:43.915777 (+   477us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1917533440}
I20260709 13:03:43.919041 14446 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:43.920619 14435 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:43.888825 14585 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:43.890395 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:43.883996 14628 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:43.923619 14585 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:43.896917 14604 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:43.897477 14477 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:43.925889 14604 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.897606 14638 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:43.926486 14430 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:43.898715 14644 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:43.899919 13228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
W20260709 13:03:43.902407 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.906366 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 322) took 2534 ms. Trace:
I20260709 13:03:43.891273 12690 rpcz_store.cc:276] 0709 13:03:42.176390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.177090 (+   700us) service_pool.cc:224] Handling call
0709 13:03:42.182469 (+  5379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:42.441935 (+259466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.862791 (+1420856us) spinlock_profiling.cc:243] Waited 98.1 ms on lock 0x7b5400405454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:43.863297 (+   506us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":225615104}
I20260709 13:03:43.884069 14422 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:43.931569 12510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.015s	sys 0.005s
I20260709 13:03:43.935437 13228 raft_consensus.cc:606] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:03:43.936575 14592 raft_consensus.cc:3055] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:43.948489 14592 raft_consensus.cc:740] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:43.926851 14638 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:43.949178 14638 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:43.942571 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 443) took 2396 ms. Trace:
I20260709 13:03:43.945139 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:43.945966 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:43.946329 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.932092 12621 rpcz_store.cc:276] 0709 13:03:41.372037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.562106 (+190069us) service_pool.cc:224] Handling call
0709 13:03:41.562432 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.010046 (+1447614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.902243 (+892197us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b54002a67d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:43.906038 (+  3795us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3260381568}
I20260709 13:03:43.947144 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:43.926501 14604 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:43.957595 12694 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 2.
I20260709 13:03:43.949816 14592 consensus_queue.cc:260] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:43.950459 12695 rpcz_store.cc:276] 0709 13:03:41.545720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.019086 (+473366us) service_pool.cc:224] Handling call
0709 13:03:42.019375 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.440944 (+1421569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.940799 (+499855us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54003e8fd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:43.942388 (+  1589us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3133798272}
I20260709 13:03:43.962863 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:43.962730 14524 consensus_queue.cc:1059] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:43.964128 14524 raft_consensus.cc:3055] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:43.964602 14524 raft_consensus.cc:740] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:03:43.966239 14544 consensus_meta.cc:287] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 1.160s	user 0.016s	sys 0.002s
I20260709 13:03:43.966637 14256 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:43.967593 14256 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:43.955956 14644 raft_consensus.cc:697] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:43.969641 14644 consensus_queue.cc:237] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:43.971647 14256 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:43.963193 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:43.970234 14524 consensus_queue.cc:260] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:43.959280 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 765535us
W20260709 13:03:43.979234 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.017946 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:44.002592 14422 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:03:44.019904 14422 raft_consensus.cc:3055] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:44.020411 14422 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:43.894886 12693 rpcz_store.cc:276] 0709 13:03:42.859778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.983328 (+123550us) service_pool.cc:224] Handling call
0709 13:03:43.060358 (+ 77030us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:43.081919 (+ 21561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:43.081956 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:43.082475 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:03:43.326076 (+243601us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:43.326151 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:43.326244 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:43.865775 (+539531us) raft_consensus.cc:1685] finished
0709 13:03:43.865830 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:43.866161 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13953,"raft.queue_time_us":6037,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":4267,"thread_start_us":239340,"threads_started":1,"wal-append.queue_time_us":335870}
I20260709 13:03:43.966732 14544 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:44.027565 12688 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:44.042518 13199 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:03:44.047019 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 44050.9us
I20260709 13:03:44.050123 14646 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:44.050401 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:44.050719 14646 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.051251 14646 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.053925 14237 consensus_queue.cc:1059] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:44.055450 14237 raft_consensus.cc:3055] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:44.055883 14237 raft_consensus.cc:740] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:44.056278 12538 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:44.031028 14422 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:44.059142 14422 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:44.062486 14517 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:44.057214 14237 consensus_queue.cc:260] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:44.066601 14517 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:44.080729 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:44.081979 12545 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
W20260709 13:03:44.088977 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:44.093187 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:44.094583 14297 consensus_meta.cc:287] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.672s	user 0.007s	sys 0.011s
I20260709 13:03:44.137703 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:44.138892 14655 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:03:44.151887 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.152082 14524 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:44.153538 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.154980 12615 raft_consensus.cc:2393] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 6: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:44.154560 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:44.162467 12688 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
W20260709 13:03:44.167991 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.155602 14629 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:44.170933 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:44.172055 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:44.173010 14629 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:44.151929 14592 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.174250 14585 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.175037 14585 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:44.176898 14445 raft_consensus.cc:3055] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:44.178562 14582 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:44.179330 14582 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:44.182410 12618 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:44.182572 12620 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:03:44.183158 14635 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.181049 14585 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:44.183712 14609 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:44.184028 14585 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.183820 14635 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:44.184553 14609 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:44.186010 12695 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:44.177024 14408 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.186129 14617 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.154654 14638 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:44.184715 14585 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:44.192386 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.194217 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:44.195829 12540 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:03:44.196238 12540 pending_rounds.cc:85] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 4
I20260709 13:03:44.196506 12540 pending_rounds.cc:107] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:03:44.196818 12540 raft_consensus.cc:2889] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:44.198101 14561 raft_consensus.cc:3055] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:44.198710 14561 raft_consensus.cc:740] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:44.199128 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:44.200074 12694 raft_consensus.cc:2393] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:44.177469 14445 raft_consensus.cc:740] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:44.202287 14445 consensus_queue.cc:260] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:44.203646 14445 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.204048 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:44.197865 14408 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:44.194300 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:44.213109 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.216070 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:44.217401 12621 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 3: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:44.198757 14617 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:44.221889 14619 raft_consensus.cc:3055] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:03:44.222333 14660 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.002s
I20260709 13:03:44.222407 14619 raft_consensus.cc:740] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:44.223894 14619 consensus_queue.cc:260] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:44.228777 14293 raft_consensus.cc:3055] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:44.229370 14293 raft_consensus.cc:740] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:44.229421 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:44.229821 14361 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:44.230780 14361 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:44.231979 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:44.190361 14237 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:44.243994 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 106473us
W20260709 13:03:44.245774 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.248162 14582 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:44.250741 14408 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:44.251668 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:44.252497 14609 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:44.252765 12546 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:44.253687 14635 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:44.258221 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:44.261971 14619 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:44.262724 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:44.264667 14646 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:44.266419 14544 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:44.267087 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 441) took 2721 ms. Trace:
I20260709 13:03:44.200017 14561 consensus_queue.cc:260] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:44.231323 14293 consensus_queue.cc:260] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:44.209335 14604 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:44.272114 14638 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:44.272392 12512 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.195:34641 timed out after 1.771s (SENT) [suppressed 51 similar messages]
W20260709 13:03:44.277055 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.285722 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:44.293438 12696 rpcz_store.cc:276] 0709 13:03:41.545184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.007010 (+461826us) service_pool.cc:224] Handling call
0709 13:03:42.007271 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.091065 (+1083794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.266579 (+1175514us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002c9054. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:44.266865 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2413109504}
W20260709 13:03:44.300593 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.301164 14561 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.307649 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:03:44.305490 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.321295 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:44.321516 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1427) took 1199 ms. Trace:
I20260709 13:03:44.322829 12620 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:44.338858 12621 raft_consensus.cc:2368] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5.
W20260709 13:03:44.338987 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.318953 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1179) took 1147 ms. Trace:
I20260709 13:03:44.322010 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:44.339653 12544 rpcz_store.cc:276] 0709 13:03:43.171355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.171559 (+   204us) service_pool.cc:224] Handling call
0709 13:03:44.268649 (+1097090us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b5400410d54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:44.318727 (+ 50078us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282429824}
I20260709 13:03:44.335841 12615 rpcz_store.cc:276] 0709 13:03:43.122355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.124807 (+  2452us) service_pool.cc:224] Handling call
0709 13:03:44.321280 (+1196473us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b54001cc354. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:44.321441 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2263897344}
I20260709 13:03:44.349264 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:44.341064 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:44.349965 12618 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.301271 14293 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:44.322829 12616 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:44.367990 12546 raft_consensus.cc:2393] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 5: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:44.382480 12695 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
W20260709 13:03:44.389251 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 53371.1us
I20260709 13:03:44.390760 13229 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.338749 14551 consensus_queue.cc:260] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:44.437704 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.543550 12617 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:03:44.429533 12621 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:44.505813 12615 raft_consensus.cc:1240] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:03:44.500953 12510 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:44.509706 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.467890 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1439) took 1141 ms. Trace:
I20260709 13:03:44.428800 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:44.506098 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:44.605953 12540 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:44.606352 12618 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:44.466470 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1182) took 1286 ms. Trace:
I20260709 13:03:44.538831 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:44.436048 12662 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:44.605659 12619 rpcz_store.cc:276] 0709 13:03:43.326457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.348484 (+ 22027us) service_pool.cc:224] Handling call
0709 13:03:44.467514 (+1119030us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b54000997d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:44.467688 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1591457152}
I20260709 13:03:44.523420 14650 raft_consensus.cc:993] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372: : Instructing follower a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:03:44.612548 13235 raft_consensus.cc:2410] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:03:44.612978 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:03:44.614032 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.607709 13199 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:03:44.615844 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:44.613014 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 183317us
I20260709 13:03:44.618407 13234 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: []
W20260709 13:03:44.438355 14594 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 1.860s	user 0.000s	sys 0.006s
I20260709 13:03:44.542204 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:44.402913 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:44.609226 12539 rpcz_store.cc:276] 0709 13:03:43.180141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.180425 (+   284us) service_pool.cc:224] Handling call
0709 13:03:44.465998 (+1285573us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b540018cc54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:44.466284 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520406784}
I20260709 13:03:44.504663 14585 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:44.464286 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2405) took 1634 ms. Trace:
I20260709 13:03:44.457309 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 493) took 2275 ms. Trace:
W20260709 13:03:44.624038 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 218559us
W20260709 13:03:44.625272 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 48573.8us
I20260709 13:03:44.431428 14604 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:44.399830 14552 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:44.435432 13228 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:44.543437 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:44.636063 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 363614us
I20260709 13:03:44.607532 14361 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:44.634981 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:44.620514 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:44.609943 14644 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:44.615572 14435 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:44.453502 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:44.538429 14515 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:03:44.542832 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:44.645103 12618 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:44.827576 14658 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.010s	sys 0.024s
W20260709 13:03:44.888262 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 259391us
W20260709 13:03:44.888986 14658 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.010s	sys 0.034s
I20260709 13:03:44.635006 12614 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:44.727985 12621 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:44.725217 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:44.891745 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.707183 12539 raft_consensus.cc:1240] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:44.652192 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:44.650787 12544 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
W20260709 13:03:44.708910 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 60963.8us
I20260709 13:03:44.642248 14646 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:44.931160 13235 raft_consensus.cc:2393] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:44.871121 12662 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:44.847587 12615 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:44.653384 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:44.753775 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:44.935937 12617 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
W20260709 13:03:44.837975 14524 consensus_meta.cc:287] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.685s	user 0.008s	sys 0.005s
W20260709 13:03:44.945135 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:44.753718 14650 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:44.706923 14445 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:44.704587 14551 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:44.887094 14512 raft_consensus.cc:1081] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Signalling peer a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:03:44.870752 14242 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:44.781944 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:44.718217 14237 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:44.949928 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 449079us
I20260709 13:03:44.951650 12619 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
W20260709 13:03:44.951578 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 213930us
I20260709 13:03:44.953500 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:44.819860 12616 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:44.645210 14552 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:44.969671 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 212882us
I20260709 13:03:44.971963 12615 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:44.631224 13231 rpcz_store.cc:276] 0709 13:03:42.182043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.194921 (+ 12878us) service_pool.cc:224] Handling call
0709 13:03:42.238120 (+ 43199us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:43.193701 (+955581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.456770 (+1263069us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b5400570dd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:44.457112 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2030699264}
I20260709 13:03:44.852197 14586 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.352s
I20260709 13:03:44.946985 14617 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:44.838069 14644 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:44.972062 12619 pending_rounds.cc:85] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 1
I20260709 13:03:44.955067 14445 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:44.992095 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2403) took 3393 ms. Trace:
I20260709 13:03:44.933431 14559 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.338s
I20260709 13:03:44.972905 14650 raft_consensus.cc:697] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:44.970173 14646 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.000195 12619 pending_rounds.cc:107] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260709 13:03:45.001184 14242 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:44.957602 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:44.969308 14524 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.001214 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:44.654249 14435 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:44.651906 14297 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.324s
I20260709 13:03:44.995249 14545 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:44.977734 14604 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.002516 12543 rpcz_store.cc:276] 0709 13:03:41.581633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.021928 (+440295us) service_pool.cc:224] Handling call
0709 13:03:42.025855 (+  3927us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:42.105524 (+ 79669us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:42.105553 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:42.106008 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:03:42.324701 (+218693us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:42.324735 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:42.324803 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.437355 (+2112552us) spinlock_profiling.cc:243] Waited 48.5 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:03:44.947589 (+510234us) raft_consensus.cc:1685] finished
0709 13:03:44.947612 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.974498 (+ 26886us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111446272,"thread_start_us":218428,"threads_started":1,"wal-append.queue_time_us":326729}
I20260709 13:03:45.011282 12615 raft_consensus.cc:1240] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:45.015221 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:45.027899 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 50235.9us
I20260709 13:03:45.002417 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:45.033025 12512 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:03:45.050366 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 48700.5us
I20260709 13:03:45.032401 12619 raft_consensus.cc:2889] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:45.006310 14445 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:45.077970 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 49926.5us
I20260709 13:03:45.002579 14237 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:45.112726 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 222549us
I20260709 13:03:45.091833 12618 raft_consensus.cc:2410] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:45.097163 13199 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:03:45.090443 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 118065us
W20260709 13:03:45.141031 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 132556us
I20260709 13:03:45.148790 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:45.013630 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:03:45.135159 14658 log.cc:927] Time spent T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:03:45.152259 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.146951 12510 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:45.149900 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 52862.6us
I20260709 13:03:45.091416 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:45.138036 14544 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.166177 12662 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:03:45.166980 14680 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:03:45.167595 14544 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:45.171636 13229 consensus_meta.cc:287] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.734s	user 0.007s	sys 0.003s
I20260709 13:03:45.172137 13229 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:44.633306 12542 rpcz_store.cc:276] 0709 13:03:42.829684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.832306 (+  2622us) service_pool.cc:224] Handling call
0709 13:03:42.844838 (+ 12532us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:43.036312 (+191474us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:03:43.667735 (+631423us) log.cc:844] Serialized 14 byte log entry
0709 13:03:43.935406 (+267671us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:44.001333 (+ 65927us) log.cc:844] Serialized 564 byte log entry
0709 13:03:44.001673 (+   340us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:44.001732 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.463669 (+461937us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54002ccc54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:44.463720 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:44.463772 (+    52us) raft_consensus.cc:1685] finished
0709 13:03:44.463876 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:44.464074 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55277,"prepare.queue_time_us":28244,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":55501,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":244,"spinlock_wait_cycles":310861056,"thread_start_us":539098,"threads_started":2,"wal-append.queue_time_us":284140}
W20260709 13:03:45.176427 14619 consensus_meta.cc:287] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.914s	user 0.007s	sys 0.002s
W20260709 13:03:45.177194 14671 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.446s	user 0.000s	sys 0.002s
I20260709 13:03:45.177928 12618 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:45.160660 14545 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:45.137717 14604 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:45.191756 14604 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:45.191887 14552 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:45.013948 14650 consensus_queue.cc:237] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:45.194655 14242 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:45.078353 14559 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 13:03:45.039474 14524 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:45.051199 14646 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:45.236048 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:45.239730 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 44189.4us
W20260709 13:03:45.240504 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.241178 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.242323 12513 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:45.243423 14604 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:45.244043 14604 raft_consensus.cc:697] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 4 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:03:45.245311 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 84466.8us
I20260709 13:03:45.198484 14619 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:45.262969 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 2.01087e+06us
I20260709 13:03:45.263947 14193 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:45.187525 14545 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.161756 14638 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:03:45.196900 13228 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:45.239279 13231 raft_consensus.cc:2393] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:45.273674 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:45.278543 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 1302) took 1059 ms. Trace:
I20260709 13:03:45.230129 14242 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.279161 12688 rpcz_store.cc:276] 0709 13:03:44.209659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.235728 (+1026069us) service_pool.cc:224] Handling call
0709 13:03:45.269347 (+ 33619us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:45.283321 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.288017 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 150256us
W20260709 13:03:45.289201 12540 consensus_meta.cc:287] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.658s	user 0.006s	sys 0.003s
I20260709 13:03:45.292930 12540 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:03:45.293511 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 396) took 1043 ms. Trace:
I20260709 13:03:45.293879 12540 rpcz_store.cc:276] 0709 13:03:44.250463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.428398 (+177935us) service_pool.cc:224] Handling call
0709 13:03:45.293452 (+865054us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:45.294780 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:45.296281 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 130238us
I20260709 13:03:45.295536 12692 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:45.236169 14586 consensus_queue.cc:1059] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:03:45.273600 14545 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:45.282397 14552 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:45.313210 12613 raft_consensus.cc:2410] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:03:45.303181 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 211555us
W20260709 13:03:45.326123 13232 consensus_meta.cc:287] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.632s	user 0.005s	sys 0.006s
I20260709 13:03:45.326634 13232 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:45.327818 14644 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:45.288966 14687 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:45.328744 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:45.295053 14688 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.314687 14552 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.292172 14242 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:45.350030 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.354198 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.345259 12510 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:45.351214 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:45.245342 14604 consensus_queue.cc:237] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:45.356236 12692 raft_consensus.cc:2393] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:45.335258 14297 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.349421 14593 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.366492 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:45.370131 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:45.370958 12696 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:03:45.373267 14681 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.373639 14242 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:45.373953 14681 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:45.375888 12618 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:45.376315 14681 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:45.376987 13235 raft_consensus.cc:2410] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:45.377501 14685 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:45.377643 14638 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.376991 14686 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.378469 14638 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:45.378805 14686 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:45.380998 14638 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:45.342595 14629 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.369985 14593 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:45.353842 14552 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:45.382135 12692 raft_consensus.cc:2410] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:03:45.393178 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.355165 14687 raft_consensus.cc:697] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:03:45.363256 14626 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:03:45.360028 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:45.385078 12588 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:45.381363 14686 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:45.501677 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:45.355118 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:45.503328 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:45.503762 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:45.504518 12692 raft_consensus.cc:2393] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 3: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:45.504750 13226 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:45.376955 14445 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:45.507795 14445 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:45.363590 14435 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:45.485710 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 110520us
I20260709 13:03:45.360353 14644 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:03:45.522660 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 192912us
I20260709 13:03:45.485105 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:03:45.384469 12541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1181) took 2207 ms (client timeout 1925 ms). Trace:
I20260709 13:03:45.511808 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:45.396200 14237 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:45.445541 12690 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:03:45.496330 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:45.381735 14694 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.350354 14688 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:45.523837 12541 rpcz_store.cc:269] 0709 13:03:43.176888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.177314 (+   426us) service_pool.cc:224] Handling call
0709 13:03:45.384029 (+2206715us) spinlock_profiling.cc:243] Waited 70.5 ms on lock 0x7b54003aa054. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:45.384234 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162140544}
I20260709 13:03:45.480134 14685 raft_consensus.cc:697] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:45.546383 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:45.482163 14695 raft_consensus.cc:3055] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:45.361016 14423 consensus_queue.cc:1059] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.259s
W20260709 13:03:45.538827 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 209683us
I20260709 13:03:45.552529 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 474) took 1015 ms. Trace:
I20260709 13:03:45.553097 14237 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.553018 13227 rpcz_store.cc:276] 0709 13:03:44.536820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.882182 (+345362us) service_pool.cc:224] Handling call
0709 13:03:45.496110 (+613928us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b58000f6398. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae53f0a0 00007fc3ae53e984 00007fc3a7ab96d4 00007fc3a7ab9662
0709 13:03:45.552469 (+ 56359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7980800}
I20260709 13:03:45.553951 14237 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:45.554571 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:45.555936 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:45.556608 14237 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:45.557147 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:45.562081 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:45.564268 12696 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:45.557722 14644 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:45.562342 14694 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:45.563158 14564 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:45.564587 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:45.560524 12692 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:45.565064 14705 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:45.566148 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:45.567260 13200 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:45.394469 14297 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:45.543373 14561 consensus_meta.cc:287] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 1.204s	user 0.009s	sys 0.004s
I20260709 13:03:45.578009 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:45.481302 14638 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:45.590492 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:45.529995 14524 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:45.582495 12510 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:45.589082 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.593117 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.550125 14695 raft_consensus.cc:740] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:45.592442 12662 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:45.601677 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:45.602106 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 60080.9us
I20260709 13:03:45.539016 14629 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:45.623018 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:45.624285 12695 raft_consensus.cc:2393] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 6: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:45.626402 12692 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:03:45.634917 12693 raft_consensus.cc:2393] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 4: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:45.635437 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:45.636312 12690 raft_consensus.cc:2368] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4.
I20260709 13:03:45.587611 14564 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:45.636971 12687 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:03:45.638810 14685 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:45.644105 14293 consensus_meta.cc:287] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.277s	user 0.004s	sys 0.009s
W20260709 13:03:45.673946 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 70672.4us
W20260709 13:03:45.674965 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.675866 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.676239 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:45.676584 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.641909 14435 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:03:45.684425 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.650172 14681 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:45.647222 14638 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:45.652909 14644 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:45.637758 14696 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.705284 14694 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:45.639168 14687 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:45.705878 14696 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:45.707183 14688 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:45.708160 14696 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:45.659042 14646 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:45.711472 14237 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:45.711652 14297 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:45.712086 14237 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:45.712666 14638 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:45.713305 14616 consensus_queue.cc:260] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:45.714569 14616 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:45.715113 14638 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:45.696170 14629 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:45.698282 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:45.724383 12695 raft_consensus.cc:2393] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 6: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:45.699414 12691 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:45.691280 14681 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:45.701920 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:45.690408 14435 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:45.646566 14705 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:45.709981 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:45.705161 14714 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:45.724184 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 339225us
W20260709 13:03:45.700898 12616 consensus_meta.cc:287] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.680s	user 0.007s	sys 0.003s
I20260709 13:03:45.724567 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:45.710214 13200 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:45.714783 14237 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:45.750738 12692 raft_consensus.cc:2410] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:03:45.751914 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 176987us
I20260709 13:03:45.730801 14681 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:45.780890 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.733863 14435 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:45.781525 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 71484.5us
I20260709 13:03:45.730933 14644 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.746224 14559 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:45.734189 12616 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:45.787886 12696 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:45.756141 14638 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:45.797820 12617 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:45.802911 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:45.820585 12588 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:45.788285 14629 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:45.828615 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.828578 14629 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:45.829484 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.831674 14629 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:45.788816 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:45.838027 12659 connection.cc:256] RPC call timeout handler was delayed by -1.4491916129999254s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
I20260709 13:03:45.789341 12543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8"
dest_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:35624
I20260709 13:03:45.842247 12543 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:45.842775 12543 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:45.826020 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:03:45.823696 12616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2497) took 1429 ms (client timeout 1761 ms). Trace:
I20260709 13:03:45.825318 14714 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.856158 14564 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:03:45.876461 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 73688.4us
I20260709 13:03:45.827911 14644 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:45.865285 14638 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:45.866199 14629 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:45.874440 12542 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:45.850759 14237 consensus_queue.cc:1059] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260709 13:03:45.959367 12659 connection.cc:256] RPC call timeout handler was delayed by -1.3690916130000232s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
W20260709 13:03:45.869546 12616 rpcz_store.cc:269] 0709 13:03:44.394123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.430090 (+ 35967us) service_pool.cc:224] Handling call
0709 13:03:45.804471 (+1374381us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:45.958879 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 79459us
I20260709 13:03:45.876156 14719 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.942646 14604 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:03:45.976668 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 156187us
I20260709 13:03:45.946280 14720 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:03:45.981475 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.984457 14705 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:45.985756 14719 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:45.988526 14719 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:45.885900 14714 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:45.992475 14714 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:45.993727 12622 raft_consensus.cc:2410] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:03:45.994582 12659 connection.cc:256] RPC call timeout handler was delayed by -1.3366916129999709s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1952s for a response
I20260709 13:03:45.964277 14688 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:45.998559 12587 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:45.958482 14717 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:45.949900 14638 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:45.951800 14629 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:46.000952 12512 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:03:46.019976 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.070428 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.073800 14619 consensus_meta.cc:287] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.801s	user 0.010s	sys 0.001s
I20260709 13:03:46.076399 14638 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:46.074370 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 104056us
I20260709 13:03:46.075438 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 507) took 1066 ms. Trace:
W20260709 13:03:46.054098 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:45.997578 14551 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:46.083781 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 125204us
I20260709 13:03:46.088503 14564 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:46.091289 14564 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:46.091691 14644 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:46.092744 14552 consensus_meta.cc:287] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.583s	user 0.011s	sys 0.000s
I20260709 13:03:46.092520 14435 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:46.095256 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 96787.8us
I20260709 13:03:46.095871 12512 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:46.077683 14619 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:46.077023 14717 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:45.995376 14720 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:46.093236 14552 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:46.099180 12543 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:46.094028 14545 consensus_meta.cc:287] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.770s	user 0.012s	sys 0.000s
I20260709 13:03:46.101444 12512 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:46.093394 14564 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:46.097532 14688 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:46.003293 14604 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:46.106432 14644 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:46.118609 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:46.106583 14293 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:46.123356 14293 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:46.125708 14521 raft_consensus.cc:3055] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:46.126156 14521 raft_consensus.cc:740] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:46.127054 14521 consensus_queue.cc:260] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:46.128376 14521 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:46.115978 14644 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:46.129810 14644 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:46.133104 12493 auto_rebalancer.cc:893] Removing replace marker failed: Replica a11816c5d72e4d1295a242f3ced09e5f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
W20260709 13:03:46.133534 12613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1437) took 2885 ms (client timeout 1898 ms). Trace:
W20260709 13:03:46.133824 12493 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:03:46.134455 12493 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:03:46.141791 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 392) took 1950 ms. Trace:
W20260709 13:03:46.134001 12613 rpcz_store.cc:269] 0709 13:03:43.248614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.249409 (+   795us) service_pool.cc:224] Handling call
0709 13:03:46.133229 (+2883820us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b540007bcd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:46.133427 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4589433600}
I20260709 13:03:46.142237 12547 rpcz_store.cc:276] 0709 13:03:44.191634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.216190 (+ 24556us) service_pool.cc:224] Handling call
0709 13:03:44.468139 (+251949us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:44.619745 (+151606us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:44.619830 (+    85us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:44.634490 (+ 14660us) log.cc:844] Serialized 26 byte log entry
0709 13:03:44.938500 (+304010us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:44.938540 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.938606 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:45.375966 (+437360us) raft_consensus.cc:1685] finished
0709 13:03:45.375986 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:46.141397 (+765411us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b540018cc50. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:46.141609 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":153339,"raft.queue_time_us":146298,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"spinlock_wait_cycles":578046848,"thread_start_us":129769,"threads_started":1,"wal-append.queue_time_us":647371}
I20260709 13:03:46.148061 14293 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:46.107048 14729 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:46.154819 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:46.158931 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:46.159863 13233 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 475) took 1622 ms (client timeout 1935 ms). Trace:
I20260709 13:03:46.160194 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:46.160840 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1204) took 3325 ms. Trace:
I20260709 13:03:46.161206 12689 rpcz_store.cc:276] 0709 13:03:42.835738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.853254 (+ 17516us) service_pool.cc:224] Handling call
0709 13:03:42.859241 (+  5987us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:43.688278 (+829037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.160426 (+2472148us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b540016f3d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:46.160689 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1562534784}
I20260709 13:03:46.162302 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 727) took 3917 ms. Trace:
I20260709 13:03:46.162545 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:46.165279 13234 rpcz_store.cc:276] 0709 13:03:42.245070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:42.245423 (+   353us) service_pool.cc:224] Handling call
0709 13:03:42.256444 (+ 11021us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:44.619038 (+2362594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.162033 (+1542995us) spinlock_profiling.cc:243] Waited 2.35 s on lock 0x7b540063a954. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:46.162245 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5413331328}
W20260709 13:03:46.160228 13233 rpcz_store.cc:269] 0709 13:03:44.537085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.943585 (+406500us) service_pool.cc:224] Handling call
0709 13:03:46.158781 (+1215196us) spinlock_profiling.cc:243] Waited 947 us on lock 0x7b58000f6398. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae53f0a0 00007fc3ae53e984 00007fc3a7ab96d4 00007fc3a7ab9662
0709 13:03:46.159779 (+   998us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2177408}
I20260709 13:03:46.169602 14604 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:46.170532 12543 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:46.175034 14717 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:46.175920 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:46.176244 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:46.176625 12618 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:03:46.176859 12615 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:46.177929 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:46.178471 12618 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:03:46.179282 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:46.179916 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:46.181142 14718 log.cc:927] Time spent T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:03:46.181355 14681 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:46.179808 12618 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:46.178484 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:46.179778 14719 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:03:46.187053 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.105629 14720 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:46.090296 14551 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:46.191504 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 77655.4us
I20260709 13:03:46.250139 12512 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:46.251852 14435 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:46.212759 12587 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:46.253227 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:46.254340 12614 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 5: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:46.254911 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2501) took 1601 ms. Trace:
I20260709 13:03:46.173877 14729 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:46.212761 14477 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:03:46.258625 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:46.259508 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:46.258641 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.260703 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 73395.1us
I20260709 13:03:46.263079 13197 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:46.263005 14683 consensus_queue.cc:1059] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:46.264626 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 478) took 1200 ms. Trace:
W20260709 13:03:46.264838 14724 log.cc:927] Time spent T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
W20260709 13:03:46.216593 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.265026 13235 rpcz_store.cc:276] 0709 13:03:45.064397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.153533 (+ 89136us) service_pool.cc:224] Handling call
0709 13:03:46.264436 (+1110903us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400511b54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:46.264566 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236692224}
I20260709 13:03:46.265209 14237 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:46.266458 14548 consensus_queue.cc:1059] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:03:46.266639 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 54135.6us
I20260709 13:03:46.267520 14548 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:46.267994 14548 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.268107 12587 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:46.268538 14548 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:46.255416 12614 rpcz_store.cc:276] 0709 13:03:44.707872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.212282 (+1504410us) service_pool.cc:224] Handling call
0709 13:03:46.254843 (+ 42561us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:46.117203 14619 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:46.270915 13197 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:03:46.270673 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.278450 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.276531 14479 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:46.281787 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.282282 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.290539 13199 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:46.296782 13197 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:03:46.297427 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.297719 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:46.297827 13197 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:46.298429 12543 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:46.268173 14237 raft_consensus.cc:3055] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:46.303632 12512 leader_election.cc:400] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4.
I20260709 13:03:46.304044 12512 leader_election.cc:403] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:03:46.306054 14681 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:46.306761 14689 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.307322 14689 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:46.277271 14729 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:46.079783 13229 rpcz_store.cc:276] 0709 13:03:45.009514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.172874 (+163360us) service_pool.cc:224] Handling call
0709 13:03:46.074604 (+901730us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b58000f6398. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:03:46.074850 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:46.075055 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:46.075087 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:46.075140 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:46.075181 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.075244 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:46.075375 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12384000}
I20260709 13:03:46.274900 14714 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:46.276858 14635 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:46.319113 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:03:46.323271 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 46075.1us
I20260709 13:03:46.290546 14435 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.118057 14545 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:46.328770 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:46.327950 12687 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:46.328497 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:46.326896 12696 raft_consensus.cc:1275] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:46.334671 12689 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:46.339740 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 332) took 1397 ms. Trace:
I20260709 13:03:46.344995 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:46.345937 12695 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:46.310441 14237 raft_consensus.cc:740] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:46.324892 14681 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:46.366082 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 91732.8us
I20260709 13:03:46.295974 14725 consensus_queue.cc:1059] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 13:03:46.367224 12692 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:46.328171 12542 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:46.392028 12443 catalog_manager.cc:5697] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:46.397035 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:46.398201 12687 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:03:46.367487 14515 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.287s	user 0.011s	sys 0.014s
I20260709 13:03:46.407146 12543 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:46.371567 14561 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:46.339929 14435 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:46.417639 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.343688 14644 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:46.349256 14714 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:46.460333 14559 raft_consensus.cc:3055] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:46.472543 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:46.485877 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:46.420202 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:46.459013 12543 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 13:03:46.465551 14695 consensus_queue.cc:260] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:46.469121 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:46.394748 14619 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4.
I20260709 13:03:46.393913 14479 consensus_queue.cc:1059] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.088s
W20260709 13:03:46.409534 14515 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.376s	user 0.012s	sys 0.014s
I20260709 13:03:46.490760 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:46.526244 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.526837 12687 raft_consensus.cc:2393] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 3: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:46.491429 12547 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:46.492156 14705 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.494580 12544 raft_consensus.cc:1275] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:46.481812 14559 raft_consensus.cc:740] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:46.496136 14695 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:46.501963 12540 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:46.456827 14525 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:46.512367 12545 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:46.513666 14544 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:46.545037 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:46.516227 14714 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:46.416311 14561 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.459862 14629 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:46.456423 14645 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:46.461692 14690 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:46.532863 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:46.536808 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:46.537927 12542 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:46.538137 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:46.547986 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:46.467643 14545 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:46.549916 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.584416 12544 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 5: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:46.458935 14435 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:46.498808 14717 raft_consensus.cc:3055] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:46.501081 14552 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:46.502894 14644 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:46.561641 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:46.471648 14237 consensus_queue.cc:260] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:46.564843 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:46.571825 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 257082us
I20260709 13:03:46.611704 12547 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:46.573633 14685 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.497474 14593 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:46.545049 14705 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:46.553593 14525 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.499823 14689 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:46.562779 14561 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:46.606575 12545 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:03:46.578893 14645 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.636065 14645 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:46.636953 14521 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:46.532087 14683 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:03:46.607712 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:46.637511 14521 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:46.638157 12687 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:46.639058 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:46.639935 12687 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:46.640122 14521 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:46.642305 13234 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:03:46.642833 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:46.643260 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:46.643477 13230 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:46.643828 13234 raft_consensus.cc:3055] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:46.644189 13234 raft_consensus.cc:740] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:46.644613 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:46.645226 13230 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:03:46.646528 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:46.648074 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:46.649260 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:46.650167 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:46.641424 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:46.652100 13228 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:46.652253 13233 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:46.654405 13232 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 737) took 2422 ms (client timeout 1650 ms). Trace:
I20260709 13:03:46.613656 12588 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:03:46.654850 13232 rpcz_store.cc:269] 0709 13:03:44.231518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.257746 (+ 26228us) service_pool.cc:224] Handling call
0709 13:03:46.654136 (+2396390us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b54005965d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:46.654261 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":906993536}
I20260709 13:03:46.655544 14645 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:46.656423 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.656913 13230 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:46.657792 14544 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:46.531451 14604 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.658389 14604 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:46.340238 12621 rpcz_store.cc:276] 0709 13:03:44.933492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.939851 (+  6359us) service_pool.cc:224] Handling call
0709 13:03:45.663667 (+723816us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b58001f4198. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454eee 0000000000375939 00007fc3ae4c81e0 00007fc3ae5910c4 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:03:45.663847 (+   180us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:45.664344 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:45.664379 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:45.665033 (+   654us) log.cc:844] Serialized 52 byte log entry
0709 13:03:45.951823 (+286790us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:46.328936 (+377113us) log.cc:844] Serialized 14 byte log entry
0709 13:03:46.329203 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:46.329269 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:46.329327 (+    58us) raft_consensus.cc:1685] finished
0709 13:03:46.330883 (+  1556us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:46.331071 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":302941,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":43771,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":5246,"spinlock_wait_cycles":2360192,"thread_start_us":632457,"threads_started":2,"wal-append.queue_time_us":480760}
I20260709 13:03:46.660598 14604 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:46.660666 12621 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:46.621196 12544 raft_consensus.cc:1275] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:03:46.662357 12687 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
W20260709 13:03:46.662808 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.610361 12543 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:46.594674 14690 raft_consensus.cc:697] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:46.601117 14717 raft_consensus.cc:740] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:46.651722 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:46.666267 12513 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:46.667786 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:46.668036 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:46.678313 13232 raft_consensus.cc:2393] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:46.631702 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:46.681051 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:46.682000 12545 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:03:46.645061 13234 consensus_queue.cc:260] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:46.685063 13234 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:46.680428 12513 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:46.685344 12512 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:46.688279 12547 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:46.667372 14525 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:46.701203 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:46.714205 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:46.717208 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.723711 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:46.641037 14635 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:46.728996 12687 raft_consensus.cc:2393] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 4: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:46.739543 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:46.740375 12545 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:46.695027 14604 raft_consensus.cc:2764] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:03:46.633536 14548 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:46.696786 14644 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:46.693652 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:46.631484 14685 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:46.774840 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:46.738231 14545 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:46.776479 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:46.696537 14552 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:03:46.704919 14720 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:46.670531 14559 consensus_queue.cc:260] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:46.770439 14644 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:46.788122 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.787598 12696 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
W20260709 13:03:46.793471 14733 log.cc:927] Time spent T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:03:46.743425 14638 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 13:03:46.802016 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 166453us
I20260709 13:03:46.798265 12542 raft_consensus.cc:2393] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 5: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:46.787297 13228 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:46.787303 14545 raft_consensus.cc:697] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:46.809113 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:46.809386 13200 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:46.810747 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:46.811587 12547 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:46.798491 14644 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:46.817167 13200 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:46.821337 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:46.822197 12547 raft_consensus.cc:2376] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3. Re-sending same reply.
I20260709 13:03:46.813177 13226 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:46.833551 13200 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:46.836865 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:46.819669 14559 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:46.839181 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:46.842185 12547 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:46.794337 14690 consensus_queue.cc:237] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:46.844221 14297 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:46.862844 14741 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:46.868266 14741 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.868655 14741 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:46.869117 14297 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:46.871163 12542 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:46.836474 14689 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:46.874097 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:46.874213 14689 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:46.876699 14689 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:46.876816 14741 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:46.802155 14717 consensus_queue.cc:260] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:46.843688 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:46.877950 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:46.878683 13229 raft_consensus.cc:2368] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 7. Current term is 8.
I20260709 13:03:46.879106 14741 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:46.879629 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:46.880277 12539 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:46.881425 12539 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:46.881578 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:46.882856 12617 raft_consensus.cc:2393] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 3: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:46.883833 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:46.884403 12617 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
W20260709 13:03:46.885020 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:46.885138 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:46.886307 12613 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:03:46.887565 12618 raft_consensus.cc:1275] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:03:46.866034 14545 consensus_queue.cc:237] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:46.894121 14450 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:46.894418 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:46.897105 14685 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:46.897605 14691 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:46.898579 14744 log.cc:927] Time spent T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:03:46.898991 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:46.933457 12545 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:46.900668 12620 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:46.864843 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:46.904981 12617 raft_consensus.cc:2393] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 2: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:46.846029 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:46.905386 13233 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:46.902657 12613 pending_rounds.cc:85] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 2
I20260709 13:03:46.938570 12613 pending_rounds.cc:107] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:03:46.938939 12613 raft_consensus.cc:2889] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:46.843830 14735 log.cc:927] Time spent T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 13:03:46.908979 14450 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:46.903080 12618 pending_rounds.cc:85] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 2
W20260709 13:03:46.866489 14738 log.cc:927] Time spent T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:03:46.881208 14544 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:46.847276 14645 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:46.861933 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:46.912322 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:46.935567 13234 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:46.939680 12687 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:46.942777 12618 pending_rounds.cc:107] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:03:46.956607 12618 raft_consensus.cc:2889] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:46.904969 14297 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:46.865720 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:46.946691 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:03:46.947154 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 113679us
I20260709 13:03:46.945454 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:46.946691 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:46.953061 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:46.954439 12622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1446) took 3569 ms (client timeout 3157 ms). Trace:
I20260709 13:03:47.023926 12620 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:46.986644 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:03:47.025403 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:47.026209 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.007279 12543 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:46.910743 13230 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:03:46.956777 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:46.997480 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.029930 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:47.023563 12622 rpcz_store.cc:269] 0709 13:03:43.385137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:43.856475 (+471338us) service_pool.cc:224] Handling call
0709 13:03:46.950991 (+3094516us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b54003af7d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:46.954369 (+  3378us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4902981504}
W20260709 13:03:46.967916 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.030444 12613 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:47.030797 12688 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
W20260709 13:03:46.991890 14729 consensus_meta.cc:287] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.658s	user 0.000s	sys 0.010s
I20260709 13:03:47.036376 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:46.943521 14720 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:47.032233 13228 raft_consensus.cc:2393] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 4: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:47.045230 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:47.049631 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.050779 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:47.046940 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.047884 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:47.033720 14755 log.cc:927] Time spent T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:03:47.054009 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.052016 12618 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:46.986061 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:47.053493 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.029834 14742 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.059504 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:47.033553 14515 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:46.986958 14450 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:47.057127 12620 raft_consensus.cc:2410] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 13:03:47.036571 14750 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:03:46.943303 14691 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:47.033695 14689 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.085011 14689 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:47.086189 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:47.087661 14751 log.cc:927] Time spent T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:03:47.056248 12618 raft_consensus.cc:1275] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:03:47.062273 12617 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:47.063015 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:47.062955 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:47.159000 14597 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.418s	user 0.025s	sys 0.041s
I20260709 13:03:47.090377 12614 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:03:47.159456 14597 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.518s	user 0.025s	sys 0.041s
I20260709 13:03:47.159623 12540 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:47.064190 14601 raft_consensus.cc:3055] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:47.160698 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:47.161176 14601 raft_consensus.cc:740] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:47.159224 12543 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:47.064670 12613 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:47.070480 14681 consensus_queue.cc:1059] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 13:03:47.162696 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:47.163117 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:47.065198 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:47.163681 12613 raft_consensus.cc:2376] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5. Re-sending same reply.
I20260709 13:03:47.163777 14752 raft_consensus.cc:3055] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:47.164351 14752 raft_consensus.cc:740] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:47.164477 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:47.165264 12547 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 5: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:03:47.066998 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.165416 14752 consensus_queue.cc:260] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:47.166358 12547 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:47.167019 14752 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:47.075577 14691 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:47.076189 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:47.067799 13200 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:47.035707 13231 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:47.167521 12547 raft_consensus.cc:1240] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:47.160528 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:47.142174 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 87547.6us
W20260709 13:03:47.172183 13231 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 741) took 1849 ms (client timeout 2256 ms). Trace:
I20260709 13:03:47.161597 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.128737 12621 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:47.169921 12692 raft_consensus.cc:1240] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:47.124495 12622 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:03:47.166648 14601 consensus_queue.cc:260] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:47.163802 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:47.168143 12619 raft_consensus.cc:2393] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 3: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:47.141386 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:03:47.174160 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 110004us
I20260709 13:03:47.182130 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:47.183383 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 386) took 3124 ms. Trace:
I20260709 13:03:47.183866 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:47.184038 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:47.127285 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.164477 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:03:47.185258 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.185582 12613 raft_consensus.cc:2376] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4. Re-sending same reply.
I20260709 13:03:47.185899 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.151118 13233 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:47.186770 12622 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 3: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:47.177728 12618 pending_rounds.cc:85] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 2
I20260709 13:03:47.178334 12690 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:47.187728 12618 pending_rounds.cc:107] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:03:47.187827 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:47.188148 12618 raft_consensus.cc:2889] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:47.058226 14729 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:47.158776 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:47.180208 13234 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5. Ops: [2.5-4.6]
I20260709 13:03:47.176577 12620 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:47.186744 12687 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:47.162989 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:47.193413 12688 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:47.194658 14601 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:47.180311 13231 rpcz_store.cc:269] 0709 13:03:45.322487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.342466 (+ 19979us) service_pool.cc:224] Handling call
0709 13:03:46.865510 (+1523044us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b58000f6398. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae53f0a0 00007fc3ae53e984 00007fc3a7ab96d4 00007fc3a7ab9662
0709 13:03:47.172123 (+306613us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3448192}
I20260709 13:03:47.192569 14559 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:03:47.169478 14551 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:47.183811 12538 rpcz_store.cc:276] 0709 13:03:44.058637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:44.059508 (+   871us) service_pool.cc:224] Handling call
0709 13:03:44.298984 (+239476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:44.424163 (+125179us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:44.646410 (+222247us) log.cc:844] Serialized 14 byte log entry
0709 13:03:44.780660 (+134250us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:44.780742 (+    82us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:44.780812 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:44.780906 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:47.181120 (+2400214us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b5400410d50. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:47.183322 (+  2202us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":503775,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":180,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":141,"spinlock_wait_cycles":529198336,"thread_start_us":143311,"threads_started":2,"wal-append.queue_time_us":302436,"wal-append.run_cpu_time_us":1740,"wal-append.run_wall_time_us":1139187}
I20260709 13:03:47.203897 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:47.096735 14714 raft_consensus.cc:3055] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:03:47.199826 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.202445 12692 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
W20260709 13:03:47.202630 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.185451 14620 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:03:47.199353 14561 consensus_meta.cc:287] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.001s
I20260709 13:03:47.099910 14717 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:47.232971 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:47.201081 12616 raft_consensus.cc:2376] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3. Re-sending same reply.
I20260709 13:03:47.217092 12542 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:47.232923 12662 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:47.241526 14597 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:47.222788 12587 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:47.242048 14597 raft_consensus.cc:697] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:47.242743 12587 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:47.243006 14597 consensus_queue.cc:237] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:47.243667 14544 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:47.244045 14544 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.244367 14544 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:47.222713 14582 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:47.245740 14521 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:47.246563 14361 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:47.226327 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.230072 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.246951 14361 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.247339 12617 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:47.230454 12689 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:47.149115 14525 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:47.231870 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.237746 14615 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:03:47.238725 14691 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:47.240298 12696 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:47.222591 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:47.258062 12695 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:47.066450 14742 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:47.227922 13199 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:03:47.231987 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.254231 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.262105 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.262633 14525 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:47.262687 12616 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:47.263957 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.247339 14361 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:47.265158 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:47.265743 14737 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:47.254643 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.254973 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:47.266223 14737 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.266660 14737 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:47.206631 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1225) took 1645 ms. Trace:
I20260709 13:03:47.267107 12690 rpcz_store.cc:276] 0709 13:03:45.560750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.150475 (+1589725us) service_pool.cc:224] Handling call
0709 13:03:47.173920 (+ 23445us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:47.190016 (+ 16096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.203224 (+ 13208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:47.268858 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:47.269448 12613 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:47.258903 12510 connection.cc:256] RPC call timeout handler was delayed by -3.6972770279999168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1898s for a response
I20260709 13:03:47.259730 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.231570 14714 raft_consensus.cc:740] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:47.260277 13199 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:47.266748 12691 raft_consensus.cc:2393] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 6: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:03:47.260139 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:47.272202 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.260793 12618 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:47.240048 14620 raft_consensus.cc:697] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:47.277662 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:47.278421 13234 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 6: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:03:47.279372 12510 connection.cc:256] RPC call timeout handler was delayed by -1.0143006269998978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31570000000000004s for a response
I20260709 13:03:47.241171 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:47.282542 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:47.283836 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.284276 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.284575 12618 raft_consensus.cc:2393] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 6: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:47.284667 13199 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:47.285874 12695 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:03:47.285467 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.287672 12540 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:47.288626 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:47.289125 12540 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:47.289840 13230 raft_consensus.cc:2393] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 4: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:47.289906 12547 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:03:47.292273 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:47.287688 12618 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:47.235515 14561 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:47.305271 13226 raft_consensus.cc:2393] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 5: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:03:47.296859 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 55752.8us
I20260709 13:03:47.306020 14714 consensus_queue.cc:260] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:47.298168 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:47.278127 14620 consensus_queue.cc:237] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:47.299275 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:47.278600 14752 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:47.310427 12538 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:47.298933 12443 catalog_manager.cc:5697] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 3 to 5, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 5 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:47.299858 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:47.300249 14477 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:47.300719 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:47.301791 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:47.325954 13234 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:47.302260 14445 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:47.302569 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.312865 12613 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:47.330711 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.331359 12613 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:47.324380 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.332262 12618 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:03:47.333076 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:47.290424 14638 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:47.337227 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:47.337952 12547 raft_consensus.cc:2368] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4.
I20260709 13:03:47.338016 12540 raft_consensus.cc:2410] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:03:47.339298 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:47.339802 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 97155.1us
I20260709 13:03:47.340528 12613 raft_consensus.cc:2410] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 6 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:03:47.341997 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:47.343075 12622 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:47.344372 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:47.334335 14644 consensus_meta.cc:287] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.005s
I20260709 13:03:47.291949 14681 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:03:47.325320 14477 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.346603 12541 raft_consensus.cc:2410] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:47.329684 14445 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.449723 13227 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
W20260709 13:03:47.391189 12659 leader_election.cc:336] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 3.102s (SENT)
I20260709 13:03:47.365494 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.496538 12613 raft_consensus.cc:2393] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 3: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:47.369385 12544 raft_consensus.cc:1240] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:47.392342 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.497509 12512 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:47.347114 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:47.374354 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.499171 12622 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
W20260709 13:03:47.435218 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 128508us
W20260709 13:03:47.499974 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:47.469436 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.498523 12512 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:03:47.398232 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:47.500748 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.480677 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.376384 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.502317 12618 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 1.
I20260709 13:03:47.395328 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:47.503463 12615 raft_consensus.cc:2393] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 6: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:47.474659 12619 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:47.504582 12513 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:47.506160 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:47.377233 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:47.405252 14742 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:47.506968 14445 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:47.511499 14545 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:47.453310 14361 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:47.511989 14545 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.512462 14545 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:47.513231 12616 raft_consensus.cc:2368] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5.
I20260709 13:03:47.514456 14729 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:47.515038 14729 raft_consensus.cc:697] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:47.516129 14729 consensus_queue.cc:237] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:47.517256 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:47.517988 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:47.478209 14674 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:03:47.510054 14629 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:47.520663 12541 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:03:47.521696 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.523500 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.335592 14714 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:47.526707 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.531471 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:47.532431 12694 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:47.534750 12547 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:47.471024 13199 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:03:47.540302 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 69391.6us
I20260709 13:03:47.546332 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.547425 12622 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:47.552109 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:47.549710 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 45216.6us
I20260709 13:03:47.551699 12695 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:03:47.557039 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 58568.8us
I20260709 13:03:47.558429 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:47.558689 12512 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:47.563246 12512 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:47.556876 13197 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:47.564504 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:47.507130 14477 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:47.557482 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:47.565667 12541 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:47.567917 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:47.568970 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:47.548981 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:47.538582 14552 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.599538 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:47.555979 14741 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:03:47.606115 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 214990us
I20260709 13:03:47.606061 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:47.607322 12547 raft_consensus.cc:2376] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4. Re-sending same reply.
I20260709 13:03:47.433022 14544 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:47.456243 14297 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:47.353029 14644 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:47.609645 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:47.378669 14638 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:47.610428 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:47.615260 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:47.616014 12541 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:47.616845 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:47.617426 12541 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:47.565435 14361 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:47.565237 14629 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:03:47.610476 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 53683.8us
I20260709 13:03:47.627139 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:47.628892 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.568452 14774 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:47.634577 12617 raft_consensus.cc:2368] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4.
I20260709 13:03:47.626674 14629 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:47.612447 14620 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:47.623407 12542 raft_consensus.cc:2410] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:03:47.639305 12543 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 6: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:47.644187 13234 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5. Ops: []
W20260709 13:03:47.644773 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 103566us
I20260709 13:03:47.622961 13231 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:47.642550 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:03:47.646323 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.625130 14741 raft_consensus.cc:697] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:47.656514 14638 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:47.656963 14741 consensus_queue.cc:237] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:47.659703 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:47.605901 14552 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:47.675062 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:47.643496 14629 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:47.685909 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:47.691934 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:03:47.697685 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.661936 14681 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:03:47.712373 12538 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:47.719322 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:03:47.725404 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 76200.1us
I20260709 13:03:47.696494 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:47.736814 14775 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:47.750445 14775 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:47.752866 14775 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:47.759485 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:47.760504 12538 raft_consensus.cc:2393] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 2: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:47.759552 12510 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:47.782936 12693 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:47.783810 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1234) took 1471 ms. Trace:
I20260709 13:03:47.784396 12693 rpcz_store.cc:276] 0709 13:03:46.312609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.718302 (+1405693us) service_pool.cc:224] Handling call
0709 13:03:47.782719 (+ 64417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:47.783517 (+   798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:47.783744 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:47.786017 14297 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:47.820218 14717 consensus_meta.cc:287] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.001s
I20260709 13:03:47.820012 14545 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:47.821493 14561 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:47.821938 12547 raft_consensus.cc:2368] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5.
I20260709 13:03:47.822139 14644 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:47.821519 14552 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:47.824795 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:47.826007 14737 consensus_meta.cc:287] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.000s
I20260709 13:03:47.826418 14737 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:47.826803 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 483) took 1004 ms. Trace:
I20260709 13:03:47.827183 13230 rpcz_store.cc:276] 0709 13:03:46.822776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.054386 (+231610us) service_pool.cc:224] Handling call
0709 13:03:47.826593 (+772207us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54002bfcd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:47.826726 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":422679936}
I20260709 13:03:47.834453 14544 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:47.834576 14445 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:47.836042 14752 consensus_meta.cc:287] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.000s
I20260709 13:03:47.836455 14752 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:47.836740 14445 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:47.839541 14686 consensus_queue.cc:1059] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:47.840806 14453 raft_consensus.cc:3055] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:47.841180 14453 raft_consensus.cc:740] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:47.842067 14453 consensus_queue.cc:260] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:47.844216 12539 raft_consensus.cc:2410] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 13:03:47.792852 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.848539 12541 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:47.850098 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:47.850950 12541 raft_consensus.cc:2368] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5.
W20260709 13:03:47.851022 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 202548us
I20260709 13:03:47.851897 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:47.852864 12541 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
W20260709 13:03:47.853525 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 94080.5us
I20260709 13:03:47.837083 14700 consensus_queue.cc:1059] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:03:47.858174 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 103092us
I20260709 13:03:47.738432 14691 consensus_queue.cc:1059] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.112s
I20260709 13:03:47.820225 14237 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:47.860723 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:47.867528 12538 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:47.858059 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:47.833225 14477 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:47.865979 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:47.856292 14774 raft_consensus.cc:697] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:47.858027 14775 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:47.873744 12547 raft_consensus.cc:2393] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 4: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:47.864219 13227 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:47.882324 12510 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:47.887470 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:47.873473 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:47.890728 12538 raft_consensus.cc:2410] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:03:47.892100 14780 raft_consensus.cc:3055] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:47.892544 14786 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:47.893247 14477 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:47.893460 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:47.903031 12545 raft_consensus.cc:2410] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:47.893877 14689 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:47.908267 12545 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:47.909605 14545 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:47.896652 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:47.888154 14445 consensus_queue.cc:1059] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:03:47.909930 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:47.911185 12538 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:47.912364 12538 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:47.913830 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:47.914261 14774 consensus_queue.cc:237] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:47.915166 12547 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:47.919333 12694 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:03:47.895989 14780 raft_consensus.cc:740] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:47.921029 14780 consensus_queue.cc:260] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:47.922493 14780 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:47.922680 14453 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:47.926440 14705 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:47.930138 14548 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:47.931504 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:47.932009 12542 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:47.932102 12621 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:47.941208 14737 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:47.943029 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:47.895989 14781 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:03:47.943965 12614 raft_consensus.cc:2410] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:03:47.954373 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 485) took 1131 ms. Trace:
I20260709 13:03:47.954962 13226 rpcz_store.cc:276] 0709 13:03:46.823257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.873779 (+ 50522us) service_pool.cc:224] Handling call
0709 13:03:47.954096 (+1080317us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b54006cfcd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:47.954290 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":989034368}
W20260709 13:03:47.964561 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 445451us
W20260709 13:03:47.967574 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:47.967399 13200 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:47.968349 14690 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:47.968824 14690 raft_consensus.cc:697] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:47.969722 14690 consensus_queue.cc:237] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:47.971777 14765 log.cc:927] Time spent T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.544s	user 0.000s	sys 0.002s
W20260709 13:03:47.969316 12588 leader_election.cc:336] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.564s (SENT)
I20260709 13:03:47.974632 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:47.991699 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:47.992564 12692 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:47.996963 12588 leader_election.cc:336] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.578s (SENT)
I20260709 13:03:47.997440 12588 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:03:48.004443 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 107940us
I20260709 13:03:48.004941 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:03:48.005132 12588 leader_election.cc:336] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.648s (SENT)
I20260709 13:03:48.005249 12510 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:48.005602 12588 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:48.005776 12696 raft_consensus.cc:2393] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 5: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:48.006623 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:48.007454 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:48.008124 12613 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:48.007315 12689 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:48.011418 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:03:48.013278 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 75632.8us
I20260709 13:03:48.013458 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:48.014112 12696 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:48.012482 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 160549us
I20260709 13:03:47.998456 14729 raft_consensus.cc:2764] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:03:48.007084 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:48.018373 12689 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 4: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:48.000244 14694 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:48.020946 12510 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:48.032502 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:48.022373 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 152627us
I20260709 13:03:48.023804 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2450) took 1036 ms. Trace:
I20260709 13:03:48.028865 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:48.034406 12695 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:48.034194 12543 rpcz_store.cc:276] 0709 13:03:46.987522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.163546 (+176024us) service_pool.cc:224] Handling call
0709 13:03:48.023624 (+860078us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b5400228154. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:48.023745 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1053259008}
I20260709 13:03:48.035122 12696 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:48.036317 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:48.037091 12622 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:48.046648 12588 leader_election.cc:336] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.685s (SENT)
I20260709 13:03:48.047290 12588 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:48.052220 12695 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:03:48.020431 14515 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:03:48.053486 14788 consensus_queue.cc:1048] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:48.053853 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:48.024000 12693 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:48.055579 14775 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:48.021317 14763 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:48.017234 14582 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:48.058604 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:48.058657 14453 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:48.059407 12613 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:03:48.060243 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:03:48.060443 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.060946 12613 raft_consensus.cc:2393] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 5: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:48.061146 12692 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:48.054508 12542 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:48.062283 12662 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:48.062987 14788 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:48.063375 12546 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:03:48.064270 14788 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:48.064687 12539 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:48.064831 14788 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:48.065214 14788 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:48.065722 14544 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:48.066519 14638 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:48.064224 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:48.070518 12510 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:48.071764 13197 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:48.067866 12662 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:48.075851 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:48.072947 14786 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:03:48.079152 14453 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:48.079660 14453 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:48.080085 14453 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:48.081010 14597 raft_consensus.cc:2955] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:03:48.087246 14714 consensus_meta.cc:287] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.541s	user 0.005s	sys 0.005s
I20260709 13:03:48.091809 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:48.092581 12543 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:48.098641 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 52039.7us
W20260709 13:03:48.099251 12588 leader_election.cc:336] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Timed out: RequestConsensusVote RPC to 127.11.44.196:33997 timed out after 1.691s (SENT)
I20260709 13:03:48.099589 12588 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:03:48.101305 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 67767us
I20260709 13:03:48.102193 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:48.109408 12621 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:03:48.107236 12659 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
W20260709 13:03:48.121863 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 50212.1us
I20260709 13:03:48.121338 12622 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:48.122875 13197 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:48.124898 14705 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:48.125303 12510 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:48.126716 13197 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:03:48.128762 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 52972.1us
I20260709 13:03:48.135592 12659 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:48.102067 14644 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:48.098114 14786 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:48.126396 14714 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:48.139860 12538 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:03:48.145360 12588 leader_election.cc:336] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Timed out: RequestConsensusVote RPC to 127.11.44.196:33997 timed out after 1.779s (SENT)
I20260709 13:03:48.150606 12588 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:48.146744 12659 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:48.129300 14477 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:48.152856 12510 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:48.128607 14638 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.137548 14781 raft_consensus.cc:2764] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:03:48.157516 12510 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:48.158335 12543 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:48.125710 14445 consensus_queue.cc:1059] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:03:48.145488 14615 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:48.125865 14780 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:03:48.140349 14785 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:48.159927 12662 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:48.146875 14515 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:03:48.146677 14691 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:48.155473 14477 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.172390 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 410) took 1642 ms. Trace:
I20260709 13:03:48.137106 14789 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:03:48.173626 14582 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:48.177016 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:48.164269 14646 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:48.160964 14545 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:48.193681 12587 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:48.159847 14548 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:03:48.144505 14435 consensus_queue.cc:1048] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:03:48.228515 14615 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:48.165771 14775 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:48.165426 14361 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:48.165691 14783 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:03:48.283129 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 50700.3us
W20260709 13:03:48.218870 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 76743.8us
I20260709 13:03:48.196928 14717 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.167702 14629 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:48.201334 14786 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.292840 14786 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:48.294157 14629 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:48.196144 14694 consensus_queue.cc:1059] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:03:48.294935 12542 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:03:48.294983 14786 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:48.245195 12544 rpcz_store.cc:276] 0709 13:03:46.530388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.662546 (+132158us) service_pool.cc:224] Handling call
0709 13:03:47.170512 (+507966us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b5800000c98. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:03:47.170728 (+   216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:47.507115 (+336387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.171613 (+664498us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b54002e1e20. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a94f0dc0 00007fc3a957ca02 00007fc3a9578dd6 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:03:48.172159 (+   546us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54000a64d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:48.172333 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502864768}
W20260709 13:03:48.249897 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 90035.3us
W20260709 13:03:48.195004 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 53095.8us
W20260709 13:03:48.298458 14797 log.cc:927] Time spent T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:03:48.260061 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 83122.5us
I20260709 13:03:48.299800 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:48.300386 13199 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:03:48.301275 14794 log.cc:927] Time spent T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:03:48.244894 14686 raft_consensus.cc:3055] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:48.301797 14686 raft_consensus.cc:740] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:48.302203 14552 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:48.302829 14686 consensus_queue.cc:260] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:48.304100 14686 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:48.274363 14545 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.306067 14545 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:48.306887 14689 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:48.230800 14785 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:48.308774 14785 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:48.310484 12620 raft_consensus.cc:3055] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:03:48.262177 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 77990.7us
I20260709 13:03:48.246747 14477 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.295127 12540 raft_consensus.cc:2368] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5.
I20260709 13:03:48.318295 14700 raft_consensus.cc:3055] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:48.318922 14700 raft_consensus.cc:740] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:48.281739 14585 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:48.319900 14694 raft_consensus.cc:3055] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:48.319756 14700 consensus_queue.cc:260] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:48.320322 14585 raft_consensus.cc:697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:48.321125 12545 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:48.257279 14445 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:48.322191 14445 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.322578 14445 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:48.260449 14646 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:48.276855 14791 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:03:48.310848 12620 raft_consensus.cc:740] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:48.324572 12620 consensus_queue.cc:260] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:48.325428 12620 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.325470 12587 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:48.320412 14694 raft_consensus.cc:740] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:48.327051 14694 consensus_queue.cc:260] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:48.328033 14714 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:48.276700 14775 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.328447 14694 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:48.277426 14615 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:48.257009 14515 raft_consensus.cc:697] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:48.339637 14783 consensus_queue.cc:1059] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:48.340773 14783 raft_consensus.cc:3055] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:48.340292 14515 consensus_queue.cc:237] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:48.342074 12662 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:48.290417 14361 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:48.343186 14781 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:48.275456 14559 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:48.291754 14717 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:48.285260 14795 log.cc:927] Time spent T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:03:48.347456 14717 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:48.336416 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 48681.7us
I20260709 13:03:48.341188 14783 raft_consensus.cc:740] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:48.356395 13199 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:03:48.361958 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 206001us
I20260709 13:03:48.367118 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:48.379307 12541 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:48.300333 13229 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:48.328691 14775 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:48.390777 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.328583 14714 raft_consensus.cc:697] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:48.397945 12510 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:48.399827 12620 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
W20260709 13:03:48.399971 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.300468 13226 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
W20260709 13:03:48.427574 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 59512.3us
I20260709 13:03:48.433604 12620 pending_rounds.cc:85] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 5
I20260709 13:03:48.434700 12620 pending_rounds.cc:107] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:03:48.435492 12620 raft_consensus.cc:2889] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:48.437162 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 68811.7us
W20260709 13:03:48.446077 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 58012.6us
I20260709 13:03:48.446895 12659 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:48.446606 12443 catalog_manager.cc:5697] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:48.448400 12659 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:48.450126 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1212) took 1076 ms. Trace:
I20260709 13:03:48.448169 12510 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:48.450634 12545 rpcz_store.cc:276] 0709 13:03:47.374074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:47.909343 (+535269us) service_pool.cc:224] Handling call
0709 13:03:48.320961 (+411618us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:48.321532 (+   571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:48.449878 (+128346us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54002baa50. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:48.450056 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":946030976}
I20260709 13:03:48.410081 14602 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:48.457894 14714 consensus_queue.cc:237] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:48.459069 14774 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:48.421780 14720 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:48.448158 12443 catalog_manager.cc:5697] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:48.462436 14729 consensus_queue.cc:1059] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:48.463158 14717 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.463507 14361 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:48.429704 14559 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:03:48.464178 14644 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:48.465610 12510 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:48.432461 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:48.480406 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:48.501017 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.503592 14638 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:48.482837 12443 catalog_manager.cc:5697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:48.499552 12659 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:03:48.505208 12510 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:48.506035 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:48.436158 14561 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:03:48.477680 14552 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:03:48.505474 12443 catalog_manager.cc:5697] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 2 to 4, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 4 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:48.477886 14435 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:48.511065 14619 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:48.514250 14789 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:48.517637 12442 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50014 (request call id 222) took 7119 ms. Trace:
I20260709 13:03:48.501438 14644 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:48.520287 12443 catalog_manager.cc:5697] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 3 to 4, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 4 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:48.522354 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:48.534825 12510 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:48.480168 14602 raft_consensus.cc:697] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:03:48.538393 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 60992.2us
I20260709 13:03:48.532265 12513 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:48.539259 12659 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:48.542557 12510 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:48.545902 12443 catalog_manager.cc:5697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 2 to 3, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 3 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:48.551699 12443 catalog_manager.cc:5697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 5 to 6, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 6 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:48.498322 14717 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:48.553730 14803 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:48.554206 14774 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:48.532444 14435 raft_consensus.cc:697] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:48.559998 14477 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:48.560556 14788 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:48.536471 14602 consensus_queue.cc:237] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:48.500877 14585 consensus_queue.cc:237] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:48.525156 14729 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:48.562043 14453 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:48.571632 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 272721us
I20260709 13:03:48.576341 14638 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:48.572458 13235 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:48.530272 12442 rpcz_store.cc:276] 0709 13:03:41.389506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:41.389665 (+   159us) service_pool.cc:224] Handling call
0709 13:03:48.509158 (+7119493us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:43.841465 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:43.842474 (+  1009us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:43.842527 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:03:43.842566 (+    39us) tablet.cc:662] Decoding operations
0709 13:03:43.844131 (+  1565us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:43.844252 (+   121us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:43.844300 (+    48us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:03:43.845872 (+  1572us) tablet.cc:701] Row locks acquired
0709 13:03:43.845919 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:03:43.846104 (+   185us) write_op.cc:270] Start()
0709 13:03:43.846292 (+   188us) write_op.cc:276] Timestamp: P: 1783602223846044 usec, L: 0
0709 13:03:43.846340 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 13:03:43.847531 (+  1191us) log.cc:844] Serialized 5196 byte log entry
0709 13:03:44.460169 (+612638us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b18000df120. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c522 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
0709 13:03:44.574555 (+114386us) op_driver.cc:464] REPLICATION: finished
0709 13:03:44.933189 (+358634us) write_op.cc:301] APPLY: starting
0709 13:03:44.944598 (+ 11409us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:44.992794 (+ 48196us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:44.992842 (+    48us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:45.012775 (+ 19933us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:45.013134 (+   359us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:03:45.013184 (+    50us) write_op.cc:312] APPLY: finished
0709 13:03:45.013625 (+   441us) log.cc:844] Serialized 95 byte log entry
0709 13:03:45.013840 (+   215us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:45.014005 (+   165us) write_op.cc:454] Released schema lock
0709 13:03:45.014070 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:45.089211 (+ 75141us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:45.094297 (+  5086us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1099180,"reported_tablets":20,"child_traces":[["op",{"apply.queue_time_us":283206,"apply.run_cpu_time_us":5176,"apply.run_wall_time_us":153208,"num_ops":13,"prepare.queue_time_us":7619,"prepare.run_cpu_time_us":48181,"prepare.run_wall_time_us":125387,"raft.queue_time_us":599475,"raft.run_cpu_time_us":43042,"raft.run_wall_time_us":72396,"replication_time_us":728005,"spinlock_wait_cycles":9372032,"thread_start_us":1078102,"threads_started":4,"wal-append.queue_time_us":113989,"wal-append.run_cpu_time_us":49021,"wal-append.run_wall_time_us":2220882}]]}
W20260709 13:03:48.621206 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 279218us
I20260709 13:03:48.577075 14690 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:03:48.540660 14644 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:48.574225 14804 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:03:48.643289 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:48.640590 14763 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.645704 14686 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:48.646174 14686 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:48.646056 14763 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:48.646659 14686 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.648203 14763 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:48.648756 14785 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:48.649484 14477 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:48.565028 14646 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:48.609088 12588 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:03:48.654492 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 45475.6us
I20260709 13:03:48.576200 14784 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:48.615079 14453 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:48.577368 14781 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.638772 14780 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:48.616904 12688 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:48.472571 14783 consensus_queue.cc:260] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:48.617866 12687 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:48.576265 14619 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 13:03:48.595366 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 52905.3us
I20260709 13:03:48.610733 14638 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.669888 14638 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:48.647889 14775 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:48.566215 12443 catalog_manager.cc:5697] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 1 to 3, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 3 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:48.656117 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:48.675802 12618 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:48.658257 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:48.611652 14435 consensus_queue.cc:237] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:48.616771 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 77596us
I20260709 13:03:48.650802 14785 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:48.681924 12659 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:48.662081 14646 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.658948 14763 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:48.628769 14615 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:48.706874 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:48.708539 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 53217.5us
W20260709 13:03:48.721978 12588 leader_election.cc:336] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.783s (SENT)
I20260709 13:03:48.722747 12618 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
W20260709 13:03:48.722834 12588 leader_election.cc:336] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.847s (SENT)
I20260709 13:03:48.724260 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:48.725224 13197 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:48.708974 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:03:48.731041 12588 leader_election.cc:336] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.868s (SENT)
I20260709 13:03:48.718765 14694 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:48.723567 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:48.736058 12588 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:48.728247 13234 raft_consensus.cc:2955] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:48.680171 14545 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:48.733276 12690 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:48.752760 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:48.753257 14597 raft_consensus.cc:3055] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:48.753756 14597 raft_consensus.cc:740] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:48.720479 14789 raft_consensus.cc:697] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:48.728873 14561 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:48.754592 14597 consensus_queue.cc:260] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:48.760273 13226 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:03:48.760681 14597 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.758347 14694 raft_consensus.cc:697] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:48.761930 14701 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:48.762472 14694 consensus_queue.cc:237] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:48.764398 13228 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 4: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:48.728933 14763 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:48.709467 14646 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:48.751624 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:48.733314 14552 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:03:48.782173 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.743125 12616 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.760393 14561 raft_consensus.cc:697] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:03:48.770539 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 59346.9us
W20260709 13:03:48.769436 12588 leader_election.cc:336] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.925s (SENT)
I20260709 13:03:48.742750 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:48.803895 12659 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:48.789593 14717 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:48.817524 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 48125.8us
W20260709 13:03:48.818233 12588 leader_election.cc:336] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.991s (SENT)
I20260709 13:03:48.818889 12588 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:03:48.821234 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 54156.2us
I20260709 13:03:48.811399 14788 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:48.809273 14552 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
W20260709 13:03:48.833365 12588 leader_election.cc:336] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.041s (SENT)
I20260709 13:03:48.816351 14775 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:48.835390 12662 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:48.772341 14789 consensus_queue.cc:237] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:48.826367 14763 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:48.831898 14453 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.844468 12659 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:48.847498 14813 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:03:48.843658 14615 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:48.841787 14445 consensus_meta.cc:287] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.001s
I20260709 13:03:48.855063 14445 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:48.859627 14445 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:03:48.862092 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.862382 14646 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:48.837550 14826 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:03:48.863502 14818 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.121s	user 0.003s	sys 0.000s
I20260709 13:03:48.867585 12659 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:48.869802 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:48.875957 12618 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:48.842543 14561 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:48.878711 13197 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:48.879698 14477 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:48.880081 14477 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.880434 14477 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.881772 12588 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:48.882970 14763 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:48.883330 14763 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.884708 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:48.883708 14763 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:48.849123 14638 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:48.888576 12618 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:48.892824 14563 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:48.875077 14814 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:48.897223 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:48.897562 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:48.898375 12546 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 3: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:03:48.897919 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 62624.9us
I20260709 13:03:48.900274 14691 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:48.901454 14824 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:48.903406 14783 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:48.908708 14827 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:48.910568 14827 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:48.915738 14827 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:48.920333 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:48.896556 14826 raft_consensus.cc:697] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:03:48.921360 13235 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 481) took 2099 ms (client timeout 1779 ms). Trace:
I20260709 13:03:48.922088 14826 consensus_queue.cc:237] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:48.921886 13235 rpcz_store.cc:269] 0709 13:03:46.822212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:46.822337 (+   125us) service_pool.cc:224] Handling call
0709 13:03:48.921180 (+2098843us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b5400750dd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:48.921278 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3365160704}
I20260709 13:03:48.893669 14297 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:03:48.865705 14453 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:48.899724 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:48.909297 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:48.895501 14644 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:48.914968 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:48.933076 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:48.935395 14824 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:48.936311 14781 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:48.936120 14691 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:48.937789 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:48.940573 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:48.941047 14453 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:48.941378 13231 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:48.942030 12544 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:48.943516 12659 leader_election.cc:400] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5.
I20260709 13:03:48.943917 12659 leader_election.cc:403] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:03:48.944523 13200 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:03:48.945286 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 45649.1us
I20260709 13:03:48.946609 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:48.952029 12543 raft_consensus.cc:1240] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:48.885413 14686 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:48.957897 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:48.961313 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:48.958011 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:48.959725 12541 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:48.942736 14644 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:48.962321 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:48.961035 12545 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:03:48.976260 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:48.977020 12613 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:48.976899 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:48.978899 12614 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:03:48.979286 12615 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:03:48.980050 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:48.981220 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:48.983412 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:48.983484 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:48.984426 12691 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 6: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:48.986287 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:48.960709 14824 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:48.988001 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:48.988325 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:48.988031 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:48.990175 14686 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:48.989712 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:48.992700 12614 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:48.995466 14638 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:48.997532 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:48.997989 14747 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:48.998320 13235 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:48.961621 14694 consensus_queue.cc:1059] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:03:48.952972 14563 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:49.000126 14563 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:49.000680 14563 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:48.962303 14297 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:48.975514 14701 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:48.960978 14814 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5.
I20260709 13:03:49.018627 13235 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:03:49.001119 14763 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:49.022861 14597 consensus_queue.cc:1059] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:48.961475 14714 consensus_queue.cc:1059] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:03:49.005110 14453 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:49.029368 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:49.029763 12692 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:49.029901 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:49.030668 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:49.034399 12695 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:49.034529 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:49.034998 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:49.035297 12512 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:49.048626 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:49.049822 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:49.050969 12687 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:49.017293 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:49.026017 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:49.027844 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:49.022038 14824 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:49.150154 12545 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
W20260709 13:03:49.156641 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 179807us
I20260709 13:03:49.106412 12613 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:49.156647 12617 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:49.172751 12588 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:49.175748 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:49.017805 14477 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:49.067795 14297 raft_consensus.cc:697] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:03:49.217180 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 182022us
I20260709 13:03:49.217954 12659 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:49.218694 12512 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:49.220189 12512 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:49.221832 13232 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:49.058768 14701 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:49.162528 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:49.157392 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 131723us
I20260709 13:03:49.231514 12662 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:49.196142 12688 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:49.060904 14781 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 13:03:49.163692 14690 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:49.179930 12545 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 5: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:49.174896 14691 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:49.182013 13231 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:49.163348 12693 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
W20260709 13:03:49.239317 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.155170 14827 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:49.233191 12690 raft_consensus.cc:2410] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:03:49.234519 14544 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:49.227911 14824 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:49.280725 12619 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:49.225600 14638 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:03:49.288551 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 115895us
I20260709 13:03:49.182250 14842 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:49.237149 14619 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:49.271592 14781 raft_consensus.cc:3055] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:49.298954 12588 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:03:49.299324 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 67940.7us
I20260709 13:03:49.308869 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:03:49.302205 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.329663 12588 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:49.304373 14615 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:49.353688 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:49.269634 14690 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:49.312363 14824 raft_consensus.cc:697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:03:49.383476 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 53977.7us
W20260709 13:03:49.386937 14840 log.cc:927] Time spent T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:03:49.387979 14780 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:49.388520 14780 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:49.393373 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:49.394294 12539 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:49.396958 14834 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260709 13:03:49.398994 14837 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:03:49.403362 14848 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:49.357594 14841 raft_consensus.cc:3055] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:49.404476 14841 raft_consensus.cc:740] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:49.405264 14563 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:49.405668 14445 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:49.405321 14841 consensus_queue.cc:260] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:49.407040 14827 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:49.407145 14841 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:49.409179 14843 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:03:49.410152 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:49.411811 14701 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:49.412494 14701 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:49.413210 14701 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:03:49.331419 14717 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:49.384450 12588 leader_election.cc:400] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5.
I20260709 13:03:49.418816 12588 leader_election.cc:403] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:03:49.419689 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:49.424047 12588 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:49.427129 12588 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:49.314852 14781 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:49.329219 14789 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:03:49.431339 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.440393 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:49.421188 14720 raft_consensus.cc:3055] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:49.420468 14563 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:49.417980 14763 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:49.452724 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:49.366216 14714 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:49.360348 14826 consensus_queue.cc:1059] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
W20260709 13:03:49.483711 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.432461 14854 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:49.484143 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:49.490195 14826 raft_consensus.cc:3055] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:49.454186 14720 raft_consensus.cc:740] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:49.511570 14826 raft_consensus.cc:740] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:49.528918 14789 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.529405 14763 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:49.529515 14789 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:49.491786 14853 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:49.531340 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:49.532068 12588 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:49.493677 14714 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:49.494099 14844 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:49.494906 14690 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:49.447458 14694 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:49.383314 14297 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:49.430794 14691 consensus_queue.cc:1059] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 13:03:49.447892 14701 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:49.554553 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:49.532155 14789 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:49.495438 13231 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:49.501158 14477 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:49.531975 12693 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:49.502054 14849 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:49.529417 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:49.511525 14842 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:49.633525 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 104969us
W20260709 13:03:49.559598 12616 consensus_meta.cc:287] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.751s	user 0.008s	sys 0.007s
I20260709 13:03:49.557399 14694 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:49.637998 12539 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
W20260709 13:03:49.639055 12587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.017s	sys 0.010s
W20260709 13:03:49.639395 12587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.017s	sys 0.010s
W20260709 13:03:49.586560 14515 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.001s	sys 0.020s
I20260709 13:03:49.644292 12588 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:49.644433 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:49.582629 14548 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:49.634568 14585 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.917s	user 0.000s	sys 0.025s
I20260709 13:03:49.587318 14854 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:49.679003 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:49.680299 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:49.680634 12588 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:49.495451 14781 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:49.641549 14822 raft_consensus.cc:3055] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:03:49.733155 12613 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.017s	sys 0.033s
W20260709 13:03:49.646278 14515 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.001s	sys 0.020s
I20260709 13:03:49.639191 14694 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:49.645033 14783 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.638885 12616 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
W20260709 13:03:49.758522 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 77965.5us
W20260709 13:03:49.652132 14585 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.000s	sys 0.025s
I20260709 13:03:49.732973 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:03:49.762518 12613 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.018s	sys 0.034s
W20260709 13:03:49.762777 12622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.010s	sys 0.043s
I20260709 13:03:49.503978 14824 consensus_queue.cc:237] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:49.768543 12512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.015s	sys 0.013s
W20260709 13:03:49.774796 12512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.015s	sys 0.014s
W20260709 13:03:49.775204 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 547400us
I20260709 13:03:49.642470 14561 consensus_queue.cc:1059] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.105s
W20260709 13:03:49.772547 12622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.010s	sys 0.043s
I20260709 13:03:49.648599 14844 consensus_queue.cc:1059] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.119s
I20260709 13:03:49.732205 14822 raft_consensus.cc:740] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:49.768735 14763 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:49.792558 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 208508us
I20260709 13:03:49.768885 14615 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:03:49.803167 14850 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 13:03:49.805169 14836 log.cc:927] Time spent T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:03:49.807099 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:49.807741 12620 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:03:49.808334 14860 log.cc:927] Time spent T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 13:03:49.810393 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:03:49.811295 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:49.812575 14845 log.cc:927] Time spent T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 13:03:49.812708 12614 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:49.814211 14763 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.814780 14763 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:49.818012 14615 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:49.825716 14815 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 1.157s	user 0.004s	sys 0.000s
I20260709 13:03:49.837042 12620 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 2.
I20260709 13:03:49.840952 12620 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:49.677762 14548 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:49.781090 14854 raft_consensus.cc:697] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:49.784633 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 378) took 1131 ms. Trace:
I20260709 13:03:49.850607 13200 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:49.676118 14720 consensus_queue.cc:260] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:49.843118 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:03:49.873085 12510 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.022s	sys 0.143s
W20260709 13:03:49.878167 12510 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.022s	sys 0.143s
W20260709 13:03:49.878521 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 870018us
I20260709 13:03:49.879595 12510 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:49.781452 14783 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:49.885159 12620 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:49.871873 14690 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:49.896884 14854 consensus_queue.cc:237] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:49.902519 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:49.903774 12620 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:49.877331 14789 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.872295 14870 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.854660 12616 rpcz_store.cc:276] 0709 13:03:48.653457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.656777 (+  3320us) service_pool.cc:224] Handling call
0709 13:03:49.780512 (+1123735us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:49.925545 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 46091.9us
I20260709 13:03:49.932919 12620 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:49.933199 12510 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:03:49.939110 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:49.909152 14714 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:49.927544 13226 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:49.911263 14690 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:49.956185 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:49.950054 14445 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.948060 14871 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:49.887033 14869 consensus_queue.cc:1059] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 13:03:49.935432 14789 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:49.978451 12538 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:49.976866 14842 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:49.968278 14690 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:49.979694 14878 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:49.933625 14870 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:50.025771 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2457) took 1076 ms. Trace:
I20260709 13:03:49.972711 14561 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:03:50.027299 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 94193.8us
I20260709 13:03:49.971637 14445 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:50.018250 14763 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:50.037060 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:50.039057 12541 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 5: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:03:50.041697 12512 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.195:34641 timed out after 1.523s (SENT) [suppressed 54 similar messages]
I20260709 13:03:50.026206 12544 rpcz_store.cc:276] 0709 13:03:48.949013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.949164 (+   151us) service_pool.cc:224] Handling call
0709 13:03:49.391269 (+442105us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b5800000c98. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:03:49.391530 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:49.391810 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:49.634284 (+242474us) log.cc:844] Serialized 14 byte log entry
0709 13:03:50.025029 (+390745us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:50.025130 (+   101us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:50.025251 (+   121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.025484 (+   233us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:50.025677 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":398596,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"spinlock_wait_cycles":8851712,"thread_start_us":611619,"threads_started":3,"wal-append.queue_time_us":337638}
I20260709 13:03:50.025315 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:49.975243 14871 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:50.030668 14445 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:50.056555 12690 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:03:50.030664 14545 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:50.040580 14841 consensus_meta.cc:287] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.633s	user 0.010s	sys 0.003s
I20260709 13:03:50.059108 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:50.060009 12541 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:03:50.033362 14561 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:50.067576 12541 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:50.085951 14885 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.086567 14885 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:50.091861 14810 log.cc:927] Time spent T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 1.374s	user 0.001s	sys 0.002s
I20260709 13:03:50.094235 14686 raft_consensus.cc:3055] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:50.094709 14686 raft_consensus.cc:740] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:50.095330 14561 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:50.095636 14686 consensus_queue.cc:260] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:50.096815 14686 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:50.102227 14825 raft_consensus.cc:1064] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:03:50.103374 14884 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.103930 14884 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:50.069464 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:50.106921 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:50.107677 12690 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:03:50.108548 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:50.110828 14875 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:03:50.110965 13226 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:50.115383 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:50.117231 12616 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:03:50.120786 14886 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:50.084769 14445 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.122402 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:50.095997 14561 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:50.057150 14873 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:03:50.136126 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2553) took 1175 ms. Trace:
I20260709 13:03:50.136576 12613 rpcz_store.cc:276] 0709 13:03:48.960786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.178171 (+217385us) service_pool.cc:224] Handling call
0709 13:03:49.178513 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:49.771507 (+592994us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:49.771558 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:49.780878 (+  9320us) log.cc:844] Serialized 26 byte log entry
0709 13:03:49.975728 (+194850us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:49.975780 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.975866 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:50.135884 (+160018us) raft_consensus.cc:1685] finished
0709 13:03:50.135906 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:50.136055 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":208031,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":142,"thread_start_us":723511,"threads_started":2,"wal-append.queue_time_us":269964}
W20260709 13:03:50.138974 14823 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 1.398s	user 0.002s	sys 0.006s
I20260709 13:03:50.140183 12614 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:50.084192 14545 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:50.141330 14545 raft_consensus.cc:697] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:50.142220 14545 consensus_queue.cc:237] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:50.122063 14445 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:50.028633 14878 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:50.164820 13232 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:03:50.128086 14885 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:50.129750 12693 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:50.186775 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:50.187144 14445 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:03:50.200268 14435 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.406s	user 0.003s	sys 0.006s
W20260709 13:03:50.200779 14435 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.406s	user 0.003s	sys 0.006s
I20260709 13:03:50.205120 14783 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:50.211930 14789 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:03:50.213346 14853 consensus_meta.cc:287] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.682s	user 0.007s	sys 0.005s
I20260709 13:03:50.239986 14853 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5.
I20260709 13:03:50.242581 14876 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:50.192122 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:50.244005 14871 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:50.260128 12618 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:03:50.214506 14548 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:50.261879 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2461) took 1311 ms. Trace:
I20260709 13:03:50.262342 12547 rpcz_store.cc:276] 0709 13:03:48.950473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.950702 (+   229us) service_pool.cc:224] Handling call
0709 13:03:50.118968 (+1168266us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b5800000c98. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:03:50.119224 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:50.132345 (+ 13121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:50.132379 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:50.132780 (+   401us) log.cc:844] Serialized 26 byte log entry
0709 13:03:50.204524 (+ 71744us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:50.204588 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.204747 (+   159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:50.255090 (+ 50343us) raft_consensus.cc:1685] finished
0709 13:03:50.255104 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:50.261694 (+  6590us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20113,"raft.queue_time_us":13325,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":23798,"spinlock_wait_cycles":9613696,"thread_start_us":37760,"threads_started":1,"wal-append.queue_time_us":44693}
I20260709 13:03:50.257921 14884 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:50.256480 14853 raft_consensus.cc:476] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Not starting pre-election -- already a leader
I20260709 13:03:50.243247 14825 consensus_queue.cc:237] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:50.261476 12690 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:03:50.278170 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2545) took 1321 ms. Trace:
I20260709 13:03:50.278767 12617 rpcz_store.cc:276] 0709 13:03:48.956814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.956920 (+   106us) service_pool.cc:224] Handling call
0709 13:03:48.957189 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:49.174769 (+217580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.277832 (+1103063us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b540007bcd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:50.278083 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":438062976}
I20260709 13:03:50.279870 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:50.282316 14615 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:50.285943 14879 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 13:03:50.286624 14878 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:50.265697 14870 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:50.290202 14297 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:50.290896 14297 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:50.291815 12696 raft_consensus.cc:1275] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:03:50.295259 14747 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:50.243263 14876 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:50.296047 14747 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:50.295377 14694 consensus_meta.cc:287] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.003s
I20260709 13:03:50.298393 14694 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:50.303664 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:50.303833 14876 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:50.284894 14690 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:50.304411 12539 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:50.306762 12688 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5. Ops: []
W20260709 13:03:50.312500 14780 consensus_meta.cc:287] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.923s	user 0.014s	sys 0.000s
I20260709 13:03:50.313110 14297 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:50.314857 12690 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:50.317335 12615 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:03:50.329099 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2550) took 1370 ms. Trace:
I20260709 13:03:50.329741 12615 rpcz_store.cc:276] 0709 13:03:48.958613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.316592 (+1357979us) service_pool.cc:224] Handling call
0709 13:03:50.317040 (+   448us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:50.322078 (+  5038us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.328727 (+  6649us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:50.312988 14780 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:50.331324 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:50.333118 14780 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:50.343973 13197 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:50.306360 14694 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:50.345816 13197 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:50.347512 14896 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:50.347688 14512 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:50.347808 13197 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:50.348507 14896 raft_consensus.cc:697] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:50.348548 14512 raft_consensus.cc:697] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:50.349514 14742 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:50.350288 14896 consensus_queue.cc:237] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:50.438967 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:50.544524 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.360316 13229 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:50.524062 14681 raft_consensus.cc:3055] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:50.399978 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:50.482438 14820 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 1.808s	user 0.004s	sys 0.000s
I20260709 13:03:50.584456 12615 raft_consensus.cc:2410] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 13:03:50.494052 14903 log.cc:927] Time spent T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.102s	user 0.002s	sys 0.000s
W20260709 13:03:50.420908 14905 log.cc:927] Time spent T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:03:50.520248 13227 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:50.447499 14694 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:50.494365 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:50.412779 14742 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:50.417234 14856 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.653s	user 0.002s	sys 0.002s
I20260709 13:03:50.481602 14894 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:50.420715 14888 raft_consensus.cc:3055] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:50.400560 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:50.535070 14720 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:50.448207 14561 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:50.391640 14690 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:50.361403 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:50.583540 14681 raft_consensus.cc:740] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:50.358536 14297 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.231s
I20260709 13:03:50.616271 14894 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:50.503150 14826 consensus_queue.cc:260] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:50.614118 14888 raft_consensus.cc:740] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:50.603123 14694 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:50.412637 14512 consensus_queue.cc:237] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:50.625640 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 763) took 1897 ms. Trace:
I20260709 13:03:50.641639 13227 rpcz_store.cc:276] 0709 13:03:48.722758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.724049 (+  1291us) service_pool.cc:224] Handling call
0709 13:03:50.519826 (+1795777us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b58000f6398. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:03:50.520050 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:50.597829 (+ 77779us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.616283 (+ 18454us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15931776}
I20260709 13:03:50.622705 12690 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:50.622488 14561 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:50.644810 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.628038 13231 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:03:50.694031 12615 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:03:50.645344 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:50.696973 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.668100 14781 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:50.647784 14888 consensus_queue.cc:260] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:50.670394 14855 log.cc:927] Time spent T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 1.028s	user 0.003s	sys 0.000s
I20260709 13:03:50.645061 14561 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:03:50.698112 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:50.702234 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.646947 14871 consensus_queue.cc:1059] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 13:03:50.656826 14894 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:50.702865 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 444) took 1698 ms. Trace:
I20260709 13:03:50.707126 14851 raft_consensus.cc:3055] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:50.707823 14851 raft_consensus.cc:740] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:50.706744 12543 rpcz_store.cc:276] 0709 13:03:49.004531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.005699 (+  1168us) service_pool.cc:224] Handling call
0709 13:03:49.036541 (+ 30842us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:49.058485 (+ 21944us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:49.058522 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:49.058994 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:03:49.350767 (+291773us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:49.350826 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.350909 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:50.669789 (+1318880us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:03:50.702526 (+ 32737us) raft_consensus.cc:1685] finished
0709 13:03:50.702547 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:50.702788 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11822,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":4015,"spinlock_wait_cycles":51964160,"thread_start_us":169149,"threads_started":1,"wal-append.queue_time_us":356201}
I20260709 13:03:50.709467 14747 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:50.710716 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:50.722950 12691 raft_consensus.cc:2410] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:03:50.724052 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:50.725239 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:50.712220 12687 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:50.712636 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:50.649014 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:50.726617 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:50.727065 12690 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:03:50.718942 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 535) took 1687 ms. Trace:
I20260709 13:03:50.727142 12614 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:50.728240 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:50.727861 13235 rpcz_store.cc:276] 0709 13:03:49.032049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.062545 (+ 30496us) service_pool.cc:224] Handling call
0709 13:03:50.718059 (+1655514us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b58000f6398. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:03:50.718312 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:50.718536 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:50.718566 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:50.718611 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:50.718675 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.718737 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:50.718870 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4206848}
I20260709 13:03:50.729210 12690 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 6: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:50.732139 12692 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:03:50.736012 14825 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.699538 14888 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:50.738569 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.726617 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:50.732160 14700 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:50.736557 14825 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:50.743852 12587 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:50.738090 12691 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:50.655525 14694 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:50.751430 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:50.754890 13235 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:50.646823 14853 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.105s
I20260709 13:03:50.747244 14686 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.756165 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:50.762823 14783 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:50.753578 14848 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:03:50.779062 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 518) took 1271 ms. Trace:
I20260709 13:03:50.777091 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:50.786381 14846 log.cc:927] Time spent T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 1.342s	user 0.004s	sys 0.000s
I20260709 13:03:50.792868 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2459) took 1843 ms. Trace:
I20260709 13:03:50.793295 12546 rpcz_store.cc:276] 0709 13:03:48.949936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.950046 (+   110us) service_pool.cc:224] Handling call
0709 13:03:48.952740 (+  2694us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:48.953295 (+   555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:48.953336 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:48.985799 (+ 32463us) log.cc:844] Serialized 26 byte log entry
0709 13:03:49.280234 (+294435us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:49.280294 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.280403 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:50.249462 (+969059us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b48000024d8. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3ae4a2aa1 00007fc3ae499b37 00007fc3ae4999ca 00007fc3ae59126f 00007fc3ae590f37 00007fc3ae5a555c 00007fc3ae5a5508 00007fc3ae5a5488 00007fc3ae5a5443 00007fc3ae5a46ec 00007fc3ad4cea96
0709 13:03:50.776155 (+526693us) spinlock_profiling.cc:243] Waited 17.2 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:03:50.792626 (+ 16471us) raft_consensus.cc:1685] finished
0709 13:03:50.792649 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:50.792791 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79,"raft.run_cpu_time_us":3849,"raft.run_wall_time_us":1289175,"spinlock_wait_cycles":75528192,"thread_start_us":218334,"threads_started":1,"wal-append.queue_time_us":394244}
I20260709 13:03:50.772421 14686 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:50.771751 14916 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:03:50.753304 14870 consensus_queue.cc:1059] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:03:50.802074 12588 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:50.804957 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:50.805629 13235 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:03:50.772765 14701 raft_consensus.cc:3055] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:50.773576 14848 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:50.777544 12690 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:03:50.808663 12588 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:50.811071 14853 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:50.811311 12615 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:50.779678 12693 rpcz_store.cc:276] 0709 13:03:49.507567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.187868 (+680301us) service_pool.cc:224] Handling call
0709 13:03:50.727675 (+539807us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b5800210698. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454eee 0000000000375939 00007fc3ae4c81e0 00007fc3ae5910c4 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:03:50.727842 (+   167us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:50.728318 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:03:50.728352 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:50.728879 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:03:50.770466 (+ 41587us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:50.770544 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.770666 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:50.772180 (+  1514us) raft_consensus.cc:1685] finished
0709 13:03:50.772222 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:50.778962 (+  6740us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13034,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"spinlock_wait_cycles":2573312,"thread_start_us":41106,"threads_started":1,"wal-append.queue_time_us":41441}
I20260709 13:03:50.813745 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:50.800634 13231 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:50.815342 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:50.810148 14848 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:50.809389 14849 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:50.807880 14701 raft_consensus.cc:740] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:50.811704 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:50.827267 14849 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.812778 14694 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:50.806591 14871 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 13:03:50.833755 14775 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:50.888799 14775 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:50.891127 14775 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:50.896293 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:50.897186 12690 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:03:50.900658 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:50.834403 14545 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:50.835119 14889 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:50.835714 14884 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:50.907437 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:50.914778 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:50.915376 12615 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:50.889204 14686 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:50.818229 14870 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:50.850260 14849 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:50.886209 14783 raft_consensus.cc:697] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:03:50.886507 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 376746us
I20260709 13:03:50.928511 12513 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:50.897748 14619 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:50.929685 14720 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:50.930107 14720 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:50.929898 14619 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:50.930546 14720 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:50.932132 14619 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:50.916535 14857 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.933120 14857 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:50.934355 12513 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:50.934155 14783 consensus_queue.cc:237] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:50.935423 14857 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:50.928148 14686 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:50.936235 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:50.936550 14686 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:50.897957 14899 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:50.937537 14899 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:50.938663 14686 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:50.897812 14893 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.900059 14638 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:50.833875 14784 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:50.901768 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:50.949013 12539 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:03:50.832834 14853 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:03:50.902426 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:50.903034 12540 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:03:50.960076 12546 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:50.919575 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:50.839190 13197 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:50.960799 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:50.838861 12588 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:50.901397 14545 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:50.930269 12542 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:50.899402 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:50.945461 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 173934us
I20260709 13:03:50.947410 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:50.908077 14747 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:03:50.969969 12544 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:50.961858 12540 raft_consensus.cc:2410] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:03:50.962324 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 123588us
W20260709 13:03:50.961150 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 122042us
I20260709 13:03:50.972751 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:50.922181 14870 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:50.966214 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:50.968888 12543 raft_consensus.cc:2393] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 6: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:50.908396 14694 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:50.975672 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:50.979178 12540 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:50.982388 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:50.948714 14644 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:50.983269 12539 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:50.984628 13197 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:03:50.916555 14889 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:50.917043 14884 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:50.969969 14857 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:50.990669 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:50.992076 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:50.973654 14646 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:50.980480 14870 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:51.014016 14871 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.014330 14822 consensus_queue.cc:260] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:51.014685 14871 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:51.015237 14889 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:51.015475 14822 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:50.996800 12538 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 5: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:51.016844 14871 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:51.017480 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:51.017868 14694 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:51.018615 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:51.020730 14686 consensus_queue.cc:1059] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:51.021248 14700 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:50.996897 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:50.997510 12546 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:03:51.023022 12539 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:51.023646 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:51.024406 12546 raft_consensus.cc:2410] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:03:51.025280 12546 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:03:50.998549 12540 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:50.999683 14884 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:51.000805 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:51.001641 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:50.963580 14638 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:50.980285 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:51.005604 12545 raft_consensus.cc:1275] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:03:51.039480 12545 pending_rounds.cc:85] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 2
I20260709 13:03:51.039716 12545 pending_rounds.cc:107] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:03:51.039942 12545 raft_consensus.cc:2889] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:50.983745 14784 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:50.944319 14701 consensus_queue.cc:260] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:51.044065 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:51.022154 14915 raft_consensus.cc:3055] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:51.007634 14899 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:51.009454 14851 consensus_queue.cc:260] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:51.016204 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:51.026444 12546 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:03:51.028913 13200 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:51.036778 12617 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 4: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:51.040918 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:51.042996 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 46005.9us
I20260709 13:03:51.069507 12538 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:51.070602 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.048985 12512 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:50.965317 14786 consensus_queue.cc:1059] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:03:51.013062 14720 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:51.022312 14691 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.053328 14694 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.019418 14545 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:51.035120 14896 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:50.958194 14893 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:50.995857 14646 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:51.054247 12690 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:51.061529 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:50.995997 14917 consensus_queue.cc:1059] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.095s
W20260709 13:03:51.090376 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 70044.8us
I20260709 13:03:51.095130 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:03:51.097440 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.101866 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:51.146968 12512 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:51.098377 12538 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:51.092309 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:51.065022 14915 raft_consensus.cc:740] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:51.152074 12543 raft_consensus.cc:2368] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4.
I20260709 13:03:51.152185 12662 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:51.160413 12617 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:51.153710 12539 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:51.148893 14644 raft_consensus.cc:697] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:03:51.092703 14913 log.cc:927] Time spent T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:03:51.089798 14899 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:03:51.093089 14868 log.cc:927] Time spent T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 1.140s	user 0.004s	sys 0.008s
W20260709 13:03:51.165237 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 63434.5us
I20260709 13:03:51.167531 12512 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:51.095326 14747 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:51.176231 12588 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:51.169946 14854 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:51.114440 14884 consensus_queue.cc:1059] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:03:51.151917 14646 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:51.179123 14878 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.148540 14775 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.148360 14851 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:51.164113 14701 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:51.096935 14896 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:51.095757 12542 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:03:51.097056 14691 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:51.190110 12512 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:51.198411 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2541) took 2242 ms. Trace:
I20260709 13:03:51.202006 14775 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:51.244858 12619 rpcz_store.cc:276] 0709 13:03:48.955700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.963383 (+  7683us) service_pool.cc:224] Handling call
0709 13:03:48.963662 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:49.297553 (+333891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:51.198150 (+1900597us) spinlock_profiling.cc:243] Waited 317 ms on lock 0x7b54001e91d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:51.198345 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":728155904}
I20260709 13:03:51.176396 14747 raft_consensus.cc:697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:51.246698 14747 consensus_queue.cc:237] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:51.247951 14849 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:51.102658 14786 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:03:51.188862 14854 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:51.215103 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:51.158262 14853 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.206571 12510 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:51.169600 14785 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:51.237655 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.115386 14694 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:51.247131 14775 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:51.244896 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 54854.1us
I20260709 13:03:51.268313 14853 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:51.268841 12512 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:51.269843 14775 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:51.169227 14545 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:51.270992 14853 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:51.242161 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:51.271678 14853 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:51.256618 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2543) took 2300 ms. Trace:
I20260709 13:03:51.272465 12622 rpcz_store.cc:276] 0709 13:03:48.956285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.956392 (+   107us) service_pool.cc:224] Handling call
0709 13:03:48.980027 (+ 23635us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:49.054491 (+ 74464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:49.054522 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:49.065889 (+ 11367us) log.cc:844] Serialized 26 byte log entry
0709 13:03:49.780510 (+714621us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:49.780581 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.780683 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:51.092600 (+1311917us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:03:51.256290 (+163690us) raft_consensus.cc:1685] finished
0709 13:03:51.256309 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:51.256549 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29134,"raft.queue_time_us":256795,"raft.run_cpu_time_us":5718,"raft.run_wall_time_us":45303,"spinlock_wait_cycles":5891840,"thread_start_us":683011,"threads_started":2,"wal-append.queue_time_us":738692}
I20260709 13:03:51.200841 14700 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.274760 14700 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:51.277050 14700 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:51.279868 14694 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:51.265103 14899 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:51.200655 14878 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:51.283485 14878 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:51.284055 14878 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.284518 14878 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:51.286302 14922 log.cc:927] Time spent T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:03:51.286520 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:51.288283 14237 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.288857 14237 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:51.291209 14237 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:51.292164 14638 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:51.169394 14888 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
W20260709 13:03:51.258456 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 51976us
I20260709 13:03:51.206666 14619 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:51.213894 14896 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:51.305320 12619 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:51.263367 14784 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:51.264184 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 80917.2us
I20260709 13:03:51.315258 12588 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:51.209692 14926 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:51.270215 14775 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:51.271802 12546 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:51.347594 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:51.349108 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:51.350095 12546 raft_consensus.cc:2393] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 5: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:51.351027 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:51.265920 14924 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.255373 12539 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
W20260709 13:03:51.301280 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 149170us
I20260709 13:03:51.286345 14720 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:51.259289 14717 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:51.309693 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:51.293507 14919 log.cc:927] Time spent T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:03:51.316256 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:51.364367 12613 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:51.252964 14925 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 13:03:51.344091 12588 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:03:51.254257 14902 log.cc:927] Time spent T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:03:51.352308 14926 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:51.373193 14559 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.295177 14899 raft_consensus.cc:697] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:51.308320 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:51.377256 12619 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:51.358152 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:51.359695 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:51.378360 12546 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:03:51.361256 12617 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:03:51.363245 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:51.365425 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:51.382982 12613 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
W20260709 13:03:51.343063 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.352124 14775 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:51.364428 14717 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:51.368075 14858 log.cc:927] Time spent T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 1.622s	user 0.001s	sys 0.004s
I20260709 13:03:51.353502 12615 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:51.294440 14785 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:51.373947 14559 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:51.251943 14644 consensus_queue.cc:237] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:51.388049 12546 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:03:51.358456 14849 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:51.296679 14870 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:51.396739 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:51.436882 14559 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:51.440538 14780 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:51.441222 14780 raft_consensus.cc:697] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:51.442180 14780 consensus_queue.cc:237] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:51.443017 14785 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:51.373440 14926 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:51.452210 12544 raft_consensus.cc:2410] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:51.436817 14681 consensus_queue.cc:260] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:51.358965 14915 consensus_queue.cc:260] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:51.454490 14681 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:51.445214 14775 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:51.458673 14893 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:51.459653 14775 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:51.460417 14899 consensus_queue.cc:237] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:51.461915 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2544) took 2505 ms. Trace:
I20260709 13:03:51.462580 14825 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:51.462363 12621 rpcz_store.cc:276] 0709 13:03:48.956553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.956667 (+   114us) service_pool.cc:224] Handling call
0709 13:03:48.984374 (+ 27707us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:49.147838 (+163464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:49.147870 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:49.171100 (+ 23230us) log.cc:844] Serialized 26 byte log entry
0709 13:03:49.361884 (+190784us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:49.361931 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:49.362004 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:51.315643 (+1953639us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:03:51.461580 (+145937us) raft_consensus.cc:1685] finished
0709 13:03:51.461609 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:51.461839 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51417,"raft.queue_time_us":312964,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":15292,"spinlock_wait_cycles":25067776,"thread_start_us":254194,"threads_started":2,"wal-append.queue_time_us":361384}
I20260709 13:03:51.465332 12539 raft_consensus.cc:2410] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:51.466635 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 458) took 1190 ms. Trace:
I20260709 13:03:51.467180 12547 rpcz_store.cc:276] 0709 13:03:50.276384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.277462 (+  1078us) service_pool.cc:224] Handling call
0709 13:03:50.298250 (+ 20788us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:50.886053 (+587803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:50.886091 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:50.886636 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 13:03:50.964091 (+ 77455us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:50.964154 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:50.964502 (+   348us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:51.466352 (+501850us) raft_consensus.cc:1685] finished
0709 13:03:51.466382 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:51.466560 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":539467,"raft.queue_time_us":587712,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"thread_start_us":76965,"threads_started":1,"wal-append.queue_time_us":199849}
I20260709 13:03:51.473114 12619 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:51.474920 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:51.475823 12619 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:51.393705 14717 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:51.486508 14878 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:51.491160 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:51.435756 14854 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:51.436203 14934 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:51.498744 12544 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:03:51.506297 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:51.514758 12547 raft_consensus.cc:1240] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 1. Current term is 2. Ops: []
W20260709 13:03:51.516001 14857 consensus_meta.cc:287] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.000s
I20260709 13:03:51.516527 14857 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:51.517287 14848 consensus_meta.cc:287] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.692s	user 0.007s	sys 0.004s
I20260709 13:03:51.526397 12544 raft_consensus.cc:1275] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:51.493810 14615 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.491922 14853 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.547968 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:51.548866 13234 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:51.451332 14646 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:51.508442 14934 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:51.517793 14848 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:51.570974 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:51.575681 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.577929 12689 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:03:51.571064 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:03:51.578299 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.370694 14924 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:51.534895 14853 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:51.535184 14615 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:51.826673 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:51.588804 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:51.643278 12617 raft_consensus.cc:1275] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:52.081596 12688 raft_consensus.cc:2410] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:03:52.006958 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.082901 14615 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:52.083199 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:51.702291 13234 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:52.061805 14870 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:52.059374 14924 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:52.008855 14827 consensus_queue.cc:1059] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:03:52.086019 14827 raft_consensus.cc:3055] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:52.016130 13233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:03:52.086655 14827 raft_consensus.cc:740] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:52.086958 13233 raft_consensus.cc:606] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:52.017593 14646 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:03:51.682530 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 98127.5us
I20260709 13:03:52.087706 14827 consensus_queue.cc:260] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:52.014096 14619 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:52.090198 14939 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:03:52.014206 14681 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:51.682190 13227 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:52.092098 14681 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:52.092803 14939 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:51.580372 14893 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.093912 14893 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:51.971612 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.095891 14893 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:52.096285 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.096385 14893 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:03:52.096733 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.096916 14893 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:51.972417 14775 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:52.016279 13231 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:03:51.559036 14889 raft_consensus.cc:3055] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:52.098831 14889 raft_consensus.cc:740] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:52.098944 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:52.099661 12695 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 1.
I20260709 13:03:52.099910 14889 consensus_queue.cc:260] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:52.101061 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:52.083878 12617 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:52.082680 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:52.102628 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 773) took 2671 ms. Trace:
I20260709 13:03:51.653925 14917 consensus_queue.cc:1059] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.450s
I20260709 13:03:51.597440 12587 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:52.090588 14619 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:52.104545 13233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "588a15c12a6c46ab9373c48890191400"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
W20260709 13:03:52.105052 14896 consensus_meta.cc:287] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.755s	user 0.009s	sys 0.000s
I20260709 13:03:51.577222 14934 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:52.106895 12695 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
W20260709 13:03:52.137854 12661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.074s	user 0.010s	sys 0.034s
W20260709 13:03:52.138291 12661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.084s	user 0.011s	sys 0.035s
I20260709 13:03:52.138969 12695 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:03:52.139420 12695 pending_rounds.cc:85] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 4
I20260709 13:03:52.140101 12695 pending_rounds.cc:107] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:03:51.595341 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:52.112530 13232 rpcz_store.cc:276] 0709 13:03:49.431656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.431814 (+   158us) service_pool.cc:224] Handling call
0709 13:03:49.432274 (+   460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:50.165524 (+733250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:52.102078 (+1936554us) spinlock_profiling.cc:243] Waited 732 ms on lock 0x7b54005794d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:52.102546 (+   468us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1683842304}
I20260709 13:03:52.109772 12688 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:52.109141 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:52.129961 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 532603us
I20260709 13:03:52.131055 12659 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:52.088622 14924 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:03:52.135840 12588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.000s	sys 0.001s
W20260709 13:03:52.145272 12588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.000s	sys 0.001s
W20260709 13:03:52.145994 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 801953us
I20260709 13:03:52.146817 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:52.101192 14889 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:52.188324 12695 raft_consensus.cc:2917] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
W20260709 13:03:52.188436 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 57466us
I20260709 13:03:52.189069 12695 raft_consensus.cc:2889] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:52.189262 12659 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:52.165103 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2472) took 1192 ms. Trace:
I20260709 13:03:52.167423 12696 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:03:52.173187 12694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1252) took 2532 ms (client timeout 2049 ms). Trace:
I20260709 13:03:52.098239 14775 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:52.193041 12692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 520) took 2659 ms (client timeout 1893 ms). Trace:
I20260709 13:03:52.192276 14937 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:03:52.191325 12694 rpcz_store.cc:269] 0709 13:03:49.640990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.172925 (+2531935us) service_pool.cc:211] Skipping call since client already timed out
0709 13:03:52.173074 (+   149us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:03:52.193719 12692 rpcz_store.cc:269] 0709 13:03:49.508129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.631599 (+123470us) service_pool.cc:224] Handling call
0709 13:03:52.166733 (+2535134us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540018bd54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:52.167888 (+  1155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2478352128}
I20260709 13:03:52.191972 12543 rpcz_store.cc:276] 0709 13:03:50.972492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.976433 (+  3941us) service_pool.cc:224] Handling call
0709 13:03:52.164785 (+1188352us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54002baf54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:52.165012 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":360283520}
I20260709 13:03:52.198781 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:52.199581 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:52.200379 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.200302 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:52.137595 13229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.880s	user 0.020s	sys 0.025s
I20260709 13:03:52.090248 14827 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:52.204562 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:52.206374 12688 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:03:52.173604 14870 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:52.212864 14775 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:52.213058 14931 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:03:52.213337 14854 consensus_meta.cc:287] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.694s	user 0.006s	sys 0.002s
I20260709 13:03:52.213464 14775 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:52.214095 14854 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:52.214267 14775 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:52.214979 14854 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:52.215631 14854 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:52.217785 14681 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:52.217842 14775 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:52.218146 13228 consensus_meta.cc:287] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.634s	user 0.007s	sys 0.003s
I20260709 13:03:52.248805 13228 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:03:52.217835 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:52.248073 14775 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:52.250260 14775 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:52.251078 12620 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:52.251715 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 393) took 2137 ms. Trace:
I20260709 13:03:52.251963 14781 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.252533 14781 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:52.252002 12620 rpcz_store.cc:276] 0709 13:03:50.114630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.116577 (+  1947us) service_pool.cc:224] Handling call
0709 13:03:52.250725 (+2134148us) spinlock_profiling.cc:243] Waited 7.62 ms on lock 0x7b58001f4198. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454e9c 00007fc3a6454a5b 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:03:52.250914 (+   189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:52.251476 (+   562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:52.251658 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17516928}
W20260709 13:03:52.213323 12690 consensus_meta.cc:287] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.038s	user 0.007s	sys 0.003s
I20260709 13:03:52.250231 12622 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
W20260709 13:03:52.207952 13229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.020s	sys 0.025s
W20260709 13:03:52.212142 14701 consensus_meta.cc:287] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.989s	user 0.007s	sys 0.003s
I20260709 13:03:52.239763 14848 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:52.205971 14822 raft_consensus.cc:3055] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:52.255981 12690 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:03:52.193161 14924 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:52.174203 14896 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:52.213554 14931 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.266361 14893 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:52.265986 12616 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:52.269793 12688 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
W20260709 13:03:52.272181 12690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 1350) took 1338 ms (client timeout 1573 ms). Trace:
I20260709 13:03:52.272524 14775 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:52.211251 14870 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.214990 14788 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:52.265863 14822 raft_consensus.cc:740] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:52.278136 13233 raft_consensus.cc:606] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:03:52.278774 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:52.281697 12622 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:03:52.275208 14615 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:52.293857 13233 raft_consensus.cc:614] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:52.299101 12620 raft_consensus.cc:1240] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:52.294250 12688 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:52.308070 12540 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.100s	user 0.024s	sys 0.009s
W20260709 13:03:52.308594 12540 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.105s	user 0.024s	sys 0.009s
I20260709 13:03:52.310077 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2467) took 1404 ms. Trace:
I20260709 13:03:52.310614 12540 rpcz_store.cc:276] 0709 13:03:50.905788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.026288 (+120500us) service_pool.cc:224] Handling call
0709 13:03:51.026610 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:51.026820 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:51.203296 (+176476us) log.cc:844] Serialized 14 byte log entry
0709 13:03:52.309405 (+1106109us) log.cc:844] Serialized 14 byte log entry
0709 13:03:52.309638 (+   233us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:52.309693 (+    55us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:52.309766 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:52.309864 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:52.310008 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60853,"prepare.queue_time_us":146608,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":13474,"thread_start_us":1193901,"threads_started":2}
W20260709 13:03:52.301326 12662 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.944s	user 0.010s	sys 0.022s
I20260709 13:03:52.274974 14917 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.276670 14931 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:52.312258 12614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.927s	user 0.037s	sys 0.082s
I20260709 13:03:52.290553 12615 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:52.237205 14937 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:52.291075 14874 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.006s	sys 0.013s
I20260709 13:03:52.294723 14870 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:52.349148 12662 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.992s	user 0.011s	sys 0.022s
I20260709 13:03:52.305423 14848 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.313268 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 500) took 1243 ms. Trace:
W20260709 13:03:52.367525 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 1.01003e+06us
W20260709 13:03:52.359165 14783 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.008s	sys 0.024s
W20260709 13:03:52.347370 14644 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.013s	sys 0.021s
W20260709 13:03:52.362965 12614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.989s	user 0.037s	sys 0.082s
I20260709 13:03:52.372934 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:52.388032 12662 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:52.299924 14788 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:52.292713 12690 rpcz_store.cc:269] 0709 13:03:50.933867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.946659 (+ 12792us) service_pool.cc:224] Handling call
0709 13:03:52.272083 (+1325424us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:52.367017 14619 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:52.376004 14874 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.342s	user 0.008s	sys 0.013s
I20260709 13:03:52.365110 14871 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.339898 14944 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:52.390879 12662 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:52.370131 14935 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:03:52.388623 14644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.013s	sys 0.022s
W20260709 13:03:52.377321 14783 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.008s	sys 0.025s
I20260709 13:03:52.393635 12688 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
I20260709 13:03:52.402585 14936 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:03:52.409946 14694 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:52.410521 14694 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:52.394176 14938 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:52.376394 14848 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:52.366501 14917 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:52.373982 14822 consensus_queue.cc:260] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:52.434231 14717 consensus_meta.cc:287] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.925s	user 0.005s	sys 0.005s
I20260709 13:03:52.434474 14936 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:52.406993 14944 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:52.405354 14871 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:52.473397 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:52.480085 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.476586 14691 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:52.459414 14938 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:52.407124 14935 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:52.510847 14781 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:03:52.523065 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.466446 14924 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:52.516523 14871 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:52.520547 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:52.521522 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:52.535002 12620 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:52.465142 14936 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:52.466666 14896 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:52.531610 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 524) took 2700 ms. Trace:
W20260709 13:03:52.532998 12618 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.180s	user 0.040s	sys 0.086s
W20260709 13:03:52.543797 12618 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.191s	user 0.040s	sys 0.086s
I20260709 13:03:52.543678 12696 rpcz_store.cc:276] 0709 13:03:49.831308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:50.292773 (+461465us) service_pool.cc:224] Handling call
0709 13:03:52.166898 (+1874125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:52.191245 (+ 24347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:52.523866 (+332621us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b540018bd50. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:52.531528 (+  7662us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4309386624}
W20260709 13:03:52.535909 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 359538us
I20260709 13:03:52.534459 12615 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:03:52.457854 14717 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:52.547752 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:52.549275 12620 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
W20260709 13:03:52.538816 12512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.268s	user 0.014s	sys 0.046s
W20260709 13:03:52.550626 12512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.280s	user 0.014s	sys 0.046s
W20260709 13:03:52.551023 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 1.28077e+06us
W20260709 13:03:52.555925 13199 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.356s	user 0.021s	sys 0.042s
W20260709 13:03:52.557792 13199 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.358s	user 0.021s	sys 0.042s
I20260709 13:03:52.563722 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:52.543524 14938 raft_consensus.cc:697] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:03:52.551929 14899 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.007s	sys 0.025s
W20260709 13:03:52.574970 14899 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.007s	sys 0.025s
I20260709 13:03:52.576081 12545 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: []
W20260709 13:03:52.577330 14882 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.483s	user 0.020s	sys 0.016s
W20260709 13:03:52.578073 13197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.025s	sys 0.010s
W20260709 13:03:52.574440 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 429960us
W20260709 13:03:52.579908 13197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.025s	sys 0.010s
I20260709 13:03:52.555089 14952 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.605659 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:52.608861 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:52.610663 13232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
W20260709 13:03:52.530663 14780 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.085s	user 0.051s	sys 0.104s
I20260709 13:03:52.611855 12688 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: []
W20260709 13:03:52.577805 14882 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.488s	user 0.020s	sys 0.017s
I20260709 13:03:52.613370 12696 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 6: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:52.619278 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:52.613858 13232 raft_consensus.cc:606] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:03:52.614971 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:52.621083 12688 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:52.647894 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:52.649094 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:52.652071 13197 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:52.653414 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:52.616263 12513 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:52.656565 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:03:52.663722 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 52633.6us
W20260709 13:03:52.697680 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 45731.5us
I20260709 13:03:52.706338 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:52.618196 14780 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.173s	user 0.051s	sys 0.104s
W20260709 13:03:52.707592 12510 leader_election.cc:336] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.607s (SENT)
I20260709 13:03:52.708442 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:52.610975 14644 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.710772 12546 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:52.718155 12688 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:52.711643 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:52.603176 14701 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.713269 12540 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 4: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:52.720119 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:52.716874 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 326041us
I20260709 13:03:52.611495 14788 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:52.724598 12662 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:52.730414 12662 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:52.730554 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:52.622524 14899 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:52.612454 14947 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:52.647770 14619 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:52.706127 14937 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:52.749934 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:52.754801 12693 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.019s	sys 0.045s
I20260709 13:03:52.746975 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:52.706439 14871 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:03:52.764112 13199 connection.cc:256] RPC call timeout handler was delayed by -1.6650051459998849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
I20260709 13:03:52.826267 14940 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:52.650144 14952 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:52.798823 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 45594.4us
W20260709 13:03:52.833508 13199 connection.cc:256] RPC call timeout handler was delayed by -1.4004051459999118s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
I20260709 13:03:52.798861 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:52.728667 14874 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:52.831007 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 89553.9us
W20260709 13:03:52.835466 13199 connection.cc:256] RPC call timeout handler was delayed by -1.2411051459998816s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
I20260709 13:03:52.756850 14939 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:52.840233 12615 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:03:52.839576 13199 connection.cc:256] RPC call timeout handler was delayed by -1.226705145999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
W20260709 13:03:52.827904 14951 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
I20260709 13:03:52.864907 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:52.865756 12688 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:03:52.801357 14937 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:52.856297 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 137863us
I20260709 13:03:52.742681 14644 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:52.830184 14548 consensus_queue.cc:1059] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 13:03:52.832885 12693 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.022s	sys 0.053s
I20260709 13:03:52.866771 13233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:03:52.870105 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:52.857985 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2558) took 1548 ms. Trace:
I20260709 13:03:52.881177 13233 raft_consensus.cc:606] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:52.835033 14935 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:52.771641 14788 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.835528 14848 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:52.839193 14874 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.862987 14893 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.755431 14899 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:52.835897 14884 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.798664 14780 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:52.371519 13229 rpcz_store.cc:276] 0709 13:03:51.069788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.086850 (+ 17062us) service_pool.cc:224] Handling call
0709 13:03:51.148566 (+ 61716us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:51.188644 (+ 40078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:51.212858 (+ 24214us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:51.256975 (+ 44117us) log.cc:844] Serialized 26 byte log entry
0709 13:03:52.274685 (+1017710us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:52.276582 (+  1897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:52.291200 (+ 14618us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:52.295084 (+  3884us) raft_consensus.cc:1685] finished
0709 13:03:52.297217 (+  2133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:52.307046 (+  9829us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17117,"raft.queue_time_us":6163,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":25423,"thread_start_us":1009970,"threads_started":1,"wal-append.queue_time_us":945308}
I20260709 13:03:52.830621 14959 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:52.773159 14619 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:52.880023 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:52.746120 14701 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:52.856596 14939 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:52.881217 12618 rpcz_store.cc:276] 0709 13:03:51.309545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.311236 (+  1691us) service_pool.cc:224] Handling call
0709 13:03:51.311608 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:51.311865 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:03:52.544962 (+1233097us) log.cc:844] Serialized 14 byte log entry
0709 13:03:52.852997 (+308035us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:52.853058 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:52.853108 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:52.853438 (+   330us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:52.857529 (+  4091us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1516693,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":99,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":1318,"thread_start_us":1499349,"threads_started":2}
I20260709 13:03:52.860985 14917 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:52.854081 14933 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:52.784160 12662 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:52.764231 14947 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:52.906270 12587 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:52.863664 14896 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:03:52.855926 14871 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:52.919661 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 135604us
I20260709 13:03:52.930649 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:52.897601 14874 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:52.838810 14940 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:52.924805 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:52.885609 14681 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:03:52.927404 12587 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:52.936168 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:52.932235 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 92694.2us
I20260709 13:03:52.934896 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:52.900614 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 191463us
I20260709 13:03:52.877218 14937 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:52.923305 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 64261.4us
I20260709 13:03:52.936085 12540 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:52.860672 14938 consensus_queue.cc:237] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:53.231758 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 52907.2us
I20260709 13:03:53.010986 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2475) took 1969 ms. Trace:
W20260709 13:03:53.015200 12616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2566) took 1697 ms (client timeout 1894 ms). Trace:
I20260709 13:03:53.003001 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:52.902578 14780 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.019119 12619 raft_consensus.cc:1217] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[5.7-5.7]   Dedup: 5.7->[]
I20260709 13:03:53.253818 12619 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:03:52.936249 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:53.254884 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:53.016968 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:53.253360 12547 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:53.258349 12543 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:03:53.256210 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:52.941161 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:53.261547 12541 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:53.261679 12688 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:52.937083 12546 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:53.262912 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:53.252378 12616 rpcz_store.cc:269] 0709 13:03:51.318262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.423644 (+105382us) service_pool.cc:224] Handling call
0709 13:03:53.015043 (+1591399us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b54001ea5d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:53.015143 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1755534592}
I20260709 13:03:53.263496 12688 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:03:53.253733 12545 rpcz_store.cc:276] 0709 13:03:51.041464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.476563 (+435099us) service_pool.cc:224] Handling call
0709 13:03:51.476965 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:52.576516 (+1099551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:53.010749 (+434233us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54003ab454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:53.010928 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2527168896}
W20260709 13:03:53.030236 12662 connection.cc:256] RPC call timeout handler was delayed by -2.0000187309999546s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
I20260709 13:03:53.074389 13232 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:53.264268 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:53.260933 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:53.315024 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:52.973325 14954 log.cc:927] Time spent T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.258s	user 0.002s	sys 0.000s
I20260709 13:03:52.930917 14933 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:53.442374 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:53.443398 12547 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:53.444301 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:52.899356 14788 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:53.008265 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:53.445497 12621 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:53.446643 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:53.448426 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:53.269433 14780 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:53.021795 14927 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:53.453971 14927 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:53.455778 12543 raft_consensus.cc:2410] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:53.017916 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:53.458451 14969 log.cc:927] Time spent T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260709 13:03:53.437409 12688 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
W20260709 13:03:53.459803 14957 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.605s	user 0.000s	sys 0.001s
I20260709 13:03:53.459815 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:53.462236 14788 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:53.439880 14940 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:52.919731 14884 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:52.903347 14962 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:52.990674 14960 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:03:53.458398 13226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 501) took 2388 ms (client timeout 1576 ms). Trace:
I20260709 13:03:53.021639 14548 raft_consensus.cc:3055] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:53.090129 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:53.478622 12615 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:53.472131 12618 raft_consensus.cc:2393] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 6: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:03:53.165350 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.454007 12512 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:53.481334 12512 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:53.457113 14927 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:53.012951 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:03:53.473701 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:52.900048 14848 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:53.516063 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:53.523068 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:53.524667 12618 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:53.233633 14943 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.020825 14944 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:52.905262 14893 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:53.478248 14548 raft_consensus.cc:740] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:53.468082 14962 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:53.522315 14927 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:03:53.498445 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.074334 14775 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:53.231843 14946 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:52.921142 14939 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:52.931089 14930 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:52.928016 14959 raft_consensus.cc:697] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 4 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:53.006896 14947 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:53.478016 13226 rpcz_store.cc:269] 0709 13:03:51.070133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.086756 (+ 16623us) service_pool.cc:224] Handling call
0709 13:03:53.017757 (+1931001us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b58000f6398. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae53f0a0 00007fc3ae53e984 00007fc3a7ab96d4 00007fc3a7ab9662
0709 13:03:53.458285 (+440528us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41004416}
I20260709 13:03:53.488487 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:53.470117 14935 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:53.594384 13235 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:03:53.009814 14899 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:53.525794 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:53.567492 14944 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.016778 14952 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:53.020931 14701 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:53.019074 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 412) took 1947 ms. Trace:
I20260709 13:03:53.011281 14871 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:53.008306 14619 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:53.540669 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:53.500998 14882 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:53.435227 13199 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
W20260709 13:03:53.641265 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 206185us
I20260709 13:03:53.014983 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:53.490782 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:53.648527 12662 connection.cc:256] RPC call timeout handler was delayed by -1.5766604850000476s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21520000000000003s for a response
I20260709 13:03:53.399564 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:53.649717 12616 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:53.517091 12541 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
W20260709 13:03:53.481442 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:53.553901 13234 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.025s	sys 0.079s
W20260709 13:03:53.651841 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:53.651891 13234 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.026s	sys 0.079s
W20260709 13:03:53.652663 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:53.545101 14783 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.056s	sys 0.131s
I20260709 13:03:53.527441 14848 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:53.559149 14931 consensus_meta.cc:287] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.185s	user 0.007s	sys 0.004s
I20260709 13:03:53.500685 14960 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:53.580278 12622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.043s	sys 0.064s
W20260709 13:03:53.661988 12622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.043s	sys 0.065s
I20260709 13:03:53.559623 14927 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:53.600669 12618 raft_consensus.cc:2410] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:53.663067 14927 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:53.663354 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1487) took 1115 ms. Trace:
I20260709 13:03:53.663770 12618 rpcz_store.cc:276] 0709 13:03:52.547603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.525491 (+977888us) service_pool.cc:224] Handling call
0709 13:03:53.663286 (+137795us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:53.664803 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:53.665620 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1492) took 1117 ms. Trace:
I20260709 13:03:53.665953 12618 rpcz_store.cc:276] 0709 13:03:52.548666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.664527 (+1115861us) service_pool.cc:224] Handling call
0709 13:03:53.665541 (+  1014us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:53.666863 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:53.667505 12618 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:53.667968 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1497) took 1118 ms. Trace:
I20260709 13:03:53.668288 12618 rpcz_store.cc:276] 0709 13:03:52.549417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.666600 (+1117183us) service_pool.cc:224] Handling call
0709 13:03:53.667914 (+  1314us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:52.975157 14717 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:53.577482 14930 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.670130 14930 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:53.671602 14927 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:53.604081 14934 consensus_meta.cc:287] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 1.399s	user 0.013s	sys 0.000s
I20260709 13:03:53.603626 14548 consensus_queue.cc:260] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:53.586920 14971 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:53.674228 14971 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.674583 14548 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:53.543306 14943 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:53.630491 13235 raft_consensus.cc:1240] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:53.677477 14943 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:53.678102 14943 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:53.669268 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:53.656550 14783 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.056s	sys 0.131s
I20260709 13:03:53.680464 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:53.597743 14935 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.569092 14775 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:53.624840 14889 consensus_meta.cc:287] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 1.417s	user 0.009s	sys 0.005s
I20260709 13:03:53.609922 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1269) took 2036 ms. Trace:
W20260709 13:03:53.548806 14911 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.091s	sys 0.180s
I20260709 13:03:53.715085 12544 raft_consensus.cc:2410] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:03:53.623221 14851 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.014s	sys 0.033s
I20260709 13:03:53.673892 14934 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:53.674697 14971 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:53.582366 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:53.572567 14946 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:53.660290 13199 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:53.704697 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1491) took 1156 ms. Trace:
I20260709 13:03:53.735204 12618 rpcz_store.cc:276] 0709 13:03:52.548428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.680077 (+1131649us) service_pool.cc:224] Handling call
0709 13:03:53.704585 (+ 24508us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:53.719877 14911 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.092s	sys 0.181s
I20260709 13:03:53.695933 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:53.708299 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:53.656985 14788 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.640237 14882 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:53.710950 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:53.694706 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.741721 13235 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:53.626649 14944 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:53.719005 14717 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:53.726783 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 476664us
I20260709 13:03:53.704789 14935 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:53.735919 12616 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:03:53.633697 14952 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:03:53.737471 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 77298.8us
I20260709 13:03:53.754348 13199 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:53.725364 14851 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.015s	sys 0.033s
I20260709 13:03:53.755518 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:53.757021 14717 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:53.743647 14882 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:53.762895 14775 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:53.764808 14946 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:53.720494 14870 consensus_meta.cc:287] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 1.344s	user 0.009s	sys 0.004s
I20260709 13:03:53.765750 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:53.765890 14870 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:53.766503 12616 raft_consensus.cc:2393] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 3: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:53.766918 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1495) took 1217 ms. Trace:
I20260709 13:03:53.767191 12616 rpcz_store.cc:276] 0709 13:03:52.549123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.756253 (+1207130us) service_pool.cc:224] Handling call
0709 13:03:53.766864 (+ 10611us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:53.768105 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:53.768990 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1493) took 1220 ms. Trace:
I20260709 13:03:53.770468 12616 rpcz_store.cc:276] 0709 13:03:52.548837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.767809 (+1218972us) service_pool.cc:224] Handling call
0709 13:03:53.768942 (+  1133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:53.684998 14644 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:53.679718 14943 consensus_queue.cc:1059] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:03:53.743733 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:53.741549 14980 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:53.752754 13197 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:53.741145 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:53.762993 14944 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:53.635139 14780 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:53.794240 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:53.725345 13229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.037s	sys 0.066s
W20260709 13:03:53.771554 12587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.017s	sys 0.043s
W20260709 13:03:53.796365 12587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.017s	sys 0.043s
W20260709 13:03:53.796789 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 869445us
I20260709 13:03:53.797905 12587 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:53.682703 14848 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:53.657593 14896 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:53.773859 12615 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
W20260709 13:03:53.754642 14936 consensus_meta.cc:287] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.198s	user 0.006s	sys 0.006s
I20260709 13:03:53.792900 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:03:53.734627 14930 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
W20260709 13:03:53.800252 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 47577.6us
I20260709 13:03:53.802227 13235 raft_consensus.cc:606] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:03:53.804277 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 420) took 1174 ms. Trace:
I20260709 13:03:53.806198 12618 rpcz_store.cc:276] 0709 13:03:52.630143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.774192 (+1144049us) service_pool.cc:224] Handling call
0709 13:03:53.803565 (+ 29373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:53.803810 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:53.803846 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:53.803907 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:53.803966 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:53.804043 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:53.804203 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:53.802235 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 419) took 1174 ms. Trace:
I20260709 13:03:53.808224 12615 rpcz_store.cc:276] 0709 13:03:52.627369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.990543 (+363174us) service_pool.cc:224] Handling call
0709 13:03:53.802148 (+811605us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:53.774441 14870 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:53.680797 14931 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:53.740672 14959 consensus_queue.cc:237] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:53.820223 14848 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:53.632192 12614 rpcz_store.cc:276] 0709 13:03:51.071506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.086792 (+ 15286us) service_pool.cc:224] Handling call
0709 13:03:51.163390 (+ 76598us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:51.224661 (+ 61271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:51.240060 (+ 15399us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:51.308485 (+ 68425us) log.cc:844] Serialized 52 byte log entry
0709 13:03:52.404843 (+1096358us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:52.408207 (+  3364us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:52.415230 (+  7023us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:53.018808 (+603578us) raft_consensus.cc:1685] finished
0709 13:03:53.018835 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:53.019011 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":78794,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91,"thread_start_us":1013267,"threads_started":1,"wal-append.queue_time_us":1186004}
W20260709 13:03:53.823271 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.823367 12587 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:53.751035 14788 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:53.802521 13229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.037s	sys 0.067s
I20260709 13:03:53.775544 14980 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:53.778419 14937 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:53.828465 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 72519.3us
W20260709 13:03:53.830499 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:53.805970 14938 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:53.758277 14952 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:53.805599 14896 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:53.836290 12688 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:53.873224 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 421) took 1242 ms. Trace:
I20260709 13:03:53.878881 12616 rpcz_store.cc:276] 0709 13:03:52.631290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.828377 (+1197087us) service_pool.cc:224] Handling call
0709 13:03:53.872499 (+ 44122us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:53.872745 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:53.872786 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:53.872849 (+    63us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:53.872899 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:53.872984 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:53.873144 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:53.880959 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:53.874814 12696 raft_consensus.cc:2368] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6.
I20260709 13:03:53.883050 12616 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:03:53.885005 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:53.886626 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:53.824469 14944 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.858860 14871 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:03:53.829329 14962 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:53.820943 14851 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260709 13:03:53.872282 14909 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:53.887861 14896 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:53.829813 14848 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:53.935815 12616 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:53.776891 14874 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:53.935534 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:53.960950 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 94961.2us
I20260709 13:03:53.961592 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:53.962437 12616 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:53.961797 14946 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.963275 14946 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:53.965031 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 423) took 1330 ms. Trace:
I20260709 13:03:53.965735 14946 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:53.965500 12616 rpcz_store.cc:276] 0709 13:03:52.634440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.963321 (+1328881us) service_pool.cc:224] Handling call
0709 13:03:53.963618 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:53.963803 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:53.963831 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:53.963876 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:53.963920 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:53.964058 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:53.964968 (+   910us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:53.967859 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 424) took 1263 ms. Trace:
I20260709 13:03:53.968623 12616 rpcz_store.cc:276] 0709 13:03:52.704984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.966803 (+1261819us) service_pool.cc:224] Handling call
0709 13:03:53.967178 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:53.967413 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:53.967438 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:53.967487 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:53.967553 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:53.967631 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:53.967773 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:53.959223 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 204937us
I20260709 13:03:53.888289 14701 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:53.970975 13199 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:53.970820 14701 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:53.959223 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 91864.4us
I20260709 13:03:53.818732 14936 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:53.973683 14701 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:53.871743 14870 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:53.919155 14988 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:53.870028 14980 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:53.925740 14893 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:53.888650 14986 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 13:03:53.926281 14938 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:53.927258 14944 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:53.931649 14871 raft_consensus.cc:697] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:53.993454 13232 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 4: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:53.975901 14848 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:53.999245 12662 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:53.988574 14870 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:53.714807 12693 rpcz_store.cc:276] 0709 13:03:51.573801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.576888 (+  3087us) service_pool.cc:224] Handling call
0709 13:03:52.014914 (+438026us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:52.108367 (+ 93453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:52.128713 (+ 20346us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:52.254005 (+125292us) log.cc:844] Serialized 52 byte log entry
0709 13:03:52.925421 (+671416us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:52.966067 (+ 40646us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:53.060676 (+ 94609us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:53.609632 (+548956us) raft_consensus.cc:1685] finished
0709 13:03:53.609662 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:53.609848 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38085,"raft.queue_time_us":29839,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":51708,"thread_start_us":627686,"threads_started":1,"wal-append.queue_time_us":1241076}
I20260709 13:03:53.989136 12690 raft_consensus.cc:2410] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:03:53.990630 14681 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:54.011535 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 779) took 1076 ms. Trace:
I20260709 13:03:54.062860 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:54.088259 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 103483us
I20260709 13:03:54.091681 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:54.092521 12695 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:03:54.011067 14934 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:54.018421 14982 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 13:03:54.056794 14983 log.cc:927] Time spent T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:03:54.021180 14944 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:03:54.019167 14978 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 13:03:54.057140 14931 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:54.019783 14938 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:54.066125 14870 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:54.015882 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 422) took 1379 ms. Trace:
I20260709 13:03:54.219177 12614 rpcz_store.cc:276] 0709 13:03:52.633634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.868134 (+1234500us) service_pool.cc:224] Handling call
0709 13:03:53.933606 (+ 65472us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:53.982951 (+ 49345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:53.984358 (+  1407us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:53.990267 (+  5909us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:53.992784 (+  2517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.003885 (+ 11101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.012948 (+  9063us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:54.221733 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:54.223027 12614 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
W20260709 13:03:54.199522 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.227566 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:54.228761 12614 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:03:54.018756 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:54.230417 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:54.230723 12693 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:03:54.231429 12614 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:54.231608 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 542) took 1504 ms. Trace:
I20260709 13:03:54.232160 12693 rpcz_store.cc:276] 0709 13:03:52.726863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.018404 (+1291541us) service_pool.cc:224] Handling call
0709 13:03:54.231474 (+213070us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:54.200771 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 201403us
I20260709 13:03:54.061426 14681 raft_consensus.cc:697] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:54.234496 12662 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:54.235625 14681 consensus_queue.cc:237] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:54.202888 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:54.207141 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 236099us
W20260709 13:03:54.065846 13228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 768) took 5053 ms (client timeout 1779 ms). Trace:
W20260709 13:03:54.208194 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.208645 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 782) took 1204 ms. Trace:
I20260709 13:03:54.121479 14788 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:54.089814 13229 rpcz_store.cc:276] 0709 13:03:52.935573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.973533 (+ 37960us) service_pool.cc:224] Handling call
0709 13:03:53.011974 (+ 38441us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:03:53.012483 (+   509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:53.012517 (+    34us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:03:53.013329 (+   812us) log.cc:844] Serialized 78 byte log entry
0709 13:03:53.859398 (+846069us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:54.007124 (+147726us) log.cc:844] Serialized 14 byte log entry
0709 13:03:54.011201 (+  4077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.011290 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:54.011331 (+    41us) raft_consensus.cc:1685] finished
0709 13:03:54.011343 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.011482 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3780,"prepare.queue_time_us":115707,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":3153,"raft.queue_time_us":18114,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":185,"thread_start_us":930448,"threads_started":2,"wal-append.queue_time_us":914720}
I20260709 13:03:54.252607 14911 raft_consensus.cc:3055] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:03:54.252113 14944 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:03:54.252950 13199 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:54.193266 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2574) took 1895 ms. Trace:
I20260709 13:03:54.253692 12622 rpcz_store.cc:276] 0709 13:03:52.297991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.298167 (+   176us) service_pool.cc:224] Handling call
0709 13:03:52.299432 (+  1265us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:52.299884 (+   452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:52.299927 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:53.006328 (+706401us) spinlock_profiling.cc:243] Waited 51.6 ms on lock 0x7b2c0004c3c8. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:03:53.006995 (+   667us) log.cc:844] Serialized 52 byte log entry
0709 13:03:53.662564 (+655569us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:53.662629 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:53.662751 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:54.191373 (+528622us) raft_consensus.cc:1685] finished
0709 13:03:54.191473 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.192838 (+  1365us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":16141,"spinlock_wait_cycles":118648704,"thread_start_us":655066,"threads_started":1,"wal-append.queue_time_us":797866}
I20260709 13:03:54.255687 12695 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:54.114430 14871 consensus_queue.cc:237] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:54.257484 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:54.258477 12695 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:03:54.249132 13234 rpcz_store.cc:276] 0709 13:03:53.003800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.005640 (+  1840us) service_pool.cc:224] Handling call
0709 13:03:53.006149 (+   509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:53.006529 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:53.006556 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:53.007591 (+  1035us) log.cc:844] Serialized 564 byte log entry
0709 13:03:53.652682 (+645091us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:53.652760 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:53.652869 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:54.207952 (+555083us) raft_consensus.cc:1685] finished
0709 13:03:54.207999 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.208358 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":644747,"threads_started":1,"wal-append.queue_time_us":746175}
I20260709 13:03:54.238106 14552 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:54.259509 14552 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.259850 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:54.260908 12695 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:03:54.065850 14882 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:54.265093 14882 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:54.130290 14993 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:54.267282 13199 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:54.151674 14952 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:54.148397 14998 log.cc:927] Time spent T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:03:54.016595 15001 consensus_queue.cc:1059] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.114s
I20260709 13:03:54.269866 15001 consensus_queue.cc:1243] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Peer a70479a3b4114f3581095e9890f5d653 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:03:54.018290 15002 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:54.271507 15002 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:54.272066 14950 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:54.237068 12662 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:54.110625 15007 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:54.244287 15008 consensus_queue.cc:1059] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:03:54.285444 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 48653.3us
I20260709 13:03:54.129041 14930 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:54.245702 14936 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:54.244937 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:54.253170 14911 raft_consensus.cc:740] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:54.140784 14926 raft_consensus.cc:3055] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:54.260057 14552 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:54.160745 14971 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:54.001881 14988 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:54.140230 14992 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:54.264613 14935 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:54.242981 14874 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:54.267755 14993 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.315201 14993 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:54.156942 14997 consensus_queue.cc:1048] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:03:54.284372 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 428) took 1423 ms. Trace:
I20260709 13:03:54.308045 14848 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:54.321507 12616 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: []
I20260709 13:03:54.272688 14950 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.321746 12622 rpcz_store.cc:276] 0709 13:03:52.860095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.256434 (+1396339us) service_pool.cc:224] Handling call
0709 13:03:54.257087 (+   653us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:54.257543 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:54.274528 (+ 16985us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:54.280508 (+  5980us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:54.280578 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.282899 (+  2321us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.283087 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:54.286063 15008 consensus_queue.cc:1243] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [LEADER]: Peer a70479a3b4114f3581095e9890f5d653 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:03:54.287470 15013 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:54.251570 13228 rpcz_store.cc:269] 0709 13:03:49.012344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:49.016195 (+  3851us) service_pool.cc:224] Handling call
0709 13:03:50.726468 (+1710273us) spinlock_profiling.cc:243] Waited 6.46 ms on lock 0x7b58000f6398. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae53f0a0 00007fc3ae53e984 00007fc3a7ab96d4 00007fc3a7ab9662
0709 13:03:54.065617 (+3339149us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b540063a954. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:54.065746 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1952552064}
I20260709 13:03:54.291185 12614 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:03:54.294420 13199 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:03:54.297382 14926 raft_consensus.cc:740] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:54.302425 12545 raft_consensus.cc:1240] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 4 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:54.326013 14926 consensus_queue.cc:260] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:54.307960 15007 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:54.313630 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:54.322619 14950 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:54.323961 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:54.324530 14971 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:54.314349 14935 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:54.328523 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 52923.9us
I20260709 13:03:54.327629 15013 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:54.330013 15013 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:54.331117 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:54.329957 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:54.331670 14874 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:54.333804 14874 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:54.334736 14874 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:54.311703 14992 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:54.336349 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:54.336948 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.341243 14909 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:54.341735 15008 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:54.342190 15008 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:54.342761 15008 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:54.308471 14911 consensus_queue.cc:260] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:54.334709 14848 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:54.454211 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:54.340562 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 416) took 2752 ms. Trace:
W20260709 13:03:54.459101 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 172677us
W20260709 13:03:54.417752 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 55062.9us
I20260709 13:03:54.462581 12614 raft_consensus.cc:2368] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 2. Current term is 3.
I20260709 13:03:54.354936 12620 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:54.355942 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 1360) took 1723 ms. Trace:
I20260709 13:03:54.346952 12693 raft_consensus.cc:2393] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 3: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:54.462607 12617 rpcz_store.cc:276] 0709 13:03:51.587965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.198139 (+610174us) service_pool.cc:224] Handling call
0709 13:03:52.198448 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:52.377860 (+179412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:52.377895 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:52.377939 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:52.377983 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.340002 (+1962019us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54003d09d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:54.340068 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.340317 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":412124928}
I20260709 13:03:54.465065 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2578) took 1009 ms. Trace:
W20260709 13:03:54.394176 12696 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 1361) took 1758 ms (client timeout 1532 ms). Trace:
I20260709 13:03:54.464972 12688 rpcz_store.cc:276] 0709 13:03:52.632802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.459522 (+826720us) service_pool.cc:224] Handling call
0709 13:03:54.355450 (+895928us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b54003e9ed4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:54.355711 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":846325504}
I20260709 13:03:54.458626 15007 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:54.458173 14997 consensus_queue.cc:1059] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:03:54.478544 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:54.357321 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:54.407009 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:54.406301 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:54.444602 15017 log.cc:927] Time spent T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:03:54.468349 12622 rpcz_store.cc:276] 0709 13:03:53.453505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.341654 (+888149us) service_pool.cc:224] Handling call
0709 13:03:54.342153 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:54.343347 (+  1194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:54.343376 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:54.343445 (+    69us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:03:54.462533 (+119088us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.462613 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.462739 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":155,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":234}
I20260709 13:03:54.407547 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:54.356735 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:54.482870 14559 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:54.484333 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:54.484601 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 543) took 2938 ms. Trace:
W20260709 13:03:54.357957 12690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 1355) took 1736 ms (client timeout 2155 ms). Trace:
I20260709 13:03:54.485052 13227 rpcz_store.cc:276] 0709 13:03:51.546019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.546985 (+   966us) service_pool.cc:224] Handling call
0709 13:03:51.547414 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:52.092278 (+544864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.484085 (+2391807us) spinlock_profiling.cc:243] Waited 94.2 ms on lock 0x7b5400572954. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:54.484398 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216727936}
I20260709 13:03:54.486044 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:54.485778 12690 rpcz_store.cc:269] 0709 13:03:52.621163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.014696 (+393533us) service_pool.cc:224] Handling call
0709 13:03:54.357496 (+1342800us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54002c8b54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:54.357772 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601829248}
W20260709 13:03:54.469703 12696 rpcz_store.cc:269] 0709 13:03:52.635258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.656303 (+ 21045us) service_pool.cc:224] Handling call
0709 13:03:54.393492 (+1737189us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54001b5654. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:54.393879 (+   387us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2799367936}
I20260709 13:03:54.398283 14992 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:54.357757 14988 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:54.494256 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:54.415812 14552 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:54.408484 14950 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:54.497893 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 545) took 2951 ms. Trace:
I20260709 13:03:54.498111 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 1366) took 1047 ms. Trace:
I20260709 13:03:54.503288 12695 rpcz_store.cc:276] 0709 13:03:53.451069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.485453 (+1034384us) service_pool.cc:224] Handling call
0709 13:03:54.498012 (+ 12559us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:54.487432 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 1358) took 1859 ms. Trace:
I20260709 13:03:54.398798 14896 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:54.511577 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:54.512524 12690 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:54.413187 14980 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:54.464532 14993 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:54.514461 12587 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:54.513885 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:54.520955 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:54.505119 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:54.522224 12540 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:54.496237 14874 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:54.528780 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 48467.2us
I20260709 13:03:54.530051 12687 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:54.525741 12546 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:03:54.511090 12693 rpcz_store.cc:276] 0709 13:03:52.628410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.290906 (+1662496us) service_pool.cc:224] Handling call
0709 13:03:54.481905 (+190999us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:54.526772 14911 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:03:54.537660 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 59459.6us
I20260709 13:03:54.535807 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:54.533339 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:54.537385 12687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1271) took 2939 ms (client timeout 1508 ms). Trace:
I20260709 13:03:54.541172 12547 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:54.539182 12687 rpcz_store.cc:269] 0709 13:03:51.593879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.594037 (+   158us) service_pool.cc:224] Handling call
0709 13:03:54.405925 (+2811888us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b5800210698. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae53f0a0 00007fc3ae53e984 00007fc3a7ab96d4 00007fc3a7ab9662
0709 13:03:54.533002 (+127077us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7712640}
I20260709 13:03:54.531775 14848 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:54.545904 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:54.548156 12541 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:54.549747 14874 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:54.531806 15013 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:54.550617 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:54.552742 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 532) took 1902 ms. Trace:
I20260709 13:03:54.552954 15013 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:54.553766 12542 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:03:54.553151 12695 rpcz_store.cc:276] 0709 13:03:52.650010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.551704 (+1901694us) service_pool.cc:224] Handling call
0709 13:03:54.552167 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:54.552379 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:54.552404 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:54.552460 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:54.552507 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.552573 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.552667 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:54.555209 14896 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:54.555673 14853 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:54.555797 12695 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:54.549392 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:54.557412 14552 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:54.504125 13231 rpcz_store.cc:276] 0709 13:03:51.546803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.550970 (+  4167us) service_pool.cc:224] Handling call
0709 13:03:51.551410 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:52.098319 (+546909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.486696 (+2388377us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b5400578854. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:54.497685 (+ 10989us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1063666944}
I20260709 13:03:54.568960 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 534) took 1850 ms. Trace:
I20260709 13:03:54.549397 14822 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:54.568631 14852 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.571516 14852 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:54.574046 14852 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:54.574270 14932 log.cc:927] Time spent T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 2.252s	user 0.001s	sys 0.012s
I20260709 13:03:54.575748 15008 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:54.545271 14848 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:54.558198 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:54.577028 12693 raft_consensus.cc:1240] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:54.577417 12688 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
I20260709 13:03:54.576567 14993 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:54.570853 12695 rpcz_store.cc:276] 0709 13:03:52.711725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.555148 (+1843423us) service_pool.cc:224] Handling call
0709 13:03:54.555515 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:54.561809 (+  6294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.562067 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:54.580864 15018 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:03:54.583290 12688 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:03:54.568694 14915 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:54.585029 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 539) took 1863 ms. Trace:
I20260709 13:03:54.586122 12688 rpcz_store.cc:276] 0709 13:03:52.721342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.578251 (+1856909us) service_pool.cc:224] Handling call
0709 13:03:54.582772 (+  4521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:54.584797 (+  2025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.584978 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:54.579540 14848 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:54.591382 14939 consensus_meta.cc:287] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.011s	user 0.015s	sys 0.005s
I20260709 13:03:54.592167 14939 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:54.577435 14933 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:54.595062 14939 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:54.595902 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:54.603696 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:54.651777 14552 consensus_queue.cc:1048] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:54.653182 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 429) took 1628 ms. Trace:
I20260709 13:03:54.610124 12695 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:03:54.606886 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:54.653591 12613 rpcz_store.cc:276] 0709 13:03:53.024815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.336869 (+1312054us) service_pool.cc:224] Handling call
0709 13:03:54.338097 (+  1228us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:54.338681 (+   584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:54.338712 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:54.339285 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 13:03:54.523194 (+183909us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:54.523249 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.525957 (+  2708us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:54.652851 (+126894us) raft_consensus.cc:1685] finished
0709 13:03:54.652871 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.653003 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":467,"raft.queue_time_us":3747,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":5251,"thread_start_us":62842,"threads_started":1,"wal-append.queue_time_us":243005}
I20260709 13:03:54.654930 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:54.653782 12695 pending_rounds.cc:85] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 6
I20260709 13:03:54.656157 12695 pending_rounds.cc:107] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:03:54.656313 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:54.656713 12695 raft_consensus.cc:2889] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:54.656949 14927 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:54.657544 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 540) took 1935 ms. Trace:
I20260709 13:03:54.658025 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:54.658442 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:54.659066 12617 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 4: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:54.660245 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:54.660923 13231 raft_consensus.cc:2393] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 4: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:54.661285 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 531) took 2051 ms. Trace:
I20260709 13:03:54.661775 12693 rpcz_store.cc:276] 0709 13:03:52.609967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.547059 (+1937092us) service_pool.cc:224] Handling call
0709 13:03:54.547490 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:54.577478 (+ 29988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.660989 (+ 83511us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b5400250154. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:54.661196 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67390848}
I20260709 13:03:54.663686 12693 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:54.664286 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 545) took 1892 ms. Trace:
I20260709 13:03:54.664386 12547 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:03:54.664681 12693 rpcz_store.cc:276] 0709 13:03:52.771638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.662779 (+1891141us) service_pool.cc:224] Handling call
0709 13:03:54.663263 (+   484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:54.664037 (+   774us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.664209 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:54.665781 14552 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:54.666983 15008 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:54.667184 12541 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:03:54.618988 15001 raft_consensus.cc:3055] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:54.629320 14780 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:54.668013 15001 raft_consensus.cc:740] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:54.616850 14882 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:54.625295 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2567) took 3306 ms. Trace:
W20260709 13:03:54.629894 15020 log.cc:927] Time spent T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:03:54.670149 12621 rpcz_store.cc:276] 0709 13:03:51.318565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.520825 (+202260us) service_pool.cc:224] Handling call
0709 13:03:52.853583 (+1332758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:53.446061 (+592478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.624041 (+1177980us) spinlock_profiling.cc:243] Waited 591 ms on lock 0x7b54002954d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:54.624832 (+   791us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54002954d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:54.625089 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4393188992}
I20260709 13:03:54.630759 13234 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:54.688359 12540 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:03:54.632185 13228 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:54.633023 13226 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:54.633378 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:54.624514 12546 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:54.610944 14959 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:54.617463 14925 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.636508 12542 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:54.647734 14884 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:54.648001 14694 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:54.649139 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.670059 14980 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:54.614426 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:54.667397 14958 raft_consensus.cc:993] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: : Instructing follower a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:03:54.601325 12659 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:54.657955 12695 rpcz_store.cc:276] 0709 13:03:52.722492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.579090 (+1856598us) service_pool.cc:224] Handling call
0709 13:03:54.589125 (+ 10035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:54.657282 (+ 68157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.657465 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:54.665438 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:54.692605 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:54.702226 12541 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:54.696295 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:54.652012 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:54.708040 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:54.708192 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 107034us
I20260709 13:03:54.708853 12542 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:54.710033 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:54.710712 12542 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:54.711848 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:54.702152 14959 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:54.713932 14993 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:54.706218 14925 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:54.714494 14993 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.714884 14993 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:54.716106 14959 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:54.716718 14884 consensus_queue.cc:1059] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:54.716985 14925 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:54.717749 14884 raft_consensus.cc:3055] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:54.718226 14884 raft_consensus.cc:740] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:54.719214 14884 consensus_queue.cc:260] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:54.721472 12540 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:54.720445 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:54.726315 12615 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 4: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:54.729595 12546 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:54.732645 12662 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:54.748093 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:54.748157 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:54.724637 14884 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:54.728368 13227 raft_consensus.cc:1240] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:54.698985 14882 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:54.744920 14939 consensus_queue.cc:1059] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:03:54.755409 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:54.763062 12547 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:03:54.768326 12541 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:54.766960 12659 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:54.772130 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:54.776661 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:54.785923 12662 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:54.792680 14940 raft_consensus.cc:1081] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Signalling peer a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:03:54.777539 14925 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:54.757102 15001 consensus_queue.cc:260] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:54.788578 14552 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:54.805676 12692 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:03:54.805855 14552 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.806526 14552 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:54.807440 14939 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:03:54.807768 12692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 1369) took 1355 ms (client timeout 1780 ms). Trace:
W20260709 13:03:54.808158 12692 rpcz_store.cc:269] 0709 13:03:53.452063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.708051 (+255988us) service_pool.cc:224] Handling call
0709 13:03:54.807556 (+1099505us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b540016f3d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:54.807716 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2218384640}
I20260709 13:03:54.809372 15003 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.809968 15003 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:54.813936 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 546) took 1981 ms. Trace:
I20260709 13:03:54.814523 12693 rpcz_store.cc:276] 0709 13:03:52.832258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.687565 (+1855307us) service_pool.cc:224] Handling call
0709 13:03:54.753026 (+ 65461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:54.790526 (+ 37500us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:54.791580 (+  1054us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:54.798959 (+  7379us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:03:54.802036 (+  3077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.813698 (+ 11662us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.813850 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:54.791270 14822 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:54.816334 14822 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.816730 14822 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:54.818748 14993 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:54.817595 15001 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:54.821121 14993 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:54.794108 14959 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.821835 14943 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:54.822283 14959 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:54.822651 14943 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:54.824782 14959 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:54.794379 15008 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:54.803714 15022 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:03:54.801194 12659 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:54.775034 14915 consensus_queue.cc:1059] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:03:54.828361 12617 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:54.845814 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:54.851445 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 63607.4us
I20260709 13:03:54.830521 15008 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:03:54.855052 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 43513.4us
I20260709 13:03:54.813361 14848 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:54.843050 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:54.857154 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:54.869270 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:54.875126 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:54.882129 12692 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:03:54.882491 12659 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:54.857211 15013 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:54.857524 15008 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:54.890189 12546 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:03:54.894621 12613 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:54.894464 12694 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:03:54.868731 14943 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:54.897960 12617 raft_consensus.cc:2410] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:03:54.849553 14925 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:54.888820 15013 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:54.886847 13226 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:54.900847 12615 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:03:54.909322 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:54.912580 13228 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 13:03:54.931708 13228 pending_rounds.cc:85] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Aborting all ops after (but not including) 4
I20260709 13:03:54.932235 13228 pending_rounds.cc:107] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 4.5
I20260709 13:03:54.932687 13228 raft_consensus.cc:2917] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted by new leader
I20260709 13:03:54.932916 12540 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
W20260709 13:03:54.934243 15024 log.cc:927] Time spent T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:03:54.934995 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:54.935848 12540 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 6: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:54.936689 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:54.937060 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1359) took 2307 ms. Trace:
I20260709 13:03:54.937681 14915 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:54.937997 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 535) took 2192 ms. Trace:
I20260709 13:03:54.938211 14915 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:54.938668 14915 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:54.938472 12690 rpcz_store.cc:276] 0709 13:03:52.717247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.568852 (+1851605us) service_pool.cc:224] Handling call
0709 13:03:54.614182 (+ 45330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:54.614511 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:54.788385 (+173874us) log.cc:844] Serialized 14 byte log entry
0709 13:03:54.909401 (+121016us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:54.909447 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:54.909498 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.909601 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.909724 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2150,"prepare.queue_time_us":280353,"raft.queue_time_us":5636,"spinlock_wait_cycles":16750336,"thread_start_us":224940,"threads_started":2}
I20260709 13:03:54.931474 12659 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:54.941956 12659 leader_election.cc:400] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 2. Current term is 3.
I20260709 13:03:54.942047 14992 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:54.942315 12659 leader_election.cc:403] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:03:54.942850 14992 raft_consensus.cc:697] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:54.910204 12693 raft_consensus.cc:1240] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:54.943378 15007 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:54.944343 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1279) took 1112 ms. Trace:
I20260709 13:03:54.944119 14992 consensus_queue.cc:237] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:54.944785 12693 rpcz_store.cc:276] 0709 13:03:53.832329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.815758 (+983429us) service_pool.cc:224] Handling call
0709 13:03:54.893790 (+ 78032us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:54.944029 (+ 50239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.944283 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:54.945302 14783 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:54.945926 14783 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:54.949245 14939 consensus_queue.cc:1059] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:54.950510 14939 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:54.950840 14848 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:54.951561 14825 raft_consensus.cc:3055] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:54.952862 15007 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 2. Current term is 3.
I20260709 13:03:54.955345 14825 raft_consensus.cc:740] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:54.956321 14825 consensus_queue.cc:260] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:54.957352 14825 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:54.937335 12540 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:54.959088 14925 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:54.960278 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:54.961576 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:03:54.962136 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:54.962272 12617 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:54.965932 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:54.966521 12690 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:54.968042 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:54.953483 14686 consensus_queue.cc:1059] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:03:54.951556 13233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 786) took 1883 ms. Trace:
I20260709 13:03:54.977005 12659 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:54.979923 12690 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:03:54.980760 13234 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
I20260709 13:03:54.972528 13233 rpcz_store.cc:276] 0709 13:03:53.005004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.501392 (+1496388us) service_pool.cc:224] Handling call
0709 13:03:54.512186 (+ 10794us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:54.512740 (+   554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:54.512770 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:54.513476 (+   706us) log.cc:844] Serialized 26 byte log entry
0709 13:03:54.581851 (+ 68375us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:54.581903 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.582053 (+   150us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:54.888437 (+306384us) raft_consensus.cc:1685] finished
0709 13:03:54.888455 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.888571 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":67846,"threads_started":1,"wal-append.queue_time_us":182718}
I20260709 13:03:54.983325 12692 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:37280
I20260709 13:03:54.983665 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:54.984068 12692 raft_consensus.cc:606] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Received request to transfer leadership
I20260709 13:03:54.959088 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:54.984496 12692 raft_consensus.cc:614] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:03:54.984256 12546 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:54.986106 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:54.986250 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:54.986822 12615 raft_consensus.cc:2376] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5. Re-sending same reply.
I20260709 13:03:54.987776 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:54.988867 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:54.907703 15013 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:54.985033 12692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:37280 (request call id 86) took 1325 ms. Trace:
I20260709 13:03:54.991909 14882 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:54.992053 14717 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:54.989507 12615 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 5: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:54.913197 14945 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:54.933420 13228 raft_consensus.cc:2889] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:54.961602 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:54.993444 12692 rpcz_store.cc:276] 0709 13:03:53.688652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.901667 (+1213015us) service_pool.cc:224] Handling call
0709 13:03:54.984928 (+ 83261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:54.998345 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:54.994434 14552 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:54.989812 14686 raft_consensus.cc:3055] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:55.001199 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:54.957387 14822 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:55.009711 14686 raft_consensus.cc:740] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:55.011090 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:55.012070 12539 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:55.012648 13226 raft_consensus.cc:2410] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:03:55.013800 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:55.014506 13233 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:55.014746 14997 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:55.015558 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:55.016734 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:54.909648 14927 consensus_queue.cc:1059] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 13:03:55.019652 14552 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:55.020828 13197 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:03:55.021888 13227 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 6: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:55.022014 14927 consensus_queue.cc:1243] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:03:55.022214 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:55.022794 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:55.023514 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:55.024024 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:55.024755 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:55.026127 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 55390.5us
I20260709 13:03:55.013221 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:55.026825 12659 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:55.027122 12539 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:55.003384 12546 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
I20260709 13:03:55.029278 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:55.022621 14927 raft_consensus.cc:3055] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:54.937461 12687 rpcz_store.cc:276] 0709 13:03:52.629231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.549522 (+1920291us) service_pool.cc:224] Handling call
0709 13:03:54.549964 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:54.550579 (+   615us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:54.550615 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:54.551253 (+   638us) log.cc:844] Serialized 26 byte log entry
0709 13:03:54.748974 (+197721us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:54.900729 (+151755us) log.cc:844] Serialized 14 byte log entry
0709 13:03:54.906842 (+  6113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:54.906944 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:54.936845 (+ 29901us) raft_consensus.cc:1685] finished
0709 13:03:54.936863 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:54.936984 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5756,"prepare.queue_time_us":187124,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":8582,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":21134,"thread_start_us":326932,"threads_started":2,"wal-append.queue_time_us":246166}
I20260709 13:03:55.032207 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:55.021400 14953 log.cc:927] Time spent T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 2.700s	user 0.001s	sys 0.013s
I20260709 13:03:55.042119 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:55.043239 12615 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 5: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:55.045998 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:55.025395 13230 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
I20260709 13:03:55.052871 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:55.038182 14911 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:55.053792 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:55.055784 13234 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:03:55.033208 14927 raft_consensus.cc:740] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:55.062471 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:55.057133 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:55.059937 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:55.064316 12617 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:55.045010 14552 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:55.065191 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:55.044133 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:55.059522 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:55.030507 14783 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:55.070101 12692 raft_consensus.cc:2368] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 4. Current term is 5.
I20260709 13:03:55.068948 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:55.070305 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:55.071329 12615 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:55.071152 12687 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:03:55.038998 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:55.073969 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:55.058492 13231 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:55.070188 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:55.077279 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:55.077997 12538 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:55.063184 14911 raft_consensus.cc:697] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:55.067469 14822 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:55.081887 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1280) took 1248 ms. Trace:
I20260709 13:03:55.084607 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:55.083096 12689 raft_consensus.cc:2393] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:55.083016 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:55.082593 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:55.085703 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 1367) took 1634 ms. Trace:
I20260709 13:03:55.085213 12696 rpcz_store.cc:276] 0709 13:03:53.833244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.052138 (+1218894us) service_pool.cc:224] Handling call
0709 13:03:55.081830 (+ 29692us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:55.084607 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:55.086110 12689 rpcz_store.cc:276] 0709 13:03:53.451412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.051897 (+1600485us) service_pool.cc:224] Handling call
0709 13:03:55.085610 (+ 33713us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:55.087499 12692 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:03:55.088517 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 49673.5us
I20260709 13:03:55.093432 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2565) took 3752 ms. Trace:
I20260709 13:03:55.093817 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:55.093993 12619 rpcz_store.cc:276] 0709 13:03:51.317992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.502446 (+184454us) service_pool.cc:224] Handling call
0709 13:03:53.018981 (+1516535us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:53.254305 (+235324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.055109 (+1800804us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54001ca550. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:55.069893 (+ 14784us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3486781824}
W20260709 13:03:55.097884 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.091540 13227 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:03:55.090888 12588 connection.cc:256] RPC call timeout handler was delayed by -1.2381193890000759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1817s for a response
W20260709 13:03:55.100786 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 44479.7us
I20260709 13:03:55.104931 12617 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:55.072190 14686 consensus_queue.cc:260] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:55.112064 14686 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:55.116492 14947 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:55.117947 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:55.118772 12546 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:55.097796 12693 raft_consensus.cc:2410] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:55.121925 12690 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:55.123129 12539 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:55.123987 12659 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:03:55.117111 14947 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:55.140950 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:55.137812 12587 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:55.142625 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:55.149812 12692 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:55.166594 12619 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:55.168164 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:03:55.169912 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.171716 14694 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:55.172219 14694 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:55.172657 14694 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:55.172906 14871 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:55.182663 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:55.139479 14848 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:55.183435 12621 raft_consensus.cc:2376] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3. Re-sending same reply.
I20260709 13:03:55.183756 14848 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:55.184517 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:55.185242 12621 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 4: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:55.197886 12538 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:03:55.202914 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:55.200974 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:03:55.208316 12588 connection.cc:256] RPC call timeout handler was delayed by -1.3385922860001074s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3165s for a response
W20260709 13:03:55.208886 12588 connection.cc:256] RPC call timeout handler was delayed by -1.3024254889999156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
I20260709 13:03:55.170117 14927 consensus_queue.cc:260] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:55.210408 14822 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:03:55.211702 12588 connection.cc:256] RPC call timeout handler was delayed by -1.2979254889999083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
W20260709 13:03:55.213032 12588 connection.cc:256] RPC call timeout handler was delayed by -1.2898254889998952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1517s for a response
W20260709 13:03:55.213351 12588 connection.cc:256] RPC call timeout handler was delayed by -1.2826254889999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
W20260709 13:03:55.213675 12588 connection.cc:256] RPC call timeout handler was delayed by -1.248425488999942s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1563s for a response
W20260709 13:03:55.214388 12588 connection.cc:256] RPC call timeout handler was delayed by -1.2448254889999362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
W20260709 13:03:55.214742 12588 connection.cc:256] RPC call timeout handler was delayed by -1.2268254889999071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
W20260709 13:03:55.215116 12588 connection.cc:256] RPC call timeout handler was delayed by -1.2268254889999071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
W20260709 13:03:55.215463 12588 connection.cc:256] RPC call timeout handler was delayed by -1.1449254889998883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
W20260709 13:03:55.216480 12588 connection.cc:256] RPC call timeout handler was delayed by -1.1017254889999322s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
W20260709 13:03:55.216864 12588 connection.cc:256] RPC call timeout handler was delayed by -1.1017254889999322s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
W20260709 13:03:55.217665 12588 connection.cc:256] RPC call timeout handler was delayed by -1.0657254889999876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
I20260709 13:03:55.194981 14947 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:55.230918 12539 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
W20260709 13:03:55.217100 12510 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.503s (SENT) [suppressed 32 similar messages]
I20260709 13:03:55.231809 12617 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
W20260709 13:03:55.234014 15030 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:03:55.234416 14994 raft_consensus.cc:993] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:55.234935 14994 raft_consensus.cc:1081] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:03:55.235551 15008 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:55.237838 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 136121us
I20260709 13:03:55.238687 12659 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:55.239869 12696 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:55.186851 14871 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:55.240634 12659 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:03:55.247709 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 161616us
I20260709 13:03:55.247763 12689 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:55.178723 14911 consensus_queue.cc:237] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:55.249526 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 152657us
I20260709 13:03:55.250916 14927 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:55.230386 14822 raft_consensus.cc:697] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:55.253031 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:55.252821 14915 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:55.254189 12687 raft_consensus.cc:2410] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:55.255414 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:55.253405 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:55.274014 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:55.247702 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:55.277900 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 46281.7us
I20260709 13:03:55.278096 15046 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.280465 12538 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:55.253717 12541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad"
dest_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:35624
I20260709 13:03:55.284024 12541 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:55.284499 12541 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:55.286837 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.294445 12622 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:03:55.295711 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:55.296368 14960 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:55.296520 12622 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
W20260709 13:03:55.294665 14977 log.cc:927] Time spent T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 1.740s	user 0.004s	sys 0.000s
I20260709 13:03:55.298599 12622 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:03:55.301910 14545 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:55.302405 14545 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:55.302783 14545 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:55.257797 14992 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:55.305982 14992 raft_consensus.cc:697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:55.306428 12588 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:03:55.306915 12544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 479) took 2594 ms (client timeout 1652 ms). Trace:
I20260709 13:03:55.307010 14992 consensus_queue.cc:237] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:55.307687 12544 rpcz_store.cc:269] 0709 13:03:52.712342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:52.716576 (+  4234us) service_pool.cc:224] Handling call
0709 13:03:55.306334 (+2589758us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b54002cc754. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:55.306629 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2024696704}
I20260709 13:03:55.310838 15003 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:55.313927 14848 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:55.314571 14848 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:55.283141 15008 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:55.316778 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2491) took 2300 ms. Trace:
I20260709 13:03:55.320111 12620 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:55.320235 12513 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:55.321409 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:55.321730 14884 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:03:55.323179 12694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 530) took 2713 ms (client timeout 2185 ms). Trace:
I20260709 13:03:55.323359 14884 consensus_queue.cc:1059] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:03:55.323644 12694 rpcz_store.cc:269] 0709 13:03:52.609619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.016738 (+407119us) service_pool.cc:224] Handling call
0709 13:03:55.322958 (+2306220us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54002c8654. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:55.323105 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3445620096}
I20260709 13:03:55.324478 14884 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:55.324911 14884 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:55.325726 14925 raft_consensus.cc:3055] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:55.326153 14925 raft_consensus.cc:740] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:55.326784 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 425) took 2613 ms. Trace:
I20260709 13:03:55.327185 12616 rpcz_store.cc:276] 0709 13:03:52.713610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.970195 (+1256585us) service_pool.cc:224] Handling call
0709 13:03:53.976258 (+  6063us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:54.322207 (+345949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.326523 (+1004316us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b54002a71d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:55.326721 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783021952}
I20260709 13:03:55.321271 14882 consensus_queue.cc:1059] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:03:55.328372 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:55.329106 12616 raft_consensus.cc:2368] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6.
I20260709 13:03:55.329970 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:55.330559 12616 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:55.327204 14925 consensus_queue.cc:260] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:55.332919 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 53977.3us
I20260709 13:03:55.333113 14826 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:55.333482 12693 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
I20260709 13:03:55.333864 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:55.334769 12616 raft_consensus.cc:2393] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:55.301337 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:55.336052 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:55.338081 12539 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:55.326169 14780 raft_consensus.cc:3055] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:55.338713 14780 raft_consensus.cc:740] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:55.339335 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48978 (request call id 5) took 1629 ms. Trace:
I20260709 13:03:55.339701 13235 rpcz_store.cc:276] 0709 13:03:53.709685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.773494 (+ 63809us) service_pool.cc:224] Handling call
0709 13:03:55.338725 (+1565231us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b54005774a0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a94f6520 00007fc3a9573652 00007fc3ae54160a 00007fc3a7ac77d4 00007fc3a7ac7762 00007fc3a7ac7691 00007fc3a7ac760c 00007fc3a7ac68c2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:55.339087 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51345664}
I20260709 13:03:55.340670 14717 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:55.273897 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:55.342592 15027 raft_consensus.cc:3055] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:55.343010 15027 raft_consensus.cc:740] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:55.343211 13226 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:03:55.343962 15027 consensus_queue.cc:260] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:55.344588 14822 consensus_queue.cc:237] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:55.347030 15001 consensus_meta.cc:287] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.000s
I20260709 13:03:55.347486 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:55.348766 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:55.349763 14916 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.350348 14916 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:55.351958 12691 raft_consensus.cc:1275] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:03:55.352216 15032 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
I20260709 13:03:55.352586 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:55.353384 12696 raft_consensus.cc:2368] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5.
I20260709 13:03:55.353545 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1354) took 4308 ms. Trace:
I20260709 13:03:55.353921 12691 rpcz_store.cc:276] 0709 13:03:51.044931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:51.045128 (+   197us) service_pool.cc:224] Handling call
0709 13:03:51.098661 (+ 53533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:55.352343 (+4253682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.353278 (+   935us) spinlock_profiling.cc:243] Waited 4.25 s on lock 0x7b5400240254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:55.353475 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9780350720}
I20260709 13:03:55.354722 12615 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:03:55.355113 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:55.355525 14871 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:55.355803 12691 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:03:55.356163 14871 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:55.356730 14871 raft_consensus.cc:697] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 6 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:03:55.358286 12543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2497) took 2340 ms (client timeout 1964 ms). Trace:
W20260709 13:03:55.344445 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:55.358734 12543 rpcz_store.cc:269] 0709 13:03:53.017890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.260638 (+242748us) service_pool.cc:224] Handling call
0709 13:03:55.357930 (+2097292us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b5400228654. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:55.358107 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45787904}
I20260709 13:03:55.359764 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2589) took 1049 ms. Trace:
I20260709 13:03:55.273378 14993 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:55.360152 12614 rpcz_store.cc:276] 0709 13:03:54.310625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.481437 (+170812us) service_pool.cc:224] Handling call
0709 13:03:54.510660 (+ 29223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:54.549654 (+ 38994us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:54.766583 (+216929us) log.cc:844] Serialized 14 byte log entry
0709 13:03:55.341077 (+574494us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b1800154840. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a91214bc 00007fc3a646f48b 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a911923a
0709 13:03:55.341285 (+   208us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:55.341333 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:55.341392 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.341457 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:55.359702 (+ 18245us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":342496,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":6709,"spinlock_wait_cycles":2707328,"thread_start_us":322264,"threads_started":2,"wal-append.queue_time_us":199700}
I20260709 13:03:55.362869 12614 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:55.365622 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:55.366336 12613 raft_consensus.cc:2393] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:55.367017 12613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:60170
I20260709 13:03:55.367048 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:55.367631 12613 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:55.367565 15046 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:55.368211 12613 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:55.370510 12659 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:55.371392 13197 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:55.337337 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:55.339637 14780 consensus_queue.cc:260] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:55.293382 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:55.375232 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 122057us
I20260709 13:03:55.325331 14884 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:55.317312 12545 rpcz_store.cc:276] 0709 13:03:53.016372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.264224 (+247852us) service_pool.cc:224] Handling call
0709 13:03:53.264465 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:54.325810 (+1061345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:55.316360 (+990550us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54002baf54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:55.316673 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2385494400}
I20260709 13:03:55.333170 14925 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:55.345386 15027 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:55.382112 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 44635.2us
I20260709 13:03:55.380275 12512 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:55.385162 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:03:55.381057 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:55.370078 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:55.388561 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:03:55.388762 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.377621 14943 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:55.370079 15046 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:55.404057 12541 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:55.398733 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:55.421741 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:55.424862 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:55.426983 12689 raft_consensus.cc:2393] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 4: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:55.428099 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:55.429208 12689 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:55.430198 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:55.430915 12620 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:55.386340 15041 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.153s
I20260709 13:03:55.383131 14940 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:03:55.370047 15013 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:55.439607 15013 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:55.442448 15047 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:55.443218 15047 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:55.407042 14871 consensus_queue.cc:237] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:55.390059 14780 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:55.376040 14694 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:55.451997 14694 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:55.412832 14960 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:03:55.433785 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 51173us
I20260709 13:03:55.465770 12659 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:55.454639 12541 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:55.453287 12692 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 6: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:03:55.461714 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.409183 14943 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.481107 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:55.484745 12689 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 4: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:03:55.484720 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 73263.7us
W20260709 13:03:55.487052 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 165746us
W20260709 13:03:55.489717 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 682892us
I20260709 13:03:55.499060 12659 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:55.499330 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:55.500018 12613 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:55.480499 14960 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:55.512125 14960 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:55.512148 15006 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:55.512507 12587 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:55.489745 14943 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:55.517859 14930 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:55.518735 14930 raft_consensus.cc:697] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:55.519905 14930 consensus_queue.cc:237] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:55.412182 14896 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.082s
W20260709 13:03:55.512171 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 99398.3us
I20260709 13:03:55.507067 14882 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:55.530453 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:55.530885 14882 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:55.531340 14882 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:55.531396 12616 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:55.526240 12613 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:55.525080 15006 raft_consensus.cc:697] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:03:55.533847 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.535589 12620 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:55.537551 12616 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 4. Current term is 5. Ops: [2.5-4.6]
W20260709 13:03:55.539709 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:55.540337 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.501411 15013 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:55.544199 12588 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:55.547576 13199 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:03:55.550163 12512 leader_election.cc:400] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6.
I20260709 13:03:55.550693 12512 leader_election.cc:403] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:03:55.551434 12512 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:55.551787 14717 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6.
I20260709 13:03:55.551888 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:55.553119 12512 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:55.553838 12620 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:03:55.554332 14993 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:55.554636 14950 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:55.551914 14936 raft_consensus.cc:3055] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:55.550235 12613 raft_consensus.cc:1275] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:55.555728 12622 raft_consensus.cc:1275] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:55.556246 15001 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:55.557122 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:55.558470 12615 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:55.558285 15006 consensus_queue.cc:237] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:55.597021 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:55.559969 15046 consensus_queue.cc:1059] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:55.560639 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:03:55.561657 13232 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 788) took 2556 ms (client timeout 2661 ms). Trace:
I20260709 13:03:55.565027 15027 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:55.568552 14545 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:55.569931 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:55.570657 15041 consensus_queue.cc:1059] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:55.570968 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:55.618674 12696 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 6: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:03:55.573663 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.523933 15047 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:55.558598 12587 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:55.561358 15054 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:55.542227 14915 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:03:55.599474 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 208278us
W20260709 13:03:55.600827 13232 rpcz_store.cc:269] 0709 13:03:53.005545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:53.488129 (+482584us) service_pool.cc:224] Handling call
0709 13:03:55.561234 (+2073105us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b5400750dd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:55.561459 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":937597312}
I20260709 13:03:55.604216 12687 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 4: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:55.603726 12512 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:55.592638 14936 raft_consensus.cc:740] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:03:55.619449 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 62424.1us
I20260709 13:03:55.633612 12540 raft_consensus.cc:1240] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:55.634092 12662 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:55.582348 15013 raft_consensus.cc:697] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:55.628976 12691 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:55.619338 14826 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:55.622681 14927 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:55.522174 14942 consensus_queue.cc:1059] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.126s
W20260709 13:03:55.644148 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 106005us
W20260709 13:03:55.654106 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 60965.8us
I20260709 13:03:55.644913 14826 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.643615 15027 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:55.646692 15054 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.644515 14927 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:03:55.672466 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 113925us
I20260709 13:03:55.672663 15052 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:55.673414 14848 raft_consensus.cc:3055] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:55.674603 15047 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:55.675956 14936 consensus_queue.cc:260] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:55.681885 15027 raft_consensus.cc:697] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:55.657512 14992 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:55.683761 12659 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:03:55.688387 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 198542us
I20260709 13:03:55.690958 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:55.693478 12616 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 6: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:55.695218 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:55.695950 12614 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:55.698120 15027 consensus_queue.cc:237] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:55.670437 14826 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:55.703022 12512 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:03:55.705708 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:55.719445 12510 leader_election.cc:336] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.624s (SENT)
I20260709 13:03:55.720108 12510 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:55.720183 12588 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:03:55.720758 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.689252 14927 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:55.684661 15054 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:55.689713 14848 raft_consensus.cc:740] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:55.726660 12587 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:03:55.742336 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 49074.9us
I20260709 13:03:55.721876 14945 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:55.731241 14545 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:55.755506 14545 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:55.757926 12512 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:55.727797 15042 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.762581 15042 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:55.763068 12614 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:03:55.764400 12659 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:55.764961 15042 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:55.722800 14992 raft_consensus.cc:697] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:03:55.766620 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 112823us
I20260709 13:03:55.770486 12613 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:55.770622 12512 leader_election.cc:400] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 4. Current term is 5.
I20260709 13:03:55.772562 12512 leader_election.cc:403] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:03:55.738742 14717 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:55.722775 15047 raft_consensus.cc:697] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:03:55.778884 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.779251 14871 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:55.753523 14936 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:55.776372 14545 raft_consensus.cc:2764] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:03:55.782882 15014 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:03:55.783167 14717 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 4. Current term is 5.
I20260709 13:03:55.777141 14930 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:55.786996 15014 consensus_queue.cc:1059] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:55.787106 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:55.792677 15070 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:55.770709 15052 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:55.793893 15052 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:55.794380 15052 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:55.795492 15070 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:55.778832 12614 raft_consensus.cc:1240] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:55.758335 14945 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:55.810643 12691 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:03:55.812094 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:55.815605 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 56682us
I20260709 13:03:55.816753 12588 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:55.803707 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:55.757910 14882 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:55.829751 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:55.726827 15013 consensus_queue.cc:237] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:55.836325 12691 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: [6.8-8.9]
I20260709 13:03:55.838392 14930 raft_consensus.cc:697] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:55.815241 14945 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:03:55.842204 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:55.834641 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:55.829463 14925 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:03:55.850051 15047 consensus_queue.cc:237] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:55.851572 13199 leader_election.cc:400] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5.
I20260709 13:03:55.852020 13199 leader_election.cc:403] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:03:55.842772 15003 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:55.854827 15070 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:55.854871 14926 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:55.825754 14915 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:03:55.857935 13199 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:55.863996 13199 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:55.870766 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 170620us
I20260709 13:03:55.872658 12512 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:55.876832 14942 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:55.877002 15059 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:55.883657 14717 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:55.885223 12696 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:55.870798 15078 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:55.877516 14911 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:55.904521 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:55.874733 15069 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEARNER]: Advancing to term 6
I20260709 13:03:55.884857 12693 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:03:55.880833 14925 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:03:55.909857 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 93235.6us
I20260709 13:03:55.915351 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:55.916203 12690 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:03:55.911353 15061 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.190s	user 0.002s	sys 0.000s
I20260709 13:03:55.907045 14960 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:55.909858 14925 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:55.946810 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:55.877055 14848 consensus_queue.cc:260] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:55.899082 15059 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:55.879199 14992 consensus_queue.cc:237] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:55.936367 14925 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:55.923678 14960 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:55.976907 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:55.978114 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:03:55.985100 15077 log.cc:927] Time spent T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 13:03:55.985998 15075 log.cc:927] Time spent T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:03:55.988813 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:55.989861 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:55.991259 14882 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:55.996701 15069 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEARNER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:55.977818 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:55.912976 14930 consensus_queue.cc:237] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:56.000829 12617 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:55.982550 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:56.002516 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 134599us
I20260709 13:03:56.002914 13235 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:56.014882 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:56.004207 14884 consensus_meta.cc:287] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.619s	user 0.013s	sys 0.000s
I20260709 13:03:55.997584 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:56.023311 13199 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:56.030488 12687 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 6: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:03:56.032162 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 135092us
I20260709 13:03:56.032804 12691 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:56.021344 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:55.980746 15082 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:03:56.043975 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:56.049489 12540 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:03:56.025319 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:56.033967 15069 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:03:56.056649 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 171718us
I20260709 13:03:56.062040 12687 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:03:56.064345 12692 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:03:56.027547 14884 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:56.065935 14927 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:56.067376 14694 raft_consensus.cc:3055] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:56.067852 14694 raft_consensus.cc:740] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:03:56.068089 15079 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:03:56.068745 14694 consensus_queue.cc:260] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:56.069717 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.071424 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:56.073736 14916 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:03:55.980582 15074 consensus_queue.cc:1175] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "66750b8bbd4c4b3a9695951d0ede3372" responder_term: 5 status { last_received { term: 4 index: 4 } last_committed_idx: 4 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:03:56.091243 12690 raft_consensus.cc:2393] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:56.071924 14945 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:56.136250 14943 consensus_meta.cc:287] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.623s	user 0.011s	sys 0.001s
I20260709 13:03:56.061012 13228 raft_consensus.cc:3055] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:03:56.099493 14993 consensus_meta.cc:287] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.523s	user 0.012s	sys 0.000s
I20260709 13:03:56.194581 15054 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:56.153473 13228 raft_consensus.cc:740] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:56.199035 13228 consensus_queue.cc:260] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:56.200410 13228 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:56.210203 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 234629us
I20260709 13:03:56.148800 12688 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:03:56.220986 12688 pending_rounds.cc:85] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 5
I20260709 13:03:56.221336 12688 pending_rounds.cc:107] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:03:56.221632 12688 raft_consensus.cc:2889] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:03:56.223182 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.273767 15086 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.186s
I20260709 13:03:56.276093 15086 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:56.276196 14925 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:56.277947 14686 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.281903 15070 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5.
I20260709 13:03:56.217948 14993 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:56.282505 14686 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:56.286381 14925 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:56.153194 14943 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:56.078898 15052 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:56.197502 15054 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:56.348341 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:56.352095 14943 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:56.276866 15086 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:56.299312 14694 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:56.405773 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.373811 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:56.478694 12541 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:56.483508 12541 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
W20260709 13:03:56.495491 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 202144us
W20260709 13:03:56.395236 14826 consensus_meta.cc:287] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.610s	user 0.011s	sys 0.001s
I20260709 13:03:56.501762 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:56.505715 14826 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:56.502350 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:56.507347 12545 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 5: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:56.514118 12687 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:03:56.513988 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:56.406806 14945 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:56.500110 15085 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.520133 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:56.484601 14925 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:56.521052 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:56.517143 12543 raft_consensus.cc:2376] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3. Re-sending same reply.
I20260709 13:03:56.519606 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:56.524580 12540 raft_consensus.cc:2393] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 7: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:56.522894 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:56.526615 12545 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:56.515368 15059 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:56.527545 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:56.527871 12544 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:03:56.529500 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:56.533456 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 543) took 3780 ms. Trace:
I20260709 13:03:56.533370 12546 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:56.530893 12541 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:56.534009 12688 rpcz_store.cc:276] 0709 13:03:52.748640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.586725 (+1838085us) service_pool.cc:224] Handling call
0709 13:03:54.602050 (+ 15325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:56.269123 (+1667073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:56.528470 (+259347us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54002c9054. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:56.528629 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3553112448}
I20260709 13:03:56.537258 12540 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:56.540050 12539 raft_consensus.cc:2393] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 7: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:56.565788 12543 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:03:56.521865 15069 raft_consensus.cc:697] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:56.566016 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:56.526163 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:03:56.570228 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.526157 15085 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:56.579560 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:56.600571 12546 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:03:56.576936 14884 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:56.616369 13200 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:56.618165 13200 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:56.618990 15102 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:56.621738 15059 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:56.623821 15069 consensus_queue.cc:237] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:56.583709 12542 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:56.628715 15052 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:56.528916 14925 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:56.633955 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 54542.6us
I20260709 13:03:56.634855 12588 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:56.635623 15047 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:56.635927 14925 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:56.636339 15047 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:56.638471 15086 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:56.639647 13200 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:56.641310 14980 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:56.641983 14980 consensus_queue.cc:1059] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:56.642865 15102 raft_consensus.cc:3055] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:56.643229 15102 raft_consensus.cc:740] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:56.644016 15102 consensus_queue.cc:260] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:56.646273 14936 consensus_meta.cc:287] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.831s	user 0.006s	sys 0.005s
I20260709 13:03:56.646802 14911 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:56.647142 12692 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:03:56.647337 14911 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:56.647557 12692 pending_rounds.cc:85] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 5
I20260709 13:03:56.647941 12692 pending_rounds.cc:107] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:03:56.648219 12692 raft_consensus.cc:2889] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:56.650648 15052 consensus_queue.cc:1059] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:03:56.652616 15096 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:56.655115 14987 consensus_queue.cc:1059] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:56.655851 14942 raft_consensus.cc:3055] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:56.656212 14942 raft_consensus.cc:740] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:56.656364 14987 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:03:56.656838 12538 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:56.656956 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1299) took 1540 ms. Trace:
I20260709 13:03:56.657649 14826 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:56.657441 12689 rpcz_store.cc:276] 0709 13:03:55.116853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.499082 (+382229us) service_pool.cc:224] Handling call
0709 13:03:56.656774 (+1157692us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54000c80d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:56.656902 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":580518656}
I20260709 13:03:56.657028 14942 consensus_queue.cc:260] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:56.658895 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:56.659638 12538 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
W20260709 13:03:56.661767 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.667186 12541 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:03:56.667855 12542 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:56.669054 12510 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:56.659806 14942 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:56.601945 15078 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:56.682725 12588 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:56.691066 15052 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:56.691594 15052 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:56.692070 15052 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:56.692034 12588 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:56.695097 15047 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:56.697291 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:56.668932 14960 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:56.700891 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.702975 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:56.703946 12613 raft_consensus.cc:2393] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:56.702615 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:56.684404 14927 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:56.719836 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:56.722054 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:56.723030 12620 raft_consensus.cc:2368] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 4. Current term is 5.
I20260709 13:03:56.724071 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:56.726485 15085 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:56.730530 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:56.722707 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:56.715981 14960 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:56.734114 12617 raft_consensus.cc:2393] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 6: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:03:56.735033 13228 consensus_meta.cc:287] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
I20260709 13:03:56.735423 13228 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:03:56.736181 12510 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:56.736613 14911 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:56.737787 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:56.702553 15078 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:56.741205 14927 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:56.741708 15078 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:56.703270 14884 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:56.742794 14884 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:56.744270 14884 consensus_queue.cc:1048] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:56.746383 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:56.747174 12546 raft_consensus.cc:2368] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 6. Current term is 7.
I20260709 13:03:56.749795 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:56.742029 14927 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:56.750434 12613 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:56.723603 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:56.763041 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:56.764137 12614 raft_consensus.cc:2368] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 4. Current term is 5.
I20260709 13:03:56.767218 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:56.768101 12546 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:03:56.769044 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:56.769819 12539 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:56.770957 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:03:56.773623 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.773445 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:56.774196 12545 raft_consensus.cc:2393] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 5: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:56.781780 12544 raft_consensus.cc:2393] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 5: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:56.756227 14911 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:56.779449 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:56.774473 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:56.786271 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:56.787125 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:56.787600 12545 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:03:56.787941 12546 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:56.790306 12621 raft_consensus.cc:2368] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7.
I20260709 13:03:56.792831 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:56.793552 12621 raft_consensus.cc:2393] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:03:56.791643 14690 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.015s	sys 0.023s
W20260709 13:03:56.820959 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:56.825951 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:56.823957 14690 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.015s	sys 0.023s
I20260709 13:03:56.845745 13235 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:56.846716 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:56.830533 12546 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:03:56.830199 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:56.830340 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:56.830726 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:56.855499 13200 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:56.859195 15103 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:56.859629 15103 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:56.860101 15103 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:56.858879 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:56.862792 12621 raft_consensus.cc:2393] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:56.863451 12546 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:03:56.868172 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:56.866505 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:56.861809 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:56.877262 13227 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 4: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:56.882906 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:56.883442 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:56.884013 13228 raft_consensus.cc:3055] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:56.884078 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:56.884341 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:56.884403 13228 raft_consensus.cc:740] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:56.885531 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:56.886669 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:56.888948 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 447) took 1256 ms. Trace:
I20260709 13:03:56.889328 12622 rpcz_store.cc:276] 0709 13:03:55.632267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:56.888018 (+1255751us) service_pool.cc:224] Handling call
0709 13:03:56.888370 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:56.888635 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:56.888660 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:56.888704 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:56.888737 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:56.888787 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:56.888897 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:56.891180 15053 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 1.242s	user 0.002s	sys 0.015s
I20260709 13:03:56.877794 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:56.885310 13228 consensus_queue.cc:260] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:56.898160 13228 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:56.898775 15119 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:56.899515 15119 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:56.903918 13234 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:56.905015 12513 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:56.906143 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:56.907697 13234 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:03:56.878883 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:56.910511 13233 raft_consensus.cc:2393] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 4: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:56.911453 15116 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:56.876334 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:56.914273 12621 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:56.915374 12544 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:56.920663 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:56.913617 15116 raft_consensus.cc:697] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 4 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:56.928546 13233 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:56.928957 13228 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:03:56.929596 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:56.917670 15107 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:56.932283 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:56.933223 12621 raft_consensus.cc:2410] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:56.935070 13235 raft_consensus.cc:1240] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:03:56.947634 12622 raft_consensus.cc:2393] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 3: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:03:56.964588 12510 leader_election.cc:336] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.628s (SENT)
I20260709 13:03:56.965322 12510 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:56.968039 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.009930 13229 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:03:57.015955 15052 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:57.020130 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:57.025359 12620 raft_consensus.cc:2393] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:56.943017 15119 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:57.025959 15119 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.026309 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:57.026435 15119 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:57.027388 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:57.027961 12620 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:03:57.028517 15119 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:57.020841 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:57.008510 14927 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.021890 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:57.022562 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:57.029919 12617 raft_consensus.cc:2393] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:57.023237 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:03:57.023813 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 59302.6us
I20260709 13:03:57.023972 14884 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:57.033988 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.041999 12618 raft_consensus.cc:2393] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:57.042980 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:57.042380 12616 raft_consensus.cc:2393] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:56.991545 15116 consensus_queue.cc:237] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:57.070050 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:03:57.075519 12510 leader_election.cc:336] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.732s (SENT)
I20260709 13:03:57.109166 12613 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:57.105840 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:57.121057 12621 raft_consensus.cc:2393] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:57.113269 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:57.130555 12622 raft_consensus.cc:2410] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 13:03:57.021293 13231 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
W20260709 13:03:57.156433 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.163645 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:57.138669 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:57.069097 14884 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:57.207037 15124 log.cc:927] Time spent T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 13:03:57.212792 15103 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:57.220567 15082 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:57.244334 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 170017us
W20260709 13:03:57.245460 12510 leader_election.cc:336] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.775s (SENT)
I20260709 13:03:57.247593 12588 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:57.248523 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:57.215471 15052 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:56.992053 15107 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:57.254544 12588 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:57.254982 12613 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
W20260709 13:03:57.255705 12510 leader_election.cc:336] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.503s (SENT)
I20260709 13:03:57.256310 12510 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:57.261323 12588 leader_election.cc:400] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 6. Current term is 7.
I20260709 13:03:57.261782 12588 leader_election.cc:403] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:03:57.253213 15085 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:57.263270 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:57.263973 12547 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:03:57.265893 12510 leader_election.cc:336] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.532s (SENT)
I20260709 13:03:57.252662 15119 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:57.273121 12538 raft_consensus.cc:1240] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:57.259784 15041 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:03:57.275408 12510 leader_election.cc:336] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.823s (SENT)
W20260709 13:03:57.277127 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.277523 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:57.286832 14884 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:57.265695 14925 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:57.266234 15103 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:57.248165 15082 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
W20260709 13:03:57.290531 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.294354 14947 raft_consensus.cc:2955] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:57.276739 15085 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 6. Current term is 7.
I20260709 13:03:57.303529 12510 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:57.304641 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 48416us
I20260709 13:03:57.305737 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:57.306531 15041 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:03:57.306962 15041 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:57.307605 15041 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:57.307952 14925 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:57.308916 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.307093 15082 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:57.312650 12547 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:03:57.312840 12541 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:57.313828 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:57.317422 14994 raft_consensus.cc:3055] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:57.299810 15127 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:57.318684 12588 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:57.318773 12510 leader_election.cc:400] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 4. Current term is 5.
I20260709 13:03:57.321789 12510 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:57.322723 13234 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:03:57.324353 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:57.338006 14925 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:57.329672 15078 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.338783 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:57.339311 15082 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:57.338042 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:57.339903 15082 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:57.340462 13227 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 7: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:57.319932 14994 raft_consensus.cc:740] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:57.341928 15082 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:57.342490 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 558) took 2009 ms. Trace:
I20260709 13:03:57.342468 14994 consensus_queue.cc:260] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:57.329758 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:57.343071 12691 rpcz_store.cc:276] 0709 13:03:55.332911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:55.841600 (+508689us) service_pool.cc:224] Handling call
0709 13:03:56.032588 (+190988us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:56.033432 (+   844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:57.342311 (+1308879us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54000c7bd0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:57.342437 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":438361856}
I20260709 13:03:57.343683 14994 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:57.319710 15085 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:57.344273 15085 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.350997 15085 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:57.353783 15007 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:57.354236 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:03:57.354722 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.354351 15007 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:57.354586 15103 consensus_queue.cc:1059] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:03:57.355396 12510 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:57.355598 15103 raft_consensus.cc:3055] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:57.355986 15103 raft_consensus.cc:740] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:57.356504 15007 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:57.356611 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:57.357026 15007 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.357414 15119 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:57.357708 15013 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.358142 15119 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.358206 15013 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:57.327476 14940 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.356804 15103 consensus_queue.cc:260] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:57.359385 14940 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:57.360411 15013 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:57.362743 12588 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:57.363722 15074 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.361325 14940 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:57.361747 15082 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:03:57.364697 15074 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:57.365636 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:57.369040 14960 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:57.360435 15103 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:57.382509 12510 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:57.386318 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 1.38567e+06us
I20260709 13:03:57.387043 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:57.387854 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:57.387790 12512 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:57.393256 12512 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:57.394942 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:57.395736 12613 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:57.375315 15074 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:57.402480 12615 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:57.403337 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 446) took 1771 ms. Trace:
I20260709 13:03:57.404559 12541 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:57.398634 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1364) took 3940 ms. Trace:
I20260709 13:03:57.357488 15007 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:57.403787 12615 rpcz_store.cc:276] 0709 13:03:55.631957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.382375 (+1750418us) service_pool.cc:224] Handling call
0709 13:03:57.402201 (+ 19826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:57.403031 (+   830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:57.403266 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:57.372247 15086 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:03:57.391467 15078 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:57.413211 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:57.417932 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:57.444561 12694 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:57.412168 15127 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.412222 14925 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:57.420610 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.421751 14826 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.422005 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:57.422371 14945 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:57.455897 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:57.460618 12616 raft_consensus.cc:2393] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 7: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:57.422008 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:57.423370 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:57.424322 15129 log.cc:927] Time spent T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:03:57.424981 15128 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:03:57.425002 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:57.431577 15007 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:57.406689 12695 rpcz_store.cc:276] 0709 13:03:53.450354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.704605 (+1254251us) service_pool.cc:224] Handling call
0709 13:03:54.753909 (+ 49304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:55.347840 (+593931us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:55.348193 (+   353us) log.cc:844] Serialized 14 byte log entry
0709 13:03:55.509086 (+160893us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:55.509224 (+   138us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:55.509398 (+   174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:56.890844 (+1381446us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b18003f9160. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a645a2a6 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419
0709 13:03:57.390001 (+499157us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b54003ea3d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:57.390065 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:57.390177 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12149,"prepare.queue_time_us":168,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":4269,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":178,"spinlock_wait_cycles":1373320832,"thread_start_us":157160,"threads_started":1,"wal-append.queue_time_us":277337,"wal-append.run_cpu_time_us":1362,"wal-append.run_wall_time_us":1055044}
I20260709 13:03:57.474267 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:03:57.442411 15130 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:03:57.397430 15082 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:57.373150 14690 consensus_queue.cc:1059] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:03:57.401865 15052 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.447103 12512 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:57.410099 15074 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:57.476336 15052 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:57.448796 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 46765.6us
I20260709 13:03:57.479228 15052 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:57.479888 15052 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:03:57.483662 12622 raft_consensus.cc:1275] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:57.452376 12613 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:03:57.448777 15119 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:57.422572 14780 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.461218 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:57.492755 13233 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 4: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:03:57.492257 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 45224.8us
I20260709 13:03:57.493098 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:57.493554 12512 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:57.453630 15078 raft_consensus.cc:697] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:57.463023 12541 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:03:57.495960 12541 pending_rounds.cc:85] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 5
I20260709 13:03:57.496282 12541 pending_rounds.cc:107] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:03:57.496549 12541 raft_consensus.cc:2889] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:57.472227 15132 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:57.463496 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 89260.2us
I20260709 13:03:57.467618 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:57.470527 12618 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:57.457988 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:57.486698 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:57.488214 12615 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:57.498987 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:57.499658 13228 raft_consensus.cc:2410] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:03:57.497242 14780 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:57.493757 12687 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:57.461935 12696 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:03:57.507652 12694 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:03:57.508689 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:57.509313 12694 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 6: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:57.516783 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:57.492440 15052 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:57.626698 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:57.470299 14826 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:57.495440 15127 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:57.628557 12694 raft_consensus.cc:2410] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:03:57.495116 14925 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:57.472422 14945 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:57.634037 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 135196us
I20260709 13:03:57.514729 14690 raft_consensus.cc:3055] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:57.646559 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:57.647821 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:57.513716 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:57.585134 15119 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:57.650712 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:57.627357 14960 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.652863 12694 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 7: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:57.500972 14884 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.137s
I20260709 13:03:57.653115 15051 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:57.667448 12510 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:57.648514 14690 raft_consensus.cc:740] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:57.517954 15132 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:57.677302 12662 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:57.631672 15052 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:57.686115 12694 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:03:57.686287 12662 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:57.675175 14915 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:57.687553 14884 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.687907 14915 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:57.687564 15007 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.687765 15084 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.690547 14780 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:57.682875 14783 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:57.691313 14826 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:57.691560 14783 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:57.680809 15001 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:57.694275 15001 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:57.695681 14826 consensus_queue.cc:1048] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:57.696882 15135 log.cc:927] Time spent T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:03:57.689908 15007 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:57.690042 14915 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:57.713548 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.723140 12696 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:03:57.652540 15041 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:57.714497 12620 raft_consensus.cc:2955] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:03:57.727895 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 71380us
I20260709 13:03:57.728444 12662 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:57.731899 12689 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:03:57.734365 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:57.732448 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:57.735507 12696 raft_consensus.cc:2368] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6.
I20260709 13:03:57.773633 12614 raft_consensus.cc:1275] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:57.774310 12510 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:57.739167 12662 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:57.778368 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:57.773325 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:57.780750 12618 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:03:57.782452 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:57.783380 12615 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:57.740633 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:57.779384 12622 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:03:57.725838 14884 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:57.799823 12512 leader_election.cc:400] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6.
I20260709 13:03:57.800357 12512 leader_election.cc:403] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:03:57.737507 14780 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:57.674104 15051 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:57.809859 12510 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:57.773277 15003 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:57.673614 15078 consensus_queue.cc:237] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:57.813534 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:57.816256 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:57.794229 14783 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:03:57.803577 14925 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.825706 12694 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:57.806202 15127 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:57.827344 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:57.815990 14936 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:57.831696 12512 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:57.842695 12622 raft_consensus.cc:1275] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:57.821933 15007 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:57.806591 14884 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:57.861703 15140 log.cc:927] Time spent T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:03:57.863294 14925 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:03:57.880645 15138 log.cc:927] Time spent T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:03:57.861858 14945 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:57.893428 12689 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:57.899228 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1387) took 1995 ms. Trace:
I20260709 13:03:57.899667 12690 rpcz_store.cc:276] 0709 13:03:55.903507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:56.092121 (+188614us) service_pool.cc:224] Handling call
0709 13:03:56.146804 (+ 54683us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:57.375169 (+1228365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:57.375200 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:57.397899 (+ 22699us) log.cc:844] Serialized 52 byte log entry
0709 13:03:57.629848 (+231949us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:57.633889 (+  4041us) log.cc:844] Serialized 14 byte log entry
0709 13:03:57.671990 (+ 38101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:57.672092 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:57.899004 (+226912us) raft_consensus.cc:1685] finished
0709 13:03:57.899028 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:57.899166 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1231443,"prepare.queue_time_us":6285,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":1259576,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":28297,"thread_start_us":180240,"threads_started":1,"wal-append.queue_time_us":266659}
W20260709 13:03:57.905002 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:57.906042 12694 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:03:57.912825 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 173726us
I20260709 13:03:57.912904 12616 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:57.913657 12662 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:57.915640 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:57.918473 12662 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:03:57.912555 15085 consensus_meta.cc:287] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.558s	user 0.014s	sys 0.000s
I20260709 13:03:57.920753 12690 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:57.920966 12662 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:57.919070 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1390) took 1929 ms. Trace:
I20260709 13:03:57.922194 12693 rpcz_store.cc:276] 0709 13:03:55.989413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:56.153988 (+164575us) service_pool.cc:224] Handling call
0709 13:03:56.202098 (+ 48110us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:57.374799 (+1172701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:57.377245 (+  2446us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:57.414927 (+ 37682us) log.cc:844] Serialized 26 byte log entry
0709 13:03:57.582462 (+167535us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:03:57.582611 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:57.582812 (+   201us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:57.912129 (+329317us) raft_consensus.cc:1685] finished
0709 13:03:57.912545 (+   416us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:57.916484 (+  3939us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1169938,"raft.queue_time_us":1172787,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":12296,"thread_start_us":79962,"threads_started":1,"wal-append.queue_time_us":221791}
I20260709 13:03:57.923966 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:46986 (request call id 16) took 2351 ms. Trace:
I20260709 13:03:57.924443 12688 rpcz_store.cc:276] 0709 13:03:55.572261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:56.548286 (+976025us) service_pool.cc:224] Handling call
0709 13:03:57.923700 (+1375414us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54002ca454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957f735 00007fc3ae53fd29 00007fc3a7abe1d4 00007fc3a7abe162 00007fc3a7abe091 00007fc3a7abe00c 00007fc3a7abd2c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:57.923865 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496927488}
I20260709 13:03:57.925890 15134 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:57.926400 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:57.927234 12616 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:03:57.928169 15131 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:57.928714 15131 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:57.926455 15134 raft_consensus.cc:697] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:03:57.965677 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:03:58.007925 12687 consensus_meta.cc:287] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.002s
I20260709 13:03:58.008466 12687 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:03:58.009260 12691 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:58.009478 14780 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:03:57.916461 14945 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:03:58.011620 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 90738.7us
I20260709 13:03:57.913722 15150 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:57.920675 15007 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:58.019841 14884 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:58.030182 15051 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:58.031975 15119 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.034842 15001 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:03:58.038266 12493 auto_rebalancer.cc:893] Removing replace marker failed: Leader has not yet committed an operation in its own term
W20260709 13:03:58.038729 12493 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:03:58.039032 12493 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:03:58.020540 15052 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:58.025725 15132 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:57.938596 15085 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:58.027362 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:58.044225 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 808) took 1162 ms. Trace:
I20260709 13:03:58.027109 15134 consensus_queue.cc:237] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:58.028676 15074 consensus_meta.cc:287] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.000s
I20260709 13:03:58.044754 13235 rpcz_store.cc:276] 0709 13:03:56.882136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:56.913995 (+ 31859us) service_pool.cc:224] Handling call
0709 13:03:56.934728 (+ 20733us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:56.935605 (+   877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:58.043977 (+1108372us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b54006c02d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:58.044147 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35516672}
I20260709 13:03:58.039988 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:58.064430 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:58.080994 12695 raft_consensus.cc:2393] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:58.032801 15119 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:57.930924 15131 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:58.041016 15058 raft_consensus.cc:3055] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:03:58.097266 12587 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:58.099319 14945 raft_consensus.cc:697] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:03:58.106583 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 67359.6us
I20260709 13:03:58.107904 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:58.102355 15058 raft_consensus.cc:740] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:56.898162 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:03:58.110158 12587 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:58.111989 12587 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:58.113049 12587 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:58.099083 15150 raft_consensus.cc:697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 4 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:03:58.114585 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 304845us
I20260709 13:03:58.104059 15127 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6.
I20260709 13:03:58.115965 12510 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:58.120224 12662 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:58.106390 15052 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:03:58.108011 15007 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:03:58.121938 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 196707us
I20260709 13:03:58.099808 15074 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:58.113832 14871 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:58.114969 15144 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:58.130723 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:58.132622 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:58.134967 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:58.135658 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:58.136135 12692 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:58.122392 14916 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:58.120038 15054 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:58.139454 15137 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:03:58.125793 15046 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:03:58.141139 15058 consensus_queue.cc:260] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:58.138240 14916 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:58.142329 15058 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:58.142379 14916 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:58.145833 15119 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:58.146417 15147 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:03:58.141637 15054 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:58.148526 15054 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:58.151729 12692 pending_rounds.cc:85] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 3
I20260709 13:03:58.152108 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:58.152909 13227 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:58.153399 15148 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:03:58.154040 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:58.155633 14686 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:58.141376 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:58.158934 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:58.159629 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.159767 12617 raft_consensus.cc:2410] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:58.159785 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:58.152102 12692 pending_rounds.cc:107] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:03:58.162098 12692 raft_consensus.cc:2889] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:58.161948 14926 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:58.162693 14926 raft_consensus.cc:697] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:58.168265 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:58.171625 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:58.173983 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:58.174847 12691 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:03:58.163656 12512 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:58.179436 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:58.133479 15006 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:58.182767 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:58.192623 13234 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:03:58.207118 12662 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:58.218010 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:58.254602 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 103119us
W20260709 13:03:58.244515 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 80913.1us
W20260709 13:03:58.256289 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 136468us
I20260709 13:03:58.241639 13233 raft_consensus.cc:2955] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:03:58.257577 12587 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:58.257477 12512 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:03:58.259400 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 143557us
I20260709 13:03:58.261281 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:58.214707 15085 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:58.255812 15116 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.044s	user 0.013s	sys 0.009s
I20260709 13:03:58.222190 15119 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:58.243129 15158 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:03:58.273928 15116 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.062s	user 0.013s	sys 0.009s
I20260709 13:03:58.243952 15144 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.264511 14871 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:03:58.274379 15152 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.281777 12617 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:58.256130 15054 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:58.223215 14926 consensus_queue.cc:237] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:58.187831 14945 consensus_queue.cc:237] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:58.284694 15153 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:03:58.263659 15150 consensus_queue.cc:237] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:58.305733 15116 consensus_queue.cc:1059] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:03:58.308782 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.284512 15152 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:58.311228 15152 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:58.311836 15152 raft_consensus.cc:3055] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:03:58.312191 15152 raft_consensus.cc:740] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:58.281693 15127 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:58.312671 15127 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.313063 15127 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:58.305786 15153 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.314965 15153 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:58.316702 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:58.318094 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:58.318876 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 799) took 1497 ms. Trace:
I20260709 13:03:58.319186 13230 rpcz_store.cc:276] 0709 13:03:56.821435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:56.826595 (+  5160us) service_pool.cc:224] Handling call
0709 13:03:58.317933 (+1491338us) spinlock_profiling.cc:243] Waited 5.21 ms on lock 0x7b58000f6398. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae53f0a0 00007fc3ae53e984 00007fc3a7ab96d4 00007fc3a7ab9662
0709 13:03:58.318820 (+   887us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11983744}
I20260709 13:03:58.320869 12662 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:58.277451 13227 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:03:58.276648 15158 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.298671 15161 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:58.298854 15074 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:58.296779 13229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 568) took 1413 ms (client timeout 1713 ms). Trace:
I20260709 13:03:58.277993 15155 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:03:58.276064 15131 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.321422 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:03:58.294070 15151 log.cc:927] Time spent T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 13:03:58.338260 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 77082.1us
I20260709 13:03:58.340420 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:03:58.340130 13229 rpcz_store.cc:269] 0709 13:03:56.883704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:56.883832 (+   128us) service_pool.cc:224] Handling call
0709 13:03:58.296552 (+1412720us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b5400576cd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:58.296689 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44513664}
W20260709 13:03:58.341346 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 78337.8us
I20260709 13:03:58.344782 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:58.346614 12510 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:58.297977 14871 raft_consensus.cc:697] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 7 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:58.337952 15147 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:03:58.339502 14915 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.339771 15158 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:58.353463 12513 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:58.312999 15152 consensus_queue.cc:260] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:58.361905 12662 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:58.372445 12510 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:58.360487 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:58.296718 15144 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:58.363379 15054 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:58.377797 15161 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:58.352897 14916 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:58.346180 15131 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:58.368950 15147 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:03:58.384238 15152 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:58.383512 14871 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:58.387677 12510 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:03:58.389581 15144 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:58.369912 15169 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:58.393324 15131 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:58.406139 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:58.375613 14960 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:58.363961 14915 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:58.383940 15161 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:58.376132 15084 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:03:58.397073 15170 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:03:58.420527 15156 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:03:58.421522 15169 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:58.424008 15161 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:58.434011 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:58.418069 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:03:58.395752 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:03:58.430824 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.442319 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:58.443769 12513 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:03:58.443975 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:58.432677 15127 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:58.444824 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:58.445840 14884 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:03:58.446604 15127 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:58.430718 15170 raft_consensus.cc:697] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:58.432677 15169 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:58.447926 15170 consensus_queue.cc:237] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:58.448602 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:03:58.449410 12690 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:58.454674 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:58.454893 13227 raft_consensus.cc:2376] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5. Re-sending same reply.
I20260709 13:03:58.457520 12690 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:03:58.457901 12513 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:58.458756 12512 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:03:58.467068 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 79487us
I20260709 13:03:58.471081 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:58.471765 12546 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:58.473469 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:58.474155 12546 raft_consensus.cc:2376] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3. Re-sending same reply.
I20260709 13:03:58.423830 14915 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:58.477286 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:58.478979 12541 raft_consensus.cc:2376] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6. Re-sending same reply.
I20260709 13:03:58.479462 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:58.481303 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:58.425148 14916 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:58.483691 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:58.483718 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:58.484356 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:58.484586 12539 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:03:58.484987 12546 raft_consensus.cc:2376] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5. Re-sending same reply.
I20260709 13:03:58.486222 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:58.487206 12542 raft_consensus.cc:2410] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:03:58.498278 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:58.498219 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:58.499848 12540 raft_consensus.cc:2376] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6. Re-sending same reply.
I20260709 13:03:58.469167 14960 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:03:58.467003 15169 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:58.503463 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:58.502761 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:58.507848 12538 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:03:58.491606 15158 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:58.510046 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:58.512612 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:58.512540 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:58.513324 12542 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:03:58.513361 12619 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:03:58.512882 12539 raft_consensus.cc:2410] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:03:58.510751 14960 raft_consensus.cc:697] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:58.496697 15085 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.519822 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:58.520210 14848 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:58.521761 14960 consensus_queue.cc:237] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:58.524804 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.526001 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:58.527204 12615 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:03:58.527798 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:58.532032 12616 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 7: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:58.533790 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:58.535107 12538 raft_consensus.cc:2376] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3. Re-sending same reply.
I20260709 13:03:58.507138 15052 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:58.483645 14980 consensus_queue.cc:1059] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:03:58.516942 15096 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:58.545778 13197 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:03:58.549628 12622 raft_consensus.cc:1240] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:58.550282 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:58.551004 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:58.538089 15085 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:58.554519 13200 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:58.538312 15058 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 13:03:58.514921 15169 raft_consensus.cc:697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:03:58.568398 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:58.569124 12542 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:58.561669 12619 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 5. Current term is 6. Ops: []
I20260709 13:03:58.567301 12538 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: []
W20260709 13:03:58.567325 15157 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:03:58.602991 12542 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
W20260709 13:03:58.602916 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 48501.7us
I20260709 13:03:58.606580 12542 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:03:58.608047 12544 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:58.608322 12621 raft_consensus.cc:2410] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:03:58.619225 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:58.620395 12544 raft_consensus.cc:2410] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:03:58.602542 15070 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:03:58.632500 15176 log.cc:927] Time spent T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:03:58.635389 15102 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:58.636350 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:58.636994 12542 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:03:58.611076 15115 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:03:58.570511 15052 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:58.616410 15175 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:03:58.642112 12622 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 7 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:03:58.642549 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:58.609835 15109 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.645136 12544 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
I20260709 13:03:58.668494 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:58.650266 12545 raft_consensus.cc:1275] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:03:58.651547 12541 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: []
I20260709 13:03:58.670653 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:58.670838 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:58.666630 12588 leader_election.cc:336] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.508s (SENT)
I20260709 13:03:58.672190 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:58.672405 12588 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:58.671829 12541 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:03:58.570679 15096 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:58.604274 15101 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:03:58.674969 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:58.675530 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:58.694150 12540 raft_consensus.cc:1275] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:03:58.669356 12544 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:03:58.676880 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:58.694897 12617 raft_consensus.cc:2376] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5. Re-sending same reply.
I20260709 13:03:58.695293 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:58.696086 12588 leader_election.cc:336] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.517s (SENT)
I20260709 13:03:58.624751 15070 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:58.693055 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:58.695791 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:58.677102 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:58.696890 12544 raft_consensus.cc:2393] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 6: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:58.696756 12588 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:58.702240 12617 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:03:58.702342 12542 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:58.704211 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:03:58.705495 12545 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:58.706264 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:58.706210 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 97341.8us
I20260709 13:03:58.610535 14896 consensus_queue.cc:1059] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:03:58.749977 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:58.769021 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:58.707871 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:58.713111 12542 raft_consensus.cc:2410] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:03:58.674333 15155 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:58.613739 15059 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:03:58.715191 15054 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:58.705654 15137 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:58.868487 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:58.921005 12617 raft_consensus.cc:2393] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:03:58.869017 12541 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:03:58.831665 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:03:58.830736 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:58.924060 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:58.924619 12614 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:58.922142 12540 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:03:58.927143 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:58.927814 12617 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
W20260709 13:03:58.763046 15175 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:03:58.703482 15070 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:03:58.699819 14871 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:58.829284 12588 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:03:58.904036 12538 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:03:58.763622 14926 consensus_queue.cc:1048] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.143s
I20260709 13:03:58.677742 15109 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:03:58.861181 15115 raft_consensus.cc:697] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:58.697671 15169 consensus_queue.cc:237] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:58.826599 15153 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:58.870611 14993 consensus_queue.cc:1059] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.092s
W20260709 13:03:58.962222 14945 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.046s	sys 0.050s
W20260709 13:03:58.988617 15178 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:03:58.987015 15108 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.289s
I20260709 13:03:58.990422 15085 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:03:58.963603 15180 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:59.016824 12614 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:03:58.917121 15155 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:58.966336 14871 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:59.346696 12540 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:03:59.348560 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:03:59.350176 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:59.090137 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.365278 12617 raft_consensus.cc:2410] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:03:59.343060 12662 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:59.343593 12538 raft_consensus.cc:1275] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:03:59.038033 15181 log.cc:927] Time spent T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.298s	user 0.000s	sys 0.001s
W20260709 13:03:59.023741 15182 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.178s	user 0.001s	sys 0.004s
I20260709 13:03:59.421535 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1324) took 1133 ms. Trace:
I20260709 13:03:59.422077 12691 rpcz_store.cc:276] 0709 13:03:58.288491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.291489 (+  2998us) service_pool.cc:224] Handling call
0709 13:03:58.291808 (+   319us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:58.416168 (+124360us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:58.416213 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:58.439854 (+ 23641us) log.cc:844] Serialized 52 byte log entry
0709 13:03:58.567895 (+128041us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:58.567950 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.041771 (+473821us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54001a0c54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:03:59.041845 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:59.421152 (+379307us) raft_consensus.cc:1685] finished
0709 13:03:59.421181 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:59.421454 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15918,"raft.queue_time_us":19469,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":4234,"spinlock_wait_cycles":237936384,"thread_start_us":58481,"threads_started":1,"wal-append.queue_time_us":158333}
W20260709 13:03:59.426079 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 596822us
I20260709 13:03:59.427433 12588 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:59.049014 14993 raft_consensus.cc:3055] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:03:59.429358 14993 raft_consensus.cc:740] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:03:59.430670 14993 consensus_queue.cc:260] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:59.511013 12513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.002s	sys 0.010s
I20260709 13:03:59.029450 14848 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:03:59.442589 12621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1545) took 2311 ms (client timeout 2531 ms). Trace:
I20260709 13:03:59.442855 12620 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:03:59.517532 12620 pending_rounds.cc:85] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 4
I20260709 13:03:59.517838 12620 pending_rounds.cc:107] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:03:59.518079 12620 raft_consensus.cc:2889] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:03:59.428009 15116 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:59.511119 15059 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.000s	sys 0.006s
I20260709 13:03:59.474267 12444 catalog_manager.cc:5697] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 3 to 5, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 5 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:03:59.364645 14896 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.001s	sys 0.042s
I20260709 13:03:59.197922 15108 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.495623 15052 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:03:59.511586 12513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.002s	sys 0.010s
I20260709 13:03:59.506160 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:03:59.557435 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 51399.5us
I20260709 13:03:59.441197 14871 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:59.418324 15155 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:59.519198 15084 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:03:59.573421 15078 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:59.573945 15084 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:03:59.515749 12621 rpcz_store.cc:269] 0709 13:03:57.131505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.163248 (+ 31743us) service_pool.cc:224] Handling call
0709 13:03:59.442320 (+2279072us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54003d13d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:03:59.442487 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3310796160}
I20260709 13:03:59.543251 12541 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:03:59.547724 12618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.015s	sys 0.060s
W20260709 13:03:59.587036 12618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.015s	sys 0.060s
I20260709 13:03:59.446853 15170 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:59.050122 15153 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:59.224470 15085 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:59.191785 14926 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.515741 14780 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:59.558702 12662 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:03:59.632170 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 73540.8us
I20260709 13:03:59.633756 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:03:59.545212 15059 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.000s	sys 0.007s
I20260709 13:03:59.565054 14997 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:03:59.048590 14945 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.046s	sys 0.050s
I20260709 13:03:59.574855 15084 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:03:59.571924 14993 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:03:59.610672 15078 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.611435 15052 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.612380 15137 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.568440 14848 raft_consensus.cc:697] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 6 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:03:59.623091 15193 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:59.574844 15155 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.562382 14694 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:59.542855 15116 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:59.600507 15190 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.596551 15096 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:59.481878 15103 raft_consensus.cc:3055] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:03:59.636531 15001 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:03:59.570075 15115 consensus_queue.cc:237] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:59.644906 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:03:59.609643 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 182205us
I20260709 13:03:59.648303 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:59.566331 15108 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:59.641023 15153 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:59.645283 14950 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.009s	sys 0.004s
W20260709 13:03:59.655544 15161 consensus_meta.cc:287] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 1.219s	user 0.015s	sys 0.022s
I20260709 13:03:59.641288 14947 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:03:59.653944 15201 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.679800 13229 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:03:59.655853 13228 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.340s	user 0.037s	sys 0.108s
W20260709 13:03:59.695231 13228 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.379s	user 0.038s	sys 0.108s
W20260709 13:03:59.696339 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:03:59.697434 12543 raft_consensus.cc:1275] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:03:59.680107 12588 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:59.662461 14945 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:03:59.637526 15085 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:59.638535 14926 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:59.683678 15152 consensus_meta.cc:287] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 1.280s	user 0.004s	sys 0.008s
I20260709 13:03:59.641595 14780 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:59.760793 13229 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
W20260709 13:03:59.690155 14950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.009s	sys 0.005s
I20260709 13:03:59.679231 15001 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.631093 15170 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:59.658656 15078 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:59.676103 15103 raft_consensus.cc:740] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:03:59.661311 15052 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:59.821548 12513 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:59.694839 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:59.666465 15137 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:03:59.820737 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 140720us
I20260709 13:03:59.835700 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
W20260709 13:03:59.823541 13199 connection.cc:256] RPC call timeout handler was delayed by -1.6298683149999533s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15860000000000002s for a response
W20260709 13:03:59.839378 13199 connection.cc:256] RPC call timeout handler was delayed by -1.6110120580000284s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2088s for a response
W20260709 13:03:59.839910 13199 connection.cc:256] RPC call timeout handler was delayed by -1.5766554399999677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
I20260709 13:03:59.341853 14690 consensus_queue.cc:260] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:59.676122 15155 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:59.764055 15194 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:59.830690 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 197219us
I20260709 13:03:59.675372 14694 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:59.682473 15190 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:59.822592 15001 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:03:59.832397 12545 consensus_meta.cc:287] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 1.005s	user 0.010s	sys 0.006s
I20260709 13:03:59.767743 15169 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:03:59.756388 15197 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:03:59.689755 15153 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:59.820474 15096 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.858387 15169 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:59.864060 15096 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:59.865325 14926 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:59.866160 15190 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:03:59.866747 15102 consensus_meta.cc:287] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 1.231s	user 0.013s	sys 0.000s
I20260709 13:03:59.867355 15096 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:59.867504 15153 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:59.867998 15116 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:59.698592 15161 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:59.851727 12545 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:03:59.672879 15193 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:59.831806 15196 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.709683 14848 consensus_queue.cc:237] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:03:59.839707 13227 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:03:59.836138 14871 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:03:59.841207 13226 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
W20260709 13:03:59.855988 15191 log.cc:927] Time spent T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 13:03:59.850710 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:03:59.905897 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 55282.2us
I20260709 13:03:59.894985 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:59.906934 15202 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:03:59.907121 12621 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:03:59.896519 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:03:59.908274 15205 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:03:59.908533 12617 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:03:59.910190 15078 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:03:59.910470 12513 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:03:59.903168 15214 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:03:59.911991 14947 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:03:59.901109 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2552) took 1191 ms. Trace:
W20260709 13:03:59.913122 15070 consensus_meta.cc:287] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.947s	user 0.003s	sys 0.008s
I20260709 13:03:59.906823 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:59.711163 15201 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:59.857401 15206 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.874070 14994 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.913343 12545 rpcz_store.cc:276] 0709 13:03:58.703585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.703800 (+   215us) service_pool.cc:224] Handling call
0709 13:03:59.894466 (+1190666us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:03:59.906819 12622 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 3. Current term is 4. Ops: []
I20260709 13:03:59.866703 15190 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:03:59.918036 14947 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:03:59.909152 15085 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:59.919153 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:03:59.920872 12547 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 6: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:03:59.923383 15208 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:59.922973 13199 connection.cc:256] RPC call timeout handler was delayed by -1.1772264300000188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19730000000000003s for a response
I20260709 13:03:59.854506 15194 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:59.918731 15052 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:59.924506 15199 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:03:59.906050 15150 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.598s	user 0.006s	sys 0.011s
W20260709 13:03:59.909183 15192 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:03:59.904888 14950 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.936419 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:03:59.952731 13229 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:03:59.958320 14691 raft_consensus.cc:1064] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
W20260709 13:03:59.958931 14691 raft_consensus.cc:1068] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Unable to promote non-voter 66750b8bbd4c4b3a9695951d0ede3372: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:03:59.960500 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2548) took 1283 ms. Trace:
I20260709 13:03:59.960904 12544 rpcz_store.cc:276] 0709 13:03:58.677218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.685306 (+1008088us) service_pool.cc:224] Handling call
0709 13:03:59.685706 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:59.852284 (+166578us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:59.852316 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:59.852863 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:03:59.960245 (+107382us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:59.960275 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.960324 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:03:59.960359 (+    35us) raft_consensus.cc:1685] finished
0709 13:03:59.960367 (+     8us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:03:59.960453 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57692,"raft.queue_time_us":171357,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":3258,"thread_start_us":257332,"threads_started":2,"wal-append.queue_time_us":101253}
I20260709 13:03:59.961910 12662 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:03:59.963002 14691 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:03:59.963371 12544 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 7. Current term is 8. Ops: []
I20260709 13:03:59.963502 14691 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.963994 14691 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:03:59.964154 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 529) took 1254 ms. Trace:
I20260709 13:03:59.964638 12544 rpcz_store.cc:276] 0709 13:03:58.709555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.962842 (+1253287us) service_pool.cc:224] Handling call
0709 13:03:59.963173 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:59.963902 (+   729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.964097 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:03:59.966403 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 130790us
I20260709 13:03:59.926578 15153 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:59.970499 12588 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:03:59.976966 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:03:59.978045 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 67647.7us
I20260709 13:03:59.930564 14994 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:59.893739 15197 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:03:59.970821 15150 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.662s	user 0.007s	sys 0.011s
I20260709 13:03:59.949425 15134 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:03:59.921469 15070 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:59.993893 13235 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:03:59.977483 15199 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:59.951974 14945 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:03:59.999840 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:03:59.905731 15196 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:59.982532 15052 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:03:59.982726 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:03:59.981998 15214 raft_consensus.cc:697] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:04:00.022361 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 45464.4us
I20260709 13:04:00.023144 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
W20260709 13:04:00.022846 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 75475.7us
I20260709 13:04:00.018168 15216 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:00.018651 15167 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:00.019038 15217 raft_consensus.cc:2764] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:03:59.985954 14694 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:00.019785 15169 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:00.019834 15207 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:00.024664 13199 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:00.003932 15134 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:59.928313 15206 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:59.979975 14950 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:00.039937 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:00.040305 12588 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:00.040161 15052 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:00.042531 13226 raft_consensus.cc:2393] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 7: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:03:59.938133 15190 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:00.017510 15116 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.044219 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:00.045077 15170 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:03:59.985173 15153 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:03:59.948585 15208 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:00.051458 15134 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:00.052332 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 530) took 1342 ms. Trace:
I20260709 13:04:00.026502 15216 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:00.069829 15216 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:00.047729 13199 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:00.060134 13229 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:04:00.052145 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:00.065241 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:00.062119 15225 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:00.066493 15217 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:00.067816 15190 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:00.058646 13230 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:04:00.071898 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:00.078238 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:00.078842 12662 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:00.064610 12544 rpcz_store.cc:276] 0709 13:03:58.710264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.965965 (+1255701us) service_pool.cc:224] Handling call
0709 13:03:59.966291 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:59.966500 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:03:59.967209 (+   709us) log.cc:844] Serialized 14 byte log entry
0709 13:04:00.051989 (+ 84780us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:00.052035 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:00.052077 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.052137 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.052258 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":191,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":86,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":1186,"thread_start_us":84395,"threads_started":1}
I20260709 13:04:00.068281 15153 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:00.025810 14945 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:00.057687 15052 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:00.075223 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2547) took 1419 ms. Trace:
W20260709 13:04:00.067945 15224 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 13:04:00.077425 13199 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:00.063913 14691 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:00.084092 14826 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:00.089577 15227 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:00.072654 15137 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:00.090451 15208 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:04:00.090828 15200 log.cc:927] Time spent T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 13:04:00.089510 15085 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:00.090978 15052 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:00.092407 12588 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:00.095022 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2530) took 1446 ms. Trace:
I20260709 13:04:00.055086 15207 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:00.072479 15116 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:00.095963 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:00.303350 15103 consensus_queue.cc:260] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:00.305874 15206 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:00.300904 15203 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.466s	user 0.001s	sys 0.002s
W20260709 13:04:00.141199 12662 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.084s (SENT) [suppressed 33 similar messages]
I20260709 13:04:00.076881 15217 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:04:00.303853 12660 connection.cc:256] RPC call timeout handler was delayed by -1.4547549760000038s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:04:00.324644 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:00.078466 14694 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:00.287257 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1300) took 1790 ms. Trace:
W20260709 13:04:00.332041 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 254700us
W20260709 13:04:00.307394 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 215057us
W20260709 13:04:00.097235 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:00.332548 12510 connection.cc:256] RPC call timeout handler was delayed by -1.1380049989999179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25310000000000005s for a response
I20260709 13:04:00.332839 13199 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:00.087252 12541 rpcz_store.cc:276] 0709 13:03:58.655900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.592970 (+937070us) service_pool.cc:224] Handling call
0709 13:03:59.593390 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:59.600534 (+  7144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:59.600566 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:59.609304 (+  8738us) log.cc:844] Serialized 26 byte log entry
0709 13:03:59.819642 (+210338us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:59.854145 (+ 34503us) log.cc:844] Serialized 14 byte log entry
0709 13:04:00.074770 (+220625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.074966 (+   196us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:00.075019 (+    53us) raft_consensus.cc:1685] finished
0709 13:04:00.075037 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.075165 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33646,"prepare.queue_time_us":34707,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":43,"raft.queue_time_us":161105,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":25451,"thread_start_us":378758,"threads_started":2,"wal-append.queue_time_us":210859}
I20260709 13:04:00.335760 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:00.081198 15226 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:04:00.261252 14993 consensus_meta.cc:287] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.607s	user 0.005s	sys 0.006s
I20260709 13:04:00.239987 14884 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:00.345892 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:00.345896 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:00.288290 14947 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:00.278005 15225 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.149962 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:00.336400 12621 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:04:00.356081 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:00.356652 12621 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:04:00.167886 15107 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:00.175228 15158 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:00.332144 12546 rpcz_store.cc:276] 0709 13:03:58.497388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.497536 (+   148us) service_pool.cc:224] Handling call
0709 13:04:00.287007 (+1789471us) spinlock_profiling.cc:243] Waited 872 ms on lock 0x7b54003aaa54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:00.287171 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2006749440}
I20260709 13:04:00.336992 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:00.337124 12689 raft_consensus.cc:1240] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:00.280766 15194 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:00.338281 12696 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:04:00.085390 15193 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:00.343029 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:00.295606 15201 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:00.274307 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 579) took 1305 ms. Trace:
I20260709 13:04:00.177802 14945 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:00.346964 12622 raft_consensus.cc:2393] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 7: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:00.347358 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:00.308292 12539 rpcz_store.cc:276] 0709 13:03:58.648747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.648875 (+   128us) service_pool.cc:224] Handling call
0709 13:03:58.693902 (+ 45027us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:59.046182 (+352280us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:03:59.505137 (+458955us) log.cc:844] Serialized 14 byte log entry
0709 13:03:59.957961 (+452824us) log.cc:844] Serialized 14 byte log entry
0709 13:03:59.986865 (+ 28904us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:59.986917 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:03:59.986966 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.094764 (+107798us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b54000a5fd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:00.094819 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.094957 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84153,"prepare.queue_time_us":526085,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":90,"raft.queue_time_us":205658,"raft.run_cpu_time_us":297,"raft.run_wall_time_us":11236,"spinlock_wait_cycles":809457536,"thread_start_us":411311,"threads_started":3,"wal-append.queue_time_us":316903}
W20260709 13:04:00.165432 15084 consensus_meta.cc:287] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.000s
W20260709 13:04:00.178243 15215 log.cc:927] Time spent T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:04:00.373467 12688 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:04:00.309916 15161 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:00.309101 14826 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:00.295428 15041 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:00.296228 15196 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:00.175357 15070 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:00.233834 14960 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:00.352373 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:00.174373 15199 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:00.310978 15197 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:00.306367 15103 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:00.356788 12617 raft_consensus.cc:1240] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:00.322201 15217 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:00.270545 15001 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:00.330075 15013 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:00.366803 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:00.135252 14871 consensus_queue.cc:1059] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.217s
I20260709 13:04:00.337075 15115 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:00.081768 15214 consensus_queue.cc:237] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:00.381780 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 240627us
I20260709 13:04:00.361443 15119 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:00.379546 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 61233.6us
I20260709 13:04:00.357175 15153 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.355830 15236 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:00.386453 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:00.337265 15085 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:00.347980 15137 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:04:00.396555 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 537) took 2906 ms. Trace:
I20260709 13:04:00.398571 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:00.369298 15170 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:00.381935 15206 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:00.355674 14884 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:00.376375 14694 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:04:00.424857 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:00.463948 12695 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:04:00.386283 14826 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:00.384581 15208 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:04:00.434926 15041 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:00.467671 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:00.467880 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:00.468586 12688 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:00.404588 15223 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:00.429993 15196 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:04:00.369868 13227 rpcz_store.cc:276] 0709 13:03:58.968739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.512499 (+543760us) service_pool.cc:224] Handling call
0709 13:03:59.568376 (+ 55877us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:59.905066 (+336690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.273966 (+368900us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5400630954. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:00.274222 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":293813504}
I20260709 13:04:00.437453 15236 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:00.384228 15109 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:00.437834 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:00.447207 13228 rpcz_store.cc:276] 0709 13:03:57.490137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:57.500479 (+ 10342us) service_pool.cc:224] Handling call
0709 13:03:58.314162 (+813683us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b58000f6398. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:03:58.314596 (+   434us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:58.315037 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:03:58.315065 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:58.315670 (+   605us) log.cc:844] Serialized 52 byte log entry
0709 13:03:59.078777 (+763107us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a646f0ac 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b
0709 13:03:59.695852 (+617075us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:59.695907 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.696001 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:00.300194 (+604193us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:04:00.396218 (+ 96024us) raft_consensus.cc:1685] finished
0709 13:04:00.396251 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.396475 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5420,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":115,"spinlock_wait_cycles":81957760,"thread_start_us":1379758,"threads_started":1,"wal-append.queue_time_us":1451710}
I20260709 13:04:00.437951 15230 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.456543 15207 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:00.430177 15197 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.428280 14848 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:04:00.430306 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 63583.9us
I20260709 13:04:00.495301 12588 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:00.363626 15225 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:00.403262 14960 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:00.468327 12695 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:00.438048 15211 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:00.470616 14947 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:04:00.455039 15116 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:00.474443 12617 raft_consensus.cc:3055] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:00.478880 15236 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:00.479192 15165 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 2.147s	user 0.000s	sys 0.013s
I20260709 13:04:00.479476 15223 raft_consensus.cc:697] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:00.481935 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:00.381826 15084 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:00.437744 15133 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.483656 15206 raft_consensus.cc:697] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:00.453926 14783 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:04:00.434728 15115 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:00.431998 15013 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:00.493228 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:00.473806 14691 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:00.447131 15119 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:00.531500 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 468) took 1442 ms. Trace:
I20260709 13:04:00.483187 15226 raft_consensus.cc:3055] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:00.533963 12617 raft_consensus.cc:740] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:00.536158 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:00.462414 15170 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:00.452956 15153 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:00.651932 12688 raft_consensus.cc:2393] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 7: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:00.628022 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:00.653079 12695 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:04:00.546183 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:00.602229 15234 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:04:00.532085 14694 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:00.533851 15085 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:00.598975 15233 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 13:04:00.733232 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:00.580550 15237 log.cc:927] Time spent T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:04:00.725514 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:00.698030 12617 consensus_queue.cc:260] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:00.798449 12617 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:00.651751 12614 rpcz_store.cc:276] 0709 13:03:59.089498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.445164 (+355666us) service_pool.cc:224] Handling call
0709 13:03:59.445517 (+   353us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:03:59.644528 (+199011us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:59.644575 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:03:59.670107 (+ 25532us) log.cc:844] Serialized 52 byte log entry
0709 13:03:59.841945 (+171838us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:03:59.841979 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:59.842040 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:00.069995 (+227955us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:04:00.494196 (+424201us) raft_consensus.cc:1685] finished
0709 13:04:00.494219 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.531416 (+ 37197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":198351,"raft.queue_time_us":198526,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":11586,"spinlock_wait_cycles":9627520,"thread_start_us":143912,"threads_started":1,"wal-append.queue_time_us":221699}
I20260709 13:04:00.707294 13197 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:00.655917 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 160714us
I20260709 13:04:00.546147 12613 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:00.600687 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 464) took 2056 ms. Trace:
I20260709 13:04:00.759572 12690 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:00.570222 14993 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:00.622354 15001 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:00.704442 15208 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 13:04:00.544765 15185 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:00.627313 15225 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:00.780100 12692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1399) took 2642 ms. Trace:
I20260709 13:04:00.780921 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:01.011523 13228 raft_consensus.cc:2393] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 6: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:00.502589 15197 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:00.781949 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 294717us
W20260709 13:04:01.023002 12510 leader_election.cc:336] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.575s (SENT)
I20260709 13:04:00.623318 14884 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:00.502769 15230 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:00.696473 15226 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:00.783443 14694 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:04:00.787469 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:01.020659 15216 consensus_meta.cc:287] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.950s	user 0.008s	sys 0.004s
I20260709 13:04:00.789441 15101 raft_consensus.cc:3055] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:01.040930 14694 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:01.042646 15101 raft_consensus.cc:740] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:00.542435 15210 consensus_queue.cc:1048] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.286s
I20260709 13:04:00.792346 15223 consensus_queue.cc:237] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:00.800230 12588 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:04:00.802608 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 95408.5us
I20260709 13:04:00.797912 12695 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:04:00.539256 15134 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:00.725545 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:00.801143 15155 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:00.696408 14848 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:00.807546 15070 raft_consensus.cc:670] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:04:00.799885 12618 rpcz_store.cc:276] 0709 13:03:58.544503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.547376 (+  2873us) service_pool.cc:224] Handling call
0709 13:03:58.547639 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:58.700730 (+153091us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:03:58.833179 (+132449us) log.cc:844] Serialized 14 byte log entry
0709 13:03:59.601644 (+768465us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:03:59.601694 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:03:59.601743 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.600312 (+998569us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54001e96d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:00.600383 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.600591 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8374,"prepare.queue_time_us":125072,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":9749,"raft.queue_time_us":14894,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":2802,"spinlock_wait_cycles":351815936,"thread_start_us":736739,"threads_started":1,"wal-append.queue_time_us":848855}
I20260709 13:04:00.805913 14993 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:00.749958 15133 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:00.855132 15206 consensus_queue.cc:237] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:00.741602 15199 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:04:00.807921 15201 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:01.012065 12617 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:04:01.049814 14960 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:01.033613 12510 leader_election.cc:336] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.800s (SENT)
I20260709 13:04:01.038035 12694 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 7. Current term is 8. Ops: []
W20260709 13:04:01.008034 14826 consensus_meta.cc:287] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.001s
I20260709 13:04:00.788403 15013 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:01.076776 14826 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:00.545516 15211 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:01.043866 15101 consensus_queue.cc:260] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:01.050293 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 532) took 1409 ms. Trace:
I20260709 13:04:01.051193 12544 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:01.053063 13197 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:01.049770 12688 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
W20260709 13:04:01.055253 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 255073us
I20260709 13:04:01.085179 13197 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:01.061427 12691 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:04:01.009663 12692 rpcz_store.cc:276] 0709 13:03:58.137241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.151017 (+ 13776us) service_pool.cc:224] Handling call
0709 13:03:58.151541 (+   524us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:03:58.162621 (+ 11080us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:03:58.162653 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:03:58.163094 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:03:58.267620 (+104526us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:03:58.267656 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:03:58.267723 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:00.425138 (+2157415us) spinlock_profiling.cc:243] Waited 37.1 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:04:00.726268 (+301130us) raft_consensus.cc:1685] finished
0709 13:04:00.726298 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:00.780035 (+ 53737us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":85261056,"thread_start_us":104256,"threads_started":1,"wal-append.queue_time_us":136096}
I20260709 13:04:01.066535 12545 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: []
W20260709 13:04:01.066442 12547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1294) took 2589 ms (client timeout 1766 ms). Trace:
I20260709 13:04:01.085959 12588 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:01.057458 15251 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:01.070729 14993 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:01.074555 15153 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:01.076023 15230 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:00.995966 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:01.083703 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 58658.1us
W20260709 13:04:01.118713 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.027252 15185 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:01.090235 15084 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:04:01.086438 12547 rpcz_store.cc:269] 0709 13:03:58.477369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.483374 (+  6005us) service_pool.cc:224] Handling call
0709 13:04:01.066240 (+2582866us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54001121d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:01.066376 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3302390144}
I20260709 13:04:01.084295 12540 rpcz_store.cc:276] 0709 13:03:59.641318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.283659 (+642341us) service_pool.cc:224] Handling call
0709 13:04:00.284008 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:00.284382 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:00.284412 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:00.284894 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:04:00.363291 (+ 78397us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:00.364294 (+  1003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.364372 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:01.050080 (+685708us) raft_consensus.cc:1685] finished
0709 13:04:01.050103 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:01.050237 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":135,"thread_start_us":78008,"threads_started":1,"wal-append.queue_time_us":154901}
I20260709 13:04:01.064954 15201 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.093410 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:01.095221 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:01.078351 15199 consensus_queue.cc:1243] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer a11816c5d72e4d1295a242f3ced09e5f log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:04:01.098059 12693 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6. Ops: []
W20260709 13:04:01.137916 12510 leader_election.cc:336] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.842s (SENT)
I20260709 13:04:01.047056 15216 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:01.138707 12616 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:01.079177 15242 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.146690 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 832) took 1125 ms. Trace:
W20260709 13:04:01.148823 12443 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36398 (request call id 353) took 15778 ms (client timeout 15000 ms). Trace:
I20260709 13:04:00.477342 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:01.158244 12444 catalog_manager.cc:5697] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 2 to 4, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 4 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.097082 15085 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:01.095489 15170 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:01.091408 15251 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:01.180954 13229 rpcz_store.cc:276] 0709 13:04:00.021583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.021840 (+   257us) service_pool.cc:224] Handling call
0709 13:04:00.022137 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:00.071688 (+ 49551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.146392 (+1074704us) spinlock_profiling.cc:243] Waited 33.4 ms on lock 0x7b54004989d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:01.146616 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76787584}
I20260709 13:04:01.190192 12547 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:01.142522 14950 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:01.201490 12546 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:01.203845 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:01.526294 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2559) took 1087 ms. Trace:
I20260709 13:04:01.532936 12615 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:01.533180 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2556) took 1179 ms. Trace:
I20260709 13:04:01.533471 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:01.519279 14822 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.535629 14822 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:01.536418 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:01.538030 14822 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:01.335001 15170 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:04:01.294517 15150 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:01.265986 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2649) took 2915 ms. Trace:
W20260709 13:04:01.240072 15052 consensus_meta.cc:287] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.918s	user 0.017s	sys 0.000s
I20260709 13:04:01.260151 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2543) took 2605 ms. Trace:
I20260709 13:04:01.543053 12543 rpcz_store.cc:276] 0709 13:03:58.654820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.489049 (+834229us) service_pool.cc:224] Handling call
0709 13:03:59.489534 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:59.697936 (+208402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.259889 (+1561953us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b5400228b54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:01.260081 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470463744}
W20260709 13:04:01.286584 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.256290 12621 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:04:01.279760 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 194620us
W20260709 13:04:01.544804 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.279291 15115 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:01.205078 15242 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:01.326421 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 127345us
I20260709 13:04:01.466233 15189 raft_consensus.cc:3055] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:01.177995 15152 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:01.499891 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:01.309238 12659 connection.cc:256] RPC call timeout handler was delayed by -2.142909960999873s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
I20260709 13:04:01.206472 15199 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:01.176560 15201 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:01.297081 15134 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:01.409932 15216 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:01.244218 12541 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:01.296186 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:01.356586 15133 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:01.546160 15210 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.244995 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:01.204057 15193 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:01.357964 14826 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:01.284372 15197 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:01.468873 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1330) took 1145 ms. Trace:
W20260709 13:04:01.181242 12443 rpcz_store.cc:269] 0709 13:03:45.370411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:45.370664 (+   253us) service_pool.cc:224] Handling call
0709 13:04:01.148538 (+15777874us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:48.841905 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:03:48.917403 (+ 75498us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:03:48.917440 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:03:48.917459 (+    19us) tablet.cc:662] Decoding operations
0709 13:03:48.918489 (+  1030us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:03:48.918568 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:03:48.918598 (+    30us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:03:48.919387 (+   789us) tablet.cc:701] Row locks acquired
0709 13:03:48.919405 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:03:48.919544 (+   139us) write_op.cc:270] Start()
0709 13:03:48.919662 (+   118us) write_op.cc:276] Timestamp: P: 1783602228919497 usec, L: 0
0709 13:03:48.919688 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:03:48.920339 (+   651us) log.cc:844] Serialized 4135 byte log entry
0709 13:03:50.311667 (+1391328us) spinlock_profiling.cc:243] Waited 36 ms on lock 0x7b5400235e28. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af9359e1 00007fc3af93464c 00007fc3acfb03bb 00007fc3acfb271a 00007fc3acfb26a8 00007fc3acfb2628 00007fc3acfb25e3 00007fc3acfb17fc 00007fc3af3e4626 00007fc3af3dedd8 00007fc3a9585310
0709 13:03:50.311839 (+   172us) op_driver.cc:464] REPLICATION: finished
0709 13:03:50.342288 (+ 30449us) write_op.cc:301] APPLY: starting
0709 13:03:50.342369 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:03:50.342599 (+   230us) tablet.cc:1370] finished BulkCheckPresence
0709 13:03:50.342621 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:03:50.470267 (+127646us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:03:50.493807 (+ 23540us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:03:50.500407 (+  6600us) write_op.cc:312] APPLY: finished
0709 13:03:50.529316 (+ 28909us) log.cc:844] Serialized 77 byte log entry
0709 13:03:50.529591 (+   275us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:50.529764 (+   173us) write_op.cc:454] Released schema lock
0709 13:03:50.529830 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 13:03:50.532419 (+  2589us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:03:50.532450 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2292069,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":30153,"apply.run_cpu_time_us":8287,"apply.run_wall_time_us":190113,"num_ops":10,"prepare.queue_time_us":69481,"prepare.run_cpu_time_us":10435,"prepare.run_wall_time_us":208550,"raft.queue_time_us":404743,"raft.run_cpu_time_us":9308,"raft.run_wall_time_us":538326,"replication_time_us":886995,"spinlock_wait_cycles":82835200,"thread_start_us":407157,"threads_started":4,"wal-append.queue_time_us":389277,"wal-append.run_cpu_time_us":117599,"wal-append.run_wall_time_us":2217390}]]}
I20260709 13:04:01.398579 15211 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:01.283644 15103 consensus_meta.cc:287] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.858s	user 0.012s	sys 0.000s
W20260709 13:04:01.227427 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.580720 12616 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
W20260709 13:04:01.584517 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.289191 15252 consensus_queue.cc:1059] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.069s
W20260709 13:04:01.266449 15217 consensus_meta.cc:287] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.806s	user 0.015s	sys 0.000s
I20260709 13:04:01.340199 14848 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:01.464979 14694 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:01.602866 14994 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:01.603543 12614 raft_consensus.cc:2393] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 6: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:01.495421 14783 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:01.432086 12588 connection.cc:256] RPC call timeout handler was delayed by -2.6803046689999519s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
I20260709 13:04:01.240491 12444 catalog_manager.cc:5697] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 2 to 4, now has a pending config: VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193), VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194), VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195), VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 4 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:01.235687 12617 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:01.253288 15236 consensus_meta.cc:287] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.711s	user 0.007s	sys 0.004s
I20260709 13:04:01.362553 15214 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:01.233747 15251 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:01.462574 15108 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:01.518469 15185 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:01.518941 15241 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:04:01.532882 12544 rpcz_store.cc:276] 0709 13:04:00.434111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.545843 (+111732us) service_pool.cc:224] Handling call
0709 13:04:01.521630 (+975787us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b5400227c54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:01.521775 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":625896832}
I20260709 13:04:01.533804 12547 rpcz_store.cc:276] 0709 13:04:00.354146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.166724 (+812578us) service_pool.cc:224] Handling call
0709 13:04:01.189995 (+ 23271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:01.532258 (+342263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.533099 (+   841us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:01.535023 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:01.545085 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:01.540380 12620 rpcz_store.cc:276] 0709 13:03:58.350224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.350785 (+   561us) service_pool.cc:224] Handling call
0709 13:03:59.442444 (+1091659us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:03:59.543879 (+101435us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.265349 (+1721470us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54003d13d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:01.265495 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2509948672}
I20260709 13:04:01.539945 15150 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:01.545743 14947 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.550213 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2554) took 1196 ms. Trace:
I20260709 13:04:01.654129 12546 rpcz_store.cc:276] 0709 13:04:00.353581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.370237 (+ 16656us) service_pool.cc:224] Handling call
0709 13:04:00.370601 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:01.532715 (+1162114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.549971 (+ 17256us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b54000a55d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:01.550151 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1909817216}
I20260709 13:04:01.551666 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:01.555580 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:01.656154 12618 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:01.657074 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:01.560141 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:01.562616 12659 connection.cc:256] RPC call timeout handler was delayed by -2.0284921879999729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20840000000000003s for a response
I20260709 13:04:01.657950 12543 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
W20260709 13:04:01.658257 12659 connection.cc:256] RPC call timeout handler was delayed by -1.914295963999848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
W20260709 13:04:01.658659 12659 connection.cc:256] RPC call timeout handler was delayed by -1.8477099609999641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19230000000000003s for a response
I20260709 13:04:01.653259 12617 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
W20260709 13:04:01.659063 12659 connection.cc:256] RPC call timeout handler was delayed by -1.7739099609999585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2005s for a response
W20260709 13:04:01.659478 12659 connection.cc:256] RPC call timeout handler was delayed by -1.6727170959999285s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
W20260709 13:04:01.659811 12659 connection.cc:256] RPC call timeout handler was delayed by -1.6217959639999435s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2082s for a response
I20260709 13:04:01.563977 15155 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.660169 14947 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:01.660499 15155 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:01.661098 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:01.567104 15242 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:01.695389 15244 raft_consensus.cc:3055] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:01.695901 15244 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:01.696926 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:01.696749 15244 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:01.567885 12622 raft_consensus.cc:2393] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 3: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:01.577925 12542 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
W20260709 13:04:01.593484 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.594827 12693 rpcz_store.cc:276] 0709 13:04:00.323206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.330195 (+  6989us) service_pool.cc:224] Handling call
0709 13:04:00.342639 (+ 12444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:01.174780 (+832141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.468534 (+293754us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b54003ea8d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:01.468785 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1736779520}
I20260709 13:04:01.592263 15210 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:01.602068 15217 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:01.552639 15052 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:01.612200 12588 leader_election.cc:336] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.766s (SENT)
I20260709 13:04:01.618383 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:01.577921 15199 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.619166 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:01.620102 12444 catalog_manager.cc:5697] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:01.618125 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:01.648973 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:01.581077 15008 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:04:01.584029 15193 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:01.649459 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:01.650765 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:01.652002 12621 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:04:01.652063 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:01.654848 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 574) took 3504 ms. Trace:
I20260709 13:04:01.662632 14947 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:01.564755 15152 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:01.662945 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:01.664706 15134 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:01.664983 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:01.666807 14848 raft_consensus.cc:2955] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 6 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:01.667964 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:01.669162 14694 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:01.608806 14783 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:01.672772 15245 log.cc:927] Time spent T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.679s	user 0.003s	sys 0.000s
W20260709 13:04:01.660207 12659 connection.cc:256] RPC call timeout handler was delayed by -1.1545409339998969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
I20260709 13:04:01.614987 15236 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:01.619424 15214 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:01.681932 15241 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:01.682173 15051 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:01.682824 15223 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:01.608987 14940 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:04:01.618734 15206 raft_consensus.cc:3055] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:01.684973 12547 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 6: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:04:01.685889 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.563436 15189 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:01.919194 12619 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:01.919426 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:01.920171 12618 raft_consensus.cc:2393] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:01.921425 15052 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:01.807238 14780 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:01.909183 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:01.788564 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 479) took 1432 ms. Trace:
I20260709 13:04:01.922976 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:01.947264 12613 rpcz_store.cc:276] 0709 13:04:00.334700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.336772 (+  2072us) service_pool.cc:224] Handling call
0709 13:04:01.766676 (+1429904us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b5400104ad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:01.766857 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419575680}
I20260709 13:04:01.948135 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:01.946200 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:01.949687 12687 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
I20260709 13:04:01.950143 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:01.816610 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2549) took 3121 ms. Trace:
I20260709 13:04:01.950877 12544 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:04:01.924823 12659 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:01.953318 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:01.924903 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:01.922875 13235 rpcz_store.cc:276] 0709 13:03:58.150896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:58.152221 (+  1325us) service_pool.cc:224] Handling call
0709 13:03:58.152553 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:00.004438 (+1851885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.654561 (+1650123us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b5400570dd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:01.654775 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4228974976}
I20260709 13:04:01.923812 13234 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:01.767439 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 589) took 1074 ms. Trace:
I20260709 13:04:01.934473 12615 raft_consensus.cc:2393] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 5: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:04:01.786206 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 610116us
I20260709 13:04:01.957260 12691 rpcz_store.cc:276] 0709 13:04:00.693233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.024572 (+331339us) service_pool.cc:224] Handling call
0709 13:04:01.024870 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:01.085807 (+ 60937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.767138 (+681331us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b5400404a54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:01.767365 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83526016}
I20260709 13:04:01.765203 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2553) took 1412 ms. Trace:
I20260709 13:04:01.935878 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:01.961002 12620 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:01.960820 12541 rpcz_store.cc:276] 0709 13:04:00.353270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.353400 (+   130us) service_pool.cc:224] Handling call
0709 13:04:00.353670 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:01.577312 (+1223642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.764821 (+187509us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b54000799d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:01.765112 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2037327232}
I20260709 13:04:01.923628 12622 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:01.962150 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:01.963061 12541 raft_consensus.cc:2376] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8. Re-sending same reply.
I20260709 13:04:01.919055 12616 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:04:01.921156 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:01.944185 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:01.808157 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2557) took 1453 ms. Trace:
I20260709 13:04:01.953394 12659 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:01.749961 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1329) took 1427 ms. Trace:
I20260709 13:04:01.951229 12545 rpcz_store.cc:276] 0709 13:03:58.695608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:59.938915 (+1243307us) service_pool.cc:224] Handling call
0709 13:04:01.066389 (+1127474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:01.086161 (+ 19772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.816317 (+730156us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001121d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:01.816521 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2592084352}
I20260709 13:04:01.703166 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:01.965248 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:02.019265 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:02.019466 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:01.992920 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:02.019479 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 407275us
I20260709 13:04:02.020364 12545 raft_consensus.cc:2410] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:04:02.020507 12541 raft_consensus.cc:2376] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6. Re-sending same reply.
W20260709 13:04:02.021232 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 67915us
I20260709 13:04:02.021628 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:02.018683 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:02.022143 12541 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:02.022655 12659 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:02.022783 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:02.019966 12538 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:02.023254 12690 rpcz_store.cc:276] 0709 13:04:00.322936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.337724 (+ 14788us) service_pool.cc:224] Handling call
0709 13:04:00.352755 (+ 15031us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:00.800070 (+447315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.749602 (+949532us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b540012e154. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:01.749882 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":935172480}
I20260709 13:04:02.024168 12614 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:02.025840 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:02.045334 12546 raft_consensus.cc:2393] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 5: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:02.030423 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:01.956504 12613 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:02.046469 12544 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:02.040198 12659 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
W20260709 13:04:01.999214 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.047566 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:02.049031 12659 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:02.049803 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:02.056602 12621 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:04:02.000463 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:01.947963 12444 catalog_manager.cc:5697] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:02.053076 12616 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:04:01.933589 15193 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:02.054445 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:01.700029 15150 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:02.055156 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:02.073948 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:01.934794 15206 raft_consensus.cc:740] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:04:01.985571 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:01.794993 15226 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:01.741410 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:02.061848 13200 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:02.066814 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:02.089340 13233 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:02.068348 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:01.752585 14690 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:02.101851 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:02.102878 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:02.103986 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:02.104960 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:02.052021 15052 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.105916 12538 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:04:02.105768 15070 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:02.105897 15052 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:02.106622 15070 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.107095 15070 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:02.108150 15052 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:02.069816 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:02.071590 13199 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:01.949674 15241 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:02.110401 13199 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:02.110502 15251 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:02.111413 15241 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:02.111735 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:02.112856 13199 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:01.793148 15119 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:01.922391 15101 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:01.934643 15199 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:02.075265 12689 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:04:02.077095 12620 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:02.077600 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:02.154855 12687 raft_consensus.cc:2410] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:04:01.967918 12618 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:01.933743 15041 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:02.080116 14925 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.051573 14947 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 13:04:02.025326 15132 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:01.781111 15144 raft_consensus.cc:476] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 13:04:02.085914 12546 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:02.059221 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:02.050418 12547 raft_consensus.cc:2955] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:02.088850 12444 catalog_manager.cc:5697] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 3 to 4, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 4 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:02.051368 15133 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:02.100101 15008 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:02.067485 13234 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:02.091802 13200 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:04:02.174106 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 82371.1us
I20260709 13:04:02.174536 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:02.175251 12696 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:02.176321 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:01.949608 15051 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:02.054992 14826 consensus_queue.cc:1048] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:04:02.099896 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2555) took 1746 ms. Trace:
I20260709 13:04:02.100363 15198 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.100069 15206 consensus_queue.cc:260] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:02.194020 12539 rpcz_store.cc:276] 0709 13:04:00.353845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.386495 (+ 32650us) service_pool.cc:224] Handling call
0709 13:04:00.406605 (+ 20110us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:00.407021 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:00.407058 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:00.428047 (+ 20989us) log.cc:844] Serialized 26 byte log entry
0709 13:04:00.752843 (+324796us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:04:00.752904 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:00.753002 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:01.672166 (+919164us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:04:02.086293 (+414127us) raft_consensus.cc:1685] finished
0709 13:04:02.086314 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.099827 (+ 13513us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":22565,"spinlock_wait_cycles":15806848,"thread_start_us":200315,"threads_started":1,"wal-append.queue_time_us":361094}
I20260709 13:04:02.100697 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:02.055331 14822 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:02.163803 14940 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:02.161125 15155 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:02.024327 12540 rpcz_store.cc:276] 0709 13:04:00.354422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.168426 (+814004us) service_pool.cc:224] Handling call
0709 13:04:01.168759 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:01.177135 (+  8376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:01.177167 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:01.234196 (+ 57029us) log.cc:844] Serialized 52 byte log entry
0709 13:04:01.592973 (+358777us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:01.612889 (+ 19916us) log.cc:844] Serialized 14 byte log entry
0709 13:04:01.613126 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:01.613205 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:01.790852 (+177647us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b1800373420. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c3f3 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
0709 13:04:01.807728 (+ 16876us) raft_consensus.cc:1685] finished
0709 13:04:01.807879 (+   151us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:01.808082 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6157,"prepare.queue_time_us":20194,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":57,"raft.queue_time_us":2241,"raft.run_cpu_time_us":538,"raft.run_wall_time_us":65323,"spinlock_wait_cycles":68578688,"thread_start_us":332973,"threads_started":1,"wal-append.queue_time_us":366238}
I20260709 13:04:02.223855 15214 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:02.114809 13199 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:02.120723 12544 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:02.226146 15152 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:02.228471 13226 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:02.229640 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:02.188591 15132 raft_consensus.cc:697] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:02.231566 15132 consensus_queue.cc:237] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:02.113257 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:02.155210 12690 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:02.156530 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:02.234310 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 121107us
I20260709 13:04:02.234882 13233 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:01.904874 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:02.083611 15244 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:02.083365 15226 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:02.236207 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:01.967300 13230 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:02.051266 15223 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:02.163674 15041 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:02.238278 15236 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:02.239339 15223 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:02.175064 13200 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:02.194301 13234 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:02.240170 15041 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:02.188355 12444 catalog_manager.cc:5697] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 2 to 3, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 3 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:02.204473 14822 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.241709 14822 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:02.243674 12444 catalog_manager.cc:5697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 1 to 3, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 3 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:02.201342 12513 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:04:02.194213 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.206007 15198 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:02.246620 15119 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:02.195446 12541 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
W20260709 13:04:02.205766 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.247915 15198 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:02.055634 14780 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:02.248533 15198 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:02.248755 14780 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:02.248975 15198 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.249316 14780 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:02.249728 12619 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
W20260709 13:04:02.246044 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 47150.2us
I20260709 13:04:02.251760 12513 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:02.101199 14927 consensus_queue.cc:1059] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:02.197683 14950 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:02.253193 14950 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:02.253691 14950 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:02.213863 14940 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.254639 14940 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:02.200815 15204 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:04:02.256392 15204 raft_consensus.cc:3055] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:02.256771 15204 raft_consensus.cc:740] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:02.215579 15051 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:02.159075 15096 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:02.257926 15096 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:02.177510 15189 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:02.258374 15096 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:02.173208 14925 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:02.219640 15070 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:02.184333 14896 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:02.221817 15251 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:02.222127 14783 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:02.259514 15119 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:02.260318 15119 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:02.260673 15070 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:02.260787 14925 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:02.245247 15155 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:02.252971 14927 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:02.261765 14927 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.261089 12444 catalog_manager.cc:5697] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:02.252970 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:02.262142 14927 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:02.263108 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:02.262974 12444 catalog_manager.cc:5697] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 1 to 3, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 3 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:02.264279 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:02.265069 13230 raft_consensus.cc:2393] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 5: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:01.968019 15134 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:02.267489 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 152774us
I20260709 13:04:02.188522 15008 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:04:02.257952 12510 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:02.272950 12513 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:02.273278 12510 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
W20260709 13:04:02.271775 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 96778us
I20260709 13:04:02.278955 12622 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:02.280120 13234 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:04:02.266537 12693 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 2.
I20260709 13:04:02.283438 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:02.285892 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:02.289474 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:02.282179 15152 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:02.271034 15201 consensus_meta.cc:287] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.674s	user 0.003s	sys 0.007s
I20260709 13:04:02.297480 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:02.249446 15198 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:02.311830 12587 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:02.280901 15196 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:02.309899 13233 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:04:02.266608 15206 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:02.306807 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:02.280489 15074 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:02.289491 15168 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:02.321065 15168 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:02.321511 15168 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:02.321784 15059 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:02.310719 15051 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.322945 15051 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:04:02.316164 13227 raft_consensus.cc:2393] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 6: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:02.289014 15070 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:02.327477 15070 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.327986 15070 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:02.314694 15201 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:02.343689 13232 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:02.282958 15214 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:02.347430 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:02.321324 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:02.349402 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:02.325356 15051 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:02.316207 15225 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:02.357991 15051 consensus_queue.cc:1059] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:02.359042 15051 raft_consensus.cc:3055] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:02.359375 15051 raft_consensus.cc:740] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:02.360186 15051 consensus_queue.cc:260] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:02.361632 15051 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:02.361981 15201 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:02.364230 15210 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:02.365301 15217 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:02.367975 15134 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:02.371888 15152 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:02.376538 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:02.281337 15204 consensus_queue.cc:260] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:02.379841 14822 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:02.354884 15225 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.318696 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:02.395985 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:02.397683 13233 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:04:02.386253 14950 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:02.390924 12544 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 6: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:02.392989 12587 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:02.394328 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 345349us
I20260709 13:04:02.434952 12659 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:02.398737 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 335416us
W20260709 13:04:02.403581 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.450220 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:02.451022 12617 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:02.451719 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:02.452325 12613 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:04:02.453914 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:02.454535 12613 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:02.455585 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:02.456073 12613 raft_consensus.cc:2376] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6. Re-sending same reply.
I20260709 13:04:02.456847 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:02.457443 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:02.457695 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:02.458691 12613 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:04:02.460626 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:02.450600 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:02.463030 12696 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:02.461400 12613 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:04:02.397064 15204 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:02.397403 15225 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:02.465899 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:02.465952 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:02.469883 12622 raft_consensus.cc:2410] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:04:02.467116 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:02.469532 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:02.470036 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:02.470482 12617 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:04:02.470541 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:02.467447 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:02.471509 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:02.468180 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:02.468598 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:02.472586 12614 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:02.462926 12618 raft_consensus.cc:2376] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6. Re-sending same reply.
I20260709 13:04:02.408011 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2558) took 1974 ms. Trace:
I20260709 13:04:02.473366 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:02.474697 12613 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:02.476842 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:02.446382 15134 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:02.478255 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:02.478406 15134 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:02.479805 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:02.480032 14822 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:02.480438 12622 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:04:02.480686 15134 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:02.482043 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:02.482606 12622 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:04:02.482560 14780 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:02.484879 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:02.485126 14780 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:02.473750 12542 rpcz_store.cc:276] 0709 13:04:00.433814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.946636 (+1512822us) service_pool.cc:224] Handling call
0709 13:04:01.946888 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:01.947094 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:04:02.068756 (+121662us) log.cc:844] Serialized 14 byte log entry
0709 13:04:02.407268 (+338512us) log.cc:844] Serialized 14 byte log entry
0709 13:04:02.407517 (+   249us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:02.407586 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:02.407651 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.407745 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.407930 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":119319,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":82,"raft.queue_time_us":7012,"spinlock_wait_cycles":108515456,"thread_start_us":328860,"threads_started":1}
I20260709 13:04:02.494576 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:02.398680 15168 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:02.495386 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:02.496582 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:02.497117 12542 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:02.497521 15168 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:02.495393 12541 raft_consensus.cc:2410] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:04:02.485528 12622 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:02.485831 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:02.487097 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:02.486878 14927 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:02.489101 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:02.503336 12614 raft_consensus.cc:2376] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6. Re-sending same reply.
I20260709 13:04:02.491313 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:02.492537 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:02.505983 12620 raft_consensus.cc:2410] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:04:02.506346 12695 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:02.506825 14927 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:02.509177 13233 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 6: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:02.510471 13233 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:02.512115 13233 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: []
W20260709 13:04:02.523015 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:02.528121 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 85829us
I20260709 13:04:02.452057 15217 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:02.474623 12691 raft_consensus.cc:2955] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:02.548736 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:02.462004 15223 consensus_queue.cc:1059] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:04:02.540891 12510 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:02.465135 15133 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:02.553920 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:02.555819 12542 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
I20260709 13:04:02.556877 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:02.557821 13233 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:04:02.560220 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:02.481333 15134 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.070s
I20260709 13:04:02.580935 12542 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
W20260709 13:04:02.562798 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 102313us
I20260709 13:04:02.549916 15217 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.575119 15155 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:02.573472 13233 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:04:02.561932 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:02.570669 15223 consensus_queue.cc:1059] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:04:02.575305 13229 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:02.561137 15168 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:02.598973 12545 raft_consensus.cc:2410] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:04:02.565517 15150 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:02.552526 15193 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:02.603121 13233 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:04:02.604949 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.605381 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:02.596966 12659 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:02.505393 15096 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:02.536372 15270 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:04:02.572100 12510 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:02.575119 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:02.572286 14694 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 13:04:02.598073 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:02.595017 15155 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:02.548182 12588 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:02.585920 15102 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:02.573505 12662 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:02.592231 15217 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:02.637933 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:02.635866 13228 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6. Ops: []
W20260709 13:04:02.635286 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 63286.2us
W20260709 13:04:02.638768 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 344008us
I20260709 13:04:02.639245 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:02.599700 15168 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.642455 12659 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:02.642970 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:04:02.653056 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 104958us
I20260709 13:04:02.653929 12588 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:02.654106 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:02.655156 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2560) took 2220 ms. Trace:
I20260709 13:04:02.655642 12510 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:02.596243 14780 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:04:02.657444 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:02.632965 15223 consensus_queue.cc:1243] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:04:02.658115 13235 raft_consensus.cc:2368] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6.
I20260709 13:04:02.659279 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:02.659457 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 371541us
I20260709 13:04:02.664379 13199 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:02.665208 12545 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:04:02.638063 15204 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:02.636464 15115 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:02.601116 15199 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:02.652473 15102 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:02.703661 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.695938 13199 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:02.767998 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.675817 12542 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:04:02.683931 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.655652 12547 rpcz_store.cc:276] 0709 13:04:00.434302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.950230 (+1515928us) service_pool.cc:224] Handling call
0709 13:04:02.049920 (+ 99690us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:02.050240 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:02.277335 (+227095us) log.cc:844] Serialized 14 byte log entry
0709 13:04:02.631754 (+354419us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:02.645604 (+ 13850us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:02.654676 (+  9072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.654822 (+   146us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:02.655036 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":243,"raft.queue_time_us":2180,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":20048,"thread_start_us":329809,"threads_started":1,"wal-append.queue_time_us":398372}
I20260709 13:04:02.690819 12545 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: []
W20260709 13:04:02.730755 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 88454us
W20260709 13:04:02.704135 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 50293.4us
I20260709 13:04:02.652148 15168 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:02.641690 15158 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:02.639119 15155 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:02.711329 12544 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:02.832302 12588 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:02.839834 12659 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:02.846125 12588 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:02.665233 15271 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:04:02.849923 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.664335 14927 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:04:02.761976 14848 consensus_meta.cc:287] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.002s
I20260709 13:04:02.710299 15190 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:02.664593 15170 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:02.733163 15223 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:02.739177 15275 log.cc:927] Time spent T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:04:02.730494 14925 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:02.667687 15144 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:02.665053 15214 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:02.872290 15214 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.872766 15214 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:02.873026 15290 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:04:02.854300 15297 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:02.861864 15190 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:02.874472 15190 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:02.856974 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 161122us
I20260709 13:04:02.876600 13199 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:02.691043 15134 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:02.654609 14947 consensus_queue.cc:1059] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.191s
I20260709 13:04:02.879882 13199 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:02.742887 15225 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:02.760315 14950 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:02.854317 14927 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:02.738229 15193 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:02.871250 14940 consensus_meta.cc:287] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.616s	user 0.009s	sys 0.001s
I20260709 13:04:02.760665 13230 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:02.695318 15108 consensus_queue.cc:1059] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.166s
I20260709 13:04:02.854612 15133 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:02.815876 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 584) took 1076 ms. Trace:
I20260709 13:04:02.901845 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:02.902511 12695 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:02.698554 15058 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.164s
I20260709 13:04:02.861404 15236 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:02.884914 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:02.740000 15096 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:02.880602 15288 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:04:02.862775 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 289298us
W20260709 13:04:02.915716 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:02.861404 15271 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:02.864714 15170 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:02.863564 13231 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:02.915957 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:02.898550 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:04:02.908756 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 251374us
I20260709 13:04:02.889927 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:02.901414 14940 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:02.905341 13227 rpcz_store.cc:276] 0709 13:04:01.740766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.741005 (+   239us) service_pool.cc:224] Handling call
0709 13:04:02.815558 (+1074553us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54002bfcd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:02.815783 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":349147904}
I20260709 13:04:02.926379 12510 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:02.912500 12689 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:02.859562 15273 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:04:02.927330 12510 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:02.895134 14927 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:02.895872 14896 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:02.893682 15134 raft_consensus.cc:697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:02.876766 15223 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:02.904255 14947 raft_consensus.cc:3055] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:02.932673 12695 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
W20260709 13:04:02.906020 15244 consensus_meta.cc:287] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.670s	user 0.011s	sys 0.000s
I20260709 13:04:02.938266 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:02.940343 12692 raft_consensus.cc:1217] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[4.3-6.4]   Dedup: 4.3->[6.4-6.4]
I20260709 13:04:02.941157 12692 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:04:02.944903 13199 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:02.950732 15273 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:02.951247 15273 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:02.951627 15223 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:02.939716 14947 raft_consensus.cc:740] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:02.953094 14940 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:02.953819 15288 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:02.937325 15295 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:04:02.954514 15288 raft_consensus.cc:697] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:02.955457 15288 consensus_queue.cc:237] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:02.951651 15273 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:02.960948 15198 consensus_meta.cc:287] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.642s	user 0.003s	sys 0.005s
I20260709 13:04:02.917928 15170 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:02.952768 14947 consensus_queue.cc:260] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:02.966010 15294 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:02.988512 15294 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:02.988755 14947 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:02.989321 15294 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:02.989872 15293 log.cc:927] Time spent T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.248s	user 0.001s	sys 0.001s
I20260709 13:04:02.963606 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:02.990960 12692 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:02.988389 15134 consensus_queue.cc:237] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:02.965430 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:02.962055 15282 log.cc:927] Time spent T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 13:04:02.961530 15198 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:02.962491 15289 log.cc:927] Time spent T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:04:03.017365 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.005863 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2569) took 1045 ms. Trace:
W20260709 13:04:02.998639 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 71379.1us
I20260709 13:04:03.021867 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:03.008023 12513 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:04:03.010125 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.023603 14925 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:03.024041 14925 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.024392 14925 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:03.031868 12510 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:03.021245 12540 rpcz_store.cc:276] 0709 13:04:01.960484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.223211 (+262727us) service_pool.cc:224] Handling call
0709 13:04:02.223574 (+   363us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:02.224021 (+   447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:02.224052 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:02.224641 (+   589us) log.cc:844] Serialized 52 byte log entry
0709 13:04:02.584910 (+360269us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:02.584952 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:02.585022 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:03.005631 (+420609us) raft_consensus.cc:1685] finished
0709 13:04:03.005651 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.005802 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":540,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":154,"thread_start_us":359827,"threads_started":1,"wal-append.queue_time_us":506731}
I20260709 13:04:03.040800 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:03.004596 15198 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:03.043673 15198 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:03.044160 15198 raft_consensus.cc:697] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:02.943118 15270 consensus_queue.cc:1059] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.095s
I20260709 13:04:02.938367 14780 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.080s
W20260709 13:04:03.051467 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 113248us
W20260709 13:04:03.003230 15283 log.cc:927] Time spent T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.101s	user 0.003s	sys 0.000s
I20260709 13:04:03.049486 12692 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:03.001961 15204 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:03.055384 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:03.055428 13199 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:03.079406 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:03.080063 12695 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:03.080117 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 182366us
W20260709 13:04:03.048291 15070 consensus_meta.cc:287] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.720s	user 0.011s	sys 0.002s
I20260709 13:04:03.006196 15299 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:04:03.050000 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 203923us
I20260709 13:04:03.068495 15133 raft_consensus.cc:697] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:03.000564 15298 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:03.045008 15198 consensus_queue.cc:237] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:03.045954 15199 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:03.035775 14925 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:03.088742 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:03.089702 12659 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
W20260709 13:04:03.092938 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 61952.2us
I20260709 13:04:03.000313 15155 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:03.017457 15271 consensus_queue.cc:1059] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:04:03.069203 15193 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:03.093636 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:03.095837 12588 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:03.107589 12692 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:04:03.001300 15217 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:03.102671 12695 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:04:03.087718 15288 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:03.087581 15299 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:03.088050 15298 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:03.119246 12692 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:04:03.120579 13227 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:04:03.090939 15204 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:03.147737 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:03.096623 15270 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:03.096029 13226 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
I20260709 13:04:03.089223 15070 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:03.157480 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 125695us
I20260709 13:04:03.156165 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:04:03.156391 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 74875.5us
I20260709 13:04:03.114586 15271 consensus_queue.cc:1243] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:04:03.163300 12510 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:03.165124 12510 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:03.148022 15299 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:03.148622 15144 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:03.175098 12587 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:03.179328 12689 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:03.175894 13199 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:03.147522 15298 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:03.151582 15288 raft_consensus.cc:697] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:03.156881 15225 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:03.163990 15204 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:04:03.186136 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:03.187870 13228 raft_consensus.cc:2393] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 8: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:03.190218 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:03.117024 15193 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:03.190606 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:03.195479 12695 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:03.192323 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:03.115294 15308 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 13:04:03.194303 15305 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:03.198268 14950 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:03.204243 15155 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:03.204013 14950 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:03.205014 15155 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:03.177217 14822 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:04:03.204418 15304 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:04:03.211227 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:03.216148 13233 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:03.192806 15134 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:03.214223 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:03.162348 15158 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:04:03.162510 14780 consensus_queue.cc:1059] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:04:03.222906 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:03.221796 12695 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:04:03.191473 15108 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:03.223737 12687 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:03.194736 15223 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:03.237216 15217 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:03.226892 15155 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:03.246381 14925 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:03.247448 15189 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:03.248775 15070 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:03.254779 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:03.256323 13231 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 583) took 3212 ms (client timeout 1763 ms). Trace:
W20260709 13:04:03.205022 15310 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:04:03.265345 12696 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:03.270184 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:03.283676 13233 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:03.185905 15273 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:03.284842 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:04:03.285274 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 229943us
I20260709 13:04:03.285511 12691 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:04:03.288204 12696 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 7: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:03.288874 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:03.291460 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 183820us
I20260709 13:04:03.292208 12513 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:03.293545 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:03.293655 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:03.307722 12691 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:03.174309 15133 consensus_queue.cc:237] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:03.300549 12513 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:03.309829 12691 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:03.317293 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:03.306459 14925 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:03.327931 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 542) took 1256 ms. Trace:
I20260709 13:04:03.328405 13226 rpcz_store.cc:276] 0709 13:04:02.071780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.229329 (+157549us) service_pool.cc:224] Handling call
0709 13:04:03.327720 (+1098391us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b540014afd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:03.327863 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1700654464}
W20260709 13:04:03.346045 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 81446.6us
I20260709 13:04:03.348034 15299 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:03.325256 15294 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:03.293949 15304 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:04:03.282819 15108 raft_consensus.cc:697] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:03.285121 15223 raft_consensus.cc:697] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:04:03.356947 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.358807 12691 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:04:03.368850 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:03.369412 12695 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:04:03.370666 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:03.367647 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 201479us
W20260709 13:04:03.256840 13231 rpcz_store.cc:269] 0709 13:04:00.043982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:00.046560 (+  2578us) service_pool.cc:224] Handling call
0709 13:04:03.256072 (+3209512us) spinlock_profiling.cc:243] Waited 2.78 s on lock 0x7b54005794d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:03.256214 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6395020544}
I20260709 13:04:03.331905 15305 raft_consensus.cc:697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:03.290429 15170 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:04:03.308825 15070 consensus_queue.cc:1059] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
W20260709 13:04:03.366325 15310 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:04:03.385797 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:03.389101 12695 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:04:03.314282 15214 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:03.386669 12510 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:03.392489 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1327) took 1010 ms. Trace:
I20260709 13:04:03.393026 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:03.394207 12588 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:03.394317 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:03.393712 12540 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:04:03.392946 12538 rpcz_store.cc:276] 0709 13:04:02.382453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.662544 (+280091us) service_pool.cc:224] Handling call
0709 13:04:02.688411 (+ 25867us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:02.890853 (+202442us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:04:02.890964 (+   111us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:02.891783 (+   819us) log.cc:844] Serialized 52 byte log entry
0709 13:04:03.079714 (+187931us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:03.079775 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.079871 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:03.392197 (+312326us) raft_consensus.cc:1685] finished
0709 13:04:03.392225 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:03.392415 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":218605,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":17339,"thread_start_us":369346,"threads_started":2,"wal-append.queue_time_us":257466}
I20260709 13:04:03.396076 12588 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:03.397804 14848 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:03.398463 14848 raft_consensus.cc:697] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 6 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:03.378603 15316 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:03.398550 15108 consensus_queue.cc:237] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:03.399416 14848 consensus_queue.cc:237] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:03.293330 15288 consensus_queue.cc:237] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:03.404428 12588 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:03.376660 12691 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
W20260709 13:04:03.407528 15314 log.cc:927] Time spent T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:04:03.407981 15311 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:03.408440 15311 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.408766 15311 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:03.410427 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:03.410816 12588 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:03.411233 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:03.413162 12539 raft_consensus.cc:2393] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 8: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:03.413514 12588 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:03.413874 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:03.414917 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:03.416662 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:03.418751 12588 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:03.415577 12616 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:04:03.421722 15217 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:03.424388 12588 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:03.412386 15299 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:03.426529 12588 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:03.467542 12695 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:04:03.441202 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.409523 15294 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:03.413036 15251 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:03.412575 15271 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:03.418133 15074 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:04:03.427939 12647 heartbeater.cc:646] Failed to heartbeat to 127.11.44.254:44047 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.11.44.254:44047 timed out after 15.000s (SENT)
W20260709 13:04:03.464145 15310 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:04:03.425489 15217 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:04:03.491966 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:03.466248 15190 consensus_meta.cc:287] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.591s	user 0.008s	sys 0.003s
W20260709 13:04:03.425443 15236 consensus_meta.cc:287] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.511s	user 0.005s	sys 0.001s
I20260709 13:04:03.430516 15273 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:03.473196 14694 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:03.505507 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:03.470997 15193 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:03.428194 15144 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:04:03.464389 14927 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:03.429900 15305 consensus_queue.cc:237] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:03.485101 15329 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:04:03.514320 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 85901.9us
I20260709 13:04:03.490082 15225 consensus_queue.cc:1059] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 13:04:03.522004 13234 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:03.508493 15236 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:03.551270 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:03.555488 12695 raft_consensus.cc:2376] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5. Re-sending same reply.
I20260709 13:04:03.429751 15223 consensus_queue.cc:237] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:03.505872 15190 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:03.572527 12695 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:03.576567 13226 raft_consensus.cc:1240] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 13:04:03.570094 15168 consensus_meta.cc:287] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.713s	user 0.012s	sys 0.000s
I20260709 13:04:03.587090 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:03.565405 15190 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:03.593042 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 125505us
I20260709 13:04:03.570411 15316 raft_consensus.cc:697] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:04:03.601830 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.619429 15316 consensus_queue.cc:237] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:03.589206 15214 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:03.581532 15168 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:03.588796 15341 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:03.613334 15170 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:03.743149 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 129059us
I20260709 13:04:03.613744 15298 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:03.778685 12619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1569) took 2378 ms (client timeout 2396 ms). Trace:
I20260709 13:04:03.778705 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 594) took 1730 ms. Trace:
W20260709 13:04:03.779173 12619 rpcz_store.cc:269] 0709 13:04:01.400448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.920894 (+520446us) service_pool.cc:224] Handling call
0709 13:04:03.778489 (+1857595us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b540031cc54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:03.778619 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":650978176}
I20260709 13:04:03.779425 12690 rpcz_store.cc:276] 0709 13:04:02.048727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.048856 (+   129us) service_pool.cc:224] Handling call
0709 13:04:02.154950 (+106094us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:02.234440 (+ 79490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.778439 (+1543999us) spinlock_profiling.cc:243] Waited 77.1 ms on lock 0x7b540018bd50. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:03.778631 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177301248}
I20260709 13:04:03.785459 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:03.787444 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:03.817248 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:03.741750 15341 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:03.821512 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:03.821897 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:03.830127 12616 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:03.829816 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 237289us
I20260709 13:04:03.778383 14694 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:04:03.825737 15338 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:04:03.825909 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:03.827073 14950 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:03.832091 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:03.797155 14927 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:03.835649 12538 raft_consensus.cc:2410] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 6 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 13:04:03.771775 15340 consensus_queue.cc:1059] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.078s
W20260709 13:04:03.830242 15331 log.cc:927] Time spent T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
I20260709 13:04:03.836766 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:03.842497 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:03.835784 12540 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:03.838348 12690 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:04:03.840113 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:03.842604 12695 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:03.844622 12539 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:03.834344 12619 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:03.845432 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:03.846136 12613 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:03.847307 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:03.847904 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:03.848459 12618 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:03.837894 14694 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:03.860184 14925 consensus_meta.cc:287] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.534s	user 0.011s	sys 0.000s
I20260709 13:04:03.860685 14694 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:03.860944 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:03.860621 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:03.854559 12510 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:03.862241 12621 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:03.863832 15299 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:03.864254 15299 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:03.864609 15299 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:03.867100 15341 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:03.870293 12621 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:04:03.877126 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:03.880426 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:03.860679 14925 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:03.886041 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:03.887395 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:03.888182 13233 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
I20260709 13:04:03.837867 15339 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:03.874071 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:03.890826 15339 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:03.872753 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:03.891793 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 606) took 1637 ms. Trace:
I20260709 13:04:03.892266 13230 rpcz_store.cc:276] 0709 13:04:02.253934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.478006 (+224072us) service_pool.cc:224] Handling call
0709 13:04:03.891555 (+1413549us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b5400468554. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:03.891716 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":647772544}
I20260709 13:04:03.892952 15339 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:03.893529 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:03.894240 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:03.896720 15206 raft_consensus.cc:3055] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:03.897403 15206 raft_consensus.cc:740] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:03.897863 13233 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:03.898185 15341 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:03.898317 15206 consensus_queue.cc:260] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:03.898938 15341 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:03.899497 15206 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:03.893386 12619 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:04:03.890110 13231 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:04:03.913206 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:03.907114 15299 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:03.945081 13226 raft_consensus.cc:1240] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:03.947961 15299 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:03.950716 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:03.969375 15343 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:04:03.971304 15298 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:03.973101 15168 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:03.978436 15311 consensus_meta.cc:287] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.569s	user 0.005s	sys 0.007s
I20260709 13:04:03.979065 15311 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:03.981021 12693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1340) took 2035 ms (client timeout 1792 ms). Trace:
I20260709 13:04:03.982062 15311 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:03.982285 12693 rpcz_store.cc:269] 0709 13:04:01.945424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.992545 (+ 47121us) service_pool.cc:224] Handling call
0709 13:04:03.980739 (+1988194us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b5400240254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:03.980919 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506752384}
I20260709 13:04:03.985112 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:04.022245 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:04.023478 13226 raft_consensus.cc:2410] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:04:04.028837 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.027861 15288 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.044116 15288 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:04.046936 15288 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:04.100035 12546 raft_consensus.cc:1240] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:04:04.181799 12616 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:04.193414 12513 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:04.193837 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:04.195026 15316 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:04.195668 15316 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.195607 15298 consensus_queue.cc:1059] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:04.196331 15316 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:04.196892 15298 raft_consensus.cc:3055] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:04.197328 15298 raft_consensus.cc:740] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:04.198354 15298 consensus_queue.cc:260] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:04.202430 15298 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:04.206591 15316 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:04.020715 15168 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.209434 15168 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:04.214632 15168 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:04.209400 15316 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:04.215483 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:04.216157 13226 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:04.222978 13226 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:04.224431 12513 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:04.225432 15316 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:04.226344 15316 raft_consensus.cc:697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:04.228107 15316 consensus_queue.cc:237] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:04.227092 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:04.230535 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:04.231122 13226 raft_consensus.cc:2376] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3. Re-sending same reply.
I20260709 13:04:04.231186 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 850) took 1192 ms. Trace:
I20260709 13:04:04.235425 13228 rpcz_store.cc:276] 0709 13:04:03.039130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.040491 (+  1361us) service_pool.cc:224] Handling call
0709 13:04:04.231003 (+1190512us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400740ed4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:04.231120 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335885056}
I20260709 13:04:04.235760 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:04.237664 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:04.239490 13228 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
I20260709 13:04:04.240670 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:04.240844 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.242344 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:04.246655 12544 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:04:04.246743 12539 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:04:04.247445 15170 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.247895 15170 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:04.248157 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:04.248907 12545 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:04:04.249212 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:04.250394 15298 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:04.250649 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:04.250990 15298 raft_consensus.cc:697] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:04.251497 15299 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:04.252007 15299 raft_consensus.cc:697] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:04.252059 15298 consensus_queue.cc:237] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:04.252882 15299 consensus_queue.cc:237] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:04.254251 13197 connection.cc:256] RPC call timeout handler was delayed by -1.9897528860000193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
W20260709 13:04:04.254654 13197 connection.cc:256] RPC call timeout handler was delayed by -1.2820775029999822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
I20260709 13:04:04.255673 13197 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:04.238453 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:04.256544 13226 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
I20260709 13:04:04.265583 15316 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.266150 15316 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:04.283090 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1361) took 1099 ms. Trace:
I20260709 13:04:04.283640 12689 rpcz_store.cc:276] 0709 13:04:03.184065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.184245 (+   180us) service_pool.cc:224] Handling call
0709 13:04:03.184569 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.184805 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:04:03.217707 (+ 32902us) log.cc:844] Serialized 14 byte log entry
0709 13:04:04.268688 (+1050981us) spinlock_profiling.cc:243] Waited 4.25 ms on lock 0x7b180031c6c0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a6406c0a 00007fc3afb46219 00007fc3a648ea40 00007fc3a64894e4 00007fc3a6489455 00007fc3a9571060 00007fc3a9583716 00007fc3a9594287 00007fc3a9594208
0709 13:04:04.282658 (+ 13970us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:04.282720 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:04.282785 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.282866 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.283025 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12084,"prepare.queue_time_us":37712,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":61,"raft.queue_time_us":1052747,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":51,"spinlock_wait_cycles":9768320,"thread_start_us":13652,"threads_started":1}
I20260709 13:04:04.285822 15058 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:04.286681 15058 consensus_queue.cc:1059] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:04.288477 15108 raft_consensus.cc:3055] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:04.289002 15108 raft_consensus.cc:740] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:04.289846 15108 consensus_queue.cc:260] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:04.288295 15058 consensus_queue.cc:1059] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:04.291023 15108 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:04.298058 15058 raft_consensus.cc:3055] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:04.298534 15058 raft_consensus.cc:740] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:04.299508 15058 consensus_queue.cc:260] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:04.300690 15058 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:04.311642 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:04.312600 12538 raft_consensus.cc:2393] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 4: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:04.340786 15226 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.357105 15226 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:04.369753 15226 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:04.384559 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.384855 15299 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:04.385504 15299 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:04.394380 15299 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:04.395989 15150 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:04.396556 15150 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:04.398849 15223 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.039s	sys 0.038s
W20260709 13:04:04.399240 15223 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.039s	sys 0.038s
W20260709 13:04:04.404188 13235 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 539) took 2333 ms (client timeout 1552 ms). Trace:
W20260709 13:04:04.404675 13235 rpcz_store.cc:269] 0709 13:04:02.071032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.081344 (+ 10312us) service_pool.cc:224] Handling call
0709 13:04:04.403926 (+2322582us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b54005965d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:04.404099 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1238840192}
W20260709 13:04:04.406855 13234 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 603) took 2234 ms (client timeout 2472 ms). Trace:
W20260709 13:04:04.407280 13234 rpcz_store.cc:269] 0709 13:04:02.172487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.289074 (+116587us) service_pool.cc:224] Handling call
0709 13:04:04.406675 (+2117601us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400740254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:04.406788 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2832719104}
I20260709 13:04:04.413619 12513 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:04.414651 15299 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:04.415088 15299 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.415459 15299 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:04.416152 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:04.422346 13227 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:04.423659 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 1424) took 1070 ms. Trace:
W20260709 13:04:04.424413 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.424119 12691 rpcz_store.cc:276] 0709 13:04:03.353261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.370435 (+ 17174us) service_pool.cc:224] Handling call
0709 13:04:04.423477 (+1053042us) spinlock_profiling.cc:243] Waited 5.34 ms on lock 0x7b540041fad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:04.423595 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12288768}
W20260709 13:04:04.426175 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.429270 15311 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.429801 15311 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:04.430274 12622 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 7 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:04.431802 15311 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:04.434152 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:04.433707 15150 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:04.438081 15150 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:04.444329 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 1.14854e+06us
I20260709 13:04:04.447415 15305 consensus_queue.cc:1059] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:04.454438 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:04.455754 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:04.456820 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:04.457304 12621 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:04.457554 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:04.457856 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:04.458209 12689 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:04.458462 12693 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:04.459816 12620 raft_consensus.cc:2393] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:04.464470 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 587) took 2528 ms. Trace:
I20260709 13:04:04.464869 13232 rpcz_store.cc:276] 0709 13:04:01.936139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.936265 (+   126us) service_pool.cc:224] Handling call
0709 13:04:02.050331 (+114066us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:02.347773 (+297442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.464216 (+2116443us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54006a3bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:04.464408 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":674088192}
I20260709 13:04:04.466369 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:04.468945 15206 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.469475 15206 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:04.470925 12693 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:04.471534 15206 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:04.476995 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.480381 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1417) took 1218 ms. Trace:
I20260709 13:04:04.502068 12687 rpcz_store.cc:276] 0709 13:04:03.263378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.265672 (+  2294us) service_pool.cc:224] Handling call
0709 13:04:04.478780 (+1213108us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:04.478992 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:04.479018 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:04.479064 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:04.479119 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.479187 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.480165 (+   978us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b5400240250. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:04.480310 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2788768128}
I20260709 13:04:04.490484 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2655) took 3197 ms. Trace:
I20260709 13:04:04.511771 12615 rpcz_store.cc:276] 0709 13:04:01.292903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.957113 (+664210us) service_pool.cc:224] Handling call
0709 13:04:03.780776 (+1823663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.781022 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:03.781066 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:03.781162 (+    96us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:03.781217 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:03.781305 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.490269 (+708964us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b540031cc50. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:04.490416 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4037916416}
I20260709 13:04:04.514043 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:04.515630 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:04.507232 15115 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:04.518290 15115 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:04.519496 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.521875 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:04.508597 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:04.522446 13233 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:04.523185 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:04.523938 12622 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 6: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:04.491259 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:04.524950 12695 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:04.525964 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:04.526401 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:04.526759 12622 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 7: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:04.527024 13231 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:04:04.527557 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:04.487123 12540 raft_consensus.cc:2955] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:04:04.529873 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:04.532317 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.461387 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:04.533856 12620 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:04.533322 15206 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.538425 15206 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:04.539425 12541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1314) took 2254 ms (client timeout 2112 ms). Trace:
W20260709 13:04:04.539856 12541 rpcz_store.cc:269] 0709 13:04:02.285367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:02.285596 (+   229us) service_pool.cc:224] Handling call
0709 13:04:04.539198 (+2253602us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54002eb3d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:04.539347 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479225088}
I20260709 13:04:04.537647 15316 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:04.542954 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:04.506542 15102 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:04.549932 15206 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:04.449463 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:04.561143 13233 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
W20260709 13:04:04.516058 12613 consensus_meta.cc:287] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.669s	user 0.009s	sys 0.000s
I20260709 13:04:04.564596 12613 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:04.565219 15051 raft_consensus.cc:3055] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:04.565692 15051 raft_consensus.cc:740] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:04.566658 15051 consensus_queue.cc:260] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:04.567878 15051 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:04.571270 15170 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:04.572746 13229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 843) took 2955 ms (client timeout 2528 ms). Trace:
I20260709 13:04:04.575156 13230 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:04:04.573129 13229 rpcz_store.cc:269] 0709 13:04:01.617741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:01.617887 (+   146us) service_pool.cc:224] Handling call
0709 13:04:04.572532 (+2954645us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b540022e054. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:04.572647 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1491835648}
I20260709 13:04:04.578135 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1428) took 1158 ms. Trace:
I20260709 13:04:04.578539 12694 rpcz_store.cc:276] 0709 13:04:03.419552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.420084 (+   532us) service_pool.cc:224] Handling call
0709 13:04:03.420355 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.420546 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:04:03.420804 (+   258us) log.cc:844] Serialized 14 byte log entry
0709 13:04:04.577773 (+1156969us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:04.577828 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:04.577878 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.577961 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.578078 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1009820,"prepare.queue_time_us":1765,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"thread_start_us":146594,"threads_started":1,"wal-append.queue_time_us":195658}
I20260709 13:04:04.583428 15052 raft_consensus.cc:3055] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:04.584029 15052 raft_consensus.cc:740] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:04.593420 14780 raft_consensus.cc:3055] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:04.593926 14780 raft_consensus.cc:740] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:04.594733 14780 consensus_queue.cc:260] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:04.595849 14780 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:04.601001 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:04.585078 15052 consensus_queue.cc:260] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:04.602072 15052 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:04.603497 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.599898 15134 raft_consensus.cc:697] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:04.609946 12613 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:04:04.610217 15134 consensus_queue.cc:237] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:04.615022 12622 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:04.617012 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:04.617734 12622 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 3.
I20260709 13:04:04.619303 12619 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:04.630596 15158 raft_consensus.cc:1064] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
W20260709 13:04:04.631348 15158 raft_consensus.cc:1068] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Unable to promote non-voter 66750b8bbd4c4b3a9695951d0ede3372: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:04:04.633827 15299 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:04.636823 15299 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:04.637620 12620 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
W20260709 13:04:04.638629 12618 consensus_meta.cc:287] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.790s	user 0.013s	sys 0.000s
I20260709 13:04:04.638761 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:04.638980 12618 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:04.639328 12620 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:04.640009 14822 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.640072 12618 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:04:04.640668 14822 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:04.641734 12618 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 13:04:04.642336 12621 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:04.642656 15321 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.643344 12621 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:04.643205 15321 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:04.643842 15305 raft_consensus.cc:3055] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:04.644236 15305 raft_consensus.cc:740] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:04.644500 12621 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:04:04.646260 15294 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:04.646538 12622 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 13:04:04.646788 15294 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:04.648131 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:04.648772 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:04.649132 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:04.649873 12692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1409) took 1486 ms. Trace:
I20260709 13:04:04.650256 12692 rpcz_store.cc:276] 0709 13:04:03.163133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.163321 (+   188us) service_pool.cc:224] Handling call
0709 13:04:03.163620 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.164654 (+  1034us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:03.189020 (+ 24366us) log.cc:844] Serialized 14 byte log entry
0709 13:04:04.637387 (+1448367us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:04.637446 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:04.637495 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.649696 (+ 12201us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:04.649812 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1276834,"prepare.queue_time_us":24588,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":6732,"raft.queue_time_us":1259640,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":188375,"threads_started":1,"wal-append.queue_time_us":239800,"wal-append.run_cpu_time_us":1217,"wal-append.run_wall_time_us":1001255}
I20260709 13:04:04.652444 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:04.645072 15305 consensus_queue.cc:260] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:04.653071 12689 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:04.653857 15305 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:04.642685 14822 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:04.658622 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:04.658723 12691 raft_consensus.cc:1217] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[4.3-6.4]   Dedup: 4.3->[6.4-6.4]
I20260709 13:04:04.659353 12691 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:04:04.659760 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:04.660661 12621 raft_consensus.cc:1240] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:04:04.661181 12693 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:04.662025 12621 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:04:04.662465 12695 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:04:04.663623 12694 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:04.665195 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:04.665751 15321 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:04.669910 12621 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:04:04.671892 15294 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:04.681154 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:04.682363 12687 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:04:04.685529 15294 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:04.682750 12694 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:04:04.683257 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:04.683866 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 234462us
I20260709 13:04:04.690622 12689 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:04.690630 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:04.692482 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:04.694700 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:04.699030 14783 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:04.699656 14783 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:04.561271 15115 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:04.697671 15321 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:04.706620 15115 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:04.708213 12695 raft_consensus.cc:2410] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:04:04.721208 12696 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 7. Current term is 8. Ops: []
W20260709 13:04:04.805929 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:04.807389 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 111116us
I20260709 13:04:04.820142 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:04.822507 12662 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:04.824191 15294 consensus_queue.cc:1059] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:04.823454 15134 consensus_queue.cc:1059] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:04:04.831699 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:04.832131 15294 raft_consensus.cc:3055] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:04.832805 15294 raft_consensus.cc:740] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:04.827611 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:04.833772 15313 raft_consensus.cc:3055] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:04:04.830976 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.834550 12621 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:04.836921 15294 consensus_queue.cc:260] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:04.838044 15299 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.839715 15294 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:04.839192 15299 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:04.833150 13197 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:04.834468 15313 raft_consensus.cc:740] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:04.862198 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:04.863611 12692 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:04.867093 15313 consensus_queue.cc:260] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:04.870428 15313 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:04.872849 15170 consensus_queue.cc:1059] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:04.875451 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:04.878038 12688 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:04.881762 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:04.882588 15316 raft_consensus.cc:3055] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:04.883280 15316 raft_consensus.cc:740] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:04.878750 15321 consensus_queue.cc:1059] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:04.882727 13229 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:04.891774 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 69698us
I20260709 13:04:04.885248 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:04.894922 15058 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:04.895838 12615 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:04.897861 14940 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:04:04.900228 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 67628.2us
I20260709 13:04:04.902339 12587 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:04.885298 15316 consensus_queue.cc:260] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:04.903867 15052 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:04.907248 15316 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:04.893680 12513 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:04:04.910473 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 350074us
W20260709 13:04:04.913228 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.918036 15305 consensus_queue.cc:1059] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 13:04:04.932684 15134 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:04.933326 13229 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:04.877431 13230 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:04:04.939445 15198 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.940605 15198 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:04.975924 14783 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:04.941372 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:04.976967 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:04.976883 14783 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:04.886041 15321 raft_consensus.cc:3055] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:04.942180 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:04.979641 15321 raft_consensus.cc:740] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:04.981487 15321 consensus_queue.cc:260] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
W20260709 13:04:04.942468 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 53712.5us
I20260709 13:04:04.942711 15170 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:04.983870 15170 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:04.984432 15170 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:04.986222 12513 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:04.987322 12513 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:04.988655 15152 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:04.988866 15321 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:04.992496 14780 raft_consensus.cc:3055] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:04.946995 12619 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:04.992987 14780 raft_consensus.cc:740] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:04.942169 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:04.949234 12617 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:04.996109 13233 raft_consensus.cc:3055] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:04.996459 13229 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:04.996534 13233 raft_consensus.cc:740] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:04.949347 12662 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:04.997324 13230 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:04:04.998688 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 49630us
I20260709 13:04:05.000989 15132 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:05.003433 15058 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:05.004529 13232 raft_consensus.cc:1240] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:04.950035 15305 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:05.005934 14940 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:05.006023 15305 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:04.950515 15134 raft_consensus.cc:697] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:05.008086 15134 consensus_queue.cc:237] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:05.009069 15305 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:05.011598 12692 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:04:04.952843 15299 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:05.014093 15299 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:05.014500 15299 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.014986 15299 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:04.939558 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 606) took 1673 ms. Trace:
I20260709 13:04:05.017321 15132 raft_consensus.cc:697] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:05.017729 12696 rpcz_store.cc:276] 0709 13:04:03.266468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.289545 (+ 23077us) service_pool.cc:224] Handling call
0709 13:04:03.289879 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:04.721956 (+1432077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:04.938999 (+217043us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54001effd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:04.939337 (+   338us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3291172736}
I20260709 13:04:04.958683 13197 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:04.960752 15322 consensus_queue.cc:1059] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:04.961199 15309 consensus_queue.cc:1059] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:04:05.019717 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 86021.8us
I20260709 13:04:05.020036 15309 raft_consensus.cc:3055] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:05.019073 15132 consensus_queue.cc:237] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:05.020529 15309 raft_consensus.cc:740] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:04.962038 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:05.021919 12688 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:04.962109 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:04.963716 15270 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.964417 15052 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:04.967799 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:04:05.043234 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 64909.6us
I20260709 13:04:05.044497 15052 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:05.053683 12512 connection.cc:256] RPC call timeout handler was delayed by -1.9907338299999537s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
W20260709 13:04:05.054306 12512 connection.cc:256] RPC call timeout handler was delayed by -1.9051835489999576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27690000000000003s for a response
W20260709 13:04:05.054607 12512 connection.cc:256] RPC call timeout handler was delayed by -1.6608909929999527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
W20260709 13:04:05.054884 12512 connection.cc:256] RPC call timeout handler was delayed by -1.5876636069999677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20450000000000002s for a response
W20260709 13:04:05.055151 12512 connection.cc:256] RPC call timeout handler was delayed by -1.5807376089999252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
W20260709 13:04:05.055457 12512 connection.cc:256] RPC call timeout handler was delayed by -1.5627909929999078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
W20260709 13:04:05.055709 12512 connection.cc:256] RPC call timeout handler was delayed by -1.4663996899998892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20579999999999998s for a response
I20260709 13:04:05.055897 15052 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:05.056157 12512 connection.cc:256] RPC call timeout handler was delayed by -1.4377747529999851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.39180000000000004s for a response
I20260709 13:04:05.022163 15058 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:04:05.056744 12476 debug-util.cc:398] Leaking SignalData structure 0x7b0800034be0 after lost signal to thread 11446
W20260709 13:04:05.078065 12476 debug-util.cc:398] Leaking SignalData structure 0x7b0800034c40 after lost signal to thread 12479
I20260709 13:04:05.084375 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:05.063078 13233 consensus_queue.cc:260] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:05.087072 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:05.089030 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1607) took 1238 ms. Trace:
W20260709 13:04:05.095373 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:05.096028 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:05.098417 12540 consensus_meta.cc:287] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.551s	user 0.011s	sys 0.012s
I20260709 13:04:05.100423 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:05.106796 12687 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:04:05.087239 15052 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:04:05.129588 12476 debug-util.cc:398] Leaking SignalData structure 0x7b08000355a0 after lost signal to thread 12571
W20260709 13:04:05.130039 12476 debug-util.cc:398] Leaking SignalData structure 0x7b08000355e0 after lost signal to thread 12572
W20260709 13:04:05.131466 12476 debug-util.cc:398] Leaking SignalData structure 0x7b0800368ba0 after lost signal to thread 12646
W20260709 13:04:05.133054 12476 debug-util.cc:398] Leaking SignalData structure 0x7b08003a54e0 after lost signal to thread 12720
I20260709 13:04:05.134632 15198 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:05.135324 15198 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:04:05.139707 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 58921.8us
I20260709 13:04:05.137257 12689 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:05.100807 15316 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:04:05.070348 15309 consensus_queue.cc:260] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:05.131477 12613 consensus_meta.cc:287] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.512s	user 0.016s	sys 0.000s
I20260709 13:04:05.189201 12613 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:05.189055 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:05.189682 15309 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:05.190523 12622 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:05.157992 15052 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:05.192032 12588 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.629s (SENT) [suppressed 41 similar messages]
I20260709 13:04:05.158419 15155 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:04:05.159040 13199 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:05.122624 14780 consensus_queue.cc:260] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:05.195293 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 116727us
I20260709 13:04:05.160446 15322 raft_consensus.cc:3055] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:05.160434 15198 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:05.195931 14780 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:05.196235 15322 raft_consensus.cc:740] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:04:05.195993 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.158954 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:05.197841 14940 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:05.198441 14940 raft_consensus.cc:697] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:05.198474 13199 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:05.198869 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:05.199839 15288 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:05.199589 14940 consensus_queue.cc:237] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:05.200227 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:05.094384 12614 rpcz_store.cc:276] 0709 13:04:03.850921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:03.851684 (+   763us) service_pool.cc:224] Handling call
0709 13:04:03.852026 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:03.852278 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:04.891606 (+1039328us) log.cc:844] Serialized 14 byte log entry
0709 13:04:05.061608 (+170002us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:05.071521 (+  9913us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:05.088468 (+ 16947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:05.088590 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:05.088820 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":629726,"prepare.queue_time_us":631399,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":125,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":227,"thread_start_us":506677,"threads_started":2}
I20260709 13:04:05.166990 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:05.200266 15288 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.202898 15288 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:05.203037 12547 raft_consensus.cc:2393] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 5: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:05.168272 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:05.168360 12442 catalog_manager.cc:5697] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 2 to 3, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 3 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:05.204255 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 64130.5us
I20260709 13:04:05.197789 15198 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:05.205621 12442 catalog_manager.cc:5697] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 3 to 4, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 4 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:05.207551 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:05.208235 12538 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:04:05.208616 12547 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:04:05.081039 15270 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:05.209549 15198 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:05.210278 15198 raft_consensus.cc:697] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:05.097343 15170 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:05.175361 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:05.211385 15198 consensus_queue.cc:237] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:05.212399 12541 raft_consensus.cc:2368] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6.
I20260709 13:04:05.213402 14783 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:05.158113 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:05.204941 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:05.214630 12690 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:05.215338 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:05.215618 15058 consensus_queue.cc:1059] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:04:05.178267 12444 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36396 (request call id 352) took 16755 ms (client timeout 15000 ms). Trace:
I20260709 13:04:05.211758 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:05.217260 15115 raft_consensus.cc:3055] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:05.161208 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:04:05.218510 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 77420.6us
I20260709 13:04:05.218664 15052 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:05.217869 12689 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:05.219655 12662 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:05.221036 15133 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:04:05.172039 12476 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3140 after lost signal to thread 13259
I20260709 13:04:05.200987 13199 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:05.223106 15058 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:05.217748 15115 raft_consensus.cc:740] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:05.224804 15115 consensus_queue.cc:260] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:05.231057 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:05.232368 15051 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:05.212327 15170 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:05.217430 12444 rpcz_store.cc:269] 0709 13:03:48.422646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:48.422987 (+   341us) service_pool.cc:224] Handling call
0709 13:03:50.141016 (+1718029us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b5400002490. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6455640 00007fc3af32cb76 00007fc3af436c3e 00007fc3ad8f72a4 00007fc3ad8f7232 00007fc3ad8f7161 00007fc3ad8f70dc 00007fc3ad8f6392 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:05.177977 (+15036961us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:04.099633 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:04.100137 (+   504us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:04.100174 (+    37us) write_op.cc:435] Acquired schema lock
0709 13:04:04.100186 (+    12us) tablet.cc:662] Decoding operations
0709 13:04:04.101201 (+  1015us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:04.101312 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:04.101345 (+    33us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:04:04.102593 (+  1248us) tablet.cc:701] Row locks acquired
0709 13:04:04.102653 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:04:04.102799 (+   146us) write_op.cc:270] Start()
0709 13:04:04.102912 (+   113us) write_op.cc:276] Timestamp: P: 1783602244102737 usec, L: 0
0709 13:04:04.102925 (+    13us) op_driver.cc:348] REPLICATION: starting
0709 13:04:04.306544 (+203619us) log.cc:844] Serialized 4313 byte log entry
0709 13:04:04.364061 (+ 57517us) op_driver.cc:464] REPLICATION: finished
0709 13:04:04.373341 (+  9280us) write_op.cc:301] APPLY: starting
0709 13:04:04.373445 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:04.373749 (+   304us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:04.373918 (+   169us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:04.380966 (+  7048us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:04.381337 (+   371us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:04:04.381391 (+    54us) write_op.cc:312] APPLY: finished
0709 13:04:04.381759 (+   368us) log.cc:844] Serialized 77 byte log entry
0709 13:04:04.382648 (+   889us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:04.382778 (+   130us) write_op.cc:454] Released schema lock
0709 13:04:04.382843 (+    65us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:04.532987 (+150144us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400235fd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9574e28 00007fc3acfaf581 00007fc3acfaed58 00007fc3acfb39f1 00007fc3acfb39a9 00007fc3acfb3939 00007fc3acfb3901 00007fc3acfb2b2d 000000000038f354 000000000038f199
0709 13:04:04.533202 (+   215us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:04.533233 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2934464,"reported_tablets":28,"spinlock_wait_cycles":56205056,"child_traces":[["op",{"apply.queue_time_us":8972,"apply.run_cpu_time_us":6980,"apply.run_wall_time_us":9977,"num_ops":10,"prepare.queue_time_us":2044,"prepare.run_cpu_time_us":18079,"prepare.run_wall_time_us":433521,"raft.queue_time_us":8584,"raft.run_cpu_time_us":1130,"raft.run_wall_time_us":5111,"replication_time_us":260947,"spinlock_wait_cycles":466652928,"thread_start_us":62750,"threads_started":4,"wal-append.queue_time_us":46107}]]}
I20260709 13:04:05.249415 13233 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:05.209233 12442 catalog_manager.cc:5697] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 2 to 4, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 4 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
W20260709 13:04:05.254874 12476 debug-util.cc:398] Leaking SignalData structure 0x7b08003a2420 after lost signal to thread 15070
W20260709 13:04:05.262880 12476 debug-util.cc:398] Leaking SignalData structure 0x7b080004f960 after lost signal to thread 15101
I20260709 13:04:05.140643 15152 raft_consensus.cc:697] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:04:05.281612 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 62085.5us
I20260709 13:04:05.288810 12688 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
W20260709 13:04:05.289176 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 74314.7us
W20260709 13:04:05.288796 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 43592.5us
I20260709 13:04:05.295704 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:05.279364 12692 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
W20260709 13:04:05.299376 12512 connection.cc:256] RPC call timeout handler was delayed by -1.3669835489999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3367s for a response
I20260709 13:04:05.296737 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:05.309656 12510 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:05.322000 12614 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:04:05.324218 12512 connection.cc:256] RPC call timeout handler was delayed by -1.1759892510000327s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25630000000000003s for a response
I20260709 13:04:05.298275 12442 catalog_manager.cc:5697] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:05.330417 15270 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:05.333105 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 77364.9us
I20260709 13:04:05.329135 13197 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:05.298547 15052 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:04:05.348598 12512 connection.cc:256] RPC call timeout handler was delayed by -1.0852390719999221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1656s for a response
I20260709 13:04:05.237460 15322 consensus_queue.cc:260] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:05.360319 12662 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:05.360013 12442 catalog_manager.cc:5697] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:05.362644 12442 catalog_manager.cc:5697] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 2 to 3, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 3 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.364069 15008 consensus_queue.cc:1059] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:04:05.365898 15008 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:05.366407 15008 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:05.366902 15008 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:05.370307 15386 log.cc:927] Time spent T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.115s	user 0.002s	sys 0.000s
W20260709 13:04:05.374135 12476 debug-util.cc:398] Leaking SignalData structure 0x7b08003b27a0 after lost signal to thread 15275
W20260709 13:04:05.374593 12476 debug-util.cc:398] Leaking SignalData structure 0x7b0800339f80 after lost signal to thread 15278
W20260709 13:04:05.374828 12476 debug-util.cc:398] Leaking SignalData structure 0x7b08002baec0 after lost signal to thread 15281
W20260709 13:04:05.377684 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:05.378408 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.378113 15052 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:05.379331 15295 raft_consensus.cc:3055] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:05.379827 15295 raft_consensus.cc:740] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:05.380505 15052 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:05.357231 12510 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:05.385430 12689 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:05.364945 12442 catalog_manager.cc:5697] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 2 to 5, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 5 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:04:05.386505 12694 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:05.380861 15295 consensus_queue.cc:260] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:05.389091 15384 consensus_queue.cc:1059] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:05.390192 15384 raft_consensus.cc:3055] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:05.390419 15295 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:05.391161 15294 consensus_meta.cc:287] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.005s
I20260709 13:04:05.380262 15152 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:05.392202 12696 raft_consensus.cc:2410] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:04:05.349059 15170 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.394192 15170 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:05.390686 15384 raft_consensus.cc:740] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:05.396391 15170 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:05.397063 12695 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:04:05.397464 12695 pending_rounds.cc:85] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 6
I20260709 13:04:05.396863 15384 consensus_queue.cc:260] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:05.397725 12695 pending_rounds.cc:107] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:04:05.398196 12695 raft_consensus.cc:2889] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:05.400326 12695 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:04:05.402215 12695 raft_consensus.cc:3055] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:05.402796 12695 raft_consensus.cc:740] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:05.404148 12695 consensus_queue.cc:260] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:05.405709 15305 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:04:05.406430 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.387323 12620 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:04:05.409664 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:05.410331 13233 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:04:05.412355 12689 raft_consensus.cc:2410] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:04:05.398025 15155 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:05.414284 15155 raft_consensus.cc:697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:05.415555 15155 consensus_queue.cc:237] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:05.416565 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.405969 15299 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:05.428889 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:05.430903 12659 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:05.435478 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 82859.2us
I20260709 13:04:05.438349 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:05.436656 12693 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:04:05.446288 12442 catalog_manager.cc:5697] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 2 to 3, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 3 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:05.458773 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 234314us
I20260709 13:04:05.439126 15322 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:05.479686 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.468204 15058 raft_consensus.cc:697] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:05.481969 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:05.483413 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.485054 12442 catalog_manager.cc:5697] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:05.486073 15384 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:05.487085 12442 catalog_manager.cc:5697] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:05.488476 12442 catalog_manager.cc:5697] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 2 to 3, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 3 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:05.490945 12687 raft_consensus.cc:2410] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:04:05.490433 12442 catalog_manager.cc:5697] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:05.491935 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:05.493146 12538 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:05.434495 15305 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:05.494518 12620 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: [3.5-5.6]
I20260709 13:04:05.496055 15305 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:05.499259 12541 raft_consensus.cc:2410] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:04:05.502180 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:05.473515 15051 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:05.506273 15051 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:05.506680 15051 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:05.510239 12546 raft_consensus.cc:1240] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:04:05.511858 12618 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:04:05.515033 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 463212us
I20260709 13:04:05.422875 15132 consensus_queue.cc:1059] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:04:05.518973 12695 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:05.489039 15008 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:05.442749 15134 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.074s
W20260709 13:04:05.527292 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.515928 15170 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:04:05.535259 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 51615us
I20260709 13:04:05.537307 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:05.552511 15388 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:05.553236 15388 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:05.555449 15115 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:05.555830 15388 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:05.556465 15388 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.555303 15052 consensus_queue.cc:1059] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:05.523522 15309 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
W20260709 13:04:05.568648 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.538393 15316 consensus_queue.cc:1059] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:04:05.574268 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:05.575387 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 168197us
I20260709 13:04:05.587165 12588 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:05.599512 12538 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 13:04:05.609592 12541 raft_consensus.cc:2410] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:04:05.610260 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:05.586175 15270 raft_consensus.cc:3055] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:04:05.617995 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.618059 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:05.619158 15008 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:05.620575 15393 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:05.621054 15393 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:05.628057 15389 log.cc:927] Time spent T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.143s	user 0.002s	sys 0.000s
I20260709 13:04:05.631946 15158 raft_consensus.cc:3055] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:05.632581 15158 raft_consensus.cc:740] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:05.635049 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:05.637023 15384 raft_consensus.cc:3055] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:05.637511 15384 raft_consensus.cc:740] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:05.638449 15384 consensus_queue.cc:260] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:05.639324 15288 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:05.639775 15384 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:05.642182 12512 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:05.643461 15316 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:05.643939 15316 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:05.644356 15316 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:04:05.651537 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.641851 15058 consensus_queue.cc:237] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:05.557109 15388 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:05.645040 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 320087us
W20260709 13:04:05.653156 12662 connection.cc:256] RPC call timeout handler was delayed by -1.6755041969998956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2528s for a response
I20260709 13:04:05.658041 15223 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:05.658443 12546 raft_consensus.cc:1240] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:05.621410 15393 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:05.614724 15198 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.615222 15270 raft_consensus.cc:740] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:05.675213 15198 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:05.678380 12538 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:05.678567 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:05.631209 15051 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:05.680676 12662 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:05.681519 15051 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:05.683336 13197 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:05.686347 12545 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:05.686599 15295 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:05.689406 15288 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:05.660382 15299 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:05.690285 12614 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:05.686409 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:05.664598 14940 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.707336 13197 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:05.710755 12622 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:04:05.710917 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.693668 15198 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:05.714357 12613 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:05.706629 15295 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:05.711783 15313 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:05.708316 15288 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:05.703085 14940 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:05.756960 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1345) took 1486 ms. Trace:
W20260709 13:04:05.759320 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 181332us
I20260709 13:04:05.759271 15394 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:04:05.759413 12546 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: []
W20260709 13:04:05.759583 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 79118.3us
I20260709 13:04:05.764596 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:05.767699 12691 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:05.718890 15309 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 13:04:05.731395 15295 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:05.761546 12540 rpcz_store.cc:276] 0709 13:04:04.246097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.486398 (+240301us) service_pool.cc:224] Handling call
0709 13:04:04.486749 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:04.486985 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:05.098988 (+612003us) log.cc:844] Serialized 14 byte log entry
0709 13:04:05.704267 (+605279us) log.cc:844] Serialized 14 byte log entry
0709 13:04:05.713276 (+  9009us) log.cc:844] Serialized 14 byte log entry
0709 13:04:05.717964 (+  4688us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:05.718032 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:05.727016 (+  8984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:05.732435 (+  5419us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:05.732599 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2251,"raft.queue_time_us":19897,"raft.run_cpu_time_us":477,"raft.run_wall_time_us":46722,"thread_start_us":528945,"threads_started":2,"wal-append.queue_time_us":370337}
I20260709 13:04:05.740628 15288 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:05.695005 15158 consensus_queue.cc:260] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:05.762887 15412 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.760218 15391 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:05.797542 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.790241 15309 consensus_queue.cc:1243] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer a11816c5d72e4d1295a242f3ced09e5f log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:04:05.781499 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:05.820493 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 57690.6us
I20260709 13:04:05.827410 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:05.827397 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.812845 15295 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:05.812070 15288 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:05.839362 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 71952.6us
I20260709 13:04:05.738811 15270 consensus_queue.cc:260] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:05.820456 15051 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:05.851181 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.826649 15412 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:05.835826 15170 raft_consensus.cc:697] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:05.846737 12512 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:05.859689 15158 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:05.870946 12588 leader_election.cc:400] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6.
I20260709 13:04:05.834983 15152 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:04:05.862812 15305 consensus_queue.cc:1059] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:04:05.883735 12588 leader_election.cc:403] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:04:05.892184 12662 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:05.892558 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.871546 15388 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:05.897841 15417 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.898331 15417 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:05.900403 15417 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:05.901832 14780 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:04:05.902637 15396 log.cc:927] Time spent T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 13:04:05.913758 12695 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:04:05.914341 12695 pending_rounds.cc:85] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 8
I20260709 13:04:05.861670 15051 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:05.919584 12695 pending_rounds.cc:107] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:04:05.889699 15270 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:05.920605 12695 raft_consensus.cc:2889] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:05.874048 15398 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:05.918263 12618 pending_rounds.cc:85] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 3
I20260709 13:04:05.924613 12618 pending_rounds.cc:107] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:04:05.926257 12618 raft_consensus.cc:2889] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:05.927253 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:05.927996 13227 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:05.868521 15391 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:05.915309 15155 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:05.896502 15409 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:04:05.942595 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:05.947595 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:05.957310 12691 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
W20260709 13:04:05.928359 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 101354us
I20260709 13:04:05.930913 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:05.963749 13227 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:05.943298 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:05.931864 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:05.965967 13232 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:04:05.966279 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:05.966892 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:05.968104 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:05.969062 15051 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:05.937095 15395 log.cc:927] Time spent T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 13:04:05.967090 13230 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 6: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:05.968968 12513 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:05.935606 15313 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:05.935825 15391 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:04:05.970311 15413 log.cc:927] Time spent T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:04:05.969341 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:05.948175 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:05.950712 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:05.928582 15400 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:04:05.984122 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 145080us
I20260709 13:04:05.984288 12513 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:05.916283 14780 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:04:05.936978 14940 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:05.987082 12546 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:05.980324 15313 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:05.994210 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:05.997220 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:05.994359 13199 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:05.961279 15305 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:04:05.989158 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 130262us
W20260709 13:04:05.994652 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 118199us
I20260709 13:04:06.002965 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:05.945832 15415 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:04:06.009680 12691 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:06.011845 15408 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:06.011605 13228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22a877009d42412fb470ba88a418be05"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:04:06.012451 15408 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:06.012916 15408 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:06.015328 13197 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:06.016816 13197 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:06.017712 14940 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:06.017926 15391 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:06.018345 14940 raft_consensus.cc:697] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:06.018410 15391 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:06.018999 15391 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:06.019244 15407 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:04:06.019439 14940 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.021763 15398 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:06.022203 15398 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.022666 15398 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:06.024308 15410 log.cc:927] Time spent T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260709 13:04:06.025801 15401 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
W20260709 13:04:06.029052 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.038079 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:06.039557 12662 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:06.000645 15152 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:06.047147 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:06.048158 12613 raft_consensus.cc:2393] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 6: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:06.046878 15152 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.063503 15152 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:06.068420 15155 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:06.078840 12662 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:06.080647 14783 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:06.081398 14783 consensus_queue.cc:1059] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:06.081638 15132 consensus_queue.cc:1059] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:06.082556 14783 raft_consensus.cc:3055] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:06.082682 15132 raft_consensus.cc:3055] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:06.082979 14783 raft_consensus.cc:740] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:06.083087 15132 raft_consensus.cc:740] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:06.083930 15132 consensus_queue.cc:260] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:06.084995 13227 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:06.085129 15132 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:06.085918 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:06.087285 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:06.088250 13226 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:04:06.083930 14783 consensus_queue.cc:260] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:06.091302 14783 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:06.092803 15394 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:06.093654 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.093361 15394 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.090214 13226 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:06.093070 15313 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.095602 15394 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:06.095877 15313 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:06.104301 15134 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:04:06.107049 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 120788us
I20260709 13:04:06.107343 12695 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:06.108899 12662 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:06.113145 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 75070.3us
I20260709 13:04:06.115594 12512 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:06.117708 15134 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:06.125331 15412 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:06.127781 13234 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:04:06.128330 13234 pending_rounds.cc:85] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Aborting all ops after (but not including) 7
I20260709 13:04:06.128587 13234 pending_rounds.cc:107] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:04:06.128863 13234 raft_consensus.cc:2889] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:06.132292 13228 raft_consensus.cc:606] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:04:06.132879 13228 raft_consensus.cc:614] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:06.105296 12546 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:06.139114 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:06.139720 12620 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:06.140136 15321 raft_consensus.cc:3055] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:06.140589 15321 raft_consensus.cc:740] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:06.140769 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:06.142875 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:06.143502 12621 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:04:06.046850 15316 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.144415 15408 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.146610 15408 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:06.146890 15316 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:06.150630 13199 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:06.148020 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:06.152498 13226 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:06.155948 12620 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:06.153764 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:06.159155 12615 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:06.153738 12513 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:06.160279 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:06.158252 12619 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:04:06.164476 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:06.164829 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:06.168998 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:06.169783 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:06.170387 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:06.170595 12695 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:06.171015 12613 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:06.173379 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.043653 15115 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.122s
W20260709 13:04:06.175887 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.180212 12662 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:06.172454 15198 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:06.181969 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:06.181916 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:06.188140 12691 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
I20260709 13:04:06.166412 15388 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:06.195714 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:06.196849 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:06.172803 14780 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:06.199071 12621 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:06.199522 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:06.189827 15394 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.198115 15313 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:04:06.202281 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 86776.8us
I20260709 13:04:06.166970 15391 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.202943 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:06.203883 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:06.203997 15390 consensus_queue.cc:1059] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:04:06.205183 12620 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:04:06.175161 15158 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:06.165639 15408 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 13:04:06.208634 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.179397 13230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:04:06.219712 12619 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:06.166267 15288 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:06.211038 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.211346 12616 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:06.151929 15321 consensus_queue.cc:260] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:06.205312 15388 raft_consensus.cc:697] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:06.190941 15409 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:04:06.213963 13228 raft_consensus.cc:2368] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6.
I20260709 13:04:06.168685 15393 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.215545 15419 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:06.215826 15418 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:06.218376 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:06.051270 15170 consensus_queue.cc:237] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:04:06.221264 12613 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:06.232515 13232 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:06.234056 12620 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: [4.3-6.4]
I20260709 13:04:06.235395 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:06.238108 12546 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:06.238933 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:06.239903 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:06.240439 12613 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:04:06.241417 15321 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:06.247043 13229 raft_consensus.cc:2393] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:06.259881 12545 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:04:06.261225 12662 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:06.261161 13200 leader_election.cc:336] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.534s (SENT)
I20260709 13:04:06.232800 13230 raft_consensus.cc:606] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:04:06.233127 15419 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.216496 15158 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.289108 12614 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:04:06.293113 15309 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:06.294169 15294 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:06.294744 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:06.294426 15398 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.288239 13227 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:06.314954 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:06.317858 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 104098us
I20260709 13:04:06.297103 13230 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:04:06.349474 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.351619 12616 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
W20260709 13:04:06.358515 13200 leader_election.cc:336] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.618s (SENT)
I20260709 13:04:06.361059 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:06.362986 13230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:04:06.307665 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:06.268183 15295 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.286522 14780 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:06.226963 15394 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.353396 12659 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:06.376653 15133 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:06.377609 15133 raft_consensus.cc:697] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:06.378796 15133 consensus_queue.cc:237] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.364114 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:06.358683 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 66014.5us
I20260709 13:04:06.359186 13200 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:06.383998 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:06.385037 15008 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:06.304487 15419 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:06.370833 13235 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:06.391683 15322 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:06.342363 15132 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:06.404973 12662 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:06.302445 13233 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:06.402990 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:06.408248 12613 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:06.408105 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:06.413607 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.395849 13230 raft_consensus.cc:606] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:04:06.410121 15008 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:06.421713 15008 raft_consensus.cc:697] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:06.422842 14940 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:06.422760 15008 consensus_queue.cc:237] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:06.432189 13197 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:06.443147 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 84663.8us
I20260709 13:04:06.440554 13233 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:04:06.444576 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:06.445191 12613 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:04:06.417224 13230 raft_consensus.cc:614] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:04:06.446259 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.447193 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:06.447856 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.448904 12513 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:04:06.455907 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 55686.8us
W20260709 13:04:06.457437 15433 log.cc:927] Time spent T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.150s	user 0.001s	sys 0.002s
I20260709 13:04:06.472338 12615 raft_consensus.cc:2410] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:04:06.446740 15404 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:04:06.481420 13200 leader_election.cc:336] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.632s (SENT)
I20260709 13:04:06.505231 15404 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.504597 15390 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:04:06.464372 15436 log.cc:927] Time spent T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:04:06.407388 15388 consensus_queue.cc:237] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:06.466104 15435 log.cc:927] Time spent T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:04:06.515516 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:04:06.510277 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 103200us
I20260709 13:04:06.490072 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:06.516233 13234 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
I20260709 13:04:06.558269 12613 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:06.558861 13230 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:04:06.457484 15391 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:06.461494 15158 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:06.548959 13200 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:06.509637 15288 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:04:06.536412 15401 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:04:06.557452 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:06.548707 15404 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:06.566282 15426 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.570042 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:06.575996 12615 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:04:06.578389 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 67800.1us
I20260709 13:04:06.574131 12618 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 3.
I20260709 13:04:06.589006 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:04:06.599906 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.565099 15321 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.612298 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:04:06.614014 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 132636us
I20260709 13:04:06.613821 15321 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:06.577328 15305 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.619247 15305 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.577065 15288 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:06.622119 15321 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:06.626972 15398 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:06.627799 15446 log.cc:927] Time spent T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:04:06.572484 15008 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 13:04:06.621831 15288 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.580096 14780 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.635396 12613 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:06.609030 15133 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.634737 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:06.638228 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:06.588857 15426 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:06.648924 15152 consensus_meta.cc:287] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.585s	user 0.009s	sys 0.001s
I20260709 13:04:06.650205 15299 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.651471 15457 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:04:06.658424 15152 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.613425 15295 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:06.664553 12613 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:04:06.616207 15390 raft_consensus.cc:697] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:04:06.674422 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 67308.3us
I20260709 13:04:06.686412 12613 raft_consensus.cc:1240] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:04:06.662120 15394 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:06.661625 14780 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:06.700471 15424 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.704246 12613 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:06.663515 15133 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.708499 15459 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:06.709353 15390 consensus_queue.cc:237] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.676915 15299 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.701222 15424 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:06.720218 15445 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:04:06.724004 12512 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:06.726163 15452 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:06.732661 12615 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:04:06.707593 15152 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:06.734987 15464 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:06.741900 15464 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.742341 15464 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:06.727488 15288 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:06.766845 15299 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:06.747480 15305 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:06.770948 15424 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:06.738590 15452 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:06.781399 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.782322 15452 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:06.778470 15133 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:06.790822 15404 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.793347 15404 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:04:06.794790 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 70869us
I20260709 13:04:06.794209 14780 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:06.802045 15419 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.803699 13228 raft_consensus.cc:2368] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 6. Current term is 7.
I20260709 13:04:06.804795 15419 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:06.793550 15418 consensus_meta.cc:287] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.535s	user 0.007s	sys 0.003s
W20260709 13:04:06.805975 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.804831 12621 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:06.807778 15384 raft_consensus.cc:3055] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:06.808768 15464 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.812551 12512 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:06.814162 15115 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.813650 14780 consensus_queue.cc:1059] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:06.814755 15115 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.815078 14780 raft_consensus.cc:3055] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:06.815748 14780 raft_consensus.cc:740] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:06.812786 15384 raft_consensus.cc:740] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:06.813146 15418 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6.
I20260709 13:04:06.816969 15115 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:06.817382 15384 consensus_queue.cc:260] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.820637 15384 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:06.822165 14780 consensus_queue.cc:260] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.823510 14780 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:06.824445 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.819736 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:06.825539 15393 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:06.826103 13228 raft_consensus.cc:2393] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 6: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:06.827906 15133 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:06.829202 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:06.829865 13228 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:06.831634 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:06.832248 12545 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:04:06.834061 15408 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:06.836637 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:06.837965 12688 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:04:06.840260 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.837886 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:06.842540 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:06.844735 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:06.853195 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:06.854456 12614 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:06.862097 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:06.862848 12690 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:06.866315 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:06.866776 12662 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:06.869059 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:06.869382 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:06.870234 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:06.869256 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:06.871069 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:06.872440 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:06.879029 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:06.880054 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:06.881474 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.881904 15295 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:06.883880 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:06.911008 13232 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:06.911692 12540 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 5: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:06.880749 15409 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:04:06.910876 12621 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:04:06.812278 15417 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.004s	sys 0.022s
W20260709 13:04:06.917212 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:06.913699 12694 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:06.911537 12687 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:06.923374 13228 raft_consensus.cc:2393] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 10: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:06.912027 13226 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:06.918308 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:06.924571 12618 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:06.919872 12615 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:04:06.926206 12693 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:04:06.927428 12513 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:06.930199 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:06.930757 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:06.930962 12688 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:06.932449 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 122851us
W20260709 13:04:06.918499 15417 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.005s	sys 0.022s
I20260709 13:04:06.909835 15305 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.909516 15133 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.913578 15295 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.982678 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:06.983389 12615 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:06.910872 15407 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:06.985482 13226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
W20260709 13:04:06.963560 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 145891us
W20260709 13:04:06.985625 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 46241.4us
I20260709 13:04:06.987547 13199 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:06.988408 15452 consensus_queue.cc:1059] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:04:07.010422 15464 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:07.011211 15438 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:07.011675 15438 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.012070 15438 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:07.016134 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:07.016412 15426 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:07.018735 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 63731.4us
I20260709 13:04:07.021190 15008 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:04:07.022285 15468 log.cc:927] Time spent T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:04:07.022018 15008 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:07.024204 15008 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:07.026242 12620 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:06.984717 15133 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:07.031762 15133 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:06.989591 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:07.035495 12512 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:06.972193 15158 consensus_queue.cc:1059] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 13:04:07.036821 15158 raft_consensus.cc:3055] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:07.037192 15158 raft_consensus.cc:740] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:07.037753 15464 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:07.038260 15464 raft_consensus.cc:697] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:06.934978 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:07.045192 13200 leader_election.cc:336] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.096s (SENT)
W20260709 13:04:07.046895 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.067451 13200 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:07.072209 12692 raft_consensus.cc:2410] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:04:07.095451 12512 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:06.995302 15295 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:07.101287 12512 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:07.039142 15464 consensus_queue.cc:237] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:06.978142 15305 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:07.067535 15391 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.121546 12688 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:07.129428 13232 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
W20260709 13:04:07.130810 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 85655.1us
W20260709 13:04:07.131048 12510 leader_election.cc:336] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 2.396s (SENT)
W20260709 13:04:07.129757 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 182806us
I20260709 13:04:07.068105 15058 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:04:07.132128 12662 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:07.108692 14780 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.069301 15407 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:07.105675 15384 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:07.131456 13200 leader_election.cc:336] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.785s (SENT)
I20260709 13:04:07.108963 15471 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:04:07.148101 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 525303us
I20260709 13:04:07.103268 13231 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
W20260709 13:04:07.143632 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 156144us
I20260709 13:04:07.149515 13200 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:07.156098 13199 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:04:07.160135 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 63106.6us
I20260709 13:04:07.161164 12512 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:07.150981 14780 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:07.173089 13199 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:07.169817 12662 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:07.175210 12662 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:07.151629 15467 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:07.170775 12587 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:07.133098 14783 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.213657 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:07.212170 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 80735.7us
W20260709 13:04:07.214991 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.215672 12691 raft_consensus.cc:1240] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:07.222707 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:07.226872 12616 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:07.227558 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:07.228336 13232 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
W20260709 13:04:07.229499 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.213160 12512 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:07.181912 15198 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:07.233821 15460 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.234411 15460 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:07.236780 15460 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:07.211897 14783 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:07.238685 14783 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:07.191113 15155 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 13:04:07.240710 15416 log.cc:927] Time spent T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.002s
I20260709 13:04:07.208035 15170 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 13:04:07.212119 15476 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:04:07.243742 12512 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:07.244423 15456 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:04:07.212843 15474 log.cc:927] Time spent T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:04:07.247167 15316 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:04:07.248443 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 77783.9us
I20260709 13:04:07.249043 15305 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:07.249122 15198 raft_consensus.cc:697] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:07.249778 15415 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:07.208997 15134 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:07.250255 15198 consensus_queue.cc:237] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:07.251080 15134 raft_consensus.cc:697] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:07.170413 15417 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:07.125496 15391 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:07.193838 15115 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:07.134932 15408 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:07.264815 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:07.265326 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:07.280503 12620 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:07.178967 15481 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.266396 12618 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:07.194164 15467 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:07.192121 15133 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:07.245289 15456 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:07.264101 12616 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:07.214932 15270 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.317875 12546 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 7. Current term is 9. Ops: []
I20260709 13:04:07.134855 15158 consensus_queue.cc:260] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:07.314766 15456 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.318714 15456 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:07.318965 15158 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:07.290493 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:07.311172 15467 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:07.282485 15471 consensus_queue.cc:1059] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:04:07.290887 12538 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:07.250257 15415 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.168845 15051 consensus_queue.cc:1059] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:04:07.209049 15409 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:07.261884 15417 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:07.264125 15452 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:07.313165 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:07.332418 12622 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:07.286628 15477 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:07.317512 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:07.282446 15408 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:07.338550 12544 raft_consensus.cc:2410] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:04:07.264946 15438 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:07.311537 15115 raft_consensus.cc:697] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:07.344677 13235 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:07.343767 13228 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEARNER]: Advancing to term 7
I20260709 13:04:07.329463 15415 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:07.332315 14780 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:07.252121 15134 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:07.338491 15452 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.338305 15417 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:07.351262 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:07.340794 15408 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:07.359048 12539 raft_consensus.cc:2368] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7.
I20260709 13:04:07.346632 15471 consensus_queue.cc:1243] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:04:07.360585 13232 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:07.290308 15481 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:07.318146 15270 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:04:07.366901 13235 raft_consensus.cc:3055] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:07.367362 13235 raft_consensus.cc:740] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:07.368419 13230 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:04:07.368110 13235 consensus_queue.cc:260] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:07.368692 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:07.368832 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:07.369237 13235 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:07.364799 12588 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:07.342288 15426 consensus_queue.cc:1059] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:04:07.355837 15152 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.360138 15452 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:07.383123 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.384646 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:07.373615 12662 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:07.374505 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:07.387476 12547 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:07.392033 13226 raft_consensus.cc:606] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:04:07.373061 15051 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:07.374080 15313 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:07.357520 15155 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:04:07.346596 15477 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:07.398638 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:07.384104 14780 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:07.413520 14780 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:07.415321 15477 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:07.415537 14780 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:04:07.416173 13200 leader_election.cc:336] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.885s (SENT)
I20260709 13:04:07.418108 15270 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:07.418996 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.420246 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:07.407543 15313 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.421132 12695 raft_consensus.cc:2410] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:04:07.421156 15313 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:07.426642 12547 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:07.427717 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:07.428791 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:07.429839 12547 raft_consensus.cc:2393] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 8: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:07.400683 15481 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:07.384071 15152 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:07.404220 15438 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:07.405964 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:07.405751 15115 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:07.406869 13228 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEARNER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:04:07.411379 15008 consensus_queue.cc:1059] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:07.412281 15456 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:07.432729 13235 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:07.436246 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:07.438452 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 513) took 1208 ms. Trace:
I20260709 13:04:07.442338 12538 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:07.446362 12588 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:07.451545 12547 raft_consensus.cc:2410] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:04:07.451007 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:07.443276 15475 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:04:07.457249 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:07.459352 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:07.461213 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:07.449671 12619 rpcz_store.cc:276] 0709 13:04:06.230551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.243081 (+ 12530us) service_pool.cc:224] Handling call
0709 13:04:06.258289 (+ 15208us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:07.130487 (+872198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:07.130528 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:07.147577 (+ 17049us) log.cc:844] Serialized 26 byte log entry
0709 13:04:07.339226 (+191649us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:07.339289 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:07.339495 (+   206us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:07.438147 (+ 98652us) raft_consensus.cc:1685] finished
0709 13:04:07.438187 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:07.438371 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":879295,"raft.queue_time_us":862191,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":3341,"thread_start_us":130815,"threads_started":1,"wal-append.queue_time_us":224221}
I20260709 13:04:07.462105 15152 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:07.521745 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:07.522152 12546 raft_consensus.cc:2393] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 5: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:07.461910 15467 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:07.462975 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:07.456175 15426 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:07.463763 15415 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:07.467494 15391 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:07.420687 15407 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:07.437896 15384 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:07.541640 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:07.472271 15133 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:07.474568 15420 raft_consensus.cc:3055] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:07.476696 15408 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:07.480789 15417 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:07.486770 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:04:07.488929 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.557771 13197 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:07.490042 15444 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.490821 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:07.491798 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1626) took 1121 ms. Trace:
W20260709 13:04:07.481359 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 70864us
I20260709 13:04:07.496239 15313 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:07.482236 15295 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:07.512018 15456 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:07.515466 12622 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:07.482970 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:07.451586 15482 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:04:07.573760 12691 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:07.530843 12659 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:07.514492 12547 raft_consensus.cc:2376] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6. Re-sending same reply.
I20260709 13:04:07.537078 12543 raft_consensus.cc:2393] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 4: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:04:07.574988 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 44238.3us
I20260709 13:04:07.530036 15481 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.451683 15487 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:04:07.468994 15466 log.cc:927] Time spent T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.474s	user 0.001s	sys 0.003s
I20260709 13:04:07.548581 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:07.553707 12613 raft_consensus.cc:3055] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:07.590303 12613 raft_consensus.cc:740] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:07.554065 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:07.557813 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:07.591303 12617 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:04:07.560855 12545 raft_consensus.cc:2410] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:04:07.561704 12614 rpcz_store.cc:276] 0709 13:04:06.370448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.370571 (+   123us) service_pool.cc:224] Handling call
0709 13:04:07.491553 (+1120982us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b54001ea0d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:07.491697 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":942906752}
I20260709 13:04:07.562350 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:07.541554 15305 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:07.565610 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:07.566627 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:07.594350 12620 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:04:07.532287 15418 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:07.596640 12541 raft_consensus.cc:2393] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 8: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:07.571336 13197 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:07.574673 12542 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:07.550256 15420 raft_consensus.cc:740] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:07.585758 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:07.586786 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:07.589016 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:07.601825 12619 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:07.603223 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:07.603828 13197 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:07.604756 13197 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:07.603340 12613 consensus_queue.cc:260] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:07.607246 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:07.607524 15409 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:07.608295 15409 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:07.608834 15409 raft_consensus.cc:697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:07.609822 15409 consensus_queue.cc:237] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:07.613746 15294 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:04:07.614147 15486 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.614706 15486 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:07.616348 12541 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:04:07.616936 15486 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:07.614015 12659 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:07.618553 12659 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:07.619045 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:07.619343 15008 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:07.619626 15486 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:07.619884 15008 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.620385 15008 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:07.620327 15486 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.621289 15486 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:07.619732 12541 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:07.576800 15391 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:07.607146 15478 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:07.623890 12622 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:07.603899 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:07.607299 12613 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:07.630193 12544 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:07.587708 15158 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:07.632045 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:07.632367 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:07.651057 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:07.651856 12617 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:07.651872 12547 raft_consensus.cc:2393] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 6: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:07.656042 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:07.657367 12545 raft_consensus.cc:2393] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 4: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:07.659695 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:07.661341 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:07.572852 15452 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:07.661586 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:07.663017 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:07.664191 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:07.665697 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:07.669508 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:07.669708 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:07.589695 15481 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:07.674870 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:07.676525 12543 raft_consensus.cc:2393] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 8: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:07.676465 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:07.677079 12689 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 6: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:07.680816 12613 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:07.680943 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:07.681869 12690 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:04:07.683382 12690 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:07.680019 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:07.651070 15158 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.687112 12543 raft_consensus.cc:2376] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5. Re-sending same reply.
I20260709 13:04:07.689507 15447 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:07.689631 15420 consensus_queue.cc:260] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:07.690255 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 92336.1us
I20260709 13:04:07.659113 15477 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.717290 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:07.694725 12696 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:04:07.695235 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:07.604431 15418 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:07.696445 12695 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:07.587919 15444 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:07.702521 15494 log.cc:927] Time spent T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:04:07.712452 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:07.721504 12543 raft_consensus.cc:2368] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7.
I20260709 13:04:07.685138 15051 raft_consensus.cc:2764] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:04:07.656669 15115 consensus_queue.cc:1059] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:04:07.724206 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:07.726861 12543 raft_consensus.cc:2410] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:04:07.728677 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:07.711515 15158 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:07.739305 12512 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:07.740681 15152 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.740784 15390 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:07.741510 15415 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:07.742477 15313 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:07.743270 15393 raft_consensus.cc:3055] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:07.742301 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:07.743703 15417 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:07.784140 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 55546.2us
I20260709 13:04:07.744637 15408 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:07.744834 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:07.746130 15478 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:07.749424 15444 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:07.771212 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.744123 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:07.750833 15502 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:07.790438 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 51224.6us
I20260709 13:04:07.791041 12543 raft_consensus.cc:2393] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 6: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:07.795086 12512 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:07.766399 15426 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:07.796947 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:07.801545 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 195245us
I20260709 13:04:07.802301 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:07.796000 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:07.796800 12512 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:07.720407 15477 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:04:07.770146 15170 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:04:07.798094 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 168770us
W20260709 13:04:07.812215 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.783725 15393 raft_consensus.cc:740] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:07.815146 12539 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:07.819900 13197 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:07.820699 12539 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 6. Ops: []
I20260709 13:04:07.808923 12662 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:07.824954 13197 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:07.795100 15467 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:07.830711 13197 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:07.806357 15456 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:07.833910 12543 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:04:07.835439 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:07.836004 12543 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:07.835657 13197 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:07.824208 15134 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:07.770219 15152 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:07.785930 15390 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:07.841118 12541 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:07.819810 15313 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:07.850140 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 53459.1us
I20260709 13:04:07.851200 12512 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:07.840365 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:07.824656 15408 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:07.854933 12662 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:07.798900 15478 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:07.857100 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:04:07.857651 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.857982 12539 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:07.834537 15058 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:07.832484 15409 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:07.860328 12539 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:04:07.861011 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:07.863742 12662 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:07.856657 15170 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
W20260709 13:04:07.868305 15500 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:04:07.873903 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:07.874656 12542 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:07.876739 15133 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:07.877271 15133 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.877671 15133 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:07.877786 15384 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:07.877872 15504 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:07.880276 15390 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:07.881868 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 63271.4us
I20260709 13:04:07.884768 12539 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:04:07.885174 12539 pending_rounds.cc:85] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 6
I20260709 13:04:07.885414 12539 pending_rounds.cc:107] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:04:07.885739 12539 raft_consensus.cc:2889] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:07.887952 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:07.866281 15058 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.806210 15502 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:07.895327 12541 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:07.896795 12541 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:07.897253 12662 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:07.859521 15321 raft_consensus.cc:3055] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:07.862165 15467 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:07.860041 15456 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:04:07.911828 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 45315us
I20260709 13:04:07.891815 15058 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:07.887512 15313 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:04:07.918309 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:07.892143 15393 consensus_queue.cc:260] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:07.922710 15418 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:07.923115 15393 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:07.892146 15409 raft_consensus.cc:697] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:07.858737 15471 consensus_queue.cc:1059] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:04:07.906306 15134 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:04:07.931630 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:07.938321 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 55397.9us
I20260709 13:04:07.906977 15321 raft_consensus.cc:740] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:07.906597 15481 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:07.912644 15456 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.945194 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:07.946070 12695 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:07.947686 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:07.959507 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:07.960299 12540 raft_consensus.cc:2393] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 4: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:07.962162 12512 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:07.963732 15170 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:07.964460 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:07.964423 15170 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:07.965173 12618 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:07.965440 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:07.966185 12613 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:07.964789 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:07.969925 12620 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:07.976687 12688 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:04:07.977344 15502 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:07.977922 15502 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:07.921854 15313 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:07.989717 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 156324us
I20260709 13:04:08.003360 12543 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:07.982527 12620 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:07.941072 15134 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:07.930338 15467 raft_consensus.cc:697] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:07.930833 15452 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:08.020569 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:08.009929 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:08.008811 12588 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:08.023991 12696 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:08.024718 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:08.024541 12695 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:07.952314 15456 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:08.033001 15491 log.cc:927] Time spent T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.283s	user 0.003s	sys 0.000s
I20260709 13:04:08.033361 15152 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:08.016815 15170 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:04:07.937711 15390 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:04:07.998828 15313 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:08.046682 12618 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
W20260709 13:04:08.042377 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 122708us
I20260709 13:04:08.021674 15134 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:08.050065 13200 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:07.988925 15481 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:04:07.978390 15502 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:08.018007 15504 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:08.058105 13200 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:08.062081 15412 raft_consensus.cc:3055] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:08.008316 15008 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:08.046204 15452 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.016616 15505 consensus_queue.cc:1059] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:04:08.093320 12695 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:08.100787 12695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:04:08.101538 12695 raft_consensus.cc:606] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:08.111794 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:08.118482 15509 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:04:08.074295 15412 raft_consensus.cc:740] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:08.078528 15477 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:08.079157 15504 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:08.141705 15504 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:08.142231 15504 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.142678 15504 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:08.145028 15504 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:08.125761 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:08.147717 12618 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:08.152796 15295 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:08.154567 15478 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:08.078123 15409 consensus_queue.cc:237] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:08.098968 15305 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:08.159320 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:08.160822 15501 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:08.167179 12542 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
W20260709 13:04:08.123530 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 204294us
I20260709 13:04:08.050796 15321 consensus_queue.cc:260] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:08.134359 12616 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:08.084812 15452 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:08.132019 12696 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:08.096807 15486 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:08.191761 15223 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:08.193670 12696 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:08.197729 15515 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:04:08.198580 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 208780us
I20260709 13:04:08.102962 15467 consensus_queue.cc:237] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:08.293747 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:08.294013 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 235961us
I20260709 13:04:08.305733 13229 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:08.161531 15501 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:08.224030 12693 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:08.317198 12694 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:04:08.226312 12687 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:04:08.176824 15464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.002s	sys 0.016s
I20260709 13:04:08.208421 12695 raft_consensus.cc:614] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:04:08.350988 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 44493.9us
I20260709 13:04:08.343472 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:08.231696 12689 raft_consensus.cc:2393] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:04:08.304967 15497 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:04:08.228266 15502 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:08.176999 15432 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:08.244240 15478 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.230993 15517 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:08.232503 15487 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:08.367451 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:08.357486 15464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.002s	sys 0.021s
I20260709 13:04:08.306147 15515 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.262490 15426 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:08.373641 13200 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:08.310204 15008 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:08.231194 15486 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:08.378247 12588 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:08.379163 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:08.391053 15426 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:08.391427 13228 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:08.382169 13199 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:08.385694 13227 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:04:08.375563 15404 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:04:08.313290 15456 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:08.390087 12613 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:08.316486 15134 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:08.245266 15133 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:08.228937 15158 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:08.376053 15420 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:08.398727 13199 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:08.231035 15313 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:08.391451 15426 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:08.376559 15487 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:08.407400 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 369266us
I20260709 13:04:08.383374 15515 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:08.222249 15058 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:08.412320 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:08.371279 15478 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:08.404490 15393 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:08.426445 12538 raft_consensus.cc:2393] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 8: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:08.426640 13234 raft_consensus.cc:1240] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:08.412959 13229 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:08.408542 15517 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:08.430014 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.378883 15432 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:08.414855 15452 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:08.474190 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:08.637089 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 172078us
I20260709 13:04:08.640192 13234 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:08.441782 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:08.469599 13230 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:08.641009 12616 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:04:08.643986 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:08.654074 12662 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:08.418809 15426 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:08.645761 12541 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.030s	sys 0.014s
W20260709 13:04:08.444577 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 52375.2us
I20260709 13:04:08.445475 15115 consensus_queue.cc:1059] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.206s
I20260709 13:04:08.444784 15517 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:08.453480 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:08.663513 12541 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.030s	sys 0.014s
I20260709 13:04:08.655171 12692 raft_consensus.cc:2368] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7.
I20260709 13:04:08.658965 15537 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:08.430512 15404 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:08.674611 13233 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:04:08.676294 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:08.676690 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:08.661393 15417 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:04:08.485265 15158 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:08.679695 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:08.690080 12538 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:08.681535 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:08.641100 15051 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:08.670405 15452 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:08.730340 15452 raft_consensus.cc:697] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:08.730149 15051 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:08.731468 15452 consensus_queue.cc:237] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:08.732604 15051 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:08.686524 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:08.733628 15008 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.734167 15008 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:08.735193 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:08.735826 13235 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:08.736313 15008 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:08.737278 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:08.737648 15478 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:08.670382 15528 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.009s
W20260709 13:04:08.698378 15531 log.cc:927] Time spent T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.252s	user 0.000s	sys 0.000s
I20260709 13:04:08.699608 15384 consensus_queue.cc:1059] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:08.702399 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:08.705915 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:08.791389 12542 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:08.710245 15456 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:08.723404 13234 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
W20260709 13:04:08.723917 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 46256.7us
I20260709 13:04:08.666623 15523 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:08.670822 15517 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:08.666836 15409 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:04:08.684320 15404 raft_consensus.cc:697] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:08.722126 12513 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:08.691852 12541 raft_consensus.cc:2393] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 5: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:04:08.739077 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 71794.3us
I20260709 13:04:08.724349 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:08.801013 12587 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:08.802593 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:08.663502 15428 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
W20260709 13:04:08.798664 15538 log.cc:927] Time spent T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:04:08.816162 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 94131.6us
I20260709 13:04:08.799325 12588 leader_election.cc:400] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6.
I20260709 13:04:08.827193 12513 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:08.827358 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:08.829807 12693 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:08.825332 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:08.835727 12687 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:04:08.838552 15464 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:08.839026 15464 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:08.839362 15464 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:08.840441 15501 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:08.842481 12588 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:08.842352 15535 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:08.843199 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:08.843981 12695 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 8: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:08.845021 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:08.741856 15515 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:08.825914 13227 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 7: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:08.853504 12694 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:04:08.821883 15456 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:08.831457 12690 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:08.859154 12587 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:08.827562 15051 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:08.854843 12694 pending_rounds.cc:85] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 6
I20260709 13:04:08.845969 15415 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:04:08.862135 13226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd40576623a84072be59a32d23cda14b"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:04:08.867084 12694 pending_rounds.cc:107] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:04:08.867472 12694 raft_consensus.cc:2889] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:08.867558 13226 raft_consensus.cc:606] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:08.862190 15419 consensus_queue.cc:1059] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:04:08.864369 15412 consensus_queue.cc:260] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:08.876917 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 201113us
I20260709 13:04:08.853076 15428 consensus_queue.cc:1243] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 8.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:04:08.882541 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:08.884013 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:08.810415 15158 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.814278 15523 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:08.885921 12545 raft_consensus.cc:2393] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 6: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:08.911402 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:08.913961 12541 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:08.911744 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:08.919374 13200 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:08.921433 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:08.928990 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:08.875342 15501 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:08.885200 15467 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:08.910796 15428 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:08.935168 13200 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:08.886581 15536 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:08.926832 15115 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:08.967011 15115 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:08.967456 15115 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:08.923693 15158 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:08.972565 15158 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:08.935405 15412 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:08.975565 15419 consensus_queue.cc:1059] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:04:08.931847 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 102849us
I20260709 13:04:08.884418 15456 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:08.978255 15456 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:08.980139 15420 consensus_meta.cc:287] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.565s	user 0.007s	sys 0.002s
I20260709 13:04:08.980782 15456 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:08.940303 15409 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:08.962909 15428 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:08.869449 15505 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:04:08.944201 15444 raft_consensus.cc:3055] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:08.982025 15444 raft_consensus.cc:740] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:08.963758 15467 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:08.983160 15444 consensus_queue.cc:260] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:08.885301 15418 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:04:08.984323 15467 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:08.964893 15487 consensus_meta.cc:287] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.000s
I20260709 13:04:08.984882 15456 consensus_queue.cc:1059] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:08.959290 15515 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:08.960090 15432 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:08.910529 15404 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:08.986208 15456 raft_consensus.cc:3055] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:08.981789 15428 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:08.986617 15456 raft_consensus.cc:740] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:08.987571 15456 consensus_queue.cc:260] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:08.980844 12620 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:08.881508 15464 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:08.981624 12689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 1486) took 1281 ms (client timeout 1614 ms). Trace:
W20260709 13:04:08.990374 12689 rpcz_store.cc:269] 0709 13:04:07.700268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:07.743844 (+ 43576us) service_pool.cc:224] Handling call
0709 13:04:08.981405 (+1237561us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b54000c80d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:08.981531 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1004808576}
I20260709 13:04:08.991230 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:08.939910 15501 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:08.992990 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:08.992378 12542 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:08.995283 15464 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:08.996315 12513 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:08.997306 15464 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:08.997936 15464 raft_consensus.cc:697] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:08.999126 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1482) took 1323 ms. Trace:
I20260709 13:04:08.998837 15464 consensus_queue.cc:237] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:08.999487 12688 rpcz_store.cc:276] 0709 13:04:07.675534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:07.977681 (+302147us) service_pool.cc:224] Handling call
0709 13:04:07.977963 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:07.978282 (+   319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:07.978308 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:08.016453 (+ 38145us) log.cc:844] Serialized 26 byte log entry
0709 13:04:08.405744 (+389291us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:08.422931 (+ 17187us) log.cc:844] Serialized 14 byte log entry
0709 13:04:08.423315 (+   384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:08.423437 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:08.996888 (+573451us) spinlock_profiling.cc:243] Waited 8.53 ms on lock 0x7b1800426d00. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c3f3 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
0709 13:04:08.998845 (+  1957us) raft_consensus.cc:1685] finished
0709 13:04:08.998945 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:08.999071 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16563,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":85493,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":36197,"spinlock_wait_cycles":35699328,"thread_start_us":338879,"threads_started":1,"wal-append.queue_time_us":439515}
I20260709 13:04:08.985483 15487 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:08.990505 12510 leader_election.cc:336] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.734s (SENT)
I20260709 13:04:09.004099 12510 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:09.005234 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 146152us
I20260709 13:04:09.006502 15456 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:09.007565 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:09.011493 12692 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6. Ops: []
W20260709 13:04:09.018399 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 175988us
I20260709 13:04:09.018718 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:09.004662 15501 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:09.017748 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 157616us
I20260709 13:04:09.031103 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:09.031040 13228 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:09.032470 13199 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:04:09.044310 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 53831.7us
I20260709 13:04:09.036718 12542 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
W20260709 13:04:09.045053 12510 leader_election.cc:336] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.775s (SENT)
I20260709 13:04:09.063395 13228 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:09.028450 15544 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:04:09.075888 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 44857.6us
I20260709 13:04:09.048614 15515 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:04:09.079392 12510 leader_election.cc:336] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.852s (SENT)
I20260709 13:04:09.080030 12510 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:09.066407 15409 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.048661 15418 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:09.085441 12689 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:09.074874 15420 raft_consensus.cc:2764] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:04:09.051074 15467 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:04:09.075829 13227 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:09.074493 15536 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:09.057919 15517 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:09.135687 12588 leader_election.cc:400] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 6. Current term is 7.
I20260709 13:04:09.144264 12588 leader_election.cc:403] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:04:09.078740 15515 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:09.136934 13231 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:09.140352 12513 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:04:09.145689 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.086318 15051 raft_consensus.cc:697] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:09.082386 15426 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:09.158341 12542 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:04:09.160193 15051 consensus_queue.cc:237] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:09.150455 15536 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:09.163599 15487 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:09.169456 15407 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:04:09.170487 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 91105.2us
I20260709 13:04:09.172191 15407 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:09.173197 15407 raft_consensus.cc:697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:09.149477 15515 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:09.130610 15418 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:09.119570 15409 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:09.181155 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:09.151130 15432 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 13:04:09.164561 15536 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:09.182376 15551 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:09.190653 15551 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:09.190559 15407 consensus_queue.cc:237] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:09.193131 15551 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:09.193365 15547 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:04:09.194759 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:09.180287 15420 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 6. Current term is 7.
W20260709 13:04:09.200838 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 114811us
W20260709 13:04:09.204969 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.203450 15452 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:09.213325 12659 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:09.219517 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:09.214331 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:09.221112 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:09.216252 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:09.222465 13233 raft_consensus.cc:2376] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5. Re-sending same reply.
I20260709 13:04:09.216468 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:09.200165 15432 consensus_queue.cc:1243] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 8.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:04:09.225178 12542 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:04:09.226329 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:09.227097 13235 raft_consensus.cc:2368] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 6. Current term is 7.
I20260709 13:04:09.227818 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:09.231806 12659 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:09.235112 12538 raft_consensus.cc:1275] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:04:09.211966 15409 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:09.240108 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:09.241525 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:09.242313 13235 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
W20260709 13:04:09.243697 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.245970 12659 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:09.239321 15008 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:04:09.250473 15115 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:09.250523 12510 leader_election.cc:336] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.509s (SENT)
I20260709 13:04:09.252597 15115 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:09.208212 15561 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:04:09.235803 15313 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:09.259315 15313 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:09.259814 15313 raft_consensus.cc:697] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:09.260643 15313 consensus_queue.cc:237] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:09.261621 15518 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:09.262074 15518 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:09.262452 15518 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:09.263863 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:09.267385 12659 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:09.276186 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.277675 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:09.289865 13235 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:09.278348 12659 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:09.293259 13235 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:04:09.298539 12616 raft_consensus.cc:3055] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:09.299012 12616 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:09.205838 15551 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:04:09.236658 15486 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:09.300212 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:09.309832 12688 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:09.275712 15517 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:09.299827 12616 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:09.322549 12616 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:09.323256 15559 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:09.323302 12587 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:09.324167 12512 leader_election.cc:400] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7.
I20260709 13:04:09.324536 12512 leader_election.cc:403] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:04:09.324625 15559 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:09.314764 15432 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:09.311686 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:09.316141 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:09.325129 15544 consensus_queue.cc:1059] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:09.326413 12615 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:09.316898 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:09.327036 15544 raft_consensus.cc:3055] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:09.327083 12541 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:09.325896 15408 raft_consensus.cc:3055] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:09.328004 15408 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:09.328202 15418 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:09.328712 15428 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:09.327313 12619 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:09.299013 15158 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:09.330367 15158 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:09.330794 15158 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:09.331051 15428 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:09.266238 15426 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:09.325444 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:09.333784 12616 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:04:09.335995 15515 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:09.266036 15133 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:09.337124 13234 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:09.316130 15391 raft_consensus.cc:3055] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:09.337841 15391 raft_consensus.cc:740] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:09.338681 15391 consensus_queue.cc:260] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:09.318806 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:09.339901 12621 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:09.320150 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:09.342039 12617 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:09.324813 15536 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:09.325855 12614 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:09.314711 15321 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:09.217065 15452 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:09.347009 12619 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:04:09.348408 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:09.349069 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:09.326987 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:09.286026 15412 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:04:09.355152 12620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 534) took 1335 ms (client timeout 1600 ms). Trace:
I20260709 13:04:09.355446 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:09.358307 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:09.421551 12617 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:09.360590 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:09.352820 12543 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
W20260709 13:04:09.382550 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.325737 15456 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:09.328917 15408 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:09.435230 15408 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:09.302395 15478 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:09.437803 15478 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.438328 15478 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:09.420531 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 167351us
I20260709 13:04:09.427207 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:04:09.424459 12620 rpcz_store.cc:269] 0709 13:04:08.019817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.024330 (+  4513us) service_pool.cc:224] Handling call
0709 13:04:09.354976 (+1330646us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b54002a71d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:09.355091 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2196752640}
I20260709 13:04:09.441627 12618 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:09.351110 15544 raft_consensus.cc:740] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:09.433462 15452 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:09.447350 12614 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:04:09.433825 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:09.462723 12619 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:09.434309 12621 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:09.364283 15551 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:09.325732 15432 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:09.442138 12510 leader_election.cc:336] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 2.156s (SENT)
I20260709 13:04:09.522569 15452 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:04:09.523255 15566 log.cc:927] Time spent T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:04:09.523566 15452 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:09.524856 15523 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:09.525905 15407 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.543581 12659 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:09.530838 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 89522.6us
I20260709 13:04:09.531284 15432 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:09.534221 12688 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:09.535419 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:09.547194 12690 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:09.522694 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:09.538672 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:09.548823 12615 raft_consensus.cc:2393] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 6: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:09.422318 15051 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:09.539510 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:09.548503 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:09.553820 12617 raft_consensus.cc:2410] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:04:09.553578 15544 consensus_queue.cc:260] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:09.554725 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:09.554970 15544 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:09.555843 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:09.556664 12617 raft_consensus.cc:2393] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 8: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:09.423619 15428 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.557397 15428 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:09.558017 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 664) took 1158 ms. Trace:
I20260709 13:04:09.558559 13231 rpcz_store.cc:276] 0709 13:04:08.399547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.404510 (+  4963us) service_pool.cc:224] Handling call
0709 13:04:08.465754 (+ 61244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:09.151730 (+685976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:09.557745 (+406015us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b5400740254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:09.557924 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1535183232}
I20260709 13:04:09.559111 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:09.559538 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:09.559746 12614 raft_consensus.cc:2376] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6. Re-sending same reply.
I20260709 13:04:09.560212 12617 raft_consensus.cc:2393] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:09.557955 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:09.560598 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:09.560949 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:09.561167 12614 raft_consensus.cc:2376] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6. Re-sending same reply.
I20260709 13:04:09.529976 15452 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:09.425324 15536 raft_consensus.cc:697] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 7 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:09.562527 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:09.559960 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:09.561525 12617 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
W20260709 13:04:09.551741 12510 leader_election.cc:336] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.598s (SENT)
I20260709 13:04:09.549871 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:09.566139 12615 raft_consensus.cc:2376] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6. Re-sending same reply.
I20260709 13:04:09.567163 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:09.564839 13229 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:09.566195 12621 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:04:09.444468 15548 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:09.583384 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:09.568279 12510 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:09.584553 12620 raft_consensus.cc:2410] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:04:09.559962 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:09.574663 12659 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:09.562355 15536 consensus_queue.cc:237] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:09.586555 13231 raft_consensus.cc:2393] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 8: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:09.604858 15133 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:09.590363 15452 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:09.607347 15452 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:09.607692 15452 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:09.609692 15561 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:09.610633 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:09.611343 12617 raft_consensus.cc:2393] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:09.612174 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:09.612769 12617 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:04:09.589293 12659 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:09.544982 15551 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:09.723317 13233 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:04:10.078557 15486 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:09.593609 15152 consensus_queue.cc:1059] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.526s
W20260709 13:04:10.101415 15518 consensus_meta.cc:287] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.827s	user 0.010s	sys 0.001s
I20260709 13:04:10.119778 15486 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:10.120162 15564 raft_consensus.cc:3055] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:09.440346 15412 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:10.120913 15564 raft_consensus.cc:740] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:09.614372 15548 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:10.121495 12613 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:04:10.058809 15321 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:10.121994 15564 consensus_queue.cc:260] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:10.122452 15321 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:10.123051 15548 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:09.757141 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:09.830405 15574 log.cc:927] Time spent T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 13:04:09.550660 15407 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:09.584270 15051 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:10.126592 13235 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.008s	sys 0.026s
W20260709 13:04:10.127097 13235 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.008s	sys 0.026s
I20260709 13:04:09.617513 13229 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
W20260709 13:04:09.687240 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:09.605370 15133 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:09.789419 12689 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:10.126171 12543 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:04:10.127143 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 537902us
W20260709 13:04:10.112833 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:10.117873 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 397188us
I20260709 13:04:10.125898 15321 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:09.615432 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:10.114126 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 563135us
I20260709 13:04:10.132339 12659 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:09.638727 12690 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
W20260709 13:04:10.116478 12618 consensus_meta.cc:287] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.605s	user 0.016s	sys 0.006s
I20260709 13:04:10.192518 12618 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:10.194327 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:10.195195 12618 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
W20260709 13:04:10.158281 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:10.198374 12621 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:10.199291 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:10.198179 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:10.200070 12618 raft_consensus.cc:2393] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:10.200381 12614 raft_consensus.cc:2393] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 4: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:10.174175 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:04:10.113793 12619 consensus_meta.cc:287] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.650s	user 0.006s	sys 0.029s
W20260709 13:04:10.195972 12510 leader_election.cc:336] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.675s (SENT)
I20260709 13:04:10.202026 12619 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:10.202097 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:10.196704 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:09.832924 13227 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.017s	sys 0.028s
W20260709 13:04:09.866859 15313 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.002s	sys 0.012s
I20260709 13:04:10.203512 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:10.205847 12618 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:10.209995 12617 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:04:09.671386 15539 raft_consensus.cc:3055] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:09.959726 15515 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:09.800865 15525 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.157545 15133 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:10.159981 15501 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:04:10.198165 15544 consensus_meta.cc:287] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.617s	user 0.012s	sys 0.000s
W20260709 13:04:10.217185 12510 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.711s (SENT) [suppressed 30 similar messages]
W20260709 13:04:10.232076 12510 leader_election.cc:336] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.734s (SENT)
I20260709 13:04:10.232185 12618 raft_consensus.cc:2410] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:04:10.232518 12510 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:10.233150 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:10.157424 15407 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:09.592828 15432 consensus_queue.cc:1059] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.611s
I20260709 13:04:10.221485 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:10.223686 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:04:10.212172 15313 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.946s	user 0.004s	sys 0.019s
I20260709 13:04:10.240000 15313 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:10.120316 15518 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:10.242358 15518 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:10.240381 15313 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.243397 15313 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:10.245771 15051 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:10.224434 15525 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:10.248910 13231 raft_consensus.cc:2393] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 7: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:10.250145 15525 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:10.252197 15313 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:10.254513 15313 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:10.257253 15456 consensus_meta.cc:287] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.747s	user 0.006s	sys 0.000s
I20260709 13:04:09.589916 15008 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.616s
I20260709 13:04:10.197805 15447 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:10.202414 15152 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.212641 15321 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:10.221252 13227 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.033s	sys 0.029s
I20260709 13:04:10.233289 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48978 (request call id 10) took 1383 ms. Trace:
W20260709 13:04:10.223354 15158 consensus_meta.cc:287] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.892s	user 0.012s	sys 0.004s
I20260709 13:04:10.233873 12692 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:10.218040 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:10.220013 15134 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:10.218657 15539 raft_consensus.cc:740] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:10.220501 15563 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:10.238897 12614 raft_consensus.cc:2368] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7.
I20260709 13:04:10.238330 12619 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:10.237011 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:10.258908 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:10.270867 12688 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 8: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:10.267180 12621 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:04:10.265832 13226 rpcz_store.cc:276] 0709 13:04:08.846541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.846686 (+   145us) service_pool.cc:224] Handling call
0709 13:04:10.229415 (+1382729us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b540014b7a0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a94f45e7 00007fc3a9573c68 00007fc3a957384a 00007fc3ae54160a 00007fc3a7ac77d4 00007fc3a7ac7762 00007fc3a7ac7691 00007fc3a7ac760c 00007fc3a7ac68c2 00007fc3a78b448c
0709 13:04:10.229618 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":265205248}
W20260709 13:04:10.262008 15478 consensus_meta.cc:287] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.743s	user 0.009s	sys 0.002s
I20260709 13:04:10.272568 12691 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:04:10.238600 15544 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:04:10.238886 15501 raft_consensus.cc:697] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:10.261186 15407 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:04:10.429935 15579 log.cc:927] Time spent T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 13:04:10.430924 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:10.268589 15152 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:10.432633 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:10.463994 12692 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:10.464157 12619 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:04:10.433064 12695 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:04:10.433249 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 166389us
I20260709 13:04:10.264417 15456 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7.
I20260709 13:04:10.465915 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:10.466570 12618 raft_consensus.cc:2393] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:10.467769 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:10.468577 12614 raft_consensus.cc:2393] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 6: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:04:10.471006 15580 log.cc:927] Time spent T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.354s	user 0.000s	sys 0.001s
W20260709 13:04:10.471402 15452 consensus_meta.cc:287] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.863s	user 0.011s	sys 0.000s
I20260709 13:04:10.471818 15452 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:10.472213 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2749) took 1107 ms. Trace:
I20260709 13:04:10.472025 15539 consensus_queue.cc:260] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:10.473182 15539 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:10.472599 12622 rpcz_store.cc:276] 0709 13:04:09.364649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.365225 (+   576us) service_pool.cc:224] Handling call
0709 13:04:09.424899 (+ 59674us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:09.429222 (+  4323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:09.429252 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:09.429705 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 13:04:09.717655 (+287950us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:09.717713 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:09.717814 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:10.472002 (+754188us) raft_consensus.cc:1685] finished
0709 13:04:10.472023 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:10.472156 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3892,"raft.queue_time_us":4964,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"thread_start_us":287491,"threads_started":1,"wal-append.queue_time_us":706434}
I20260709 13:04:10.474588 12619 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:10.476008 15551 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:10.476572 15551 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:10.477062 15551 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:10.479163 15551 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:10.267979 15321 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:10.480014 15152 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:10.429960 15563 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:10.482028 15321 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:10.483016 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:10.483709 13233 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:10.483809 15563 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:10.430954 15486 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:10.268268 15447 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:10.486182 15501 consensus_queue.cc:237] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:10.487066 15447 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:10.489668 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 678) took 1143 ms. Trace:
I20260709 13:04:10.490939 12614 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:10.491739 12693 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:04:10.489945 13235 rpcz_store.cc:276] 0709 13:04:09.346310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.347411 (+  1101us) service_pool.cc:224] Handling call
0709 13:04:09.347717 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:09.349738 (+  2021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:09.349777 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:09.350187 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 13:04:10.129368 (+779181us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:10.129431 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:10.130379 (+   948us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:10.489432 (+359053us) raft_consensus.cc:1685] finished
0709 13:04:10.489446 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:10.489595 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1687,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":11939,"thread_start_us":684358,"threads_started":1,"wal-append.queue_time_us":695282}
I20260709 13:04:10.431267 15478 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:10.497375 12510 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:10.499189 12617 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:10.499379 12510 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:10.469655 12621 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:10.504750 12618 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:04:10.274081 15158 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:04:10.509045 12694 raft_consensus.cc:2368] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9.
I20260709 13:04:10.510224 12692 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:10.503103 15544 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:10.516127 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:10.517536 12695 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:10.504719 15452 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:10.518560 12692 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:10.504914 15407 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:04:10.545037 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:10.546201 12692 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:10.555977 13199 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:10.570621 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:10.574630 15478 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:10.542207 15563 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:10.580104 12695 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:10.554911 15452 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:10.573352 15525 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:10.591784 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:10.592003 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:10.592587 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:10.594029 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 461765us
I20260709 13:04:10.596105 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:10.596594 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2751) took 1051 ms. Trace:
W20260709 13:04:10.597342 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 98036.9us
I20260709 13:04:10.597767 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:10.590411 15270 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:04:10.594830 12659 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:10.596933 12615 rpcz_store.cc:276] 0709 13:04:09.545611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.604353 (+ 58742us) service_pool.cc:224] Handling call
0709 13:04:09.604670 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:10.115327 (+510657us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:10.228216 (+112889us) log.cc:844] Serialized 14 byte log entry
0709 13:04:10.591593 (+363377us) log.cc:844] Serialized 14 byte log entry
0709 13:04:10.596261 (+  4668us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:10.596321 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:10.596368 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:10.596429 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:10.596541 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":356203,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"thread_start_us":475194,"threads_started":2}
I20260709 13:04:10.589004 15525 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:10.598814 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:10.607596 12659 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:10.601603 15407 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.590826 15452 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:10.618798 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 62907.2us
I20260709 13:04:10.619385 12659 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:10.617952 12510 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:10.606292 15525 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:10.624089 12659 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:10.625739 12662 connection.cc:256] RPC call timeout handler was delayed by -1.5076942450000388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
I20260709 13:04:10.612126 15589 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:10.616073 15501 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:10.617061 15590 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:10.618134 15595 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:10.617302 15511 raft_consensus.cc:3055] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:10.632256 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:10.603212 15133 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:10.643059 15058 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:10.644972 15133 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:10.625190 15515 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:04:10.624117 15407 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:10.651939 12692 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 7: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:10.653156 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:10.659566 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:10.659817 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:10.660547 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:10.660961 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:10.661417 12538 raft_consensus.cc:2410] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:04:10.628402 15158 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:10.623545 15447 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:04:10.661546 12540 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:10.662197 12547 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:10.662266 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:10.668449 12542 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:04:10.642328 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 667) took 2219 ms. Trace:
I20260709 13:04:10.669524 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:10.642769 15511 raft_consensus.cc:740] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:10.661942 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:10.680491 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:10.660583 12539 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 6: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:10.662355 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:10.662385 12620 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:04:10.817548 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:10.852139 12614 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:10.818307 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:10.819197 15589 raft_consensus.cc:697] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:10.820151 15133 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:10.820612 15501 raft_consensus.cc:697] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:10.821846 15588 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.822278 15591 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.822351 12542 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:04:10.824831 15525 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:10.651927 15407 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:10.788568 12617 raft_consensus.cc:1275] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:04:10.663025 15134 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:10.826251 15447 raft_consensus.cc:3055] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:04:10.826680 12510 connection.cc:256] RPC call timeout handler was delayed by -1.333328927000025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.193s for a response
W20260709 13:04:10.794629 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 162423us
I20260709 13:04:10.860903 15133 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:10.831262 15452 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:10.690099 13230 rpcz_store.cc:276] 0709 13:04:08.417450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.417617 (+   167us) service_pool.cc:224] Handling call
0709 13:04:08.417995 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:08.669118 (+251123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:10.636493 (+1967375us) spinlock_profiling.cc:243] Waited 51.3 ms on lock 0x7b540037aad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:10.636665 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117966208}
I20260709 13:04:10.847052 12538 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:10.890339 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:10.891134 12538 raft_consensus.cc:2368] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6.
I20260709 13:04:10.891270 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:10.626720 15486 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:10.870045 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:10.893188 12542 raft_consensus.cc:2393] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 8: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:10.869645 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:10.875676 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:10.892068 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:10.877697 12614 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:10.885285 12662 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:10.886329 12510 connection.cc:256] RPC call timeout handler was delayed by -1.1087318689999393s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
I20260709 13:04:10.880007 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:10.883258 15447 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:10.853725 12619 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:04:10.627189 15522 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:04:10.788616 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 153022us
I20260709 13:04:10.893899 12622 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:10.895098 12547 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:04:10.845048 12541 raft_consensus.cc:2368] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5.
I20260709 13:04:10.666652 15590 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:10.907127 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:10.912375 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:10.913910 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:10.914186 12542 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:10.914585 12546 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:04:10.889164 15133 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:10.918504 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:10.920794 12544 raft_consensus.cc:2393] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 7: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:04:10.922627 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:10.929765 12540 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
W20260709 13:04:10.941521 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 314414us
I20260709 13:04:10.914855 15452 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:10.868532 15588 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:10.944519 12542 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:10.950057 15134 raft_consensus.cc:697] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:10.952201 15134 consensus_queue.cc:237] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:10.942373 13199 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:10.898308 15321 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:04:10.956666 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:10.959793 12620 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:10.966044 15597 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:10.967677 15535 raft_consensus.cc:1064] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:04:10.967507 15486 raft_consensus.cc:697] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:10.878753 15591 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:10.970073 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 57731.1us
I20260709 13:04:10.972689 15478 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:10.976693 15613 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:10.985661 13199 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:04:10.995283 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:10.911398 15511 consensus_queue.cc:260] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:10.983191 15535 raft_consensus.cc:1068] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Unable to promote non-voter 66750b8bbd4c4b3a9695951d0ede3372: Illegal state: Leader has not yet committed an operation in its own term
W20260709 13:04:11.006397 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 105885us
I20260709 13:04:10.911041 15589 consensus_queue.cc:237] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:10.918880 15501 consensus_queue.cc:237] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:10.925158 15447 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:10.959350 15602 consensus_queue.cc:1059] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 13:04:11.012784 12620 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:11.007676 15515 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:11.036371 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:11.037199 12620 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:10.994310 15478 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.044778 12688 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:04:11.046145 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:11.047365 12620 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:04:11.047760 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:11.048735 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:11.049856 12620 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:11.026577 15612 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:11.039919 15511 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:11.054728 12687 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:04:11.051550 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:11.057034 12688 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
W20260709 13:04:11.051887 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.052496 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:10.996726 15613 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:11.042670 15602 consensus_queue.cc:1243] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:04:11.046711 15447 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:11.041113 15525 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:11.063078 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 47039.1us
I20260709 13:04:11.063638 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:11.046275 15515 raft_consensus.cc:697] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:11.064940 12688 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:11.051577 15612 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.041244 15486 consensus_queue.cc:237] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:11.068193 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.068703 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:11.066164 15614 raft_consensus.cc:1064] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
W20260709 13:04:11.116797 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 131241us
I20260709 13:04:11.097761 15535 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.074617 15612 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:11.126106 12690 raft_consensus.cc:2376] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6. Re-sending same reply.
I20260709 13:04:11.075939 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:11.070245 15588 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:11.124958 15554 log.cc:927] Time spent T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:04:11.095924 15613 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:11.067034 15599 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.134263 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:11.134851 12512 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:11.134568 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:11.069046 15590 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:11.137779 12512 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:11.139809 12659 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:11.145767 12620 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:11.141731 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:11.142328 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:11.140784 12659 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:11.125243 15614 raft_consensus.cc:1068] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Unable to promote non-voter 66750b8bbd4c4b3a9695951d0ede3372: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:04:11.151072 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:11.164935 12546 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:11.166143 12540 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:11.167922 12512 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:11.156985 12659 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:11.162964 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:11.171022 12690 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:04:11.173271 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:11.173879 12687 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:11.182080 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:11.186100 15321 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:11.186856 15321 raft_consensus.cc:697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:11.188027 15321 consensus_queue.cc:237] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:11.189924 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:11.190925 15412 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:11.191406 15511 raft_consensus.cc:670] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } [suppressed 2 similar messages]
I20260709 13:04:11.192764 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 602) took 2278 ms. Trace:
I20260709 13:04:11.193125 12545 rpcz_store.cc:276] 0709 13:04:08.914798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.927386 (+ 12588us) service_pool.cc:224] Handling call
0709 13:04:08.927812 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:08.928200 (+   388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:08.928238 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:08.931168 (+  2930us) log.cc:844] Serialized 26 byte log entry
0709 13:04:09.119041 (+187873us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:09.353839 (+234798us) log.cc:844] Serialized 14 byte log entry
0709 13:04:09.356171 (+  2332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:09.356251 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:11.024453 (+1668202us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b18003d4d40. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c3f3 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
0709 13:04:11.192452 (+167999us) raft_consensus.cc:1685] finished
0709 13:04:11.192549 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:11.192670 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3783,"prepare.queue_time_us":33032,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":3850,"raft.queue_time_us":16902,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":4427,"spinlock_wait_cycles":5514624,"thread_start_us":372705,"threads_started":2,"wal-append.queue_time_us":201632}
I20260709 13:04:11.151562 15599 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.196405 15619 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:11.198025 15591 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:11.211813 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:11.217744 12540 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:11.138823 15602 consensus_queue.cc:1059] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:04:11.140187 15618 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.154693 15613 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:11.073901 15601 consensus_queue.cc:1048] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:04:11.096649 15515 consensus_queue.cc:237] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.215828 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:11.213501 12546 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:11.221879 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 614) took 1685 ms. Trace:
W20260709 13:04:11.226104 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 58512us
I20260709 13:04:11.227942 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:11.233857 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1490) took 3123 ms. Trace:
I20260709 13:04:11.238268 12540 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:11.132400 15535 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.237185 12543 rpcz_store.cc:276] 0709 13:04:09.536515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.536695 (+   180us) service_pool.cc:224] Handling call
0709 13:04:09.537043 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:10.131006 (+593963us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:11.221525 (+1090519us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54003ad254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:11.221795 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841782656}
I20260709 13:04:11.216214 15511 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.238220 12696 rpcz_store.cc:276] 0709 13:04:08.101075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.225395 (+124320us) service_pool.cc:224] Handling call
0709 13:04:08.225771 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:08.356898 (+131127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:08.356943 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:08.357524 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 13:04:08.970936 (+613412us) spinlock_profiling.cc:243] Waited 5.23 ms on lock 0x7b1800323fe0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:04:09.079478 (+108542us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:09.079528 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:11.224646 (+2145118us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54003e9ed4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:11.224707 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:11.224755 (+    48us) raft_consensus.cc:1685] finished
0709 13:04:11.224768 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:11.224905 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2439,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":22549,"spinlock_wait_cycles":312108672,"thread_start_us":107870,"threads_started":1,"wal-append.queue_time_us":789979,"wal-append.run_cpu_time_us":2141,"wal-append.run_wall_time_us":1058157}
I20260709 13:04:11.216729 15614 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:11.242949 15622 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:11.243510 15622 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.243857 15622 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:11.235062 15539 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:11.230286 15619 raft_consensus.cc:697] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:11.255292 15133 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.246977 15511 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.257792 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:11.258339 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:11.258447 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:11.253019 15599 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:11.241838 15613 raft_consensus.cc:697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:11.271354 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:11.246667 15614 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.280088 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:11.280970 12620 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:11.298909 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.302000 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:11.234371 15618 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.278975 15614 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:11.294791 15602 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.334729 15602 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:11.344584 15133 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:11.331240 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 672) took 2149 ms. Trace:
I20260709 13:04:11.345513 13227 rpcz_store.cc:276] 0709 13:04:09.179825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.180476 (+   651us) service_pool.cc:224] Handling call
0709 13:04:09.218574 (+ 38098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:09.232944 (+ 14370us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:10.278831 (+1045887us) log.cc:844] Serialized 14 byte log entry
0709 13:04:11.195522 (+916691us) spinlock_profiling.cc:243] Waited 7 ms on lock 0x7b18002fc620. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a6489455 00007fc3acf713c7 00007fc3a95839a7 00007fc3a95930bf 00007fc3a9593038
0709 13:04:11.241873 (+ 46351us) log.cc:844] Serialized 14 byte log entry
0709 13:04:11.270531 (+ 28658us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:11.281931 (+ 11400us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:11.291715 (+  9784us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:11.299901 (+  8186us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:11.328942 (+ 29041us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1865,"prepare.queue_time_us":843218,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":70,"raft.queue_time_us":26623,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":18397,"spinlock_wait_cycles":16110336,"thread_start_us":1074302,"threads_started":3,"wal-append.queue_time_us":169579}
I20260709 13:04:11.353683 15412 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.355168 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:11.357311 12543 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:11.371444 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:11.375130 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:11.357970 15539 raft_consensus.cc:697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:11.383062 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:11.384328 12696 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:04:11.360342 15412 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:11.393620 15535 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:11.374185 12543 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
W20260709 13:04:11.394307 15624 log.cc:927] Time spent T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:04:11.395308 15629 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:11.395866 15629 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.382028 12620 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
W20260709 13:04:11.400712 15628 log.cc:927] Time spent T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 13:04:11.397702 12659 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:11.411140 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:11.413527 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:11.415269 13200 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:11.371822 15619 consensus_queue.cc:237] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:11.418890 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:11.418748 12696 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:11.418687 13200 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:11.374069 15613 consensus_queue.cc:237] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:11.423853 15393 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:11.419045 15620 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.414882 15412 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:11.429734 15620 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.433312 12687 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:11.433971 12691 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:11.439461 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:11.440227 12687 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 13:04:11.441612 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:11.442442 12615 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:11.443274 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:04:11.443876 15633 consensus_queue.cc:1059] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:04:11.444586 15605 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:11.445117 15605 raft_consensus.cc:697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:04:11.448212 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:11.455338 15625 log.cc:927] Time spent T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:04:11.457087 15511 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:11.461395 12538 raft_consensus.cc:3055] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:11.461845 12538 raft_consensus.cc:740] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:11.462610 12538 consensus_queue.cc:260] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:11.463543 12538 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:11.466099 12688 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:11.467958 12587 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:11.423173 15612 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.432233 15601 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:11.471097 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:11.473949 13199 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:11.485853 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:11.487874 12620 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:11.491389 12538 raft_consensus.cc:1275] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:04:11.482008 15588 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:04:11.507365 15536 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.077s	user 0.005s	sys 0.012s
I20260709 13:04:11.421099 15614 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.527453 15588 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:11.542605 15643 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:11.542891 15588 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:11.543244 15643 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.544793 15614 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:11.545245 15637 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:11.535426 15536 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.257s	user 0.005s	sys 0.013s
I20260709 13:04:11.513445 15629 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:11.545882 15637 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.546698 15629 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:11.547335 15629 raft_consensus.cc:697] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:11.548655 15637 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:11.492432 15632 raft_consensus.cc:3055] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:11.437919 15539 consensus_queue.cc:237] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:11.477944 15511 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:04:11.492271 15590 consensus_queue.cc:1059] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:04:11.553385 12545 raft_consensus.cc:2368] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8.
I20260709 13:04:11.557252 12615 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:11.561511 12659 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:11.551610 15632 raft_consensus.cc:740] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:11.564749 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:11.548481 15629 consensus_queue.cc:237] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.568601 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:11.578040 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:11.578963 12615 raft_consensus.cc:2410] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:04:11.587977 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:11.589171 12615 raft_consensus.cc:2410] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:04:11.590345 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:11.590763 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.591405 15590 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.592188 15649 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.591897 15590 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.592686 15649 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:11.593298 15051 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.594307 15051 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:11.593796 12588 connection.cc:256] RPC call timeout handler was delayed by -1.0209492409999257s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
I20260709 13:04:11.595022 15590 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:11.597019 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:11.595322 15649 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:11.596235 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:11.598093 13230 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:11.597314 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:11.598899 13226 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:04:11.599028 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:11.599550 15051 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:11.599696 13230 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:11.603621 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:11.597281 12588 connection.cc:256] RPC call timeout handler was delayed by -1.0209492409999257s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
I20260709 13:04:11.604950 15620 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:11.604329 12588 connection.cc:256] RPC call timeout handler was delayed by -1.0209492409999257s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
W20260709 13:04:11.600226 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.569456 15613 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:11.601986 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:11.602662 12689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1397) took 2421 ms (client timeout 2163 ms). Trace:
I20260709 13:04:11.591835 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:11.600198 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 92670us
W20260709 13:04:11.608112 12689 rpcz_store.cc:269] 0709 13:04:09.166024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.166168 (+   144us) service_pool.cc:224] Handling call
0709 13:04:11.587122 (+2420954us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b540009c254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:11.587237 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1390376704}
W20260709 13:04:11.596073 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 159478us
I20260709 13:04:11.606370 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:11.608683 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 135001us
I20260709 13:04:11.610605 12588 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:11.611512 13226 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:11.612764 13199 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:11.610546 13200 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:11.617067 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:11.617501 12588 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:04:11.617324 12510 leader_election.cc:336] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 2.657s (SENT)
I20260709 13:04:11.618302 15412 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:11.618821 15051 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:11.619240 15051 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:11.614964 15590 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.621526 15590 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.623790 15590 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:11.624691 15428 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:11.627616 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:11.632416 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:11.633313 12538 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:11.606899 15649 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.635967 12588 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:11.636467 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:11.637794 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:11.639801 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:11.640293 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:11.640766 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:11.609536 12620 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:11.645146 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:11.536521 15605 consensus_queue.cc:237] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.642462 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:11.646401 12542 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
I20260709 13:04:11.646817 12620 raft_consensus.cc:2410] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:04:11.643054 15428 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:11.643721 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:11.619601 15051 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:11.645325 12659 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:11.642948 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:11.620165 15613 raft_consensus.cc:697] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:11.648739 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:11.650820 15478 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:11.647610 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:11.660269 13233 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:11.653318 13234 raft_consensus.cc:2410] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:04:11.655426 12588 leader_election.cc:400] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6.
I20260709 13:04:11.660179 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:11.636533 15515 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:11.657068 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:11.662516 12588 leader_election.cc:403] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:11.664687 15599 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:11.660831 15535 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:04:11.665030 15428 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6.
I20260709 13:04:11.665346 15599 raft_consensus.cc:697] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:11.666436 15612 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:11.666320 15599 consensus_queue.cc:237] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:11.667055 15612 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:11.667414 15612 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:11.667251 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:11.667868 15612 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:11.668232 13234 raft_consensus.cc:2393] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 6: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:11.668869 15633 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:11.657727 15590 consensus_queue.cc:1059] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 13:04:11.669888 15590 raft_consensus.cc:3055] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:11.669394 15633 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:11.670316 15590 raft_consensus.cc:740] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:11.670531 15633 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:11.671402 15590 consensus_queue.cc:260] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.672958 15590 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:11.674073 12541 raft_consensus.cc:2410] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 10 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:04:11.677886 15133 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.678409 15133 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.678788 15633 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.680540 15133 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:11.681860 15633 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:11.682531 15613 consensus_queue.cc:237] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:04:11.565757 15632 consensus_queue.cc:260] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.706699 13233 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:11.685400 13226 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:11.664304 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:11.719858 12543 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:04:11.765776 13231 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 588) took 2156 ms (client timeout 1981 ms). Trace:
I20260709 13:04:11.766534 13227 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:11.765887 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:11.767339 15622 consensus_meta.cc:287] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.001s
I20260709 13:04:11.761082 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:11.807039 15652 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:11.655143 15649 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:11.828850 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.759320 15515 raft_consensus.cc:697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:11.677227 15588 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:11.841259 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:11.941190 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 543) took 1260 ms. Trace:
W20260709 13:04:11.941399 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 277191us
I20260709 13:04:11.942055 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:11.884096 13229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 878) took 3442 ms (client timeout 2017 ms). Trace:
I20260709 13:04:11.942868 15618 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:11.932682 15548 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:11.943666 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:11.944335 15548 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.945262 12618 raft_consensus.cc:2393] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 11: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:11.884233 13232 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:04:11.951062 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2755) took 1030 ms. Trace:
I20260709 13:04:11.951627 12618 rpcz_store.cc:276] 0709 13:04:10.920574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.943453 (+1022879us) service_pool.cc:224] Handling call
0709 13:04:11.951006 (+  7553us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:11.952313 15622 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.883526 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:11.941720 15515 consensus_queue.cc:237] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.945930 15588 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:11.946388 15645 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.438s	user 0.002s	sys 0.010s
I20260709 13:04:11.946669 12615 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:11.948000 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:11.945539 13231 rpcz_store.cc:269] 0709 13:04:09.609666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.617730 (+  8064us) service_pool.cc:224] Handling call
0709 13:04:11.765465 (+2147735us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400511b54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:11.765650 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286608128}
I20260709 13:04:11.942092 15270 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:11.953543 12546 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 6: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:11.966586 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:11.968348 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 550) took 1101 ms. Trace:
I20260709 13:04:11.968735 12618 rpcz_store.cc:276] 0709 13:04:10.867532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.967497 (+1099965us) service_pool.cc:224] Handling call
0709 13:04:11.967782 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:11.968051 (+   269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:11.968077 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:11.968118 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:11.968150 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:11.968198 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:11.968299 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:11.973042 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:11.884209 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:11.978794 12620 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:11.980892 12513 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:11.982509 15614 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:11.955320 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:11.983812 13233 raft_consensus.cc:2368] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8.
I20260709 13:04:11.950208 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:11.950302 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:11.986104 12617 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:11.986755 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:11.988298 13234 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:04:12.000473 15602 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:11.983035 15614 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.002390 15614 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:12.004199 12614 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:04:12.005714 12614 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:11.952739 15548 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:11.932680 15551 raft_consensus.cc:3055] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:12.021760 15551 raft_consensus.cc:740] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:12.022661 15551 consensus_queue.cc:260] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:12.023252 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.023737 15551 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:11.942905 12588 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:12.025044 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 82193us
I20260709 13:04:11.988915 12659 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:11.962567 15544 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:04:11.955334 15622 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:12.026661 12588 leader_election.cc:400] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5.
I20260709 13:04:12.026997 12588 leader_election.cc:403] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:04:12.028124 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:12.028748 12688 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:04:12.029011 15426 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:12.029143 12588 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:12.029789 15426 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5.
I20260709 13:04:12.030049 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:12.030388 15426 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:12.030701 12692 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:12.030823 15426 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.031255 15426 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:12.031315 15590 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:12.006918 15627 raft_consensus.cc:3055] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:12.032016 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:12.032238 15627 raft_consensus.cc:740] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:12.032616 12692 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:12.033242 15627 consensus_queue.cc:260] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:04:12.034663 15627 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:12.035226 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:11.953352 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 669) took 2936 ms. Trace:
I20260709 13:04:12.038025 13232 rpcz_store.cc:276] 0709 13:04:09.016867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.017038 (+   171us) service_pool.cc:224] Handling call
0709 13:04:11.884009 (+2866971us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:11.951319 (+ 67310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:11.953161 (+  1842us) spinlock_profiling.cc:243] Waited 2.86 s on lock 0x7b54004989d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:11.953283 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6569636096}
I20260709 13:04:11.963637 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:12.008795 15656 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:11.943315 13229 rpcz_store.cc:269] 0709 13:04:08.441301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:08.441440 (+   139us) service_pool.cc:224] Handling call
0709 13:04:11.883873 (+3442433us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b54004989d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:11.884007 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2090949504}
I20260709 13:04:12.039376 13231 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:04:12.039486 15656 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:11.941767 12621 rpcz_store.cc:276] 0709 13:04:10.680901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:10.681030 (+   129us) service_pool.cc:224] Handling call
0709 13:04:10.681295 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:10.925740 (+244445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:10.925770 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:10.925809 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:10.925845 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:11.940871 (+1015026us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b5400104ad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:11.940938 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:11.941095 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":561484672}
I20260709 13:04:12.030282 12588 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:04:12.039142 12442 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36394 (request call id 338) took 17540 ms (client timeout 15000 ms). Trace:
W20260709 13:04:12.012792 12616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2745) took 2657 ms (client timeout 1894 ms). Trace:
I20260709 13:04:12.013897 13197 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:11.882182 15525 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.043767 12621 raft_consensus.cc:1275] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:04:12.043872 15525 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:12.044780 13197 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:11.962736 13226 raft_consensus.cc:2410] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:04:12.041823 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:12.042605 15588 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:12.046618 15486 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:12.046891 15588 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:12.047060 15223 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:12.047478 15588 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:12.047848 15223 raft_consensus.cc:697] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:12.048812 15223 consensus_queue.cc:237] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:12.047186 15486 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:12.051316 15601 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.007s	sys 0.009s
W20260709 13:04:12.051725 15601 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.007s	sys 0.010s
I20260709 13:04:12.051975 15601 raft_consensus.cc:697] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:12.052232 15058 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:12.053100 15058 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:12.052726 15486 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:12.053023 15601 consensus_queue.cc:237] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:12.053885 15158 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:12.011730 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1354) took 1352 ms. Trace:
I20260709 13:04:12.057078 12544 rpcz_store.cc:276] 0709 13:04:10.659136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:10.659287 (+   151us) service_pool.cc:224] Handling call
0709 13:04:12.011521 (+1352234us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b54004100d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:12.011647 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":598622592}
I20260709 13:04:12.057794 15058 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:12.058784 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.061543 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:12.062477 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:12.062884 15447 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:04:12.063133 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 398803us
I20260709 13:04:12.063148 13232 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:12.064446 13197 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:12.064325 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:12.065150 12695 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:04:12.065737 15565 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:12.065726 15622 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:12.066140 15651 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:12.066425 15565 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:12.066939 15565 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:12.067540 15622 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:04:12.069131 12616 rpcz_store.cc:269] 0709 13:04:09.354915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.355113 (+   198us) service_pool.cc:224] Handling call
0709 13:04:12.012584 (+2657471us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b54001e9bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:12.012698 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4894709120}
I20260709 13:04:12.070537 13232 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:12.070659 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:12.071643 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:12.071661 12616 raft_consensus.cc:2393] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:12.072515 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:12.073276 13229 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:12.073400 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:12.074445 12616 raft_consensus.cc:2410] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:04:12.074173 15588 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:12.075222 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:12.076216 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:12.077185 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:12.113719 15632 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:12.046618 15525 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:12.077445 15486 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:12.165585 12662 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:12.174038 12688 raft_consensus.cc:2393] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 9: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:12.174923 15613 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:12.175088 15486 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:12.008852 12622 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:04:11.949822 15652 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:12.176079 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2766) took 1044 ms. Trace:
I20260709 13:04:12.176434 12622 rpcz_store.cc:276] 0709 13:04:11.131486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.008290 (+876804us) service_pool.cc:224] Handling call
0709 13:04:12.008556 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:12.175818 (+167262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:12.176019 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:12.177348 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:11.949268 15649 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:12.177609 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:12.107033 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 58914.5us
I20260709 13:04:12.178299 12622 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:12.178900 15613 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:12.179771 13235 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
W20260709 13:04:12.116130 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 505618us
I20260709 13:04:12.105983 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 668) took 1873 ms. Trace:
I20260709 13:04:12.102231 15444 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:12.090837 15643 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:12.110333 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:12.186055 12662 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:12.088972 12692 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:12.186224 13200 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:12.187158 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2753) took 1273 ms. Trace:
I20260709 13:04:12.187521 12615 rpcz_store.cc:276] 0709 13:04:10.914218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.591542 (+677324us) service_pool.cc:224] Handling call
0709 13:04:12.187008 (+595466us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b54000997d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:12.187104 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":777521536}
I20260709 13:04:12.188577 12662 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:12.187780 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:12.082548 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:12.083850 12443 catalog_manager.cc:5697] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 3 to 4, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 4 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.190671 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:12.023749 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.099296 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:12.126365 12620 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:12.097851 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:12.096244 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:12.138870 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:04:12.154773 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.159384 12695 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:12.077659 15588 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:12.113855 15487 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:12.129786 15391 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:12.168561 15607 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:12.168820 15656 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:12.238883 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 55590.9us
I20260709 13:04:12.130048 15565 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:12.104461 12442 rpcz_store.cc:269] 0709 13:03:54.499391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:54.499851 (+   460us) service_pool.cc:224] Handling call
0709 13:04:12.039046 (+17539195us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:05.780561 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:05.983865 (+203304us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:05.989657 (+  5792us) write_op.cc:435] Acquired schema lock
0709 13:04:05.994034 (+  4377us) tablet.cc:662] Decoding operations
0709 13:04:06.118104 (+124070us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:06.118187 (+    83us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:06.118224 (+    37us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:04:06.119439 (+  1215us) tablet.cc:701] Row locks acquired
0709 13:04:06.119486 (+    47us) write_op.cc:260] PREPARE: finished
0709 13:04:06.119669 (+   183us) write_op.cc:270] Start()
0709 13:04:06.119830 (+   161us) write_op.cc:276] Timestamp: P: 1783602246119594 usec, L: 0
0709 13:04:06.119854 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:04:06.120630 (+   776us) log.cc:844] Serialized 4756 byte log entry
0709 13:04:06.742043 (+621413us) op_driver.cc:464] REPLICATION: finished
0709 13:04:06.759756 (+ 17713us) write_op.cc:301] APPLY: starting
0709 13:04:06.759970 (+   214us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:06.760224 (+   254us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:06.760356 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:06.896928 (+136572us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:07.131013 (+234085us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:04:07.135714 (+  4701us) write_op.cc:312] APPLY: finished
0709 13:04:07.243333 (+107619us) log.cc:844] Serialized 89 byte log entry
0709 13:04:07.243526 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:07.243704 (+   178us) write_op.cc:454] Released schema lock
0709 13:04:07.243794 (+    90us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:07.244251 (+   457us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:07.244282 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1269450,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":17368,"apply.run_cpu_time_us":7637,"apply.run_wall_time_us":484489,"num_ops":12,"prepare.queue_time_us":232357,"prepare.run_cpu_time_us":11507,"prepare.run_wall_time_us":459343,"raft.queue_time_us":62549,"raft.run_cpu_time_us":3304,"raft.run_wall_time_us":17523,"replication_time_us":622016,"thread_start_us":358315,"threads_started":4,"wal-append.queue_time_us":83937,"wal-append.run_cpu_time_us":17804,"wal-append.run_wall_time_us":2043230}]]}
I20260709 13:04:12.240296 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:12.176282 15614 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:12.177276 15652 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:12.179199 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:12.088322 15058 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:12.070573 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:12.063162 13231 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:04:12.099503 12694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1402) took 2751 ms (client timeout 2220 ms). Trace:
I20260709 13:04:12.181599 12616 raft_consensus.cc:2376] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7. Re-sending same reply.
I20260709 13:04:12.181238 12693 rpcz_store.cc:276] 0709 13:04:10.233319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:10.233435 (+   116us) service_pool.cc:224] Handling call
0709 13:04:10.233746 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:10.494611 (+260865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:12.105650 (+1611039us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54003ea8d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:12.105908 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":592755968}
I20260709 13:04:12.188681 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:12.120285 15564 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:12.085420 12613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2735) took 2791 ms (client timeout 2901 ms). Trace:
I20260709 13:04:12.190321 12690 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:04:12.191326 12443 catalog_manager.cc:5697] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.172415 15051 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:12.210870 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:12.193435 15447 consensus_queue.cc:1048] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:04:12.301743 12622 raft_consensus.cc:2376] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6. Re-sending same reply.
W20260709 13:04:12.195312 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.211694 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:12.302194 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:12.195820 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:12.302814 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:12.303367 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.244675 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:12.303754 12622 raft_consensus.cc:2410] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:04:12.193907 15619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.005s	sys 0.007s
I20260709 13:04:12.129171 15612 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:12.313287 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:12.295147 12547 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
W20260709 13:04:12.303380 12613 rpcz_store.cc:269] 0709 13:04:09.293998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.294139 (+   141us) service_pool.cc:224] Handling call
0709 13:04:12.085229 (+2791090us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b54003aedd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:12.085357 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1741416320}
I20260709 13:04:12.314522 12547 pending_rounds.cc:85] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 2
I20260709 13:04:12.314226 12622 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:12.314931 12547 pending_rounds.cc:107] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:04:12.315198 12547 raft_consensus.cc:2889] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:12.194276 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2758) took 1268 ms. Trace:
I20260709 13:04:12.249429 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:12.304257 12694 rpcz_store.cc:269] 0709 13:04:09.348049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.348851 (+   802us) service_pool.cc:224] Handling call
0709 13:04:12.099251 (+2750400us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54002373d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:12.099419 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2633686912}
I20260709 13:04:12.317088 13235 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:12.260048 15438 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.305882 13232 raft_consensus.cc:2376] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6. Re-sending same reply.
I20260709 13:04:12.256239 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:12.334082 12545 raft_consensus.cc:2410] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:04:12.255786 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:12.271042 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:12.304657 12615 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:12.335235 12538 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:12.304926 12443 catalog_manager.cc:5697] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 3 to 5, term changed from 3 to 6, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to <none>, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:12.336575 12615 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:04:12.255378 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:12.197320 12662 leader_election.cc:400] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8.
I20260709 13:04:12.267057 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:12.307340 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.339314 13199 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:12.340407 15596 consensus_queue.cc:1059] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:12.340588 13199 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:12.341444 15647 raft_consensus.cc:3055] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:12.341894 15058 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:12.341907 15647 raft_consensus.cc:740] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:12.343258 12615 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:12.343485 15647 consensus_queue.cc:260] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:12.344745 12615 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:04:12.344986 15647 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:12.238365 15643 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.134s
W20260709 13:04:12.280738 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 184562us
I20260709 13:04:12.348330 12588 leader_election.cc:400] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 6. Current term is 7.
I20260709 13:04:12.348686 12588 leader_election.cc:403] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:12.349768 15551 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 6. Current term is 7.
I20260709 13:04:12.291054 12543 raft_consensus.cc:1275] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:12.268286 12687 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:04:12.268085 12539 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:12.285441 13227 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:12.275929 12541 raft_consensus.cc:1275] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:12.280002 15456 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.302975 12690 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:12.260066 12513 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:04:12.356252 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 96296us
I20260709 13:04:12.314226 12616 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:12.251979 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:12.270257 15170 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:12.317910 12620 rpcz_store.cc:276] 0709 13:04:10.925460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.979725 (+1054265us) service_pool.cc:224] Handling call
0709 13:04:12.126103 (+146378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:12.194021 (+ 67918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:12.194224 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:12.320451 12618 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: []
W20260709 13:04:12.358239 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 106507us
I20260709 13:04:12.342082 15652 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:12.322927 15051 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:12.194440 15486 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.138s
I20260709 13:04:12.323419 15612 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:12.196491 12695 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:12.203368 15452 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:12.196257 15606 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:12.338759 12662 leader_election.cc:403] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:12.259548 15408 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.242268 15649 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:12.352614 12622 raft_consensus.cc:1275] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:12.334501 15438 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:12.353359 12615 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:12.436281 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:12.436666 15438 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:12.353984 13199 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:12.438341 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 84780.6us
I20260709 13:04:12.439134 13199 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:12.441148 13199 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:12.196208 15393 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:12.321676 15614 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:12.337704 12443 catalog_manager.cc:5697] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 3 to 6, term changed from 5 to 6, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to <none>, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 6 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:12.361426 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:12.357025 12513 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:12.356000 15634 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:12.374229 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2752) took 1460 ms. Trace:
W20260709 13:04:12.377692 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 180332us
I20260709 13:04:12.239537 15487 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:12.474786 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:12.475454 12620 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:12.353734 15619 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:12.384996 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.391743 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:12.458935 13199 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:04:12.392336 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 197299us
I20260709 13:04:12.396828 12616 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:12.480494 12616 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:04:12.480994 12616 pending_rounds.cc:85] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 6
I20260709 13:04:12.481254 12616 pending_rounds.cc:107] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:04:12.399761 12622 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:04:12.304036 12619 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:04:12.370042 15152 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:12.389379 15170 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:12.401358 15662 log.cc:927] Time spent T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
W20260709 13:04:12.405730 15669 log.cc:927] Time spent T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:04:12.405836 15008 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8.
I20260709 13:04:12.406546 15408 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:12.412708 15620 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.416138 12539 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:12.419209 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2759) took 1490 ms. Trace:
I20260709 13:04:12.358669 15417 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:04:12.359963 15456 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:12.428776 15565 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:12.398452 15158 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:04:12.430526 15606 raft_consensus.cc:697] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:12.338526 15426 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:12.527877 15426 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:12.431905 12689 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:04:12.437376 12546 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:12.483965 15634 raft_consensus.cc:697] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:12.443734 15467 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:12.378492 15627 consensus_queue.cc:1059] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 13:04:12.483479 15619 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:12.354843 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:12.272425 15607 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:12.445919 12615 raft_consensus.cc:1275] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:12.457374 12618 rpcz_store.cc:276] 0709 13:04:10.913925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.970175 (+1056250us) service_pool.cc:224] Handling call
0709 13:04:11.970461 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:12.358743 (+388282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:12.373388 (+ 14645us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b540031cc54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:12.374149 (+   761us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":804474240}
W20260709 13:04:12.458881 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 101928us
W20260709 13:04:12.471280 12510 leader_election.cc:336] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.614s (SENT)
I20260709 13:04:12.565088 12510 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:12.476641 12443 catalog_manager.cc:5697] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:12.483978 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.478921 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:04:12.566202 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 87364.5us
I20260709 13:04:12.566984 12662 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:12.566524 12443 catalog_manager.cc:5697] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.481534 12616 raft_consensus.cc:2889] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:12.496237 12617 rpcz_store.cc:276] 0709 13:04:10.928580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.986801 (+1058221us) service_pool.cc:224] Handling call
0709 13:04:11.987108 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:11.987432 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:11.987458 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:11.987985 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:04:12.185726 (+197741us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:12.185763 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:12.185834 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:12.418993 (+233159us) raft_consensus.cc:1685] finished
0709 13:04:12.419012 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:12.419148 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2497,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":197377,"threads_started":1,"wal-append.queue_time_us":371471}
I20260709 13:04:12.473382 15528 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:04:12.511883 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 53052.7us
W20260709 13:04:12.513248 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 152680us
W20260709 13:04:12.579746 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:12.532145 12613 raft_consensus.cc:2393] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 6: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:12.372479 15595 consensus_queue.cc:1059] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:04:12.539326 12620 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:12.529222 15170 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:12.489048 15393 raft_consensus.cc:697] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:12.444260 15618 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:12.480012 15504 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:04:12.533488 15008 consensus_queue.cc:1059] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
W20260709 13:04:12.569053 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 97812.8us
W20260709 13:04:12.570418 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 215649us
I20260709 13:04:12.580785 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:12.583182 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:04:12.607637 12510 leader_election.cc:336] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.711s (SENT)
I20260709 13:04:12.544466 15051 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.503834 15452 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.059s
W20260709 13:04:12.561623 15645 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:04:12.489158 15649 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.062s
I20260709 13:04:12.586916 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 556) took 1182 ms. Trace:
I20260709 13:04:12.594286 12615 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:04:12.594470 12621 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:12.595680 12546 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
W20260709 13:04:12.597438 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 110655us
I20260709 13:04:12.596138 12619 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
W20260709 13:04:12.635560 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 52598.7us
I20260709 13:04:12.635778 13199 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:12.559688 12544 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:12.560640 15638 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:12.567874 15648 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:12.513895 15620 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:12.608127 12662 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:12.604121 15618 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.608687 12443 catalog_manager.cc:5697] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 4 to 6, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 6 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:12.577754 15551 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:12.630302 12588 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:12.579527 15599 raft_consensus.cc:2764] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:04:12.587160 15563 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:12.599551 12512 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:04:12.657972 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 58523.4us
I20260709 13:04:12.634228 12615 pending_rounds.cc:85] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 7
I20260709 13:04:12.661747 12615 pending_rounds.cc:107] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:04:12.662038 12615 raft_consensus.cc:2889] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:12.632783 12614 rpcz_store.cc:276] 0709 13:04:11.405016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.032571 (+627555us) service_pool.cc:224] Handling call
0709 13:04:12.032872 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:12.036055 (+  3183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:12.036084 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:12.036529 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:04:12.040845 (+  4316us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:12.040881 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:12.040943 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:12.586684 (+545741us) raft_consensus.cc:1685] finished
0709 13:04:12.586705 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:12.586847 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2658,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":92,"thread_start_us":3956,"threads_started":1,"wal-append.queue_time_us":201043}
I20260709 13:04:12.641426 15638 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.641449 15627 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:12.661451 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:12.661890 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:12.597203 15613 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:12.663826 12541 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:12.663928 12539 raft_consensus.cc:2393] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 7: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:12.626371 15612 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:12.653450 12443 catalog_manager.cc:5697] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.639727 15133 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:12.642556 15648 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:12.681073 12443 catalog_manager.cc:5697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 6 to 7, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 7 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.689656 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:12.691802 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:12.704990 15679 log.cc:927] Time spent T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:04:12.706017 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:12.673691 15058 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:12.707684 15393 consensus_queue.cc:237] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:12.710106 15677 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:04:12.653667 15618 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:12.706701 12547 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:12.715628 12443 catalog_manager.cc:5697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 3 to 5, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 5 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:12.718772 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:12.665329 15638 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:12.635361 15632 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:04:12.731858 12443 catalog_manager.cc:5697] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 4 to 5, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 5 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.669988 15008 raft_consensus.cc:3055] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:12.634410 15051 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:12.670710 15595 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:12.665616 15633 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:12.711305 15655 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:04:12.732031 12543 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:12.735309 13200 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:12.648228 15523 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:04:12.756129 13200 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:12.713128 15648 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:12.679342 15133 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:12.735960 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:12.727681 15596 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:12.728472 15613 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:12.674712 15627 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:12.739645 15588 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:12.738059 15008 raft_consensus.cc:740] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:12.683981 15612 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:12.774652 13200 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:12.721642 15599 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:04:12.665531 15606 consensus_queue.cc:237] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:12.656286 15634 consensus_queue.cc:237] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:12.747615 12443 catalog_manager.cc:5697] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:12.760047 15487 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:12.761327 15528 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:12.766461 15133 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:12.764110 15417 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:12.762295 15595 raft_consensus.cc:697] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:12.831743 15051 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:12.827131 15678 log.cc:927] Time spent T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:04:12.830962 15595 consensus_queue.cc:237] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:12.756628 15525 consensus_queue.cc:1059] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:04:12.775350 15408 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:12.762496 15633 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:12.779067 15456 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:12.790997 15657 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:04:12.849543 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 213930us
W20260709 13:04:12.832540 15444 consensus_meta.cc:287] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.641s	user 0.011s	sys 0.001s
W20260709 13:04:12.889441 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 282033us
I20260709 13:04:12.953107 12588 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:12.823788 15591 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:12.962858 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:12.999153 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 46120us
W20260709 13:04:12.999485 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 49222.2us
I20260709 13:04:12.834601 15690 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.005653 15693 consensus_queue.cc:1059] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:13.007090 15693 raft_consensus.cc:3055] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:13.007539 15693 raft_consensus.cc:740] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:13.021682 15693 consensus_queue.cc:260] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:13.000705 12588 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:13.023242 15223 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:04:13.023419 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:13.028522 12588 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:12.948446 15607 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:13.033641 12588 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:13.036101 13228 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:04:12.999073 15456 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:13.009770 15588 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:13.029985 15223 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:04:13.053315 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:13.070158 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 462084us
I20260709 13:04:13.009343 15684 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:04:13.079802 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
W20260709 13:04:13.081436 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 47936.6us
I20260709 13:04:13.099612 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:13.108029 12588 connection.cc:256] RPC call timeout handler was delayed by -1.4914414580000539s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16390000000000002s for a response
W20260709 13:04:13.108588 12588 connection.cc:256] RPC call timeout handler was delayed by -1.4572414579999986s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
W20260709 13:04:13.108934 12588 connection.cc:256] RPC call timeout handler was delayed by -1.4132298869999431s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2763s for a response
W20260709 13:04:13.109320 12588 connection.cc:256] RPC call timeout handler was delayed by -1.4050414580000279s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
I20260709 13:04:13.036639 15637 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:13.116869 12618 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.080s	sys 0.112s
I20260709 13:04:13.011024 15591 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:13.124703 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 320024us
I20260709 13:04:13.078902 15408 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:13.002146 15008 consensus_queue.cc:260] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:13.040210 15692 consensus_queue.cc:1048] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:04:13.078657 15456 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:13.121987 12618 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.080s	sys 0.112s
I20260709 13:04:13.093689 15696 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:13.112109 15632 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:13.166083 12691 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.006s	sys 0.014s
W20260709 13:04:13.173259 12691 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.006s	sys 0.014s
I20260709 13:04:13.127604 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:13.098018 15051 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:13.114317 15487 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:13.165297 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:13.113750 15649 consensus_queue.cc:1059] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:04:13.185279 12510 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:04:13.192521 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 91371.7us
W20260709 13:04:13.184077 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 159185us
I20260709 13:04:13.192106 12539 raft_consensus.cc:3055] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:04:13.181632 15647 consensus_meta.cc:287] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.836s	user 0.014s	sys 0.000s
I20260709 13:04:13.194362 12539 raft_consensus.cc:740] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:04:13.183121 15564 consensus_meta.cc:287] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.872s	user 0.008s	sys 0.003s
I20260709 13:04:13.202972 15563 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:13.203449 15563 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:13.203853 15563 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:13.204439 12547 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:13.187896 15438 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:13.206427 15438 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.206799 15438 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:13.207723 13227 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:13.136597 15693 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:13.177174 15158 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:13.127307 15637 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:13.196220 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:13.176961 15612 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:13.213512 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:13.198007 15702 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.054s	user 0.001s	sys 0.001s
I20260709 13:04:13.215656 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:13.177733 15632 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:13.241590 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:13.160120 15697 consensus_queue.cc:1059] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:04:13.225373 13233 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:13.236431 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 126350us
W20260709 13:04:13.251390 12588 connection.cc:256] RPC call timeout handler was delayed by -1.2394414580001012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19190000000000002s for a response
I20260709 13:04:13.252257 12588 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:13.213950 12547 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:04:13.187772 15487 raft_consensus.cc:697] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:13.176819 15408 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:13.192623 15675 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
W20260709 13:04:13.230329 15683 log.cc:927] Time spent T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.370s	user 0.001s	sys 0.001s
I20260709 13:04:13.248024 12540 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:13.238598 12695 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:13.184413 15051 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:13.254801 12588 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:13.262176 15701 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:04:13.262737 15620 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:13.252858 12539 consensus_queue.cc:260] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:13.265283 13199 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:13.028844 15690 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:13.288666 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:13.297792 15649 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:13.265501 15636 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.306869 15636 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:13.257263 15551 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:13.308492 15551 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:13.309052 15551 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:13.301643 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:13.278870 15686 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:04:13.313925 12547 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:04:13.266985 15633 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:13.262985 15699 log.cc:927] Time spent T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:04:13.275772 15695 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:13.325162 12588 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:13.326975 12588 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:13.329473 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 133332us
I20260709 13:04:13.332000 15688 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:13.333117 15688 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:13.333630 12588 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:13.334761 12540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 615) took 2077 ms (client timeout 2193 ms). Trace:
I20260709 13:04:13.335199 15688 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:13.336187 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:13.336712 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:13.338429 12543 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:04:13.338588 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:13.339555 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:13.340212 12615 raft_consensus.cc:2368] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7.
I20260709 13:04:13.340103 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:13.340409 12614 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:04:13.341233 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:13.341866 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:04:13.304453 15687 log.cc:927] Time spent T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 13:04:13.341952 15697 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:13.358949 12613 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:13.359180 12619 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:13.321143 15647 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:13.362002 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:13.363283 12662 leader_election.cc:400] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8.
W20260709 13:04:13.322476 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 137419us
I20260709 13:04:13.352626 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:13.335206 12540 rpcz_store.cc:269] 0709 13:04:11.256975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:11.257489 (+   514us) service_pool.cc:224] Handling call
0709 13:04:13.334588 (+2077099us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b54002cc754. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:13.334706 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4515188096}
I20260709 13:04:13.351025 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:13.354699 12615 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:04:13.362979 13230 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:04:13.372517 12620 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7. Ops: [5.4-6.5]
I20260709 13:04:13.370023 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:13.374181 12662 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:13.371681 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:13.377629 12621 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:13.330381 15695 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:13.346119 15591 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:13.344187 15426 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:13.357852 15697 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:13.371502 15647 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:13.396713 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 202308us
I20260709 13:04:13.400133 12659 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:13.386679 15695 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:13.406095 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 899) took 1216 ms. Trace:
I20260709 13:04:13.406529 13229 rpcz_store.cc:276] 0709 13:04:12.189789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.189902 (+   113us) service_pool.cc:224] Handling call
0709 13:04:12.190200 (+   298us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:12.196784 (+  6584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:12.196814 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:12.243010 (+ 46196us) log.cc:844] Serialized 52 byte log entry
0709 13:04:12.496149 (+253139us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:12.718756 (+222607us) log.cc:844] Serialized 14 byte log entry
0709 13:04:12.721045 (+  2289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:12.721826 (+   781us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:13.405886 (+684060us) raft_consensus.cc:1685] finished
0709 13:04:13.405905 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:13.406028 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57522,"prepare.queue_time_us":64832,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":8152,"raft.queue_time_us":8792,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":50091,"thread_start_us":362414,"threads_started":2,"wal-append.queue_time_us":488334}
I20260709 13:04:13.394541 15697 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:13.411237 12696 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:13.398784 15525 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.401265 15649 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:13.400192 15647 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:13.354218 15487 consensus_queue.cc:237] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:13.417595 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1670) took 1368 ms. Trace:
I20260709 13:04:13.425040 12622 rpcz_store.cc:276] 0709 13:04:12.049423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.484795 (+435372us) service_pool.cc:224] Handling call
0709 13:04:12.485141 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:12.495045 (+  9904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:12.495078 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:12.516856 (+ 21778us) log.cc:844] Serialized 26 byte log entry
0709 13:04:12.767625 (+250769us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:12.786767 (+ 19142us) log.cc:844] Serialized 14 byte log entry
0709 13:04:12.787059 (+   292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:12.787146 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:13.417316 (+630170us) raft_consensus.cc:1685] finished
0709 13:04:13.417342 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:13.417507 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4721,"prepare.queue_time_us":24631,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":37,"raft.queue_time_us":1364,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":46311,"thread_start_us":176938,"threads_started":1,"wal-append.queue_time_us":471464}
I20260709 13:04:13.407522 15613 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:13.410264 15456 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:13.401160 15716 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:04:13.432744 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:13.434840 12622 raft_consensus.cc:2393] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 6: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:13.418362 15632 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:13.442988 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:13.446007 15694 log.cc:927] Time spent T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.441s	user 0.003s	sys 0.001s
I20260709 13:04:13.446664 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2655) took 1191 ms. Trace:
I20260709 13:04:13.447252 12544 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: []
W20260709 13:04:13.446664 15133 consensus_meta.cc:287] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.000s
I20260709 13:04:13.430229 15613 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:13.452375 12546 rpcz_store.cc:276] 0709 13:04:12.254908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.255042 (+   134us) service_pool.cc:224] Handling call
0709 13:04:13.446474 (+1191432us) spinlock_profiling.cc:243] Waited 99.2 ms on lock 0x7b5400228154. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:13.446597 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":228265344}
I20260709 13:04:13.448427 15563 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:13.411268 15438 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:13.437306 15606 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:04:13.409945 15710 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:04:13.437022 15716 consensus_queue.cc:1243] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer a70479a3b4114f3581095e9890f5d653 log is divergent from this leader: its last log entry 8.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:04:13.413434 15712 consensus_queue.cc:1059] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:04:13.449690 15408 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:13.556342 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 186616us
I20260709 13:04:13.428156 15525 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:13.526623 15613 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:13.561290 15637 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:04:13.584183 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 155033us
I20260709 13:04:13.591531 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 903) took 1357 ms. Trace:
I20260709 13:04:13.592097 13234 rpcz_store.cc:276] 0709 13:04:12.211635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.211887 (+   252us) service_pool.cc:224] Handling call
0709 13:04:13.563366 (+1351479us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b5400570dd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:13.568841 (+  5475us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1844595584}
I20260709 13:04:13.596306 12510 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:13.552609 15688 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:13.610898 12510 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:13.460698 15133 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:13.613737 12510 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:13.617231 12510 leader_election.cc:400] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7.
I20260709 13:04:13.647270 15634 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:13.654812 15634 consensus_queue.cc:1059] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:13.655704 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1420) took 1503 ms. Trace:
I20260709 13:04:13.656224 12696 rpcz_store.cc:276] 0709 13:04:12.152570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.193317 (+ 40747us) service_pool.cc:224] Handling call
0709 13:04:12.241444 (+ 48127us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:13.413344 (+1171900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:13.655465 (+242121us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540009f454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:13.655635 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2689854848}
I20260709 13:04:13.658717 15551 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:13.660929 15551 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:13.661091 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2783) took 1202 ms. Trace:
I20260709 13:04:13.662281 12622 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:13.662832 12617 rpcz_store.cc:276] 0709 13:04:12.458340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.588893 (+130553us) service_pool.cc:224] Handling call
0709 13:04:12.610498 (+ 21605us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:04:12.611009 (+   511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:12.611050 (+    41us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:04:12.642707 (+ 31657us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b2c0004c3c8. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:04:12.645898 (+  3191us) log.cc:844] Serialized 78 byte log entry
0709 13:04:12.836735 (+190837us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:12.998308 (+161573us) log.cc:844] Serialized 14 byte log entry
0709 13:04:12.998526 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:12.998605 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:13.202304 (+203699us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4800002dd8. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3ae4a2aa1 00007fc3ae499b37 00007fc3ae4999ca 00007fc3ae59126f 00007fc3ae590f37 00007fc3ae5a555c 00007fc3ae5a5508 00007fc3ae5a5488 00007fc3ae5a5443 00007fc3ae5a46ec 00007fc3ad4cea96
0709 13:04:13.445295 (+242991us) spinlock_profiling.cc:243] Waited 9.14 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:04:13.660873 (+215578us) raft_consensus.cc:1685] finished
0709 13:04:13.660893 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:13.661039 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":162521,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":74485,"raft.run_cpu_time_us":21279,"raft.run_wall_time_us":523888,"spinlock_wait_cycles":53157376,"thread_start_us":190443,"threads_started":1,"wal-append.queue_time_us":358276}
I20260709 13:04:13.621786 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:13.633230 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 253243us
W20260709 13:04:13.681818 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 60110us
I20260709 13:04:13.683264 12510 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:13.596714 15051 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:13.606411 15525 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:13.648940 15638 consensus_meta.cc:287] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.906s	user 0.011s	sys 0.000s
W20260709 13:04:13.647656 15720 log.cc:927] Time spent T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:04:13.648386 15710 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:13.620990 15456 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:13.614262 15408 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:13.696674 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:13.697475 12513 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:13.652014 15636 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:13.699044 12688 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:13.608193 15712 consensus_queue.cc:1059] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 13:04:13.606767 15607 consensus_queue.cc:1048] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 13:04:13.725787 15723 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:13.726483 15723 raft_consensus.cc:697] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:13.727454 15723 consensus_queue.cc:237] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:13.690464 15634 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:13.706106 12693 raft_consensus.cc:2410] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:04:13.710062 15719 log.cc:927] Time spent T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:04:13.710611 15563 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:13.711592 15721 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:04:13.713658 15562 raft_consensus.cc:3055] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:13.714358 15438 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:13.715276 15133 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:13.646660 15711 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.314s
I20260709 13:04:13.717602 15710 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:13.722086 15690 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:13.733009 12695 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:13.774008 15647 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:13.725323 15648 consensus_meta.cc:287] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.956s	user 0.005s	sys 0.005s
I20260709 13:04:13.777972 15648 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:13.779266 15647 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:13.780027 15648 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:13.780339 15649 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:13.781064 15649 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:13.647454 15727 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 13:04:13.781360 15697 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:13.717804 15467 consensus_meta.cc:287] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 1.156s	user 0.008s	sys 0.004s
I20260709 13:04:13.621623 15688 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:13.710647 15714 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
I20260709 13:04:13.756675 15565 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:04:13.776036 15725 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:04:13.776466 15693 consensus_meta.cc:287] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.538s	user 0.006s	sys 0.003s
I20260709 13:04:13.776902 15706 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:13.740018 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 700) took 1156 ms. Trace:
I20260709 13:04:13.730180 15595 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:04:13.730338 15525 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:13.798215 15417 raft_consensus.cc:3055] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:13.798734 15697 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:13.799031 15710 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:13.800889 15688 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:13.801051 15715 log.cc:927] Time spent T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.377s	user 0.001s	sys 0.000s
I20260709 13:04:13.764725 15456 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:13.753181 15562 raft_consensus.cc:740] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:04:13.715314 15618 consensus_meta.cc:287] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.977s	user 0.011s	sys 0.000s
I20260709 13:04:13.812408 15551 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:13.829156 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 146017us
I20260709 13:04:13.705420 15638 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:13.814958 12691 rpcz_store.cc:276] 0709 13:04:12.583499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.584226 (+   727us) service_pool.cc:224] Handling call
0709 13:04:12.613523 (+ 29297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:12.613780 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:13.173856 (+560076us) log.cc:844] Serialized 14 byte log entry
0709 13:04:13.437687 (+263831us) log.cc:844] Serialized 14 byte log entry
0709 13:04:13.739654 (+301967us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:13.739706 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:13.739755 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:13.739820 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:13.739952 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2788,"prepare.queue_time_us":226556,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":69,"raft.queue_time_us":335726,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":11910,"thread_start_us":1077338,"threads_started":4,"wal-append.queue_time_us":371411}
I20260709 13:04:13.707455 15724 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.108s
I20260709 13:04:13.808873 15467 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:13.827071 15721 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:04:13.840191 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 569) took 1759 ms. Trace:
I20260709 13:04:13.812958 15725 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.835347 15417 raft_consensus.cc:740] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:13.875412 12538 raft_consensus.cc:2393] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 7: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:13.875556 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:13.856532 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:13.870934 12618 rpcz_store.cc:276] 0709 13:04:12.080674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.580064 (+499390us) service_pool.cc:224] Handling call
0709 13:04:12.602307 (+ 22243us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:13.163423 (+561116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:13.163459 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:13.177723 (+ 14264us) log.cc:844] Serialized 26 byte log entry
0709 13:04:13.395546 (+217823us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:13.395582 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:13.395647 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:13.839968 (+444321us) raft_consensus.cc:1685] finished
0709 13:04:13.839989 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:13.840129 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":77283,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":29114,"thread_start_us":722195,"threads_started":2,"wal-append.queue_time_us":237909}
I20260709 13:04:13.877374 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:13.878186 12546 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:13.867609 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:13.868721 13231 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEARNER]: Advancing to term 8
I20260709 13:04:13.870179 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:13.880959 12540 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
I20260709 13:04:13.882141 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:13.882587 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:13.882869 12540 raft_consensus.cc:2393] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 6: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:13.843173 15456 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:13.883392 15456 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:13.871851 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:13.874189 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:13.884793 13232 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:13.886741 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:13.888648 12540 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:13.894402 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:13.838194 15525 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:13.895885 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:13.897135 12546 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:04:13.899303 12542 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:04:13.898247 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 447653us
W20260709 13:04:13.870002 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 131513us
I20260709 13:04:13.873689 15688 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:13.870918 15647 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:13.934809 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:13.935614 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:14.016094 13197 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:14.016707 12546 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:04:13.938542 13233 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:04:13.876390 15725 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:13.857518 15618 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:13.906651 12617 raft_consensus.cc:2955] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:13.941845 15417 consensus_queue.cc:260] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:13.946645 15696 raft_consensus.cc:3055] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:13.947957 15652 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.940162 15511 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.954082 15638 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:13.958396 12691 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:14.041360 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:13.960175 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 630) took 1266 ms. Trace:
I20260709 13:04:13.862741 15551 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:13.964748 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:13.966058 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:13.989845 13231 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:04:13.994220 13234 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:14.046159 13231 pending_rounds.cc:85] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Aborting all ops after (but not including) 5
I20260709 13:04:14.046483 13231 pending_rounds.cc:107] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:04:14.046859 13231 raft_consensus.cc:2889] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:14.041949 12541 rpcz_store.cc:276] 0709 13:04:12.693857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.139898 (+446041us) service_pool.cc:224] Handling call
0709 13:04:13.166716 (+ 26818us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:13.168014 (+  1298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:13.168051 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:13.175235 (+  7184us) log.cc:844] Serialized 26 byte log entry
0709 13:04:13.301459 (+126224us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:13.301496 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:13.321140 (+ 19644us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:13.800265 (+479125us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:04:13.914694 (+114429us) raft_consensus.cc:1685] finished
0709 13:04:13.914717 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:13.960107 (+ 45390us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":843,"raft.queue_time_us":1426,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":5415,"spinlock_wait_cycles":8485760,"thread_start_us":102444,"threads_started":1,"wal-append.queue_time_us":206695}
I20260709 13:04:13.995636 13232 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
W20260709 13:04:13.959219 15737 log.cc:927] Time spent T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.055s	user 0.002s	sys 0.000s
I20260709 13:04:14.017668 15051 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:13.999687 12540 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
W20260709 13:04:14.002920 13228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 579) took 4787 ms (client timeout 1520 ms). Trace:
I20260709 13:04:14.007262 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:14.011473 15707 raft_consensus.cc:3055] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:04:14.012077 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.018673 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:14.021857 12687 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:14.024655 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:14.064162 12622 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:04:14.026254 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:14.066159 12618 raft_consensus.cc:2393] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 6: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:14.026609 12693 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:13.938691 15713 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:13.952457 15613 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:14.031286 12659 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:14.032224 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:04:13.996024 15695 consensus_meta.cc:287] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.584s	user 0.010s	sys 0.000s
I20260709 13:04:14.042244 12620 raft_consensus.cc:2410] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:04:14.087461 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:14.089412 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:14.090255 12546 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
I20260709 13:04:14.075043 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:14.091629 12618 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 2.
I20260709 13:04:14.092752 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:14.095990 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 64775.1us
I20260709 13:04:14.032352 12588 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:14.044476 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:14.100832 12547 raft_consensus.cc:2410] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:04:14.049321 12694 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 9: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:14.102218 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:13.999178 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:14.104214 12544 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:13.993835 15565 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.137969 15565 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:14.051539 13226 raft_consensus.cc:2393] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:14.033418 15471 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:04:14.054665 13228 rpcz_store.cc:269] 0709 13:04:09.215292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:09.220893 (+  5601us) service_pool.cc:224] Handling call
0709 13:04:14.002590 (+4781697us) spinlock_profiling.cc:243] Waited 3.78 s on lock 0x7b54004e2854. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:14.002778 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8693602560}
I20260709 13:04:14.160101 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:14.160928 13228 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:14.065125 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:14.162021 12622 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:14.070923 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:14.074748 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:14.036686 15696 raft_consensus.cc:740] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:14.075884 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:14.038784 15614 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.038635 15438 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:14.080008 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.165285 12512 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:13.940526 15562 consensus_queue.cc:260] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:14.082618 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:14.053580 15417 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:14.062352 15707 raft_consensus.cc:740] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:14.111797 15733 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:14.112504 15741 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:04:14.114282 15738 log.cc:927] Time spent T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
W20260709 13:04:14.119333 15742 log.cc:927] Time spent T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:04:14.083689 15713 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:14.124058 12687 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:14.124963 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:14.192807 12546 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:14.070046 15051 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:14.127857 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:14.129806 15693 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:14.131035 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:14.132254 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:14.141523 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:14.202271 12694 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:14.143798 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:14.029748 15688 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:14.167274 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 84779.5us
I20260709 13:04:14.043413 15648 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:04:14.033178 15647 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:14.169354 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:14.167855 12544 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:14.219875 12622 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:14.170723 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:14.221859 12540 raft_consensus.cc:2376] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6. Re-sending same reply.
I20260709 13:04:14.172794 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:14.223543 13234 raft_consensus.cc:2393] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:14.221354 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:14.224699 12659 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:14.226301 15727 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:04:14.150249 15605 consensus_queue.cc:1059] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:04:14.177606 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:14.226477 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 194184us
I20260709 13:04:14.045064 15652 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:14.053246 15456 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:14.188112 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:14.152021 15551 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:14.191062 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:14.148653 15426 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.075382 15638 consensus_queue.cc:1059] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 13:04:14.203274 12618 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:14.087774 15690 consensus_queue.cc:1059] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.096s
I20260709 13:04:14.175554 15711 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:14.214468 12662 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:14.172737 15471 raft_consensus.cc:697] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:14.175179 15438 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
W20260709 13:04:14.218832 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.230572 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:14.182193 15712 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.266026 15712 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:14.270205 15638 raft_consensus.cc:3055] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:14.270846 15638 raft_consensus.cc:740] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:14.235692 15618 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:14.174113 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 151502us
I20260709 13:04:14.045249 15511 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:14.226586 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:14.278513 12540 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:14.225757 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:14.153221 15695 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:14.234052 12588 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:14.238802 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 50843.2us
I20260709 13:04:14.241508 12546 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:04:14.172566 15614 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:14.205770 15565 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:14.351713 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:14.246755 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:14.247069 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:14.249238 12618 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:14.252384 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:14.252569 12617 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:14.227141 15727 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:14.257042 12694 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:14.228350 15563 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:14.262280 12545 raft_consensus.cc:2393] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 5: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:14.263092 15731 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:14.264189 15744 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 13:04:14.243355 15525 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:14.218778 15697 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:04:14.280746 12540 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:14.280928 12622 raft_consensus.cc:2393] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:14.242847 15408 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:14.288941 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:14.337445 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:14.351946 15613 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:14.250613 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:14.248474 15724 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:14.271905 15638 consensus_queue.cc:260] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:14.192528 15733 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:14.619197 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:14.766224 12616 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:14.767256 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:14.767822 12616 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:04:14.502748 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:14.555876 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2789) took 1119 ms. Trace:
W20260709 13:04:14.744424 12659 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.045s	sys 0.078s
I20260709 13:04:14.768600 12614 rpcz_store.cc:276] 0709 13:04:13.436220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.561276 (+125056us) service_pool.cc:224] Handling call
0709 13:04:13.561622 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:13.569549 (+  7927us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:13.602402 (+ 32853us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:13.603089 (+   687us) log.cc:844] Serialized 26 byte log entry
0709 13:04:14.001179 (+398090us) spinlock_profiling.cc:243] Waited 5.54 ms on lock 0x7b1800221bc0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:04:14.164393 (+163214us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:14.164433 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:14.164495 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:14.555531 (+391036us) raft_consensus.cc:1685] finished
0709 13:04:14.555553 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:14.555804 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":809,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":26325,"spinlock_wait_cycles":12751616,"thread_start_us":163045,"threads_started":1,"wal-append.queue_time_us":651577}
W20260709 13:04:14.770121 12659 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.046s	sys 0.078s
I20260709 13:04:14.739863 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:14.770959 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:14.738535 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2792) took 1290 ms. Trace:
I20260709 13:04:14.745270 12547 raft_consensus.cc:2376] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7. Re-sending same reply.
I20260709 13:04:14.745945 12620 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:14.772272 12621 rpcz_store.cc:276] 0709 13:04:13.448294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.806623 (+358329us) service_pool.cc:224] Handling call
0709 13:04:13.807086 (+   463us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:13.807551 (+   465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:13.807586 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:13.808305 (+   719us) log.cc:844] Serialized 52 byte log entry
0709 13:04:14.246696 (+438391us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:14.246739 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:14.246823 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:14.738268 (+491445us) raft_consensus.cc:1685] finished
0709 13:04:14.738290 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:14.738467 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1998,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":13360,"thread_start_us":437931,"threads_started":1,"wal-append.queue_time_us":742568}
W20260709 13:04:14.770460 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 535766us
I20260709 13:04:14.774586 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:14.557773 12542 raft_consensus.cc:1275] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:04:14.702951 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:14.775697 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.738799 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 629) took 2045 ms. Trace:
I20260709 13:04:14.748274 12541 raft_consensus.cc:2393] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 7: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:14.352638 15511 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:14.496140 12690 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:14.751066 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:14.508586 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:14.511098 15605 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.490808 15652 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:14.754504 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 501937us
I20260709 13:04:14.761263 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:14.785636 13231 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 8: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:14.236905 15696 consensus_queue.cc:260] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:14.707536 15618 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.555152 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:14.787930 13229 raft_consensus.cc:2376] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5. Re-sending same reply.
I20260709 13:04:14.707221 15648 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:14.776659 12543 rpcz_store.cc:276] 0709 13:04:12.693643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.768268 (+ 74625us) service_pool.cc:224] Handling call
0709 13:04:13.338115 (+569847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:13.338812 (+   697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:14.738542 (+1399730us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b54002cc750. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:14.738724 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1275302784}
I20260709 13:04:14.752036 15731 raft_consensus.cc:697] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:14.652485 15438 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:14.495115 15051 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:14.415802 15741 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:14.511782 15456 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:14.780378 12618 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:14.808251 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:14.809016 12618 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:14.809358 12690 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:14.752323 15727 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:14.782934 13230 raft_consensus.cc:2393] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 6: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:14.783246 12540 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:04:14.810170 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 65485.5us
I20260709 13:04:14.783623 12542 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:04:14.754209 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:14.811830 12542 pending_rounds.cc:85] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 5
I20260709 13:04:14.812108 12622 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:14.812218 12542 pending_rounds.cc:107] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:04:14.765076 13228 raft_consensus.cc:2410] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:04:14.767148 15649 consensus_meta.cc:287] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.985s	user 0.006s	sys 0.022s
I20260709 13:04:14.747545 15563 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:14.806946 15648 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:14.821457 15563 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:14.791476 12616 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:14.822444 15648 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:14.823553 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:14.824719 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:14.824642 15731 consensus_queue.cc:237] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:14.771617 12614 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:04:14.826692 12614 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:04:14.827881 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:14.828270 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:14.797029 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:14.829430 12617 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
W20260709 13:04:14.550920 15758 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.259s	user 0.000s	sys 0.000s
I20260709 13:04:14.801618 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:14.769629 15606 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:14.817957 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:14.833550 13234 raft_consensus.cc:2368] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9.
I20260709 13:04:14.834086 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 624) took 2144 ms. Trace:
I20260709 13:04:14.834487 12538 rpcz_store.cc:276] 0709 13:04:12.689177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.689315 (+   138us) service_pool.cc:224] Handling call
0709 13:04:14.833867 (+2144552us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54000799d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:14.833990 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2698948992}
I20260709 13:04:14.834936 13234 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:04:14.557301 15712 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:14.805507 12541 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:04:14.805660 12546 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:14.562709 15647 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:14.725406 15695 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:14.812762 12542 raft_consensus.cc:2889] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:14.250934 15426 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:14.795882 15725 consensus_meta.cc:287] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.760s	user 0.012s	sys 0.000s
I20260709 13:04:14.814844 12618 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:14.564291 15471 consensus_queue.cc:237] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:14.751868 15724 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:14.662582 15559 consensus_queue.cc:1059] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.143s
I20260709 13:04:14.813482 13197 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:14.552724 15614 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:14.262006 15707 consensus_queue.cc:260] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:14.835896 12538 raft_consensus.cc:1217] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[5.3-9.5]   Dedup: 5.3->[7.4-9.5]
I20260709 13:04:15.138230 12538 pending_rounds.cc:85] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 3
I20260709 13:04:15.138545 12538 pending_rounds.cc:107] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 13:04:14.792672 15638 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:15.138810 12538 raft_consensus.cc:2889] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:15.141069 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2796) took 1105 ms. Trace:
I20260709 13:04:14.825377 13230 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:15.139292 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:14.823616 12543 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 13:04:15.139101 13200 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:15.141471 12618 rpcz_store.cc:276] 0709 13:04:14.035555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.814115 (+778560us) service_pool.cc:224] Handling call
0709 13:04:14.814450 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:15.140797 (+326347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.141010 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:15.145133 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2668) took 1105 ms. Trace:
W20260709 13:04:14.970778 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:15.145504 12542 rpcz_store.cc:276] 0709 13:04:14.039919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.778210 (+738291us) service_pool.cc:224] Handling call
0709 13:04:14.778534 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:15.144911 (+366377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.145080 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:15.146799 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2663) took 1108 ms. Trace:
I20260709 13:04:15.147606 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2669) took 1107 ms. Trace:
I20260709 13:04:15.147241 12546 rpcz_store.cc:276] 0709 13:04:14.038033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.779477 (+741444us) service_pool.cc:224] Handling call
0709 13:04:14.805420 (+ 25943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:15.146449 (+341029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.146748 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:15.147651 13200 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:04:15.148556 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 335138us
I20260709 13:04:15.148089 12541 rpcz_store.cc:276] 0709 13:04:14.040525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.778220 (+737695us) service_pool.cc:224] Handling call
0709 13:04:14.805303 (+ 27083us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:15.147376 (+342073us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.147556 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:15.152330 13197 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:15.023499 15417 consensus_meta.cc:287] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.848s	user 0.010s	sys 0.008s
I20260709 13:04:15.155364 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2670) took 1114 ms. Trace:
I20260709 13:04:14.801137 15684 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.161346 12543 rpcz_store.cc:276] 0709 13:04:14.040780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.795030 (+754250us) service_pool.cc:224] Handling call
0709 13:04:14.823409 (+ 28379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:15.150247 (+326838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.155293 (+  5046us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:15.165427 13228 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 7. Current term is 8. Ops: []
W20260709 13:04:15.083770 15722 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 1.437s	user 0.002s	sys 0.008s
I20260709 13:04:15.167021 12621 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:14.807529 15613 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:14.887729 15619 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:14.853916 15696 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:15.072808 15058 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:14.953277 15713 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:15.001889 15627 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:14.796015 15605 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:15.153807 15697 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.156177 15444 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:15.148505 15452 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:15.186606 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:15.161481 15511 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:14.807170 15618 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:15.184921 13228 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:14.956411 15648 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.225s
I20260709 13:04:15.169853 15559 consensus_queue.cc:1243] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:04:15.178154 15755 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:14.887970 15649 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:15.156435 15467 consensus_queue.cc:1059] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:04:15.154450 15725 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:15.198248 15693 consensus_meta.cc:287] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.989s	user 0.008s	sys 0.005s
I20260709 13:04:15.203907 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:15.179280 15741 consensus_queue.cc:1059] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:04:15.206990 15652 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:15.190601 15736 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:04:15.199891 15511 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:15.181937 15613 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:15.189357 15697 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:15.179056 15684 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:15.212793 15755 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.220963 15693 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:15.221763 15620 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:15.223403 15652 raft_consensus.cc:697] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:15.233976 15755 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:15.284880 15724 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:15.285418 15649 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:15.277133 15788 raft_consensus.cc:3055] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:15.277536 15733 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:15.285611 15684 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:15.281406 15785 raft_consensus.cc:3055] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:04:15.289762 15775 log.cc:927] Time spent T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:04:15.288703 15788 raft_consensus.cc:740] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:15.291241 15727 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:15.288555 15725 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:15.294234 15788 consensus_queue.cc:260] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:15.294806 15727 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:15.295343 15788 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:15.292785 15785 raft_consensus.cc:740] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:15.297232 15785 consensus_queue.cc:260] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:15.298475 15785 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:15.300050 15755 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:15.302644 15755 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:15.335702 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2671) took 1294 ms. Trace:
W20260709 13:04:15.342466 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 176760us
W20260709 13:04:15.344379 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 196677us
I20260709 13:04:15.347512 15438 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.348834 15438 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:15.352263 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:15.190838 15058 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:15.354614 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:15.355224 15426 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:15.355857 13234 raft_consensus.cc:2410] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:04:15.358819 15438 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:15.359002 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:15.199738 15444 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:15.203179 15452 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:15.364671 15444 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:15.367389 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:15.439273 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2793) took 1990 ms. Trace:
I20260709 13:04:15.440062 12613 rpcz_store.cc:276] 0709 13:04:13.448973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.822334 (+373361us) service_pool.cc:224] Handling call
0709 13:04:13.822686 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:13.822914 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:04:14.064794 (+241880us) log.cc:844] Serialized 14 byte log entry
0709 13:04:15.411230 (+1346436us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b180036e9e0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a6406c0a 00007fc3afb46219 00007fc3a648ea40 00007fc3a64894e4 00007fc3a6489455 00007fc3a9571060 00007fc3a9583716 00007fc3a9594287 00007fc3a9594208
0709 13:04:15.438200 (+ 26970us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:15.438314 (+   114us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:15.438456 (+   142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.438627 (+   171us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:15.438920 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13663,"prepare.queue_time_us":382650,"prepare.run_cpu_time_us":160,"prepare.run_wall_time_us":8861,"spinlock_wait_cycles":32610048,"thread_start_us":407308,"threads_started":3,"wal-append.queue_time_us":177721}
W20260709 13:04:15.399377 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 53879.6us
I20260709 13:04:15.223023 15511 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:15.408488 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1390) took 1530 ms. Trace:
I20260709 13:04:15.368049 15058 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:15.397821 15613 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:15.448125 12545 rpcz_store.cc:276] 0709 13:04:13.878099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.894128 (+ 16029us) service_pool.cc:224] Handling call
0709 13:04:15.408029 (+1513901us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b54002ea9d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:15.408287 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":843769216}
I20260709 13:04:15.405001 15605 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:15.407631 15618 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:15.406281 15697 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:15.396502 15652 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:15.470014 15774 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:15.472239 15774 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:15.475121 15774 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:15.337005 12540 rpcz_store.cc:276] 0709 13:04:14.041338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.811107 (+769769us) service_pool.cc:224] Handling call
0709 13:04:14.811421 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:14.826103 (+ 14682us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:04:14.826138 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:14.826728 (+   590us) log.cc:844] Serialized 26 byte log entry
0709 13:04:15.146449 (+319721us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:15.146485 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.146541 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:15.334539 (+187998us) raft_consensus.cc:1685] finished
0709 13:04:15.334633 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:15.335309 (+   676us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14269,"raft.queue_time_us":15671,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":103,"thread_start_us":319314,"threads_started":1,"wal-append.queue_time_us":378469}
I20260709 13:04:15.477291 15452 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:15.405697 15733 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:04:15.509413 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2675) took 1409 ms. Trace:
I20260709 13:04:15.510138 12546 rpcz_store.cc:276] 0709 13:04:14.045912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.158829 (+1112917us) service_pool.cc:224] Handling call
0709 13:04:15.182959 (+ 24130us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:15.356670 (+173711us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:04:15.356745 (+    75us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:15.357831 (+  1086us) log.cc:844] Serialized 52 byte log entry
0709 13:04:15.435192 (+ 77361us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:15.435249 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.435387 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:15.445136 (+  9749us) raft_consensus.cc:1685] finished
0709 13:04:15.445459 (+   323us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:15.455707 (+ 10248us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":172779,"raft.queue_time_us":177476,"raft.run_cpu_time_us":418,"raft.run_wall_time_us":417,"thread_start_us":76801,"threads_started":1,"wal-append.queue_time_us":77270}
I20260709 13:04:15.511691 13200 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:15.513283 15471 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:15.520092 13229 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:15.520738 13228 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:15.286087 15620 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:15.532364 15620 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:04:15.533744 13199 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.195:34641 timed out after 1.572s (SENT) [suppressed 21 similar messages]
W20260709 13:04:15.538946 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 366161us
I20260709 13:04:15.539193 13230 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:04:15.547540 12613 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:15.549809 13200 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:15.539093 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2790) took 2099 ms. Trace:
W20260709 13:04:15.537752 13226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 698) took 2331 ms (client timeout 2085 ms). Trace:
I20260709 13:04:15.571074 13197 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:15.571487 15551 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:15.572904 15471 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:15.573522 15471 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:15.573844 15649 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:15.574113 15471 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:15.579248 15753 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.580364 15753 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:15.551362 12615 rpcz_store.cc:276] 0709 13:04:13.439715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.691043 (+251328us) service_pool.cc:224] Handling call
0709 13:04:13.691452 (+   409us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:04:13.701955 (+ 10503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:13.701988 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:04:13.705910 (+  3922us) log.cc:844] Serialized 78 byte log entry
0709 13:04:13.993612 (+287702us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:14.174804 (+181192us) log.cc:844] Serialized 14 byte log entry
0709 13:04:15.538346 (+1363542us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.538545 (+   199us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:15.538638 (+    93us) raft_consensus.cc:1685] finished
0709 13:04:15.538654 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:15.538912 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1256491,"prepare.queue_time_us":242954,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":6885,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":16689,"thread_start_us":373397,"threads_started":3,"wal-append.queue_time_us":347638,"wal-append.run_cpu_time_us":3600,"wal-append.run_wall_time_us":1165088}
I20260709 13:04:15.572383 15551 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:15.579378 15759 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:04:15.553655 13226 rpcz_store.cc:269] 0709 13:04:13.206205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.209353 (+  3148us) service_pool.cc:224] Handling call
0709 13:04:15.537219 (+2327866us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b54006801d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:15.537485 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1864193408}
I20260709 13:04:15.583954 15525 raft_consensus.cc:2764] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:04:15.585136 15051 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:15.589974 15051 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:15.590617 15551 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:15.592900 15051 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:15.597932 15759 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:15.601119 15759 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:15.610388 15511 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:15.613788 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2797) took 1571 ms. Trace:
I20260709 13:04:15.614202 12622 rpcz_store.cc:276] 0709 13:04:14.041952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.841293 (+799341us) service_pool.cc:224] Handling call
0709 13:04:15.138266 (+296973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:15.138530 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:15.340165 (+201635us) log.cc:844] Serialized 14 byte log entry
0709 13:04:15.612866 (+272701us) log.cc:844] Serialized 14 byte log entry
0709 13:04:15.613035 (+   169us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:15.613092 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:15.613360 (+   268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.613466 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:15.613612 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":159370,"prepare.queue_time_us":56487,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":87,"raft.queue_time_us":170956,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":153,"thread_start_us":277228,"threads_started":2,"wal-append.queue_time_us":92200}
I20260709 13:04:15.615594 15696 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.616745 15511 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:15.611626 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 1.37738e+06us
I20260709 13:04:15.617148 15426 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:15.613454 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:15.617995 15008 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:15.610565 15753 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:15.617314 15696 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:15.621510 15801 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:15.623046 12588 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:15.593962 15620 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:15.626803 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2674) took 1581 ms. Trace:
I20260709 13:04:15.627892 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2803) took 1404 ms. Trace:
I20260709 13:04:15.624591 15796 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:15.629186 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 587) took 1292 ms. Trace:
W20260709 13:04:15.629984 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 59134.8us
I20260709 13:04:15.620057 12613 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
W20260709 13:04:15.631621 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 97992us
I20260709 13:04:15.641409 12542 rpcz_store.cc:276] 0709 13:04:14.045686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.158032 (+1112346us) service_pool.cc:224] Handling call
0709 13:04:15.158464 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:15.181868 (+ 23404us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:04:15.470401 (+288533us) log.cc:844] Serialized 14 byte log entry
0709 13:04:15.524006 (+ 53605us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:15.524750 (+   744us) log.cc:844] Serialized 26 byte log entry
0709 13:04:15.524881 (+   131us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:04:15.524908 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.524990 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:15.625233 (+100243us) raft_consensus.cc:1685] finished
0709 13:04:15.625254 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:15.626547 (+  1293us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":187523,"prepare.queue_time_us":267874,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":32976,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":8314,"thread_start_us":302570,"threads_started":2,"wal-append.queue_time_us":138409}
I20260709 13:04:15.649981 15688 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:15.649811 15801 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:15.653936 15688 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:15.654788 15688 raft_consensus.cc:697] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:15.643594 12620 rpcz_store.cc:276] 0709 13:04:14.290768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.836383 (+545615us) service_pool.cc:224] Handling call
0709 13:04:14.836687 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:14.836935 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:15.142278 (+305343us) log.cc:844] Serialized 14 byte log entry
0709 13:04:15.569705 (+427427us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:15.569865 (+   160us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:15.570018 (+   153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.570153 (+   135us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:15.570395 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147614,"prepare.queue_time_us":348612,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":238840,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":195,"thread_start_us":492275,"threads_started":3,"wal-append.queue_time_us":142262}
I20260709 13:04:15.654235 15796 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:15.653935 15620 raft_consensus.cc:697] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:15.659124 15647 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:15.659889 15696 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:15.660145 15051 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:15.662405 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1701) took 1630 ms. Trace:
I20260709 13:04:15.662878 15471 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:15.665129 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:15.671816 15620 consensus_queue.cc:237] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:15.676815 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:15.641886 12614 rpcz_store.cc:276] 0709 13:04:14.223527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.828260 (+604733us) service_pool.cc:224] Handling call
0709 13:04:14.828492 (+   232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:14.828687 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:15.120206 (+291519us) log.cc:844] Serialized 14 byte log entry
0709 13:04:15.528001 (+407795us) log.cc:844] Serialized 14 byte log entry
0709 13:04:15.627133 (+ 99132us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:15.627222 (+    89us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:15.627342 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.627452 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:15.627667 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":418339,"prepare.queue_time_us":341390,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":97,"raft.queue_time_us":487578,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":324,"thread_start_us":372687,"threads_started":3,"wal-append.queue_time_us":98509}
I20260709 13:04:15.716887 15710 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:15.717810 15710 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:15.718263 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 43940.8us
I20260709 13:04:15.691675 15796 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:15.720356 15710 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:15.721546 13197 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:15.722468 15471 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:15.723263 15471 consensus_queue.cc:1059] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:15.725924 15618 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.726166 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:15.727082 12540 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:15.726713 15618 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:15.726848 15688 consensus_queue.cc:237] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:15.726014 12688 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6. Ops: []
W20260709 13:04:15.735219 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 81765.8us
I20260709 13:04:15.676834 12619 rpcz_store.cc:276] 0709 13:04:14.032070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.286437 (+254367us) service_pool.cc:224] Handling call
0709 13:04:14.302730 (+ 16293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:15.526821 (+1224091us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:15.526903 (+    82us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:15.527736 (+   833us) log.cc:844] Serialized 26 byte log entry
0709 13:04:15.553041 (+ 25305us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:15.574136 (+ 21095us) log.cc:844] Serialized 14 byte log entry
0709 13:04:15.574351 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.574462 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:15.661828 (+ 87366us) raft_consensus.cc:1685] finished
0709 13:04:15.661850 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:15.662071 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1184221,"prepare.queue_time_us":29530,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":68,"raft.queue_time_us":1285670,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"spinlock_wait_cycles":5856000,"thread_start_us":46182,"threads_started":2,"wal-append.queue_time_us":130516}
I20260709 13:04:15.751804 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:15.756179 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:15.757704 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:15.748911 15058 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:04:15.760064 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:15.761945 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:15.747900 15051 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:15.735229 15801 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:15.764925 12588 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:15.770329 12622 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
W20260709 13:04:15.770663 15638 consensus_meta.cc:287] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.615s	user 0.014s	sys 0.004s
I20260709 13:04:15.771512 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:15.772368 12619 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:15.773108 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:15.773729 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:15.775259 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:15.775827 12613 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:15.773795 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:15.761618 15058 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.774654 12696 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:04:15.777987 13226 raft_consensus.cc:2393] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:15.770329 12694 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:15.775148 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:15.795292 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:15.782429 15058 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:15.790378 15467 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.799566 12545 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:04:15.807723 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:15.808516 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:15.810582 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:15.812788 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:15.813712 12614 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:15.814204 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:15.816111 12620 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:15.816774 15559 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.817248 15696 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:15.823144 15696 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:15.792412 15801 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.825757 15801 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:15.826278 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 72629.5us
I20260709 13:04:15.827375 12588 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:15.828703 15801 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:15.827661 15696 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:15.831714 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:15.833117 12694 raft_consensus.cc:2410] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:04:15.834826 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:15.836131 12696 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:15.838441 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 589) took 1283 ms. Trace:
I20260709 13:04:15.838935 12618 rpcz_store.cc:276] 0709 13:04:14.555253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.142570 (+587317us) service_pool.cc:224] Handling call
0709 13:04:15.143017 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:15.602482 (+459465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:15.606975 (+  4493us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:15.618327 (+ 11352us) log.cc:844] Serialized 26 byte log entry
0709 13:04:15.742732 (+124405us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:15.742799 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.755144 (+ 12345us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:15.838008 (+ 82864us) raft_consensus.cc:1685] finished
0709 13:04:15.838037 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:15.838218 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":338655,"raft.queue_time_us":435058,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":235,"thread_start_us":204572,"threads_started":2,"wal-append.queue_time_us":184052}
I20260709 13:04:15.854437 13197 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:15.866930 15467 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:15.802168 15796 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.870028 15599 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.870256 15796 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:15.870834 15599 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:15.874156 12692 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:04:15.878762 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:15.897540 15467 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:15.890683 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:15.900008 12696 raft_consensus.cc:2410] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 13:04:15.890192 12688 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 4.
I20260709 13:04:15.817441 15559 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:15.919317 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 65069.4us
I20260709 13:04:15.880045 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:15.921772 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:15.922587 12696 raft_consensus.cc:2376] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7. Re-sending same reply.
I20260709 13:04:15.922719 12613 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:15.923205 12687 raft_consensus.cc:1240] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:15.926419 15467 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:15.930384 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:15.931406 15810 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:15.931980 15810 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:15.932431 15810 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:15.930601 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 103350us
I20260709 13:04:15.934429 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:15.880600 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:15.929251 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:15.935375 12545 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:04:15.935616 12618 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:15.936568 12546 raft_consensus.cc:3055] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:15.936991 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:15.894986 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:15.892159 12690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 1524) took 1928 ms (client timeout 2085 ms). Trace:
I20260709 13:04:15.939193 13197 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:15.937021 12546 raft_consensus.cc:740] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:15.873395 15796 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:15.954798 12540 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:15.950843 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:04:15.939626 12690 rpcz_store.cc:269] 0709 13:04:13.964040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.964424 (+   384us) service_pool.cc:224] Handling call
0709 13:04:15.891661 (+1927237us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54000c71d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:15.891928 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1035049216}
I20260709 13:04:15.917590 15801 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:15.961390 13197 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:15.964241 15755 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:15.964870 15755 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:15.965350 15755 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:15.971930 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:15.978284 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:15.980672 13197 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:15.983356 12613 raft_consensus.cc:2410] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:04:15.985678 13200 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:15.993050 12620 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:15.997886 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 577) took 1637 ms. Trace:
I20260709 13:04:16.000162 13200 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:16.004244 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.006096 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:15.988011 15791 consensus_queue.cc:1059] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:04:16.002264 15652 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:15.999269 12617 rpcz_store.cc:276] 0709 13:04:14.278985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.830320 (+551335us) service_pool.cc:224] Handling call
0709 13:04:14.830648 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:15.549741 (+719093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:15.549788 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:15.550455 (+   667us) log.cc:844] Serialized 26 byte log entry
0709 13:04:15.751884 (+201429us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:15.751925 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:15.755366 (+  3441us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:15.916136 (+160770us) raft_consensus.cc:1685] finished
0709 13:04:15.916167 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:15.916393 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":649393,"raft.queue_time_us":747238,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":221,"thread_start_us":228557,"threads_started":2,"wal-append.queue_time_us":323193}
I20260709 13:04:15.999686 15444 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:16.001541 15808 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:16.023208 12693 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:04:16.031423 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.032822 15710 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.033007 12694 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:16.033475 15710 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:16.035940 15710 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:16.036429 15710 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:16.036908 15710 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:16.038859 12513 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:16.040078 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:16.040725 12617 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:15.992753 15801 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:04:16.041806 12614 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:16.024016 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.017472 15620 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:16.019412 15652 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:16.057778 15652 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:16.050603 15620 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:16.059489 15620 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:16.059612 15426 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:16.060304 15426 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:16.046262 13199 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:16.063565 15634 raft_consensus.cc:3055] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:16.064162 15634 raft_consensus.cc:740] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:16.066007 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.053998 12546 consensus_queue.cc:260] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:16.019724 15444 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:16.050896 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.057034 12539 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:16.067500 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.066176 15801 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:16.075763 12617 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:04:16.075652 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:16.070255 13197 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:16.077554 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 79818.7us
I20260709 13:04:16.079766 12546 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:16.080610 15818 log.cc:927] Time spent T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:04:16.083202 12613 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:16.086143 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.087137 12688 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 9: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:04:16.088516 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 47649.5us
I20260709 13:04:16.080238 15563 consensus_queue.cc:1059] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:04:16.094790 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:16.102401 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.103376 12693 raft_consensus.cc:2393] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 3: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:16.105516 15152 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:16.106539 15718 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:16.106626 15408 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 13:04:16.107343 15718 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:16.109915 12687 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:16.069490 15511 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:16.113092 15713 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:16.070051 15444 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:16.113763 15713 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:16.115648 15810 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:16.117990 12691 raft_consensus.cc:2410] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:04:16.118253 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:16.050187 15808 raft_consensus.cc:697] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 6 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:16.118510 15612 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:16.119117 12617 raft_consensus.cc:2410] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:04:16.119478 15808 consensus_queue.cc:237] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:16.118288 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 76535.6us
I20260709 13:04:16.118016 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.130681 15810 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:16.132143 12513 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:16.135720 15713 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:16.136410 15713 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:04:16.130697 12510 leader_election.cc:336] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.972s (SENT)
I20260709 13:04:16.121312 15791 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:16.142104 12510 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:16.145015 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.147159 12546 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:04:16.147223 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:16.152864 12694 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:16.137874 15058 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:16.155735 12690 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:04:16.161991 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.109333 15652 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:16.163122 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:16.065442 15634 consensus_queue.cc:260] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:16.158211 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:16.156992 15152 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:16.165989 13233 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:04:16.152601 15791 raft_consensus.cc:697] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:16.140029 15408 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:04:16.326627 12690 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:16.334829 13228 raft_consensus.cc:2410] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:04:16.343190 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:16.358233 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 300579us
I20260709 13:04:16.360232 15511 raft_consensus.cc:697] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:04:16.362015 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.362795 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.363528 12694 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
W20260709 13:04:16.363899 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 230365us
W20260709 13:04:16.378947 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 422161us
I20260709 13:04:16.380131 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:16.369489 12588 connection.cc:256] RPC call timeout handler was delayed by -1.4646491599999081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15200000000000002s for a response
I20260709 13:04:16.331718 15810 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.401437 13226 raft_consensus.cc:2368] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10.
I20260709 13:04:16.394634 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:16.410038 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.385291 15563 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:16.405092 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:16.390470 15760 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:16.421240 15632 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:04:16.421881 15810 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:16.422573 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 335318us
I20260709 13:04:16.424407 15810 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:16.433450 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.435491 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:16.446291 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:16.458171 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.442893 15710 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:16.446753 15634 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:16.475117 15755 consensus_meta.cc:287] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.001s
W20260709 13:04:16.464316 15819 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 13:04:16.464702 15820 log.cc:927] Time spent T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:04:16.480369 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:16.415277 15511 consensus_queue.cc:237] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:16.483227 13234 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:16.490510 15710 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:16.491091 15620 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:16.492467 13228 raft_consensus.cc:2393] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 8: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:16.453516 15718 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:16.493081 13226 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:16.446892 15791 consensus_queue.cc:237] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:16.476127 15755 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:16.495810 15755 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:16.463464 15760 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:16.498147 13232 raft_consensus.cc:2393] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 7: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:16.500104 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.485433 15652 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:16.502856 15735 raft_consensus.cc:3055] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:16.503326 15735 raft_consensus.cc:740] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:16.504352 15735 consensus_queue.cc:260] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:16.506363 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.506824 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.511372 12539 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:04:16.518003 15170 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:04:16.518966 15417 raft_consensus.cc:3055] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:16.501992 15426 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:16.505474 15760 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:16.520175 12616 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:16.507290 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:16.480032 15058 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:16.526341 12621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 588) took 1953 ms (client timeout 2069 ms). Trace:
I20260709 13:04:16.505432 15735 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:16.526789 12621 rpcz_store.cc:269] 0709 13:04:14.554324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.774354 (+220030us) service_pool.cc:224] Handling call
0709 13:04:16.507312 (+1732958us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b54003d18d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:16.507494 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":895584640}
I20260709 13:04:16.519426 15417 raft_consensus.cc:740] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:04:16.538431 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 128760us
I20260709 13:04:16.543274 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.549161 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 631) took 3813 ms. Trace:
I20260709 13:04:16.549739 12539 rpcz_store.cc:276] 0709 13:04:12.728777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.191632 (+462855us) service_pool.cc:224] Handling call
0709 13:04:13.191965 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:16.056219 (+2864254us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b58007e38d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a94d50aa 00007fc3a9557447 00007fc3a956ffe7 00007fc3a95717de 00007fc3a957bb49 00007fc3a957c416 00007fc3a9578d8f 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4
0709 13:04:16.511787 (+455568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.541774 (+ 29987us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5292287232}
I20260709 13:04:16.527040 15426 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:16.555851 15417 consensus_queue.cc:260] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:16.547889 15152 raft_consensus.cc:697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:16.562150 15152 consensus_queue.cc:237] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:16.565033 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:16.565840 12621 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:04:16.557257 15417 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:16.604993 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:16.554481 15718 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.610913 13197 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:16.621230 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 67580.4us
I20260709 13:04:16.555851 15444 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:16.625530 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 200146us
I20260709 13:04:16.634788 12621 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:16.637188 12510 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:16.636427 13197 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:16.638221 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 270571us
I20260709 13:04:16.642585 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:16.643319 12621 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:04:16.619570 15718 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:16.657523 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2800) took 2590 ms. Trace:
I20260709 13:04:16.657649 15834 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:16.658232 15834 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:16.658100 12616 rpcz_store.cc:276] 0709 13:04:14.067608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.823545 (+755937us) service_pool.cc:224] Handling call
0709 13:04:16.519399 (+1695854us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:16.520778 (+  1379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.657267 (+136489us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b54003d18d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:16.657452 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3871398144}
I20260709 13:04:16.658721 15834 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:16.659510 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:16.658128 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 714) took 1872 ms. Trace:
I20260709 13:04:16.642621 15838 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:16.669165 12510 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:16.667505 12616 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:16.668745 15633 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:16.673200 15718 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:16.678905 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 708) took 2681 ms. Trace:
I20260709 13:04:16.679401 13227 rpcz_store.cc:276] 0709 13:04:13.997353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:13.997481 (+   128us) service_pool.cc:224] Handling call
0709 13:04:13.997786 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:14.245859 (+248073us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:14.245894 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:14.245932 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:14.245960 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.678444 (+2432484us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b5400570154. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:16.678511 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:16.678700 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":570071424}
I20260709 13:04:16.682065 15620 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:16.671483 15838 raft_consensus.cc:697] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:16.671566 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.667465 13229 rpcz_store.cc:276] 0709 13:04:14.786045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.114086 (+328041us) service_pool.cc:224] Handling call
0709 13:04:15.114556 (+   470us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:15.520826 (+406270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.657859 (+1137033us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b5400630954. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:16.658054 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":863306112}
I20260709 13:04:16.646281 15843 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:16.695636 12693 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:16.695789 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:16.696024 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.696593 12689 raft_consensus.cc:2393] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 7: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:16.696921 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.697767 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.698102 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.698372 15848 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:16.698763 12688 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:16.698820 15848 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:16.699373 15848 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:16.699975 12690 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
W20260709 13:04:16.700230 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:16.700659 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:16.700976 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.704977 15638 raft_consensus.cc:3055] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:16.705493 15638 raft_consensus.cc:740] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:16.702967 15838 consensus_queue.cc:237] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:16.710166 15638 consensus_queue.cc:260] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:16.711336 15638 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:16.711759 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:16.714187 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.715859 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:16.716653 12687 raft_consensus.cc:2376] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9. Re-sending same reply.
I20260709 13:04:16.719269 15444 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:16.725797 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.724180 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:16.728020 15564 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.729629 12619 raft_consensus.cc:1275] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:04:16.729843 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:16.730890 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.728534 15591 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.724678 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 593) took 1941 ms. Trace:
W20260709 13:04:16.731875 15828 log.cc:927] Time spent T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.091s	user 0.000s	sys 0.003s
I20260709 13:04:16.728307 15690 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.732213 15591 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:16.732831 15690 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:16.734875 15591 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:16.734761 15849 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:16.735273 15601 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:16.735965 12689 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:16.724180 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.721022 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.732123 12615 rpcz_store.cc:276] 0709 13:04:14.783571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:15.582686 (+799115us) service_pool.cc:224] Handling call
0709 13:04:15.584220 (+  1534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:15.591327 (+  7107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:15.591375 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:15.591467 (+    92us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:15.591499 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.724476 (+1132977us) spinlock_profiling.cc:243] Waited 998 us on lock 0x7b54001e96d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:16.724516 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:16.724626 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2294528}
I20260709 13:04:16.737789 12694 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:16.731870 12692 raft_consensus.cc:2410] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:04:16.738003 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:16.727634 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.749410 12621 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:16.741420 15591 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:16.777527 15591 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:16.778053 12621 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:16.779588 12621 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:04:16.780001 15591 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:16.725976 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:16.780241 15618 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:04:16.759064 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 108212us
I20260709 13:04:16.722470 15599 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:16.753515 15471 raft_consensus.cc:3055] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:16.781675 15471 raft_consensus.cc:740] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:16.782699 15471 consensus_queue.cc:260] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:16.783890 15471 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:16.767145 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.741362 15564 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:16.792308 15564 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:16.741488 15559 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:16.734777 15690 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:16.802042 12588 connection.cc:256] RPC call timeout handler was delayed by -1.4142491599999403s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
W20260709 13:04:16.802501 12588 connection.cc:256] RPC call timeout handler was delayed by -1.3368491599999288s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
W20260709 13:04:16.802810 12588 connection.cc:256] RPC call timeout handler was delayed by -1.0911491599999863s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
I20260709 13:04:16.803751 12588 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:16.805056 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:16.805488 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 46447.2us
I20260709 13:04:16.806555 15696 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:16.806761 15796 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:16.807232 15696 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:16.808157 15760 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:16.807899 12512 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:16.808960 15760 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:16.807385 15796 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:16.806610 15810 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:16.812971 15810 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:16.814540 12659 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:16.815202 15810 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:16.816057 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.815760 15842 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:16.816648 12659 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:16.818360 15599 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:16.818691 12587 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:16.818779 15599 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:16.819393 15599 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:16.819940 12587 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:16.820557 15736 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:16.821131 15736 raft_consensus.cc:697] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:16.821728 15051 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:16.821506 15847 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:16.822115 15426 consensus_queue.cc:1059] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:16.823179 15426 raft_consensus.cc:3055] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:16.822463 15805 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:16.822238 15713 consensus_queue.cc:1048] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:04:16.823993 15805 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:16.823402 15736 consensus_queue.cc:237] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:16.824435 15805 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:16.822160 15051 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:16.825831 15051 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:16.823561 15426 raft_consensus.cc:740] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:16.809520 15696 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:16.811961 15796 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:16.832989 15850 log.cc:927] Time spent T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.178s	user 0.002s	sys 0.000s
W20260709 13:04:16.844640 15853 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.178s	user 0.002s	sys 0.000s
W20260709 13:04:16.876096 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 111702us
I20260709 13:04:16.902091 12542 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:04:16.903034 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:16.903868 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:16.904335 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:16.900956 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:16.908908 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:16.899089 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:16.900573 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:16.896716 15805 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:16.938823 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2814) took 1010 ms. Trace:
I20260709 13:04:16.900454 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:16.900050 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:16.945490 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 137786us
I20260709 13:04:16.941524 12614 rpcz_store.cc:276] 0709 13:04:15.928038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.104470 (+176432us) service_pool.cc:224] Handling call
0709 13:04:16.104877 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:16.105143 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:16.105511 (+   368us) log.cc:844] Serialized 14 byte log entry
0709 13:04:16.370219 (+264708us) log.cc:844] Serialized 14 byte log entry
0709 13:04:16.693380 (+323161us) spinlock_profiling.cc:243] Waited 6.33 ms on lock 0x7b18003c58c0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a645a2a6 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c3f3 00007fc3a648e7c1
0709 13:04:16.730749 (+ 37369us) spinlock_profiling.cc:243] Waited 26.8 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:04:16.791824 (+ 61075us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b18003c58c0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c3f3 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
0709 13:04:16.793795 (+  1971us) spinlock_profiling.cc:243] Waited 7.41 ms on lock 0x7b18003c58c0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a6406c0a 00007fc3afb46219 00007fc3a648ea40 00007fc3a64894e4 00007fc3a6489455 00007fc3a9571060 00007fc3a9583716 00007fc3a9594287 00007fc3a9594208
0709 13:04:16.924094 (+130299us) log.cc:844] Serialized 14 byte log entry
0709 13:04:16.938504 (+ 14410us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:16.938555 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:16.938605 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.938663 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:16.938768 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":620662,"prepare.queue_time_us":151221,"prepare.run_cpu_time_us":125,"prepare.run_wall_time_us":1576,"raft.queue_time_us":448129,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":11915,"spinlock_wait_cycles":129580928,"thread_start_us":258868,"threads_started":1,"wal-append.queue_time_us":508105}
W20260709 13:04:16.909780 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 88394us
I20260709 13:04:16.939782 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2815) took 1011 ms. Trace:
I20260709 13:04:16.947538 13197 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:16.953770 12613 raft_consensus.cc:2410] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:04:16.954782 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:16.955363 12622 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:16.955156 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:16.956058 12542 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
W20260709 13:04:16.956679 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 55587us
I20260709 13:04:16.958091 12540 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:16.958442 15618 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:16.959213 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2672) took 2878 ms. Trace:
I20260709 13:04:16.961835 15805 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:16.965883 12539 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 8: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:16.966908 15834 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:16.969278 13231 raft_consensus.cc:2955] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:16.970513 13228 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:16.971848 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:16.972265 13232 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:16.973153 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:16.971866 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:16.977963 15618 raft_consensus.cc:697] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:16.978920 12694 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:16.979089 15618 consensus_queue.cc:237] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:16.937000 15690 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:16.980291 15690 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:16.980885 15690 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:16.982827 15471 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:16.983625 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 44341.2us
I20260709 13:04:16.983723 12621 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:04:16.943202 12616 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
W20260709 13:04:16.989073 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.002482 12619 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:04:17.007086 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:17.007608 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 55680.9us
I20260709 13:04:16.959681 12538 rpcz_store.cc:276] 0709 13:04:14.045134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.835400 (+790266us) service_pool.cc:224] Handling call
0709 13:04:14.835728 (+   328us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:04:15.155165 (+319437us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:04:15.831084 (+675919us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b18003e4640. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a6489455 00007fc3acf713c7 00007fc3a95839a7 00007fc3a95930bf 00007fc3a9593038
0709 13:04:16.019569 (+188485us) log.cc:844] Serialized 14 byte log entry
0709 13:04:16.630684 (+611115us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:16.670042 (+ 39358us) log.cc:844] Serialized 52 byte log entry
0709 13:04:16.670380 (+   338us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:16.670432 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.741455 (+ 71023us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:16.753334 (+ 11879us) spinlock_profiling.cc:243] Waited 1.98 ms on lock 0x7b18003e4640. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c3f3 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
0709 13:04:16.857728 (+104394us) raft_consensus.cc:1685] finished
0709 13:04:16.857758 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:16.923288 (+ 65530us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":194633,"prepare.queue_time_us":294190,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":76,"raft.queue_time_us":48727,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":12008,"spinlock_wait_cycles":29944448,"thread_start_us":696846,"threads_started":3,"wal-append.queue_time_us":403991}
I20260709 13:04:17.011075 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:17.011144 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:17.012893 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:17.035907 12512 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:17.037099 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:17.006214 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 55374.2us
I20260709 13:04:17.042475 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:17.045039 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:17.047538 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:17.049005 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:16.897503 15051 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:17.051525 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:17.051855 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:17.057617 12614 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:17.060628 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 53415.1us
I20260709 13:04:17.062165 12616 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:17.063926 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:17.065065 12616 raft_consensus.cc:2376] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6. Re-sending same reply.
I20260709 13:04:16.983417 15471 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:17.054808 15152 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:17.086133 12512 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:17.003746 15835 consensus_queue.cc:1048] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:04:17.050850 15772 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:17.078261 13199 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:16.982872 15426 consensus_queue.cc:260] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:17.093744 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 288734us
I20260709 13:04:17.061185 15620 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.035s
W20260709 13:04:17.126746 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.093475 15731 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:04:17.129112 15716 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:04:17.130221 12512 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
W20260709 13:04:17.129467 15723 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.336s	user 0.014s	sys 0.008s
W20260709 13:04:17.138536 15723 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.420s	user 0.015s	sys 0.008s
I20260709 13:04:17.145685 15559 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.146612 15559 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:17.150748 15599 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:17.151115 15051 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:17.152958 15599 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:17.153360 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:17.155114 15633 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:17.156009 15564 consensus_queue.cc:1059] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:17.157385 15152 raft_consensus.cc:3055] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:17.157838 15152 raft_consensus.cc:740] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:17.159068 15152 consensus_queue.cc:260] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:17.160303 15152 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:17.153403 15444 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:04:17.162358 15856 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:04:17.155778 12512 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:17.163441 12512 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:04:17.163547 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 59029.8us
I20260709 13:04:17.164486 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 727) took 1019 ms. Trace:
I20260709 13:04:17.164862 13230 rpcz_store.cc:276] 0709 13:04:16.144840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.144961 (+   121us) service_pool.cc:224] Handling call
0709 13:04:16.702287 (+557326us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b58000f6398. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454eee 0000000000375939 00007fc3ae4c81e0 00007fc3ae5910c4 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:04:16.702451 (+   164us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:16.702877 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:16.702907 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:16.703379 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:04:16.987665 (+284286us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:16.987719 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.990019 (+  2300us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:17.164170 (+174151us) raft_consensus.cc:1685] finished
0709 13:04:17.164189 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:17.164403 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1186,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":99,"spinlock_wait_cycles":2677504,"thread_start_us":283863,"threads_started":1,"wal-append.queue_time_us":357868}
I20260709 13:04:17.111304 15632 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:17.167418 15632 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.167819 15632 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:17.169699 15616 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:17.166947 15591 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:17.185578 12622 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:17.172497 12614 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:17.104875 15805 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:04:17.129447 15855 log.cc:927] Time spent T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:04:17.192167 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:17.155848 15633 raft_consensus.cc:697] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:04:17.195958 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 123983us
I20260709 13:04:17.156060 15426 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:17.110249 15528 consensus_queue.cc:1059] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
W20260709 13:04:17.207767 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:17.223163 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 58814.7us
I20260709 13:04:17.178362 15591 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:04:17.228767 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 102727us
I20260709 13:04:17.110764 15772 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:17.198874 15616 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:17.107838 15170 consensus_queue.cc:1059] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:04:17.232703 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:17.239605 13199 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:17.242564 12696 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
W20260709 13:04:17.229746 15848 consensus_meta.cc:287] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.530s	user 0.012s	sys 0.000s
I20260709 13:04:17.244304 12587 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:17.199119 15559 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:17.250288 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 58204us
I20260709 13:04:17.231746 15591 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:17.232038 15861 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.237393 15616 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:17.240702 15736 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:17.282100 15860 log.cc:927] Time spent T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:04:17.290194 13230 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:17.291666 13232 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:17.296346 12622 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:17.271900 15808 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:17.299477 15633 consensus_queue.cc:237] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:17.263684 15838 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:17.303206 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:17.307375 12687 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:04:17.278090 15638 consensus_meta.cc:287] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.566s	user 0.012s	sys 0.000s
I20260709 13:04:17.234867 15766 consensus_queue.cc:1059] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:04:17.313046 13226 raft_consensus.cc:2368] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7.
I20260709 13:04:17.280789 15616 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:17.271759 15834 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:17.278635 15861 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:17.319392 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:17.321161 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:17.321746 15760 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:17.302953 15559 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:04:17.314774 15696 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
W20260709 13:04:17.322692 15857 log.cc:927] Time spent T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 13:04:17.328872 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:17.329838 13230 raft_consensus.cc:2393] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 8: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:17.330578 13235 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:17.331832 12618 raft_consensus.cc:1240] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:17.321753 13232 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:04:17.334370 15471 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:17.334895 15471 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.335356 15471 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:16.949051 12617 rpcz_store.cc:276] 0709 13:04:15.928443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.119797 (+191354us) service_pool.cc:224] Handling call
0709 13:04:16.120112 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:16.120522 (+   410us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:16.396541 (+276019us) log.cc:844] Serialized 14 byte log entry
0709 13:04:16.930286 (+533745us) log.cc:844] Serialized 14 byte log entry
0709 13:04:16.939466 (+  9180us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:16.939514 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:16.939560 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:16.939623 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:16.939727 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":278092,"prepare.queue_time_us":15206,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":5970,"raft.queue_time_us":297697,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":15453,"spinlock_wait_cycles":148738176,"thread_start_us":491390,"threads_started":2,"wal-append.queue_time_us":274644}
I20260709 13:04:17.340049 15772 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:17.314924 15859 log.cc:927] Time spent T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:04:17.319695 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2822) took 1272 ms. Trace:
I20260709 13:04:17.343078 12619 rpcz_store.cc:276] 0709 13:04:16.047826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.730450 (+682624us) service_pool.cc:224] Handling call
0709 13:04:16.987217 (+256767us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:17.010132 (+ 22915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:17.319484 (+309352us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54002a85d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:17.319637 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589745408}
I20260709 13:04:17.304486 15808 raft_consensus.cc:697] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:17.230116 15805 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:17.315913 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 57632.9us
I20260709 13:04:17.264241 15848 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:17.372995 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.434044 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:17.437108 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 70030.7us
I20260709 13:04:17.439194 13199 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
W20260709 13:04:17.442976 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 121912us
I20260709 13:04:17.443562 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2820) took 1400 ms. Trace:
I20260709 13:04:17.443837 12588 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:17.443996 12620 rpcz_store.cc:276] 0709 13:04:16.043112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.683536 (+640424us) service_pool.cc:224] Handling call
0709 13:04:16.683886 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:16.811410 (+127524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:16.811448 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:16.811978 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:04:17.022445 (+210467us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:17.022500 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:17.022597 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:17.443325 (+420728us) raft_consensus.cc:1685] finished
0709 13:04:17.443345 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:17.443498 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":127056,"raft.queue_time_us":128459,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":209970,"threads_started":1,"wal-append.queue_time_us":316422}
I20260709 13:04:17.432363 15796 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:17.433531 15772 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.451452 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:17.445149 12588 leader_election.cc:400] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9.
I20260709 13:04:17.463985 12588 leader_election.cc:403] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:17.455576 12620 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:17.308909 15736 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:17.342810 15638 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
I20260709 13:04:17.441471 15471 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:17.490056 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 45075.3us
I20260709 13:04:17.457209 15716 raft_consensus.cc:3055] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:04:17.482249 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.445518 15051 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:04:17.502071 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 62970.5us
I20260709 13:04:17.503948 13199 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:17.454877 13197 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:17.508956 12620 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:17.486127 15426 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9.
W20260709 13:04:17.510550 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.455287 15612 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 13:04:17.519245 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 64458.5us
I20260709 13:04:17.520891 13197 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:17.527056 13197 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:17.455757 15772 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:17.508343 15591 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:17.518762 15528 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:17.545926 15528 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:17.546325 15528 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:17.546936 15591 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:17.549722 15845 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:17.551504 15444 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:17.553113 15845 raft_consensus.cc:697] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:17.554242 15845 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:17.558786 15632 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:17.542838 15796 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.561631 15808 consensus_queue.cc:237] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:17.562242 15796 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:17.565378 15796 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:17.568050 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 64180us
I20260709 13:04:17.570879 13199 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:17.572188 15612 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:17.574988 15632 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:17.543705 15834 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:17.503448 15716 raft_consensus.cc:740] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:17.595191 12619 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:04:17.596527 15834 raft_consensus.cc:697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:17.602569 12588 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:17.544035 15417 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:17.609001 15861 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:17.611554 15471 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:17.611675 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:04:17.599648 15690 consensus_meta.cc:287] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.618s	user 0.013s	sys 0.000s
I20260709 13:04:17.608697 15834 consensus_queue.cc:237] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:17.615597 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:17.616803 12588 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:17.618207 12695 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:17.519532 15688 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 13:04:17.630585 12588 leader_election.cc:400] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10.
I20260709 13:04:17.631096 12588 leader_election.cc:403] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:04:17.631378 12615 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.031s	sys 0.021s
W20260709 13:04:17.631964 12615 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.031s	sys 0.021s
I20260709 13:04:17.632887 12588 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:17.627588 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:17.606644 15426 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:17.643544 12620 raft_consensus.cc:1275] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:17.647004 12588 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:17.625041 15861 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:17.637811 15051 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10.
I20260709 13:04:17.621717 15525 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:04:17.624547 15690 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:17.656457 15796 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:17.656765 15426 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:17.655326 15805 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:17.657315 15848 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:17.664299 15633 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.719022 15616 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:17.700743 15716 consensus_queue.cc:260] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:17.701339 15796 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:17.740010 15796 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:17.743525 15869 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:04:17.751468 15562 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:17.762794 15871 log.cc:927] Time spent T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.221s	user 0.002s	sys 0.000s
I20260709 13:04:17.764309 15620 raft_consensus.cc:3055] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:17.764860 15620 raft_consensus.cc:740] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:17.757099 15528 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:17.662467 15595 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:17.766034 15620 consensus_queue.cc:260] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:17.766785 15595 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:17.767679 15620 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:17.770323 12547 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:04:17.771580 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.774058 15525 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.774566 15525 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:17.775884 15716 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:17.776024 12546 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:17.776351 12538 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:17.777096 15525 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:17.778626 15471 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:17.780301 15471 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:17.783200 15772 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:17.783485 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:17.784112 12541 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:17.785720 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:17.786276 15707 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:17.787695 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:17.788290 12543 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:17.786386 12618 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:04:17.789093 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:17.791044 12545 raft_consensus.cc:2368] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8.
I20260709 13:04:17.794355 15391 consensus_queue.cc:1059] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:17.795921 15391 raft_consensus.cc:3055] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:17.797485 13197 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:17.799526 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:17.805483 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:17.806351 12545 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:17.806825 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:17.810375 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:17.790931 15638 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.789484 15417 raft_consensus.cc:697] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:17.811789 12662 leader_election.cc:400] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7.
I20260709 13:04:17.819342 13199 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:17.830544 12662 leader_election.cc:403] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:04:17.796291 15391 raft_consensus.cc:740] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:17.840835 15391 consensus_queue.cc:260] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:17.842296 15391 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:17.852244 12614 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:17.853667 15633 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:17.854113 15417 consensus_queue.cc:237] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:17.855975 15633 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:17.857759 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:04:17.865072 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.875027 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:17.875679 12695 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
W20260709 13:04:17.912635 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 115670us
I20260709 13:04:17.812057 15736 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:17.815323 15845 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:04:17.864809 15858 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.723s	user 0.004s	sys 0.000s
I20260709 13:04:17.914238 12587 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:17.796254 15706 consensus_queue.cc:1059] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:04:17.955050 12613 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:04:17.865058 15849 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:04:17.957406 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.957333 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:17.965859 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 51741.6us
I20260709 13:04:17.966120 12688 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
W20260709 13:04:17.959641 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:17.942981 12541 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
W20260709 13:04:17.964327 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 49966.4us
I20260709 13:04:17.970038 15706 consensus_queue.cc:1243] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:04:17.970467 15879 log.cc:927] Time spent T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:04:17.970770 15706 raft_consensus.cc:3055] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:17.971191 15706 raft_consensus.cc:740] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:04:17.962791 15618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.976s	user 0.027s	sys 0.037s
W20260709 13:04:17.972488 15618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.027s	sys 0.038s
I20260709 13:04:17.972007 15706 consensus_queue.cc:260] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:17.973239 15706 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:17.973680 15736 consensus_queue.cc:1059] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:17.974884 15736 raft_consensus.cc:3055] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:17.975328 15736 raft_consensus.cc:740] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:17.976424 15736 consensus_queue.cc:260] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:17.977638 15760 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:17.978180 15690 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:17.982394 15528 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:17.983276 15633 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.983843 15633 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:17.984045 15770 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.185s
I20260709 13:04:17.985436 15735 consensus_queue.cc:1059] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:17.988121 12546 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:04:17.953887 15716 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7.
I20260709 13:04:17.939186 15612 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:17.995359 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:17.956717 15845 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.839435 15638 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:18.004969 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2828) took 1081 ms. Trace:
I20260709 13:04:18.006312 12616 rpcz_store.cc:276] 0709 13:04:16.923659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:17.065923 (+142264us) service_pool.cc:224] Handling call
0709 13:04:17.066357 (+   434us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:17.066899 (+   542us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:04:17.082509 (+ 15610us) log.cc:844] Serialized 14 byte log entry
0709 13:04:17.271674 (+189165us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:17.306204 (+ 34530us) log.cc:844] Serialized 52 byte log entry
0709 13:04:17.306363 (+   159us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:17.306399 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:17.306466 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:18.004723 (+698257us) raft_consensus.cc:1685] finished
0709 13:04:18.004743 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:18.004894 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18512,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":419,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":3557,"thread_start_us":142361,"threads_started":1,"wal-append.queue_time_us":513266}
I20260709 13:04:17.978202 15760 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.034809 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2833) took 1030 ms. Trace:
W20260709 13:04:18.018608 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 371657us
I20260709 13:04:17.987272 15633 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:18.035310 12622 rpcz_store.cc:276] 0709 13:04:17.004590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:17.306840 (+302250us) service_pool.cc:224] Handling call
0709 13:04:17.307175 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:17.359795 (+ 52620us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:17.455119 (+ 95324us) log.cc:844] Serialized 14 byte log entry
0709 13:04:18.034258 (+579139us) log.cc:844] Serialized 14 byte log entry
0709 13:04:18.034442 (+   184us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:18.034491 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:18.034543 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:18.034614 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:18.034750 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":239764,"prepare.queue_time_us":19046,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":395,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":338650,"threads_started":1,"wal-append.queue_time_us":503412}
I20260709 13:04:17.964929 15601 consensus_queue.cc:1059] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:04:17.999639 15612 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.045327 12614 raft_consensus.cc:3055] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:18.045960 12614 raft_consensus.cc:740] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:18.046092 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:18.004463 15766 raft_consensus.cc:3055] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:18.005874 15845 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:18.038033 15760 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:18.051005 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.055012 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2829) took 1131 ms. Trace:
I20260709 13:04:18.055550 12615 rpcz_store.cc:276] 0709 13:04:16.924480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:17.067658 (+143178us) service_pool.cc:224] Handling call
0709 13:04:17.067911 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:17.068107 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:17.639769 (+571662us) log.cc:844] Serialized 14 byte log entry
0709 13:04:18.053694 (+413925us) log.cc:844] Serialized 14 byte log entry
0709 13:04:18.054431 (+   737us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:18.054487 (+    56us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:18.054537 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:18.054597 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:18.054939 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109134,"prepare.queue_time_us":60121,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":9680,"raft.queue_time_us":208,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":82,"thread_start_us":835291,"threads_started":2,"wal-append.queue_time_us":396773}
I20260709 13:04:18.062638 12546 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:18.046949 15736 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:18.048822 15612 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:18.082321 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:18.083320 12541 raft_consensus.cc:2393] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 9: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:18.049947 15766 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:18.086068 12614 consensus_queue.cc:260] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:18.093094 12622 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:18.099334 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:18.100860 12614 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:04:18.101835 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 282592us
I20260709 13:04:18.100675 12691 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:18.132540 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:18.133309 12541 raft_consensus.cc:2376] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9. Re-sending same reply.
W20260709 13:04:18.139647 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 72583.6us
I20260709 13:04:18.103698 15008 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.130378 15564 raft_consensus.cc:3055] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:18.146071 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:18.153201 15564 raft_consensus.cc:740] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:18.156862 15564 consensus_queue.cc:260] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:18.160751 15889 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:04:18.142081 15525 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.165247 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:18.173731 15834 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:18.188354 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:18.191321 12691 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1436) took 2047 ms (client timeout 1944 ms). Trace:
W20260709 13:04:18.191803 12691 rpcz_store.cc:269] 0709 13:04:16.144060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:16.144258 (+   198us) service_pool.cc:224] Handling call
0709 13:04:18.191084 (+2046826us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b54001effd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:18.191220 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4410750720}
I20260709 13:04:18.173731 15766 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:18.205462 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:18.206048 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:18.206352 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:18.208019 15885 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:04:18.207815 12659 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:18.217080 12538 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 3.
I20260709 13:04:18.217875 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:18.228257 12546 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:18.228534 12692 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:18.223304 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:18.223524 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:18.223691 13229 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:18.224499 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:18.224925 13231 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:18.225062 13234 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:18.224560 13228 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:04:18.225594 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:18.142246 15471 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:18.237067 13232 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:18.143955 15008 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:18.240765 12659 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:18.283695 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:18.264629 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:18.213186 15564 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:18.214623 15895 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:18.297410 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 69296.4us
W20260709 13:04:18.298738 12512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.017s	user 0.025s	sys 0.068s
I20260709 13:04:18.294144 12544 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
W20260709 13:04:18.289249 12510 leader_election.cc:336] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.582s (SENT)
I20260709 13:04:18.305267 12542 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:18.307418 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:18.295518 12541 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
W20260709 13:04:18.281250 15891 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.237s	user 0.001s	sys 0.001s
I20260709 13:04:18.312153 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:18.312642 12696 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:18.315214 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.315913 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:18.316108 15898 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:18.241716 15620 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:18.212450 15525 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:18.317641 12614 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:04:18.243618 15730 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:18.296022 15690 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.327023 12692 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:18.319696 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:18.327087 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:18.213445 15796 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:18.213083 15834 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:18.329214 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:18.321002 12544 raft_consensus.cc:1275] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:18.329877 12542 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:18.296032 15810 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:18.329407 13233 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 7: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:18.323104 12614 pending_rounds.cc:85] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 6
I20260709 13:04:18.320267 15152 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:18.306492 15735 consensus_queue.cc:1059] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:04:18.341082 15638 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:18.346400 13232 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
W20260709 13:04:18.348227 12512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.067s	user 0.026s	sys 0.069s
W20260709 13:04:18.348706 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 1.06721e+06us
I20260709 13:04:18.331902 12614 pending_rounds.cc:107] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:04:18.349864 12614 raft_consensus.cc:2889] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:18.327996 15730 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:18.355463 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:18.357100 12512 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:18.357750 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:18.311241 15895 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:18.398844 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:18.356846 15730 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:18.332427 15690 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:18.328327 15620 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:18.425843 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:18.428777 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 71763.8us
I20260709 13:04:18.354748 15599 consensus_queue.cc:1059] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 13:04:18.431201 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:18.434316 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.436137 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:18.377992 15638 raft_consensus.cc:2764] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:04:18.379885 15706 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:18.442986 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:18.346797 15810 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:18.450929 12542 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:18.398447 15152 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.479066 12622 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:18.484081 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:18.484901 12544 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:18.487891 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:18.493263 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:18.480695 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 162416us
W20260709 13:04:18.495501 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 180186us
I20260709 13:04:18.464635 15706 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:04:18.512496 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 204198us
W20260709 13:04:18.513631 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.463753 15898 raft_consensus.cc:697] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:18.515681 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:18.495012 15896 raft_consensus.cc:3055] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:18.496381 15599 raft_consensus.cc:3055] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:04:18.532359 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:18.520375 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 200712us
I20260709 13:04:18.515321 15706 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:18.543797 12662 leader_election.cc:400] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8.
I20260709 13:04:18.545156 12662 leader_election.cc:403] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:04:18.564450 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.573220 13229 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 10. Ops: []
I20260709 13:04:18.577713 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:18.497632 15152 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:18.522487 15599 raft_consensus.cc:740] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:18.533699 15808 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.533763 15848 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.505884 15612 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:18.534641 15471 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:18.521116 15896 raft_consensus.cc:740] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:18.588186 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:18.614118 13230 raft_consensus.cc:2393] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 8: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:04:18.588869 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 47350.4us
I20260709 13:04:18.522778 15528 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:18.614837 12662 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:18.616773 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 104617us
I20260709 13:04:18.619556 13229 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:04:18.619939 13229 pending_rounds.cc:85] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Aborting all ops after (but not including) 8
I20260709 13:04:18.620249 13229 pending_rounds.cc:107] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:04:18.620479 13229 raft_consensus.cc:2889] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:18.609089 15760 consensus_meta.cc:287] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.002s
I20260709 13:04:18.625965 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2667) took 4586 ms. Trace:
I20260709 13:04:18.625965 13232 raft_consensus.cc:2368] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9.
I20260709 13:04:18.542690 15770 consensus_queue.cc:1059] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:04:18.607160 15690 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:18.626418 12547 rpcz_store.cc:276] 0709 13:04:14.039677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:14.782047 (+742370us) service_pool.cc:224] Handling call
0709 13:04:14.810969 (+ 28922us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:17.770741 (+2959772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:18.611214 (+840473us) spinlock_profiling.cc:243] Waited 2.96 s on lock 0x7b54003aaa54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:18.625910 (+ 14696us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6804703104}
I20260709 13:04:18.618086 15796 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:18.605867 15808 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:18.612449 15848 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:18.672627 13231 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:04:18.671631 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.622795 15528 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:18.628485 15912 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:04:18.632836 15760 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:18.661367 15525 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:18.667663 15716 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 8
W20260709 13:04:18.686518 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 69067.4us
I20260709 13:04:18.670559 15895 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:18.687899 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:18.712788 15902 log.cc:927] Time spent T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:04:18.675500 15599 consensus_queue.cc:260] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:18.733347 12547 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:18.721143 15810 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:18.709985 15903 log.cc:927] Time spent T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:04:18.697990 15796 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.740587 12614 raft_consensus.cc:2393] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 7: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:18.649494 15898 consensus_queue.cc:237] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:18.738900 15916 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:18.744613 15888 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:04:18.759528 15845 consensus_meta.cc:287] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.685s	user 0.011s	sys 0.001s
I20260709 13:04:18.802465 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:18.811369 15152 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:18.812700 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 197930us
I20260709 13:04:18.806336 15690 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:04:18.814291 12662 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:18.815385 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:18.816634 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:18.817174 12662 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:18.818017 15888 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:18.820592 15690 consensus_queue.cc:1059] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:18.820169 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:18.817302 12547 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:18.785363 15599 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:18.772282 15620 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:18.774590 15916 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:04:18.813385 15564 consensus_meta.cc:287] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.507s	user 0.006s	sys 0.003s
I20260709 13:04:18.841054 12544 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:18.821307 15888 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:18.770596 15796 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:18.822544 15528 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:18.831702 15849 raft_consensus.cc:3055] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:18.821486 15690 raft_consensus.cc:3055] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:18.842417 15909 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:18.891523 12547 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:04:18.869688 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 751) took 1054 ms. Trace:
W20260709 13:04:18.892207 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.845489 15916 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:18.820271 15562 consensus_queue.cc:1059] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
W20260709 13:04:18.885048 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.710135 15896 consensus_queue.cc:260] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:18.842299 15612 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:18.807185 15845 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:18.899075 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 113634us
I20260709 13:04:18.900409 12547 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:18.842979 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:18.892333 12687 rpcz_store.cc:276] 0709 13:04:17.809367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:17.814292 (+  4925us) service_pool.cc:224] Handling call
0709 13:04:17.840283 (+ 25991us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:18.138545 (+298262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:18.138578 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:18.139134 (+   556us) log.cc:844] Serialized 52 byte log entry
0709 13:04:18.289578 (+150444us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:18.289636 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:18.289727 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:18.863755 (+574028us) raft_consensus.cc:1685] finished
0709 13:04:18.863772 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:18.863923 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6377,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":104,"thread_start_us":447822,"threads_started":2,"wal-append.queue_time_us":235407}
W20260709 13:04:18.902539 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 82490.1us
I20260709 13:04:18.872416 15912 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:18.870380 15849 raft_consensus.cc:740] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:18.840004 15706 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:18.873589 15690 raft_consensus.cc:740] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:18.905084 12547 raft_consensus.cc:1240] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:18.922385 12620 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:04:18.908617 12539 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:04:18.930727 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:18.902559 15914 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.154s	user 0.001s	sys 0.001s
W20260709 13:04:18.932848 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:18.933451 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:18.937484 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:18.939432 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:18.941028 12692 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:18.941396 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:18.942620 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:18.943291 12687 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:18.944950 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:18.945647 12692 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:18.975220 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:18.976035 15890 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.933s	user 0.007s	sys 0.004s
I20260709 13:04:18.975600 15849 consensus_queue.cc:260] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:18.976763 15849 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:18.977191 15690 consensus_queue.cc:260] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:18.978153 15924 log.cc:927] Time spent T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:04:18.932821 15562 consensus_queue.cc:1243] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:04:18.990193 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:18.978715 15690 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:18.986554 12691 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:04:18.988299 15706 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:18.936896 15808 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:18.938452 15848 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:18.904657 15920 consensus_queue.cc:1059] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:04:19.005578 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:19.006475 12688 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:18.943459 15760 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:18.996667 15925 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:04:18.989146 15735 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:18.990219 15612 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:18.979936 15912 raft_consensus.cc:697] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:18.914788 15909 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
W20260709 13:04:19.029127 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 125423us
I20260709 13:04:19.036329 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:19.019135 15716 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8.
I20260709 13:04:19.023782 15735 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:19.054490 12538 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:04:19.047992 15730 consensus_meta.cc:287] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.617s	user 0.006s	sys 0.006s
I20260709 13:04:19.082122 12538 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:04:19.083925 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:04:19.089550 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 46317.6us
I20260709 13:04:19.034543 15612 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:19.046597 15845 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:19.042174 15933 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:19.093058 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:19.081954 15735 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:19.054610 15808 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:19.104163 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:19.106071 12662 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:19.091320 15729 raft_consensus.cc:3055] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:04:19.107982 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.109295 12538 raft_consensus.cc:3055] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:19.110100 12538 raft_consensus.cc:740] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:19.097472 15796 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:19.118376 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:19.088680 15730 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:19.126156 12689 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:04:19.128288 12688 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:04:19.128646 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:19.132539 12662 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:19.111464 15729 raft_consensus.cc:740] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:19.125190 12538 consensus_queue.cc:260] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:19.142192 15770 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:19.104998 15808 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:19.155120 12542 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:19.126431 15930 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:19.159708 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:19.126282 15933 raft_consensus.cc:697] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:04:19.161882 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:19.147297 15736 consensus_meta.cc:287] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.065s	user 0.008s	sys 0.005s
W20260709 13:04:19.162519 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.154377 15909 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:19.151036 15939 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:19.170835 12662 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:19.175127 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:19.176319 12688 raft_consensus.cc:2410] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:04:19.177037 12512 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:19.161911 15930 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.178611 12622 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:19.181376 12512 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:19.132150 15935 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:04:19.186359 15562 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:19.186632 15928 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:19.189535 15928 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.129874 15912 consensus_queue.cc:237] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:19.188978 15941 log.cc:927] Time spent T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:04:19.193653 15916 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:19.190029 15928 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:19.195888 15916 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:19.183274 12512 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:19.200032 12512 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:04:19.201743 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.170667 15909 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.204557 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:19.172482 15736 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:19.179658 15930 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:19.179646 15770 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:19.233027 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 59052.6us
I20260709 13:04:19.232577 15729 consensus_queue.cc:260] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:19.236092 15808 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:19.220337 15929 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:19.236999 15929 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.237349 15929 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:19.198755 15939 raft_consensus.cc:697] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:19.241791 15933 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:19.242441 15939 consensus_queue.cc:237] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:19.244223 13234 raft_consensus.cc:1240] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:19.206121 15909 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:19.245122 15417 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.245652 15417 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:19.247758 15417 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:19.232776 15944 log.cc:927] Time spent T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:04:19.233155 15736 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:19.258709 15882 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 1.249s	user 0.007s	sys 0.000s
I20260709 13:04:19.259613 15612 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:19.260295 15884 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 1.217s	user 0.000s	sys 0.005s
I20260709 13:04:19.210151 15562 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:19.261636 15562 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.261981 15562 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:19.265014 15899 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 1.079s	user 0.000s	sys 0.006s
I20260709 13:04:19.268415 15766 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:19.230919 15152 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:19.269953 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1702) took 1230 ms. Trace:
I20260709 13:04:19.270313 12617 rpcz_store.cc:276] 0709 13:04:18.039155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:18.039740 (+   585us) service_pool.cc:224] Handling call
0709 13:04:18.040222 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:18.040716 (+   494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:18.040755 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:18.041259 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:04:18.097481 (+ 56222us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:04:18.097524 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:18.098087 (+   563us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:19.264471 (+1166384us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:04:19.269647 (+  5176us) raft_consensus.cc:1685] finished
0709 13:04:19.269670 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:19.269891 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2876,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":61931776,"thread_start_us":55613,"threads_started":1,"wal-append.queue_time_us":133751}
I20260709 13:04:19.271627 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:19.273649 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.274339 15934 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:19.276417 15834 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:19.287531 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2703) took 1007 ms. Trace:
I20260709 13:04:19.220930 15706 consensus_queue.cc:1059] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:04:19.288865 15706 raft_consensus.cc:3055] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:19.289238 15706 raft_consensus.cc:740] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:19.290349 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2707) took 1008 ms. Trace:
I20260709 13:04:19.290100 15706 consensus_queue.cc:260] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:19.288089 12540 rpcz_store.cc:276] 0709 13:04:18.280094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:18.283106 (+  3012us) service_pool.cc:224] Handling call
0709 13:04:18.300079 (+ 16973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:18.313315 (+ 13236us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:18.480131 (+166816us) log.cc:844] Serialized 14 byte log entry
0709 13:04:19.286835 (+806704us) log.cc:844] Serialized 14 byte log entry
0709 13:04:19.287066 (+   231us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:19.287133 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:19.287196 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:19.287306 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:19.287455 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":664542,"prepare.queue_time_us":970717,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":48975,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":22314,"thread_start_us":187738,"threads_started":2,"wal-append.queue_time_us":189054}
I20260709 13:04:19.273197 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:19.307137 12691 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:19.307559 13226 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:19.307808 12512 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:04:19.305583 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.257344 15736 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:19.311724 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2701) took 1032 ms. Trace:
I20260709 13:04:19.290764 12541 rpcz_store.cc:276] 0709 13:04:18.281499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:18.320176 (+ 38677us) service_pool.cc:224] Handling call
0709 13:04:18.321223 (+  1047us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:18.328806 (+  7583us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:18.521818 (+193012us) log.cc:844] Serialized 14 byte log entry
0709 13:04:19.289799 (+767981us) log.cc:844] Serialized 14 byte log entry
0709 13:04:19.289980 (+   181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:19.290030 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:19.290082 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:19.290150 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:19.290289 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":718979,"prepare.queue_time_us":1624134,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":60,"raft.queue_time_us":46238,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":5344,"thread_start_us":242066,"threads_started":2,"wal-append.queue_time_us":238589}
I20260709 13:04:19.314571 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 741) took 1087 ms. Trace:
I20260709 13:04:19.315142 13226 rpcz_store.cc:276] 0709 13:04:18.220868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:18.223052 (+  2184us) service_pool.cc:224] Handling call
0709 13:04:19.273030 (+1049978us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b58000f6398. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae53f0a0 00007fc3ae53e984 00007fc3a7ab96d4 00007fc3a7ab9662
0709 13:04:19.308066 (+ 35036us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5189888}
I20260709 13:04:19.306794 12662 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:19.291319 15706 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:19.293478 15051 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.292323 15808 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:19.312162 12543 rpcz_store.cc:276] 0709 13:04:18.279456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:18.279559 (+   103us) service_pool.cc:224] Handling call
0709 13:04:18.279904 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:18.280137 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:18.377870 (+ 97733us) log.cc:844] Serialized 14 byte log entry
0709 13:04:19.280841 (+902971us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b1800472ea0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a6406c0a 00007fc3afb46219 00007fc3a648ea40 00007fc3a64894e4 00007fc3a6489455 00007fc3acf713c7 00007fc3a95839a7 00007fc3a95930bf 00007fc3a9593038
0709 13:04:19.281076 (+   235us) log.cc:844] Serialized 14 byte log entry
0709 13:04:19.281408 (+   332us) log.cc:844] Serialized 14 byte log entry
0709 13:04:19.281540 (+   132us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:19.298689 (+ 17149us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:19.298745 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:19.298811 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:19.311653 (+ 12842us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":724324,"prepare.queue_time_us":1018970,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":87,"raft.queue_time_us":12551,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":2956,"spinlock_wait_cycles":58128768,"thread_start_us":240879,"threads_started":2,"wal-append.queue_time_us":258134}
W20260709 13:04:19.338699 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.341689 12690 raft_consensus.cc:2410] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:04:19.344589 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.319489 12512 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:19.348974 12662 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:19.364574 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 46649.3us
W20260709 13:04:19.360549 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 157017us
I20260709 13:04:19.370558 12662 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:19.372835 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:19.316999 15633 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:19.326326 15932 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.317451 15417 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.350270 15730 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:19.307760 15735 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:19.394019 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:19.349159 15888 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:19.379065 15808 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:19.406720 15888 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:19.408799 15888 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:19.408932 15808 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:19.355000 15736 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:19.311758 15612 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:04:19.411353 15612 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:19.417810 15834 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:19.320705 15152 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
W20260709 13:04:19.404938 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.426630 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:19.427338 12622 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:19.426652 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.431644 12613 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:19.433463 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:19.434304 12613 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:19.396095 15716 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:19.435153 15152 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:19.435688 15152 raft_consensus.cc:697] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:19.435961 12614 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:04:19.436543 15152 consensus_queue.cc:237] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:19.437626 15760 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:19.438225 15760 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:19.439175 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:19.440412 15760 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:19.379279 15599 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:19.445991 15716 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:19.447325 15562 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:19.448494 15008 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:19.449417 15562 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:19.383229 15934 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:19.404486 15932 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:19.348102 15929 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:19.456118 15929 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:19.344471 15909 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:19.409317 15888 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:19.504922 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:19.506412 12620 raft_consensus.cc:2393] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 5: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:19.367338 15051 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:19.511725 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:19.512259 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:19.512495 12618 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:19.512861 12613 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:19.518563 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:19.528067 12622 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:19.529913 12616 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
W20260709 13:04:19.531936 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 138046us
W20260709 13:04:19.536764 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 217402us
I20260709 13:04:19.402444 15417 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:19.538612 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:19.539309 12620 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:04:19.541815 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:19.543054 12618 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 10: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:19.527463 15599 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.477123 15928 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:19.549813 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.549474 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:19.552024 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 108244us
I20260709 13:04:19.552337 12616 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:19.555262 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:19.556639 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:19.557492 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.513406 15888 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:19.544866 15950 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:19.564289 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:19.594467 12695 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:19.596481 15928 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:19.597999 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:19.598703 15616 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:19.565310 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:19.599781 12543 raft_consensus.cc:2410] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:04:19.566628 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:19.600921 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:19.601260 12547 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:19.566958 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:19.603018 12539 raft_consensus.cc:2376] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8. Re-sending same reply.
I20260709 13:04:19.603144 12695 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:19.603991 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:19.604851 12539 raft_consensus.cc:2393] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 10: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:19.567255 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:19.605989 12540 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:19.606040 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:19.568198 15595 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:19.570362 15892 log.cc:927] Time spent T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 1.528s	user 0.000s	sys 0.004s
I20260709 13:04:19.607185 12544 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 8: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:19.573856 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:19.608498 12688 raft_consensus.cc:2393] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:19.609416 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 623) took 1972 ms. Trace:
I20260709 13:04:19.609920 12621 rpcz_store.cc:276] 0709 13:04:17.637521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:17.747417 (+109896us) service_pool.cc:224] Handling call
0709 13:04:17.747899 (+   482us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:17.748375 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:17.748410 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:17.749080 (+   670us) log.cc:844] Serialized 26 byte log entry
0709 13:04:18.001945 (+252865us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:18.002018 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:18.002116 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:19.569824 (+1567708us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:04:19.609102 (+ 39278us) raft_consensus.cc:1685] finished
0709 13:04:19.609124 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:19.609350 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2085,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":13141760,"thread_start_us":252087,"threads_started":1,"wal-append.queue_time_us":292589}
I20260709 13:04:19.611378 15909 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:19.574189 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:19.574422 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 665) took 1064 ms. Trace:
I20260709 13:04:19.575757 15736 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.612548 12542 rpcz_store.cc:276] 0709 13:04:18.509703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:18.536347 (+ 26644us) service_pool.cc:224] Handling call
0709 13:04:19.574226 (+1037879us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b5400410d54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:19.574339 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":655632640}
I20260709 13:04:19.612959 15736 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:19.576591 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:19.614542 13228 raft_consensus.cc:2368] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8.
I20260709 13:04:19.614974 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 920) took 1392 ms. Trace:
I20260709 13:04:19.615015 15417 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:19.615429 13228 rpcz_store.cc:276] 0709 13:04:18.222311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:19.576343 (+1354032us) service_pool.cc:224] Handling call
0709 13:04:19.614913 (+ 38570us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:19.615855 15736 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:19.616325 15932 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:19.612569 12541 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:19.618333 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:04:19.577239 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:19.619432 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 253708us
I20260709 13:04:19.587003 15729 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:19.590521 12620 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:19.590764 12613 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:19.592187 15735 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:19.627552 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.578826 15896 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:19.567589 13199 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:19.627662 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:04:19.629195 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 61681.4us
I20260709 13:04:19.590642 15051 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:19.637676 12693 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:19.638279 13197 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:19.641992 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:19.643304 12613 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:19.645897 12547 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:19.646550 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:19.647564 12621 raft_consensus.cc:2393] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 7: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:19.554119 15599 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:19.651175 15599 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:19.652729 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:19.654587 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:19.655014 15888 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:19.658509 12619 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:19.655491 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:19.665691 12512 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:19.676851 12692 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:19.636097 15849 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:04:19.690877 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.562454 15930 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:19.702018 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:19.692252 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:19.697598 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 162258us
I20260709 13:04:19.713652 12693 raft_consensus.cc:2410] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:04:19.715188 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:19.719290 12694 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:19.687774 15595 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:19.672096 15964 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:04:19.731913 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 92562.1us
I20260709 13:04:19.733587 13197 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:19.734247 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 70160.9us
I20260709 13:04:19.737551 13200 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:19.743705 12615 raft_consensus.cc:1217] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Deduplicated request from leader. Original: 3.5->[4.6-6.7]   Dedup: 6.7->[]
I20260709 13:04:19.744405 12615 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 13:04:19.748415 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1704) took 1685 ms. Trace:
I20260709 13:04:19.727264 15528 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:19.748883 12615 rpcz_store.cc:276] 0709 13:04:18.062580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:19.743096 (+1680516us) service_pool.cc:224] Handling call
0709 13:04:19.743581 (+   485us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:19.748125 (+  4544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:19.748346 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:19.749948 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:19.724320 15849 raft_consensus.cc:697] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:04:19.755576 12510 leader_election.cc:336] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.900s (SENT)
I20260709 13:04:19.756209 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:19.762172 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:19.763322 12613 raft_consensus.cc:2368] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6.
I20260709 13:04:19.740118 15964 raft_consensus.cc:697] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:19.766887 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:19.769333 12662 leader_election.cc:336] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Timed out: RequestConsensusVote RPC to 127.11.44.196:33997 timed out after 2.236s (SENT)
I20260709 13:04:19.771536 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:19.774793 15849 consensus_queue.cc:237] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:19.778228 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:19.779052 12688 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 4.
I20260709 13:04:19.779426 15965 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:19.779852 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:19.781031 12619 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:19.737398 15595 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:19.782073 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:19.782753 12619 raft_consensus.cc:2368] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 7. Current term is 8.
W20260709 13:04:19.782831 15961 log.cc:927] Time spent T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:04:19.783011 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:19.783394 15595 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:19.783705 12694 raft_consensus.cc:2393] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 7: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:19.784197 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:19.784591 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:19.784762 12616 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:19.787245 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:19.787315 12622 raft_consensus.cc:1217] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Deduplicated request from leader. Original: 3.3->[5.4-6.5]   Dedup: 6.5->[]
I20260709 13:04:19.788587 12622 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7. Ops: [5.4-6.5]
I20260709 13:04:19.790036 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:19.791319 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:19.792142 12622 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:19.783546 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:19.794450 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:19.786890 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:19.752056 15528 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:19.803424 12619 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:04:19.803732 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:19.804517 12620 raft_consensus.cc:2393] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:19.804829 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:19.806143 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:19.740298 15958 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:04:19.808156 12621 raft_consensus.cc:1240] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 2. Current term is 3. Ops: []
I20260709 13:04:19.809017 12615 raft_consensus.cc:2393] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:19.808832 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:19.811777 12693 raft_consensus.cc:2410] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:04:19.772987 12510 leader_election.cc:336] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.931s (SENT)
I20260709 13:04:19.813822 12694 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:19.755041 15735 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 13:04:19.814837 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:19.815522 12622 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
W20260709 13:04:19.817044 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 44105.8us
I20260709 13:04:19.819411 12616 raft_consensus.cc:2410] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:04:19.821472 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:19.806984 15528 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:19.820509 12510 leader_election.cc:336] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.940s (SENT)
I20260709 13:04:19.828938 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:19.835083 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:19.843811 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:19.847108 12542 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:19.845333 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:19.849041 12622 raft_consensus.cc:2393] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:19.851558 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:19.856720 15845 consensus_queue.cc:1059] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:19.857972 15845 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:19.859148 13199 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:19.861707 15962 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:19.856778 15973 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:19.863179 15973 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:19.861378 15964 consensus_queue.cc:237] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:19.868163 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 749) took 2251 ms. Trace:
I20260709 13:04:19.863566 15973 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:19.872409 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:19.876444 12543 raft_consensus.cc:2393] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 7: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:19.868646 12696 rpcz_store.cc:276] 0709 13:04:17.616533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:17.616684 (+   151us) service_pool.cc:224] Handling call
0709 13:04:18.194151 (+577467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:18.522772 (+328621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:18.522800 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:18.522849 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:18.522890 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:19.691482 (+1168592us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54001effd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:19.691544 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:19.867950 (+176406us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b54001effd0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:19.868072 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36669,"raft.queue_time_us":34950,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":15076,"spinlock_wait_cycles":1559703808,"thread_start_us":185905,"threads_started":1}
W20260709 13:04:19.879271 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 78709.5us
I20260709 13:04:19.881443 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:19.882403 12540 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:19.885864 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:19.886785 12547 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:19.893298 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:19.894378 12543 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:19.895592 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:19.898501 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:19.899194 12547 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:19.902477 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:19.903151 12616 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:04:19.846576 15928 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:19.907033 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:19.908530 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:19.836985 15957 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:04:19.920877 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.928858 12542 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:19.934744 12547 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
W20260709 13:04:19.939356 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:19.954936 12662 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:20.095453 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:19.954692 12542 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:20.004894 15736 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.119545 15736 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:19.953893 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:20.123385 12622 raft_consensus.cc:2393] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:20.023818 12540 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:20.126350 12613 raft_consensus.cc:2410] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:04:19.932961 15939 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.127357 15939 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:20.128720 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2699) took 1849 ms. Trace:
I20260709 13:04:19.989447 12621 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6. Ops: []
W20260709 13:04:20.151238 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.008157 12616 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
W20260709 13:04:20.064877 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 194655us
I20260709 13:04:20.200515 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:20.147090 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 192225us
I20260709 13:04:20.250692 12662 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:19.934146 15957 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.253015 15707 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:20.129494 12546 rpcz_store.cc:276] 0709 13:04:18.278838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:18.283188 (+  4350us) service_pool.cc:224] Handling call
0709 13:04:18.299409 (+ 16221us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:18.332223 (+ 32814us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:04:18.489505 (+157282us) log.cc:844] Serialized 14 byte log entry
0709 13:04:19.239616 (+750111us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b1800424900. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c3f3 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
0709 13:04:20.126067 (+886451us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b1800424900. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a91214bc 00007fc3a646f48b 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a6489455 00007fc3a9571060 00007fc3a9583716 00007fc3a9594287
0709 13:04:20.126239 (+   172us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:20.126708 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:04:20.128132 (+  1424us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:20.128196 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:20.128345 (+   149us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:20.128412 (+    67us) raft_consensus.cc:1685] finished
0709 13:04:20.128451 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:20.128612 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5967,"prepare.queue_time_us":952285,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":41879,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":10171,"spinlock_wait_cycles":16360832,"thread_start_us":308123,"threads_started":3,"wal-append.queue_time_us":163653}
W20260709 13:04:20.218739 15968 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.385s	user 0.001s	sys 0.000s
I20260709 13:04:20.255960 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:20.274924 12621 raft_consensus.cc:2393] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:20.243783 15939 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:19.959089 15729 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:20.055308 15975 consensus_queue.cc:1059] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.235s
W20260709 13:04:20.249729 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 369448us
I20260709 13:04:20.261255 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:20.294552 12613 raft_consensus.cc:2410] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:04:20.263645 12662 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:20.017992 15976 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:04:20.210341 15970 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.321s	user 0.001s	sys 0.001s
I20260709 13:04:19.951452 15928 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:19.940001 15958 raft_consensus.cc:3055] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:04:19.964957 15967 log.cc:927] Time spent T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:04:20.260010 13199 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:20.202220 15909 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:20.282094 15417 raft_consensus.cc:3055] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:20.306547 15975 raft_consensus.cc:3055] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:20.306718 15444 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:20.313158 13200 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:20.293021 15939 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:04:20.342649 13200 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:20.316259 15958 raft_consensus.cc:740] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:04:20.320293 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 60415.5us
I20260709 13:04:20.349126 13199 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:20.320701 15912 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:20.320864 15849 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:20.322901 15928 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:20.330113 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 1565) took 1311 ms. Trace:
I20260709 13:04:20.360247 13230 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:04:20.315935 15417 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:20.279146 15957 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:20.305190 15729 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.338760 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 1559) took 1395 ms. Trace:
I20260709 13:04:20.358227 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:20.303491 15736 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:20.356621 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:20.356913 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:20.385955 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:20.386868 12614 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:20.357797 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:20.358623 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:20.356144 13228 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:04:20.332988 15930 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:20.375674 12690 rpcz_store.cc:276] 0709 13:04:18.943563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:18.980670 (+ 37107us) service_pool.cc:224] Handling call
0709 13:04:20.338594 (+1357924us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b54004349d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:20.338711 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":803575680}
I20260709 13:04:20.374833 12691 rpcz_store.cc:276] 0709 13:04:19.019243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:19.019500 (+   257us) service_pool.cc:224] Handling call
0709 13:04:20.329921 (+1310421us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b54002c9f54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:20.330040 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63864576}
I20260709 13:04:20.357364 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:20.392212 13232 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:04:20.359064 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:20.375633 15729 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:20.351502 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.376363 13233 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:04:20.341049 15975 raft_consensus.cc:740] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:20.362083 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:20.350394 15706 consensus_meta.cc:287] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.993s	user 0.011s	sys 0.001s
I20260709 13:04:20.407271 12540 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:20.393402 13231 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:20.397297 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:04:20.399809 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 50797.2us
I20260709 13:04:20.409345 12613 raft_consensus.cc:2393] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:20.409614 13199 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:20.410784 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:20.411099 13199 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:20.411454 13230 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:20.373544 15849 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:20.403815 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:20.413256 15849 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:20.414414 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:20.415059 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:20.415565 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:20.416291 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:20.416440 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:20.417037 12616 raft_consensus.cc:2393] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:20.417649 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:20.417935 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:20.418272 12622 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:20.389075 15444 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.419191 15444 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:20.419889 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:20.421901 13235 raft_consensus.cc:2393] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 8: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:04:20.422240 13197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.008s	sys 0.017s
I20260709 13:04:20.412580 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:20.421461 15444 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:20.397593 15976 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:20.422914 13226 raft_consensus.cc:2368] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8.
I20260709 13:04:20.422935 12622 raft_consensus.cc:3055] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:20.395546 15981 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:20.402365 15912 raft_consensus.cc:697] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:20.405848 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:20.427410 12688 raft_consensus.cc:2410] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:04:20.427311 12546 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:20.423595 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:20.421259 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:20.423784 12622 raft_consensus.cc:740] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:04:20.428601 15977 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:04:20.412637 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:20.424372 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:20.429361 15912 consensus_queue.cc:237] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:20.317780 15980 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
I20260709 13:04:20.430590 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 630) took 1006 ms. Trace:
I20260709 13:04:20.431084 12617 rpcz_store.cc:276] 0709 13:04:19.423878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:19.423984 (+   106us) service_pool.cc:224] Handling call
0709 13:04:19.435339 (+ 11355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:19.635775 (+200436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:19.635806 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:19.635845 (+    39us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:19.635874 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:20.430389 (+794515us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54002a71d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:20.430426 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:20.430540 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":460494080}
I20260709 13:04:20.429299 12622 consensus_queue.cc:260] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:20.433169 12622 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:20.433151 15957 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:20.434844 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:20.435251 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.435915 15957 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:20.423063 15444 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:20.436803 15444 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.437181 15444 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:20.438257 15417 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:20.439603 15417 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:20.441464 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:20.442154 12622 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:04:20.442342 12617 raft_consensus.cc:2393] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:20.443295 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:20.443878 12616 raft_consensus.cc:2376] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8. Re-sending same reply.
I20260709 13:04:20.444412 12538 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:20.444962 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:20.446076 12619 raft_consensus.cc:2410] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:04:20.447382 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:20.448240 12614 raft_consensus.cc:2410] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:04:20.448978 12622 pending_rounds.cc:85] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 5
I20260709 13:04:20.449357 12622 pending_rounds.cc:107] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:04:20.449708 12622 raft_consensus.cc:2889] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:20.444950 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:20.452083 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:04:20.453251 13197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.008s	sys 0.018s
W20260709 13:04:20.453824 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 720462us
I20260709 13:04:20.455494 13197 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:20.456925 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:20.457113 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:20.458190 12615 raft_consensus.cc:2410] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:04:20.468545 12538 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:04:20.469671 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 677) took 1921 ms. Trace:
I20260709 13:04:20.470207 12538 rpcz_store.cc:276] 0709 13:04:18.548465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:19.093912 (+545447us) service_pool.cc:224] Handling call
0709 13:04:19.094179 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:20.444126 (+1349947us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b580089fcd0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a94d50aa 00007fc3a9557447 00007fc3a956ffe7 00007fc3a95717de 00007fc3a957bb49 00007fc3a957c416 00007fc3a9578d8f 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4
0709 13:04:20.469231 (+ 25105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:20.469593 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2971155712}
I20260709 13:04:20.472361 13230 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:04:20.410773 15895 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:04:20.486344 15984 log.cc:927] Time spent T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:04:20.477730 15620 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:20.481431 15975 consensus_queue.cc:260] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:20.488517 15988 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:20.488751 15975 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:20.491418 13233 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:20.491860 15954 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.492393 15954 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:20.495016 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.495954 12513 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:04:20.477411 15564 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:04:20.497366 15690 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:20.497687 12692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 1567) took 1414 ms. Trace:
W20260709 13:04:20.454908 15612 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.042s	user 0.013s	sys 0.002s
I20260709 13:04:20.423316 15976 raft_consensus.cc:697] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:20.426990 15981 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.499282 13197 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:18.974819 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:20.498376 12692 rpcz_store.cc:276] 0709 13:04:19.083254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:19.083587 (+   333us) service_pool.cc:224] Handling call
0709 13:04:20.497509 (+1413922us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b5400236ed4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:20.497632 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1314295680}
W20260709 13:04:20.509835 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:20.498654 15612 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.086s	user 0.013s	sys 0.002s
I20260709 13:04:20.421185 15849 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:20.517908 15982 log.cc:927] Time spent T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:04:20.518699 15954 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:20.519881 15444 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:20.501789 13229 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:20.352166 15958 consensus_queue.cc:260] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:20.521976 15612 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:20.522636 15612 raft_consensus.cc:697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:20.523044 15958 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:20.523607 15612 consensus_queue.cc:237] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:20.525851 13227 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:20.526963 15981 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:20.520221 15849 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:20.500065 15528 consensus_meta.cc:287] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.650s	user 0.005s	sys 0.005s
W20260709 13:04:20.546278 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:20.522104 15983 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 13:04:20.561267 12510 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.992s (SENT) [suppressed 35 similar messages]
I20260709 13:04:20.485291 15729 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:20.546504 15973 consensus_meta.cc:287] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.649s	user 0.007s	sys 0.002s
W20260709 13:04:20.563411 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:20.534570 15972 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.018s	sys 0.020s
I20260709 13:04:20.566785 15690 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:20.563516 15707 raft_consensus.cc:697] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:20.560421 15528 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:20.582077 15972 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.018s	sys 0.021s
I20260709 13:04:20.611778 15707 consensus_queue.cc:237] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:20.610106 15690 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:20.614609 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:20.615355 13235 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 10: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:20.615919 15690 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:20.600546 15929 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:20.616737 15929 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:20.618563 15729 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:20.605437 15928 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.621708 15928 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:20.623903 15928 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:20.568003 15973 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:20.627835 15973 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:20.636646 15930 raft_consensus.cc:1064] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: attempting to promote NON_VOTER 66750b8bbd4c4b3a9695951d0ede3372 to VOTER
I20260709 13:04:20.639147 15528 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:20.646252 13234 raft_consensus.cc:1240] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:20.632563 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:20.681586 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.684751 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:20.686259 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:20.679370 15564 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.688706 15564 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:20.692363 12692 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:04:20.694571 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:20.694654 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:20.695235 12695 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:04:20.698707 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:20.699612 12690 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:20.708261 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:20.708881 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:20.709815 12696 raft_consensus.cc:2410] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:04:20.679594 15690 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.720614 12693 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:20.607673 15444 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:20.722316 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:20.728215 12691 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:20.684526 15528 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.601934 15950 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 13:04:20.734684 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:20.729645 15706 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:20.735872 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:20.731242 12694 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:20.738903 12662 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:20.719301 12695 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:20.747876 12695 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:20.723073 12692 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:20.754007 12659 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:20.718077 15929 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:20.755482 13199 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:20.775851 12662 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:04:20.776505 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 433897us
I20260709 13:04:20.775875 13231 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:20.692085 15735 consensus_queue.cc:1059] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:04:20.786023 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:20.755735 15896 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:04:20.795434 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:20.800885 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:20.801600 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 48144.7us
I20260709 13:04:20.729864 15835 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:04:20.808717 12662 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:20.802498 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 365504us
I20260709 13:04:20.730197 15690 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:20.726209 15980 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:04:20.782624 15417 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:04:20.793947 15991 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:04:20.819380 12615 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:04:20.775216 15444 consensus_queue.cc:1059] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:04:20.751281 15528 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:20.828713 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:20.832406 12617 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:04:20.724035 15976 consensus_queue.cc:237] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:20.784713 15834 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:04:20.755558 15706 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:20.839715 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 394804us
I20260709 13:04:20.836098 12587 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:20.842339 12621 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:04:20.844378 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.818621 15898 raft_consensus.cc:2764] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:04:20.821677 15920 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:20.849835 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:20.852861 12617 raft_consensus.cc:2410] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:04:20.850523 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:20.854722 12621 raft_consensus.cc:2393] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 10: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:20.861680 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:20.862355 12621 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:20.864370 12690 pending_rounds.cc:85] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 6
I20260709 13:04:20.864828 12690 pending_rounds.cc:107] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 6.7
W20260709 13:04:20.864863 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.865296 12690 raft_consensus.cc:2889] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:20.805588 15981 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:20.844867 15992 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:20.857404 15920 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.850010 15417 raft_consensus.cc:697] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:20.883304 15992 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:20.887931 15920 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:20.925495 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.989094 13235 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:20.894163 15950 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:20.999164 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.017072 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:21.017969 12615 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:21.019624 15706 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:21.020385 16002 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:21.022416 15999 consensus_queue.cc:1059] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:20.983047 15929 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:21.023699 15929 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:21.025820 15929 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:21.029613 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.047205 15981 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:21.048251 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2700) took 2769 ms. Trace:
I20260709 13:04:21.048753 12545 rpcz_store.cc:276] 0709 13:04:18.279166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:18.282340 (+  3174us) service_pool.cc:224] Handling call
0709 13:04:18.282749 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:18.295148 (+ 12399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:18.295174 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:18.305134 (+  9960us) log.cc:844] Serialized 26 byte log entry
0709 13:04:20.275631 (+1970497us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b1800474040. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:04:20.581013 (+305382us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:20.642184 (+ 61171us) log.cc:844] Serialized 14 byte log entry
0709 13:04:20.642399 (+   215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:20.642491 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:21.009036 (+366545us) raft_consensus.cc:1685] finished
0709 13:04:21.047989 (+ 38953us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:21.048175 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":60908,"raft.queue_time_us":1229,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":12931,"spinlock_wait_cycles":13466112,"thread_start_us":304867,"threads_started":1,"wal-append.queue_time_us":2426780}
I20260709 13:04:21.053584 15612 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:21.054046 13197 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:21.055188 13197 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:21.055650 15612 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:21.056463 15845 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:21.056959 15612 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:21.058470 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:20.980178 15992 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:21.085649 12621 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:21.087324 13197 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:21.087551 12695 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:04:21.090378 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 281791us
I20260709 13:04:21.091367 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:21.098533 15994 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:21.099391 15994 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:21.102327 15994 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:21.104267 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 283315us
I20260709 13:04:21.108525 12659 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:21.110961 15994 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:20.896816 15930 consensus_queue.cc:237] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:21.084764 15975 consensus_meta.cc:287] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.595s	user 0.012s	sys 0.000s
I20260709 13:04:21.161047 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:21.164790 12621 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:21.166917 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:21.172729 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:21.174679 12695 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 8: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:21.131667 15999 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:21.135169 15834 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:21.095400 15706 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:21.095506 15929 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:04:21.188730 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 340510us
I20260709 13:04:21.189152 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:21.190402 16011 raft_consensus.cc:3055] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:21.190999 16011 raft_consensus.cc:740] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:04:21.191493 16001 log.cc:927] Time spent T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:04:21.192130 16011 consensus_queue.cc:260] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:21.194038 15998 log.cc:927] Time spent T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 13:04:21.197846 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:21.198706 12696 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:21.198920 12689 raft_consensus.cc:1275] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:21.200302 12696 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:21.184733 15690 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:21.189872 12695 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:21.205626 16011 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:21.210134 15929 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:21.211750 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.212361 15929 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:21.212909 15929 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:21.134526 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 302769us
I20260709 13:04:21.183336 12621 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:21.063014 15417 consensus_queue.cc:237] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:21.218255 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:21.219863 13197 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:21.232654 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:21.233227 12695 raft_consensus.cc:2376] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8. Re-sending same reply.
I20260709 13:04:21.221020 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:21.224262 12588 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:21.227281 12615 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:21.235162 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:21.235896 12542 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 8: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:21.235973 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:21.236544 12615 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:21.236761 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:21.237390 12542 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:04:21.237449 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:21.238125 12695 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:21.232093 12543 raft_consensus.cc:2376] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6. Re-sending same reply.
I20260709 13:04:21.234232 12621 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:21.244241 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:21.244815 12543 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:21.248564 12588 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:21.245414 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:21.250018 12542 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:21.251427 13200 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:21.251405 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:21.252650 12696 raft_consensus.cc:2393] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 11: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:21.252903 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:21.253955 12691 raft_consensus.cc:2376] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7. Re-sending same reply.
I20260709 13:04:21.244750 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:21.188769 15528 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:21.256664 13197 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:21.231721 15834 raft_consensus.cc:697] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:21.262532 15834 consensus_queue.cc:237] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:21.273058 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:21.213320 15929 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:21.255033 15975 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:21.258163 16007 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:21.271469 15612 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:21.307868 12545 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:04:21.276968 12588 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:21.277083 15528 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:21.314628 12513 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:21.316495 12615 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:21.318305 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:21.319218 12615 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:21.321763 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:21.325842 12615 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:21.326296 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:21.327641 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:21.330047 12615 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:04:21.335562 12615 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:04:21.337909 12615 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:21.306129 16009 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:21.342749 12659 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:21.297636 16007 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:21.275782 16013 consensus_queue.cc:1059] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:04:21.343896 12617 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:04:21.288591 15973 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:04:21.310196 15528 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:21.353333 12659 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:21.354446 12510 leader_election.cc:336] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.502s (SENT)
I20260709 13:04:21.354854 15835 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.355305 15994 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:04:21.355779 16016 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:04:21.415239 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 80337.8us
I20260709 13:04:21.416148 16009 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:04:21.417245 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 140371us
I20260709 13:04:21.418267 12588 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:21.419585 16009 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:21.420112 16009 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:21.420594 16009 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:21.422027 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:21.423501 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 99479.6us
W20260709 13:04:21.427919 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.359992 15528 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:21.359009 16007 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:21.368001 15994 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:21.367836 15835 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:21.448689 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 95467.8us
W20260709 13:04:21.448873 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.404078 15690 consensus_queue.cc:1059] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:04:21.449162 15939 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:21.390304 15920 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:21.472218 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.453989 15950 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:21.498761 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 211704us
W20260709 13:04:21.476876 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 54962.5us
W20260709 13:04:21.478405 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 385653us
I20260709 13:04:21.479307 12513 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:21.506084 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:21.487210 16010 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:21.488004 16012 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:21.490464 12619 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:21.490993 15735 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.492924 15994 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:21.498180 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 241582us
I20260709 13:04:21.446677 15975 raft_consensus.cc:697] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:21.506306 12662 leader_election.cc:400] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8.
I20260709 13:04:21.486455 15930 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:21.523341 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:21.497082 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 202179us
I20260709 13:04:21.479571 16014 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:21.478225 16048 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:21.538471 13197 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:21.539104 12687 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 7. Current term is 8. Ops: []
W20260709 13:04:21.535729 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 111256us
I20260709 13:04:21.563066 13197 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:21.518695 15950 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:21.558297 15735 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:21.534313 16002 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:21.598989 12543 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:21.602080 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:21.586498 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:21.605145 13232 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:21.587898 13229 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:04:21.551430 16024 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:04:21.616734 13233 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:21.579356 15958 consensus_meta.cc:287] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 1.056s	user 0.011s	sys 0.004s
W20260709 13:04:21.671947 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 107348us
W20260709 13:04:21.658010 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 179554us
I20260709 13:04:21.677938 16002 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:21.681201 16002 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:21.678694 12513 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:04:21.679114 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 155971us
I20260709 13:04:21.685680 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:21.650803 12543 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:04:21.660255 12510 leader_election.cc:336] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.724s (SENT)
W20260709 13:04:21.680424 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 118262us
I20260709 13:04:21.687171 12512 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:21.687794 12510 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:21.588541 13230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:04:21.689685 16010 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:21.690110 13230 raft_consensus.cc:606] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:21.690843 16020 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 13:04:21.691028 15975 consensus_queue.cc:237] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:21.691320 15835 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:21.693706 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.579715 15950 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:21.704041 16025 log.cc:927] Time spent T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260709 13:04:21.537941 15939 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:21.704460 15735 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:21.748018 15958 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:21.726894 13232 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
W20260709 13:04:21.753166 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 74604.7us
I20260709 13:04:21.755575 16002 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:21.754068 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 68514.2us
I20260709 13:04:21.650432 16014 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:21.757434 15835 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:21.599509 15997 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:21.650681 16031 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:21.758298 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 98077.3us
W20260709 13:04:21.820408 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:21.820825 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:21.758757 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 71661.8us
I20260709 13:04:21.822206 12512 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:04:21.764917 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:21.703953 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:21.631666 15929 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:21.808352 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:21.826256 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:21.827385 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 68760.9us
I20260709 13:04:21.816375 16002 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:04:21.829860 12614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.003s	sys 0.011s
I20260709 13:04:21.712005 15736 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:21.938110 12614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.004s	sys 0.012s
I20260709 13:04:21.943106 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 646) took 1128 ms. Trace:
I20260709 13:04:21.948047 12614 rpcz_store.cc:276] 0709 13:04:20.814317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:20.814465 (+   148us) service_pool.cc:224] Handling call
0709 13:04:20.832526 (+ 18061us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:20.832731 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:21.314210 (+481479us) log.cc:844] Serialized 14 byte log entry
0709 13:04:21.942717 (+628507us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:21.942774 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:21.942823 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.942911 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:21.943042 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":459891,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"thread_start_us":1107391,"threads_started":2}
I20260709 13:04:21.783349 16047 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:21.964936 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 441315us
W20260709 13:04:21.969909 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:22.032393 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:22.054486 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 121009us
W20260709 13:04:22.056835 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 77963.4us
I20260709 13:04:22.060386 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:22.069411 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.071599 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:21.813653 16043 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:22.066784 13228 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEARNER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:21.783835 16029 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.193s
I20260709 13:04:22.154892 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:22.157245 12614 raft_consensus.cc:2410] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:04:22.158905 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 71853.2us
W20260709 13:04:22.103276 15992 consensus_meta.cc:287] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.032s	user 0.006s	sys 0.005s
W20260709 13:04:22.121714 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 299614us
I20260709 13:04:21.930852 15835 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:22.132148 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:22.177652 12617 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
W20260709 13:04:22.054342 16021 log.cc:927] Time spent T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.603s	user 0.000s	sys 0.002s
I20260709 13:04:21.961009 15930 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:04:22.103454 12510 leader_election.cc:336] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.892s (SENT)
I20260709 13:04:21.937206 15958 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.157s
I20260709 13:04:22.154857 12687 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5. Ops: []
W20260709 13:04:22.086519 16056 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:04:22.290602 12688 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:22.088392 13226 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:22.120441 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:22.053033 15690 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:22.087198 15929 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:22.177060 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:22.193300 16014 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:21.942274 15950 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:21.973992 15736 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:22.337903 16002 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:22.338541 16002 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:22.339157 15736 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:22.340602 16002 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:22.342566 15895 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.261498 15930 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:22.314868 15690 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:22.345749 15930 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:22.346246 15690 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:22.346803 15690 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:22.347146 15690 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:22.347455 15690 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:22.348596 15920 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:22.352006 15996 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.352552 15996 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:22.360780 15845 consensus_meta.cc:287] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 1.304s	user 0.009s	sys 0.001s
I20260709 13:04:22.361265 15845 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:22.265211 12510 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:22.283290 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:04:22.281397 15612 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.023s	sys 0.054s
I20260709 13:04:21.942164 15997 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:22.175805 16043 raft_consensus.cc:697] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:22.430315 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 691) took 1209 ms. Trace:
I20260709 13:04:22.430394 16043 consensus_queue.cc:237] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:22.431072 12541 rpcz_store.cc:276] 0709 13:04:21.221100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.221227 (+   127us) service_pool.cc:224] Handling call
0709 13:04:21.246354 (+ 25127us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:21.359992 (+113638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:21.360045 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:21.366265 (+  6220us) log.cc:844] Serialized 26 byte log entry
0709 13:04:21.526618 (+160353us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:21.526653 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.526731 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:22.430031 (+903300us) raft_consensus.cc:1685] finished
0709 13:04:22.430063 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:22.430242 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10860,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":6641,"thread_start_us":192330,"threads_started":2,"wal-append.queue_time_us":996415}
I20260709 13:04:22.433952 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 649) took 1615 ms. Trace:
I20260709 13:04:22.434441 12618 rpcz_store.cc:276] 0709 13:04:20.818148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:20.818454 (+   306us) service_pool.cc:224] Handling call
0709 13:04:20.841498 (+ 23044us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:21.103011 (+261513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:21.103048 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:21.103467 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:04:21.387010 (+283543us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:21.387066 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.387177 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:22.433751 (+1046574us) raft_consensus.cc:1685] finished
0709 13:04:22.433771 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:22.433899 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":179641,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"thread_start_us":544004,"threads_started":2,"wal-append.queue_time_us":1322827}
I20260709 13:04:22.436214 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:22.437793 13229 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
W20260709 13:04:22.409222 16009 consensus_meta.cc:287] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.981s	user 0.005s	sys 0.005s
I20260709 13:04:22.438524 16009 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:22.440418 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 701) took 1204 ms. Trace:
I20260709 13:04:22.441144 16009 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:22.441797 12621 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:22.131870 15729 consensus_queue.cc:1059] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.131s
I20260709 13:04:22.306680 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:22.443666 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:22.444804 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:21.937599 16031 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:22.447152 16031 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:22.343104 15895 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:22.450345 15895 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:22.454443 16048 consensus_meta.cc:287] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.837s	user 0.008s	sys 0.000s
I20260709 13:04:22.454892 16048 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:22.437351 15528 consensus_meta.cc:287] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.942s	user 0.008s	sys 0.000s
I20260709 13:04:22.455636 15528 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:22.437358 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:22.459293 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:22.460065 12618 raft_consensus.cc:2368] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6.
I20260709 13:04:22.087451 16060 raft_consensus.cc:3055] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:22.133021 16038 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.148s
I20260709 13:04:22.461304 16060 raft_consensus.cc:740] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:22.462268 16060 consensus_queue.cc:260] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:22.463925 16060 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:22.461236 15528 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:22.469907 16064 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:22.470364 16064 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:22.470669 16064 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:22.472146 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 369208us
W20260709 13:04:22.472800 12510 leader_election.cc:336] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 2.007s (SENT)
I20260709 13:04:22.473145 12510 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:22.474041 15690 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:22.322275 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 145303us
W20260709 13:04:22.328749 16028 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.776s	user 0.001s	sys 0.000s
I20260709 13:04:22.329835 15564 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:22.332360 16045 log.cc:927] Time spent T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.169s	user 0.000s	sys 0.000s
W20260709 13:04:22.333132 16054 log.cc:927] Time spent T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
I20260709 13:04:22.334852 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 695) took 1100 ms. Trace:
I20260709 13:04:22.364100 16029 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:04:22.306488 16026 log.cc:927] Time spent T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.811s	user 0.001s	sys 0.000s
W20260709 13:04:22.250643 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 90743.9us
W20260709 13:04:22.369781 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.380359 12614 raft_consensus.cc:2393] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:22.053614 16047 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:22.215791 15992 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:22.329857 15950 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:22.417737 15939 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:22.419524 15835 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:22.426139 16011 consensus_meta.cc:287] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 1.219s	user 0.006s	sys 0.005s
I20260709 13:04:22.428715 15996 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:22.409381 15612 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.023s	sys 0.055s
I20260709 13:04:22.407521 16002 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:22.440798 12547 rpcz_store.cc:276] 0709 13:04:21.236141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.280827 (+ 44686us) service_pool.cc:224] Handling call
0709 13:04:21.295069 (+ 14242us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:21.295474 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:21.295516 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:21.309029 (+ 13513us) log.cc:844] Serialized 26 byte log entry
0709 13:04:21.533555 (+224526us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:21.533629 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.533702 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:22.440228 (+906526us) raft_consensus.cc:1685] finished
0709 13:04:22.440247 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:22.440363 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":5668,"thread_start_us":172315,"threads_started":1,"wal-append.queue_time_us":1092790}
I20260709 13:04:22.316617 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:22.445358 12617 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:22.484723 12512 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:04:22.511116 12538 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.021s	sys 0.021s
I20260709 13:04:22.513105 12540 rpcz_store.cc:276] 0709 13:04:21.234354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.234502 (+   148us) service_pool.cc:224] Handling call
0709 13:04:21.250350 (+ 15848us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:21.363740 (+113390us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:21.498889 (+135149us) log.cc:844] Serialized 14 byte log entry
0709 13:04:21.756862 (+257973us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:21.757534 (+   672us) log.cc:844] Serialized 52 byte log entry
0709 13:04:21.757717 (+   183us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:21.757950 (+   233us) log.cc:844] Serialized 14 byte log entry
0709 13:04:21.785631 (+ 27681us) log.cc:844] Serialized 14 byte log entry
0709 13:04:22.158224 (+372593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:22.158295 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:22.334521 (+176226us) raft_consensus.cc:1685] finished
0709 13:04:22.334553 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:22.334771 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85962,"prepare.queue_time_us":2405465,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":684611,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":110673,"thread_start_us":741165,"threads_started":5,"wal-append.queue_time_us":206012}
W20260709 13:04:22.521014 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.531265 12692 raft_consensus.cc:2368] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10.
W20260709 13:04:22.537822 12538 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.021s	sys 0.021s
W20260709 13:04:22.544178 12513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.004s	sys 0.018s
W20260709 13:04:22.544138 13199 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.005s	sys 0.017s
W20260709 13:04:22.547822 13199 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.005s	sys 0.017s
W20260709 13:04:22.547613 12513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.005s	sys 0.019s
W20260709 13:04:22.552978 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 766031us
W20260709 13:04:22.557538 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.365752 16014 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:22.602931 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 690) took 1383 ms. Trace:
I20260709 13:04:22.605868 12539 rpcz_store.cc:276] 0709 13:04:21.219310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.219550 (+   240us) service_pool.cc:224] Handling call
0709 13:04:21.219887 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:21.220367 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:21.220396 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:21.240401 (+ 20005us) log.cc:844] Serialized 26 byte log entry
0709 13:04:21.523978 (+283577us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:21.524037 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.524132 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:22.601006 (+1076874us) raft_consensus.cc:1685] finished
0709 13:04:22.601036 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:22.602866 (+  1830us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11696,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":9071,"thread_start_us":237965,"threads_started":1,"wal-append.queue_time_us":666388}
I20260709 13:04:22.608243 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 751) took 2236 ms. Trace:
W20260709 13:04:22.608831 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 94064.7us
I20260709 13:04:22.609942 12614 raft_consensus.cc:3055] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:22.610414 12614 raft_consensus.cc:740] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:22.541584 16061 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:22.608822 13235 rpcz_store.cc:276] 0709 13:04:20.371839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:20.616741 (+244902us) service_pool.cc:224] Handling call
0709 13:04:20.616997 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:20.990596 (+373599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:22.607917 (+1617321us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b5400750154. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:22.608155 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":855246208}
I20260709 13:04:22.546590 16036 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:22.543860 16002 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:22.608536 16031 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:04:22.661849 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:22.669734 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 59990.4us
I20260709 13:04:22.608115 16048 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:22.665421 13231 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 753) took 2293 ms (client timeout 1999 ms). Trace:
W20260709 13:04:22.689127 12622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.057s	sys 0.108s
W20260709 13:04:22.701607 12622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.058s	sys 0.108s
I20260709 13:04:22.704126 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 643) took 1892 ms. Trace:
I20260709 13:04:22.704706 12613 rpcz_store.cc:276] 0709 13:04:20.811702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:20.811820 (+   118us) service_pool.cc:224] Handling call
0709 13:04:20.824585 (+ 12765us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:21.097808 (+273223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:21.097839 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:21.098337 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:04:21.279150 (+180813us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:21.279203 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.279293 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:22.703862 (+1424569us) raft_consensus.cc:1685] finished
0709 13:04:22.703890 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:22.704058 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":196539,"raft.run_cpu_time_us":46,"raft.run_wall_time_us":46,"thread_start_us":453242,"threads_started":2,"wal-append.queue_time_us":357541}
W20260709 13:04:22.699558 13231 rpcz_store.cc:269] 0709 13:04:20.372450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:20.409252 (+ 36802us) service_pool.cc:224] Handling call
0709 13:04:22.665251 (+2255999us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b5400740254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:22.665352 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":603802624}
I20260709 13:04:22.616127 15939 raft_consensus.cc:3055] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:22.615514 15835 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.710158 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:22.715190 12617 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:22.654134 16007 consensus_meta.cc:287] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 1.158s	user 0.011s	sys 0.000s
W20260709 13:04:22.673025 16084 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:04:22.667877 16070 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.718186 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:22.717227 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:22.671607 16034 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:04:22.727213 13233 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:22.720487 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:22.670683 15995 raft_consensus.cc:3055] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:22.706069 16033 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.711769 15417 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.652671 16014 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:22.680214 15992 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:22.678303 15981 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.681401 16047 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:22.698827 16031 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:22.768026 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:22.620710 16066 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:22.669523 15920 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:22.655937 15999 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:04:22.734992 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:22.744115 12617 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:22.887300 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:22.888067 12617 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:04:22.613054 15528 consensus_queue.cc:1059] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 13:04:22.752053 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:22.752533 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:22.896519 13231 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:22.896834 12613 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
W20260709 13:04:22.756191 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 281329us
I20260709 13:04:22.762312 13228 raft_consensus.cc:1240] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:22.762156 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:22.762590 16011 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.714587 15939 raft_consensus.cc:740] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:22.765301 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:22.758126 16023 log.cc:927] Time spent T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 1.360s	user 0.002s	sys 0.003s
I20260709 13:04:22.602741 16075 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:22.768893 13235 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:22.728984 15707 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:22.899209 13232 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:22.890923 12659 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:22.930769 12614 consensus_queue.cc:260] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:22.920873 16014 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:22.769486 15909 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.450s	user 0.007s	sys 0.007s
I20260709 13:04:22.921442 16009 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:22.961267 12614 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:22.734799 15995 raft_consensus.cc:740] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:22.720331 15835 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:22.619467 15994 consensus_meta.cc:287] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.039s	user 0.010s	sys 0.000s
W20260709 13:04:22.962651 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:22.964666 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 73874.5us
I20260709 13:04:22.964978 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 692) took 1743 ms. Trace:
I20260709 13:04:22.611053 16038 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:22.715729 16048 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:22.898307 15999 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:22.982604 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 379921us
I20260709 13:04:22.884068 16031 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:22.727852 16007 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:22.927977 15980 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:22.766441 15417 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:22.764222 16033 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:22.897821 15981 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:22.927703 15920 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:23.100907 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:23.131074 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 62554us
I20260709 13:04:22.985978 12617 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:23.115280 16036 raft_consensus.cc:697] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:23.115576 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2879) took 1135 ms. Trace:
W20260709 13:04:23.115845 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 631155us
I20260709 13:04:23.135304 12621 rpcz_store.cc:276] 0709 13:04:21.979883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.980083 (+   200us) service_pool.cc:224] Handling call
0709 13:04:21.980500 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:22.442309 (+461809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:23.115320 (+673011us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b54001ea5d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:23.115506 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1060407040}
W20260709 13:04:23.076260 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:23.032011 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:23.116580 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:23.017129 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:23.107867 15599 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:04:23.093524 15973 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.019s	sys 0.085s
I20260709 13:04:23.015942 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:23.119725 12513 connection.cc:256] RPC call timeout handler was delayed by -1.7166634810000687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19990000000000002s for a response
I20260709 13:04:23.121759 16060 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:22.619187 16061 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:23.126344 16092 log.cc:927] Time spent T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.241s	user 0.000s	sys 0.000s
I20260709 13:04:23.126832 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:23.128795 13229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 956) took 1568 ms (client timeout 1638 ms). Trace:
I20260709 13:04:23.129403 15999 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:23.132644 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:23.099578 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 642) took 2288 ms. Trace:
I20260709 13:04:23.248883 12617 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:23.077486 12614 raft_consensus.cc:1275] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:04:22.735237 16070 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:23.252660 12513 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:22.932314 15992 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.070878 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 648) took 2170 ms. Trace:
W20260709 13:04:23.232331 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 87085.5us
I20260709 13:04:23.234498 12615 raft_consensus.cc:2393] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 9: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:04:23.249794 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 117186us
I20260709 13:04:23.248816 12620 rpcz_store.cc:276] 0709 13:04:20.811392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:20.811540 (+   148us) service_pool.cc:224] Handling call
0709 13:04:20.811900 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:21.060970 (+249070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:21.061105 (+   135us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:21.065440 (+  4335us) log.cc:844] Serialized 26 byte log entry
0709 13:04:21.290277 (+224837us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:21.290331 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.290422 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:22.681326 (+1390904us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:04:23.075826 (+394500us) raft_consensus.cc:1685] finished
0709 13:04:23.075852 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:23.099487 (+ 23635us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":208885,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":34134784,"thread_start_us":469965,"threads_started":2,"wal-append.queue_time_us":296433}
I20260709 13:04:23.138823 12613 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:23.251008 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1756) took 1190 ms. Trace:
I20260709 13:04:23.012938 13232 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:23.256415 12614 rpcz_store.cc:276] 0709 13:04:22.060630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.542242 (+481612us) service_pool.cc:224] Handling call
0709 13:04:22.603281 (+ 61039us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:23.250797 (+647516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:23.250959 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:23.257089 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:23.258026 13232 raft_consensus.cc:2376] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10. Re-sending same reply.
W20260709 13:04:23.247632 13229 rpcz_store.cc:269] 0709 13:04:21.559959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.703660 (+143701us) service_pool.cc:224] Handling call
0709 13:04:23.128588 (+1424928us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b5400571a54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:23.128717 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1408356736}
W20260709 13:04:22.963995 15909 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.644s	user 0.008s	sys 0.007s
W20260709 13:04:23.114698 16102 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:04:23.279201 12659 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:23.114373 16085 log.cc:927] Time spent T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:04:23.253655 12538 rpcz_store.cc:276] 0709 13:04:21.221505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.221653 (+   148us) service_pool.cc:224] Handling call
0709 13:04:21.247247 (+ 25594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:21.247436 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:04:21.580781 (+333345us) log.cc:844] Serialized 14 byte log entry
0709 13:04:22.964478 (+1383697us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b180041e8a0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a6406c0a 00007fc3afb46219 00007fc3a648ea40 00007fc3a64894e4 00007fc3a6489455 00007fc3a9571060 00007fc3a9583716 00007fc3a9594287 00007fc3a9594208
0709 13:04:22.964628 (+   150us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:22.964679 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:22.964732 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:22.964809 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:22.964927 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":169895,"prepare.queue_time_us":1184850,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":429003,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":32554,"spinlock_wait_cycles":39237504,"thread_start_us":1262279,"threads_started":2,"wal-append.queue_time_us":1039435}
I20260709 13:04:23.254491 12616 rpcz_store.cc:276] 0709 13:04:20.817783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:20.817929 (+   146us) service_pool.cc:224] Handling call
0709 13:04:20.818243 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:21.101784 (+283541us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:21.101814 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:21.102286 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:04:21.598097 (+495811us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:21.598161 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.598272 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:22.988161 (+1389889us) raft_consensus.cc:1685] finished
0709 13:04:22.988180 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:22.988340 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":202722,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"thread_start_us":778498,"threads_started":2,"wal-append.queue_time_us":1430405}
I20260709 13:04:23.199443 13234 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:04:22.967619 15391 raft_consensus.cc:3055] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:22.960688 15707 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:23.016139 15994 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:23.104256 15939 consensus_queue.cc:260] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:23.282552 15835 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:23.282976 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:22.932083 16011 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:23.276252 16040 consensus_queue.cc:1059] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:04:23.284230 16095 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:23.284888 16002 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:23.276968 16047 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:23.378621 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:23.379036 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:23.379269 12695 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:04:23.379637 12689 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:04:23.287278 13231 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:23.204335 15980 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:23.267630 16066 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.289806 12613 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
W20260709 13:04:23.138911 15929 consensus_meta.cc:287] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.824s	user 0.009s	sys 0.000s
W20260709 13:04:23.251580 15973 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.027s	sys 0.092s
I20260709 13:04:23.391207 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:23.302490 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:23.302879 12539 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:04:23.198300 15444 raft_consensus.cc:670] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } [suppressed 3 similar messages]
I20260709 13:04:23.217792 15981 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:22.982785 16098 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:23.077764 15690 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:23.301091 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:23.141003 16091 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:23.321019 12659 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:23.283175 15999 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:23.351334 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 51731.7us
I20260709 13:04:23.456606 12691 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:23.346071 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:23.267995 16060 raft_consensus.cc:697] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:23.424856 15929 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:23.324975 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:23.461514 12538 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:23.350570 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:23.462484 12541 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:22.967391 16014 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:23.268707 15909 raft_consensus.cc:697] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:23.259245 15849 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:04:23.115090 16088 consensus_queue.cc:1059] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.236s
I20260709 13:04:22.936652 16075 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:22.983506 16009 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:23.303294 15391 raft_consensus.cc:740] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:23.288975 15997 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:23.414273 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:23.416062 12693 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:23.531759 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:23.390450 16002 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:23.277808 15992 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:23.466234 15928 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:23.306988 15599 raft_consensus.cc:697] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:23.427371 13230 raft_consensus.cc:2368] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 7. Current term is 8.
I20260709 13:04:23.440070 12662 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:23.442610 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2880) took 1461 ms. Trace:
W20260709 13:04:23.507201 16100 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:04:23.379065 15835 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:23.199746 15995 consensus_queue.cc:260] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:23.392938 15939 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:23.387656 15417 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:23.413866 16040 consensus_queue.cc:1243] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 6.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:04:23.391095 16095 raft_consensus.cc:697] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:04:23.459812 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 158858us
W20260709 13:04:23.473280 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 152716us
I20260709 13:04:23.475244 12542 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:04:23.478021 12547 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:23.479940 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:23.481963 15920 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:23.482211 16061 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:23.425092 16066 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:23.483500 15707 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:23.486245 12689 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:23.486351 15994 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:23.390707 16047 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:23.487066 16063 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:23.460549 16098 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:23.489804 16059 consensus_queue.cc:1059] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:23.490967 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:23.454346 16036 consensus_queue.cc:237] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:23.494109 15849 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:23.495170 16088 raft_consensus.cc:3055] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:04:23.496771 16015 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:04:23.505842 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2884) took 1447 ms. Trace:
I20260709 13:04:23.507159 16096 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:23.507572 15706 consensus_queue.cc:1059] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:04:23.513145 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:23.476819 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:23.518770 13200 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:23.519860 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:23.531986 12696 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:23.415362 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:23.532989 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:23.548664 16097 log.cc:927] Time spent T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:04:23.549414 16060 consensus_queue.cc:237] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:23.413089 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:23.550649 15909 consensus_queue.cc:237] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:23.536360 12539 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:23.558547 12622 rpcz_store.cc:276] 0709 13:04:21.981624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.981751 (+   127us) service_pool.cc:224] Handling call
0709 13:04:21.982147 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:22.058173 (+ 76026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:22.058281 (+   108us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:22.059044 (+   763us) log.cc:844] Serialized 26 byte log entry
0709 13:04:22.702038 (+642994us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:22.702093 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:22.702181 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:23.442318 (+740137us) raft_consensus.cc:1685] finished
0709 13:04:23.442352 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:23.442529 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75301,"raft.queue_time_us":149777,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":9404,"thread_start_us":642640,"threads_started":1,"wal-append.queue_time_us":708621}
I20260709 13:04:23.472740 15999 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:23.558892 16002 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:23.566684 16101 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:23.473127 16091 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:23.568634 15599 consensus_queue.cc:237] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:23.561398 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:23.667340 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:23.715598 16064 consensus_meta.cc:287] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 1.244s	user 0.009s	sys 0.004s
I20260709 13:04:23.550459 15391 consensus_queue.cc:260] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:24.327387 15950 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.222s	user 0.048s	sys 0.024s
W20260709 13:04:24.461285 15950 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.362s	user 0.048s	sys 0.039s
I20260709 13:04:23.816452 15992 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:24.468082 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 764) took 1188 ms. Trace:
I20260709 13:04:23.757007 16105 consensus_queue.cc:1059] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.711s
I20260709 13:04:24.468600 13229 rpcz_store.cc:276] 0709 13:04:23.279989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.368804 (+ 88815us) service_pool.cc:224] Handling call
0709 13:04:24.468024 (+1099220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":567040}
I20260709 13:04:24.469288 16105 raft_consensus.cc:3055] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:04:24.469776 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:24.470074 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:24.470839 16043 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.024s	user 0.000s	sys 0.010s
I20260709 13:04:24.471275 12622 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: []
W20260709 13:04:24.471724 13227 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.003s	sys 0.010s
W20260709 13:04:24.472162 13227 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.003s	sys 0.010s
I20260709 13:04:24.461787 16011 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:23.560829 15835 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:24.459578 16112 consensus_queue.cc:1059] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
W20260709 13:04:24.176880 16069 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.068s	user 0.003s	sys 0.018s
W20260709 13:04:24.451887 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 1.01184e+06us
I20260709 13:04:24.463452 15849 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:24.463976 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:24.503587 12588 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:24.505903 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:24.506181 12616 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:24.464481 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 798) took 1085 ms. Trace:
W20260709 13:04:24.464790 13198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.080s	user 0.010s	sys 0.036s
W20260709 13:04:24.507160 13198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.130s	user 0.010s	sys 0.037s
I20260709 13:04:24.466130 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 796) took 1095 ms. Trace:
I20260709 13:04:24.451598 15980 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:23.790915 16070 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:24.466698 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1478) took 1002 ms. Trace:
I20260709 13:04:24.509128 16002 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:24.508991 12693 rpcz_store.cc:276] 0709 13:04:23.464299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.550883 (+ 86584us) service_pool.cc:224] Handling call
0709 13:04:24.466644 (+915761us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.472388 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 765) took 1167 ms. Trace:
W20260709 13:04:24.472515 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 953764us
I20260709 13:04:24.511636 13231 rpcz_store.cc:276] 0709 13:04:23.305452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.412786 (+107334us) service_pool.cc:224] Handling call
0709 13:04:24.472332 (+1059546us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.512560 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:24.326442 12513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.051s	user 0.006s	sys 0.016s
W20260709 13:04:24.513278 12513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.238s	user 0.007s	sys 0.017s
W20260709 13:04:23.881907 12694 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.016s	sys 0.010s
W20260709 13:04:24.513684 12694 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.383s	user 0.024s	sys 0.013s
I20260709 13:04:24.513844 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 760) took 1380 ms. Trace:
I20260709 13:04:24.514209 13231 rpcz_store.cc:276] 0709 13:04:23.133161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.512339 (+1379178us) service_pool.cc:224] Handling call
0709 13:04:24.513452 (+  1113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.514456 15729 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:24.515064 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:24.515791 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 767) took 1148 ms. Trace:
I20260709 13:04:24.515259 15729 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:24.516091 13231 rpcz_store.cc:276] 0709 13:04:23.367384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.514838 (+1147454us) service_pool.cc:224] Handling call
0709 13:04:24.515714 (+   876us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.473690 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 617) took 1546 ms. Trace:
I20260709 13:04:24.474407 16075 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:24.516863 13232 rpcz_store.cc:276] 0709 13:04:22.927451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.464609 (+537158us) service_pool.cc:224] Handling call
0709 13:04:24.473625 (+1009016us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.518077 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:24.513607 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 802) took 1074 ms. Trace:
I20260709 13:04:24.519110 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 631) took 1035 ms. Trace:
I20260709 13:04:24.518918 12693 rpcz_store.cc:276] 0709 13:04:23.438765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.510309 (+1071544us) service_pool.cc:224] Handling call
0709 13:04:24.510737 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:24.510964 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:24.511000 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:24.511060 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:24.511104 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:24.511170 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:24.513523 (+  2353us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.519851 13232 rpcz_store.cc:276] 0709 13:04:23.484262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.517786 (+1033524us) service_pool.cc:224] Handling call
0709 13:04:24.519041 (+  1255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.521070 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:24.525394 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 626) took 1257 ms. Trace:
I20260709 13:04:23.708060 16007 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:24.451779 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:23.716590 12659 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:24.460529 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 948) took 4100 ms. Trace:
I20260709 13:04:24.526535 13232 rpcz_store.cc:276] 0709 13:04:23.267593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.520725 (+1253132us) service_pool.cc:224] Handling call
0709 13:04:24.525321 (+  4596us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.526584 13226 rpcz_store.cc:276] 0709 13:04:20.360069 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:20.480602 (+120533us) service_pool.cc:224] Handling call
0709 13:04:20.483307 (+  2705us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:22.298573 (+1815266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:24.460272 (+2161699us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b54007c0e54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:24.460464 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3690878720}
I20260709 13:04:24.527706 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:24.527958 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:24.459266 12510 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:24.469799 16105 raft_consensus.cc:740] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:24.528635 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 768) took 1152 ms. Trace:
W20260709 13:04:24.528999 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 69854.1us
I20260709 13:04:24.528983 13226 rpcz_store.cc:276] 0709 13:04:23.376550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.527739 (+1151189us) service_pool.cc:224] Handling call
0709 13:04:24.528576 (+   837us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.473857 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 804) took 1021 ms. Trace:
I20260709 13:04:24.529724 12691 rpcz_store.cc:276] 0709 13:04:23.452202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.457446 (+  5244us) service_pool.cc:224] Handling call
0709 13:04:24.473806 (+1016360us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.530077 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:24.482509 12622 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:24.482874 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 623) took 1414 ms. Trace:
I20260709 13:04:24.482446 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 713) took 1003 ms. Trace:
I20260709 13:04:24.533855 12543 rpcz_store.cc:276] 0709 13:04:23.479455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.479613 (+   158us) service_pool.cc:224] Handling call
0709 13:04:24.482388 (+1002775us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.533777 13229 rpcz_store.cc:276] 0709 13:04:23.068267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.469776 (+1401509us) service_pool.cc:224] Handling call
0709 13:04:24.482783 (+ 13007us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.506629 12689 rpcz_store.cc:276] 0709 13:04:23.378637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.378832 (+   195us) service_pool.cc:224] Handling call
0709 13:04:24.464425 (+1085593us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.500891 16063 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:24.542603 16063 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:24.543183 15928 consensus_meta.cc:287] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.980s	user 0.009s	sys 0.000s
I20260709 13:04:24.543859 15928 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:24.544764 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:24.505523 16069 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.403s	user 0.003s	sys 0.022s
W20260709 13:04:24.475744 15973 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.016s	user 0.005s	sys 0.004s
I20260709 13:04:24.508008 12696 rpcz_store.cc:276] 0709 13:04:23.370781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.373647 (+  2866us) service_pool.cc:224] Handling call
0709 13:04:24.466069 (+1092422us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.518257 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:24.482887 16015 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:24.551548 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 45730.8us
W20260709 13:04:24.551690 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 835113us
I20260709 13:04:24.522027 16117 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.523221 16116 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.473107 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1477) took 1013 ms. Trace:
I20260709 13:04:24.478003 12538 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
W20260709 13:04:24.471836 12544 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.907s	user 0.002s	sys 0.008s
I20260709 13:04:24.486261 15835 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:24.543154 16063 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:24.482093 15999 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:24.418751 15620 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.000s	sys 0.019s
W20260709 13:04:24.471274 16043 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.028s	user 0.000s	sys 0.011s
I20260709 13:04:24.546614 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 763) took 1277 ms. Trace:
I20260709 13:04:23.812377 16014 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:24.552577 16107 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:24.554344 15920 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:24.475915 12618 rpcz_store.cc:276] 0709 13:04:22.058887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.460643 (+401756us) service_pool.cc:224] Handling call
0709 13:04:22.461001 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:22.637449 (+176448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:22.637479 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:22.695610 (+ 58131us) log.cc:844] Serialized 26 byte log entry
0709 13:04:22.761602 (+ 65992us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:22.761641 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:23.505339 (+743698us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54001e9bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:23.505390 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:23.505457 (+    67us) raft_consensus.cc:1685] finished
0709 13:04:23.505478 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:23.505769 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16752,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":105,"spinlock_wait_cycles":404769536,"thread_start_us":11906,"threads_started":1,"wal-append.queue_time_us":213115,"wal-append.run_cpu_time_us":8471,"wal-append.run_wall_time_us":1497206}
I20260709 13:04:24.474747 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 711) took 1007 ms. Trace:
I20260709 13:04:24.574535 12539 rpcz_store.cc:276] 0709 13:04:23.467498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.471073 (+  3575us) service_pool.cc:224] Handling call
0709 13:04:24.474691 (+1003618us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.548681 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 625) took 1329 ms. Trace:
I20260709 13:04:24.574870 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:24.549320 12543 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:04:23.715649 16095 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:24.576344 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 716) took 1024 ms. Trace:
I20260709 13:04:24.576720 12543 rpcz_store.cc:276] 0709 13:04:23.552088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.548903 (+996815us) service_pool.cc:224] Handling call
0709 13:04:24.549174 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:24.576099 (+ 26925us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:24.576293 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.577768 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:24.578302 12539 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:04:24.578940 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 717) took 1016 ms. Trace:
I20260709 13:04:24.579128 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:24.579252 12539 rpcz_store.cc:276] 0709 13:04:23.563005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.577550 (+1014545us) service_pool.cc:224] Handling call
0709 13:04:24.577882 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:24.578675 (+   793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:24.578869 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.550889 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:24.580304 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:24.580847 12696 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:24.580945 13229 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 9: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:24.581669 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 616) took 1682 ms. Trace:
I20260709 13:04:24.581969 13229 rpcz_store.cc:276] 0709 13:04:22.898835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.549637 (+1650802us) service_pool.cc:224] Handling call
0709 13:04:24.581599 (+ 31962us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.582417 15849 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:24.582814 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:24.583114 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:24.583376 16098 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:24.583738 12691 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 5.
I20260709 13:04:24.560026 16007 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:04:24.567708 15620 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.123s	user 0.000s	sys 0.023s
I20260709 13:04:24.551307 12510 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:04:24.459717 13197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.006s	sys 0.009s
W20260709 13:04:24.584790 13197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.095s	user 0.007s	sys 0.009s
I20260709 13:04:24.583642 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 791) took 3080 ms. Trace:
I20260709 13:04:24.583428 13229 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
W20260709 13:04:24.585131 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 1.09581e+06us
I20260709 13:04:24.587740 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 761) took 1452 ms. Trace:
I20260709 13:04:24.588116 13229 rpcz_store.cc:276] 0709 13:04:23.135779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.582578 (+1446799us) service_pool.cc:224] Handling call
0709 13:04:24.587686 (+  5108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.588920 12510 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:24.589354 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:24.590112 12510 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:24.590353 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:24.591077 12691 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 9: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:24.575467 12618 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:24.553164 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:24.553648 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:04:24.555795 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 52337.6us
W20260709 13:04:24.546180 15444 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.018s	sys 0.041s
I20260709 13:04:24.557090 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 714) took 1040 ms. Trace:
I20260709 13:04:24.593139 12616 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:24.585988 12694 rpcz_store.cc:276] 0709 13:04:21.502889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.503314 (+   425us) service_pool.cc:224] Handling call
0709 13:04:21.536778 (+ 33464us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:21.537205 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:21.537243 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:23.129535 (+1592292us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b2c00103488. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:04:23.130212 (+   677us) log.cc:844] Serialized 52 byte log entry
0709 13:04:24.514162 (+1383950us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:24.514231 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:24.514337 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:24.571556 (+ 57219us) raft_consensus.cc:1685] finished
0709 13:04:24.571576 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:24.583578 (+ 12002us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":219957,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":5744896,"thread_start_us":1383494,"threads_started":1,"wal-append.queue_time_us":1422117}
W20260709 13:04:24.557102 12544 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.993s	user 0.002s	sys 0.008s
I20260709 13:04:24.556409 12688 rpcz_store.cc:276] 0709 13:04:23.459501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.561089 (+101588us) service_pool.cc:224] Handling call
0709 13:04:24.473053 (+911964us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.593780 12588 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:04:24.548094 15973 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.093s	user 0.006s	sys 0.004s
I20260709 13:04:24.545472 12620 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:24.550185 15706 raft_consensus.cc:3055] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:24.484187 16064 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:24.562582 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:24.562670 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:24.596758 12617 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:24.550244 15928 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:24.550443 15391 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:24.600453 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:24.600711 16064 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:24.601285 16064 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:24.601661 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:24.560202 12662 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:24.603123 12620 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:24.555574 15912 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:24.603909 15912 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:24.604341 15912 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:24.599141 15928 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:24.551945 16015 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:24.566152 16018 log.cc:927] Time spent T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 3.201s	user 0.013s	sys 0.021s
I20260709 13:04:24.567090 15999 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:24.548480 16096 raft_consensus.cc:697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 10 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:24.567525 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 688) took 3355 ms. Trace:
I20260709 13:04:23.832832 16009 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:24.569830 13232 rpcz_store.cc:276] 0709 13:04:23.269910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.527487 (+1257577us) service_pool.cc:224] Handling call
0709 13:04:24.546541 (+ 19054us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.472808 16088 raft_consensus.cc:740] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:24.575290 13231 rpcz_store.cc:276] 0709 13:04:23.218938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.518042 (+1299104us) service_pool.cc:224] Handling call
0709 13:04:24.548622 (+ 30580us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.620432 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:24.620689 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:24.593302 12538 rpcz_store.cc:276] 0709 13:04:23.516574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.519483 (+  2909us) service_pool.cc:224] Handling call
0709 13:04:24.557027 (+1037544us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.594967 12588 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:24.623479 12616 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:24.614636 15849 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
W20260709 13:04:24.605829 15939 consensus_meta.cc:287] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.889s	user 0.008s	sys 0.004s
I20260709 13:04:24.625821 16070 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.626353 16070 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:24.626986 16033 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:24.596062 15706 raft_consensus.cc:740] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:24.597743 12614 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:04:24.631094 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 627) took 1308 ms. Trace:
I20260709 13:04:24.599925 16091 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:24.568156 15992 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:04:24.605850 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:24.634429 12617 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:24.635708 12696 raft_consensus.cc:2410] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:04:24.637034 15706 consensus_queue.cc:260] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:24.638285 15706 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:24.639106 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:24.640583 12587 leader_election.cc:400] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10.
I20260709 13:04:24.633452 16009 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:24.640900 12587 leader_election.cc:403] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:24.610179 15920 raft_consensus.cc:697] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:24.613407 16113 consensus_queue.cc:1059] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260709 13:04:24.642253 16031 consensus_meta.cc:287] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 1.365s	user 0.010s	sys 0.001s
I20260709 13:04:24.642393 16113 raft_consensus.cc:3055] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:24.642062 15920 consensus_queue.cc:237] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:24.642805 16113 raft_consensus.cc:740] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:24.643524 16088 consensus_queue.cc:260] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:24.643720 16113 consensus_queue.cc:260] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:24.644794 16088 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:24.560177 16116 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:24.646225 13230 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 7: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:24.647213 16116 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:24.648329 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 630) took 1176 ms. Trace:
I20260709 13:04:24.609223 16066 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:24.648698 13230 rpcz_store.cc:276] 0709 13:04:23.471984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.558384 (+ 86400us) service_pool.cc:224] Handling call
0709 13:04:24.648138 (+1089754us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b5400750dd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:24.648269 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":275138304}
I20260709 13:04:24.575969 16107 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:24.650295 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 784) took 3805 ms. Trace:
W20260709 13:04:24.651432 12615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1753) took 2591 ms (client timeout 3426 ms). Trace:
I20260709 13:04:24.651952 16107 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:24.651844 12615 rpcz_store.cc:269] 0709 13:04:22.059741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.060113 (+   372us) service_pool.cc:224] Handling call
0709 13:04:24.651208 (+2591095us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540007bcd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:24.651350 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2697359232}
I20260709 13:04:24.653232 16015 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:24.653584 12621 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:24.653853 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:24.654760 13230 raft_consensus.cc:2368] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10.
I20260709 13:04:24.655166 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 629) took 1209 ms. Trace:
I20260709 13:04:24.655459 13230 rpcz_store.cc:276] 0709 13:04:23.445629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.649525 (+1203896us) service_pool.cc:224] Handling call
0709 13:04:24.655112 (+  5587us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.656390 13230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22a877009d42412fb470ba88a418be05"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:04:24.656760 16048 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:24.656957 13230 raft_consensus.cc:606] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:04:24.625458 16096 consensus_queue.cc:237] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:24.658968 15729 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:24.591077 16112 raft_consensus.cc:2764] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:04:24.557914 16117 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:24.615053 12545 rpcz_store.cc:276] 0709 13:04:21.212641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.240846 (+ 28205us) service_pool.cc:224] Handling call
0709 13:04:21.242014 (+  1168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:21.308385 (+ 66371us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:24.567298 (+3258913us) spinlock_profiling.cc:243] Waited 64.5 ms on lock 0x7b5400410d54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:24.567469 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":148397312}
W20260709 13:04:24.626659 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 66534.7us
I20260709 13:04:24.628005 12695 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:04:24.661067 12695 pending_rounds.cc:85] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 7
I20260709 13:04:24.661437 12695 pending_rounds.cc:107] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:04:24.661708 12695 raft_consensus.cc:2889] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:24.661626 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:24.598234 16110 raft_consensus.cc:2764] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:04:24.629506 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 628) took 1242 ms. Trace:
I20260709 13:04:24.627672 16059 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:04:24.597151 15444 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.019s	sys 0.041s
I20260709 13:04:24.597950 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:24.576193 15950 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.650741 12690 rpcz_store.cc:276] 0709 13:04:20.844493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:20.844698 (+   205us) service_pool.cc:224] Handling call
0709 13:04:20.864199 (+ 19501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:20.866061 (+  1862us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:20.866103 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:20.866559 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:04:21.095983 (+229424us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:21.096018 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:21.096088 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:24.565531 (+3469443us) spinlock_profiling.cc:243] Waited 38.8 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:04:24.649976 (+ 84445us) raft_consensus.cc:1685] finished
0709 13:04:24.650002 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:24.650224 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89209088,"thread_start_us":200692,"threads_started":1,"wal-append.queue_time_us":413497}
I20260709 13:04:24.663144 13231 rpcz_store.cc:276] 0709 13:04:23.386863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.620394 (+1233531us) service_pool.cc:224] Handling call
0709 13:04:24.629444 (+  9050us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.655558 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2891) took 1893 ms. Trace:
I20260709 13:04:24.692915 12621 rpcz_store.cc:276] 0709 13:04:22.761867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.136486 (+374619us) service_pool.cc:224] Handling call
0709 13:04:24.653391 (+1516905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:24.654019 (+   628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:24.655390 (+  1371us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b540007bcd0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:24.655505 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3487876992}
I20260709 13:04:24.657399 13230 raft_consensus.cc:614] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:24.631963 13226 rpcz_store.cc:276] 0709 13:04:23.323079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.530512 (+1207433us) service_pool.cc:224] Handling call
0709 13:04:24.631034 (+100522us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:24.688933 12588 connection.cc:256] RPC call timeout handler was delayed by -1.0735192229999484s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
I20260709 13:04:24.571416 16105 consensus_queue.cc:260] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:24.694813 12588 connection.cc:256] RPC call timeout handler was delayed by -1.0573192229999222s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1976s for a response
W20260709 13:04:24.701279 12588 connection.cc:256] RPC call timeout handler was delayed by -1.0528192229999149s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
W20260709 13:04:24.708550 12662 connection.cc:256] RPC call timeout handler was delayed by -1.686100536999902s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
W20260709 13:04:24.709184 12662 connection.cc:256] RPC call timeout handler was delayed by -1.4422005369998487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
W20260709 13:04:24.712779 12662 connection.cc:256] RPC call timeout handler was delayed by -1.3180005369998753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20470000000000002s for a response
I20260709 13:04:24.751132 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48978 (request call id 12) took 1931 ms. Trace:
I20260709 13:04:24.751543 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:24.753091 13231 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:04:24.751662 13230 rpcz_store.cc:276] 0709 13:04:22.762972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.656252 (+1893280us) service_pool.cc:224] Handling call
0709 13:04:24.694635 (+ 38383us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.755198 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 618) took 1827 ms. Trace:
I20260709 13:04:24.755587 13231 rpcz_store.cc:276] 0709 13:04:22.927812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.752353 (+1824541us) service_pool.cc:224] Handling call
0709 13:04:24.752766 (+   413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:24.754982 (+  2216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:24.755151 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:24.758306 13229 raft_consensus.cc:2368] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 7. Current term is 8.
I20260709 13:04:24.758908 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 621) took 1772 ms. Trace:
I20260709 13:04:24.759301 13229 rpcz_store.cc:276] 0709 13:04:22.986050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.588761 (+1602711us) service_pool.cc:224] Handling call
0709 13:04:24.758834 (+170073us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:24.756626 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 159576us
W20260709 13:04:24.775401 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 164673us
I20260709 13:04:24.679375 16113 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:24.688196 16059 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:24.626361 15849 consensus_queue.cc:1059] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.125s
I20260709 13:04:24.679109 16014 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:24.794641 12659 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:24.799746 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:24.800098 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:24.793509 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:24.778177 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 715) took 1244 ms. Trace:
I20260709 13:04:24.701606 15994 raft_consensus.cc:3055] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:04:24.803974 12513 leader_election.cc:336] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Timed out: RequestConsensusVote RPC to 127.11.44.196:33997 timed out after 1.514s (SENT)
I20260709 13:04:24.642711 16031 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:24.688908 15999 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10.
I20260709 13:04:24.691323 16007 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:24.806998 12513 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:24.803328 12544 rpcz_store.cc:276] 0709 13:04:23.534021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.534193 (+   172us) service_pool.cc:224] Handling call
0709 13:04:23.534514 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:23.534754 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:24.594070 (+1059316us) log.cc:844] Serialized 14 byte log entry
0709 13:04:24.777800 (+183730us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:24.777850 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:24.777902 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:24.777974 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:24.778110 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":945057,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":544,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":107,"thread_start_us":1212157,"threads_started":2,"wal-append.queue_time_us":182742}
I20260709 13:04:24.808300 12659 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:24.795063 16075 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:24.763077 16010 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:24.751950 16069 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.688750 16009 consensus_queue.cc:1059] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.116s
I20260709 13:04:24.811476 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 955) took 3252 ms. Trace:
I20260709 13:04:24.817216 12659 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:24.751010 15950 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:24.814227 13230 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:04:24.816253 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:24.805174 16059 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:24.812268 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:24.837404 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:24.814549 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:24.811650 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 221603us
I20260709 13:04:24.835554 13227 rpcz_store.cc:276] 0709 13:04:21.559541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:21.559748 (+   207us) service_pool.cc:224] Handling call
0709 13:04:21.599711 (+ 39963us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:21.681247 (+ 81536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:21.681280 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:23.468100 (+1786820us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b2c0004cc08. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:04:23.515831 (+ 47731us) log.cc:844] Serialized 52 byte log entry
0709 13:04:24.472585 (+956754us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:24.782165 (+309580us) log.cc:844] Serialized 14 byte log entry
0709 13:04:24.811106 (+ 28941us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:24.811176 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:24.811211 (+    35us) raft_consensus.cc:1685] finished
0709 13:04:24.811290 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:24.811424 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28660,"prepare.queue_time_us":285479,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":522739,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":41578,"spinlock_wait_cycles":42004224,"thread_start_us":1159081,"threads_started":3,"wal-append.queue_time_us":903132}
I20260709 13:04:24.841150 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:24.840875 12510 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:24.841900 13231 raft_consensus.cc:2393] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 8: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:24.838402 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:24.806636 15994 raft_consensus.cc:740] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:24.820648 12540 raft_consensus.cc:1240] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:24.811143 15909 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:24.843161 12510 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:24.814133 16095 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:24.815320 15975 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:24.849072 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:24.848357 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:24.847975 12510 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:24.820500 16010 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:24.856029 12619 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 11: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:24.865116 13197 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:24.867986 12510 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:24.839644 16011 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:24.809882 16014 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:24.811714 16007 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:24.817049 15912 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:24.846602 16140 raft_consensus.cc:3055] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:24.877132 13197 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:24.845656 16009 consensus_queue.cc:1243] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:04:24.875700 12510 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:24.846099 16131 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:24.883013 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:24.884444 12510 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:24.886407 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:24.855820 16036 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:24.840049 16069 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:24.877420 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:24.846498 15909 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:24.853242 16061 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:24.867789 16010 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:24.862035 16066 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:24.862937 16091 consensus_queue.cc:1059] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:04:24.903103 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:24.906242 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:24.906948 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 51997.7us
I20260709 13:04:24.913640 12614 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
W20260709 13:04:24.908684 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 206711us
I20260709 13:04:24.909675 12694 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:24.876662 15849 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:24.899201 12510 leader_election.cc:400] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6.
I20260709 13:04:24.880654 16135 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:04:24.912065 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:24.878229 15716 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:24.885334 16140 raft_consensus.cc:740] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:24.869509 15975 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:24.872773 16048 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:04:24.846429 16063 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:24.900031 16073 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:24.894588 15444 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:24.870651 15835 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:24.898687 15928 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:24.898066 16095 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:24.951902 13232 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:24.900225 16064 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:24.904156 15909 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:24.925730 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:24.926000 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:24.913614 12619 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:24.902774 16061 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:24.877189 16011 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:24.931488 12510 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:24.881098 15973 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:04:24.983028 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:24.984103 12618 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:24.936183 13197 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:24.936969 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:24.916683 15849 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:24.912839 16070 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:24.943450 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:24.946285 12588 leader_election.cc:400] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10.
W20260709 13:04:24.950380 16072 log.cc:927] Time spent T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:04:24.933140 16009 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:24.960987 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:24.995050 13231 raft_consensus.cc:2393] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 8: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:24.958039 15444 raft_consensus.cc:697] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:04:24.985313 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:24.997638 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:24.985791 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 49729.9us
I20260709 13:04:24.961933 16061 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:24.980747 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 49391.1us
W20260709 13:04:24.990026 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 43849.8us
I20260709 13:04:24.908368 15994 consensus_queue.cc:260] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:24.975479 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.001159 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:24.993001 16098 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:25.025728 16098 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:24.990955 15849 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:25.012079 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.027657 12659 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:25.022419 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.032240 16007 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:25.026121 16098 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:25.041042 16104 raft_consensus.cc:3055] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:25.041484 16104 raft_consensus.cc:740] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:25.042634 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:24.990340 15928 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:25.046183 15930 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:25.046742 15930 raft_consensus.cc:697] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:25.047590 15930 consensus_queue.cc:237] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:25.049916 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:25.051251 16014 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:25.002147 15992 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.052444 15992 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:25.054745 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 766) took 1724 ms. Trace:
I20260709 13:04:25.021427 12588 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:25.055444 15992 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:25.058779 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:25.064569 13199 connection.cc:256] RPC call timeout handler was delayed by -1.0541729680001026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
I20260709 13:04:25.066133 15912 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:25.067477 16116 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:25.067750 15950 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:25.025465 16064 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:25.026664 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:25.070405 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:25.071442 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:25.073858 16063 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:25.074167 12662 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:25.075425 12662 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:25.075559 12443 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50014 (request call id 223) took 20295 ms (client timeout 15000 ms). Trace:
I20260709 13:04:25.076220 12692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 792) took 1706 ms. Trace:
I20260709 13:04:25.077021 16086 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:25.077252 12588 leader_election.cc:400] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 7. Current term is 8.
I20260709 13:04:25.077602 12588 leader_election.cc:403] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:25.077786 16086 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:25.076686 12662 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:25.076623 12692 rpcz_store.cc:276] 0709 13:04:23.369544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.369749 (+   205us) service_pool.cc:224] Handling call
0709 13:04:23.370122 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:24.501614 (+1131492us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:04:24.716916 (+215302us) log.cc:844] Serialized 14 byte log entry
0709 13:04:24.910040 (+193124us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:24.910089 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:24.910136 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:25.074543 (+164407us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b1800436420. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a645a2a6 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419
0709 13:04:25.076007 (+  1464us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001effd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:25.076059 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:25.076169 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":59905,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":4606,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":9537,"spinlock_wait_cycles":2606784640,"thread_start_us":363182,"threads_started":2,"wal-append.queue_time_us":241789}
I20260709 13:04:25.021780 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 803) took 1577 ms. Trace:
W20260709 13:04:25.080081 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.081048 12588 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:24.996574 16031 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:25.055305 13232 rpcz_store.cc:276] 0709 13:04:23.329985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.620177 (+1290192us) service_pool.cc:224] Handling call
0709 13:04:25.054504 (+434327us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54006c02d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:25.054652 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":760570112}
I20260709 13:04:25.027729 12510 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:25.029628 13197 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:25.083616 13229 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
W20260709 13:04:25.092475 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 62940.7us
I20260709 13:04:25.076354 15835 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:25.081516 12693 rpcz_store.cc:276] 0709 13:04:23.444794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.520215 (+1075421us) service_pool.cc:224] Handling call
0709 13:04:24.520471 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:24.520672 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:04:24.873632 (+352960us) log.cc:844] Serialized 14 byte log entry
0709 13:04:25.021196 (+147564us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:25.021270 (+    74us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:25.021419 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:25.021508 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:25.021704 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25505,"prepare.queue_time_us":41080,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":18218,"raft.run_wall_time_us":52475,"thread_start_us":452464,"threads_started":2}
I20260709 13:04:25.124943 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:25.129226 13232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:04:25.136194 13232 raft_consensus.cc:606] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:04:25.136649 13232 raft_consensus.cc:614] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:25.132874 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:25.024132 16117 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:25.142872 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 115207us
I20260709 13:04:25.000684 16009 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:25.122007 16086 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:25.089771 16014 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:25.090477 16007 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 7. Current term is 8.
I20260709 13:04:25.150820 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:25.151221 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.226792 12544 raft_consensus.cc:2410] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:04:25.121380 16110 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:25.123003 15391 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:25.227377 15391 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:25.227838 15391 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:25.228500 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:25.228754 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:25.229732 12613 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:25.230896 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 706) took 1958 ms. Trace:
I20260709 13:04:25.231353 12547 rpcz_store.cc:276] 0709 13:04:23.273054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.273437 (+   383us) service_pool.cc:224] Handling call
0709 13:04:23.286320 (+ 12883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:23.716637 (+430317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:25.230644 (+1514007us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54002cc754. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:25.230835 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440419072}
I20260709 13:04:25.232586 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.133060 15994 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:25.182905 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:25.125420 16031 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:25.234295 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.234843 12545 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:25.235800 12545 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:25.236910 12545 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:25.186226 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.238293 12541 raft_consensus.cc:2410] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:04:25.187740 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:25.188540 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:25.191708 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.241952 12613 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:25.243244 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.244853 12544 raft_consensus.cc:2393] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 7: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:25.241925 12539 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:25.246315 12659 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:25.246471 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:25.247112 12616 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:25.248282 12616 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:25.248314 12659 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:25.233242 12547 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:25.224920 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:25.124161 16064 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:25.233227 12621 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:25.223412 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.262046 12538 raft_consensus.cc:2410] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:04:25.260972 13226 raft_consensus.cc:2410] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:04:25.263530 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:25.265986 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:25.225687 16093 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:25.292666 12543 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:25.264158 12613 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:25.343881 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.344656 12539 raft_consensus.cc:2368] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9.
I20260709 13:04:25.254833 15729 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:25.341204 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.341915 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:25.348883 12547 raft_consensus.cc:2410] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:04:25.254127 15939 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:04:25.075954 12443 rpcz_store.cc:269] 0709 13:04:04.780798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:04.793825 (+ 13027us) service_pool.cc:224] Handling call
0709 13:04:25.075337 (+20281512us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:13.205663 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:13.383219 (+177556us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:13.385713 (+  2494us) write_op.cc:435] Acquired schema lock
0709 13:04:13.388659 (+  2946us) tablet.cc:662] Decoding operations
0709 13:04:13.701671 (+313012us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:13.718260 (+ 16589us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:13.718299 (+    39us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:04:13.719414 (+  1115us) tablet.cc:701] Row locks acquired
0709 13:04:13.719436 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:04:13.719607 (+   171us) write_op.cc:270] Start()
0709 13:04:13.719744 (+   137us) write_op.cc:276] Timestamp: P: 1783602253719550 usec, L: 0
0709 13:04:13.719773 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:04:13.720533 (+   760us) log.cc:844] Serialized 4808 byte log entry
0709 13:04:14.965054 (+1244521us) op_driver.cc:464] REPLICATION: finished
0709 13:04:15.221451 (+256397us) write_op.cc:301] APPLY: starting
0709 13:04:15.222637 (+  1186us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:15.288810 (+ 66173us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:15.289786 (+   976us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:15.291165 (+  1379us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:15.291352 (+   187us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:04:15.291381 (+    29us) write_op.cc:312] APPLY: finished
0709 13:04:15.291577 (+   196us) log.cc:844] Serialized 89 byte log entry
0709 13:04:15.291773 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:15.291910 (+   137us) write_op.cc:454] Released schema lock
0709 13:04:15.291958 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:15.292337 (+   379us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:15.292356 (+    19us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":147419,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":221477,"apply.run_cpu_time_us":3098,"apply.run_wall_time_us":73869,"num_ops":12,"prepare.queue_time_us":164635,"prepare.run_cpu_time_us":24531,"prepare.run_wall_time_us":688313,"raft.queue_time_us":531221,"raft.run_cpu_time_us":12322,"raft.run_wall_time_us":373016,"replication_time_us":1167716,"thread_start_us":664127,"threads_started":4,"wal-append.queue_time_us":245537,"wal-append.run_cpu_time_us":44586,"wal-append.run_wall_time_us":2326256}]]}
I20260709 13:04:25.183949 15444 consensus_queue.cc:237] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:25.362319 12538 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:25.357352 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.362910 12621 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:25.372980 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:25.379241 16145 log.cc:927] Time spent T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
W20260709 13:04:25.380703 16153 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.155s	user 0.000s	sys 0.000s
I20260709 13:04:25.353885 15729 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:25.386307 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.386911 12543 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:25.387717 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:25.382694 12547 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:25.382822 12613 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:25.286012 16064 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:25.389147 12539 raft_consensus.cc:2393] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 7: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:04:25.384558 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 405112us
I20260709 13:04:25.369652 16069 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:25.345868 16043 consensus_queue.cc:1059] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:04:25.340217 16010 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:25.385456 16152 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:04:25.370627 15939 raft_consensus.cc:697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:25.343351 16059 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:25.389477 15729 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:25.400368 16148 log.cc:927] Time spent T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.372s	user 0.001s	sys 0.000s
W20260709 13:04:25.400898 16019 log.cc:927] Time spent T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 3.934s	user 0.012s	sys 0.014s
I20260709 13:04:25.414825 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.419706 12543 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:25.420264 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.357457 16093 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:25.424770 16009 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:25.427088 16064 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:25.418071 16088 consensus_meta.cc:287] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.773s	user 0.011s	sys 0.002s
I20260709 13:04:25.436929 12539 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:04:25.453619 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.455720 12538 raft_consensus.cc:2410] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:04:25.454025 12547 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
I20260709 13:04:25.456033 12513 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:25.439020 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:25.458164 12544 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:25.469884 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:25.426735 16061 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:25.475016 12513 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:25.423094 16031 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:25.478029 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.468812 16073 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:25.487102 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.475839 16040 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:25.492586 12539 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:25.476089 16088 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:25.422129 15849 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:25.486714 16150 log.cc:927] Time spent T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.234s	user 0.000s	sys 0.001s
I20260709 13:04:25.491833 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.484618 16112 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:25.498304 12547 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
W20260709 13:04:25.502785 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.475822 16098 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:25.492995 16040 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:04:25.501986 16151 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:04:25.508297 13230 raft_consensus.cc:2368] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 7. Current term is 8.
W20260709 13:04:25.506822 16146 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.389s	user 0.000s	sys 0.001s
W20260709 13:04:25.509717 16158 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:04:25.515100 16010 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:25.497839 16088 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:25.515295 16155 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:04:25.493995 16073 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } }
I20260709 13:04:25.493536 15939 consensus_queue.cc:237] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:25.526847 16073 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:25.527570 16088 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:25.520530 16059 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:25.531852 15849 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:25.532940 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.532738 16098 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:25.510850 16040 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:25.545765 15909 consensus_meta.cc:287] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.000s
I20260709 13:04:25.546473 15909 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:25.548067 16113 consensus_meta.cc:287] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.743s	user 0.007s	sys 0.004s
I20260709 13:04:25.517321 15391 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:25.551987 16061 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:25.555925 16164 log.cc:927] Time spent T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:04:25.557211 16093 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:25.546240 16086 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:25.560071 16040 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:25.561655 16040 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:25.610663 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:25.614522 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.615294 12544 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:25.616806 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:25.618160 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.618275 12613 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:25.610641 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.619432 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:25.620337 12545 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:25.614552 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.620476 12622 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:25.614609 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.630797 12541 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 3.
I20260709 13:04:25.618345 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.635706 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.636265 13227 raft_consensus.cc:2410] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:04:25.637751 15391 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:25.639662 12547 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:25.643941 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:25.644825 12542 raft_consensus.cc:2376] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7. Re-sending same reply.
I20260709 13:04:25.644966 12546 raft_consensus.cc:3055] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:25.620669 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:25.646744 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.647320 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 707) took 2373 ms. Trace:
I20260709 13:04:25.647709 12539 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:25.647886 12540 rpcz_store.cc:276] 0709 13:04:23.273842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.273991 (+   149us) service_pool.cc:224] Handling call
0709 13:04:23.285903 (+ 11912us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:24.844568 (+1558665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:25.646758 (+802190us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b5400228654. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:25.647069 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3529185536}
I20260709 13:04:25.648927 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.645489 12546 raft_consensus.cc:740] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:25.652796 12544 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
I20260709 13:04:25.656136 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.658958 12539 raft_consensus.cc:2410] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:04:25.659552 12543 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:25.660640 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:25.661402 12543 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:25.664548 12545 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
I20260709 13:04:25.666493 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:25.667309 12619 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:04:25.666513 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:25.670017 12547 raft_consensus.cc:2393] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 8: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:25.670948 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:25.673825 12546 consensus_queue.cc:260] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:25.675774 12547 raft_consensus.cc:2393] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 7: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:25.676975 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:25.681840 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.683218 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 799) took 2293 ms. Trace:
I20260709 13:04:25.682258 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.658391 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.683810 12695 rpcz_store.cc:276] 0709 13:04:23.390028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.390173 (+   145us) service_pool.cc:224] Handling call
0709 13:04:23.414636 (+ 24463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:24.662552 (+1247916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:25.682489 (+1019937us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540041fad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:25.682899 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2789756288}
I20260709 13:04:25.684926 12541 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:25.679636 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.686224 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.687251 12541 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:25.690884 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1603) took 1116 ms. Trace:
I20260709 13:04:25.691445 12694 rpcz_store.cc:276] 0709 13:04:24.574397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.604293 (+ 29896us) service_pool.cc:224] Handling call
0709 13:04:24.604567 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:24.915438 (+310871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:25.681184 (+765746us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b54001b6054. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:25.690568 (+  9384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":701234432}
I20260709 13:04:25.656689 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:25.692672 12540 raft_consensus.cc:2376] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8. Re-sending same reply.
I20260709 13:04:25.693852 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.685084 12545 raft_consensus.cc:2410] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:04:25.697500 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.699692 12587 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:25.701946 16162 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:25.704133 15716 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:25.658769 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.704872 15716 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:25.706609 12542 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 6: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:25.710335 12539 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:25.704932 12587 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:25.683861 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.676633 12546 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:25.718343 16162 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:25.712968 12539 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:25.693378 12543 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
W20260709 13:04:25.725760 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.722391 12544 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
W20260709 13:04:25.744799 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.746268 16047 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:25.747864 12662 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.897s (SENT) [suppressed 48 similar messages]
I20260709 13:04:25.727957 16015 raft_consensus.cc:3055] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:25.750146 16015 raft_consensus.cc:740] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:25.751550 16015 consensus_queue.cc:260] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:25.752758 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:25.753827 12695 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:25.720181 15995 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:25.753062 16015 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:25.732534 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.755280 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:25.770339 12619 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:25.770445 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:25.772040 12622 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:25.771551 12691 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:25.777895 12694 raft_consensus.cc:2393] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 8: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:25.724246 16011 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:25.773921 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:25.786931 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:25.787742 12539 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:25.788884 12691 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:04:25.731935 15729 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:25.798110 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:25.800823 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.802307 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:25.812134 12546 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:04:25.816089 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.821120 12694 raft_consensus.cc:2410] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:04:25.823964 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:25.824380 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:25.824918 12692 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:04:25.826035 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:25.828328 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:25.832487 12690 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:04:25.834393 12692 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
W20260709 13:04:25.839149 16133 log.cc:927] Time spent T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.959s	user 0.002s	sys 0.000s
I20260709 13:04:25.835999 15729 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:25.836619 16174 log.cc:927] Time spent T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.053s	user 0.000s	sys 0.002s
I20260709 13:04:25.838413 12688 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:25.814950 12546 pending_rounds.cc:85] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 5
I20260709 13:04:25.843475 12543 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:25.842042 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:25.852669 16115 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:25.844586 12546 pending_rounds.cc:107] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:04:25.855774 12546 raft_consensus.cc:2889] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:25.837868 15716 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:25.862005 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:25.853430 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 772) took 1039 ms. Trace:
I20260709 13:04:25.865967 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:25.867437 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.867852 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:25.868342 12540 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 6: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:25.861851 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:25.863768 13227 rpcz_store.cc:276] 0709 13:04:24.813515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.841697 (+ 28182us) service_pool.cc:224] Handling call
0709 13:04:25.853160 (+1011463us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b54006fefd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:25.853352 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1789441920}
I20260709 13:04:25.869161 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:25.875268 12540 raft_consensus.cc:2393] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 8: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:25.876753 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.887543 15716 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:25.878368 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.888854 15391 consensus_queue.cc:1059] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:25.890141 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:25.891535 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.892542 12547 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:04:25.879153 12541 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:25.899014 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.900395 12541 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 8: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:25.900872 12614 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:25.902014 12538 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:25.906440 13199 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:25.902212 12622 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:04:25.904313 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 704) took 2633 ms. Trace:
I20260709 13:04:25.901554 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.907910 12546 rpcz_store.cc:276] 0709 13:04:23.270799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.270990 (+   191us) service_pool.cc:224] Handling call
0709 13:04:23.286730 (+ 15740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:25.644674 (+2357944us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b54002bdca0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a94f0dc0 00007fc3a957b1c0 00007fc3a957c231 00007fc3a9578d8f 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c
0709 13:04:25.903957 (+259283us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:25.904249 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":992041728}
I20260709 13:04:25.919724 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:25.921103 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:25.921528 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 60215.8us
I20260709 13:04:25.922792 15909 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:25.923049 13199 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:25.909152 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.926699 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.926947 15975 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:25.927423 12547 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:25.927461 12588 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:25.928334 15980 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:25.928818 15980 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:25.929219 15980 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:25.930187 12541 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
W20260709 13:04:25.931437 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:25.931609 12691 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:04:25.935400 15999 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:25.929893 16117 consensus_queue.cc:1059] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:25.933372 12541 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:25.940177 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:25.940965 12540 raft_consensus.cc:2376] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9. Re-sending same reply.
I20260709 13:04:25.927614 15975 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:04:25.955747 13234 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 959) took 3254 ms (client timeout 2897 ms). Trace:
W20260709 13:04:25.956300 13234 rpcz_store.cc:269] 0709 13:04:22.701344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:22.701644 (+   300us) service_pool.cc:224] Handling call
0709 13:04:25.947765 (+3246121us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b5400740254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:25.955483 (+  7718us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1082335104}
W20260709 13:04:25.950906 16129 log.cc:927] Time spent T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.958s	user 0.002s	sys 0.000s
I20260709 13:04:25.958055 13199 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:25.959349 12547 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 13:04:25.951700 15975 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:25.969318 13197 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:25.970965 12693 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:25.972543 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.978839 16117 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:25.979702 16117 consensus_queue.cc:1059] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:25.979875 12588 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:04:25.953708 16029 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:04:25.967300 12544 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:04:25.968091 15975 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:25.988541 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 51085us
I20260709 13:04:25.997104 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:25.999652 15620 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:26.002084 12588 leader_election.cc:400] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 7. Current term is 8.
I20260709 13:04:26.002465 12588 leader_election.cc:403] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:26.002676 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:26.005775 16015 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:04:26.007596 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:26.008431 12622 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:25.990141 16110 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:26.012264 16075 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:26.013599 13197 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:26.012815 16075 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:26.022482 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:26.032243 15992 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:26.033025 15992 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.033906 16115 consensus_queue.cc:1059] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:26.034930 16115 raft_consensus.cc:3055] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:26.035269 16115 raft_consensus.cc:740] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:26.015733 15620 raft_consensus.cc:697] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:26.036329 16115 consensus_queue.cc:260] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.036855 15620 consensus_queue.cc:237] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.049983 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:26.050863 12619 raft_consensus.cc:2368] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10.
I20260709 13:04:26.035508 15992 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:26.054215 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 64149.3us
W20260709 13:04:26.055150 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.045779 12544 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
W20260709 13:04:26.065251 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.071441 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:26.082273 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:26.086865 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:26.091248 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.060559 15444 raft_consensus.cc:3055] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:26.093411 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:26.080438 16115 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:26.102598 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.104172 12622 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:04:26.058374 15980 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.109306 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2909) took 1254 ms. Trace:
I20260709 13:04:26.093684 15444 raft_consensus.cc:740] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:26.114063 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:26.094429 15391 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:04:26.124483 16138 log.cc:927] Time spent T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 1.245s	user 0.003s	sys 0.003s
I20260709 13:04:26.125912 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:26.127888 15444 consensus_queue.cc:260] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.142661 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:26.144546 12687 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:26.144706 16116 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.145396 16116 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.146672 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:26.147415 13234 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
W20260709 13:04:26.148808 16186 log.cc:927] Time spent T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:04:26.151405 16015 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 7. Current term is 8.
I20260709 13:04:26.161901 15444 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:26.136654 15391 raft_consensus.cc:697] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:26.170477 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:26.167177 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:26.176061 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.172115 12547 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:26.181079 12545 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:26.181905 13228 raft_consensus.cc:2368] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 11. Current term is 12.
I20260709 13:04:26.182802 12619 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:04:26.168669 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:26.188866 12619 pending_rounds.cc:85] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 3
I20260709 13:04:26.174188 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:04:26.202530 16065 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.653s	user 0.002s	sys 0.032s
I20260709 13:04:26.196178 12619 pending_rounds.cc:107] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:04:26.206303 12619 raft_consensus.cc:2889] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:26.206573 12691 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:26.175395 16104 consensus_queue.cc:260] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:26.208806 16104 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:26.213546 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.213904 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:26.214814 12616 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:26.215451 15981 raft_consensus.cc:3055] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:26.215955 15981 raft_consensus.cc:740] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:04:26.217677 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.217932 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:26.218657 13234 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:26.218988 15835 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.219184 12659 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:26.219699 15835 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.220608 12659 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:26.221845 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:26.222293 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.223790 15835 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:26.230633 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:26.238014 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:26.239102 12618 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: []
W20260709 13:04:26.240234 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.242959 16116 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:26.249998 15980 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:26.252240 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:26.253259 13227 raft_consensus.cc:2393] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 12: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:26.254341 13230 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:04:26.255888 12588 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:26.256471 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:26.257153 16015 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:26.258160 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:26.166841 15391 consensus_queue.cc:237] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.257395 13231 raft_consensus.cc:2410] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:04:26.263513 12614 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:26.267427 12617 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:26.255934 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:26.270265 13229 raft_consensus.cc:2368] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7.
I20260709 13:04:26.271684 13232 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:26.272831 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:26.273506 13234 raft_consensus.cc:2376] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10. Re-sending same reply.
I20260709 13:04:26.274896 12622 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 9: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:26.275076 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:26.275902 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:26.277629 15735 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:26.278069 15735 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.278308 15995 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:26.278442 15735 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:26.278872 15995 raft_consensus.cc:697] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:04:26.280042 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 106027us
I20260709 13:04:26.279842 15995 consensus_queue.cc:237] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:26.281015 15835 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:26.281421 15835 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.281809 15835 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:26.281809 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 61313.6us
I20260709 13:04:26.276974 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:26.286489 15909 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:26.287082 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:26.217032 15981 consensus_queue.cc:260] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.289815 15909 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:26.290364 15981 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:26.290855 15834 consensus_queue.cc:1175] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a11816c5d72e4d1295a242f3ced09e5f" responder_term: 6 status { last_received { term: 6 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 6 index: 7 } }
I20260709 13:04:26.291781 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:26.292115 13231 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:26.206197 16065 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.660s	user 0.002s	sys 0.033s
I20260709 13:04:26.296072 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:26.297740 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:26.299034 12659 leader_election.cc:400] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10.
I20260709 13:04:26.241412 12613 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:04:26.299696 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:26.300464 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:26.301043 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.321314 12659 leader_election.cc:403] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:26.306075 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:26.307237 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:26.307953 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:26.330801 12539 consensus_meta.cc:287] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.002s
I20260709 13:04:26.331269 12539 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:26.331476 12617 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 9: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:26.308856 15735 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:26.312021 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:26.113677 12615 rpcz_store.cc:276] 0709 13:04:24.854365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.854544 (+   179us) service_pool.cc:224] Handling call
0709 13:04:24.854843 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:24.855072 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:04:24.909660 (+ 54588us) log.cc:844] Serialized 14 byte log entry
0709 13:04:25.985938 (+1076278us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b18002e3ea0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a6406c0a 00007fc3afb46219 00007fc3a648ea40 00007fc3a64894e4 00007fc3a6489455 00007fc3acf713c7 00007fc3a95839a7 00007fc3a95930bf 00007fc3a9593038
0709 13:04:26.010546 (+ 24608us) log.cc:844] Serialized 14 byte log entry
0709 13:04:26.108632 (+ 98086us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:26.108701 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:26.108823 (+   122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:26.108944 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:26.109098 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23865,"prepare.queue_time_us":1050436,"prepare.run_cpu_time_us":114,"prepare.run_wall_time_us":1437,"raft.queue_time_us":4426,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":4151,"spinlock_wait_cycles":3150592,"thread_start_us":169689,"threads_started":3,"wal-append.queue_time_us":170840,"wal-append.run_cpu_time_us":1223,"wal-append.run_wall_time_us":1004188}
I20260709 13:04:26.165511 15975 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.318197 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:26.301393 15912 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:26.337100 12618 raft_consensus.cc:2410] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 11 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:04:26.337519 13231 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:04:26.352627 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 236303us
I20260709 13:04:26.354168 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2907) took 1226 ms. Trace:
W20260709 13:04:26.356786 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 57932.8us
I20260709 13:04:26.337718 12614 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:04:26.360638 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:26.300321 15835 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.367471 13229 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:26.375185 12617 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: []
W20260709 13:04:26.376605 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.378175 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:26.372969 16060 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.753s	user 0.009s	sys 0.017s
W20260709 13:04:26.382836 16060 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.800s	user 0.009s	sys 0.017s
I20260709 13:04:26.358300 12620 rpcz_store.cc:276] 0709 13:04:24.850139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:24.851682 (+  1543us) service_pool.cc:224] Handling call
0709 13:04:24.851948 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:24.852135 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:24.852414 (+   279us) log.cc:844] Serialized 14 byte log entry
0709 13:04:25.882738 (+1030324us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b180039ee60. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a911923a 00007fc3a9583a2a
0709 13:04:25.996780 (+114042us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:26.015512 (+ 18732us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:26.022826 (+  7314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:26.029106 (+  6280us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:26.076879 (+ 47773us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2037,"prepare.queue_time_us":100,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":7067,"raft.queue_time_us":162,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":2893,"spinlock_wait_cycles":6670208,"thread_start_us":110124,"threads_started":1,"wal-append.queue_time_us":1242185}
I20260709 13:04:26.382373 13233 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:26.359579 15729 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10.
I20260709 13:04:26.391043 12618 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:26.398043 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:26.399768 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.402485 16096 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.403123 16096 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.380563 15912 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:26.405295 16096 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:26.418084 13231 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:26.425580 15912 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:26.426499 12513 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:26.427973 15976 consensus_queue.cc:1059] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:04:26.432211 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:26.433014 13231 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:26.437605 12513 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:26.438270 16029 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.438349 12620 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:04:26.439632 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 52781.2us
I20260709 13:04:26.442564 16060 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:26.442965 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:26.444423 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:26.428815 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:04:26.417701 16075 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.459182 13235 raft_consensus.cc:606] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:04:26.460537 13235 raft_consensus.cc:614] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:26.463152 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:26.459750 16029 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:26.469583 12588 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:26.441133 13230 raft_consensus.cc:2955] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 3 to 7, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:26.447968 16110 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:26.474987 12616 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:26.476804 12613 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:04:26.469172 12687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1476) took 3016 ms (client timeout 1624 ms). Trace:
I20260709 13:04:26.478578 12539 raft_consensus.cc:2368] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9.
I20260709 13:04:26.450366 16015 raft_consensus.cc:2764] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:04:26.477154 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:26.477312 12687 rpcz_store.cc:269] 0709 13:04:23.452516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:23.453011 (+   495us) service_pool.cc:224] Handling call
0709 13:04:26.468921 (+3015910us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54001b5b54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:26.469061 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3796834048}
I20260709 13:04:26.481920 12513 leader_election.cc:400] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 11. Current term is 12.
I20260709 13:04:26.482275 12513 leader_election.cc:403] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:04:26.488698 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:26.484344 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:26.488394 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 688) took 1310 ms. Trace:
I20260709 13:04:26.467579 16033 consensus_queue.cc:1059] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:04:26.500269 12588 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:26.476675 16060 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:26.500694 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:26.502389 12538 raft_consensus.cc:2393] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 7: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:26.473480 15716 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:04:26.504418 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:26.505285 12539 raft_consensus.cc:2410] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:04:26.509013 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:26.509724 12544 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:26.512363 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:26.473294 15976 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:04:26.492343 15999 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:26.504638 16060 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.524488 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:26.492206 16104 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:04:26.530279 13234 raft_consensus.cc:2410] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:04:26.531490 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:26.491832 12621 rpcz_store.cc:276] 0709 13:04:25.121629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:25.384055 (+262426us) service_pool.cc:224] Handling call
0709 13:04:25.385240 (+  1185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:25.385429 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:26.106120 (+720691us) log.cc:844] Serialized 14 byte log entry
0709 13:04:26.399641 (+293521us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:26.411145 (+ 11504us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:26.430330 (+ 19185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:26.432058 (+  1728us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:26.432161 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":625442,"prepare.queue_time_us":626471,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"raft.queue_time_us":17638,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":3949,"thread_start_us":269807,"threads_started":2,"wal-append.queue_time_us":320675}
I20260709 13:04:26.533350 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:26.518808 16110 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.532063 12547 raft_consensus.cc:2376] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9. Re-sending same reply.
I20260709 13:04:26.519224 15999 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.527460 16060 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:26.526736 15975 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:26.530432 16015 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:26.523576 16115 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:04:26.544559 15707 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 13:04:26.554489 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:04:26.536458 13200 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:26.555943 13235 raft_consensus.cc:606] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:26.540074 15999 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:26.540354 15735 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:26.542119 15835 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:26.558979 12588 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:26.562469 16079 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:26.545296 16029 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:26.578835 12689 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
W20260709 13:04:26.585336 16195 log.cc:927] Time spent T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:04:26.586510 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 64531.8us
I20260709 13:04:26.589174 15417 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:26.589655 15975 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:26.590353 15975 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.590895 15975 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:26.558828 16110 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.602069 16110 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:26.603417 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:26.611047 16105 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:26.613900 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:26.622293 16126 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:26.626077 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:26.625947 16060 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.628711 13228 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:04:26.629812 13229 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
W20260709 13:04:26.634964 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 152085us
W20260709 13:04:26.636293 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 146608us
I20260709 13:04:26.640921 12545 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:26.639531 12659 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:26.642379 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:26.643153 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:26.645757 12544 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:26.636057 16015 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:26.647297 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:26.651216 12539 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:26.651965 12538 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:26.642200 16075 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:26.662838 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:04:26.667989 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.653286 15992 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:26.648972 16015 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:26.663337 16075 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:26.689329 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 168968us
I20260709 13:04:26.684026 16015 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:26.675339 16117 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:04:26.700548 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:26.695876 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 144918us
I20260709 13:04:26.702884 16060 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:26.704169 12512 connection.cc:256] RPC call timeout handler was delayed by -1.8439153870000382s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
I20260709 13:04:26.704831 16202 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:26.707895 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:26.710026 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:26.711086 12691 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:04:26.734066 13229 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:26.711930 12687 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:26.712597 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:26.735363 12693 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:26.715389 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:26.735983 12694 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:26.715840 16079 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 11. Current term is 12.
I20260709 13:04:26.721936 16015 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:26.724700 16193 log.cc:927] Time spent T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.224s	user 0.002s	sys 0.000s
W20260709 13:04:26.731259 12512 connection.cc:256] RPC call timeout handler was delayed by -1.6117153870000038s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
I20260709 13:04:26.675855 15620 consensus_queue.cc:1059] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
W20260709 13:04:26.739490 12512 connection.cc:256] RPC call timeout handler was delayed by -1.2985153870000659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
I20260709 13:04:26.738687 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:26.740972 13199 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:26.696938 15992 raft_consensus.cc:697] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:26.734177 16202 raft_consensus.cc:3055] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:26.733958 16170 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.748761 16140 consensus_queue.cc:260] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.756114 12659 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:26.749262 15999 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:26.695955 15975 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.760882 16110 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:04:26.761472 16203 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:26.761847 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:26.761864 16170 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.781467 12616 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:26.781929 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:04:26.763829 16197 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 13:04:26.766937 13199 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:26.700699 16075 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.767143 15736 raft_consensus.cc:2955] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 3 to 7, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:26.771343 15417 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:26.778509 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:26.752597 16202 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:26.785216 12617 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:04:26.785501 12512 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:26.798563 13229 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:26.816836 12694 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
W20260709 13:04:26.800103 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 61496.5us
I20260709 13:04:26.804400 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:26.786424 15735 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:26.805671 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:26.809628 12620 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:04:26.810483 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:26.822326 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:26.822623 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:26.824055 16202 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.782701 16110 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:26.825207 16110 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:26.825603 16202 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:26.825706 12621 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:26.822760 16015 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:26.784307 16126 raft_consensus.cc:3055] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:04:26.830457 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 63616.5us
I20260709 13:04:26.836414 12621 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
W20260709 13:04:26.838495 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.845853 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:26.847430 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:26.850107 15834 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:26.850754 15834 raft_consensus.cc:697] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:26.851836 12588 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:26.851752 15834 consensus_queue.cc:237] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.853843 12588 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:26.855625 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:26.857019 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:26.857697 16204 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:04:26.859935 16015 raft_consensus.cc:2764] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:04:26.860814 16015 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:26.861217 16015 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:26.861585 16015 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:26.865693 15729 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:26.866851 15999 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:26.867486 15999 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:26.867842 15999 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:26.868198 15999 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:26.868332 12616 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:26.869691 15735 raft_consensus.cc:697] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:26.870249 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:26.871001 12687 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 9: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:26.870636 15735 consensus_queue.cc:237] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:26.872685 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:26.873174 16086 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:26.873857 13199 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:26.873663 16086 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:26.875037 16033 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:26.875751 15620 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:26.875017 12659 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:26.876287 15620 raft_consensus.cc:697] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:26.877718 15620 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:26.882414 16159 log.cc:927] Time spent T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 1.464s	user 0.003s	sys 0.000s
W20260709 13:04:26.883426 12689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1482) took 2235 ms (client timeout 2079 ms). Trace:
I20260709 13:04:26.884219 16096 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:26.884822 16096 raft_consensus.cc:697] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:26.885814 16096 consensus_queue.cc:237] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:26.884037 12689 rpcz_store.cc:269] 0709 13:04:24.647968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:25.042304 (+394336us) service_pool.cc:224] Handling call
0709 13:04:26.883117 (+1840813us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b540016f3d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:26.883310 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3258326400}
I20260709 13:04:26.892633 16075 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:26.893713 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:26.894346 13231 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:04:26.895105 16170 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:26.839217 16126 raft_consensus.cc:740] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:26.896582 16126 consensus_queue.cc:260] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.898077 16126 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:26.895171 16105 consensus_queue.cc:1059] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:26.898988 16105 raft_consensus.cc:3055] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:26.899338 16105 raft_consensus.cc:740] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:26.899567 15391 raft_consensus.cc:3055] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:26.900022 15391 raft_consensus.cc:740] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:26.899780 16015 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:26.901459 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:26.875970 12692 raft_consensus.cc:1240] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 7. Current term is 8. Ops: []
W20260709 13:04:26.875320 16205 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:04:26.900345 16105 consensus_queue.cc:260] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:26.900993 15391 consensus_queue.cc:260] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.810984 12622 raft_consensus.cc:2955] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 3 to 7, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:26.820909 16140 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:26.910578 12693 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:04:26.932648 12513 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:26.933653 12513 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:04:26.909942 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 153961us
I20260709 13:04:26.936321 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:26.933210 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:26.938915 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:26.943091 12688 raft_consensus.cc:2368] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 11. Current term is 12.
I20260709 13:04:26.933738 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:26.782964 16203 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:26.947921 12689 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:26.948205 12512 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:04:26.954968 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 49591us
I20260709 13:04:26.957383 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:26.940258 16075 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:26.909920 15909 consensus_queue.cc:1059] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:04:26.965948 12617 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:26.944847 16204 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:26.911310 15992 consensus_queue.cc:237] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:26.985975 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:26.986100 16058 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:26.978277 16015 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:26.979110 16204 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:26.998101 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:26.959246 15391 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:27.006619 12621 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:04:26.972275 16105 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:27.008244 12512 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:26.998112 16204 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:26.964089 16208 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:27.020979 12690 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:26.978416 16075 raft_consensus.cc:697] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:04:27.041429 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 76037.1us
I20260709 13:04:27.028198 16208 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.032215 16079 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:04:27.045648 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 67579.9us
W20260709 13:04:27.046511 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 125930us
I20260709 13:04:27.036405 15975 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:27.050339 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:27.053205 12691 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:27.056079 16207 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:27.056696 16207 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:27.057158 16207 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:27.049456 16079 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.075564 16079 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:27.080641 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:27.069388 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:27.086936 16203 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:27.087777 16086 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:27.070282 16201 raft_consensus.cc:3055] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:27.073792 16075 consensus_queue.cc:237] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:27.045408 16208 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:27.092150 12512 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:27.093191 13199 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:27.068765 12444 catalog_manager.cc:5697] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 4 to 7, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 7 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.125506 12621 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:04:27.127141 12691 raft_consensus.cc:2410] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:04:27.128409 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 60415.6us
I20260709 13:04:27.130884 13199 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:27.137902 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:27.138728 12690 raft_consensus.cc:2393] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 12: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:04:27.139348 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 75357.5us
I20260709 13:04:27.140641 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:27.147035 12688 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:04:27.144527 12616 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:27.149041 12588 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:27.052580 15999 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:27.153965 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:27.156163 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:27.117481 16201 raft_consensus.cc:740] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:27.138273 16170 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:27.165998 12512 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:27.153582 16058 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:27.174368 12659 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:27.157631 16117 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:27.178520 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:27.140522 16115 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 13:04:27.168638 16206 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:27.181188 15909 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:27.191478 15909 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.182874 16117 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.186460 16202 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:27.184907 16170 raft_consensus.cc:697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:04:27.214896 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 79151.4us
I20260709 13:04:27.195583 15909 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:27.214098 12444 catalog_manager.cc:5697] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 2 to 4, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 4 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:04:27.209721 16117 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:27.195503 16063 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.095s
I20260709 13:04:27.265264 12588 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:27.254900 16216 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:04:27.256371 16058 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:27.257431 16060 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:27.266351 12444 catalog_manager.cc:5697] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 2 to 7, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 7 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:27.269678 16043 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:04:27.270319 16065 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:27.288352 16213 log.cc:927] Time spent T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:04:27.287055 16206 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:04:27.327646 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 166243us
I20260709 13:04:27.245711 16201 consensus_queue.cc:260] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:27.355729 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 188204us
W20260709 13:04:27.356092 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:27.374394 16221 log.cc:927] Time spent T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:04:27.290655 16110 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:27.388868 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 138210us
I20260709 13:04:27.412477 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:27.307647 16060 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:27.298627 16058 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:27.422106 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 43635.4us
I20260709 13:04:27.331815 15729 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:27.429040 16231 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:27.402519 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 123262us
I20260709 13:04:27.324004 16065 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:27.437080 12615 raft_consensus.cc:1240] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:27.425079 12444 catalog_manager.cc:5697] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 6 to 9, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 9 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:27.383134 15999 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:27.449764 12444 catalog_manager.cc:5697] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:27.438036 16159 log.cc:927] Time spent T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:04:27.474679 16237 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:27.482839 12512 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:27.424166 16202 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:27.439689 15729 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:27.385211 16207 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:27.487466 16060 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:27.487995 16204 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:27.488623 16217 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:04:27.483350 12588 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:04:27.489723 16219 log.cc:927] Time spent T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:04:27.490135 16229 consensus_queue.cc:1059] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:04:27.490427 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 55431.3us
I20260709 13:04:27.491218 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:27.492372 12588 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:27.332717 16170 consensus_queue.cc:237] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:27.501868 16110 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:27.502332 15834 raft_consensus.cc:993] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:04:27.502919 15834 raft_consensus.cc:1081] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:04:27.506039 12688 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:27.507499 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:27.507931 16058 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:27.509090 16058 raft_consensus.cc:3055] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:27.477030 16231 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:27.512468 16231 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:27.512952 16231 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:27.529533 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:27.527455 15999 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:27.532267 15999 raft_consensus.cc:697] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:27.533347 15999 consensus_queue.cc:237] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:27.488066 16060 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:27.514672 15729 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:27.513397 16231 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:27.509505 16058 raft_consensus.cc:740] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:27.440017 16079 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:27.525207 16206 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:04:27.547856 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 55541.3us
W20260709 13:04:27.561877 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 89857.6us
I20260709 13:04:27.527205 16110 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:27.584520 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:04:27.585247 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 172838us
I20260709 13:04:27.520634 16063 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:04:27.555236 16235 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.569831 12617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:60170
I20260709 13:04:27.596060 12617 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:27.596585 12617 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:27.561419 16232 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:27.545128 16202 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:27.602298 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:27.580826 16206 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:27.581398 16110 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:27.562233 16060 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:27.611138 12512 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:27.599741 12444 catalog_manager.cc:5697] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index 3 to 4, term changed from 4 to 6, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193), VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194), VOTER 7ad68e814a7741488971822f2598183a (127.11.44.195), VOTER 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 6 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:27.638707 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:27.642146 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:27.608975 16110 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:27.607375 16206 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:27.612061 16207 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:27.648141 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 63562.9us
I20260709 13:04:27.648150 12512 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:27.640050 16204 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:27.644148 16232 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:27.667207 16079 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:27.600437 16235 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:27.666819 12588 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:27.662736 15736 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:27.672881 16208 consensus_meta.cc:287] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.510s	user 0.012s	sys 0.005s
I20260709 13:04:27.678153 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:27.678896 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:27.682052 13229 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:27.679714 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 69867.9us
I20260709 13:04:27.673632 12444 catalog_manager.cc:5697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:27.673890 16234 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:27.613277 16058 consensus_queue.cc:260] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:27.700448 13229 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:04:27.685510 16224 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:27.702085 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 54049.9us
I20260709 13:04:27.704499 12512 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:27.704993 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 62049.1us
I20260709 13:04:27.705621 16246 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:27.688884 16207 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:27.689714 16204 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:27.703670 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:27.708628 12444 catalog_manager.cc:5697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 7 to 8, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 8 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.692022 16233 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:27.714015 16233 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:27.715124 16235 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:27.687026 16238 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:27.716415 16233 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:27.690117 15909 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:27.718242 16227 log.cc:927] Time spent T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 13:04:27.718919 15391 consensus_meta.cc:287] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.706s	user 0.012s	sys 0.000s
I20260709 13:04:27.719857 16060 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:27.723342 15909 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:04:27.723734 16214 log.cc:927] Time spent T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.334s	user 0.003s	sys 0.000s
I20260709 13:04:27.728986 16202 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:27.730540 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:27.730870 16117 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:27.732246 15736 raft_consensus.cc:2764] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:04:27.735342 12662 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:04:27.708079 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 123978us
I20260709 13:04:27.748433 16065 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:27.752354 15736 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:27.753149 15736 raft_consensus.cc:697] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:27.755620 16231 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:27.709035 16224 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:27.767625 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:27.768394 12693 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
W20260709 13:04:27.768564 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 101838us
I20260709 13:04:27.769518 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:27.761008 16201 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:27.772939 12617 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:27.688366 16208 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:27.787534 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 47002.1us
I20260709 13:04:27.789419 13199 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:27.791631 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:27.797008 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:27.800408 12617 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:27.792332 12618 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:27.808591 12616 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:27.813028 12444 catalog_manager.cc:5697] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 4 to 5, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 5 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:27.814616 12614 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:04:27.774102 16207 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:27.817947 12622 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:27.798152 16234 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:27.843261 12512 leader_election.cc:400] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 11. Current term is 12.
I20260709 13:04:27.842464 12444 catalog_manager.cc:5697] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 4 to 7, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 7 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:27.754294 15736 consensus_queue.cc:237] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:27.850997 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:27.813084 16065 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:27.826541 12588 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:27.852419 12613 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:27.826103 16234 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:27.871305 15729 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:27.874414 16208 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:27.880270 16206 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:27.865710 12444 catalog_manager.cc:5697] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:27.876396 16110 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:27.851027 15620 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.886145 16224 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:27.887229 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 43679.3us
I20260709 13:04:27.907435 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:27.908056 12538 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:27.908638 15729 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:27.909762 12690 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:27.887300 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:27.910470 16110 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:27.853299 16117 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:27.818785 16231 consensus_queue.cc:1059] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:04:27.912021 16086 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:27.912526 16231 raft_consensus.cc:3055] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:27.904242 15999 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:27.913096 16231 raft_consensus.cc:740] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:27.901732 16234 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:27.913650 16086 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:27.858836 16065 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.914373 16086 consensus_queue.cc:1243] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer a70479a3b4114f3581095e9890f5d653 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:04:27.914469 16065 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:27.891510 12539 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: [7.7-8.8]
I20260709 13:04:27.905786 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:27.850365 16207 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:27.917757 12619 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:27.912577 16206 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:27.905851 12444 catalog_manager.cc:5697] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 2 to 4, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 4 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:27.919462 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:27.923180 12545 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 7: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:27.923887 16207 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:27.924588 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:27.925390 12539 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 11: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:27.926774 16201 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:27.928994 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:27.929838 16201 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:27.930249 16201 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.930578 16201 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:27.933148 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:04:27.939899 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 130143us
I20260709 13:04:27.952310 12613 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:27.909245 15729 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:04:27.962860 12513 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:04:27.967661 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:27.939772 12444 catalog_manager.cc:5697] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 6 to 5, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 5 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:27.971484 12588 leader_election.cc:400] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9.
I20260709 13:04:27.976264 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:27.977353 12622 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:27.987265 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:27.998335 12588 leader_election.cc:403] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:27.986150 13197 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:27.952450 16224 raft_consensus.cc:2764] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:04:28.001694 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:28.003016 12545 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:28.005034 15976 consensus_queue.cc:1059] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:27.992231 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:28.011224 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:28.011945 12542 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:28.013064 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:27.991961 16043 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:27.981825 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:27.996546 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:28.001180 13234 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:04:28.017326 12542 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:28.006449 12615 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:04:28.007009 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:28.018913 12618 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:28.007963 15992 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:28.008445 15909 consensus_queue.cc:1059] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:27.921125 15620 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:28.041944 15981 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:28.042456 15981 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.042814 15981 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:28.043496 15620 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:28.010300 13231 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:04:28.044533 12662 connection.cc:256] RPC call timeout handler was delayed by -1.3048731520000274s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1638s for a response
I20260709 13:04:27.978847 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:28.045998 15834 consensus_queue.cc:1059] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:28.046686 13230 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 9: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:04:28.047434 12662 connection.cc:256] RPC call timeout handler was delayed by -1.255707292000011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15000000000000002s for a response
I20260709 13:04:28.048672 12618 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:27.993937 12444 catalog_manager.cc:5697] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 1 to 2, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:04:28.049853 15976 raft_consensus.cc:3055] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:28.050252 15976 raft_consensus.cc:740] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:28.050336 12444 catalog_manager.cc:5697] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 2 to 5, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 5 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:04:28.051153 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:28.011250 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:28.054211 12659 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:28.017807 13234 pending_rounds.cc:85] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: Aborting all ops after (but not including) 7
I20260709 13:04:28.054890 13234 pending_rounds.cc:107] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:04:28.055212 13234 raft_consensus.cc:2889] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:28.017632 12543 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:27.914180 16231 consensus_queue.cc:260] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:28.009375 12617 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:28.032088 12588 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:28.026176 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:28.033378 12546 raft_consensus.cc:3055] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:28.057104 12546 raft_consensus.cc:740] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:28.057906 12546 consensus_queue.cc:260] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:28.037930 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:27.992161 16237 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:04:28.045596 15909 raft_consensus.cc:3055] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:04:28.066745 12662 connection.cc:256] RPC call timeout handler was delayed by -1.2247649239999419s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
I20260709 13:04:28.002424 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:28.062801 12545 raft_consensus.cc:1275] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:27.969960 16230 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:04:28.110539 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 56411.4us
I20260709 13:04:28.111801 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:28.112433 12696 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
W20260709 13:04:28.113468 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 58012.9us
I20260709 13:04:28.116621 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:28.117424 12544 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:28.010804 16207 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9.
I20260709 13:04:28.117921 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:28.118505 12539 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:28.124048 12545 raft_consensus.cc:3055] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:28.124567 12545 raft_consensus.cc:740] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:28.125929 12545 consensus_queue.cc:260] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:28.126085 16065 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:28.127702 12545 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:28.061235 16229 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.143965 13199 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:28.061532 16202 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.146153 12543 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:28.141973 12545 raft_consensus.cc:1275] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:28.155293 12543 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:28.145336 12444 catalog_manager.cc:5697] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 2 to 4, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 4 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:28.066787 15909 raft_consensus.cc:740] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:04:28.162928 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 163331us
W20260709 13:04:28.143636 16245 log.cc:927] Time spent T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:04:28.115449 16096 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:04:28.138950 16227 log.cc:927] Time spent T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:04:28.121810 16015 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:28.169741 12444 catalog_manager.cc:5697] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:28.067097 15980 consensus_queue.cc:1059] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:04:28.141067 16230 raft_consensus.cc:697] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 11 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:28.158288 16170 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.210726 12546 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:28.060472 16043 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:28.051054 15976 consensus_queue.cc:260] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:28.066392 16252 consensus_queue.cc:1059] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 13:04:28.161368 16203 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.220329 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:28.119391 16234 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:28.178669 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:28.238565 12539 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:28.239841 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:28.240391 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:28.240669 12539 raft_consensus.cc:2410] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:04:28.241026 12546 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:04:28.152531 15444 consensus_queue.cc:1059] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:04:28.174050 16096 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.172782 15975 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:28.233428 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:28.253961 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:28.237843 16216 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:04:28.246419 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 135173us
I20260709 13:04:28.165735 15417 consensus_queue.cc:1059] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:04:28.246349 12620 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:28.164971 15707 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:04:28.157614 16229 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:28.268172 16229 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:28.243774 16170 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:28.272100 16170 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:28.274000 16234 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:28.279403 16043 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:28.241737 16208 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:28.244782 15981 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:28.281929 13228 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 12: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:28.282735 15981 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:28.245033 16203 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:28.285715 16058 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:28.287611 16201 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:28.290014 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:28.290640 12696 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:28.122877 15992 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:28.292068 12587 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:28.293015 15992 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:28.293262 16208 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:28.295641 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:28.296303 12620 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:28.297192 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:28.297951 12617 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:28.298058 12544 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
W20260709 13:04:28.217918 16261 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:04:28.244395 12444 catalog_manager.cc:5697] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:28.264611 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 92719.7us
I20260709 13:04:28.264919 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:28.265575 16224 consensus_queue.cc:1059] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:28.300213 16208 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.305015 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:28.375365 12444 catalog_manager.cc:5697] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.378413 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:28.379468 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 114075us
I20260709 13:04:28.252704 15975 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.394658 12694 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:28.394240 12444 catalog_manager.cc:5697] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:28.391316 12687 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:28.380528 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:28.285349 16203 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:28.251647 16096 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:28.321396 12539 raft_consensus.cc:2410] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:04:28.390018 12538 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:04:28.211315 16202 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:28.399623 12693 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:04:28.400842 12546 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:04:28.396406 12444 catalog_manager.cc:5697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:28.414542 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:28.416036 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.365056 16230 consensus_queue.cc:237] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:28.415743 12444 catalog_manager.cc:5697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 5 to 6, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 6 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:28.398103 16260 log.cc:927] Time spent T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.276s	user 0.000s	sys 0.003s
I20260709 13:04:28.396006 16208 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:28.422005 12617 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:04:28.398586 15975 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:28.428164 16218 log.cc:927] Time spent T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:04:28.428293 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:28.438216 16263 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
W20260709 13:04:28.440270 16259 log.cc:927] Time spent T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
I20260709 13:04:28.416853 16117 raft_consensus.cc:3055] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:28.452795 12542 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
W20260709 13:04:28.455202 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 70836.1us
I20260709 13:04:28.456394 12588 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:28.419430 16201 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:28.419443 15444 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.414047 15992 consensus_queue.cc:1059] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:04:28.435497 15909 consensus_queue.cc:260] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:28.468029 12545 raft_consensus.cc:2955] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 3 to 7, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:28.470492 12542 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:04:28.482223 12546 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:28.473417 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:28.459388 16117 raft_consensus.cc:740] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:28.487351 12619 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:28.458598 16234 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:28.487272 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:28.487814 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 69150.1us
I20260709 13:04:28.499936 12588 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:28.503494 12619 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:04:28.503528 16272 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:28.505128 16272 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:28.505514 16272 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:28.511571 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:28.512437 12547 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:28.520124 12588 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:28.499311 15909 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:28.526695 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:28.543763 12547 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:28.544133 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:28.545655 12619 raft_consensus.cc:1240] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:28.470340 15444 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:28.529072 12588 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:28.529634 16203 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:28.529989 12543 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:04:28.513670 16015 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:28.551004 16202 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:28.558439 12614 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:28.546351 16275 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.564909 12540 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:04:28.568459 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:28.570818 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:28.571628 12543 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 7: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:28.572510 12544 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:28.574378 12538 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:04:28.574766 12538 pending_rounds.cc:85] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 8
I20260709 13:04:28.575136 12538 pending_rounds.cc:107] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:04:28.575526 12538 raft_consensus.cc:2889] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:28.577193 12588 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:28.579396 15444 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:28.580598 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:28.584056 12691 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:28.569406 16234 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:28.585168 16234 raft_consensus.cc:697] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:28.585780 16203 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:28.558025 15992 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:04:28.586781 15992 consensus_queue.cc:1243] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:04:28.569461 16275 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:28.588765 16234 consensus_queue.cc:237] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:28.612401 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:28.613011 12543 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:28.614296 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:28.614296 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 58953.1us
I20260709 13:04:28.616132 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:28.618718 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:28.617838 13197 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:28.589329 16275 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:28.615048 12620 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:28.638549 12662 leader_election.cc:400] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7.
I20260709 13:04:28.643111 12662 leader_election.cc:403] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:28.639752 16252 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:28.547081 16117 consensus_queue.cc:260] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:28.654318 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:28.642091 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:28.656055 12614 raft_consensus.cc:2393] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:28.658573 12538 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:04:28.659433 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.660914 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:28.665828 12616 raft_consensus.cc:2393] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 8: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:28.663481 12690 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:28.657162 12613 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7. Ops: []
W20260709 13:04:28.666994 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 51788.7us
I20260709 13:04:28.637813 16015 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.674512 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:28.570590 15975 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:28.674458 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:28.677052 12696 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 9: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:28.677147 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:28.677992 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:28.678743 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:28.681591 12695 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 11: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:28.681845 12544 raft_consensus.cc:2376] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9. Re-sending same reply.
I20260709 13:04:28.685410 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:28.688969 12687 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:28.692533 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:28.692579 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:28.659221 16275 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7.
I20260709 13:04:28.695480 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:28.697175 12690 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 11: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:28.611778 16272 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:28.699110 13234 raft_consensus.cc:2393] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 12: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:28.697639 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:28.702054 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:28.702785 12543 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:28.703181 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:28.659416 16225 consensus_queue.cc:1059] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:04:28.703961 13228 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:28.699908 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:28.677763 16252 raft_consensus.cc:697] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:28.658794 16043 consensus_queue.cc:1059] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:04:28.710368 12691 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:28.707649 12695 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:28.707468 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:28.710829 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:28.711876 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:28.715791 16202 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:28.716416 16273 log.cc:927] Time spent T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:04:28.716480 16202 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:28.718325 16277 log.cc:927] Time spent T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:04:28.720901 16274 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:04:28.721365 16208 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:28.686266 15417 consensus_queue.cc:1059] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:04:28.724191 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:28.715783 16252 consensus_queue.cc:237] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:28.721356 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:28.727046 16275 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:28.716544 16272 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:28.728377 16208 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:28.725795 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:28.729405 12695 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:04:28.734309 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:28.741447 12695 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:28.679637 15992 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:04:28.746055 12587 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:28.737466 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:28.758594 16202 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:28.685125 16015 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:28.762706 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:28.762964 13199 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:04:28.762706 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.771571 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:28.777086 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:28.778007 13230 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:28.779500 12690 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:28.781602 12547 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:28.784443 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:28.786937 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:28.788368 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:28.804071 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:28.806416 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:28.806748 12662 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:28.744454 16096 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:28.771211 16275 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:28.771171 15444 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:04:28.812959 12695 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:28.813133 12662 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:28.775337 16234 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:28.758533 16233 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:04:28.818109 16252 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:28.818596 16252 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.818953 16252 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:28.814669 16269 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:28.819761 12662 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:28.820616 16201 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:04:28.816509 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:28.786123 16202 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.821856 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:28.771447 16241 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:04:28.829380 13235 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:28.840654 12618 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:28.846686 12662 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:28.841871 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:28.842245 12688 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 12: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:28.848119 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:28.848817 12695 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
W20260709 13:04:28.842792 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 60353.1us
I20260709 13:04:28.851907 12512 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:28.821100 16201 raft_consensus.cc:697] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:28.786412 16110 consensus_queue.cc:1059] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:04:28.858780 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:28.819793 16269 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:28.861079 12614 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:28.826177 16116 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.867587 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:28.864955 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:28.865011 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:28.868885 12543 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:28.869035 12545 raft_consensus.cc:2393] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 7: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:28.866950 12618 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 8: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:28.866878 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:28.869680 12619 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:04:28.841681 15620 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.846112 15729 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.871335 12615 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:28.841827 16234 raft_consensus.cc:697] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:28.816186 16268 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:04:28.874130 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:28.874663 12547 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:28.846009 16230 consensus_queue.cc:1059] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:04:28.933702 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:28.858669 16233 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:28.938805 12545 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:28.879155 12618 raft_consensus.cc:1240] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
W20260709 13:04:28.971318 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 104622us
I20260709 13:04:28.894976 12543 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 4.
I20260709 13:04:28.942631 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:29.041404 12541 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:28.879755 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:04:28.937363 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 90766.5us
I20260709 13:04:28.948380 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:29.039623 12619 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:28.951624 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:28.843693 16202 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:28.877611 15620 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:29.049723 16202 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:29.049954 15620 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:29.050823 16281 log.cc:927] Time spent T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
W20260709 13:04:29.051268 16262 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.794s	user 0.001s	sys 0.000s
I20260709 13:04:28.935053 16201 consensus_queue.cc:237] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:28.876151 16275 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:29.052765 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 846) took 1287 ms. Trace:
I20260709 13:04:28.938041 15729 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:29.053387 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:29.053187 12688 rpcz_store.cc:276] 0709 13:04:27.765180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:27.767184 (+  2004us) service_pool.cc:224] Handling call
0709 13:04:28.253757 (+486573us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b5800210698. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae53f0a0 00007fc3ae53e984 00007fc3a7ab96d4 00007fc3a7ab9662
0709 13:04:29.052539 (+798782us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b54001effd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:29.052706 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1351738112}
I20260709 13:04:29.054445 13230 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 11: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:28.934185 16015 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:29.044072 16241 consensus_queue.cc:1059] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:29.056595 16241 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.056739 12541 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:29.057160 16241 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:28.872959 16269 raft_consensus.cc:697] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:28.877986 16058 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.168s
I20260709 13:04:28.872565 16116 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:29.045795 15992 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:29.046757 16234 consensus_queue.cc:237] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:29.047415 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:29.053858 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:29.055366 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:04:29.042387 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 90720.3us
I20260709 13:04:29.070664 12546 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:29.059362 12545 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:29.060220 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:29.060392 13230 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:29.061930 12547 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:29.062755 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2781) took 1059 ms. Trace:
I20260709 13:04:29.072429 12540 rpcz_store.cc:276] 0709 13:04:27.982844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:27.983020 (+   176us) service_pool.cc:224] Handling call
0709 13:04:27.983374 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:28.565312 (+581938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:28.954848 (+389536us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b5400229554. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:29.041706 (+ 86858us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1331655424}
I20260709 13:04:29.062981 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:29.036696 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.083593 13197 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:29.059751 16286 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.181s	user 0.003s	sys 0.000s
I20260709 13:04:29.102758 13232 pending_rounds.cc:85] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: Aborting all ops after (but not including) 6
I20260709 13:04:29.022538 15975 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:29.104995 13232 pending_rounds.cc:107] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:04:29.108326 13232 raft_consensus.cc:2889] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:29.105538 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:29.109643 12538 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:29.109967 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:29.055457 15729 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:04:29.115307 16282 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 13:04:29.117877 16269 consensus_queue.cc:237] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:29.119181 16116 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:29.124536 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:29.125941 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:29.110816 16140 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:04:29.133390 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 326731us
I20260709 13:04:29.134881 13199 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:29.135071 12546 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
W20260709 13:04:29.136384 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 278975us
I20260709 13:04:29.141126 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:29.144675 12615 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 8. Current term is 9. Ops: []
W20260709 13:04:29.146919 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:29.147513 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.105090 15417 consensus_queue.cc:1059] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:04:29.124622 16096 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:29.156945 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:29.153577 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:29.158860 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:29.163995 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:29.165928 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:29.167570 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:29.171203 12539 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:29.169646 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:29.170059 12541 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
W20260709 13:04:29.175467 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 117527us
W20260709 13:04:29.176741 16279 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.327s	user 0.004s	sys 0.016s
W20260709 13:04:29.178192 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:29.180836 15909 consensus_meta.cc:287] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.000s
I20260709 13:04:29.185702 16243 raft_consensus.cc:3055] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:29.186221 16243 raft_consensus.cc:740] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:29.157485 16140 raft_consensus.cc:697] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:29.192262 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:29.193150 12617 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:29.194820 12615 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:04:29.189407 12662 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:29.210177 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 46271.2us
I20260709 13:04:29.213445 12588 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:29.202812 15992 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:29.174726 16015 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.222862 12539 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:29.226784 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:29.263165 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 49641.3us
I20260709 13:04:29.267426 15909 consensus_queue.cc:1048] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:29.268268 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:29.268857 15909 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:29.219406 16110 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:29.264497 12588 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:04:29.258131 16255 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.087s	user 0.000s	sys 0.008s
I20260709 13:04:29.187071 16243 consensus_queue.cc:260] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:29.270166 15999 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:29.275708 16268 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:29.283730 16060 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.270730 16295 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:29.285140 16291 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.264654 16015 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:29.282560 16241 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:29.297055 16243 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:29.299129 16268 raft_consensus.cc:697] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 10 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:29.308940 16110 raft_consensus.cc:697] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:04:29.322484 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 58045.3us
W20260709 13:04:29.326176 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.327330 12588 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:29.328536 12588 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:29.302692 15999 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:29.329722 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:29.294772 16060 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:29.343453 16110 consensus_queue.cc:237] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:29.345202 16065 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:29.345446 16222 raft_consensus.cc:3055] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:29.346268 16268 consensus_queue.cc:237] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:29.289224 16140 consensus_queue.cc:237] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:29.373463 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 102332us
I20260709 13:04:29.343354 15976 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:29.298589 16291 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:29.433459 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 164374us
I20260709 13:04:29.411366 16305 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:29.413630 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:29.442960 13226 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:29.414180 15999 raft_consensus.cc:697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:29.415335 16292 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:29.347388 16206 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:29.434593 12662 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:29.443048 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 113388us
I20260709 13:04:29.356807 16222 raft_consensus.cc:740] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:29.356202 16289 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:29.448573 12588 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:04:29.453099 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 77968.2us
I20260709 13:04:29.463168 13227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:04:29.467448 16234 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:29.451630 15736 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:29.472220 16060 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:29.456303 15834 raft_consensus.cc:3055] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:29.476426 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:29.454838 16206 raft_consensus.cc:697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:29.491415 16304 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:29.463428 15992 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 13:04:29.498481 16015 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:29.506659 12588 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:04:29.496731 16252 consensus_meta.cc:287] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.677s	user 0.009s	sys 0.004s
I20260709 13:04:29.514340 13200 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:29.518842 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:29.450831 16292 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:29.479424 15834 raft_consensus.cc:740] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:29.541538 12588 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:29.504420 16065 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:04:29.510970 16304 raft_consensus.cc:697] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:29.545383 13200 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:29.516419 16015 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:29.517303 16060 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:29.529157 16252 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:29.552209 16311 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:29.553254 16246 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.554410 16233 raft_consensus.cc:3055] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:29.555111 15735 raft_consensus.cc:3055] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:04:29.557165 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.461906 16289 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:29.559283 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:29.549533 16305 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:29.562964 13226 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:29.533072 16170 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:29.533761 16110 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:29.591483 13235 raft_consensus.cc:2368] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8.
I20260709 13:04:29.566182 15620 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:29.544426 16302 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:04:29.597448 13200 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:29.578629 15735 raft_consensus.cc:740] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:29.576812 16233 raft_consensus.cc:740] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:29.577080 16115 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:04:29.591609 16110 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:29.592826 16015 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.578835 16246 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:29.517584 16222 consensus_queue.cc:260] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:29.579474 15736 raft_consensus.cc:697] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:29.569166 16311 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:29.567808 16060 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:29.593768 16300 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:04:29.600878 13200 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:29.601316 16170 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:29.605206 16110 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:29.615633 13200 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:29.559897 15999 consensus_queue.cc:237] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:29.594547 16297 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:04:29.617954 15417 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:29.618484 16307 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:04:29.618099 15736 consensus_queue.cc:237] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:29.594542 16206 consensus_queue.cc:237] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:29.619952 16233 consensus_queue.cc:260] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:29.620432 16060 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:29.594803 16313 consensus_queue.cc:1059] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:04:29.635735 16310 consensus_queue.cc:1059] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:04:29.609547 16015 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:29.636778 16225 raft_consensus.cc:3055] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:29.637502 16252 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:29.621588 15620 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:29.640671 16246 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:29.700929 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:29.641727 16275 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:29.641886 16295 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:29.642344 15992 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.711963 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:29.646962 16289 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:29.648017 16292 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:29.634586 16170 raft_consensus.cc:697] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:29.652241 12617 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:29.654774 12616 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:29.655916 12662 leader_election.cc:400] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8.
I20260709 13:04:29.660602 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:29.718937 12662 leader_election.cc:403] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:04:29.671527 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:29.675808 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 49604.3us
I20260709 13:04:29.619019 15735 consensus_queue.cc:260] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:29.689484 12614 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:29.692623 13230 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:29.696534 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:29.698634 12688 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:29.633988 16291 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:29.707688 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:29.725986 13235 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:29.690866 16234 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:29.633720 16309 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:04:29.713853 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.714011 12613 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:29.698542 16225 raft_consensus.cc:740] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:29.720386 13227 raft_consensus.cc:606] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:29.722285 13200 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:29.723690 12695 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:29.720342 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:29.724033 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 68261.8us
I20260709 13:04:29.725078 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:29.711694 15980 raft_consensus.cc:3055] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:29.712093 15620 raft_consensus.cc:697] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:29.743062 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:29.743438 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:29.746666 13200 leader_election.cc:336] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.200s (SENT)
I20260709 13:04:29.747417 13200 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:29.751329 12614 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:29.727830 16233 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:29.613082 16304 consensus_queue.cc:237] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:29.729020 16268 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:04:29.730146 16309 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:29.764041 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:29.773216 12540 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:29.718073 15992 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:29.770807 12695 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:29.711967 16275 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:29.737011 15980 raft_consensus.cc:740] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:29.740981 15735 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:29.761226 16252 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:29.715634 16295 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:29.789666 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:29.764945 16234 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.797992 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:29.797010 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 50403.2us
I20260709 13:04:29.799021 12693 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 12: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:29.761458 16229 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:29.801100 16326 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.801895 16326 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:29.804396 16323 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.804728 16326 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:29.775630 16313 consensus_queue.cc:1243] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:04:29.805060 16323 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:29.807542 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:29.808082 16312 log.cc:927] Time spent T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.198s	user 0.001s	sys 0.001s
I20260709 13:04:29.811792 12688 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:29.811810 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:29.823520 12613 raft_consensus.cc:1240] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:29.788434 16065 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:29.776023 16246 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:29.780471 16305 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:29.777848 16309 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:29.848242 13230 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:04:29.838838 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 147734us
I20260709 13:04:29.794445 16291 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:29.843500 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:29.845085 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:29.810258 15620 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:29.817292 16252 raft_consensus.cc:697] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:29.813602 16323 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:29.887233 12689 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:04:29.793700 16225 consensus_queue.cc:260] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:29.834476 16318 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:04:29.896453 16225 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:29.867256 15707 raft_consensus.cc:3055] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:29.897643 16318 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.897856 15707 raft_consensus.cc:740] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:29.898290 16318 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:29.861275 16289 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:29.815147 16234 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:29.870594 15999 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:29.914240 12512 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:29.898804 15707 consensus_queue.cc:260] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:29.919595 15707 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:29.922415 15976 consensus_meta.cc:287] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.000s
I20260709 13:04:29.884944 15980 consensus_queue.cc:260] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:29.923236 16115 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:29.948549 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 98037.3us
I20260709 13:04:29.949997 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:29.868618 16246 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:29.900701 16311 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:29.868952 16291 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:29.924093 15980 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:29.861402 16229 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:29.980104 16291 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:29.980314 16229 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:29.947424 15999 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:29.942409 16289 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:29.945413 16321 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:04:29.998754 12617 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:29.983847 12616 raft_consensus.cc:1275] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:29.883747 16305 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:29.840476 16170 consensus_queue.cc:237] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:29.993034 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:04:29.982951 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:30.011737 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:30.008720 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.015388 12616 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:30.015479 12614 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 12: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:29.950568 16115 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:30.022424 12621 raft_consensus.cc:1275] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:29.991603 16275 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:30.031342 12616 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:04:30.043419 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.044283 16335 consensus_queue.cc:1059] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:04:30.046016 16117 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:30.056437 16295 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:30.061491 16318 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:30.062690 16318 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:30.063196 16318 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:30.064698 16110 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:30.070535 12688 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:30.070716 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:30.071357 13233 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:30.071660 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:30.077838 16234 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:30.078806 15999 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:30.067498 16318 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:30.082736 16015 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:30.000634 16252 consensus_queue.cc:237] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:30.043951 16303 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.100446 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:30.120978 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.039925 16349 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:04:30.145347 12691 raft_consensus.cc:1275] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:04:30.145553 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.146483 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:30.126016 16065 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:30.108655 16303 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:30.127318 16289 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:30.127454 16237 raft_consensus.cc:3055] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:30.128844 16208 raft_consensus.cc:3055] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:30.129941 16330 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:30.130473 16337 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:30.131626 16231 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:30.141993 16351 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:30.096475 16015 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:30.158159 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:30.163256 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.163698 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:30.167240 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:30.196947 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.209932 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:30.161242 16237 raft_consensus.cc:740] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:30.164906 16330 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.159826 16208 raft_consensus.cc:740] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:30.220314 12691 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:30.220840 12540 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:30.224624 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:30.222675 16330 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:30.227032 16246 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:30.228191 15620 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:30.227814 16208 consensus_queue.cc:260] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:30.228879 16208 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:30.230911 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:30.230538 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:30.167572 16318 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:04:30.265494 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:30.265545 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:30.264783 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 115431us
I20260709 13:04:30.186434 16015 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:30.277812 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:30.219098 16060 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:30.288381 16060 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:30.292025 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:30.301820 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 71782.6us
I20260709 13:04:30.306150 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:30.288748 16233 consensus_meta.cc:287] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.007s
I20260709 13:04:30.312434 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:30.293170 16352 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.281972 16309 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:30.311599 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:30.319303 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:30.293079 16347 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:30.326031 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:30.180794 16337 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:30.351075 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:30.351547 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.180282 16351 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:30.354099 16362 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:04:30.354887 16344 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 13:04:30.356832 12615 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: []
W20260709 13:04:30.358237 16357 log.cc:927] Time spent T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:04:30.413520 12614 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
W20260709 13:04:30.367837 16268 consensus_meta.cc:287] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.586s	user 0.010s	sys 0.000s
I20260709 13:04:30.372138 12512 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:30.376289 12621 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
W20260709 13:04:30.418534 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 46526us
I20260709 13:04:30.419343 16233 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:30.318347 16246 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 13:04:30.353058 16110 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:30.432389 12687 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:30.327621 16352 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:30.534920 16351 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:30.536648 16303 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:30.291062 16237 consensus_queue.cc:260] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:30.429742 16079 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.425309 16268 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8.
I20260709 13:04:30.349064 16347 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:30.524766 16309 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:30.535305 16337 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:30.415676 16362 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:30.637018 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 353296us
W20260709 13:04:30.639933 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:30.497390 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.634150 16110 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:04:30.664680 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:30.665184 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.665033 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:30.662642 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 303884us
I20260709 13:04:30.666635 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:30.665726 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:30.643060 16303 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.677099 12695 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:30.649655 16230 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:04:30.685915 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:30.679179 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.689313 13197 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:30.691520 12659 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:30.673322 16363 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 13:04:30.697953 12687 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:30.649655 16079 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:30.671044 16352 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:30.695111 16302 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:30.692889 16015 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:30.708380 13197 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:30.713498 16241 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:30.714577 16241 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.715059 16241 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:30.713848 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.721187 12542 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:30.674280 15834 consensus_queue.cc:260] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:30.708897 16117 consensus_meta.cc:287] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.662s	user 0.006s	sys 0.005s
I20260709 13:04:30.677528 16110 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:30.720588 16330 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:30.694433 16303 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:30.708287 16368 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:04:30.734400 12692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 864) took 1021 ms. Trace:
I20260709 13:04:30.719975 16365 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:30.721072 16369 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:04:30.696558 16230 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:30.753435 12692 rpcz_store.cc:276] 0709 13:04:29.712929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.713119 (+   190us) service_pool.cc:224] Handling call
0709 13:04:29.723083 (+  9964us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:29.723266 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:04:29.903730 (+180464us) log.cc:844] Serialized 14 byte log entry
0709 13:04:30.733809 (+830079us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b1800418780. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a91214bc 00007fc3a646f48b 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a6489455 00007fc3a9571060 00007fc3a9583716 00007fc3a9594287
0709 13:04:30.733936 (+   127us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:30.734001 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:30.734088 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:30.734173 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:30.734324 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22115,"prepare.queue_time_us":27046,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":3626,"raft.queue_time_us":48926,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":12028,"spinlock_wait_cycles":2876800,"thread_start_us":187800,"threads_started":3,"wal-append.queue_time_us":68453}
I20260709 13:04:30.770418 13231 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:30.771507 16230 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:30.772111 15735 consensus_meta.cc:287] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.974s	user 0.007s	sys 0.002s
I20260709 13:04:30.722750 16352 consensus_queue.cc:1048] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
W20260709 13:04:30.763149 16320 log.cc:927] Time spent T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.943s	user 0.006s	sys 0.000s
W20260709 13:04:30.783679 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 95399.9us
I20260709 13:04:30.759692 15834 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:30.786613 12588 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.196:33997 timed out after 2.161s (SENT) [suppressed 19 similar messages]
W20260709 13:04:30.811477 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:30.815877 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 102859us
I20260709 13:04:30.808946 15975 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:04:30.827390 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 133662us
I20260709 13:04:30.823143 16347 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:30.837278 12545 pending_rounds.cc:85] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 6
I20260709 13:04:30.839331 12545 pending_rounds.cc:107] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:04:30.839701 12545 raft_consensus.cc:2889] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:30.840723 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:30.848119 12659 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:30.851760 12544 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:30.857595 12546 raft_consensus.cc:1240] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:30.862600 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:30.832899 16225 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:04:30.835191 16369 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:04:30.874701 16303 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:30.864562 16378 consensus_queue.cc:1059] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 13:04:30.878103 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:30.876413 16330 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:30.882062 12546 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:30.882800 12544 raft_consensus.cc:2368] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8.
I20260709 13:04:30.859692 16343 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:30.884938 16126 raft_consensus.cc:3055] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:30.885317 16126 raft_consensus.cc:740] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:30.886090 16126 consensus_queue.cc:260] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:30.888684 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:30.889609 12543 raft_consensus.cc:2393] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 10: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:30.891911 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 798) took 2053 ms. Trace:
I20260709 13:04:30.892318 13228 rpcz_store.cc:276] 0709 13:04:28.829732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:28.830761 (+  1029us) service_pool.cc:224] Handling call
0709 13:04:28.851576 (+ 20815us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:28.867091 (+ 15515us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:28.867135 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:28.870061 (+  2926us) log.cc:844] Serialized 26 byte log entry
0709 13:04:30.660930 (+1790869us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b180034e760. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:04:30.799311 (+138381us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:30.799460 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:30.799581 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:30.877320 (+ 77739us) raft_consensus.cc:1685] finished
0709 13:04:30.877350 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:30.883335 (+  5985us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6827,"raft.queue_time_us":26846,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":10442,"spinlock_wait_cycles":11432704,"thread_start_us":136470,"threads_started":1,"wal-append.queue_time_us":1901871}
I20260709 13:04:30.905936 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:30.906829 12544 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
W20260709 13:04:30.919628 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 87541.4us
W20260709 13:04:30.919777 16208 consensus_meta.cc:287] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.690s	user 0.011s	sys 0.003s
I20260709 13:04:30.933311 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:30.904561 16110 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:30.942584 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 871) took 1176 ms. Trace:
I20260709 13:04:30.943053 12694 rpcz_store.cc:276] 0709 13:04:29.766074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.766258 (+   184us) service_pool.cc:224] Handling call
0709 13:04:29.766649 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:29.815498 (+ 48849us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:29.857418 (+ 41920us) log.cc:844] Serialized 14 byte log entry
0709 13:04:30.021068 (+163650us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:30.021277 (+   209us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:30.021339 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:30.942356 (+921017us) spinlock_profiling.cc:243] Waited 48.5 ms on lock 0x7b54001a0c54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:30.942400 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:30.942526 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40897,"prepare.queue_time_us":45186,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":31094,"spinlock_wait_cycles":116310272,"thread_start_us":138124,"threads_started":1,"wal-append.queue_time_us":226131}
W20260709 13:04:30.937866 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 88466.1us
I20260709 13:04:30.946547 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:30.947227 13228 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:30.951608 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:30.955570 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:30.977233 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:30.979140 12620 raft_consensus.cc:2393] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:30.982973 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:30.966485 16230 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.988955 12659 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:30.991097 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:30.995993 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:30.999167 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:30.999992 12543 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 9: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:30.954210 16096 consensus_queue.cc:1059] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:04:31.002249 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:31.004668 12543 raft_consensus.cc:2368] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8.
I20260709 13:04:31.005026 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:31.005354 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:31.005904 12543 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:31.006808 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:31.007248 12543 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:31.008008 16303 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:31.011747 12620 raft_consensus.cc:2393] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:31.008493 16225 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:31.012557 16096 raft_consensus.cc:3055] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:31.012640 16225 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:31.013146 16096 raft_consensus.cc:740] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:31.014135 16096 consensus_queue.cc:260] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:31.001865 16230 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:31.020658 16115 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:31.021112 16230 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:31.021317 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:31.032300 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:31.032768 12662 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:31.033998 12662 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:31.034942 12510 connection.cc:256] RPC call timeout handler was delayed by -1.8306157009999424s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1573s for a response
W20260709 13:04:31.035882 12510 connection.cc:256] RPC call timeout handler was delayed by -1.7715329269999529s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15980000000000003s for a response
I20260709 13:04:31.036087 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:31.040066 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:31.036201 12510 connection.cc:256] RPC call timeout handler was delayed by -1.7148329269999749s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
W20260709 13:04:31.041352 12510 connection.cc:256] RPC call timeout handler was delayed by -1.7081667129999687s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
W20260709 13:04:31.041785 12510 connection.cc:256] RPC call timeout handler was delayed by -1.7049223709999524s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3014s for a response
I20260709 13:04:31.041858 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:31.042254 12545 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
W20260709 13:04:31.042172 12510 connection.cc:256] RPC call timeout handler was delayed by -1.671266712999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1897s for a response
W20260709 13:04:31.043145 12510 connection.cc:256] RPC call timeout handler was delayed by -1.6504630579999002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15940000000000001s for a response
W20260709 13:04:31.044075 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.042541 13228 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:31.041051 16015 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.046440 16015 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:31.049024 16015 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:31.044777 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:31.050596 12620 raft_consensus.cc:2393] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 12: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:31.052397 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:31.053685 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:31.042420 12543 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 4.
I20260709 13:04:31.055830 12543 pending_rounds.cc:85] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 5
I20260709 13:04:31.057147 12543 pending_rounds.cc:107] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:04:31.057608 12543 raft_consensus.cc:2889] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:31.056759 12510 connection.cc:256] RPC call timeout handler was delayed by -1.4111667129999432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
W20260709 13:04:31.058326 12510 connection.cc:256] RPC call timeout handler was delayed by -1.2933157009999832s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.217s for a response
I20260709 13:04:31.042688 12545 pending_rounds.cc:85] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 7
I20260709 13:04:31.059095 12545 pending_rounds.cc:107] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:04:31.059504 12545 raft_consensus.cc:2889] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:31.037345 16315 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:31.038511 16303 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:31.067773 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:31.070081 12620 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:31.068115 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:31.071583 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:31.069499 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:31.072996 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:31.055902 16225 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:31.039366 15735 consensus_queue.cc:1059] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:04:31.078071 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:31.077131 12617 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:31.073697 12619 raft_consensus.cc:2393] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 7: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:31.082587 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:31.069851 16303 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.070824 16233 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:31.084048 13230 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
W20260709 13:04:31.074501 16384 log.cc:927] Time spent T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:04:31.095422 16328 log.cc:927] Time spent T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.988s	user 0.007s	sys 0.009s
W20260709 13:04:31.097662 16340 log.cc:927] Time spent T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 1.107s	user 0.002s	sys 0.014s
I20260709 13:04:31.109699 16233 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:31.112468 16233 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:31.113090 16325 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.113619 16325 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:31.115058 16241 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:31.115604 16325 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:31.116115 16325 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:31.116544 16325 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:31.117579 13232 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:31.120318 16241 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:31.097452 16385 log.cc:927] Time spent T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:04:31.124863 15975 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:31.125443 15975 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:31.131875 12542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 741) took 2653 ms (client timeout 2200 ms). Trace:
W20260709 13:04:31.132421 12542 rpcz_store.cc:269] 0709 13:04:28.478800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:28.486943 (+  8143us) service_pool.cc:224] Handling call
0709 13:04:31.131614 (+2644671us) spinlock_profiling.cc:243] Waited 2.22 s on lock 0x7b54000a64d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:31.131746 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5107960192}
W20260709 13:04:31.135213 16389 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:04:31.091936 16303 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:31.142858 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.143054 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:31.143553 12545 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:31.145478 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:31.148175 12617 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:31.080330 16330 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:31.160840 12617 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
W20260709 13:04:31.169636 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.169445 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 760) took 1420 ms. Trace:
I20260709 13:04:31.173058 12545 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:04:31.173765 13197 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:31.171707 12539 rpcz_store.cc:276] 0709 13:04:29.748749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.748963 (+   214us) service_pool.cc:224] Handling call
0709 13:04:29.770229 (+ 21266us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:29.770658 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:29.770689 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:29.798368 (+ 27679us) log.cc:844] Serialized 52 byte log entry
0709 13:04:29.863982 (+ 65614us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:29.865952 (+  1970us) log.cc:844] Serialized 14 byte log entry
0709 13:04:29.866359 (+   407us) log.cc:844] Serialized 14 byte log entry
0709 13:04:29.866524 (+   165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:29.866622 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:31.096706 (+1230084us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:04:31.169167 (+ 72461us) raft_consensus.cc:1685] finished
0709 13:04:31.169191 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:31.169368 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14458,"prepare.queue_time_us":636662,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":88,"raft.queue_time_us":63432,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":33696,"spinlock_wait_cycles":14738560,"thread_start_us":7278,"threads_started":2,"wal-append.queue_time_us":82685}
W20260709 13:04:31.181128 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 116089us
I20260709 13:04:31.183223 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:31.183918 12545 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:31.184796 13228 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:31.092525 15735 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.185748 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:31.210696 12538 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:31.211577 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:31.170466 16015 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:31.212332 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:31.212216 13228 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:31.215144 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:31.223457 16208 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:31.229324 16208 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:31.240756 16241 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:31.241428 16241 raft_consensus.cc:697] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:31.242380 16241 consensus_queue.cc:237] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:31.248320 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:31.180637 16330 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:31.211179 15735 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:31.248525 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:31.366993 12538 raft_consensus.cc:2410] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 10 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 13:04:31.302592 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 128892us
I20260709 13:04:31.251806 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:31.249264 12545 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
W20260709 13:04:31.368353 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 116634us
I20260709 13:04:31.329543 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:31.369603 12510 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:31.374446 13228 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:04:31.350198 16391 log.cc:927] Time spent T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 13:04:31.209967 15834 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.380650 12615 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:31.384173 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:04:31.264129 16385 log.cc:927] Time spent T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:04:31.283768 16350 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.398406 16350 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:31.399537 16222 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:31.386624 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:31.401960 16350 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:31.402936 16330 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:31.403587 16330 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:31.264278 16233 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:31.360347 16208 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:31.388171 12696 raft_consensus.cc:1275] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:31.408772 12542 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:31.395087 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:31.286175 16399 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:31.231997 16015 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:31.336215 16315 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:04:31.396631 16290 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 2.238s	user 0.012s	sys 0.011s
W20260709 13:04:31.385824 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 160757us
I20260709 13:04:31.409405 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:31.411497 12692 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:31.377462 16398 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:31.424175 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:31.412238 15975 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:31.434891 15975 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:31.435755 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:31.438517 16325 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:31.440631 15735 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:31.406055 15834 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:31.469723 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 868) took 1735 ms. Trace:
I20260709 13:04:31.479736 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2996) took 1167 ms. Trace:
W20260709 13:04:31.468273 13233 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 1001) took 3451 ms (client timeout 2159 ms). Trace:
I20260709 13:04:31.576550 12690 rpcz_store.cc:276] 0709 13:04:29.733844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.734015 (+   171us) service_pool.cc:224] Handling call
0709 13:04:29.734462 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:29.834907 (+100445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:29.834959 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:29.835030 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:29.835083 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:31.469408 (+1634325us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54000c7bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:31.469471 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:31.469649 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":230422272}
I20260709 13:04:31.482039 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:31.441848 12692 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:04:31.470436 13234 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:04:31.578981 13233 rpcz_store.cc:269] 0709 13:04:28.016909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:28.017028 (+   119us) service_pool.cc:224] Handling call
0709 13:04:31.468012 (+3450984us) spinlock_profiling.cc:243] Waited 1.98 s on lock 0x7b54007c0e54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:31.468179 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4551875840}
I20260709 13:04:31.583508 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:31.578608 12622 rpcz_store.cc:276] 0709 13:04:30.311808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:30.311989 (+   181us) service_pool.cc:224] Handling call
0709 13:04:30.312384 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:30.676561 (+364177us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:30.827952 (+151391us) log.cc:844] Serialized 14 byte log entry
0709 13:04:30.906915 (+ 78963us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:30.906962 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:30.907009 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:31.479448 (+572439us) spinlock_profiling.cc:243] Waited 364 ms on lock 0x7b54000203d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:31.479496 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:31.479653 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":194414,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":14403,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":10468,"spinlock_wait_cycles":836996992,"thread_start_us":206626,"threads_started":2,"wal-append.queue_time_us":90050}
I20260709 13:04:31.584224 12619 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:31.581095 12692 pending_rounds.cc:85] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 8
I20260709 13:04:31.586980 12692 pending_rounds.cc:107] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:04:31.587507 12692 raft_consensus.cc:2889] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:31.594043 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 224532us
I20260709 13:04:31.595156 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:31.421782 16398 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:31.603751 13228 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:31.442312 16302 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.605684 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:31.414494 16233 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:31.618342 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:31.604725 16238 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:31.451174 16015 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:31.618042 16060 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:31.426436 16315 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:31.452750 16208 consensus_queue.cc:1048] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.154s
W20260709 13:04:31.636866 13231 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 652) took 2936 ms (client timeout 2161 ms). Trace:
I20260709 13:04:31.423075 16399 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:31.604995 16398 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:31.637459 13231 rpcz_store.cc:269] 0709 13:04:28.700807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:28.700952 (+   145us) service_pool.cc:224] Handling call
0709 13:04:31.636686 (+2935734us) spinlock_profiling.cc:243] Waited 2.03 s on lock 0x7b5400750154. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:31.636796 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4667373824}
I20260709 13:04:31.623435 16305 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:31.643963 12659 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:31.594058 16303 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:31.640923 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:31.628648 16410 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:31.645859 13232 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:31.634325 16015 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:31.652653 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:31.654150 16015 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:31.654788 16233 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:31.626708 16302 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:31.649806 16269 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:04:31.665956 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 70881us
I20260709 13:04:31.673302 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:31.667980 12510 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:31.677721 13233 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:31.677965 12510 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:31.682008 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:31.682687 12542 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:31.653596 16410 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:31.667017 16269 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.684589 12510 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:31.684702 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:31.675316 16369 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:31.679129 16015 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:31.691311 12510 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:31.692811 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:31.687114 16238 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:31.693670 16060 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:31.726060 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:31.803076 13230 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 806) took 1757 ms (client timeout 2165 ms). Trace:
I20260709 13:04:31.805289 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:31.800159 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:31.724928 12688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 872) took 1952 ms (client timeout 2192 ms). Trace:
I20260709 13:04:31.728571 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:31.828461 13229 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:31.763531 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1507) took 1865 ms. Trace:
I20260709 13:04:31.686518 16269 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:31.725327 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:31.702841 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2985) took 1720 ms. Trace:
I20260709 13:04:31.715106 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1017) took 1643 ms. Trace:
W20260709 13:04:31.764355 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:31.827524 13230 rpcz_store.cc:269] 0709 13:04:30.045511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:30.071433 (+ 25922us) service_pool.cc:224] Handling call
0709 13:04:31.802774 (+1731341us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54007c01d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:31.802943 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2326531968}
I20260709 13:04:31.752411 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:31.727737 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:31.728893 12690 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:04:31.832480 12691 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:31.701458 12616 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:31.838357 13234 rpcz_store.cc:276] 0709 13:04:30.071495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:30.083838 (+ 12343us) service_pool.cc:224] Handling call
0709 13:04:31.469970 (+1386132us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:31.581521 (+111551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:31.714860 (+133339us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54007c0e50. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:31.715032 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3186832768}
W20260709 13:04:31.854315 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 161570us
I20260709 13:04:31.838292 12613 rpcz_store.cc:276] 0709 13:04:29.982294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.982441 (+   147us) service_pool.cc:224] Handling call
0709 13:04:29.982754 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:30.024867 (+ 42113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:30.024904 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:30.024943 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:30.024988 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:31.702633 (+1677645us) spinlock_profiling.cc:243] Waited 41.9 ms on lock 0x7b54003af7d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:31.702677 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:31.702790 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96368384}
I20260709 13:04:31.719143 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 2994) took 1408 ms. Trace:
I20260709 13:04:31.748306 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1504) took 2108 ms. Trace:
I20260709 13:04:31.707126 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 2991) took 1681 ms. Trace:
W20260709 13:04:31.829063 12688 rpcz_store.cc:269] 0709 13:04:29.772352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.772495 (+   143us) service_pool.cc:224] Handling call
0709 13:04:31.724772 (+1952277us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b540009cc54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:31.724871 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43171584}
W20260709 13:04:31.857528 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:31.857777 12621 rpcz_store.cc:276] 0709 13:04:30.025609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:30.025730 (+   121us) service_pool.cc:224] Handling call
0709 13:04:30.035522 (+  9792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:30.418803 (+383281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:31.706890 (+1288087us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b54001e9bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:31.707064 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783026944}
I20260709 13:04:31.836632 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:31.858978 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:31.856519 12614 rpcz_store.cc:276] 0709 13:04:30.310618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:30.310801 (+   183us) service_pool.cc:224] Handling call
0709 13:04:31.718840 (+1408039us) spinlock_profiling.cc:243] Waited 77.8 ms on lock 0x7b54000997d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:31.719012 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178861952}
I20260709 13:04:31.863937 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:31.857692 12689 rpcz_store.cc:276] 0709 13:04:29.640169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.658996 (+ 18827us) service_pool.cc:224] Handling call
0709 13:04:29.659338 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:29.887814 (+228476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:31.747972 (+1860158us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b5400311ad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:31.748224 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":523211136}
I20260709 13:04:31.829896 12693 rpcz_store.cc:276] 0709 13:04:29.898180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.898375 (+   195us) service_pool.cc:224] Handling call
0709 13:04:29.898734 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:29.917188 (+ 18454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:29.917382 (+   194us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:29.917909 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:04:31.480892 (+1562983us) spinlock_profiling.cc:243] Waited 1.26 ms on lock 0x7b180020f860. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:04:31.671667 (+190775us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:31.671836 (+   169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:31.671993 (+   157us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:31.763079 (+ 91086us) raft_consensus.cc:1685] finished
0709 13:04:31.763110 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:31.763438 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18042,"raft.queue_time_us":52400,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":6410,"spinlock_wait_cycles":2902400,"thread_start_us":190573,"threads_started":1,"wal-append.queue_time_us":1748955}
I20260709 13:04:31.683835 16413 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:31.855353 12510 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:31.787966 16393 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.695s	user 0.004s	sys 0.001s
W20260709 13:04:31.718149 16416 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:04:31.875087 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:31.874439 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:31.703769 16404 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:04:31.876705 12587 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:31.720335 15992 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:31.732167 16303 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:31.876029 13234 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:31.730361 16399 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:31.753104 16410 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:31.900275 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:31.869298 16237 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:31.731112 16315 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:31.889765 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:31.869360 16015 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:31.836145 16366 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:31.901222 13232 raft_consensus.cc:2376] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7. Re-sending same reply.
I20260709 13:04:31.836470 16351 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:31.892032 12510 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:31.880192 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:31.915086 12547 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:31.916038 12691 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:31.869853 16231 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:31.919697 16366 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:31.710798 16398 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:31.869171 16347 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:31.921365 16347 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:31.922286 16366 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:31.907657 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:31.920810 12692 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:31.923585 16351 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:31.925258 12620 raft_consensus.cc:1275] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:04:31.925618 12620 pending_rounds.cc:85] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 5
I20260709 13:04:31.925841 12620 pending_rounds.cc:107] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:04:31.925899 16351 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:31.926221 12620 raft_consensus.cc:2889] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:31.927657 12620 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:31.927955 12510 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:31.930218 16231 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:31.930852 16231 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:31.869983 16208 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:31.932029 16208 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:31.934684 16208 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:31.935146 16208 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:31.935470 16208 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:31.935933 16208 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:31.936671 16302 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:31.937227 16398 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:31.937709 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:31.973579 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:31.923611 16347 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:31.940613 13229 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:04:31.938597 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:31.944104 16079 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:31.978662 12510 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:31.946689 12588 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:04:31.947139 16330 consensus_meta.cc:287] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.540s	user 0.006s	sys 0.003s
I20260709 13:04:31.956912 15834 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:04:32.080039 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 101441us
I20260709 13:04:32.080456 15834 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:32.081076 12510 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:31.886466 16292 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:31.966809 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:31.967372 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48978 (request call id 16) took 2512 ms. Trace:
I20260709 13:04:32.097462 13227 rpcz_store.cc:276] 0709 13:04:29.453531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.453706 (+   175us) service_pool.cc:224] Handling call
0709 13:04:31.965616 (+2511910us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54005d3254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9573853 00007fc3ae54160a 00007fc3a7ac77d4 00007fc3a7ac7762 00007fc3a7ac7691 00007fc3a7ac760c 00007fc3a7ac68c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:31.965705 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":589771008}
I20260709 13:04:31.928265 16369 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:31.968242 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:32.097512 13228 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:31.969432 16208 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:31.971892 15981 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.974833 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:04:31.938589 16390 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.805s	user 0.000s	sys 0.003s
W20260709 13:04:31.945327 12695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 874) took 2153 ms (client timeout 2190 ms). Trace:
I20260709 13:04:31.983973 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:31.985042 12588 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:04:32.103787 12695 rpcz_store.cc:269] 0709 13:04:29.791614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.811532 (+ 19918us) service_pool.cc:224] Handling call
0709 13:04:31.945137 (+2133605us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b540016eed4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:31.945260 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1954071424}
W20260709 13:04:32.105348 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 120362us
I20260709 13:04:32.107028 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:31.959633 16404 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:04:32.079172 16347 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:04:32.079519 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 99991.3us
I20260709 13:04:32.079634 16330 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:04:32.082055 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 101318us
I20260709 13:04:32.082558 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:32.111745 12622 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.015s	sys 0.059s
W20260709 13:04:32.114303 12622 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.015s	sys 0.059s
I20260709 13:04:32.104107 12619 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:32.115200 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 761) took 2366 ms. Trace:
I20260709 13:04:32.115422 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:32.081925 16398 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:31.960578 16015 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:32.132289 12619 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:32.134197 16015 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:32.103379 16356 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.001s	user 0.005s	sys 0.009s
I20260709 13:04:32.135248 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:32.135267 16015 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:32.100186 16079 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:32.102206 16246 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:32.128432 13197 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:32.121541 12510 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:32.114693 16383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.022s	user 0.023s	sys 0.006s
I20260709 13:04:32.135953 12695 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:32.111907 16233 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:32.111653 16347 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:04:32.135634 16356 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.005s	sys 0.009s
W20260709 13:04:32.180853 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 52523.2us
I20260709 13:04:32.154229 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:32.188759 12510 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:32.189247 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:32.190011 12510 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:32.190415 13197 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:32.134174 12541 rpcz_store.cc:276] 0709 13:04:29.749181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.749379 (+   198us) service_pool.cc:224] Handling call
0709 13:04:29.763739 (+ 14360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:29.866092 (+102353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:29.866142 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:29.866783 (+   641us) log.cc:844] Serialized 26 byte log entry
0709 13:04:30.020482 (+153699us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:31.730118 (+1709636us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b1800402ee0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a91214bc 00007fc3a646f48b 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a6489455 00007fc3acf713c7 00007fc3a95839a7 00007fc3a95930bf
0709 13:04:31.730256 (+   138us) log.cc:844] Serialized 14 byte log entry
0709 13:04:32.105644 (+375388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:32.105721 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:32.105770 (+    49us) raft_consensus.cc:1685] finished
0709 13:04:32.114969 (+  9199us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:32.115133 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20401,"prepare.queue_time_us":127358,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":3236,"raft.queue_time_us":27710,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":22440,"spinlock_wait_cycles":2575616,"thread_start_us":689632,"threads_started":4,"wal-append.queue_time_us":248669,"wal-append.run_cpu_time_us":2026,"wal-append.run_wall_time_us":1002033}
I20260709 13:04:32.105976 15981 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:32.196671 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:32.127663 16413 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:04:32.171195 16383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.081s	user 0.023s	sys 0.006s
I20260709 13:04:32.115746 16225 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:04:32.209106 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:32.209929 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2806) took 1333 ms. Trace:
I20260709 13:04:32.215413 12546 rpcz_store.cc:276] 0709 13:04:30.876915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:30.895743 (+ 18828us) service_pool.cc:224] Handling call
0709 13:04:30.921852 (+ 26109us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:30.922330 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:30.922371 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:30.934706 (+ 12335us) log.cc:844] Serialized 26 byte log entry
0709 13:04:31.043953 (+109247us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:31.043989 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:31.044059 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:31.937972 (+893913us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:04:32.198696 (+260724us) raft_consensus.cc:1685] finished
0709 13:04:32.198718 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:32.209843 (+ 11125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":2725,"spinlock_wait_cycles":48897408,"thread_start_us":83509,"threads_started":1,"wal-append.queue_time_us":129467}
I20260709 13:04:32.152135 16015 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:32.201717 16079 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:32.208688 16323 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:32.211851 15981 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:32.185691 15980 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:32.211972 12510 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:32.187206 16347 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:32.184881 16330 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:32.233820 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 792) took 1263 ms. Trace:
I20260709 13:04:32.183504 16372 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:04:32.235112 12510 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:32.208796 16398 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:32.213718 15909 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:32.193990 16302 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 13:04:32.259802 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:32.262974 12510 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:32.231175 16170 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:04:32.262578 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 321000us
I20260709 13:04:32.236336 12618 rpcz_store.cc:276] 0709 13:04:30.970422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:30.970616 (+   194us) service_pool.cc:224] Handling call
0709 13:04:30.971019 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:30.981742 (+ 10723us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:04:31.083274 (+101532us) log.cc:844] Serialized 14 byte log entry
0709 13:04:31.241420 (+158146us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b4800002dd8. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3ae4a2aa1 00007fc3ae499b37 00007fc3ae4999ca 00007fc3ae59126f 00007fc3ae590f37 00007fc3ae5a555c 00007fc3ae5a5508 00007fc3ae5a5488 00007fc3ae5a5443 00007fc3ae5a46ec 00007fc3ad4cea96
0709 13:04:31.280116 (+ 38696us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:31.295273 (+ 15157us) log.cc:844] Serialized 26 byte log entry
0709 13:04:31.295441 (+   168us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:31.295477 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:31.295549 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:32.230932 (+935383us) raft_consensus.cc:1685] finished
0709 13:04:32.233610 (+  2678us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:32.233762 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15463,"prepare.queue_time_us":30839,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":4018,"raft.run_cpu_time_us":2179,"raft.run_wall_time_us":269209,"spinlock_wait_cycles":4221184,"thread_start_us":162224,"threads_started":2,"wal-append.queue_time_us":474765}
I20260709 13:04:32.267946 12510 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:32.234292 15980 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.234390 16015 raft_consensus.cc:697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 7 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:32.298185 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:32.306219 16398 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:32.306244 13235 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 1012) took 2499 ms (client timeout 1580 ms). Trace:
I20260709 13:04:32.312134 16269 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:32.279080 16292 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:32.266930 16170 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.314167 16208 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:32.294404 15980 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:32.315214 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:32.259919 15834 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:04:32.270066 16323 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:32.254914 16413 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:04:32.318547 13235 rpcz_store.cc:269] 0709 13:04:29.807101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:29.807280 (+   179us) service_pool.cc:224] Handling call
0709 13:04:32.306013 (+2498733us) spinlock_profiling.cc:243] Waited 2.3 s on lock 0x7b54004d8354. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:32.306166 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5297460480}
W20260709 13:04:32.319639 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 51781.7us
W20260709 13:04:32.328727 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 217959us
I20260709 13:04:32.262158 16334 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:32.335371 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.336162 12693 raft_consensus.cc:3055] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:32.336544 12693 raft_consensus.cc:740] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:32.337808 12547 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:32.337230 12693 consensus_queue.cc:260] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:32.339118 12693 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:32.339649 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:32.340225 12547 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:32.341866 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:32.345088 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:32.345922 12542 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:32.346045 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:32.351497 12691 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:32.353894 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:32.356189 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:32.357391 12545 raft_consensus.cc:1275] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:32.359077 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:32.360877 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:32.362368 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.362782 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:32.364653 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:32.366058 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:32.366307 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:32.354729 12538 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:32.464677 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:32.465484 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:32.466217 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:32.467362 12545 raft_consensus.cc:2410] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:04:32.466262 12542 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:32.469879 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:32.470583 12542 raft_consensus.cc:2376] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9. Re-sending same reply.
I20260709 13:04:32.471958 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:32.465323 12538 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:32.320159 16170 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:32.498044 12542 raft_consensus.cc:2393] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 10: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:32.320338 16292 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:32.516382 12546 raft_consensus.cc:1240] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:32.520633 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:32.267660 15909 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:32.525254 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:32.521351 12544 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:32.496116 16419 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.529582 12542 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:04:32.529748 12539 raft_consensus.cc:1275] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:32.333338 16413 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:32.533805 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:32.495455 16423 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.463581 15992 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.553757 12546 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:04:32.557761 16423 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:32.518329 16398 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.532428 16292 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:32.532992 16372 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:32.603861 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:32.639340 12542 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:32.604218 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:32.641178 12543 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
W20260709 13:04:32.648097 12513 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.012s	sys 0.024s
W20260709 13:04:32.648417 12513 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.012s	sys 0.024s
W20260709 13:04:32.648669 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 501016us
W20260709 13:04:32.648882 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.650178 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:32.546700 16413 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:32.657711 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:32.658470 12539 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:32.647651 16126 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:32.664403 12662 leader_election.cc:400] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8.
I20260709 13:04:32.669894 12662 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:32.671006 12542 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
W20260709 13:04:32.675344 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 484959us
I20260709 13:04:32.675211 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:32.677148 12662 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:32.675153 12513 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:32.653828 16268 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:32.707643 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:32.543681 16419 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:32.712234 12618 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:04:32.639402 16398 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:32.565554 15992 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:32.647619 16372 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:32.698711 16233 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:04:32.727291 16304 consensus_queue.cc:1059] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
W20260709 13:04:32.742082 12695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.022s	sys 0.048s
I20260709 13:04:32.698262 16410 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:04:32.742627 12695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.022s	sys 0.048s
I20260709 13:04:32.711769 16330 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:04:32.745929 12622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.028s	sys 0.020s
W20260709 13:04:32.753459 12622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.028s	sys 0.020s
I20260709 13:04:32.749437 12544 raft_consensus.cc:2410] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:04:32.762403 12538 raft_consensus.cc:1275] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:32.654254 16015 consensus_queue.cc:237] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:32.742023 16368 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:32.775025 12620 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:32.753233 16410 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:32.761950 16330 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:32.725745 16268 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:32.763314 16302 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:04:32.797482 16079 consensus_meta.cc:287] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.564s	user 0.007s	sys 0.003s
I20260709 13:04:32.798272 16079 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:32.800441 12541 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 5.
I20260709 13:04:32.800206 16292 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:32.802393 16292 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:32.771904 16409 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:32.787752 16410 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:32.790073 16330 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:32.836835 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:32.839341 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:32.816836 16409 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.843669 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:32.845412 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:32.848426 13234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:04:32.849226 13234 raft_consensus.cc:606] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:32.820029 16423 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:32.856268 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:32.826768 16269 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:32.862435 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:32.863551 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:32.867755 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 453526us
I20260709 13:04:32.852375 16409 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:32.816372 16302 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:32.858891 16423 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.876286 15735 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.886451 15735 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:32.888633 13227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:04:32.889456 13227 raft_consensus.cc:606] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:04:32.889895 13227 raft_consensus.cc:614] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:04:32.894212 16379 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 1.955s	user 0.011s	sys 0.006s
I20260709 13:04:32.911418 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:32.912608 12544 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:04:32.880818 16269 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.916399 12538 raft_consensus.cc:2376] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8. Re-sending same reply.
W20260709 13:04:32.910924 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 570123us
I20260709 13:04:32.927383 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:32.898248 15909 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:32.919212 16428 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:04:32.924119 12588 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:32.938452 12588 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:32.949484 16222 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.950176 16222 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:32.950975 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3015) took 1488 ms. Trace:
I20260709 13:04:32.951089 16362 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:32.952168 16222 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:32.937093 16351 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:32.925067 16269 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:32.954097 16351 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:32.956140 16351 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:32.956626 16269 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:32.956897 16430 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
W20260709 13:04:32.958087 16431 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.180s	user 0.001s	sys 0.001s
I20260709 13:04:32.959285 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1525) took 1233 ms. Trace:
I20260709 13:04:32.959625 12694 rpcz_store.cc:276] 0709 13:04:31.726474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.860958 (+134484us) service_pool.cc:224] Handling call
0709 13:04:31.861470 (+   512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:31.861869 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:31.861896 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:31.863019 (+  1123us) log.cc:844] Serialized 26 byte log entry
0709 13:04:32.332920 (+469901us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:32.332980 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:32.333079 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:32.959087 (+626008us) raft_consensus.cc:1685] finished
0709 13:04:32.959103 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:32.959227 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6973,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":2378,"thread_start_us":425798,"threads_started":1,"wal-append.queue_time_us":843688}
I20260709 13:04:32.951362 12622 rpcz_store.cc:276] 0709 13:04:31.462363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.597292 (+134929us) service_pool.cc:224] Handling call
0709 13:04:31.597735 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:32.117436 (+519701us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:32.117468 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:32.126775 (+  9307us) log.cc:844] Serialized 26 byte log entry
0709 13:04:32.754245 (+627470us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:32.754296 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:32.754356 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:32.950763 (+196407us) raft_consensus.cc:1685] finished
0709 13:04:32.950782 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:32.950917 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6558,"raft.queue_time_us":48632,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":4932,"thread_start_us":1078335,"threads_started":2,"wal-append.queue_time_us":733503}
I20260709 13:04:32.961381 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:32.897233 16423 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:32.966161 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:32.969246 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:32.970921 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:32.971897 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:32.935758 16398 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:32.971732 12687 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:32.983002 13200 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:32.983831 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:32.976035 12694 raft_consensus.cc:2410] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:04:32.939847 16372 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:32.987886 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:32.989961 12512 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:32.992947 12687 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:32.989269 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:32.994661 12512 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:33.002408 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:33.003333 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:04:33.001212 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 298211us
I20260709 13:04:33.007164 13200 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:33.008530 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 663) took 1426 ms. Trace:
W20260709 13:04:33.011703 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 334638us
I20260709 13:04:33.011776 13230 rpcz_store.cc:276] 0709 13:04:31.582351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.885494 (+303143us) service_pool.cc:224] Handling call
0709 13:04:31.885886 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:31.886235 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:31.886265 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:31.886789 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:04:32.263081 (+376292us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:32.263125 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:32.263199 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:33.008346 (+745147us) raft_consensus.cc:1685] finished
0709 13:04:33.008368 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:33.008478 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6759,"raft.queue_time_us":756,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":16304,"thread_start_us":345296,"threads_started":1,"wal-append.queue_time_us":744718}
I20260709 13:04:33.013351 12662 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:32.973269 16409 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.020082 12687 raft_consensus.cc:2410] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:32.988842 16241 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:33.034672 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:33.039304 12695 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 13:04:33.023550 16347 consensus_meta.cc:287] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.766s	user 0.009s	sys 0.003s
I20260709 13:04:32.989094 16304 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:33.000185 16398 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:32.997673 16419 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:33.025032 13233 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 669) took 1424 ms (client timeout 1612 ms). Trace:
W20260709 13:04:33.090041 13233 rpcz_store.cc:269] 0709 13:04:31.600876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.618070 (+ 17194us) service_pool.cc:224] Handling call
0709 13:04:33.024821 (+1406751us) spinlock_profiling.cc:243] Waited 54.1 ms on lock 0x7b54004e2854. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:33.024963 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124355968}
I20260709 13:04:32.986740 16439 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:32.987041 16441 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:33.041455 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:33.028083 16241 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.043200 16126 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:33.048866 16369 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:33.050360 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:33.050771 16423 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:33.033001 15909 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:04:33.101462 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:33.058619 16302 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:33.059053 16330 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.107605 16330 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:33.108388 16330 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.021705 12513 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:33.001219 16408 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
W20260709 13:04:33.110266 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 88678.6us
I20260709 13:04:33.070046 16447 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:33.111328 16447 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.111963 16447 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:33.072958 16446 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.114039 16246 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:33.113909 16446 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.008708 16372 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:04:33.098181 16241 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:33.091152 12662 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:33.065824 16347 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.111286 12513 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:33.108892 16330 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.140103 16369 consensus_queue.cc:1059] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:33.141707 16330 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:33.142448 16443 raft_consensus.cc:3055] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:33.142917 16443 raft_consensus.cc:740] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:33.143922 16443 consensus_queue.cc:260] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:33.123974 16446 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:33.124950 16410 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:33.100976 16351 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:04:33.147730 16410 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:33.097651 16126 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:33.128166 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 189778us
I20260709 13:04:33.148412 16126 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:33.131418 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:33.149060 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:33.150044 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:33.151150 12662 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:33.151002 12588 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:33.102270 12687 raft_consensus.cc:2376] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8. Re-sending same reply.
I20260709 13:04:33.151963 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:33.152537 16302 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.152854 16237 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:33.153285 16237 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:33.153842 16237 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:33.153206 16302 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.156178 16302 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:33.156906 16304 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:33.152559 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:33.100544 15909 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:33.139554 16450 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:33.134732 12513 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:04:33.193921 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 59299.8us
I20260709 13:04:33.145499 16443 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.178534 16450 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:33.197765 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 46830.4us
I20260709 13:04:33.178216 16410 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:33.198342 16446 raft_consensus.cc:2764] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:04:33.253626 12588 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:33.255203 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:33.256875 12588 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:33.180366 16351 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:33.160063 16398 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:33.211683 15735 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:33.151305 16305 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:33.179388 15909 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:33.211138 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3031) took 1426 ms. Trace:
I20260709 13:04:33.271286 12614 rpcz_store.cc:276] 0709 13:04:31.784523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.918739 (+134216us) service_pool.cc:224] Handling call
0709 13:04:31.918986 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:31.929123 (+ 10137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:31.929240 (+   117us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:31.929285 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:31.929322 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:33.210867 (+1281545us) spinlock_profiling.cc:243] Waited 9.96 ms on lock 0x7b54001cc354. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:33.210917 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:33.211073 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22898048}
I20260709 13:04:33.226881 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:33.273216 12615 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:04:33.228819 12613 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:33.234562 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:33.276258 12622 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:33.235667 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:33.193027 15980 consensus_meta.cc:287] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.870s	user 0.006s	sys 0.006s
I20260709 13:04:33.251055 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:33.278043 13233 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:33.202168 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 886) took 1247 ms. Trace:
I20260709 13:04:33.097400 16441 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.261274 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:33.268399 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:33.273113 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:33.280529 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:33.236562 16423 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:33.281497 12613 raft_consensus.cc:2410] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 9 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:04:33.271343 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:33.287267 12621 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:33.279021 12691 rpcz_store.cc:276] 0709 13:04:31.954496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.113409 (+158913us) service_pool.cc:224] Handling call
0709 13:04:32.126964 (+ 13555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:32.352038 (+225074us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:33.201888 (+849850us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b54002ca954. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:33.202094 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":515480960}
I20260709 13:04:33.284099 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:33.228616 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 70743.7us
I20260709 13:04:33.295743 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:33.310765 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:33.297392 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:33.291941 12512 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:33.318773 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:33.318109 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:33.321818 12588 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:33.252925 16410 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:33.262476 16419 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:33.331324 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:33.247812 16450 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:33.262696 16439 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:33.285583 16454 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:33.340735 12622 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:04:33.341630 13230 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:33.195302 16464 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 13:04:33.250717 16356 consensus_queue.cc:1059] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:04:33.282793 16351 raft_consensus.cc:697] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:33.267110 16304 consensus_queue.cc:1048] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 13:04:33.334144 12693 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.037s	sys 0.055s
W20260709 13:04:33.347704 12693 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.038s	sys 0.055s
I20260709 13:04:33.348683 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 888) took 1162 ms. Trace:
I20260709 13:04:33.300613 16409 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:33.267122 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 260016us
I20260709 13:04:33.310791 16305 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:04:33.346038 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:33.330739 16323 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:33.349156 12693 rpcz_store.cc:276] 0709 13:04:32.186399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.335756 (+149357us) service_pool.cc:224] Handling call
0709 13:04:32.336049 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:33.348224 (+1012175us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:04:33.348272 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:33.348332 (+    60us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:33.348378 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:33.348466 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:33.348615 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":52328,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":2065,"thread_start_us":638115,"threads_started":1}
I20260709 13:04:33.370160 13200 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:33.292958 16423 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:33.331444 16410 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:33.362362 12587 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:33.346328 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:33.324748 16449 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:33.330703 16440 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:04:33.350276 16413 consensus_meta.cc:287] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.677s	user 0.011s	sys 0.000s
I20260709 13:04:33.334781 16411 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:33.351368 12613 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
W20260709 13:04:33.381151 16461 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 13:04:33.286247 15980 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.354661 16419 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:04:33.375809 16170 consensus_meta.cc:287] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.838s	user 0.010s	sys 0.002s
I20260709 13:04:33.386466 16409 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:04:33.404599 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:33.460769 16170 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.461771 12545 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:33.405192 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:33.463155 16170 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:33.463148 12542 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:33.385954 16330 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:33.464639 16330 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:33.467662 16330 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:33.393536 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:33.455979 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 93697.3us
I20260709 13:04:33.378489 13199 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:33.469949 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 148195us
I20260709 13:04:33.470815 12588 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:33.471444 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 127441us
I20260709 13:04:33.472769 12662 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:33.474783 13230 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:33.475523 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:33.476480 12542 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:33.486295 12542 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:33.460152 16419 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:33.494189 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:33.495388 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 116975us
I20260709 13:04:33.495663 13200 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:33.354367 16313 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 13:04:33.496922 13200 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:33.504909 12587 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:33.458554 16411 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.505959 16419 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.524266 12587 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:33.396977 16449 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.472016 15981 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:33.389073 16225 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.109s
I20260709 13:04:33.474606 16015 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:33.498579 16305 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:33.474889 16440 raft_consensus.cc:697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:33.399322 16315 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.119s
I20260709 13:04:33.507874 16372 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:33.515503 13199 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:33.493538 16436 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:33.487972 16413 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:33.501014 16297 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:33.506716 16411 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:33.393582 16241 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.528052 16449 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:33.557055 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 44427.3us
I20260709 13:04:33.578873 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:33.574283 12513 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:33.521634 16457 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.527295 16347 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:33.570356 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 54989.7us
I20260709 13:04:33.529093 16323 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.531793 15620 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:33.556290 15981 raft_consensus.cc:697] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:33.526401 16351 consensus_queue.cc:237] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:33.509096 16420 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:04:33.580920 12513 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:33.588294 13199 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:33.531080 16448 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:04:33.589807 16457 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.667583 16423 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:33.668462 16457 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:33.668099 15981 consensus_queue.cc:237] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.567045 16372 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.669526 16372 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.670681 16268 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:33.671638 16440 consensus_queue.cc:237] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.596405 16413 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:33.557554 16469 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.568398 16304 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:33.677894 16304 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:33.678267 16079 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:33.612005 16096 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:33.679646 16439 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:33.680166 16439 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.612923 16362 raft_consensus.cc:3055] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:33.681766 16362 raft_consensus.cc:740] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:33.682579 16441 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:33.683703 16372 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.615272 15980 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:33.686980 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:33.687578 12542 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.687673 16252 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:04:33.616264 16467 log.cc:927] Time spent T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:04:33.689523 16469 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:33.689879 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:33.690189 16117 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:33.629510 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:33.630942 16241 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:33.631381 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 891) took 1314 ms. Trace:
I20260709 13:04:33.691664 12695 rpcz_store.cc:276] 0709 13:04:32.316893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.748241 (+431348us) service_pool.cc:224] Handling call
0709 13:04:32.748622 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:33.039783 (+291161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:33.631025 (+591242us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54002c8b54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:33.631298 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":667886848}
I20260709 13:04:33.692245 16372 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:04:33.697024 16237 consensus_meta.cc:287] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.001s
I20260709 13:04:33.642379 15620 raft_consensus.cc:697] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:33.699033 15620 consensus_queue.cc:237] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.639412 16323 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.636868 15909 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:33.508833 16208 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 13:04:33.644052 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:33.647898 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:33.571269 16302 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:33.651949 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 71116.5us
I20260709 13:04:33.528659 16454 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
W20260709 13:04:33.659220 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 71006.2us
I20260709 13:04:33.678347 16304 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:33.640002 16305 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:33.690933 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:33.705448 16015 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:33.705814 16323 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:33.708011 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:33.639931 16347 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:33.739013 12543 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
W20260709 13:04:33.714553 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 326075us
I20260709 13:04:33.718381 12513 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:33.641005 16459 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:33.719512 13231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "588a15c12a6c46ab9373c48890191400"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:04:33.752853 13231 raft_consensus.cc:606] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:04:33.753311 13231 raft_consensus.cc:614] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:33.607124 15992 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:33.726095 12542 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:33.727214 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:33.584160 16470 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:33.727804 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:33.730088 12689 raft_consensus.cc:1240] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5. Ops: []
I20260709 13:04:33.761480 12619 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.761343 12546 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.733942 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:33.736121 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:33.687583 16446 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:33.583613 16436 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.748268 13199 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:33.772130 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:33.730911 16126 consensus_meta.cc:287] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.000s
I20260709 13:04:33.773309 12659 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:33.727003 16413 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.706712 16297 raft_consensus.cc:3055] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:33.779656 12659 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:33.682608 16362 consensus_queue.cc:260] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:33.766116 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 241948us
I20260709 13:04:33.803542 12587 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:33.708662 16237 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.731660 16305 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:33.780948 12659 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:33.769431 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 190656us
I20260709 13:04:33.761065 16292 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:33.805478 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:33.815300 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:33.816391 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:33.817920 12546 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
W20260709 13:04:33.765574 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 292843us
I20260709 13:04:33.761657 16459 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:33.817814 12588 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:33.805428 12587 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:33.819762 12662 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:33.771966 16323 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:33.824186 16323 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:33.825766 16439 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:33.826817 16323 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:33.827594 15909 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:33.763794 16233 consensus_queue.cc:1059] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:04:33.828367 16454 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:33.828994 16454 raft_consensus.cc:697] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:33.811316 16208 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:33.830014 16454 consensus_queue.cc:237] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.831419 16450 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:33.822201 12622 raft_consensus.cc:2393] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 8: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:33.834391 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:33.835937 16305 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:33.780365 16126 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.776754 15980 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:33.843138 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:33.835589 16411 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.845966 12619 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:33.849781 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:33.850365 12688 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:04:33.850492 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:33.770059 16115 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:04:33.801165 16398 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:33.798338 15992 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:33.853289 12588 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:33.854470 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:33.862340 12622 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:04:33.853642 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:33.836751 16459 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:33.894522 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:33.855031 16323 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:33.806773 16409 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:33.836709 16237 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:33.830014 16208 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:33.878098 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:33.888957 12696 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:04:33.852313 12687 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:33.778561 16297 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:33.877523 16334 raft_consensus.cc:3055] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:33.821012 16457 consensus_queue.cc:1059] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:04:33.893224 16126 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:33.885143 16439 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:33.838274 16362 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.771718 16446 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.838115 15707 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:33.897819 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:04:33.899298 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 46081.9us
I20260709 13:04:33.803090 15735 consensus_queue.cc:1059] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
W20260709 13:04:33.878970 16447 consensus_meta.cc:287] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.766s	user 0.008s	sys 0.003s
I20260709 13:04:33.906801 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:33.911193 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 57665us
I20260709 13:04:33.808032 16413 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.831162 16410 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.936192 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:33.887108 16115 consensus_queue.cc:1243] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:04:33.936866 12620 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:33.885949 16292 raft_consensus.cc:697] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:33.891445 15909 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:33.942355 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 119302us
I20260709 13:04:33.910565 16208 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.889328 15992 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:33.934335 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:33.950433 12619 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:33.951507 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:33.953058 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:33.934796 12588 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:33.931543 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:33.902848 16369 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.907516 16450 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:33.901829 16409 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:33.959100 12540 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:33.927479 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:33.910300 16334 raft_consensus.cc:740] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:33.947746 12512 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:33.954162 12622 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:33.979976 12613 raft_consensus.cc:2393] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 8: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:33.895879 16398 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.929636 16305 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:33.931510 16423 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:04:33.978643 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 45571.6us
I20260709 13:04:33.906567 16323 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:33.991035 12662 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:33.941284 16330 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:33.957695 16448 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:33.939110 16475 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:33.992543 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 57841.7us
I20260709 13:04:33.955183 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:33.986086 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 149871us
I20260709 13:04:33.957195 15992 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:33.977420 16409 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:33.940213 16447 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:33.986663 15707 raft_consensus.cc:697] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:04:34.104893 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 113992us
I20260709 13:04:34.106779 12540 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:34.101890 12622 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:33.984418 16460 raft_consensus.cc:3055] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:34.110167 12622 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:34.130129 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:34.130909 12693 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:34.127465 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:34.005295 16420 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:33.977393 16369 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:34.193490 16485 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:04:34.198005 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:34.202966 16410 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:34.003950 16423 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:34.131918 15735 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:34.105880 16436 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:34.227110 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:34.221268 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 273619us
I20260709 13:04:34.022035 16330 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:34.126356 16460 raft_consensus.cc:740] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:34.139712 16334 consensus_queue.cc:260] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:34.239986 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:34.252210 16460 consensus_queue.cc:260] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:34.254160 16460 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:34.254359 16484 log.cc:927] Time spent T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:04:34.254698 16413 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:34.255273 16413 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.255789 16413 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:34.256494 16449 consensus_meta.cc:287] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.618s	user 0.007s	sys 0.000s
I20260709 13:04:34.258328 15707 consensus_queue.cc:237] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:34.264451 16413 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:34.271257 16446 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:34.271922 16446 consensus_queue.cc:1175] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7ad68e814a7741488971822f2598183a" responder_term: 9 status { last_received { term: 9 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 9 index: 9 } }
I20260709 13:04:34.273316 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:34.274997 16330 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:34.209065 15909 consensus_queue.cc:1059] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 13:04:34.264941 12696 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 882) took 2311 ms (client timeout 1646 ms). Trace:
I20260709 13:04:34.280746 12620 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:34.265779 16455 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:04:34.285481 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 186491us
W20260709 13:04:34.282320 12696 rpcz_store.cc:269] 0709 13:04:31.953424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:31.960231 (+  6807us) service_pool.cc:224] Handling call
0709 13:04:34.264711 (+2304480us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b540009c254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:34.264857 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4117399936}
I20260709 13:04:34.136232 16292 consensus_queue.cc:237] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:34.236601 16411 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:34.256991 16449 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:34.278714 16499 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:34.281951 16305 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.282099 16351 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:34.311837 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 384916us
W20260709 13:04:34.317744 16488 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:04:34.318643 12616 raft_consensus.cc:2393] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 8: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:34.321270 16423 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:34.303831 16334 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:34.325006 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:34.325784 12617 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:34.337236 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:34.341109 13230 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:04:34.342975 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:34.308787 16241 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:34.349897 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:34.350960 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:34.351106 16241 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:34.351630 13231 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:34.352481 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:34.353147 13232 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
W20260709 13:04:34.349542 16304 consensus_meta.cc:287] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.618s	user 0.007s	sys 0.004s
I20260709 13:04:34.354300 16304 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:34.306511 15992 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:34.355651 16459 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:34.358386 12694 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:34.355683 16241 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:34.359724 12614 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:34.360225 16447 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:34.335711 16293 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.362138 16293 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:34.364682 16293 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:34.307299 16455 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:34.368748 16455 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:34.370919 16449 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:34.372318 16323 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:34.322137 16398 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:34.375655 16208 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:34.378953 12613 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:34.385068 16459 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:34.385238 16304 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:34.334139 16419 consensus_meta.cc:287] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.802s	user 0.012s	sys 0.000s
I20260709 13:04:34.389940 16419 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:34.391039 12615 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:34.392068 16419 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:34.323151 16305 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:34.395515 16305 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:34.395844 12692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 889) took 2194 ms. Trace:
I20260709 13:04:34.396289 16459 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:34.397073 16459 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:34.399209 16459 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:34.400688 16475 raft_consensus.cc:3055] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:34.401108 16475 raft_consensus.cc:740] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:34.396214 12692 rpcz_store.cc:276] 0709 13:04:32.201842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:32.647888 (+446046us) service_pool.cc:224] Handling call
0709 13:04:32.648284 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:32.657046 (+  8762us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:32.657095 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:33.636765 (+979670us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b2c00103488. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:04:33.637210 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:04:33.913256 (+276046us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:33.913300 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:33.913380 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:34.395548 (+482168us) raft_consensus.cc:1685] finished
0709 13:04:34.395570 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:34.395788 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3208,"raft.queue_time_us":161,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7626,"spinlock_wait_cycles":12260224,"thread_start_us":275627,"threads_started":1,"wal-append.queue_time_us":367352}
I20260709 13:04:34.401907 16475 consensus_queue.cc:260] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:34.403158 15992 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:34.404579 16475 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:34.331194 16351 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:34.411767 16369 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:34.412930 16351 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:34.414877 12620 raft_consensus.cc:2393] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 9: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:34.420619 16126 raft_consensus.cc:3055] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:34.421082 16126 raft_consensus.cc:740] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:34.421932 16126 consensus_queue.cc:260] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:34.422957 16126 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:34.423034 16208 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:34.424820 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:34.425894 13197 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:34.457888 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:34.437847 16449 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:34.460567 16495 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:34.460688 16449 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:34.461180 16495 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:34.463183 16495 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:34.463523 16449 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:34.468703 13197 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:34.470158 15980 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:34.470916 15980 raft_consensus.cc:697] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:34.471992 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:34.471889 15980 consensus_queue.cc:237] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:34.472440 15834 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:34.472738 13231 raft_consensus.cc:2393] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 11: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:34.473018 15834 raft_consensus.cc:697] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:34.473740 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:34.474967 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:34.475142 16225 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:34.475677 16436 raft_consensus.cc:993] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:04:34.476305 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:34.476907 13233 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:34.476948 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:34.475590 13227 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:34.475463 15834 consensus_queue.cc:237] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:34.484965 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:34.488433 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:34.489029 16436 raft_consensus.cc:1081] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:04:34.437968 16443 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.491164 16448 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:34.501998 13234 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:34.508611 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:34.509513 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:34.510423 12617 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:34.510597 13233 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:34.511411 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:34.513473 12617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:60170
I20260709 13:04:34.513967 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:34.511780 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:34.515491 12618 raft_consensus.cc:2393] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 10: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:34.512225 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:34.516162 13226 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:34.518824 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:34.521064 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:34.524482 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:34.525946 13235 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:34.526883 12617 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:34.527655 12617 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:34.528116 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:34.529919 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:34.531165 12588 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:34.532418 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:34.517508 16480 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:34.519724 16449 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:34.534709 16480 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.534761 16449 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.535207 16480 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:34.535259 16449 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:34.537801 16015 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:34.538241 16015 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.538616 16015 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:34.541734 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:34.542874 16449 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:34.545045 16449 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:34.549940 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:34.529064 13232 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 10: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:34.513293 16448 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:34.552311 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:34.582262 13233 raft_consensus.cc:2410] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:04:34.517916 16436 consensus_queue.cc:1059] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:04:34.590194 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:34.513851 16362 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:04:34.559921 13226 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:04:34.589190 12617 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:34.560672 13227 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:34.564559 13199 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:34.565541 12587 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:34.568665 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:34.553479 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:34.514303 16443 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:34.582247 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1531) took 1423 ms. Trace:
I20260709 13:04:34.582105 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:34.552661 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:34.590478 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:34.601922 12689 rpcz_store.cc:276] 0709 13:04:33.158434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.244587 (+ 86153us) service_pool.cc:224] Handling call
0709 13:04:33.244891 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:33.763976 (+519085us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.571063 (+807087us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b5400240254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:34.582187 (+ 11124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1115396480}
I20260709 13:04:34.557785 16409 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:34.592374 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:34.596017 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:34.612769 13234 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:34.601943 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:34.596154 12616 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:34.577960 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:34.597353 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:34.597913 12587 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:34.605360 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:34.606288 12692 pending_rounds.cc:85] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 11
I20260709 13:04:34.617311 12688 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:34.612236 12687 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:04:34.617406 12692 pending_rounds.cc:107] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:04:34.617982 12692 raft_consensus.cc:2889] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:34.606312 12689 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:34.618084 13228 raft_consensus.cc:2393] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 9: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:04:34.622321 12510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.017s	sys 0.004s
W20260709 13:04:34.622735 12510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.017s	sys 0.004s
I20260709 13:04:34.624629 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:34.625855 12662 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:34.626139 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:34.626597 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:34.626971 12616 raft_consensus.cc:2368] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 7. Current term is 8.
I20260709 13:04:34.627583 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:34.627897 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:34.629827 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:34.631407 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:34.623517 12513 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:34.565953 16423 consensus_queue.cc:1059] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:04:34.610965 16372 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:34.662546 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:34.661821 12513 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:34.592870 16469 consensus_queue.cc:1059] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:04:34.663481 12695 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:34.675453 12513 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:34.677296 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:34.680770 13234 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:34.682422 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:34.661900 12618 raft_consensus.cc:2376] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10. Re-sending same reply.
I20260709 13:04:34.620419 16305 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:34.664100 12696 raft_consensus.cc:1240] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:34.664539 12659 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:34.665191 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:34.664737 12542 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:34.664387 16079 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:34.665802 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:34.664572 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:34.667394 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:34.667798 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:34.663462 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:34.669760 12662 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:34.593768 16302 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:04:34.672049 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:34.611631 16411 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:34.615454 16449 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:34.679543 12546 raft_consensus.cc:2955] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 3 to 6, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:34.761055 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:34.663903 16510 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:34.767830 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:34.768606 12539 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:34.764482 12540 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:34.769935 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:34.763942 12687 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:04:34.706619 12542 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
W20260709 13:04:34.739446 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 48768.2us
I20260709 13:04:34.671751 16351 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:34.675773 16454 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.000s	sys 0.022s
I20260709 13:04:34.692504 12690 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:34.762931 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:04:34.777145 13235 raft_consensus.cc:606] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:04:34.768000 16436 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:34.782382 16436 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:34.784461 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:34.785926 16440 raft_consensus.cc:3055] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:34.786339 16440 raft_consensus.cc:740] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:34.786695 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:34.787194 16440 consensus_queue.cc:260] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:34.788268 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:34.789018 16420 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:34.789577 16420 raft_consensus.cc:697] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:34.790257 12696 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:34.789916 16305 consensus_queue.cc:1059] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:34.790448 16420 consensus_queue.cc:237] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:34.791213 16305 raft_consensus.cc:3055] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:34.791327 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:34.791838 16305 raft_consensus.cc:740] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:34.792097 12696 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
W20260709 13:04:34.792420 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 122709us
I20260709 13:04:34.793779 16350 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:34.794811 16096 consensus_queue.cc:1059] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:34.765424 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:34.796635 12539 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:34.785274 12544 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:34.801180 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:34.766883 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:34.772863 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 108374us
W20260709 13:04:34.682689 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 453747us
I20260709 13:04:34.660980 16334 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.774474 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:04:34.775413 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 93066.5us
W20260709 13:04:34.814203 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:34.773859 12510 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:34.788430 16440 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:34.793169 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:34.668236 16233 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:34.803198 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
W20260709 13:04:34.806314 16454 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.009s	sys 0.029s
I20260709 13:04:34.802448 12690 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:34.842375 12614 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:34.763358 12693 raft_consensus.cc:2393] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 9: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:34.816620 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:34.844643 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:34.812041 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:34.821018 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:34.785248 16436 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:34.774120 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:34.828722 12618 raft_consensus.cc:3055] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:34.856325 12618 raft_consensus.cc:740] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:04:34.856966 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 83191.6us
I20260709 13:04:34.691639 16459 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:34.853771 12540 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:34.796205 15707 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:34.871904 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1813) took 1054 ms. Trace:
I20260709 13:04:34.859064 12510 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:34.855707 13199 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:34.872327 12613 rpcz_store.cc:276] 0709 13:04:33.817002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.993529 (+176527us) service_pool.cc:224] Handling call
0709 13:04:34.073695 (+ 80166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:34.379386 (+305691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:34.871660 (+492274us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b54002a7bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:34.871844 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":701329792}
W20260709 13:04:34.865443 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 62358.2us
I20260709 13:04:34.873174 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:34.873816 12538 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:34.873610 12512 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:34.693043 16500 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:34.857210 12618 consensus_queue.cc:260] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:34.897403 12618 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:34.902736 12544 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 5.
I20260709 13:04:34.825273 16350 raft_consensus.cc:3055] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:04:34.905495 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:34.915354 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:34.772917 16411 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:34.773036 16079 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:34.925530 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 76175.7us
I20260709 13:04:34.793041 16305 consensus_queue.cc:260] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:34.825093 16233 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:34.931118 12543 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:34.932703 16313 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:04:34.892676 16468 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:04:34.894951 16292 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:04:34.941798 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 68308.9us
I20260709 13:04:34.821966 16334 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:34.895166 15707 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:34.960134 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 101177us
I20260709 13:04:34.935527 12538 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 10. Current term is 11. Ops: [9.8-10.9]
I20260709 13:04:34.775507 16510 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:34.914083 16475 consensus_queue.cc:1059] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.140s
I20260709 13:04:35.147496 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:34.981261 12689 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:04:35.035975 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:35.150859 12614 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:34.930251 16241 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:35.145740 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:35.150895 12510 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:34.941768 12539 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:04:35.159941 12540 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:34.979748 12613 raft_consensus.cc:1275] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:04:34.917750 16350 raft_consensus.cc:740] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:34.925452 16500 raft_consensus.cc:697] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:04:35.098156 16523 log.cc:927] Time spent T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:04:35.166064 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:35.166491 12543 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:04:35.111845 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:35.171036 12696 raft_consensus.cc:2393] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 5: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:35.089984 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:35.171813 12620 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:34.968779 16398 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:34.976841 16233 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:35.174403 12547 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:35.055099 16305 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:34.933552 16079 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:35.079061 16499 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:35.188052 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:34.959548 16459 raft_consensus.cc:697] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:35.159247 16292 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.151619 15707 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:35.195458 12688 raft_consensus.cc:2393] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 9: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:35.054452 16323 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:35.050750 16513 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:35.158592 16241 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:35.194830 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:35.092813 16409 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:34.969527 16436 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.221s
I20260709 13:04:35.100332 16443 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:34.978955 16313 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.205542 12539 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:35.215013 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:35.227130 16512 log.cc:927] Time spent T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 13:04:35.229928 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:35.304157 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:35.235097 16455 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:04:35.246868 16521 log.cc:927] Time spent T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:04:35.247748 16297 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.207870 16292 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:35.254544 16304 raft_consensus.cc:3055] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:35.256839 16500 consensus_queue.cc:237] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.259358 16334 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:35.260416 16459 consensus_queue.cc:237] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:35.266440 16015 consensus_meta.cc:287] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.727s	user 0.010s	sys 0.002s
I20260709 13:04:35.326740 16366 raft_consensus.cc:3055] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:35.327219 16366 raft_consensus.cc:740] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:35.327059 16015 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.268008 16510 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:35.301937 16350 consensus_queue.cc:260] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.329694 16297 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:35.268615 16411 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:35.273324 16480 consensus_meta.cc:287] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.737s	user 0.010s	sys 0.001s
I20260709 13:04:35.330588 16480 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.332683 16480 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:35.312847 16455 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.336016 16455 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:35.338268 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 187456us
I20260709 13:04:35.340633 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:35.346199 12510 leader_election.cc:400] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 7. Current term is 8.
W20260709 13:04:35.347638 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.348033 12510 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:35.349133 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:35.349829 12692 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:35.347662 12587 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:35.355183 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:35.285493 12547 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:04:35.288965 12618 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:04:35.358282 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:35.286872 16513 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.290795 16241 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:35.305382 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:35.297926 16448 consensus_meta.cc:287] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.704s	user 0.010s	sys 0.001s
I20260709 13:04:35.286521 16398 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:04:35.306380 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 380730us
I20260709 13:04:35.290421 16323 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.323958 12614 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:35.317902 16304 raft_consensus.cc:740] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:35.340022 16499 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:35.365657 13199 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:35.356647 16510 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:35.365099 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1661) took 1237 ms. Trace:
I20260709 13:04:35.375227 12694 rpcz_store.cc:276] 0709 13:04:34.127308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.129326 (+  2018us) service_pool.cc:224] Handling call
0709 13:04:34.129657 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:34.358810 (+229153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:35.364909 (+1006099us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b540009c754. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:35.365049 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525552512}
I20260709 13:04:35.376956 12692 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:35.353013 16455 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:35.379853 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:35.360517 16513 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:35.364271 16334 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:35.370379 13199 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:35.363330 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:35.329392 16015 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:35.382987 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.360812 16480 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:04:35.390563 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.383915 12587 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:35.393435 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.399704 12659 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:35.358570 16419 consensus_queue.cc:1059] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:04:35.395093 12692 pending_rounds.cc:85] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 7
I20260709 13:04:35.373824 16043 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:35.393532 13200 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:35.329382 16366 consensus_queue.cc:260] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:35.406077 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.378614 16398 raft_consensus.cc:697] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:35.403559 12692 pending_rounds.cc:107] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:04:35.373169 16499 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.402293 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:35.405184 12659 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:35.410250 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 47004.2us
I20260709 13:04:35.411888 16096 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:35.415509 16115 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:35.364893 16448 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.368685 16498 consensus_queue.cc:1059] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:04:35.418239 12692 raft_consensus.cc:2889] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:35.401643 16537 raft_consensus.cc:2764] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:04:35.408769 16475 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:35.405913 16015 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:04:35.423839 16440 consensus_meta.cc:287] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.603s	user 0.002s	sys 0.009s
I20260709 13:04:35.428086 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:35.420076 16419 raft_consensus.cc:3055] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:04:35.436832 16507 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.003s	sys 0.011s
I20260709 13:04:35.404105 15992 consensus_queue.cc:1048] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:04:35.420869 16334 raft_consensus.cc:697] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:35.425263 16510 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:35.446020 12621 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:35.429093 16400 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:35.428002 16096 consensus_queue.cc:1243] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer a11816c5d72e4d1295a242f3ced09e5f log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:04:35.440155 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:35.444506 16538 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.444746 16455 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:35.510475 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:35.510838 16400 raft_consensus.cc:697] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:35.510941 16455 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.511698 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:35.511906 16400 consensus_queue.cc:237] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.512835 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:35.513173 16455 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:35.514463 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:35.518863 16448 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:35.447175 16536 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:35.447961 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:35.521431 12620 pending_rounds.cc:85] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 5
I20260709 13:04:35.521768 12543 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:35.522112 12620 pending_rounds.cc:107] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:04:35.448081 16419 raft_consensus.cc:740] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:35.448190 16015 raft_consensus.cc:697] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:35.452873 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:35.453853 16491 log.cc:927] Time spent T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 1.328s	user 0.007s	sys 0.000s
I20260709 13:04:35.526590 12694 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 9: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:35.455022 16241 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.459318 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:35.461241 16509 log.cc:927] Time spent T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.792s	user 0.002s	sys 0.000s
I20260709 13:04:35.463094 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:35.430160 16115 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:35.449199 12512 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:35.398252 16304 consensus_queue.cc:260] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.537832 16043 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:35.538203 16304 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:35.539798 16241 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:35.441084 16475 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.541904 16475 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:35.542224 16015 consensus_queue.cc:237] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.546106 16510 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:04:35.448580 16530 log.cc:927] Time spent T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:04:35.503679 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:35.504822 16323 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:35.506619 16499 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:35.507133 16538 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:35.478971 16529 log.cc:927] Time spent T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.151s	user 0.001s	sys 0.001s
I20260709 13:04:35.509781 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:35.554185 12543 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 6.
I20260709 13:04:35.522578 12620 raft_consensus.cc:2889] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:35.532660 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 83548.3us
I20260709 13:04:35.536010 16115 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:35.535673 16419 consensus_queue.cc:260] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:35.558435 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:35.555724 12512 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:35.559156 12541 raft_consensus.cc:2393] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 8: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:35.559902 12512 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:35.555570 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:35.555028 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:35.563946 12512 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:35.564281 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:35.564769 12544 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:35.565207 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:35.555150 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 161711us
I20260709 13:04:35.567989 12512 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:35.570518 12541 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:04:35.574149 12541 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9. Ops: [6.5-8.6]
I20260709 13:04:35.568822 13200 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:35.606534 13200 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:04:35.614540 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 46642.1us
I20260709 13:04:35.615964 12512 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:35.617372 16510 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:35.557099 16539 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.563009 16499 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:35.550902 16513 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:35.623680 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 239820us
W20260709 13:04:35.647665 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.641201 12544 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:35.564165 16323 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:04:35.620949 16541 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:35.569380 16455 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:35.649778 12544 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:04:35.651499 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:35.651799 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 45398.7us
I20260709 13:04:35.666067 13200 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:35.644238 16529 log.cc:927] Time spent T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:04:35.625768 15834 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:35.672492 12544 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:04:35.526355 16398 consensus_queue.cc:237] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:35.669907 12538 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:04:35.552186 16334 consensus_queue.cc:237] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:35.619040 16419 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:35.673738 12541 raft_consensus.cc:1240] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:04:35.651302 16297 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.530367 16536 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.694264 12544 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:35.647670 16510 consensus_queue.cc:1059] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:04:35.704702 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2842) took 1026 ms. Trace:
I20260709 13:04:35.644909 16539 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.705133 12546 rpcz_store.cc:276] 0709 13:04:34.678646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.678760 (+   114us) service_pool.cc:224] Handling call
0709 13:04:34.679075 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:34.679426 (+   351us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:34.806004 (+126578us) log.cc:844] Serialized 14 byte log entry
0709 13:04:35.074227 (+268223us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:35.074842 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 13:04:35.074981 (+   139us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:35.075021 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:35.075269 (+   248us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:35.704474 (+629205us) raft_consensus.cc:1685] finished
0709 13:04:35.704495 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:35.704627 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126204,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":49179,"thread_start_us":213470,"threads_started":1,"wal-append.queue_time_us":402127}
I20260709 13:04:35.663082 16535 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:35.707597 12539 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:35.700127 16293 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:35.675107 16292 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.722093 12544 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:35.683976 15707 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:35.683792 16233 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:35.728534 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:35.761199 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.762703 12588 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:35.731003 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:35.763851 12693 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:35.731382 12543 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:04:35.731736 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:35.765893 13226 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:35.732311 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 913) took 1123 ms. Trace:
I20260709 13:04:35.766786 12695 rpcz_store.cc:276] 0709 13:04:34.609264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.609390 (+   126us) service_pool.cc:224] Handling call
0709 13:04:34.620432 (+ 11042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:34.673910 (+ 53478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:35.732092 (+1058182us) spinlock_profiling.cc:243] Waited 42.8 ms on lock 0x7b54000c7bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:35.732254 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98548480}
I20260709 13:04:35.732403 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:35.768793 13235 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:35.784485 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.700548 16297 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.711926 15834 raft_consensus.cc:697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:04:35.867789 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 105155us
I20260709 13:04:35.873502 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2843) took 1052 ms. Trace:
I20260709 13:04:35.874447 12690 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:04:35.862085 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 102951us
I20260709 13:04:35.719835 16535 raft_consensus.cc:697] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:35.878216 12547 rpcz_store.cc:276] 0709 13:04:34.679212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.679315 (+   103us) service_pool.cc:224] Handling call
0709 13:04:35.730932 (+1051617us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54000a5fd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:35.731051 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":928318208}
I20260709 13:04:35.878504 12588 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:35.879874 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:35.884477 12588 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:35.886691 13226 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:35.882555 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:35.887897 12695 raft_consensus.cc:2368] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 10.
I20260709 13:04:35.889467 12695 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:35.893519 12540 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:35.896337 12588 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:35.892560 16548 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:35.913616 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:35.880403 16457 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.877660 16305 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:35.880578 16510 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:35.922181 12547 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:04:35.927815 16545 log.cc:927] Time spent T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
W20260709 13:04:35.929185 16552 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
I20260709 13:04:35.940212 16304 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:35.943815 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 909) took 1339 ms. Trace:
I20260709 13:04:35.944217 12691 rpcz_store.cc:276] 0709 13:04:34.604243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.606674 (+  2431us) service_pool.cc:224] Handling call
0709 13:04:34.607047 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:34.607289 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:34.607327 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:35.456003 (+848676us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b2c00103488. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:04:35.456474 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 13:04:35.561324 (+104850us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:35.561361 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:35.562582 (+  1221us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:35.943558 (+380976us) raft_consensus.cc:1685] finished
0709 13:04:35.943575 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:35.943759 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12013952,"thread_start_us":104511,"threads_started":1,"wal-append.queue_time_us":217666}
I20260709 13:04:35.930222 16458 raft_consensus.cc:3055] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:35.947860 16458 raft_consensus.cc:740] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:04:35.948185 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.947561 16475 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:35.931314 16536 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:35.932755 16551 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.237s	user 0.000s	sys 0.000s
I20260709 13:04:35.932654 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:35.935469 16548 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:35.933172 16015 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:35.928113 16115 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.936152 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:35.880141 16534 consensus_queue.cc:1059] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:04:35.932937 16292 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:35.938951 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:35.902838 16420 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:04:35.942339 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 46054.6us
I20260709 13:04:35.940339 12693 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:35.929526 16459 raft_consensus.cc:3055] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:35.942042 16538 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:35.943944 16513 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:35.961272 16548 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.973505 16115 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:35.937621 16457 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.948801 16458 consensus_queue.cc:260] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.961817 16459 raft_consensus.cc:740] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:35.949550 16510 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.995808 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 683) took 1651 ms. Trace:
I20260709 13:04:35.961057 16015 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.996397 13230 rpcz_store.cc:276] 0709 13:04:34.344565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.344740 (+   175us) service_pool.cc:224] Handling call
0709 13:04:34.345013 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:34.386347 (+ 41334us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:34.672770 (+286423us) log.cc:844] Serialized 14 byte log entry
0709 13:04:35.097030 (+424260us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:35.097108 (+    78us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:35.097177 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:35.995545 (+898368us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b5400750dd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:35.995603 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:35.995742 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":303477,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":136752,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":93790464,"thread_start_us":709707,"threads_started":2,"wal-append.queue_time_us":501415}
W20260709 13:04:36.001053 16555 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
I20260709 13:04:36.003089 16548 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:35.961553 16535 consensus_queue.cc:237] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:36.004544 16458 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:36.014678 16475 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:36.015218 16510 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:36.013721 16558 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:04:36.016811 16457 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:36.011185 16459 consensus_queue.cc:260] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:36.018302 16459 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:36.051819 12434 maintenance_manager.cc:419] P 78966838052c4dd980a04a5b750887f1: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033349
I20260709 13:04:35.932018 12544 raft_consensus.cc:1275] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:35.935037 12543 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:35.943922 12547 raft_consensus.cc:3055] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:36.058236 12547 raft_consensus.cc:740] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:35.953694 15834 consensus_queue.cc:237] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:35.957998 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:36.081769 16297 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:36.083366 15707 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:36.060873 12547 consensus_queue.cc:260] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:36.085664 12547 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:36.087263 16015 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:36.098529 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:36.099820 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2856) took 1413 ms. Trace:
I20260709 13:04:36.100548 12542 rpcz_store.cc:276] 0709 13:04:34.686309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.844417 (+158108us) service_pool.cc:224] Handling call
0709 13:04:36.099258 (+1254841us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54000a64d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:36.099535 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2775461248}
I20260709 13:04:36.104470 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 794) took 2396 ms. Trace:
I20260709 13:04:36.105121 12545 rpcz_store.cc:276] 0709 13:04:33.707331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.708861 (+  1530us) service_pool.cc:224] Handling call
0709 13:04:33.709291 (+   430us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:34.424010 (+714719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:34.424043 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:34.424563 (+   520us) log.cc:844] Serialized 52 byte log entry
0709 13:04:34.812457 (+387894us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:34.862725 (+ 50268us) log.cc:844] Serialized 14 byte log entry
0709 13:04:35.314964 (+452239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.102912 (+787948us) spinlock_profiling.cc:243] Waited 714 ms on lock 0x7b54003be7d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:36.103034 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:36.103149 (+   115us) raft_consensus.cc:1685] finished
0709 13:04:36.103589 (+   440us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:36.104083 (+   494us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101762,"prepare.queue_time_us":49535,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":191047,"raft.run_cpu_time_us":258,"raft.run_wall_time_us":28456,"spinlock_wait_cycles":1642738432,"thread_start_us":742302,"threads_started":2,"wal-append.queue_time_us":743623}
W20260709 13:04:36.110119 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.123143 13197 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:36.125846 16015 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:36.126914 16542 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:36.127028 16015 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:36.125336 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 841) took 1616 ms. Trace:
I20260709 13:04:36.132275 16233 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:36.138010 15981 raft_consensus.cc:3055] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:36.138775 15981 raft_consensus.cc:740] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:04:36.135252 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.149327 16548 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:36.150377 16548 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:36.134317 12621 rpcz_store.cc:276] 0709 13:04:34.508570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.509809 (+  1239us) service_pool.cc:224] Handling call
0709 13:04:34.524816 (+ 15007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:35.501452 (+976636us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.124477 (+623025us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b54001e96d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:36.124987 (+   510us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2118145792}
I20260709 13:04:36.157871 16420 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:36.158783 16420 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:36.158341 16548 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:36.160912 16305 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.162022 16305 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:36.163112 16420 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:36.165166 16305 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:36.146016 16015 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:36.174293 15909 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:36.175621 15909 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:36.180480 16436 consensus_queue.cc:1059] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:36.180830 15909 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:36.182057 16419 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:36.182716 16015 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.183561 16117 raft_consensus.cc:3055] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:36.184280 16117 raft_consensus.cc:740] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:36.183635 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1541) took 1417 ms. Trace:
I20260709 13:04:36.182371 16436 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:36.181280 13199 leader_election.cc:400] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 10.
I20260709 13:04:36.186110 13199 leader_election.cc:403] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:04:36.190446 15620 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 10.
W20260709 13:04:36.069021 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 111220us
I20260709 13:04:36.191684 15620 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
W20260709 13:04:36.198349 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.202482 16117 consensus_queue.cc:260] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:36.207204 16117 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:36.211503 12547 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:04:36.185590 12689 rpcz_store.cc:276] 0709 13:04:34.766448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.766599 (+   151us) service_pool.cc:224] Handling call
0709 13:04:36.183162 (+1416563us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54001effd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:36.183400 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411828480}
I20260709 13:04:36.183652 16015 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:36.225235 12444 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36398 (request call id 354) took 30213 ms (client timeout 15000 ms). Trace:
I20260709 13:04:36.225235 16550 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.157251 16350 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:36.215101 12547 pending_rounds.cc:85] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 8
I20260709 13:04:36.232038 12621 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:36.211644 16541 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.230486 16550 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:36.240201 16541 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:36.242638 16550 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:36.243450 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:36.244454 12622 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:36.141129 15981 consensus_queue.cc:260] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:36.245620 12617 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:36.246562 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:60170 (request call id 843) took 1733 ms. Trace:
I20260709 13:04:36.247064 12617 rpcz_store.cc:276] 0709 13:04:34.512493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.513331 (+   838us) service_pool.cc:224] Handling call
0709 13:04:36.163989 (+1650658us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b54002a71d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9570a3d 00007fc3ae540cd0 00007fc3a7ac5254 00007fc3a7ac51e2 00007fc3a7ac5111 00007fc3a7ac508c 00007fc3a7ac4342 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:36.246150 (+ 82161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29259520}
I20260709 13:04:36.230175 12547 pending_rounds.cc:107] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:04:36.252741 12547 raft_consensus.cc:2889] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:36.251191 16541 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:36.274406 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:36.275418 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.276746 12619 raft_consensus.cc:1275] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:04:36.278790 12616 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:36.280623 12587 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:36.262300 15981 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:36.263854 16015 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:36.296473 12622 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:36.298987 16548 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:36.299710 16548 raft_consensus.cc:697] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:36.302646 16539 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:36.304611 16507 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:36.305537 16507 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:36.308710 16507 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:36.321913 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 53130.8us
I20260709 13:04:36.326345 13197 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:36.326614 16313 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:36.328061 16458 consensus_queue.cc:1059] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:36.332875 12588 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:36.334909 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2866) took 1644 ms. Trace:
I20260709 13:04:36.335333 12540 rpcz_store.cc:276] 0709 13:04:34.690419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.173055 (+482636us) service_pool.cc:224] Handling call
0709 13:04:35.195989 (+ 22934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:35.893936 (+697947us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.334396 (+440460us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b54000799d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:36.334690 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1603766656}
I20260709 13:04:36.336283 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:36.338775 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:36.339761 12545 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:36.340014 12539 raft_consensus.cc:1275] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:04:36.342371 16366 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:36.259536 16550 consensus_queue.cc:1059] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:04:36.301009 16548 consensus_queue.cc:237] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:36.352707 16372 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:36.363790 16419 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:36.353253 16372 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:36.369134 12545 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:36.366575 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:36.370922 16372 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:36.393225 16269 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.393951 16269 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:36.396930 16302 raft_consensus.cc:3055] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:36.397372 16302 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:36.398346 16302 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:36.399709 16302 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:36.402688 12587 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.195:34641 timed out after 2.051s (SENT) [suppressed 15 similar messages]
I20260709 13:04:36.407346 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:04:36.415972 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 45940.2us
I20260709 13:04:36.421149 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2861) took 1731 ms. Trace:
I20260709 13:04:36.421815 12538 rpcz_store.cc:276] 0709 13:04:34.689193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.158766 (+469573us) service_pool.cc:224] Handling call
0709 13:04:35.189340 (+ 30574us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:35.674734 (+485394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:36.420388 (+745654us) spinlock_profiling.cc:243] Waited 480 ms on lock 0x7b54002baa54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:36.420918 (+   530us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1104589056}
I20260709 13:04:36.426286 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:36.427421 12696 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:36.434448 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:36.435022 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:36.435585 13233 raft_consensus.cc:2393] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 8: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:36.435861 13227 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:36.368316 16436 raft_consensus.cc:3055] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:36.420929 16508 consensus_queue.cc:1048] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:36.437970 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:36.438838 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:36.436261 13226 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:36.470434 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:36.473649 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:36.486939 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 105118us
W20260709 13:04:36.487715 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 106021us
I20260709 13:04:36.440412 12662 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:36.389098 16419 raft_consensus.cc:697] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:04:36.495494 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 78430.3us
I20260709 13:04:36.496757 12547 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:36.442781 16233 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:36.437100 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:36.503334 16448 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:36.503423 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:36.503969 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:36.504696 12695 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:36.504954 12621 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:36.504495 16448 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:36.505705 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.500901 13230 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:36.507107 16233 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:36.509596 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:36.513902 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.514887 12513 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:36.516062 16455 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:36.518543 16305 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.519398 16305 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:36.519861 13227 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:36.523144 12690 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:04:36.442094 16079 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.529381 16305 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:36.529841 16079 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:36.534240 16419 consensus_queue.cc:237] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:36.530755 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:36.532361 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:36.539023 16079 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:36.539901 12696 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:36.498231 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:36.547616 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:36.548573 12614 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:36.542204 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:36.436977 16436 raft_consensus.cc:740] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:36.541188 12546 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:36.441730 16398 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:36.565809 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:36.567423 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:36.498684 16269 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:36.576885 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:36.582249 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:36.227367 12444 rpcz_store.cc:269] 0709 13:04:06.012002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:06.042299 (+ 30297us) service_pool.cc:224] Handling call
0709 13:04:36.224887 (+30182588us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:28.821648 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:29.143763 (+322115us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:29.156555 (+ 12792us) write_op.cc:435] Acquired schema lock
0709 13:04:29.168434 (+ 11879us) tablet.cc:662] Decoding operations
0709 13:04:29.319719 (+151285us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:29.319827 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:29.319870 (+    43us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:04:29.322132 (+  2262us) tablet.cc:701] Row locks acquired
0709 13:04:29.322191 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:04:29.322398 (+   207us) write_op.cc:270] Start()
0709 13:04:29.322604 (+   206us) write_op.cc:276] Timestamp: P: 1783602269322322 usec, L: 0
0709 13:04:29.322636 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:04:29.323582 (+   946us) log.cc:844] Serialized 8763 byte log entry
0709 13:04:29.725898 (+402316us) op_driver.cc:464] REPLICATION: finished
0709 13:04:30.119914 (+394016us) write_op.cc:301] APPLY: starting
0709 13:04:30.148134 (+ 28220us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:30.328864 (+180730us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:30.355261 (+ 26397us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:30.496435 (+141174us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:30.526706 (+ 30271us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 13:04:30.526753 (+    47us) write_op.cc:312] APPLY: finished
0709 13:04:30.527213 (+   460us) log.cc:844] Serialized 152 byte log entry
0709 13:04:30.527427 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:30.527606 (+   179us) write_op.cc:454] Released schema lock
0709 13:04:30.527678 (+    72us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:30.528071 (+   393us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:30.528102 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":61296,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":342664,"apply.run_cpu_time_us":6803,"apply.run_wall_time_us":428071,"num_ops":22,"prepare.queue_time_us":185811,"prepare.run_cpu_time_us":25897,"prepare.run_wall_time_us":630560,"raft.queue_time_us":128801,"raft.run_cpu_time_us":11215,"raft.run_wall_time_us":219559,"replication_time_us":380330,"thread_start_us":231364,"threads_started":4,"wal-append.queue_time_us":126764,"wal-append.run_cpu_time_us":25705,"wal-append.run_wall_time_us":2105284}]]}
I20260709 13:04:36.591478 12538 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:36.592459 12622 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:04:36.598727 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:36.594691 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:36.582693 16233 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:36.502892 16548 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:04:36.575616 16366 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:36.606257 12545 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:36.584833 16079 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.607396 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:36.620373 12622 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:36.633848 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:36.625190 12619 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:04:36.643101 12696 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:36.645156 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:36.647953 12546 raft_consensus.cc:1240] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:36.650185 12513 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:36.651218 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:36.651978 12613 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
W20260709 13:04:36.653349 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 213283us
I20260709 13:04:36.652810 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:36.649361 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:36.657272 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 46834.4us
I20260709 13:04:36.660540 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:36.609058 16398 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:36.661365 13226 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:36.668951 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:36.669260 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:36.671262 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:36.672672 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:36.675782 16079 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:36.677788 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:36.678659 12688 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:36.679100 16448 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:36.679637 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:36.689704 16372 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:36.692871 16372 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:36.693789 13233 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:36.694031 16366 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.694581 16366 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:36.696527 16366 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:36.697393 12662 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:36.699204 16351 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:36.701905 13230 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:04:36.703433 16510 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:36.704352 16510 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:36.704545 16436 consensus_queue.cc:260] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:36.707284 16510 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:36.707536 13227 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:36.701303 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:36.708516 12513 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:36.712846 12621 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
W20260709 13:04:36.712695 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 79227.3us
I20260709 13:04:36.704384 12614 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
W20260709 13:04:36.717603 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 50448.8us
I20260709 13:04:36.722579 16269 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:36.722415 16455 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:36.723135 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:36.724071 12694 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 8: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:36.732693 12513 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:36.734601 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:36.731487 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:36.717269 16448 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.720629 16398 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:36.757726 16398 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:36.759743 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 43933.3us
I20260709 13:04:36.763181 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:36.763548 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:36.765906 12688 raft_consensus.cc:1275] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:04:36.764228 12694 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:36.769024 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 67846.6us
I20260709 13:04:36.735390 16233 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:36.780901 12687 raft_consensus.cc:2393] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 12: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:36.785898 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:36.786288 16541 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:36.774967 16448 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:36.778298 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:36.739696 16510 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:36.761656 16436 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:36.759435 16548 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.794904 12694 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:04:36.793884 16043 consensus_queue.cc:1048] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
W20260709 13:04:36.800120 16568 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.505s	user 0.004s	sys 0.000s
I20260709 13:04:36.786821 16541 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:36.816501 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:36.818145 16459 consensus_meta.cc:287] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.799s	user 0.006s	sys 0.010s
I20260709 13:04:36.777223 16398 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:36.820021 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:36.781579 16233 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:36.781744 16334 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:36.822434 12694 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:36.803306 16448 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:36.808740 16541 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:36.822464 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:36.823117 13200 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:04:36.831825 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 429147us
W20260709 13:04:36.838151 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 73765us
I20260709 13:04:36.838680 13197 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:36.807156 16510 raft_consensus.cc:697] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:04:36.814507 16565 log.cc:927] Time spent T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:04:36.847549 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:36.821412 16419 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:36.836856 15981 consensus_meta.cc:287] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.521s	user 0.006s	sys 0.005s
I20260709 13:04:36.821040 16398 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:36.821998 16079 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:36.829401 16233 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:36.824664 16015 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:36.856032 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:36.786792 16535 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.116s
W20260709 13:04:36.859817 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:36.850100 16269 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:36.864132 13235 consensus_meta.cc:287] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 1.002s	user 0.017s	sys 0.002s
I20260709 13:04:36.864609 13235 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:36.865150 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 696) took 1134 ms. Trace:
I20260709 13:04:36.865470 13235 rpcz_store.cc:276] 0709 13:04:35.730542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.732144 (+  1602us) service_pool.cc:224] Handling call
0709 13:04:36.865064 (+1132920us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:36.867053 16252 raft_consensus.cc:3055] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:36.867517 16252 raft_consensus.cc:740] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:36.810806 16548 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:36.849844 16441 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:04:36.874243 13232 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:36.876350 12690 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:04:36.881943 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 78029.3us
I20260709 13:04:36.882820 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:36.883627 16269 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:36.884043 16269 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:36.884459 16269 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:36.884881 16510 consensus_queue.cc:237] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:36.860577 16508 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:36.893865 16508 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.894292 16508 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:36.892940 16269 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:36.899562 12613 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:36.900552 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:36.900807 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:36.901815 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:36.901938 12618 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:36.902622 13200 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:36.902902 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:36.903096 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:36.903807 13200 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:36.903923 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:36.904918 16535 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:36.905355 16535 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.905368 16269 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:36.905812 16539 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:36.904238 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:36.906211 16539 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.906599 16539 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:36.907155 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:36.909775 16550 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:36.910202 16550 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:36.910527 16550 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:36.914029 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:36.916534 16548 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:36.922996 16225 consensus_queue.cc:1059] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:36.924142 16225 raft_consensus.cc:3055] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:36.924507 16225 raft_consensus.cc:740] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:36.926381 12546 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:36.904951 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:36.908238 12618 raft_consensus.cc:2410] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:04:36.939944 12538 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:36.944990 16420 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:36.917136 16548 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:36.947800 12616 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:04:36.948210 12616 pending_rounds.cc:85] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 9
I20260709 13:04:36.951591 12616 pending_rounds.cc:107] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:04:36.951848 12616 raft_consensus.cc:2889] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:36.958405 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:36.905808 16535 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:36.850916 16334 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:36.954242 12587 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:36.976802 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:36.977417 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:36.977631 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:36.989756 16586 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:36.990224 12694 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:36.990522 16586 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:36.991487 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:36.992974 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:36.989910 16269 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:36.995072 12622 raft_consensus.cc:2410] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:04:36.996361 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:37.002740 12613 raft_consensus.cc:1275] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:04:37.006484 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:37.016292 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:37.030856 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:37.031711 12694 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:36.868490 16252 consensus_queue.cc:260] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.043558 12613 raft_consensus.cc:1240] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:37.005038 16533 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:36.958035 16015 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.040189 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:36.925468 16225 consensus_queue.cc:260] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.009140 16302 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:04:37.069046 16420 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:37.069950 16420 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:37.070731 16420 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:37.071422 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 134695us
I20260709 13:04:37.073027 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:37.046530 16533 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:37.044925 16586 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:37.040477 16269 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.091244 12690 raft_consensus.cc:1240] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:37.092094 12662 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:37.093403 16588 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:04:37.094336 16269 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:37.099633 16334 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:37.090229 16459 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:37.077131 16533 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:37.105685 16351 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:37.107023 16366 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.085843 16225 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:37.067261 16233 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:37.217240 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 270457us
W20260709 13:04:37.271013 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 179017us
W20260709 13:04:37.236006 16588 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:04:37.223305 16366 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.292770 12587 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:37.297148 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 252788us
I20260709 13:04:37.295756 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:37.271966 16351 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.228802 16508 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.305275 12587 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:37.241253 16459 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.309922 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:37.302732 16592 log.cc:927] Time spent T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:04:37.311225 16599 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:04:37.314944 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 320844us
I20260709 13:04:37.290334 16539 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.328423 12587 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:37.316570 16015 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:37.339725 16460 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:04:37.340407 16366 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:37.346112 16233 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:37.347312 16574 log.cc:927] Time spent T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.579s	user 0.000s	sys 0.003s
I20260709 13:04:37.333673 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:37.305259 16351 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.322445 16599 raft_consensus.cc:697] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:37.327051 16477 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:04:37.362161 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 67354.1us
I20260709 13:04:37.369942 16043 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:37.370595 16043 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.372741 16043 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:37.369985 16585 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:37.322970 16541 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.373714 16596 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.373852 16585 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:37.374244 16596 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.375392 16541 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:37.376494 16596 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:37.384303 16459 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:37.387725 16015 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:37.390084 16366 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:37.333987 16550 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.392863 16550 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:37.390724 16366 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:37.389894 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 63341.1us
I20260709 13:04:37.396306 12587 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:37.397063 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:37.405102 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:37.409271 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:37.411085 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:37.376582 16585 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:37.345299 16535 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.414978 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:37.420879 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:37.423525 12662 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:37.424441 16477 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:37.425213 16477 raft_consensus.cc:697] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:37.425812 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:37.426409 16477 consensus_queue.cc:237] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:37.428319 16351 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:37.431326 16366 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:37.417999 16596 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:37.433966 16596 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.434356 16596 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:37.387964 16599 consensus_queue.cc:237] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.457605 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 838) took 1736 ms. Trace:
I20260709 13:04:37.441154 16508 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:37.421519 13228 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
W20260709 13:04:37.459028 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:37.459986 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:37.403551 16459 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:37.458030 13232 rpcz_store.cc:276] 0709 13:04:35.721044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:35.721203 (+   159us) service_pool.cc:224] Handling call
0709 13:04:36.873867 (+1152664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.874803 (+   936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:37.457332 (+582529us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b5400630950. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:37.457483 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2289688320}
I20260709 13:04:37.476501 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:37.479001 13229 raft_consensus.cc:2368] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13.
I20260709 13:04:37.471127 16459 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:37.484555 13227 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
W20260709 13:04:37.489428 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 82601.6us
I20260709 13:04:37.466950 16455 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.494652 16305 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:37.496263 16597 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:37.496838 16597 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.497208 16597 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:37.497093 16548 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.498521 16548 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.501529 16548 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:37.466719 16541 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:37.519170 16541 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.469586 16398 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.547462 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:37.550426 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:37.552050 13200 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:37.554962 16419 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:37.555604 16419 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:37.558281 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 231386us
I20260709 13:04:37.521447 16541 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:37.560721 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 66449.9us
I20260709 13:04:37.522572 16539 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:37.572121 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 81270.7us
I20260709 13:04:37.578181 16233 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:37.589183 13199 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:37.524228 16420 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.568648 16117 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:37.523284 16455 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:37.592571 16302 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.601351 16605 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:37.601686 16302 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.602308 16605 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:37.592008 16590 log.cc:927] Time spent T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.310s	user 0.004s	sys 0.000s
W20260709 13:04:37.607795 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 141809us
I20260709 13:04:37.608634 12512 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:37.611393 15981 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:37.549589 16398 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:37.620477 12619 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:37.618140 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 192619us
I20260709 13:04:37.624398 12512 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:37.629336 12512 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:37.605542 16605 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:37.618788 16117 raft_consensus.cc:697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:37.647660 13233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1055) took 1145 ms. Trace:
I20260709 13:04:37.620234 16585 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:37.635684 16334 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:04:37.630393 16593 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:37.648228 13233 rpcz_store.cc:276] 0709 13:04:36.502293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:36.508151 (+  5858us) service_pool.cc:224] Handling call
0709 13:04:36.508506 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:36.694241 (+185735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:37.647333 (+953092us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54006cfcd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:37.647573 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":425601792}
I20260709 13:04:37.627413 16233 consensus_queue.cc:1048] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:04:37.671293 16170 consensus_queue.cc:1059] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:04:37.671681 16117 consensus_queue.cc:237] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.658432 16305 raft_consensus.cc:697] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:37.678831 16305 consensus_queue.cc:237] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.688392 16455 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:37.661932 16535 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:37.691087 16420 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:37.660583 16459 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:37.694917 16596 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:37.697167 16596 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:37.670154 16593 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:37.698870 16593 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.699205 16593 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:37.713945 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:37.714916 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:37.720270 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 448198us
I20260709 13:04:37.724313 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:37.725549 12694 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:37.726200 12659 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:37.726776 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:37.752189 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:37.753055 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:37.759184 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:37.759976 12696 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:37.748772 16533 consensus_meta.cc:287] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.522s	user 0.005s	sys 0.006s
I20260709 13:04:37.760810 12687 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:37.761377 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:37.761511 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:37.770582 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 141346us
I20260709 13:04:37.772857 12538 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:04:37.777415 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:37.778117 12545 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:37.750918 16507 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.754446 16269 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:37.754621 16334 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:37.758116 16455 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.786541 13233 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:37.789300 12545 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:37.766503 12513 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:37.802680 16233 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:37.804015 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:37.804864 12545 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:37.805774 12695 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:37.806857 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:37.819666 12688 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:04:37.820219 12688 pending_rounds.cc:85] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 8
I20260709 13:04:37.817359 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:37.826781 12539 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:37.828272 12688 pending_rounds.cc:107] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:04:37.828707 12688 raft_consensus.cc:2889] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:37.768040 16533 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.803889 16233 raft_consensus.cc:697] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:37.789951 16459 consensus_queue.cc:1059] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:04:37.791932 16507 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.803435 16455 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:37.801129 16334 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:37.856215 12687 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:37.858964 13200 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:37.869026 16252 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:37.871681 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 254579us
I20260709 13:04:37.869234 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:37.874297 16305 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.874598 12688 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:04:37.874883 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:37.854244 16596 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:37.876597 16611 log.cc:927] Time spent T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:04:37.877980 16612 log.cc:927] Time spent T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:04:37.879046 16126 raft_consensus.cc:3055] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:37.879489 16126 raft_consensus.cc:740] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:37.879703 16618 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:37.880318 16618 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:37.880507 16126 consensus_queue.cc:260] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.882508 16618 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:37.888468 16455 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:37.892843 16455 consensus_queue.cc:1059] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:37.890087 12445 catalog_manager.cc:5697] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: NON_VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: true } } }
I20260709 13:04:37.895347 12513 leader_election.cc:400] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13.
I20260709 13:04:37.894481 12445 catalog_manager.cc:5697] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 3 to 6, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 6 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:04:37.895778 12513 leader_election.cc:403] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:04:37.857625 16302 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:37.875818 16596 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:37.897919 16541 raft_consensus.cc:3055] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:37.898393 16541 raft_consensus.cc:740] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:37.898277 16233 consensus_queue.cc:237] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.899544 16596 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:37.873991 16533 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:37.899464 16541 consensus_queue.cc:260] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.893039 12510 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:37.900991 16541 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:37.901782 12510 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:37.902997 16585 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:37.903698 16585 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:37.903937 12510 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:37.905937 16398 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:37.906401 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 47542.6us
W20260709 13:04:37.907281 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:37.907882 16302 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:37.908468 16302 raft_consensus.cc:697] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:37.909447 16302 consensus_queue.cc:237] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.910331 16419 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.910919 16507 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:37.858518 16550 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:04:37.912791 16334 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:37.917696 12545 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:04:37.917819 12695 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:37.923089 12696 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:37.924867 12694 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:37.896574 12445 catalog_manager.cc:5697] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 4 to 5, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 5 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:37.924841 12539 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
W20260709 13:04:37.929703 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 276262us
I20260709 13:04:37.919416 16585 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:37.913117 16419 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:37.946146 12587 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:37.946895 13199 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:37.947043 12587 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:37.947913 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:37.948190 12587 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:37.948506 12696 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:37.948884 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:37.949028 12587 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:37.950356 16508 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:37.951515 16508 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:37.952788 16508 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:37.953775 16448 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:37.953926 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:37.954257 16448 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.954555 12687 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:37.954630 16448 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:37.955026 16508 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:37.956048 16508 raft_consensus.cc:3055] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:37.956425 16508 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:37.957424 16596 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:37.957896 16596 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:37.957991 16615 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:37.940681 16170 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:37.958304 16596 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:37.958598 16615 raft_consensus.cc:697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:37.959352 16599 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:37.959899 16599 raft_consensus.cc:697] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:37.959503 16615 consensus_queue.cc:237] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:37.960769 16599 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.945817 12510 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:37.962627 16597 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.963675 12510 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:37.964110 12620 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 11: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:37.964408 16455 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:37.964834 16597 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:37.965068 16455 consensus_queue.cc:1048] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:37.922945 16305 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:37.943097 16593 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:37.966638 16455 consensus_queue.cc:1059] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:37.967465 16455 raft_consensus.cc:3055] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:37.967525 16305 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:37.967916 16455 raft_consensus.cc:740] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:37.968451 16593 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:37.935660 16420 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.968777 16455 consensus_queue.cc:260] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:37.938153 16126 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:37.964998 16334 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:37.970065 16455 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:37.966645 12510 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:37.973874 16334 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:37.975698 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:37.976155 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:37.976496 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:37.977058 12546 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
I20260709 13:04:37.978391 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:37.979034 12694 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
W20260709 13:04:37.981776 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:37.919901 16459 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13.
I20260709 13:04:37.984061 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:37.984843 12546 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 10: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:37.986459 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:37.987233 12539 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
I20260709 13:04:37.957351 16508 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.990671 16508 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:37.993351 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:37.994038 12539 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:37.995309 12546 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:04:37.996724 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:37.997341 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:37.997658 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:37.998021 16170 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:37.919297 16618 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:04:37.998544 16170 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:37.998886 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:37.997058 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:37.969504 16420 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:38.002526 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:38.005519 12694 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:04:38.005805 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 61222.9us
I20260709 13:04:38.005422 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:38.010152 12696 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:38.010934 12445 catalog_manager.cc:5697] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:04:38.006666 12693 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
W20260709 13:04:38.014317 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 239603us
I20260709 13:04:38.016743 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:38.020083 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:38.012717 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:38.024030 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:38.024464 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:38.025874 12587 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:38.027432 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:38.029125 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:38.029649 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:38.033197 12687 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:04:38.034530 12539 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:04:38.033475 13199 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:04:38.036422 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 250983us
I20260709 13:04:37.918848 12688 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:38.047255 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:38.049751 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:38.004061 16618 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.050407 12613 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:38.053032 12659 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:38.057988 12445 catalog_manager.cc:5697] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:04:38.046280 13199 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:38.062243 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:38.062597 12621 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:38.065477 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:38.075213 13199 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:38.078231 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:38.078831 12659 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:38.051551 16605 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:38.081404 12445 catalog_manager.cc:5697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 8 to 10, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 10 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:38.083789 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:38.084867 12659 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:38.085264 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:38.090597 16619 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:38.033396 16419 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:04:38.058740 16622 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:38.096527 12662 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:38.093678 12445 catalog_manager.cc:5697] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:38.097195 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:38.079334 16477 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:38.101878 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:38.104032 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:38.104254 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:38.104079 13227 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:38.106145 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:38.107161 13234 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:38.096561 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:38.051692 16366 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:04:38.087882 16507 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:38.092183 16605 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.119254 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:38.119728 12445 catalog_manager.cc:5697] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 6 to 9, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 9 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:38.065356 16618 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:38.099290 16533 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:04:38.128921 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 53838.4us
I20260709 13:04:38.129807 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:38.133683 13226 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:04:38.135208 13228 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 11: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:38.135610 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:38.136111 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:38.135372 12445 catalog_manager.cc:5697] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 6 to 8, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 8 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:38.111703 16619 raft_consensus.cc:697] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:38.133095 16305 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:38.137588 16619 consensus_queue.cc:237] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:38.137934 16305 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:38.139389 12544 raft_consensus.cc:2393] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 7: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:38.137506 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:38.142689 12616 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:38.144948 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:38.145699 12690 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:38.146620 16305 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:38.148056 16457 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:38.148896 16457 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.149276 16457 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:38.141029 12445 catalog_manager.cc:5697] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:38.111249 16477 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.096810 16170 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:38.151450 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:38.145900 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:38.141206 16507 raft_consensus.cc:697] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:38.124704 16605 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:38.178799 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:38.179733 12545 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:38.174858 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:38.181043 12544 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 10: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:38.165110 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:38.173372 12618 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:38.181862 12621 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
W20260709 13:04:38.171545 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 86746.6us
I20260709 13:04:38.162200 12445 catalog_manager.cc:5697] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 6 to 8, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 8 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:38.175781 12690 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:04:38.184387 12539 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:38.192992 12445 catalog_manager.cc:5697] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 2 to 3, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 3 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:04:38.203408 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:38.165462 16477 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:38.179311 16596 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:38.211503 16420 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:38.211980 16621 log.cc:927] Time spent T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.098s	user 0.001s	sys 0.001s
I20260709 13:04:38.124382 16622 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:38.195832 16460 raft_consensus.cc:2764] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:04:38.176987 16043 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:38.218732 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:38.218979 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:38.219511 12445 catalog_manager.cc:5697] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 4 to 7, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 7 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:04:38.179123 16533 raft_consensus.cc:697] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:38.195688 16269 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:38.217818 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:38.244326 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:38.247687 12546 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:38.245492 13199 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:38.227473 15981 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.250511 12621 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 11: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:04:38.245695 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 176312us
I20260709 13:04:38.249392 13199 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:38.251267 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:38.253863 12694 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:38.256698 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:38.257416 12695 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 8: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:38.259999 16550 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:38.260449 16550 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.260795 16550 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:38.261050 16622 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:38.262599 13232 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:38.263545 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:38.264508 12588 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:38.265740 16419 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:38.265940 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:38.266148 12588 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:38.266551 13231 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:38.267495 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:38.267776 12588 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:38.269418 16305 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:38.269340 16550 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:38.269930 16610 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:38.270191 16305 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:38.270663 16305 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:38.271082 16305 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:38.272435 16533 consensus_queue.cc:237] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:38.274402 12587 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:38.274633 16596 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:38.275202 16596 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:38.275542 16596 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.275907 16596 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:38.261061 16636 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:04:38.277031 12445 catalog_manager.cc:5697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 3 to 5, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 5 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:38.278957 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:38.281142 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:38.290040 12694 raft_consensus.cc:2368] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13.
I20260709 13:04:38.291335 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:38.293030 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:38.296010 12588 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:38.296725 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:38.298594 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:38.300792 12445 catalog_manager.cc:5697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 3 to 6, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 6 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:38.259071 12545 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:38.254108 16225 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:38.310729 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:38.258415 16420 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:38.244122 16043 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:38.270417 16610 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:38.320007 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:38.315125 13231 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:38.276839 16269 raft_consensus.cc:697] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:38.300199 16550 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:38.329155 12445 catalog_manager.cc:5697] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 3 to 7, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 7 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:38.277065 15981 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:38.340728 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:38.344151 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:38.347111 12545 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:38.328552 16225 raft_consensus.cc:697] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:38.348573 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:38.348722 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:38.349112 12445 catalog_manager.cc:5697] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:04:38.368887 16633 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:38.294739 16599 consensus_queue.cc:1059] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 13:04:38.369716 12544 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:38.373232 12445 catalog_manager.cc:5697] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:38.323937 16610 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:38.306313 16597 consensus_queue.cc:1059] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:04:38.371649 12621 raft_consensus.cc:1275] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:04:38.345034 16541 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:38.384799 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:38.387048 12544 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:38.387202 12445 catalog_manager.cc:5697] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:38.324774 16420 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:38.371488 16455 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:38.395979 12616 raft_consensus.cc:2410] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:04:38.395731 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 55075.2us
I20260709 13:04:38.400519 12510 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:38.401419 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:38.323330 16507 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:38.403551 12510 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:38.384562 16015 raft_consensus.cc:3055] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:38.384171 16618 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:38.397226 12445 catalog_manager.cc:5697] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:04:38.407137 16634 consensus_queue.cc:1059] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:38.422653 13234 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 7. Current term is 8. Ops: []
W20260709 13:04:38.423585 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.425375 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:38.426519 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:38.397790 16599 raft_consensus.cc:3055] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:38.403946 16593 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:04:38.429870 16639 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260709 13:04:38.430788 16632 log.cc:927] Time spent T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:04:38.432772 16398 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:38.394003 16541 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:38.435787 16420 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:38.456581 12445 catalog_manager.cc:5697] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 2 to 7, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 7 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:38.400655 16615 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.402933 16585 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:38.393432 16448 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:38.433481 12510 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:38.471832 12510 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:38.428534 16015 raft_consensus.cc:740] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:38.455027 16650 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:38.469671 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:38.451380 16599 raft_consensus.cc:740] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:38.475804 12445 catalog_manager.cc:5697] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:38.477696 12445 catalog_manager.cc:5697] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 1 to 4, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 4 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:04:38.483183 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:38.483704 16643 log.cc:927] Time spent T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:04:38.483856 13235 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:38.484427 16448 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:38.485240 12622 raft_consensus.cc:2393] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 11: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:04:38.483178 16601 log.cc:927] Time spent T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:04:38.492581 13235 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:38.492892 13229 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:38.480856 12445 catalog_manager.cc:5697] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 4 to 6, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 6 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:38.510205 13227 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:38.403662 16269 consensus_queue.cc:237] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:38.476253 16593 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:04:38.518087 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 46323.2us
I20260709 13:04:38.519672 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:38.507134 16634 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.522017 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:38.523440 12512 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:38.524718 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:38.450157 16225 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:38.527149 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:38.529363 12613 raft_consensus.cc:2410] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:04:38.527863 12512 leader_election.cc:400] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13.
I20260709 13:04:38.530805 12512 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:38.514175 16585 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:38.470745 16615 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:38.542385 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:38.569397 16618 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:38.570188 16233 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:04:38.570322 16649 log.cc:927] Time spent T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:04:38.571894 16648 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.003s
I20260709 13:04:38.576009 16596 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:38.576784 16653 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:04:38.518102 16593 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.568449 12445 catalog_manager.cc:5697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 5 to 6, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 6 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
W20260709 13:04:38.595583 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 53270.8us
I20260709 13:04:38.596836 12510 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:38.617127 12510 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:38.628945 12445 catalog_manager.cc:5697] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 4 to 7, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 7 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:04:38.566944 16398 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:04:38.610699 16593 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:38.646093 13235 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:04:38.647156 12588 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:38.640350 16043 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:38.652839 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:38.615195 16618 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:38.495394 16650 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:38.635975 16455 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:38.659473 12510 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:38.663110 16656 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:38.665330 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:38.665982 12539 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 5.
W20260709 13:04:38.666253 16457 consensus_meta.cc:287] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.504s	user 0.008s	sys 0.001s
I20260709 13:04:38.666517 12542 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:04:38.666908 12542 pending_rounds.cc:85] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 8
I20260709 13:04:38.666664 16457 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:38.666952 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:38.667371 12542 pending_rounds.cc:107] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:04:38.667689 12542 raft_consensus.cc:2889] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:38.668015 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:38.668620 12544 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:38.668871 16457 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:38.669551 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:38.670188 12540 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:38.670279 12538 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:04:38.672012 16334 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:38.675484 13233 raft_consensus.cc:2393] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 11: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:38.667696 12546 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
W20260709 13:04:38.679880 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 124667us
I20260709 13:04:38.680639 12512 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:38.647974 16233 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:38.685497 12512 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:38.656054 16420 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:38.654871 16618 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:38.695403 12544 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:38.661190 16455 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:38.698066 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:38.698727 12540 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:38.641060 16015 consensus_queue.cc:260] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:38.683216 16619 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:38.566213 16634 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:38.689275 16398 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:38.655035 16605 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:38.628257 16599 consensus_queue.cc:260] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:38.710742 16634 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:38.695600 16618 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:38.716051 16610 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:38.717840 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:38.729190 12538 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:38.720805 16633 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:38.691489 16334 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:38.659981 16597 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:04:38.699433 16455 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:38.742129 12617 raft_consensus.cc:2393] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 11: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:38.743121 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:38.726218 16596 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:38.751631 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 98854.8us
I20260709 13:04:38.759744 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:38.759797 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:38.761325 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:38.761713 12588 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:38.761991 12615 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:38.765686 16633 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:38.736043 16541 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:38.750923 16015 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:38.750151 16599 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:38.780679 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.725469 16619 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:38.787009 12538 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:04:38.718334 16651 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.116s
I20260709 13:04:38.791932 16650 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:38.803875 12615 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:38.772001 16448 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:38.806764 16448 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:38.807191 16448 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:38.773267 16305 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:38.811663 16665 consensus_queue.cc:1059] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:38.812409 16305 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:38.814620 16477 consensus_meta.cc:287] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.582s	user 0.006s	sys 0.010s
I20260709 13:04:38.815068 16477 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:38.817080 16477 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:38.817802 12687 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 13:04:38.818401 16647 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.384s	user 0.003s	sys 0.004s
W20260709 13:04:38.822345 16641 log.cc:927] Time spent T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.427s	user 0.003s	sys 0.005s
W20260709 13:04:38.827827 16657 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:04:38.834754 16605 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:38.839627 16618 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:38.797406 13200 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:38.843108 16619 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:38.844789 16252 raft_consensus.cc:3055] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:38.851227 16252 raft_consensus.cc:740] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:38.852280 16252 consensus_queue.cc:260] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:38.848678 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:38.853832 16252 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:38.854126 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 939) took 1117 ms. Trace:
I20260709 13:04:38.854723 12689 rpcz_store.cc:276] 0709 13:04:37.736759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.736956 (+   197us) service_pool.cc:224] Handling call
0709 13:04:37.737651 (+   695us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:37.751075 (+ 13424us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:04:38.092029 (+340954us) log.cc:844] Serialized 14 byte log entry
0709 13:04:38.312204 (+220175us) log.cc:844] Serialized 14 byte log entry
0709 13:04:38.843259 (+531055us) spinlock_profiling.cc:243] Waited 9.08 ms on lock 0x7b48001b0258. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3ae4a2aa1 00007fc3ae499b37 00007fc3ae4999ca 00007fc3ae59126f 00007fc3ae590f37 00007fc3ae5a555c 00007fc3ae5a5508 00007fc3ae5a5488 00007fc3ae5a5443 00007fc3ae5a46ec 00007fc3ad4cea96
0709 13:04:38.853470 (+ 10211us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b1800326bc0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a6406c0a 00007fc3afb46219 00007fc3a648ea40 00007fc3a64894e4 00007fc3a6489455 00007fc3a9571060 00007fc3a9583716 00007fc3a9594287 00007fc3a9594208
0709 13:04:38.853666 (+   196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:38.853726 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:38.853788 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:38.853869 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:38.854014 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27005,"prepare.queue_time_us":363494,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":80,"raft.queue_time_us":38995,"raft.run_cpu_time_us":12688,"raft.run_wall_time_us":548771,"spinlock_wait_cycles":27244160,"thread_start_us":480168,"threads_started":3,"wal-append.queue_time_us":218132}
I20260709 13:04:38.858029 16644 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:04:38.858301 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 471897us
I20260709 13:04:38.859071 16645 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:04:38.858067 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 536616us
W20260709 13:04:38.866058 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 68938.5us
W20260709 13:04:38.863402 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.862178 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:38.870774 16627 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:38.872752 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:38.873051 16627 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:38.873863 16634 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:38.874425 12696 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:04:38.875183 16627 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:38.875480 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:38.876063 12688 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:38.878801 12546 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:38.879374 12538 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:38.883208 12692 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:04:38.893957 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 44452.9us
I20260709 13:04:38.895264 13197 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:38.897550 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:38.901337 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:38.904079 12692 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:38.902495 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:38.906081 12588 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:38.908984 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:38.893186 16302 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:38.919276 12688 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:38.923063 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:38.927083 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:38.871063 16541 consensus_queue.cc:1059] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:04:38.929747 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:38.929962 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 128999us
I20260709 13:04:38.930459 12544 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:38.910287 16043 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:38.906838 16597 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:38.910378 16644 raft_consensus.cc:697] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:38.938223 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:38.920310 16302 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:38.949975 12588 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:38.920236 16633 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:38.912753 16455 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:38.932196 16650 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:38.939371 16043 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:38.938760 16610 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:38.959676 12588 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:38.952423 16302 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:38.971554 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.950950 16596 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:38.958962 16622 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:38.982877 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:38.961350 16653 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:39.007752 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:39.008492 12687 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 10: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:39.007215 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:39.010684 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:39.010826 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:39.011610 12539 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:39.014312 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:39.015062 12687 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:04:39.015211 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:38.951480 16420 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:04:38.975847 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:38.991663 16651 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:04:38.998879 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:39.019881 12545 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:38.999166 13235 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:04:39.020462 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:38.973554 16043 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:39.000587 12546 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:04:39.004045 13232 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 13:04:39.003703 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:39.025288 13231 raft_consensus.cc:2393] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 11: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:39.005919 12542 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:04:38.987411 16618 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:38.950896 16305 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:04:39.026183 15981 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:38.963496 16636 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:04:38.952041 16597 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:39.023452 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:39.039716 12547 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:39.028045 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:39.040527 12541 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:38.999820 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 102508us
I20260709 13:04:39.030402 12539 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:39.029448 12695 raft_consensus.cc:3055] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:39.041730 12695 raft_consensus.cc:740] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:38.970948 16633 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:39.050081 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:39.050704 12695 consensus_queue.cc:260] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:39.051801 12695 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:39.023587 16653 raft_consensus.cc:697] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:39.050740 12691 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:39.058799 12547 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
W20260709 13:04:39.062556 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 47624.8us
I20260709 13:04:39.072198 12587 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:39.064674 16636 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:39.083027 16636 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:39.086318 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:39.089028 12691 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:39.090407 16670 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:39.094019 12614 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:39.094882 16455 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:39.060278 16596 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.095772 16596 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:39.096750 16593 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:39.104281 16593 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:39.099660 12512 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:39.108421 16334 raft_consensus.cc:3055] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:39.109017 12692 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:39.109768 16671 consensus_queue.cc:1059] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:39.115744 12618 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:04:39.131453 12618 pending_rounds.cc:85] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 8
I20260709 13:04:39.131709 12618 pending_rounds.cc:107] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:04:39.131929 12618 raft_consensus.cc:2889] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:39.131852 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:39.021036 16622 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:39.138638 12512 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:39.139575 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 67533.2us
W20260709 13:04:39.099258 16642 log.cc:927] Time spent T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.659s	user 0.006s	sys 0.020s
I20260709 13:04:39.059558 16610 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.141662 12541 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:39.144196 12512 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:39.144757 12545 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:39.151436 13226 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:04:39.162329 12695 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:39.176362 12587 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:39.130074 16334 raft_consensus.cc:740] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:04:39.190914 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 59137.4us
I20260709 13:04:39.199314 16651 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:39.191877 12587 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:39.176952 16674 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:39.199918 12588 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:39.138085 16605 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:39.201614 16605 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:39.204380 16605 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:39.205266 16605 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:39.205911 16605 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:39.206758 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:39.207638 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:39.208523 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:39.211697 12691 raft_consensus.cc:2393] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 11: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:39.174606 16233 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:39.161877 16455 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:39.213824 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:39.174537 16618 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:04:39.219931 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 68164.6us
I20260709 13:04:39.223426 12512 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:39.220902 12689 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:39.223964 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:39.181207 16269 raft_consensus.cc:3055] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:39.226406 13199 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:39.177289 16593 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:04:39.215910 16605 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:39.175846 16610 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:39.214073 16507 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.242703 12662 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:39.228089 16269 raft_consensus.cc:740] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:39.244043 16610 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:39.244868 16269 consensus_queue.cc:260] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:39.245273 16507 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:39.246207 16269 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:39.221086 16305 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:39.245316 16669 raft_consensus.cc:2764] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:04:39.244082 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:39.253722 16305 raft_consensus.cc:697] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:39.293967 16305 consensus_queue.cc:237] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:39.253854 16663 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:39.296270 16663 raft_consensus.cc:697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:39.297323 16663 consensus_queue.cc:237] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:39.079274 16653 consensus_queue.cc:237] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:39.260288 16622 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:39.062839 16644 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:39.266630 16596 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:39.266798 12620 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:39.278132 16448 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:39.237773 16585 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.235864 16457 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:39.283437 16334 consensus_queue.cc:260] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:39.221313 16645 consensus_queue.cc:1059] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:04:39.252347 16618 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:39.182277 16043 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:39.289749 16459 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:39.292246 16507 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:04:39.307825 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 55921.7us
I20260709 13:04:39.325227 16672 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:39.378579 13199 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:39.421451 13199 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:39.422466 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 178437us
I20260709 13:04:39.427398 16126 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:39.422196 15981 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:39.439283 16448 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:39.438954 15981 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:39.442612 15981 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:39.323510 16585 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:39.445219 13199 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:39.448891 12689 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:39.448892 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:39.451134 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:39.452054 12692 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:04:39.425057 16507 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:39.428977 16334 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:39.464779 16477 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.470367 16477 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:39.471462 16043 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:39.476513 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:39.460402 16622 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:39.497848 16622 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.498380 16622 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:39.460000 16672 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:39.502513 16585 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:39.502573 16672 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:39.507237 16672 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:39.485051 16619 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:39.472920 16477 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:39.486011 16645 consensus_queue.cc:1048] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:04:39.489269 16615 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:39.519245 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:39.521636 13235 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:39.534862 16605 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:39.697010 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 497119us
I20260709 13:04:39.698323 12588 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:39.699165 16696 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:39.699640 16696 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:39.700047 16696 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:39.706194 12588 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:39.706980 16685 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:39.707396 12588 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:39.708703 16685 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:39.708590 16696 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:39.709314 16685 raft_consensus.cc:697] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 7 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:39.709975 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:39.710626 12617 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:39.710249 16685 consensus_queue.cc:237] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:39.711138 16696 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:39.711824 16696 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:39.712312 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:39.712551 16696 raft_consensus.cc:697] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 6 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:39.712854 12620 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:39.713462 16696 consensus_queue.cc:237] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:39.717340 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:39.718014 12510 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:39.719425 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:39.721127 16686 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:39.721590 16686 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:39.721731 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:39.722038 16686 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:39.722679 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:39.725473 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:39.726127 12542 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:39.727535 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:39.728044 12542 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:39.729408 16636 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:39.733249 12620 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:39.733335 16686 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:39.718050 12617 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:39.735786 12544 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 8: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:39.736485 12542 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:39.736847 16686 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:39.737543 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:39.737493 16696 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:39.738286 12542 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:39.735077 12588 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:39.741530 12588 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:39.743296 16696 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:39.743367 16420 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:39.744977 16420 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:39.745961 16420 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:39.746793 16420 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:39.481923 16302 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:39.748481 12542 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:39.742820 12588 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:39.750345 16302 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:39.753583 16302 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:39.754024 16696 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:39.754712 16302 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:39.746637 12510 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:39.757489 16686 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:39.757874 16302 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:39.758000 16686 raft_consensus.cc:697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:39.759022 16686 consensus_queue.cc:237] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:39.760047 16269 consensus_meta.cc:287] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.513s	user 0.011s	sys 0.000s
I20260709 13:04:39.761251 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:39.761658 16696 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:39.762359 16696 raft_consensus.cc:697] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:39.763234 16696 consensus_queue.cc:237] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:39.774715 12662 connection.cc:256] RPC call timeout handler was delayed by -1.3423884899999621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2171s for a response
I20260709 13:04:39.776763 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:39.776633 16269 consensus_queue.cc:1059] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:39.777657 16645 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:39.777916 16269 raft_consensus.cc:3055] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:39.778450 16269 raft_consensus.cc:740] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:39.778833 16420 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:39.779349 16269 consensus_queue.cc:260] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:39.784137 12617 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:04:39.784610 16684 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.783890 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:39.786603 16420 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:39.787981 12620 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:39.790503 16622 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:39.785888 16684 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:39.793809 16622 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:39.800653 12620 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:39.804075 12588 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:39.804917 16420 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:39.805539 16420 raft_consensus.cc:697] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:39.812156 16420 consensus_queue.cc:237] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:39.814786 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:39.817643 16686 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:39.818718 16686 raft_consensus.cc:697] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:39.819608 16686 consensus_queue.cc:237] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:39.817849 12510 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:39.826284 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:39.827095 16455 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:39.827654 16455 raft_consensus.cc:697] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:39.828763 16455 consensus_queue.cc:237] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:39.829031 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:39.852133 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:39.853538 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:39.854346 12538 raft_consensus.cc:2393] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 9: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:39.855330 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:39.857700 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:39.858481 12538 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 11: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:39.860098 12662 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:39.860903 16645 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:39.861150 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:39.862422 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:39.863744 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:39.864447 12538 raft_consensus.cc:2368] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 10. Current term is 11.
I20260709 13:04:39.865200 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:39.868098 16672 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.868714 16672 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:39.871447 12615 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:39.871995 16672 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:39.872537 16672 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:39.872969 16672 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:39.875649 16672 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:39.865864 12538 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:39.876657 16684 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:39.884066 12662 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:39.884718 12538 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:39.885416 12662 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:39.886132 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:39.886451 12662 leader_election.cc:400] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 10. Current term is 11.
I20260709 13:04:39.886796 12662 leader_election.cc:403] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:04:39.887996 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:39.888454 12588 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:39.890566 16615 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:39.890771 12538 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:39.891137 16615 raft_consensus.cc:697] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:39.892071 16615 consensus_queue.cc:237] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:39.893927 16672 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:39.894685 16672 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:39.895426 16622 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.895793 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:39.896004 16622 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:39.897120 12538 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:39.897451 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:39.898221 13235 raft_consensus.cc:2368] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10.
I20260709 13:04:39.895417 16672 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 10. Current term is 11.
I20260709 13:04:39.899509 13226 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:04:39.897153 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:39.900884 13234 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:39.898136 16622 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:39.904803 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:39.905617 13226 raft_consensus.cc:2393] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 11: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:39.905027 12542 raft_consensus.cc:2410] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:39.906673 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:39.907867 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:39.908980 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:39.910640 12540 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:39.911830 13231 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:39.912885 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:39.913457 13235 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:39.914291 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:39.915313 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:39.915925 13226 raft_consensus.cc:2368] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9.
I20260709 13:04:39.917884 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:39.918882 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:39.919435 13226 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:39.922437 16043 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:39.923020 16043 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:39.925045 16043 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:39.936893 16366 raft_consensus.cc:3055] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:39.941349 16366 raft_consensus.cc:740] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:39.937191 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:39.939841 16622 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:39.941522 13226 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:04:39.955315 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:39.955717 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 959) took 1041 ms. Trace:
I20260709 13:04:39.955899 13235 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:39.956094 12690 rpcz_store.cc:276] 0709 13:04:38.914804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:38.914920 (+   116us) service_pool.cc:224] Handling call
0709 13:04:39.955517 (+1040597us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54000c67d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:39.955643 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2360809216}
I20260709 13:04:39.942065 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:39.958866 16645 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:39.959285 12545 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:39.960391 12545 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:39.962826 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:39.963415 12541 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:39.964224 13235 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:39.964545 12541 raft_consensus.cc:1275] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:04:39.967079 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:39.970002 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:39.970785 12692 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:39.972748 12587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.000s	sys 0.015s
W20260709 13:04:39.973079 12587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.000s	sys 0.015s
W20260709 13:04:39.980994 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 781741us
I20260709 13:04:39.981777 16645 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:39.982118 12544 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:39.982486 16645 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:39.984972 16645 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:39.985895 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:39.986687 12512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.039s	sys 0.078s
W20260709 13:04:39.987015 12512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.039s	sys 0.078s
W20260709 13:04:39.987500 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 764120us
I20260709 13:04:39.988586 16233 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:39.988993 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:39.989146 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:39.990324 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:39.993884 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:39.995924 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:39.996397 12545 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:39.948352 16633 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:39.990334 13200 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:40.001528 12588 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:40.002326 16633 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:40.002669 16597 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:40.002692 16633 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.004343 16633 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:40.008030 12690 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:40.010938 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:40.011471 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:40.011615 12687 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:40.012802 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:40.011571 12545 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:04:40.013633 12545 pending_rounds.cc:85] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 6
I20260709 13:04:40.013866 12545 pending_rounds.cc:107] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:04:40.014097 12545 raft_consensus.cc:2889] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:40.015390 16535 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:40.016624 16302 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:40.017464 12545 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:40.018179 16302 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:39.719672 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:40.020229 16622 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:40.025121 12542 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:40.026620 16653 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.004s	sys 0.000s
W20260709 13:04:40.027038 16653 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.004s	sys 0.000s
I20260709 13:04:40.028362 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:40.029119 12693 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:40.029363 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:40.032052 16305 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.021s	sys 0.005s
W20260709 13:04:40.032590 16305 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.021s	sys 0.005s
I20260709 13:04:40.016609 16633 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:40.033501 16459 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.034039 16459 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:40.035589 16633 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:40.013298 12687 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:40.038338 16656 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.011s	sys 0.016s
I20260709 13:04:40.038349 16585 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:04:40.038731 16656 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.011s	sys 0.016s
I20260709 13:04:40.039093 16585 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:40.041244 16585 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:40.044116 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:40.044323 12588 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:40.044744 12622 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:04:40.045310 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:40.013075 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:39.942924 16366 consensus_queue.cc:260] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:40.050642 16366 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:40.056084 12687 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:40.036167 16459 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:40.061335 16597 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.061939 16597 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:40.064647 16656 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:40.065125 16656 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:40.065516 16656 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:40.065968 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:40.067649 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:40.077260 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:40.090286 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:40.075842 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:40.090929 13231 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:40.095715 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:40.095806 12687 raft_consensus.cc:1275] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:40.096403 12545 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:40.120301 16535 raft_consensus.cc:697] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:40.122618 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:40.090148 12692 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:40.095135 16618 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:40.123402 16459 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.162408 16618 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:40.169620 16618 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:40.216208 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:40.217454 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:40.218580 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:40.218843 13200 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:40.219647 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:40.220152 12540 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:40.220012 16622 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.221247 16622 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:40.223260 16622 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:40.223574 12545 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:40.223726 16459 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:40.224503 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:40.224800 13200 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:40.225513 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:40.225669 16615 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:40.225821 16459 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:40.222921 16618 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:40.238142 13197 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:40.242872 12690 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:40.247648 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:40.249046 12538 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:40.260041 12692 raft_consensus.cc:3055] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:40.260885 12692 raft_consensus.cc:740] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:40.261739 12692 consensus_queue.cc:260] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:40.248104 16117 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:40.260028 16615 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:40.275038 16618 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:40.275523 16615 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:40.276196 12692 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:40.277006 16507 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:40.278007 12540 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:04:40.278936 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:40.279342 16644 consensus_queue.cc:1059] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:40.279994 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:40.280326 16644 consensus_queue.cc:1059] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:40.281085 16644 consensus_queue.cc:1243] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer a70479a3b4114f3581095e9890f5d653 log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:04:40.281386 13200 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:40.282020 16710 raft_consensus.cc:3055] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:40.282527 16645 raft_consensus.cc:3055] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:40.282716 16710 raft_consensus.cc:740] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:40.283073 16645 raft_consensus.cc:740] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:40.284189 16710 consensus_queue.cc:260] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:40.284538 16645 consensus_queue.cc:260] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:40.287863 16043 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:40.248143 16656 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:40.288461 16043 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:40.290158 16714 log.cc:927] Time spent T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:04:40.285377 16710 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:40.255807 16597 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:40.294026 12692 raft_consensus.cc:1275] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:04:40.297881 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:40.333962 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 67958us
I20260709 13:04:40.277518 16507 raft_consensus.cc:697] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:04:40.452221 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 180890us
I20260709 13:04:40.332791 16302 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:40.293609 16644 consensus_queue.cc:1059] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.117s
I20260709 13:04:40.476303 16585 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:40.522541 16585 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:40.540381 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 249105us
I20260709 13:04:40.452512 16541 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:40.433143 16459 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:40.295222 16535 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:40.607506 12643 debug-util.cc:398] Leaking SignalData structure 0x7b08003d8640 after lost signal to thread 11446
I20260709 13:04:40.588514 16645 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:40.546469 16670 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.168s
I20260709 13:04:40.726234 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:40.844753 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:40.609133 16644 consensus_queue.cc:1243] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer a70479a3b4114f3581095e9890f5d653 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:04:40.714609 16398 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:40.880111 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:40.887890 12539 raft_consensus.cc:2393] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 12: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:40.888578 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1551) took 1164 ms. Trace:
I20260709 13:04:40.608168 16420 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:40.791474 16732 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:40.607625 16541 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:40.739185 16455 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:40.889034 12539 rpcz_store.cc:276] 0709 13:04:39.724324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.879201 (+1154877us) service_pool.cc:224] Handling call
0709 13:04:40.888503 (+  9302us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:40.789462 16043 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:40.896879 12544 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:40.901448 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:04:40.904991 13197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.003s	sys 0.017s
W20260709 13:04:41.020380 13197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.003s	sys 0.017s
W20260709 13:04:41.020853 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 685629us
W20260709 13:04:40.906991 12614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.014s	sys 0.018s
I20260709 13:04:40.722299 16459 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:41.021799 12614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.014s	sys 0.018s
I20260709 13:04:40.894676 16644 raft_consensus.cc:3055] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:04:40.926949 16716 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.663s	user 0.000s	sys 0.001s
I20260709 13:04:40.891722 16656 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:40.738564 16507 consensus_queue.cc:237] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:40.957002 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:41.029063 12544 raft_consensus.cc:1275] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:41.032174 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:40.894937 16585 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:41.040422 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:40.953290 16366 consensus_meta.cc:287] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.902s	user 0.016s	sys 0.000s
W20260709 13:04:40.978972 16707 log.cc:927] Time spent T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:04:40.965847 16711 log.cc:927] Time spent T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.663s	user 0.001s	sys 0.000s
I20260709 13:04:40.988850 16670 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:40.975862 16662 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:40.956005 16605 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:40.994284 16674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.793s	user 0.010s	sys 0.013s
I20260709 13:04:40.895455 16398 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:41.009076 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 401553us
I20260709 13:04:41.069945 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:41.069578 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:04:41.078326 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 346414us
W20260709 13:04:41.078392 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 342663us
I20260709 13:04:41.022728 16644 raft_consensus.cc:740] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:41.094102 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:41.026459 16455 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.118489 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:41.119484 12695 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
W20260709 13:04:41.104550 16727 log.cc:927] Time spent T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.378s	user 0.001s	sys 0.001s
I20260709 13:04:41.027577 16420 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:41.111543 16674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.910s	user 0.011s	sys 0.013s
I20260709 13:04:41.105489 16737 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:41.105695 16736 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:41.161619 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1599) took 1176 ms. Trace:
W20260709 13:04:41.139089 16710 consensus_meta.cc:287] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.836s	user 0.012s	sys 0.000s
I20260709 13:04:41.081306 16662 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.170815 12613 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:41.166392 12696 rpcz_store.cc:276] 0709 13:04:39.985001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.986605 (+  1604us) service_pool.cc:224] Handling call
0709 13:04:39.986893 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:39.987225 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:39.987252 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:39.987660 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 13:04:40.155811 (+168151us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:40.155866 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:40.155960 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:41.161299 (+1005339us) raft_consensus.cc:1685] finished
0709 13:04:41.161330 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:41.161515 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10394,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"thread_start_us":167752,"threads_started":1,"wal-append.queue_time_us":245075}
I20260709 13:04:41.175180 12692 raft_consensus.cc:1275] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:04:41.162717 16674 raft_consensus.cc:697] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:04:41.196704 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 104593us
I20260709 13:04:41.200102 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:41.200349 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.227492 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:41.172439 16740 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:41.237442 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:41.240145 12618 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:41.170923 16366 consensus_queue.cc:1059] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:04:41.241210 12662 leader_election.cc:400] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10.
I20260709 13:04:41.246747 12662 leader_election.cc:403] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:04:41.229759 16585 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.171166 16736 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.171664 16744 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:04:41.180132 16710 consensus_queue.cc:1059] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:04:41.168203 16737 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.237092 16745 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.239550 16541 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:41.258947 13200 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.020s	sys 0.046s
W20260709 13:04:41.270720 13200 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.020s	sys 0.046s
I20260709 13:04:41.188650 16644 consensus_queue.cc:260] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:41.290139 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1555) took 1444 ms. Trace:
I20260709 13:04:41.259209 16459 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:41.268795 16726 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 13:04:41.244443 16740 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.309028 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:41.312362 16644 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:41.315055 12618 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:41.319202 12513 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:41.290586 12543 rpcz_store.cc:276] 0709 13:04:39.730255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.861617 (+131362us) service_pool.cc:224] Handling call
0709 13:04:39.861945 (+   328us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:39.862275 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:39.862302 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:39.862882 (+   580us) log.cc:844] Serialized 52 byte log entry
0709 13:04:40.186813 (+323931us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:40.186879 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:40.186978 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:41.174061 (+987083us) raft_consensus.cc:1685] finished
0709 13:04:41.174090 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:41.174269 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":657,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":84,"thread_start_us":323494,"threads_started":1,"wal-append.queue_time_us":725613}
I20260709 13:04:41.320501 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1866) took 1608 ms. Trace:
I20260709 13:04:41.321278 12613 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
W20260709 13:04:41.321946 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 52216.1us
I20260709 13:04:41.323568 12662 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:41.324894 16743 log.cc:927] Time spent T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:04:41.284986 16751 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:04:41.314936 16741 log.cc:927] Time spent T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 13:04:41.257284 16585 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:41.321064 12618 rpcz_store.cc:276] 0709 13:04:39.712510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.237125 (+1524615us) service_pool.cc:224] Handling call
0709 13:04:41.320422 (+ 83297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:41.330677 12662 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:41.315313 16366 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:41.339048 16754 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:04:41.339396 16366 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:41.340307 16366 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:41.286453 16674 consensus_queue.cc:237] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.342010 16736 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:41.342295 16650 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:41.329753 16605 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:41.343572 16605 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.333582 12513 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:41.347390 16737 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:41.347628 16662 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:41.348165 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 870) took 1284 ms. Trace:
I20260709 13:04:41.348358 16459 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:41.348537 12545 rpcz_store.cc:276] 0709 13:04:40.064029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.296162 (+232133us) service_pool.cc:224] Handling call
0709 13:04:40.296522 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:40.304443 (+  7921us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:40.304488 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:40.404172 (+ 99684us) log.cc:844] Serialized 26 byte log entry
0709 13:04:40.721138 (+316966us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:40.721195 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:40.721289 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:41.347955 (+626666us) raft_consensus.cc:1685] finished
0709 13:04:41.347977 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:41.348109 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7045,"raft.queue_time_us":8195,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":6386,"thread_start_us":146053,"threads_started":1,"wal-append.queue_time_us":561929}
I20260709 13:04:41.350261 16398 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:41.274425 16745 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.352891 16745 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:41.337049 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 869) took 1273 ms. Trace:
W20260709 13:04:41.338369 16738 log.cc:927] Time spent T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:04:41.354982 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 918) took 1127 ms. Trace:
I20260709 13:04:41.355316 12614 rpcz_store.cc:276] 0709 13:04:40.227932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.232047 (+  4115us) service_pool.cc:224] Handling call
0709 13:04:40.232376 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:40.233576 (+  1200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:40.233606 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:40.234107 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:04:41.022196 (+788089us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:41.022242 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:41.022338 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:41.354781 (+332443us) raft_consensus.cc:1685] finished
0709 13:04:41.354800 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:41.354925 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":718,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":787778,"threads_started":1,"wal-append.queue_time_us":921924}
I20260709 13:04:41.337980 16759 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:41.356994 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:41.358799 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:41.360030 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:41.322930 16670 raft_consensus.cc:3055] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:41.353825 12540 rpcz_store.cc:276] 0709 13:04:40.063741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.294089 (+230348us) service_pool.cc:224] Handling call
0709 13:04:40.297347 (+  3258us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:40.305163 (+  7816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:40.305209 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:40.404541 (+ 99332us) log.cc:844] Serialized 52 byte log entry
0709 13:04:40.978915 (+574374us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b48000024d8. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3ae4a2aa1 00007fc3ae499b37 00007fc3ae4999ca 00007fc3ae59126f 00007fc3ae590f37 00007fc3ae5a555c 00007fc3ae5a5508 00007fc3ae5a5488 00007fc3ae5a5443 00007fc3ae5a46ec 00007fc3ad4cea96
0709 13:04:40.997541 (+ 18626us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:40.997628 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:40.997738 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:41.328627 (+330889us) raft_consensus.cc:1685] finished
0709 13:04:41.328648 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:41.336985 (+  8337us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6981,"raft.queue_time_us":7153,"raft.run_cpu_time_us":18483,"raft.run_wall_time_us":634511,"spinlock_wait_cycles":7079296,"thread_start_us":422456,"threads_started":1,"wal-append.queue_time_us":706474}
I20260709 13:04:41.361284 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:41.362409 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:41.364238 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:41.365110 16742 log.cc:927] Time spent T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:04:41.365255 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:41.365981 16605 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:41.367036 16585 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:41.367628 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:41.368366 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:41.367290 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:41.371515 12694 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:41.381352 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:41.375581 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 873) took 1087 ms. Trace:
I20260709 13:04:41.322722 16756 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10.
I20260709 13:04:41.334404 16751 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.358965 16740 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:41.382062 12687 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:41.381013 13229 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:04:41.425086 12540 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:41.396714 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:41.397042 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:41.390552 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:41.382164 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:41.384681 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 868) took 1321 ms. Trace:
I20260709 13:04:41.432345 12662 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:41.391774 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2879) took 1632 ms. Trace:
I20260709 13:04:41.382018 12543 rpcz_store.cc:276] 0709 13:04:40.288433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.332741 (+1044308us) service_pool.cc:224] Handling call
0709 13:04:41.374845 (+ 42104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:41.375080 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:41.375118 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:41.375186 (+    68us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:41.375238 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:41.375311 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:41.375505 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:41.451582 12547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1550) took 1727 ms (client timeout 2006 ms). Trace:
I20260709 13:04:41.455366 12538 rpcz_store.cc:276] 0709 13:04:39.759670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:39.900528 (+140858us) service_pool.cc:224] Handling call
0709 13:04:39.985284 (+ 84756us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:40.257844 (+272560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:41.390039 (+1132195us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54003aaa54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:41.391486 (+  1447us) spinlock_profiling.cc:243] Waited 84.4 ms on lock 0x7b54003aaa50. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:41.391697 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":800208512}
I20260709 13:04:41.361352 16710 raft_consensus.cc:3055] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:41.459509 12689 raft_consensus.cc:2376] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10. Re-sending same reply.
I20260709 13:04:41.452414 12541 rpcz_store.cc:276] 0709 13:04:40.063475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.291645 (+228170us) service_pool.cc:224] Handling call
0709 13:04:40.291965 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:40.299284 (+  7319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:40.299320 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:40.425764 (+126444us) log.cc:844] Serialized 26 byte log entry
0709 13:04:40.727092 (+301328us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:40.727143 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:40.727234 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:41.384481 (+657247us) raft_consensus.cc:1685] finished
0709 13:04:41.384502 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:41.384626 (+   124us) inbound_call.cc:177] Queueing success response
0709 13:04:41.388529 (+  3903us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b48000024d8. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3ae4a2aa1 00007fc3ae499b37 00007fc3ae4999ca 00007fc3ae59126f 00007fc3ae590f37 00007fc3ae5a555c 00007fc3ae5a5508 00007fc3ae5a5488 00007fc3ae5a5443 00007fc3ae5a46ec 00007fc3ad4cea96
Metrics: {"raft.queue_time_us":6993,"raft.run_cpu_time_us":17922,"raft.run_wall_time_us":1085912,"spinlock_wait_cycles":6144896,"thread_start_us":147091,"threads_started":1,"wal-append.queue_time_us":761971}
I20260709 13:04:41.387959 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1552) took 1663 ms. Trace:
I20260709 13:04:41.475699 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:41.456012 12547 rpcz_store.cc:269] 0709 13:04:39.724046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.396345 (+1672299us) service_pool.cc:224] Handling call
0709 13:04:41.451522 (+ 55177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:41.373376 16670 raft_consensus.cc:740] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:41.467847 12587 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:41.479198 12662 leader_election.cc:400] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9.
I20260709 13:04:41.479969 12662 leader_election.cc:403] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:04:41.387049 16645 consensus_meta.cc:287] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.532s	user 0.006s	sys 0.005s
I20260709 13:04:41.477725 16233 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:41.483654 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:41.382839 16455 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:41.384953 16420 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:41.452822 16663 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.474954 16674 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:41.483501 16760 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:41.521713 16674 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:41.522199 16730 log.cc:927] Time spent T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.561s	user 0.004s	sys 0.000s
I20260709 13:04:41.469974 12546 rpcz_store.cc:276] 0709 13:04:39.724595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.035586 (+310991us) service_pool.cc:224] Handling call
0709 13:04:40.035891 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:40.036166 (+   275us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:40.036189 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:40.036545 (+   356us) log.cc:844] Serialized 26 byte log entry
0709 13:04:41.387429 (+1350884us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b54002e2320. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e3090 00007fc3a94f06b8 00007fc3a957992b 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c
0709 13:04:41.387501 (+    72us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:41.387560 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:41.387636 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:41.387687 (+    51us) raft_consensus.cc:1685] finished
0709 13:04:41.387701 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:41.387902 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2049,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"spinlock_wait_cycles":13817600,"thread_start_us":85165,"threads_started":1,"wal-append.queue_time_us":233861,"wal-append.run_cpu_time_us":1562,"wal-append.run_wall_time_us":1002568}
I20260709 13:04:41.388466 16753 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:41.480968 16541 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:41.452958 16618 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:41.519410 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 51682.9us
I20260709 13:04:41.454558 16761 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:41.520330 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:41.481230 16756 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:41.385378 16669 consensus_queue.cc:1059] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.133s
I20260709 13:04:41.535059 13229 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:04:41.473985 16710 raft_consensus.cc:740] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:41.510636 13199 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:41.478389 15981 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:41.511617 16759 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:04:41.477934 16252 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:41.513712 16744 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:41.477924 16622 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:04:41.544395 15981 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.544953 16737 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.484278 16535 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:04:41.511157 16662 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:04:41.562314 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:41.550659 16043 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:41.551390 16766 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:41.554289 16252 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.568496 16252 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:41.569867 16650 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:41.570361 16650 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:41.555490 16670 consensus_queue.cc:260] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:41.557509 16751 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:41.548318 16539 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:41.547636 16744 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:41.573166 16670 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:41.573438 16744 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:41.510146 16233 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:41.575690 16233 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:41.577044 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:41.577615 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:41.578015 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:41.578328 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.579793 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1064) took 1685 ms. Trace:
W20260709 13:04:41.581104 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.561350 16669 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:41.582502 16669 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.584425 16252 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:41.584995 16252 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.565822 15981 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:41.562363 16737 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.534775 16756 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:41.546979 13199 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
W20260709 13:04:41.592626 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 45730.2us
I20260709 13:04:41.590230 16674 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:41.593595 13199 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:41.593816 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 732) took 1626 ms. Trace:
I20260709 13:04:41.594882 13199 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:41.595513 16732 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:41.595942 16732 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:41.596338 16732 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:41.596695 13199 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:41.597494 16662 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:41.597762 16750 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:41.598237 16662 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:41.534530 16541 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.598245 16750 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:41.599753 16750 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:41.600097 16729 log.cc:927] Time spent T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 1.313s	user 0.011s	sys 0.013s
W20260709 13:04:41.602286 16728 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 13:04:41.524067 16663 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.594255 13235 rpcz_store.cc:276] 0709 13:04:39.966932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.048777 (+ 81845us) service_pool.cc:224] Handling call
0709 13:04:40.049175 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:40.049619 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:40.049649 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:40.091166 (+ 41517us) log.cc:844] Serialized 26 byte log entry
0709 13:04:40.247399 (+156233us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:40.247448 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:40.247518 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:41.405440 (+1157922us) spinlock_profiling.cc:243] Waited 36.1 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:04:41.589166 (+183726us) raft_consensus.cc:1685] finished
0709 13:04:41.589199 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:41.593744 (+  4545us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":733,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":536,"spinlock_wait_cycles":83092352,"thread_start_us":18854,"threads_started":1,"wal-append.queue_time_us":771703}
I20260709 13:04:41.609200 13199 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:41.612774 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:41.615447 13199 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:41.618845 13230 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 9: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:41.580307 13232 rpcz_store.cc:276] 0709 13:04:39.894242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.001639 (+1107397us) service_pool.cc:224] Handling call
0709 13:04:41.002261 (+   622us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:41.017106 (+ 14845us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:04:41.237199 (+220093us) log.cc:844] Serialized 14 byte log entry
0709 13:04:41.268405 (+ 31206us) log.cc:844] Serialized 14 byte log entry
0709 13:04:41.268635 (+   230us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:41.268697 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:41.268769 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:41.578516 (+309747us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b18004bfe80. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a645a2a6 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419
0709 13:04:41.579470 (+   954us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b540037aad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:41.579530 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:41.579689 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":246,"prepare.queue_time_us":225160,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":75,"raft.queue_time_us":1678,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":4486,"spinlock_wait_cycles":156748672,"thread_start_us":230113,"threads_started":2,"wal-append.queue_time_us":130211}
I20260709 13:04:41.539472 16618 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:41.541647 16761 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:41.624001 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 93366.4us
I20260709 13:04:41.622551 13199 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:41.601401 16541 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:41.629202 12587 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:41.634287 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:41.636516 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:41.637118 12690 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:41.616978 16043 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:41.634956 12694 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:04:41.617676 16756 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:41.638092 16662 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:41.638430 15981 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:41.640872 16662 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.641400 15981 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:41.641824 15981 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:41.626965 16302 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:41.654713 12696 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:41.656738 16771 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:41.634362 16618 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:41.667125 16737 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:41.671214 12613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 910) took 1846 ms (client timeout 1780 ms). Trace:
W20260709 13:04:41.671852 12613 rpcz_store.cc:269] 0709 13:04:39.824974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.043467 (+1218493us) service_pool.cc:224] Handling call
0709 13:04:41.670950 (+627483us) spinlock_profiling.cc:243] Waited 88.6 ms on lock 0x7b54003d13d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:41.671110 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":203751808}
I20260709 13:04:41.675760 12692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1619) took 1088 ms. Trace:
I20260709 13:04:41.676328 12692 rpcz_store.cc:276] 0709 13:04:40.587509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.587657 (+   148us) service_pool.cc:224] Handling call
0709 13:04:40.587977 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:41.177396 (+589419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:41.675366 (+497970us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b54002fdad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:41.675664 (+   298us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342165760}
I20260709 13:04:41.657258 16674 consensus_queue.cc:1048] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
W20260709 13:04:41.679908 12512 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.195:34641 timed out after 1.582s (SENT) [suppressed 12 similar messages]
I20260709 13:04:41.651340 16302 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:41.654417 16252 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:41.697768 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 59044.5us
W20260709 13:04:41.699339 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.701771 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:41.702490 13235 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:04:41.640111 16710 consensus_queue.cc:260] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:41.703493 16759 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9.
I20260709 13:04:41.703675 16710 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:41.696043 16618 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:41.704615 16618 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:41.707100 16618 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:41.697664 16302 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:41.708799 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:41.710006 16761 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:41.733456 12613 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 8. Ops: []
I20260709 13:04:41.738490 12615 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:41.743382 15981 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.743897 16744 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.698809 16669 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:41.698963 16732 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.723414 16756 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.748111 16732 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:41.748289 16756 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:41.751565 16302 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.753866 12622 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:41.698782 16663 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:41.753196 16366 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.760470 16750 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.762133 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:41.762555 16744 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:41.762709 13235 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:41.757483 12620 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 6 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: []
W20260709 13:04:41.766499 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 86626us
I20260709 13:04:41.768460 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:41.770581 12621 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:41.774159 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:41.774305 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:41.776400 13235 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:41.777819 16759 consensus_queue.cc:1059] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:41.779002 16669 raft_consensus.cc:3055] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:41.779438 16669 raft_consensus.cc:740] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:41.780473 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:41.780222 16669 consensus_queue.cc:260] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.781064 12693 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:41.783371 12688 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:04:41.782366 12692 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:41.784415 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:41.784873 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:41.785699 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:41.790315 12688 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:04:41.785905 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:41.765730 15981 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:41.792805 12621 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:41.757824 16645 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:41.793651 12614 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:41.796123 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:41.794831 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:41.797055 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:41.798331 12688 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:04:41.768201 16618 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:41.797961 16541 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:41.803920 16541 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.805896 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:41.806605 12689 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:04:41.807648 16541 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:41.808090 12689 raft_consensus.cc:1275] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:41.760509 16366 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:41.809474 16768 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:41.810115 12689 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:41.810426 16618 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:41.811795 12621 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:41.786494 16420 consensus_queue.cc:1048] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:04:41.812662 12688 raft_consensus.cc:1240] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:04:41.815188 13232 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:41.823549 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:41.812579 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:41.826040 13231 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 9: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:41.827433 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:41.794086 16750 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:41.813000 12693 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:41.782886 16663 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:04:41.783432 16650 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:41.832085 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:41.832087 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:41.835917 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:41.838824 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:41.840389 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:41.840965 12540 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:41.842115 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:41.837961 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:41.843731 12538 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:41.836239 13233 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:41.845283 12546 raft_consensus.cc:2410] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:04:41.847429 13234 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:41.812260 16669 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:41.849428 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:41.850828 12546 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:04:41.856341 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:41.856966 12546 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:04:41.857774 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:41.858812 12693 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:04:41.854240 12510 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:41.862213 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:41.862982 12547 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:41.827519 16233 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:04:41.864734 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.801527 16645 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:41.865509 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:41.865267 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:41.865160 12643 debug-util.cc:398] Leaking SignalData structure 0x7b0800368420 after lost signal to thread 12479
W20260709 13:04:42.034961 12643 debug-util.cc:398] Leaking SignalData structure 0x7b08002f5aa0 after lost signal to thread 12571
W20260709 13:04:42.036113 12643 debug-util.cc:398] Leaking SignalData structure 0x7b0800381500 after lost signal to thread 12646
I20260709 13:04:41.942576 16618 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:41.881206 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:42.016294 16740 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:41.834746 16455 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:41.954922 13234 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:41.835001 16334 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.869593 12540 raft_consensus.cc:1240] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:04:41.871719 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 83901.8us
I20260709 13:04:41.956754 16758 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:41.958875 16541 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:41.835053 16672 consensus_queue.cc:1059] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:04:41.962392 16650 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:41.835116 16585 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:41.879303 16233 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:41.889287 12617 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:41.953446 16302 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:41.965430 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:42.079262 12695 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:42.080331 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:42.080614 16233 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:41.953842 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:41.953874 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:41.966643 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:41.970810 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:42.147239 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:41.972549 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:41.978266 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:41.981511 16744 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:41.989943 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:41.996219 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:42.007165 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.149115 12690 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:42.010717 12545 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
W20260709 13:04:42.011305 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:42.016464 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 162315us
I20260709 13:04:42.019430 16782 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:42.020139 16784 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:42.025323 12620 raft_consensus.cc:1240] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 5. Current term is 6. Ops: []
I20260709 13:04:42.029317 12662 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:04:42.161952 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 132721us
I20260709 13:04:42.162631 12620 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:42.162905 12662 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:41.912654 12547 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:41.886626 12616 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:42.038640 12693 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
W20260709 13:04:42.036401 12643 debug-util.cc:398] Leaking SignalData structure 0x7b08003d2300 after lost signal to thread 12647
W20260709 13:04:41.951145 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 54369.8us
W20260709 13:04:42.165668 12643 debug-util.cc:398] Leaking SignalData structure 0x7b08002c5b00 after lost signal to thread 12720
I20260709 13:04:42.040656 16645 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:42.059798 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2894) took 2256 ms. Trace:
I20260709 13:04:42.020488 16684 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:42.020582 16420 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.023670 16774 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:42.066617 16672 consensus_queue.cc:1243] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Peer a70479a3b4114f3581095e9890f5d653 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:04:42.063047 16455 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:42.062055 16740 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.062711 16334 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.072530 16662 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:42.063334 16541 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.188584 16305 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:42.103327 16585 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:42.149115 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 122494us
I20260709 13:04:42.155542 12692 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:42.062929 16758 raft_consensus.cc:697] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:42.150763 16233 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.158118 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.160790 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.161679 16784 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.165865 12512 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:42.046307 16771 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:04:42.165936 12643 debug-util.cc:398] Leaking SignalData structure 0x7b08003dcd00 after lost signal to thread 12721
I20260709 13:04:42.194182 16650 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:42.156193 16744 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:42.187003 12690 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:04:42.144603 16761 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.219342 16233 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:42.221975 16761 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:42.223634 16784 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:42.224146 16233 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:42.224598 16761 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:42.172694 16627 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:42.225108 16615 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.225128 16627 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:42.225950 16627 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:42.225690 16615 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.227825 16615 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:42.189675 16684 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:42.227223 12433 maintenance_manager.cc:643] P 78966838052c4dd980a04a5b750887f1: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 6.038s	user 0.200s	sys 0.070s Metrics: {"bytes_written":30649,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":77314,"dirs.run_cpu_time_us":682,"dirs.run_wall_time_us":27193,"drs_written":1,"lbm_read_time_us":545,"lbm_reads_lt_1ms":4,"lbm_write_time_us":310059,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":8,"lbm_writes_gt_100_ms":1,"lbm_writes_lt_1ms":24,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":118304,"threads_started":2,"update_count":26,"wal-append.queue_time_us":39567}
I20260709 13:04:42.239046 16455 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:42.218945 16771 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.193759 16788 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:42.241940 16788 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.243074 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.243774 12434 maintenance_manager.cc:419] P 78966838052c4dd980a04a5b750887f1: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10328 bytes on disk
I20260709 13:04:42.244164 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:42.244253 16788 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:42.244550 16792 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.244822 12618 raft_consensus.cc:2376] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9. Re-sending same reply.
W20260709 13:04:42.244565 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 78778.8us
I20260709 13:04:42.168867 16782 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.245703 12512 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:42.247056 12621 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 7 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:42.247553 12512 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:42.247458 16585 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:42.244735 16753 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:42.248680 16585 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:42.168311 16674 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.249444 16674 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:42.197089 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:42.202965 12692 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:04:42.169932 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:42.103188 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:42.213551 12546 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: []
W20260709 13:04:42.252161 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 82302.8us
I20260709 13:04:42.214354 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.254673 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.260993 12618 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:42.259938 12616 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:42.250586 12620 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:42.210433 12643 debug-util.cc:398] Leaking SignalData structure 0x7b0800329400 after lost signal to thread 13259
W20260709 13:04:42.265179 12643 debug-util.cc:398] Leaking SignalData structure 0x7b08004039a0 after lost signal to thread 13260
I20260709 13:04:42.230193 16684 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:42.190265 16774 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.287707 16744 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:42.288321 16792 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:42.249534 16585 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:42.289613 16774 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:42.290163 16585 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:42.290607 16792 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:42.290944 12692 raft_consensus.cc:1275] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:42.231005 16740 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:42.189056 16710 consensus_queue.cc:1059] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:04:42.293010 12690 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:04:42.205699 16305 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.205104 16751 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:42.295267 16751 raft_consensus.cc:697] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:42.296162 16751 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.12, Last appended by leader: 12, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.296458 16627 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.242017 16771 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:42.300572 16672 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:42.301043 16672 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:42.302490 16366 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:42.192088 12693 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:42.248735 16753 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:42.187003 12659 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:42.307428 16753 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:42.307912 16760 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:42.308002 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 121080us
I20260709 13:04:42.259059 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:42.310463 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 51522.7us
I20260709 13:04:42.311187 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:42.253050 12621 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:42.250945 12433 maintenance_manager.cc:643] P 78966838052c4dd980a04a5b750887f1: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":333,"lbm_reads_lt_1ms":4}
I20260709 13:04:42.168660 12542 rpcz_store.cc:276] 0709 13:04:39.803572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.030702 (+227130us) service_pool.cc:224] Handling call
0709 13:04:40.035759 (+  5057us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:40.036075 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:40.036103 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:40.036545 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 13:04:40.121962 (+ 85417us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:41.544360 (+1422398us) spinlock_profiling.cc:243] Waited 48.2 ms on lock 0x7b18003675a0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a91214bc 00007fc3a646f48b 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a6489455 00007fc3acf713c7 00007fc3a95839a7 00007fc3a95930bf
0709 13:04:41.544496 (+   136us) log.cc:844] Serialized 14 byte log entry
0709 13:04:41.625555 (+ 81059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:41.625652 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:41.625692 (+    40us) raft_consensus.cc:1685] finished
0709 13:04:41.625794 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:42.059613 (+433819us) spinlock_profiling.cc:243] Waited 4.69 ms on lock 0x7b540026b450. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:42.059738 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129199,"prepare.queue_time_us":150364,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":2067,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":173,"spinlock_wait_cycles":121726208,"thread_start_us":244819,"threads_started":3,"wal-append.queue_time_us":383744,"wal-append.run_cpu_time_us":2375,"wal-append.run_wall_time_us":1127786}
I20260709 13:04:42.224315 16784 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:42.275992 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.314356 12613 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:04:42.254561 16541 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:42.257036 16650 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.287303 12618 raft_consensus.cc:1275] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:42.250483 16758 consensus_queue.cc:237] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:42.252503 16334 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:42.290647 16585 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:42.193053 16420 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.305713 13197 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:42.305199 12619 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:04:42.326089 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.301429 16672 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:42.328075 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 872) took 2111 ms. Trace:
I20260709 13:04:42.328593 12539 rpcz_store.cc:276] 0709 13:04:40.216498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.041724 (+825226us) service_pool.cc:224] Handling call
0709 13:04:41.042038 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:41.154007 (+111969us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:41.154068 (+    61us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:41.154126 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:41.154178 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:42.327851 (+1173673us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5400227c54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:42.327896 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:42.328020 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256923392}
I20260709 13:04:42.285181 12620 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:04:42.247448 16782 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:42.188946 16756 consensus_queue.cc:1059] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:04:42.323999 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.332569 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.342928 12613 raft_consensus.cc:2410] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:04:42.368683 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.321419 16761 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:42.316675 16366 consensus_queue.cc:1059] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:04:42.320457 16744 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:04:42.377166 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.378106 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.382082 12618 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:42.339929 16662 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:42.367285 16645 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:42.327800 16760 consensus_queue.cc:1059] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:04:42.388201 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:42.327590 16669 consensus_queue.cc:1059] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:04:42.390679 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.391301 12618 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:04:42.392684 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.393430 12613 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 9: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:42.377354 16334 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:42.385658 16305 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:42.383723 16662 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:42.400610 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:42.404299 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 156808us
I20260709 13:04:42.405704 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.411497 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.415845 12613 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:42.393959 16627 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:42.388618 16710 consensus_queue.cc:1059] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:04:42.403236 16662 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:42.427237 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.430415 12616 raft_consensus.cc:2393] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 10: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:42.433365 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.435292 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.439299 16650 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:42.402767 16334 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:42.422959 16790 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:04:42.412815 16782 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:04:42.424943 16305 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:04:42.438650 16644 raft_consensus.cc:3055] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:42.419690 16793 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:04:42.425462 16455 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:04:42.462335 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.463873 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:42.467181 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:42.467940 12616 raft_consensus.cc:2376] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12. Re-sending same reply.
I20260709 13:04:42.469027 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.470062 12616 raft_consensus.cc:2410] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 13 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:04:42.455121 16535 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.477891 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:42.478753 12690 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:04:42.483994 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:42.459905 16644 raft_consensus.cc:740] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:04:42.494663 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 173834us
I20260709 13:04:42.501955 12690 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:42.472666 16792 consensus_queue.cc:1059] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:04:42.520059 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.528155 12618 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:42.529603 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.534137 16799 consensus_queue.cc:1059] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:42.536294 12588 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:04:42.500407 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 59629.7us
W20260709 13:04:42.538029 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 210766us
W20260709 13:04:42.540359 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:42.567876 12512 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:42.541322 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.542879 16269 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:42.547325 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.567459 12587 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:42.553962 16334 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:42.560762 16644 consensus_queue.cc:260] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.569475 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:42.583099 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 871) took 2487 ms. Trace:
I20260709 13:04:42.526208 16719 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:42.586817 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.481487 16535 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.577667 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:42.579136 12512 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:42.580773 16790 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:42.590366 12512 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:42.583489 12544 rpcz_store.cc:276] 0709 13:04:40.095390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.032245 (+936855us) service_pool.cc:224] Handling call
0709 13:04:41.032501 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:41.032694 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:04:41.072060 (+ 39366us) log.cc:844] Serialized 14 byte log entry
0709 13:04:41.764792 (+692732us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b180043b280. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a911923a 00007fc3a9583a2a
0709 13:04:42.544884 (+780092us) spinlock_profiling.cc:243] Waited 4.84 ms on lock 0x7b180043b280. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a91214bc 00007fc3a646f48b 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a911923a
0709 13:04:42.582706 (+ 37822us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:42.582773 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:42.582827 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:42.582909 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:42.583040 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25924,"prepare.queue_time_us":37836,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":26120,"spinlock_wait_cycles":28057088,"thread_start_us":193007,"threads_started":1,"wal-append.queue_time_us":885067}
I20260709 13:04:42.592199 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.592657 12512 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:42.591614 16790 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:42.605367 16790 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:42.588796 16305 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:42.610301 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "588a15c12a6c46ab9373c48890191400"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:04:42.611171 13235 raft_consensus.cc:606] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:42.611299 16535 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:42.611069 16662 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.612921 16615 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:42.613359 16615 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:42.614017 12588 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:42.614328 16615 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:42.615401 16766 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:42.617179 16672 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.617651 12691 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:42.619302 16672 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:42.619570 16759 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:42.620302 12691 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 984) took 2373 ms (client timeout 1542 ms). Trace:
I20260709 13:04:42.604730 16334 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:42.621598 16334 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:42.622005 16334 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:42.623000 16786 consensus_queue.cc:1059] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:42.624222 16786 raft_consensus.cc:3055] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:42.624554 16786 raft_consensus.cc:740] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:42.624948 16615 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:42.620736 12691 rpcz_store.cc:269] 0709 13:04:40.246974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:40.247389 (+   415us) service_pool.cc:224] Handling call
0709 13:04:42.620053 (+2372664us) spinlock_profiling.cc:243] Waited 2.36 s on lock 0x7b54003ea8d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:42.620171 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5427570560}
I20260709 13:04:42.596666 16719 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.620071 16759 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.637801 12690 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:42.634918 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:42.641010 12689 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:42.566167 16656 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:04:42.582963 16792 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:42.629300 16719 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:42.595113 16455 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:42.591511 16605 raft_consensus.cc:3055] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:42.640142 16789 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:42.688910 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:42.596204 16774 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:42.695883 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:04:42.613216 16662 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:42.698685 13235 raft_consensus.cc:606] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:04:42.686892 16766 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:04:42.705984 16753 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.707715 16334 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.708915 16774 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:42.708951 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.710393 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:42.711442 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 514223us
I20260709 13:04:42.715045 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.692809 16792 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.625296 16786 consensus_queue.cc:260] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.720636 16644 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:42.649919 16541 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.722869 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:42.640630 16305 raft_consensus.cc:697] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:42.727185 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:42.730688 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.729770 12513 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:42.693053 16455 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:42.692420 16605 raft_consensus.cc:740] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:42.749185 16233 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:42.742465 16684 consensus_queue.cc:1175] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "66750b8bbd4c4b3a9695951d0ede3372" responder_term: 12 status { last_received { term: 12 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 12 index: 11 } }
I20260709 13:04:42.743848 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:42.750178 16605 consensus_queue.cc:260] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.755594 16605 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:42.752528 13229 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:42.730892 16774 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:42.757793 16233 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:42.742189 16541 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:42.760459 16541 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:42.752887 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:42.761792 16786 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:42.762003 13228 raft_consensus.cc:2393] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 11: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:42.765793 13234 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:42.765898 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.751989 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:42.767632 16305 consensus_queue.cc:237] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.769467 16619 raft_consensus.cc:993] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:04:42.770037 16619 raft_consensus.cc:1081] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:04:42.770315 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:42.770593 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:42.771895 13228 raft_consensus.cc:1240] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 8. Current term is 9. Ops: []
W20260709 13:04:42.772712 16811 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:04:42.773350 16802 consensus_queue.cc:1059] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:42.726303 16753 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:42.698782 16789 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:42.740479 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:42.781049 12613 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:42.742702 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:42.746660 12620 raft_consensus.cc:1240] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:04:42.742264 12545 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:42.795502 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:42.804723 12545 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:42.774835 16455 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:42.779933 16233 raft_consensus.cc:3055] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:42.790340 16789 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:42.779819 16669 raft_consensus.cc:3055] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:42.828925 12613 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:04:42.819092 16233 raft_consensus.cc:740] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:04:42.837291 16810 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.118s	user 0.002s	sys 0.000s
I20260709 13:04:42.841915 12616 raft_consensus.cc:2410] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:04:42.801708 16645 raft_consensus.cc:3055] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:04:42.842407 16645 raft_consensus.cc:740] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:04:42.842561 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 273135us
I20260709 13:04:42.843298 16645 consensus_queue.cc:260] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:42.836769 16233 consensus_queue.cc:260] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.844264 16645 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:42.847829 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:42.848726 12544 raft_consensus.cc:2410] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:04:42.848778 16759 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:42.849625 16669 raft_consensus.cc:740] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:42.850525 16808 consensus_queue.cc:1059] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:42.851691 16334 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:42.852938 16803 raft_consensus.cc:3055] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:42.853353 16803 raft_consensus.cc:740] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:42.854537 16803 consensus_queue.cc:260] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:42.856156 16803 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:42.797348 16758 consensus_queue.cc:1059] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 13:04:42.860253 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 245694us
I20260709 13:04:42.863901 12588 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:42.850526 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:42.790174 16740 consensus_queue.cc:1059] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 13:04:42.869890 12544 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:42.872007 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:42.870267 16758 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:42.874665 12616 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:42.874019 12620 raft_consensus.cc:2393] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 12: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:42.874497 16758 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.887344 16782 raft_consensus.cc:2764] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:04:42.888338 16758 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:42.891975 16420 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:42.901868 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:42.903784 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:42.868621 16759 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:42.937090 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:42.939318 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:42.940671 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:42.942477 12691 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 10: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:42.850597 16669 consensus_queue.cc:260] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:42.943495 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:42.944322 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:42.948410 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:42.952575 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:42.953455 12689 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:42.893383 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:42.962797 12614 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: []
W20260709 13:04:42.963254 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 69972.8us
I20260709 13:04:42.963522 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3136) took 1093 ms. Trace:
I20260709 13:04:42.964143 16813 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:42.964890 16813 consensus_queue.cc:1059] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:42.966045 16420 raft_consensus.cc:3055] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:42.966472 16420 raft_consensus.cc:740] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:42.966660 16597 raft_consensus.cc:3055] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:42.967082 16597 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:42.967425 16420 consensus_queue.cc:260] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.967970 16597 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:42.969184 16597 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:42.948427 16759 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:42.963896 12614 rpcz_store.cc:276] 0709 13:04:41.869799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.869930 (+   131us) service_pool.cc:224] Handling call
0709 13:04:42.962360 (+1092430us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b58001f4198. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:04:42.962594 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:42.963280 (+   686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:42.963467 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26261888}
W20260709 13:04:42.960188 16585 consensus_meta.cc:287] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.617s	user 0.008s	sys 0.004s
I20260709 13:04:42.974395 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:42.974951 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 256018us
W20260709 13:04:42.982740 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 194625us
I20260709 13:04:42.970489 12588 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:42.984372 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:42.992215 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:43.009013 13230 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
I20260709 13:04:43.007256 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:43.016455 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:42.947494 16790 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:43.018340 13231 raft_consensus.cc:2393] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 12: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:43.003198 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:43.065657 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:43.070431 12547 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:43.063216 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:43.072424 13233 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:43.061014 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:43.068913 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:42.982079 16759 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:42.961035 16804 consensus_queue.cc:1059] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.106s
I20260709 13:04:43.020531 16813 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:43.067399 12588 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:43.073531 12540 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:43.084858 12662 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:43.088431 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:42.993947 16585 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:43.091279 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:43.133786 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 66485.2us
I20260709 13:04:43.136528 12547 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:43.137331 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:43.138391 12588 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:43.150059 12540 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 10: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:04:43.178835 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 94171.9us
I20260709 13:04:43.179814 12696 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:04:43.133944 12543 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:43.181262 12540 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: [9.6-11.7]
W20260709 13:04:43.181695 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 209483us
I20260709 13:04:43.185423 13199 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:43.185636 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 47374.2us
I20260709 13:04:43.186746 13199 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:43.187945 12547 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:43.061721 16799 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:04:43.192206 12545 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:43.189208 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:43.193504 12544 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:43.070246 16305 consensus_queue.cc:1048] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.109s
I20260709 13:04:43.020954 16806 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.159s
W20260709 13:04:43.206364 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 212014us
I20260709 13:04:43.134974 16788 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:43.207230 12588 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:04:43.196621 16814 log.cc:927] Time spent T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.298s	user 0.005s	sys 0.003s
I20260709 13:04:43.215127 12621 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:04:43.218878 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:43.221109 12588 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:43.182787 16813 raft_consensus.cc:697] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:43.093456 16750 consensus_queue.cc:1059] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.114s
I20260709 13:04:43.230525 13199 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:43.191066 16736 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:43.187388 16605 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:43.191190 16535 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:43.191874 16670 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:43.191627 16823 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:43.191573 16269 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:43.193607 16820 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.218426 16663 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:43.233349 16784 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:43.232092 16788 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:43.238617 16771 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:43.237138 16758 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.259380 12662 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:43.240916 16736 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:43.243922 16535 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:43.230525 16837 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:04:43.267577 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 271555us
I20260709 13:04:43.265887 12662 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:43.269465 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:43.273209 16672 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:04:43.273298 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 61863.5us
I20260709 13:04:43.273813 16672 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:43.255719 16788 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:43.275774 13197 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:43.277670 12510 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:43.265913 16736 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:43.274235 16672 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:43.280745 12510 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:43.281926 16836 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:43.282368 16836 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:43.282727 16836 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:43.284637 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:43.284830 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:43.285434 12615 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:43.285676 12614 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:43.287403 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:43.291864 16836 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:43.294207 16836 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:43.294828 16836 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:43.296169 16836 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:43.296532 16836 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:43.296911 16836 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:43.251606 16269 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:43.249465 16670 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:43.296977 12510 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:43.268690 16535 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:43.266927 16771 raft_consensus.cc:697] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:43.269055 16644 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:43.269274 16837 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:43.302491 12510 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:43.302685 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 72289.6us
I20260709 13:04:43.279796 16788 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:43.306784 12688 raft_consensus.cc:3055] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:43.307833 16269 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:43.280529 16833 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:43.318185 12689 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:04:43.321802 12688 raft_consensus.cc:740] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:43.322682 13233 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:04:43.310892 16753 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:43.254541 16823 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:43.328226 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:43.304639 16817 log.cc:927] Time spent T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
W20260709 13:04:43.330793 16821 log.cc:927] Time spent T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:04:43.267473 16758 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:43.321254 16644 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:43.331023 12688 consensus_queue.cc:260] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:43.331032 16825 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 13:04:43.278043 16774 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:43.337069 16815 log.cc:927] Time spent T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
W20260709 13:04:43.355398 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 78527.3us
I20260709 13:04:43.332679 16833 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:43.371505 12688 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:43.355521 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 79865.9us
I20260709 13:04:43.346645 16585 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:43.361850 16662 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:43.364594 16803 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:43.332432 16790 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:43.346700 16786 consensus_meta.cc:287] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.584s	user 0.005s	sys 0.005s
I20260709 13:04:43.321125 16837 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:43.369509 12662 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:43.264200 16820 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:43.339602 16759 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:43.347774 16753 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:43.343798 16834 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:43.280514 16813 consensus_queue.cc:237] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:43.379655 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2906) took 1526 ms. Trace:
I20260709 13:04:43.356441 16644 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:43.389925 12622 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:04:43.405772 12546 rpcz_store.cc:276] 0709 13:04:41.853100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.036799 (+183699us) service_pool.cc:224] Handling call
0709 13:04:42.037120 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:42.257830 (+220710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.379307 (+1121477us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54003ad254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:43.379575 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":396695936}
I20260709 13:04:43.394260 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:43.408933 12689 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:43.410260 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:43.414726 12693 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:43.367767 16831 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:04:43.419962 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 50541.3us
W20260709 13:04:43.421067 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 92982.6us
I20260709 13:04:43.378510 16803 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:43.422606 12688 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:04:43.423171 16477 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
W20260709 13:04:43.386739 16835 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:04:43.423820 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1732) took 1552 ms. Trace:
W20260709 13:04:43.385689 16789 consensus_meta.cc:287] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.000s
I20260709 13:04:43.373890 16833 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:43.390159 16828 log.cc:927] Time spent T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:04:43.426644 12690 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:43.439646 16758 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:43.422026 12510 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:43.428462 16366 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:43.424185 12688 rpcz_store.cc:276] 0709 13:04:41.871066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.871288 (+   222us) service_pool.cc:224] Handling call
0709 13:04:41.871558 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:43.306690 (+1435132us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b540043e2a0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a94f0dc0 00007fc3a957b1c0 00007fc3a957c231 00007fc3a9578d8f 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c
0709 13:04:43.422971 (+116281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.423762 (+   791us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":710206336}
I20260709 13:04:43.436755 12693 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:04:43.377866 16842 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:43.441851 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:43.440630 16366 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:43.383126 16820 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:43.456875 12689 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:04:43.463310 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:04:43.431085 16827 log.cc:927] Time spent T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
W20260709 13:04:43.459765 16826 log.cc:927] Time spent T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 13:04:43.466672 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:43.470659 12510 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:43.448489 12614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "588a15c12a6c46ab9373c48890191400"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:60170
I20260709 13:04:43.420859 16831 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:43.471942 12614 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:43.474130 12614 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:43.476639 12510 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:43.477288 16790 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:43.479019 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 136071us
I20260709 13:04:43.462167 16366 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:43.480888 13200 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:43.469507 16822 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:43.488188 16841 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.475489 16758 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:43.476457 16831 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:43.484639 16834 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:43.497994 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1647) took 1006 ms. Trace:
I20260709 13:04:43.442575 16789 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:43.497205 12614 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:43.540056 12695 rpcz_store.cc:276] 0709 13:04:42.491340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.607845 (+116505us) service_pool.cc:224] Handling call
0709 13:04:42.608218 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:42.854519 (+246301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:42.854566 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:42.855222 (+   656us) log.cc:844] Serialized 26 byte log entry
0709 13:04:42.959464 (+104242us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:42.959518 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:42.959738 (+   220us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:43.497795 (+538057us) raft_consensus.cc:1685] finished
0709 13:04:43.497816 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:43.497938 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":245856,"raft.queue_time_us":249827,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":103838,"threads_started":1,"wal-append.queue_time_us":221179}
I20260709 13:04:43.539381 16842 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:04:43.542591 12614 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:43.498621 16670 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:43.544338 16834 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:43.544866 16834 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:43.500403 16843 consensus_queue.cc:1059] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:04:43.501058 16844 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:43.503835 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 3139) took 1617 ms. Trace:
I20260709 13:04:43.504385 12618 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:43.505649 16832 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:43.547170 16844 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:43.441610 16771 consensus_queue.cc:237] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:43.549002 16792 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:43.549413 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 930) took 1331 ms. Trace:
I20260709 13:04:43.549816 12618 rpcz_store.cc:276] 0709 13:04:42.217881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.594450 (+376569us) service_pool.cc:224] Handling call
0709 13:04:43.504212 (+909762us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:43.547769 (+ 43557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.549213 (+  1444us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b54003af2d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:43.549351 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2061739904}
I20260709 13:04:43.550601 16756 raft_consensus.cc:3055] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:43.514389 16774 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:43.518296 16823 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:43.522996 16674 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:43.553440 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:43.555631 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:43.556180 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:43.557226 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:43.557785 13227 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:43.557899 13230 raft_consensus.cc:1240] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:43.559098 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:43.559484 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:43.560156 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:43.560863 13231 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:43.560954 13233 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 12: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:43.561081 16790 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:43.562098 12618 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:43.562399 16816 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:43.563892 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:43.562122 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 81328.4us
I20260709 13:04:43.567770 16844 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:43.568511 13227 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:04:43.569828 16789 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:43.537221 16841 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:43.571959 16841 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:43.572943 16619 consensus_queue.cc:1059] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:04:43.574146 16662 raft_consensus.cc:3055] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:43.574503 16662 raft_consensus.cc:740] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:43.575317 16662 consensus_queue.cc:260] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:43.579629 16645 consensus_meta.cc:287] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.735s	user 0.008s	sys 0.004s
I20260709 13:04:43.579180 16672 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:43.517450 16533 raft_consensus.cc:3055] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:04:43.591915 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 277345us
I20260709 13:04:43.524012 16597 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.495103 16803 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:43.595690 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:43.526029 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:43.546598 16758 raft_consensus.cc:697] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:43.547964 16832 raft_consensus.cc:697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:43.547152 12619 rpcz_store.cc:276] 0709 13:04:41.886574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.889115 (+  2541us) service_pool.cc:224] Handling call
0709 13:04:42.160558 (+271443us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b58001f4198. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae53f0a0 00007fc3ae53e984 00007fc3a7ab96d4 00007fc3a7ab9662
0709 13:04:43.503614 (+1343056us) spinlock_profiling.cc:243] Waited 98.4 ms on lock 0x7b54003af2d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:43.503739 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251742720}
I20260709 13:04:43.551126 16756 raft_consensus.cc:740] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:43.520980 12513 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:04:43.540588 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 58790.1us
W20260709 13:04:43.602388 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:43.603108 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 82255us
I20260709 13:04:43.589020 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:43.589778 12512 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:43.522301 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:43.595857 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:43.531767 13234 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: []
W20260709 13:04:43.597460 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 71544.3us
I20260709 13:04:43.636605 12662 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:43.588126 12618 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
I20260709 13:04:43.600399 12659 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:43.602033 12510 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:43.633088 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:43.635350 12687 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:04:43.592499 16533 raft_consensus.cc:740] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:43.644596 12662 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:04:43.645424 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 83873.8us
W20260709 13:04:43.645597 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 43671.8us
I20260709 13:04:43.600342 16670 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:43.646797 12510 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:43.647610 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:43.648959 13227 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
W20260709 13:04:43.649747 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 49707.5us
I20260709 13:04:43.648277 12512 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:43.650475 12662 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:43.582286 16788 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:43.582854 16736 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:43.630920 16792 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:43.653165 12659 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:43.653538 12510 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:43.640182 16842 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:43.658280 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:43.599020 16841 consensus_queue.cc:1059] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:04:43.647882 16823 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:43.647754 16789 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:43.600234 16597 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:43.649076 16803 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:43.649207 16843 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:43.656512 13227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:04:43.670926 13227 raft_consensus.cc:606] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:04:43.654904 16627 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:43.655056 16753 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:43.677448 16848 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:43.674340 16627 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:43.681938 16477 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:43.683595 16858 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:43.651294 16822 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:04:43.657805 16672 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:43.692230 16771 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.649708 16541 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:04:43.660884 16645 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:43.711143 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:43.711882 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 60151.9us
I20260709 13:04:43.652496 16585 consensus_queue.cc:1059] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:04:43.725613 16841 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.704599 16792 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:43.725770 16771 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:43.726173 16841 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:43.728135 16771 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:43.728482 16841 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:43.665385 16758 consensus_queue.cc:237] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:43.730036 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:43.731468 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:43.731598 16644 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:43.732070 13233 raft_consensus.cc:3055] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:43.731812 16366 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:43.732445 13233 raft_consensus.cc:740] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:43.702479 16832 consensus_queue.cc:237] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:43.735005 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:43.735309 16736 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:43.665867 16842 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:43.736356 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:43.738135 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:43.739866 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:43.740486 12618 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:43.741504 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:43.721205 12512 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:04:43.714165 16455 consensus_meta.cc:287] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.878s	user 0.011s	sys 0.001s
I20260709 13:04:43.657246 16759 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:04:43.721100 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:43.752449 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:43.753510 13231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:04:43.754413 13231 raft_consensus.cc:606] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:43.754853 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:43.722987 16823 raft_consensus.cc:697] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:43.675603 16843 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:04:43.763561 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:43.763832 16843 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:43.717850 16858 raft_consensus.cc:697] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:43.765329 16858 consensus_queue.cc:237] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:43.766882 16859 log.cc:927] Time spent T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:04:43.767032 16597 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:43.720791 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:43.738555 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:43.747035 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:43.708712 16627 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:43.748997 12616 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:43.750682 12659 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:43.716215 16848 raft_consensus.cc:697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:43.759531 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:43.761390 13230 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:43.715482 16477 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:43.762714 13232 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:04:43.763024 12588 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:43.733340 13233 consensus_queue.cc:260] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:43.737871 16842 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:43.771994 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 118546us
I20260709 13:04:43.775120 13235 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 12: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:43.736922 16535 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:43.776374 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 55933.9us
I20260709 13:04:43.791132 12510 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:43.778946 16852 consensus_queue.cc:1059] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:04:43.713054 16836 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:43.779305 16846 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:43.805262 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:43.805982 12545 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:43.664247 16756 consensus_queue.cc:260] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:43.780686 13233 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:43.782090 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:43.815233 13230 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:04:43.785244 16645 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:43.796603 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:43.836989 12691 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:43.799157 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:43.837263 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:43.838369 12688 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:43.818019 13227 raft_consensus.cc:1240] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:43.820737 12545 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:43.725797 16834 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:43.822630 16366 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:43.823563 16833 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:43.802053 16736 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:43.825963 16848 consensus_queue.cc:237] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:43.807471 16846 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:43.826929 16837 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:43.828609 16756 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:43.830503 16535 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:43.832612 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:43.832901 16477 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:43.834276 16788 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:43.833849 16823 consensus_queue.cc:237] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:43.779316 16644 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:43.835608 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1627) took 1785 ms. Trace:
I20260709 13:04:43.751657 16455 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:43.844805 12512 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:43.796195 12510 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:43.853209 13230 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:43.811879 16758 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:43.859153 13233 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:43.860694 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:43.836679 16645 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:43.868602 12691 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:04:43.852530 16670 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:43.928948 16615 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:43.889681 13231 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:43.931196 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:43.807116 16831 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:43.862643 16846 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:43.890673 12694 rpcz_store.cc:276] 0709 13:04:42.050491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.154628 (+104137us) service_pool.cc:224] Handling call
0709 13:04:42.154983 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:42.226423 (+ 71440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:42.226456 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:42.226937 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:04:42.490234 (+263297us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:42.490275 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.813700 (+1323425us) spinlock_profiling.cc:243] Waited 71 ms on lock 0x7b540009c754. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:43.813749 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:43.813803 (+    54us) raft_consensus.cc:1685] finished
0709 13:04:43.813816 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:43.835552 (+ 21736us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1159,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"spinlock_wait_cycles":163344768,"thread_start_us":262878,"threads_started":1,"wal-append.queue_time_us":305842,"wal-append.run_cpu_time_us":1694,"wal-append.run_wall_time_us":1001705}
I20260709 13:04:43.848831 16813 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
W20260709 13:04:43.911954 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:43.918423 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 73695.8us
W20260709 13:04:43.927326 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 131294us
I20260709 13:04:43.943018 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:43.928763 16645 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:43.939045 16744 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:43.961508 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:43.962410 16831 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:43.962262 16744 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:43.938804 16788 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:04:43.942101 16782 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:43.964600 16744 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:43.887866 16597 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:43.860791 16736 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:43.929657 16618 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:04:43.967345 16618 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:43.967787 16618 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:04:43.936055 12690 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:04:43.968685 16736 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:43.969349 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:43.970738 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:43.936884 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:43.937686 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:43.971827 13228 raft_consensus.cc:1240] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:43.941708 12512 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:43.911072 16865 raft_consensus.cc:3055] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:43.972712 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:43.973542 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:43.929373 16585 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:43.983340 12690 raft_consensus.cc:2368] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11.
I20260709 13:04:43.987950 12538 raft_consensus.cc:1275] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:04:43.987917 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:43.989810 12538 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:04:43.991034 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:43.991942 12540 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:43.992015 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:43.992969 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:43.994621 12541 raft_consensus.cc:1275] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:43.994691 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:43.993049 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:44.003402 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:44.004552 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:44.004654 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 63019.2us
I20260709 13:04:43.941994 16366 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:44.016691 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:44.008610 12544 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:44.011942 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:44.018656 12540 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 12: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:44.014601 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:43.975834 16865 raft_consensus.cc:740] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:04:43.997270 16863 log.cc:927] Time spent T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:04:43.932919 16670 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:44.043675 12547 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:04:44.047217 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 3150) took 1336 ms. Trace:
I20260709 13:04:44.047833 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:44.047670 12622 rpcz_store.cc:276] 0709 13:04:42.710336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.722594 (+ 12258us) service_pool.cc:224] Handling call
0709 13:04:44.047029 (+1324435us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54001e91d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:44.047157 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1472905600}
I20260709 13:04:44.009107 16822 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:44.056841 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:43.994115 16842 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:04:44.024575 16789 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:44.065701 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:44.068181 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:44.056628 16843 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:44.079481 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:44.085265 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:44.097935 16868 log.cc:927] Time spent T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:04:44.099452 16645 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:44.102370 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:44.104739 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:44.105305 16837 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:44.014683 16753 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
W20260709 13:04:44.112689 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.102638 12695 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:04:44.105453 12689 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:44.001751 16627 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:44.113538 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.141978 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:44.142526 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:44.135919 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:44.137410 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:44.138721 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:44.038112 16858 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:44.145684 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:44.153784 12617 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:44.061408 16822 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:44.151422 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:44.168642 12694 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 13: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:44.168880 12613 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:44.166805 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:44.167987 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.173519 12510 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:44.181910 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:44.183349 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:44.184445 12689 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 9: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:44.041553 16366 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:44.187040 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:44.191026 12690 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 10: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:44.133982 16792 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:44.210481 12617 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:04:44.194496 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:44.212396 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:44.213143 12547 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:44.195130 16802 raft_consensus.cc:3055] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:44.196677 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:44.103629 16865 consensus_queue.cc:260] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:44.197544 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 1752) took 1293 ms. Trace:
I20260709 13:04:44.190562 16645 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:44.190858 16599 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:04:44.198987 16585 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:44.190135 16753 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:44.199662 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:44.202039 13230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd40576623a84072be59a32d23cda14b"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:04:44.203984 16618 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:44.199172 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 549079us
I20260709 13:04:44.148428 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:44.186833 16838 log.cc:927] Time spent T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:04:44.179580 16822 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:44.180230 16789 raft_consensus.cc:697] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 11 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:44.241693 16782 raft_consensus.cc:697] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:44.249588 16789 consensus_queue.cc:237] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:44.239388 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 71988.5us
I20260709 13:04:44.251073 12588 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:44.251827 16799 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:44.222823 16802 raft_consensus.cc:740] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:44.252175 16799 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:44.252581 16799 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:44.252836 16802 consensus_queue.cc:260] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:44.254096 16802 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:44.223148 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:44.227041 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:44.258036 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:44.206928 16650 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:04:44.260181 16799 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:44.238407 13230 raft_consensus.cc:606] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:44.249723 16782 consensus_queue.cc:237] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:44.242381 12513 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:44.222095 12696 rpcz_store.cc:276] 0709 13:04:42.904159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.960412 (+ 56253us) service_pool.cc:224] Handling call
0709 13:04:44.197384 (+1236972us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54001b5654. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:44.197489 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411274496}
I20260709 13:04:44.264531 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:44.265539 16650 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:44.231081 16834 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:44.266122 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:44.268177 16799 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:44.269788 16799 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:44.270869 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:44.161480 16744 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 13:04:44.221534 12613 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:04:44.289057 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:44.291226 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.288668 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:44.297901 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:44.300208 12547 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:04:44.296756 12545 raft_consensus.cc:2393] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 6: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:44.294329 12588 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:44.301939 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:44.167309 16858 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:44.306499 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:44.307627 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 134252us
I20260709 13:04:44.316645 16858 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:44.317178 16858 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:44.264943 16822 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:44.318657 16858 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:44.320799 16822 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:44.311439 12688 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:44.321931 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:44.306418 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:44.322980 12688 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:44.323709 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:44.324368 12540 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:44.325209 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:44.325757 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:44.326351 12547 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:44.292138 16650 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:44.328434 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:44.331027 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:44.335289 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:44.302142 16842 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:44.336560 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:44.304586 16455 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:44.339546 12540 raft_consensus.cc:2393] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 7: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:44.340512 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:04:44.342255 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 48050.1us
I20260709 13:04:44.344794 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:44.345956 13199 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:44.348124 16858 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:44.348337 13199 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:44.348835 16871 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 13:04:44.348940 16858 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:44.349789 16819 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:44.350409 13199 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:44.275151 16753 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:44.350234 16819 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:44.298561 16799 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:04:44.348290 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:44.356520 16719 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:44.302220 16585 consensus_queue.cc:1059] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:04:44.364707 12547 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
W20260709 13:04:44.371886 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 223544us
I20260709 13:04:44.377151 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:44.379987 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1087) took 1376 ms. Trace:
I20260709 13:04:44.383518 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:44.396647 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:44.400691 12694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb9d67599bec471cb17398de70b43841"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:04:44.404217 12687 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:44.380399 13234 rpcz_store.cc:276] 0709 13:04:43.003112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.003251 (+   139us) service_pool.cc:224] Handling call
0709 13:04:43.063571 (+ 60320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:43.636063 (+572492us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.379770 (+743707us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b5400740254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:44.379929 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1075876352}
I20260709 13:04:44.407932 12587 leader_election.cc:400] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11.
I20260709 13:04:44.408319 12587 leader_election.cc:403] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:04:44.408484 12688 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:44.361760 16819 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:44.354126 16842 raft_consensus.cc:697] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:04:44.423045 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 78464.2us
I20260709 13:04:44.371002 16719 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:44.422212 12688 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:44.354185 16886 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:44.424356 12588 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:44.434105 12694 raft_consensus.cc:606] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:44.434800 12694 raft_consensus.cc:614] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:44.432809 12662 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:44.420382 16803 consensus_meta.cc:287] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.748s	user 0.012s	sys 0.000s
I20260709 13:04:44.441242 12662 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:44.443099 12662 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:44.426563 16599 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11.
W20260709 13:04:44.461684 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.427526 16650 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:44.504899 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 124272us
I20260709 13:04:44.447307 12662 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:44.437803 16843 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:44.420022 16788 consensus_queue.cc:1059] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:04:44.450467 16803 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:44.595372 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.449838 16627 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:44.439327 16645 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:44.445891 16891 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:44.478024 16744 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:44.482354 16896 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:44.455541 16420 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:44.599594 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 152348us
I20260709 13:04:44.659668 12662 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:44.453428 16644 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
W20260709 13:04:44.631932 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 94020.2us
I20260709 13:04:44.537348 16674 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:44.598559 16841 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:44.662822 12688 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:44.647689 16618 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:44.678282 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 328798us
I20260709 13:04:44.690778 13199 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:44.671907 16890 log.cc:927] Time spent T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:04:44.662879 16627 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:44.603358 16886 consensus_queue.cc:1059] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.086s
W20260709 13:04:44.731441 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 71881.5us
I20260709 13:04:44.737323 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:44.753886 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 63195.5us
I20260709 13:04:44.755024 13199 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:44.741384 12693 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
W20260709 13:04:44.760149 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:44.766417 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.649058 16645 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:44.774838 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.779677 13199 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:44.691874 16477 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:04:44.782012 12538 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.002s	sys 0.056s
W20260709 13:04:44.782380 12538 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.002s	sys 0.056s
I20260709 13:04:44.784286 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:44.711392 16803 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:44.786273 13228 raft_consensus.cc:1240] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:44.787001 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 189324us
I20260709 13:04:44.730964 16644 consensus_queue.cc:1243] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:04:44.711669 16896 raft_consensus.cc:697] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:44.730283 16802 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:44.737609 16627 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:44.762903 16849 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:44.805272 13199 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:44.694198 16841 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:44.792255 16477 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:44.817646 16899 log.cc:927] Time spent T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:04:44.819334 16841 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:04:44.821451 16893 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.338s	user 0.001s	sys 0.001s
I20260709 13:04:44.794011 16366 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:44.808894 16627 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:44.786767 16753 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:44.809978 16820 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:44.807228 16802 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:44.649148 16842 consensus_queue.cc:237] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:44.786725 16719 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:44.787427 16900 raft_consensus.cc:3055] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:44.800763 16803 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:44.833526 16756 consensus_meta.cc:287] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.965s	user 0.005s	sys 0.005s
I20260709 13:04:44.855765 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:44.858019 13228 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:44.838186 16851 raft_consensus.cc:993] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:04:44.858330 13199 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:44.859565 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 196819us
W20260709 13:04:44.860329 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 123095us
I20260709 13:04:44.865067 12695 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:04:44.865587 12695 pending_rounds.cc:85] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 6
I20260709 13:04:44.865854 12695 pending_rounds.cc:107] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:04:44.866110 12695 raft_consensus.cc:2889] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:44.835632 16645 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:44.834985 16820 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:04:44.867834 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 408161us
I20260709 13:04:44.870370 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:44.863349 12587 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:44.850528 16900 raft_consensus.cc:740] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:44.811208 16887 consensus_queue.cc:1059] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:04:44.852939 16836 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:44.884328 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:44.854187 16792 raft_consensus.cc:3055] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:44.856050 16802 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:44.855332 16803 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:44.868357 16849 raft_consensus.cc:1081] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:04:44.870924 16719 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:44.887872 16599 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:44.897897 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:44.843669 16896 consensus_queue.cc:237] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:44.902312 16898 log.cc:927] Time spent T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:04:44.899881 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:44.873922 16851 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:04:44.897118 16906 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:44.870929 16905 consensus_queue.cc:1059] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:04:44.897112 16792 raft_consensus.cc:740] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:44.899017 16782 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:44.927165 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:44.988344 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 118269us
I20260709 13:04:44.992832 16477 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:44.998639 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:44.999743 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 947) took 1260 ms. Trace:
I20260709 13:04:45.000066 12620 rpcz_store.cc:276] 0709 13:04:43.739180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.739662 (+   482us) service_pool.cc:224] Handling call
0709 13:04:44.998485 (+1258823us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b58001f4198. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae53f0a0 00007fc3ae53e984 00007fc3a7ab96d4 00007fc3a7ab9662
0709 13:04:44.999675 (+  1190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5939072}
I20260709 13:04:45.003449 16831 consensus_queue.cc:1059] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:45.005728 16831 raft_consensus.cc:3055] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:45.006108 16831 raft_consensus.cc:740] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:45.006918 16831 consensus_queue.cc:260] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.008263 16831 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:45.018795 16900 consensus_queue.cc:260] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:44.904639 16915 consensus_queue.cc:1059] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:04:45.024183 16627 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:45.028760 16846 consensus_meta.cc:287] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 1.066s	user 0.007s	sys 0.003s
I20260709 13:04:45.030640 16670 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:45.031424 16732 raft_consensus.cc:3055] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:45.033783 16792 consensus_queue.cc:260] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:44.939494 16740 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.068056 16740 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:45.070236 16740 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:44.913360 16599 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 13:04:45.070695 16843 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:44.957336 16906 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:04:45.036082 16910 log.cc:927] Time spent T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:04:45.044952 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:45.061810 16902 log.cc:927] Time spent T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:04:45.074193 12512 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:45.076097 16903 log.cc:927] Time spent T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.387s	user 0.003s	sys 0.001s
I20260709 13:04:45.076936 16897 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:45.077704 16802 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:45.078099 16802 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:45.078424 16802 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:45.079181 16585 consensus_queue.cc:1059] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:45.081409 16753 raft_consensus.cc:3055] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:45.081811 16753 raft_consensus.cc:740] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:45.082671 16753 consensus_queue.cc:260] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:45.083298 16819 consensus_meta.cc:287] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.646s	user 0.011s	sys 0.000s
I20260709 13:04:45.060992 16846 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.084556 12546 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:45.083751 16819 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.085747 16846 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:45.086912 16819 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:45.035925 16914 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:45.064807 16865 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:45.066057 16916 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:04:45.066203 16669 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:45.083866 16753 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:45.060494 16732 raft_consensus.cc:740] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:45.062765 16233 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:45.093822 12688 raft_consensus.cc:1240] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:04:45.104209 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:04:45.110625 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 246497us
I20260709 13:04:45.100267 16789 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.108260 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:45.060820 16915 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.106546 12691 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:04:45.103130 16841 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.119283 12691 pending_rounds.cc:85] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 6
I20260709 13:04:45.132290 12691 pending_rounds.cc:107] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:04:45.132117 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:45.132543 12691 raft_consensus.cc:2889] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:45.132931 12689 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:45.135602 12512 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:45.139631 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:45.139757 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:45.140846 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.117781 16803 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:45.103401 16914 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:45.148633 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:45.150926 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:45.151839 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:45.151959 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:45.152664 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:45.153591 13234 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:04:45.154619 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:45.158015 12512 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:45.150789 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:45.149260 12541 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:45.161552 13226 raft_consensus.cc:2393] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 10: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:45.167266 12691 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:45.137954 16771 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:45.116272 16876 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.161717 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:45.172966 13234 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:04:45.138934 16842 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:45.169307 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:45.174299 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:04:45.176362 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 278529us
I20260709 13:04:45.177088 12588 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:45.177276 12512 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:04:45.181346 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:45.195658 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.131374 16789 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:45.135850 16841 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:45.170048 16790 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:45.136762 16915 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.146762 16740 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 13:04:45.173978 16897 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.181108 16842 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:45.235210 12545 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:45.237150 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:45.238102 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 1009) took 1185 ms. Trace:
W20260709 13:04:45.240931 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.233031 12512 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:45.239396 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:45.238696 12693 rpcz_store.cc:276] 0709 13:04:44.052399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.214614 (+162215us) service_pool.cc:224] Handling call
0709 13:04:45.237876 (+1023262us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b54003ea8d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:45.238030 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":923467520}
I20260709 13:04:45.246390 12693 raft_consensus.cc:1275] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:45.227789 16907 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:45.169004 16803 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.179917 16710 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
W20260709 13:04:45.251433 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 74412.2us
I20260709 13:04:45.243462 16842 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:45.257011 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:04:45.259599 12588 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:45.147689 16732 consensus_queue.cc:260] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.221367 16771 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.244148 16846 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:04:45.252193 16774 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:45.254029 16420 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:04:45.273502 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.181783 16876 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.259037 16585 consensus_queue.cc:1048] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:04:45.279253 16888 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:04:45.280305 16914 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:45.282882 16803 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:45.284085 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:45.278239 16732 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:45.247901 16897 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.284195 16841 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:45.308727 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:45.315229 12616 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:45.309774 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:45.309864 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:45.310858 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:04:45.316197 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.318532 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:45.319131 12618 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:45.317477 12613 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:45.319937 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:45.320439 12618 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:45.276502 16846 raft_consensus.cc:697] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:45.254825 16907 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:45.319137 12510 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:45.337728 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:45.342139 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:45.343964 12540 raft_consensus.cc:1275] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:45.314733 16914 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:04:45.278712 16774 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.272516 16533 consensus_queue.cc:260] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.351100 12689 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:04:45.331092 16920 log.cc:927] Time spent T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:04:45.359409 12620 raft_consensus.cc:2393] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 6: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:04:45.357064 16933 log.cc:927] Time spent T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:04:45.357738 16789 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:45.359956 12621 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:45.323745 16740 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:45.365229 12616 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:04:45.324059 16888 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:45.366420 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:45.369180 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 755) took 1642 ms. Trace:
W20260709 13:04:45.370669 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 72584.7us
I20260709 13:04:45.346575 16790 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:45.369524 13227 rpcz_store.cc:276] 0709 13:04:43.726468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.768703 (+ 42235us) service_pool.cc:224] Handling call
0709 13:04:43.769013 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:43.840037 (+ 71024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.369018 (+1528981us) spinlock_profiling.cc:243] Waited 48.8 ms on lock 0x7b5400750dd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:45.369138 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112274816}
I20260709 13:04:45.372943 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:45.379647 12618 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:45.380445 12613 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:04:45.380512 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:45.382175 12613 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:45.383599 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:45.385437 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:45.393033 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:45.393905 12693 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:45.395099 12621 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:45.395097 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:45.395776 12587 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:45.400923 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:45.406188 16918 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:45.406456 16662 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:45.406811 16918 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:45.407328 16918 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:45.384459 16876 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:45.392663 16839 raft_consensus.cc:3055] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:45.393227 16914 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:45.374594 16888 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.376775 16740 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.401548 16774 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:45.402987 16915 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:45.411002 16841 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.440374 12691 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:04:45.445818 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:45.447554 13226 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:04:45.450977 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.451689 12510 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:45.453054 12588 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:45.454581 16892 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.756s	user 0.002s	sys 0.003s
I20260709 13:04:45.446506 13229 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:45.424928 16839 raft_consensus.cc:740] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:45.459466 16803 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:45.430510 16914 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:45.505880 12662 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:45.462934 16897 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:45.463502 16771 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:45.464145 16907 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:45.455523 16753 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:45.466845 16833 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:45.466630 16802 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:45.515857 16802 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:45.467283 16719 consensus_meta.cc:287] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.562s	user 0.005s	sys 0.005s
I20260709 13:04:45.516520 16719 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:45.469300 16888 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:45.517400 12538 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:04:45.433226 16917 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.475095 12588 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:45.519155 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 44136.4us
I20260709 13:04:45.520226 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:45.458487 12510 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:45.400462 16846 consensus_queue.cc:237] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:45.455152 16756 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.508724 16914 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:45.509351 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:45.497048 16599 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:45.526772 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1902) took 1387 ms. Trace:
I20260709 13:04:45.527338 12618 raft_consensus.cc:1275] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:45.518266 16917 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.525620 16926 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:45.457321 16841 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.539201 12690 raft_consensus.cc:3055] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:04:45.512378 16831 consensus_meta.cc:287] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.502s	user 0.008s	sys 0.005s
W20260709 13:04:45.528857 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 74714us
I20260709 13:04:45.547297 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:45.548302 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:45.524192 16761 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:45.530586 12539 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:04:45.557822 16541 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.558370 16541 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:45.558851 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:45.559732 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.537997 16833 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:45.506969 16803 consensus_queue.cc:1243] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:04:45.539430 12613 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:45.539605 12690 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:45.543520 16841 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:45.526593 16756 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:45.526348 16771 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:45.545975 16913 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:45.573804 16919 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:45.496925 16934 consensus_queue.cc:1048] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:04:45.527189 12619 rpcz_store.cc:276] 0709 13:04:44.139553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.140622 (+  1069us) service_pool.cc:224] Handling call
0709 13:04:44.140959 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:44.141326 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.141359 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:44.161445 (+ 20086us) log.cc:844] Serialized 26 byte log entry
0709 13:04:44.367288 (+205843us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:44.367334 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:44.367397 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:45.443670 (+1076273us) spinlock_profiling.cc:243] Waited 56.7 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:04:45.518430 (+ 74760us) raft_consensus.cc:1685] finished
0709 13:04:45.518452 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:45.526702 (+  8250us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8236,"raft.queue_time_us":523,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":14465,"spinlock_wait_cycles":130407680,"thread_start_us":140570,"threads_started":1,"wal-append.queue_time_us":324545}
I20260709 13:04:45.560624 13200 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:45.561347 13227 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:45.557520 16802 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:45.561703 12510 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:45.546749 16233 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:45.580490 16840 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:45.567026 16888 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:45.574540 12690 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.576028 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1899) took 1470 ms. Trace:
I20260709 13:04:45.546978 16914 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:45.588153 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:45.561973 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:45.592191 13228 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:04:45.557542 16761 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:45.590507 12690 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:45.590212 12614 rpcz_store.cc:276] 0709 13:04:44.105332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.105479 (+   147us) service_pool.cc:224] Handling call
0709 13:04:44.105949 (+   470us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:44.135733 (+ 29784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.135767 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:45.460518 (+1324751us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b2c0004c3c8. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:04:45.460929 (+   411us) log.cc:844] Serialized 26 byte log entry
0709 13:04:45.567862 (+106933us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:45.567896 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.567972 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:45.575611 (+  7639us) raft_consensus.cc:1685] finished
0709 13:04:45.575642 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:45.575950 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1396,"raft.queue_time_us":17397,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":21825,"spinlock_wait_cycles":11777920,"thread_start_us":106589,"threads_started":1,"wal-append.queue_time_us":109590}
I20260709 13:04:45.572821 16926 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.577476 16843 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:04:45.597620 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:45.579049 16833 raft_consensus.cc:697] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:45.603466 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:45.573999 16753 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:04:45.586263 16849 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:45.590049 16789 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:45.595261 16761 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:45.584797 16233 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:45.593186 16802 raft_consensus.cc:697] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:45.597479 16790 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:45.593681 16865 consensus_queue.cc:1048] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:04:45.607429 16849 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:45.629833 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:45.596544 16914 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.572535 16839 consensus_queue.cc:260] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:45.632331 12615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1903) took 1490 ms (client timeout 1852 ms). Trace:
I20260709 13:04:45.580585 16913 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:45.636790 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 889) took 2991 ms. Trace:
I20260709 13:04:45.607833 16846 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 13:04:45.634959 12615 rpcz_store.cc:269] 0709 13:04:44.142044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.142202 (+   158us) service_pool.cc:224] Handling call
0709 13:04:45.630702 (+1488500us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b54002a67d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:45.632265 (+  1563us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1700263168}
I20260709 13:04:45.637254 12542 rpcz_store.cc:276] 0709 13:04:42.644991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:42.645123 (+   132us) service_pool.cc:224] Handling call
0709 13:04:43.380332 (+735209us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:43.380814 (+   482us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:43.380856 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:43.428549 (+ 47693us) log.cc:844] Serialized 26 byte log entry
0709 13:04:43.475760 (+ 47211us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:43.475801 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:43.475868 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:43.683979 (+208111us) raft_consensus.cc:1685] finished
0709 13:04:43.684008 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:45.632882 (+1948874us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b54003ad250. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:45.636701 (+  3819us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16690,"raft.queue_time_us":13192,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":19333,"spinlock_wait_cycles":1689941888,"thread_start_us":46775,"threads_started":1,"wal-append.queue_time_us":104523,"wal-append.run_cpu_time_us":2552,"wal-append.run_wall_time_us":1148685}
I20260709 13:04:45.640086 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:45.584493 16918 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:45.634519 16901 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.018s	sys 0.000s
I20260709 13:04:45.630991 16849 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:45.677923 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:45.634758 16888 raft_consensus.cc:697] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:45.601950 16840 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.685352 16615 raft_consensus.cc:3055] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:45.685846 16615 raft_consensus.cc:740] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:45.686659 16615 consensus_queue.cc:260] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:45.691279 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:45.692430 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:45.624699 16790 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.697381 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:45.698067 12545 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:04:45.701208 16233 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:45.637451 16831 consensus_queue.cc:1059] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
W20260709 13:04:45.683027 16901 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.020s	sys 0.000s
I20260709 13:04:45.705188 12690 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:04:45.712520 16926 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:45.714494 16914 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:45.699270 16843 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.719453 16888 consensus_queue.cc:237] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.702831 16802 consensus_queue.cc:237] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:45.722569 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.687861 16615 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:45.732919 12690 pending_rounds.cc:85] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 9
I20260709 13:04:45.739607 12690 pending_rounds.cc:107] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:04:45.739965 12690 raft_consensus.cc:2889] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:45.742718 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:45.677228 16833 consensus_queue.cc:237] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.751580 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:45.742301 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1011) took 1689 ms. Trace:
I20260709 13:04:45.755117 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 905) took 1961 ms. Trace:
I20260709 13:04:45.755568 12546 rpcz_store.cc:276] 0709 13:04:43.802870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.810194 (+  7324us) service_pool.cc:224] Handling call
0709 13:04:43.810514 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:45.084910 (+1274396us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.754850 (+669940us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54003bddd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:45.755051 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2929634688}
I20260709 13:04:45.753633 12545 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:45.734361 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:45.679409 16917 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:45.737927 16843 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:45.733274 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 148436us
I20260709 13:04:45.759281 16918 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:45.760411 16541 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:45.767372 16744 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:45.795923 16758 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.774667 16790 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:45.778787 16922 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.648s	user 0.003s	sys 0.000s
W20260709 13:04:45.783483 16858 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:04:45.783138 16761 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.784540 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:45.787915 13232 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:04:45.793521 12540 raft_consensus.cc:2393] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 9: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:45.768857 16840 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:45.790026 16842 consensus_meta.cc:287] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.519s	user 0.005s	sys 0.006s
I20260709 13:04:45.812181 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:45.815063 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:45.810853 12545 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: []
W20260709 13:04:45.824100 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:45.753268 12690 rpcz_store.cc:276] 0709 13:04:44.052881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.402603 (+349722us) service_pool.cc:224] Handling call
0709 13:04:44.402944 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:45.539112 (+1136168us) spinlock_profiling.cc:243] Waited 43.5 ms on lock 0x7b5400438da0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a94f0dc0 00007fc3a957b1c0 00007fc3a957c231 00007fc3a9578d8f 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c
0709 13:04:45.742025 (+202913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.742245 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":100079488}
I20260709 13:04:45.804507 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:45.805433 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:45.810070 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:45.826990 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:45.797120 16913 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:45.835922 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:45.828097 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:45.838587 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:45.838881 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:45.839289 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:45.839679 12614 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:04:45.840322 12690 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 11: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:45.811934 16941 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.845990 12613 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:45.796401 16744 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.846572 12615 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 13: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:45.847750 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:45.819154 16940 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.851794 12618 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:45.817377 16771 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:45.816550 16918 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:45.853700 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:45.796610 16758 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.855189 12540 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:45.841210 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:45.858397 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:45.860280 12615 raft_consensus.cc:2368] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 10. Current term is 11.
I20260709 13:04:45.838351 16740 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:45.833138 16908 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:45.865404 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:04:45.869045 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 280552us
I20260709 13:04:45.869343 12690 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:45.876394 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:45.868928 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:45.861320 12545 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:04:45.877394 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:45.877693 12613 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:04:45.880239 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:45.830147 16842 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.858876 16771 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.885788 16951 consensus_queue.cc:1059] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:45.886897 16619 raft_consensus.cc:3055] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:45.887277 16619 raft_consensus.cc:740] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:45.887507 16771 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:45.888157 16619 consensus_queue.cc:260] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.889537 16619 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:45.890704 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:45.859489 16940 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.894838 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:45.898243 12543 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 10: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:45.861337 16918 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.880249 16761 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:45.904897 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:45.853760 16941 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.893883 16740 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:45.870337 16908 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:45.914160 12617 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:04:45.890050 16951 consensus_queue.cc:1059] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:04:45.902909 16833 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:45.919190 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:45.922900 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:45.941583 12690 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:04:45.942517 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:45.948261 16954 log.cc:927] Time spent T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:04:45.950675 12690 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 11: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:45.958535 12693 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:45.958756 12690 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:45.959901 12693 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:46.011693 12546 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:45.917614 16761 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:45.902962 16844 consensus_queue.cc:1059] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:04:46.019479 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:46.027941 12540 raft_consensus.cc:2410] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:04:46.034570 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.040647 12691 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:46.012908 16233 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.012128 16759 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:46.013195 16843 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:46.061280 16759 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:46.062949 16930 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.740s	user 0.001s	sys 0.002s
I20260709 13:04:46.064569 16759 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:46.064833 16952 log.cc:927] Time spent T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 13:04:45.921032 16740 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:46.068478 16917 raft_consensus.cc:993] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: : Instructing follower a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:04:46.069175 16917 raft_consensus.cc:1081] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Signalling peer a70479a3b4114f3581095e9890f5d653 to start an election
I20260709 13:04:46.014062 16849 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:46.078615 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:46.080809 12622 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:45.959926 16833 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:46.026340 16761 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:46.087673 16867 log.cc:927] Time spent T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 2.115s	user 0.002s	sys 0.008s
W20260709 13:04:46.095567 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 129694us
I20260709 13:04:46.082239 16744 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:46.071831 16233 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:46.086654 16758 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:46.108788 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:46.127765 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 756) took 2399 ms. Trace:
I20260709 13:04:46.111526 12659 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:46.128188 13231 rpcz_store.cc:276] 0709 13:04:43.726712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.771301 (+ 44589us) service_pool.cc:224] Handling call
0709 13:04:43.771609 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:43.930424 (+158815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.125854 (+2195430us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54006315d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:46.126029 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270890368}
I20260709 13:04:46.130230 12659 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:46.132227 12659 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
W20260709 13:04:46.133289 16965 log.cc:927] Time spent T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:04:46.138263 16844 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.142868 16844 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:46.131253 16915 consensus_queue.cc:1059] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:04:46.146503 16915 raft_consensus.cc:3055] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:46.146896 16915 raft_consensus.cc:740] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:46.146987 16233 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:46.147842 16915 consensus_queue.cc:260] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:46.148341 16756 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:46.148245 13230 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:46.149114 16915 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:46.151542 12693 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:46.134477 16744 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:46.135810 16913 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:46.143376 16959 log.cc:927] Time spent T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:04:46.139629 13231 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:46.155985 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:46.157815 12659 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:46.158419 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:46.165736 12659 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:46.166966 13231 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:46.167043 13197 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:46.137215 16759 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:46.166908 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:46.171392 13233 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:46.156837 16844 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:46.172487 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.138140 16918 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:46.170753 16759 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:46.176307 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:46.171229 16964 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:04:46.179333 13197 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:46.141320 16842 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:46.170145 16744 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:46.169340 16908 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:46.178047 16759 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:46.175587 16619 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:46.179013 16926 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:46.180820 16941 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:46.180080 16940 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:46.183388 16837 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:04:46.188346 12659 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:46.195267 16761 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:46.203061 16759 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:46.220229 16926 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:46.260375 16926 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:46.260809 16926 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:46.190619 16744 consensus_queue.cc:1059] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:04:46.265952 16744 raft_consensus.cc:3055] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:46.266422 16744 raft_consensus.cc:740] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:46.259272 16833 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:46.258783 16849 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:46.300107 12659 leader_election.cc:400] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 10. Current term is 11.
I20260709 13:04:46.300972 12659 leader_election.cc:403] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:46.304121 16761 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:04:46.308562 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1659) took 2372 ms. Trace:
I20260709 13:04:46.308995 12696 rpcz_store.cc:276] 0709 13:04:43.936211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.266987 (+330776us) service_pool.cc:224] Handling call
0709 13:04:44.267257 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.315486 (+ 48229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:44.315533 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:44.315601 (+    68us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:44.315654 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.308301 (+1992647us) spinlock_profiling.cc:243] Waited 48 ms on lock 0x7b54002c9054. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:46.308351 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:46.308500 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110316800}
I20260709 13:04:46.309991 16833 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:46.310524 16833 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:46.311414 16958 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.311932 16958 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:46.312544 16758 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:46.313155 16842 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.313228 16758 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:46.314069 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1008) took 2261 ms. Trace:
I20260709 13:04:46.314441 12687 rpcz_store.cc:276] 0709 13:04:44.052141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.343316 (+291175us) service_pool.cc:224] Handling call
0709 13:04:44.404036 (+ 60720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.404789 (+   753us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.313864 (+1909075us) spinlock_profiling.cc:243] Waited 60.2 ms on lock 0x7b54001effd0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:46.314001 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138548992}
I20260709 13:04:46.313791 16842 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:46.316105 16958 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:46.317067 16842 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:46.312628 16833 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:46.319340 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 104917us
I20260709 13:04:46.320292 12659 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:46.249782 16759 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:46.267467 16744 consensus_queue.cc:260] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:46.332127 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:46.332815 12621 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:04:46.334075 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:46.334914 12618 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 10: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:04:46.335879 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:46.337992 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 156000us
I20260709 13:04:46.339040 13197 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:46.340260 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:46.340867 12618 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 6.
I20260709 13:04:46.343775 12659 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:46.344218 12588 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:46.345244 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:46.345960 12618 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:04:46.350996 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:46.329093 16842 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.351565 12613 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:46.349068 12659 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:46.338881 16833 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:46.330121 16618 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.357354 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1775) took 1262 ms. Trace:
I20260709 13:04:46.383474 12689 rpcz_store.cc:276] 0709 13:04:45.095138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.232314 (+137176us) service_pool.cc:224] Handling call
0709 13:04:45.248195 (+ 15881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:45.359073 (+110878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.357068 (+997995us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b540041fad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:46.357283 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234665344}
I20260709 13:04:46.360235 16884 raft_consensus.cc:3055] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:46.361744 16832 raft_consensus.cc:3055] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:46.361907 16941 consensus_queue.cc:1059] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:46.365697 16710 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:46.370154 16758 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:46.371649 16926 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:46.373687 16842 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:46.351540 16940 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:04:46.375941 16744 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:46.348742 16771 consensus_queue.cc:1059] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:04:46.347213 16759 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:46.347314 16970 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:46.379335 16761 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 10. Current term is 11.
I20260709 13:04:46.381794 16674 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:46.397671 16736 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:46.396793 16884 raft_consensus.cc:740] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:46.398283 16832 raft_consensus.cc:740] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:46.410501 16710 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:46.396136 16833 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:46.417061 16900 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:46.434826 16884 consensus_queue.cc:260] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:46.437676 16884 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:46.446489 16931 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 1.046s	user 0.010s	sys 0.000s
I20260709 13:04:46.439239 16926 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:46.511226 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 174490us
W20260709 13:04:46.364171 12539 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2921) took 2313 ms (client timeout 1775 ms). Trace:
W20260709 13:04:46.517678 12539 rpcz_store.cc:269] 0709 13:04:44.050700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.079080 (+ 28380us) service_pool.cc:224] Handling call
0709 13:04:46.363766 (+2284686us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400228154. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:46.363878 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3200946944}
I20260709 13:04:46.521340 12544 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
W20260709 13:04:46.534961 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:46.536839 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 167430us
I20260709 13:04:46.538548 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:46.543577 12616 raft_consensus.cc:1275] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:04:46.544201 12616 pending_rounds.cc:85] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 6
I20260709 13:04:46.544600 12616 pending_rounds.cc:107] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:04:46.545034 12616 raft_consensus.cc:2889] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:46.397102 12659 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:46.560447 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1783) took 1185 ms. Trace:
I20260709 13:04:46.561165 12690 rpcz_store.cc:276] 0709 13:04:45.375091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:46.013754 (+638663us) service_pool.cc:224] Handling call
0709 13:04:46.014025 (+   271us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:46.038144 (+ 24119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:46.038190 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:46.038786 (+   596us) log.cc:844] Serialized 52 byte log entry
0709 13:04:46.174461 (+135675us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b1800140e60. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:04:46.382812 (+208351us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:46.382857 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.384667 (+  1810us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:46.559390 (+174723us) raft_consensus.cc:1685] finished
0709 13:04:46.559475 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:46.560153 (+   678us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9094,"raft.queue_time_us":24281,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":16183,"spinlock_wait_cycles":24575872,"thread_start_us":208157,"threads_started":1,"wal-append.queue_time_us":362961}
W20260709 13:04:46.596266 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 43774.2us
I20260709 13:04:46.598935 16420 consensus_queue.cc:1059] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:46.600976 16420 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:46.602255 16420 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:46.603291 16420 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:46.606542 16420 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:46.607322 16420 raft_consensus.cc:476] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Not starting pre-election -- already a leader
I20260709 13:04:46.608070 16420 raft_consensus.cc:3055] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:46.608758 16420 raft_consensus.cc:740] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:46.397858 16618 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:46.621471 16618 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:46.654821 16804 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:46.655597 16804 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:46.656098 16804 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:46.656188 16771 raft_consensus.cc:3055] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:46.656936 16771 raft_consensus.cc:740] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:46.659447 16842 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:46.660660 16843 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.663820 16941 raft_consensus.cc:3055] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:46.664441 16941 raft_consensus.cc:740] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:46.664278 16833 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:46.422356 16710 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:46.680063 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 277153us
I20260709 13:04:46.686210 16820 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.687247 16820 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:46.688040 16672 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:46.688282 16804 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:46.688987 16672 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:46.691522 16804 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:46.692358 16672 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:46.667816 16941 consensus_queue.cc:260] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:46.646633 16420 consensus_queue.cc:260] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:46.693660 16820 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:46.700754 16792 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:46.702426 16840 raft_consensus.cc:3055] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:46.705396 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 912) took 1157 ms. Trace:
I20260709 13:04:46.702452 16771 consensus_queue.cc:260] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:46.684427 16832 consensus_queue.cc:260] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:46.709218 16843 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:46.711875 16832 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:46.709882 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.712967 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:46.714264 12618 raft_consensus.cc:2393] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 9: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:46.715489 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:46.717409 16771 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:46.707626 16840 raft_consensus.cc:740] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:46.719378 12613 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:04:46.719398 16840 consensus_queue.cc:260] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:46.721488 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:46.722021 16840 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:46.707870 12546 rpcz_store.cc:276] 0709 13:04:45.547973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.756516 (+208543us) service_pool.cc:224] Handling call
0709 13:04:45.785327 (+ 28811us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:46.018155 (+232828us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.704838 (+686683us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54000794d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:46.705124 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520101248}
I20260709 13:04:46.717742 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:46.729396 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:46.736199 12621 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:04:46.737792 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.742700 16843 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:46.746374 16941 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:46.740981 16710 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:46.716733 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:46.764724 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1905) took 1455 ms. Trace:
I20260709 13:04:46.765748 12620 rpcz_store.cc:276] 0709 13:04:45.307841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.309606 (+  1765us) service_pool.cc:224] Handling call
0709 13:04:46.762398 (+1452792us) spinlock_profiling.cc:243] Waited 41.4 ms on lock 0x7b54001eaad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:46.762635 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95288448}
I20260709 13:04:46.771133 16710 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:46.870332 16420 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:46.874312 12618 raft_consensus.cc:2376] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9. Re-sending same reply.
I20260709 13:04:46.886940 12620 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:04:46.887863 16833 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:46.888573 16833 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:46.889334 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1664) took 2519 ms. Trace:
I20260709 13:04:46.890030 12695 rpcz_store.cc:276] 0709 13:04:44.367231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:44.637968 (+270737us) service_pool.cc:224] Handling call
0709 13:04:44.638613 (+   645us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:44.866562 (+227949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.873038 (+2006476us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b540016f3d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:46.886310 (+ 13272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":516146432}
I20260709 13:04:46.891085 16833 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:46.893617 16833 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:46.894477 16833 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:46.897828 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:46.898877 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:46.901988 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.899464 16833 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:46.893735 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:46.905396 16884 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:46.906450 16884 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:46.909545 16884 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:46.911001 16884 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.911592 12542 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
W20260709 13:04:46.912002 13232 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 1102) took 1761 ms (client timeout 1856 ms). Trace:
I20260709 13:04:46.912504 16884 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:46.912587 13232 rpcz_store.cc:269] 0709 13:04:45.150096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.151677 (+  1581us) service_pool.cc:224] Handling call
0709 13:04:46.911552 (+1759875us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b540063a954. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:46.911761 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1049655040}
I20260709 13:04:46.919204 16813 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.920032 16813 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:46.926905 16813 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:46.927688 16813 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.928505 16813 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:46.932036 16813 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:46.935259 12621 raft_consensus.cc:1240] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:46.936533 16851 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.937289 16851 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:46.939796 16851 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:46.936751 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:46.941154 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1025) took 1438 ms. Trace:
I20260709 13:04:46.945849 12620 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:46.941708 12691 rpcz_store.cc:276] 0709 13:04:45.502894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:46.041873 (+538979us) service_pool.cc:224] Handling call
0709 13:04:46.043540 (+  1667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:46.071237 (+ 27697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:46.071271 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:46.071317 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:46.071356 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.940582 (+869226us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b5400405454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:46.940667 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:46.940944 (+   277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63226752}
I20260709 13:04:46.877552 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:46.953781 16585 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:46.957444 12621 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:46.962194 16627 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:46.964699 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1595) took 1625 ms. Trace:
I20260709 13:04:46.964854 16884 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:46.966957 12618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:60170
I20260709 13:04:46.967751 12618 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:46.968104 12618 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:46.971185 12694 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:46.974665 12694 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:46.965227 12547 rpcz_store.cc:276] 0709 13:04:45.339496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.339662 (+   166us) service_pool.cc:224] Handling call
0709 13:04:45.694720 (+355058us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:45.695195 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:45.695236 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:45.695797 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 13:04:45.911322 (+215525us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:45.950099 (+ 38777us) log.cc:844] Serialized 14 byte log entry
0709 13:04:45.950320 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.950389 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:46.247004 (+296615us) raft_consensus.cc:1685] finished
0709 13:04:46.247035 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:46.964361 (+717326us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b5400229050. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:46.964523 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27130,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":56721,"raft.queue_time_us":9683,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":58978,"spinlock_wait_cycles":815597312,"thread_start_us":215074,"threads_started":1,"wal-append.queue_time_us":250681}
I20260709 13:04:46.975162 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:46.970979 12613 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:04:46.978919 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:46.982144 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:46.989988 12613 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:46.980633 16851 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:46.995697 12694 raft_consensus.cc:1275] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:46.999926 16832 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:47.002364 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1593) took 1667 ms. Trace:
I20260709 13:04:47.002961 12538 rpcz_store.cc:276] 0709 13:04:45.335803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.336034 (+   231us) service_pool.cc:224] Handling call
0709 13:04:45.336456 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:45.517837 (+181381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.983894 (+1466057us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54000690d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:47.002151 (+ 18257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415569664}
W20260709 13:04:47.008674 16961 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.854s	user 0.016s	sys 0.022s
I20260709 13:04:47.008980 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:47.017716 16839 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:47.017911 12621 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
W20260709 13:04:47.011950 16662 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.308s	user 0.031s	sys 0.027s
I20260709 13:04:47.010458 16420 consensus_queue.cc:1059] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:04:47.011678 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3176) took 1162 ms. Trace:
W20260709 13:04:47.023064 16662 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.343s	user 0.032s	sys 0.027s
I20260709 13:04:47.024726 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.023936 16420 raft_consensus.cc:3055] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:47.025494 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1923) took 1153 ms. Trace:
I20260709 13:04:47.025743 16420 raft_consensus.cc:740] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:47.027117 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.026067 12614 rpcz_store.cc:276] 0709 13:04:45.871869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.871979 (+   110us) service_pool.cc:224] Handling call
0709 13:04:45.874321 (+  2342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:45.875686 (+  1365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:45.875726 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:45.876304 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 13:04:46.070374 (+194070us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:04:46.070416 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:46.070488 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:47.007760 (+937272us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:04:47.018947 (+ 11187us) raft_consensus.cc:1685] finished
0709 13:04:47.018969 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:47.025279 (+  6310us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3754,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":1974,"spinlock_wait_cycles":7998208,"thread_start_us":193750,"threads_started":1,"wal-append.queue_time_us":245134}
I20260709 13:04:47.028574 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:47.027213 16420 consensus_queue.cc:260] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:47.029462 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.023861 12618 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:47.030702 13232 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:04:47.023736 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:47.031183 16366 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:47.029726 16844 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:47.022497 12617 rpcz_store.cc:276] 0709 13:04:45.849452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.849633 (+   181us) service_pool.cc:224] Handling call
0709 13:04:45.850012 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:45.919684 (+ 69672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:47.011068 (+1091384us) spinlock_profiling.cc:243] Waited 63.7 ms on lock 0x7b54001e91d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:47.011441 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146545408}
I20260709 13:04:47.033070 16844 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:47.035979 16844 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:46.997033 16840 consensus_queue.cc:1059] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:47.037509 16840 raft_consensus.cc:3055] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:47.038024 16840 raft_consensus.cc:740] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:47.039499 16840 consensus_queue.cc:260] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:47.041239 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:47.044564 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:47.045655 12619 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 10: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:47.046168 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.047345 13227 raft_consensus.cc:2393] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 10: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:47.023792 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:47.033421 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:47.077757 12618 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:47.082159 16895 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:47.083027 16895 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:47.086086 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.086988 13232 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:04:47.088558 13197 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:47.082015 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:47.091439 12613 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:47.074165 16420 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:47.094466 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:47.096529 16740 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:47.096884 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:47.097645 13233 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:47.098552 13227 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:04:47.099639 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:47.100994 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:47.102288 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:47.102807 13229 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:47.104200 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.105046 13231 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:47.106128 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.106500 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:47.106930 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:47.106536 12695 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:04:47.108556 12621 raft_consensus.cc:2410] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:04:47.107304 12696 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:47.089658 16895 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:47.113421 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:47.114141 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:47.109133 16840 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:47.112352 16832 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:47.116716 12687 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:04:47.119943 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.120929 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:47.121050 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.121717 12695 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:47.117695 12690 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:47.126237 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:47.126931 12690 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
W20260709 13:04:47.128804 16963 log.cc:927] Time spent T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.998s	user 0.010s	sys 0.016s
I20260709 13:04:47.129403 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:47.130864 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 1922) took 1259 ms. Trace:
I20260709 13:04:47.131302 12615 rpcz_store.cc:276] 0709 13:04:45.871215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.871348 (+   133us) service_pool.cc:224] Handling call
0709 13:04:45.871746 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:45.872144 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:45.872184 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:45.878894 (+  6710us) log.cc:844] Serialized 26 byte log entry
0709 13:04:45.957974 (+ 79080us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:45.958012 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:45.961755 (+  3743us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:47.124875 (+1163120us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:04:47.130352 (+  5477us) raft_consensus.cc:1685] finished
0709 13:04:47.130381 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:47.130686 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":114,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":2411,"spinlock_wait_cycles":4707200,"thread_start_us":60446,"threads_started":1,"wal-append.queue_time_us":195451}
I20260709 13:04:47.127485 13229 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:04:47.138072 12615 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:47.134791 12687 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:04:47.140937 13233 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:04:47.117977 16851 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:47.144176 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.144630 16851 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:47.145428 13230 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:04:47.148861 16852 raft_consensus.cc:993] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
W20260709 13:04:47.145466 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.149853 12614 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
W20260709 13:04:47.151275 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.153986 12659 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:47.153369 12614 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: []
W20260709 13:04:47.156205 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.157853 16832 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.158558 16832 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:47.161038 16832 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:47.163546 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:47.164021 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:47.165165 12539 raft_consensus.cc:2410] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:04:47.166217 12538 raft_consensus.cc:1275] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:47.166443 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:47.166862 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:47.165081 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:47.169770 12613 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:47.167207 12540 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:47.171257 12691 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:47.173012 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:47.176925 12539 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 6.
I20260709 13:04:47.176997 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:47.178606 16908 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:47.179056 16908 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:47.179417 16908 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:47.180240 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 918) took 1280 ms. Trace:
I20260709 13:04:47.181483 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:47.181950 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.184254 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:47.185611 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:47.180631 12544 rpcz_store.cc:276] 0709 13:04:45.899549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.947225 (+ 47676us) service_pool.cc:224] Handling call
0709 13:04:45.947556 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:46.522369 (+574813us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:47.173768 (+651399us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b54002ba554. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:47.180174 (+  6406us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1317943680}
I20260709 13:04:47.187252 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.187879 13231 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:47.192008 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:47.193038 16975 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.506s	user 0.001s	sys 0.001s
W20260709 13:04:47.193117 12542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 915) took 1644 ms (client timeout 1978 ms). Trace:
W20260709 13:04:47.193893 12542 rpcz_store.cc:269] 0709 13:04:45.548848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:45.639839 (+ 90991us) service_pool.cc:224] Handling call
0709 13:04:47.192925 (+1553086us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54000a64d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:47.193034 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2868907776}
I20260709 13:04:47.201047 12539 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:04:47.202850 16858 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:47.205371 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:47.207005 12696 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:04:47.199815 12547 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
W20260709 13:04:47.209028 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 120769us
W20260709 13:04:47.209777 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.204334 12617 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:47.215692 12614 raft_consensus.cc:1275] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:04:47.217862 12543 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12. Ops: [9.6-11.7]
W20260709 13:04:47.223253 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.219184 12695 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:47.227537 12538 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:47.221319 16951 raft_consensus.cc:1081] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:04:47.199806 16852 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:47.218747 12659 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:47.235211 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:47.241772 16851 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:04:47.245389 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:47.246454 13228 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:47.247076 16852 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:47.240849 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.233777 16858 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.253139 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.259974 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.260825 13232 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:47.249462 16852 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:47.267681 13229 raft_consensus.cc:3055] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:47.265540 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:47.269405 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.268194 13229 raft_consensus.cc:740] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:47.256911 16843 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:47.272428 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:47.276675 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 124380us
I20260709 13:04:47.276444 13232 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:47.289253 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.290164 13232 raft_consensus.cc:2393] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 10: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:47.293715 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.294283 12538 raft_consensus.cc:2393] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 11: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:47.294667 16533 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:47.297981 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:47.298760 13227 raft_consensus.cc:2410] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:04:47.298060 13229 consensus_queue.cc:260] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:47.298833 12546 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:47.299495 13229 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:04:47.302281 16978 log.cc:927] Time spent T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:04:47.302968 16977 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:04:47.303833 13197 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:47.308897 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.310518 12513 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:47.314688 16792 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:47.315498 13231 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:04:47.316098 12513 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:47.317122 16792 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:47.317577 16792 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.317937 16792 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:47.322383 12513 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:47.324126 16958 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:47.324571 16958 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.325062 16958 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:47.265174 16858 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:47.325529 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:04:47.326593 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 126695us
I20260709 13:04:47.367499 12659 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:47.345664 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.368961 16841 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:47.346405 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.352941 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:47.353822 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 61040.9us
W20260709 13:04:47.365224 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:47.372611 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.355353 13233 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:04:47.345757 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.356279 13228 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
W20260709 13:04:47.351722 12445 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36394 (request call id 339) took 26662 ms (client timeout 15000 ms). Trace:
I20260709 13:04:47.344966 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:47.354652 12510 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:47.342654 12587 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:47.380113 13230 raft_consensus.cc:2410] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:04:47.340129 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:47.381266 12619 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:47.347149 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.328090 12513 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:47.347960 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.386493 13234 raft_consensus.cc:2393] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 10: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:47.386245 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.387344 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:47.388032 13234 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 10: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:47.387768 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.337926 16843 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.373327 16841 raft_consensus.cc:697] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:47.353698 16662 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:47.393096 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:47.395660 12614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd40576623a84072be59a32d23cda14b"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:60170
I20260709 13:04:47.339864 16858 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:47.338485 16669 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:47.338876 16672 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:47.407063 13231 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:47.400754 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:47.395242 16833 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:47.339156 16895 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.404174 13228 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:04:47.325987 16585 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:47.416199 13226 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 10: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:04:47.417340 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 89342.4us
I20260709 13:04:47.326663 16846 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 13:04:47.327325 16740 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:04:47.359876 16792 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:47.421831 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 81958.6us
I20260709 13:04:47.354008 16951 consensus_queue.cc:1059] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:04:47.401712 16840 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:47.426944 12659 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:47.408341 16941 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:47.430776 16669 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:47.424741 16843 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:47.428966 16895 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:47.429729 16979 log.cc:927] Time spent T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.132s	user 0.000s	sys 0.002s
I20260709 13:04:47.419620 16842 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:47.429800 16233 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:47.407704 16958 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:47.341648 12442 catalog_manager.cc:5697] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:04:47.435706 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 81259.1us
I20260709 13:04:47.434412 13197 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:47.441882 16366 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:47.433367 16843 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:47.429384 16841 consensus_queue.cc:237] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:47.445588 16842 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:47.449978 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 159316us
W20260709 13:04:47.457032 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 131754us
I20260709 13:04:47.448474 16792 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:47.434980 16585 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:47.533737 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 113241us
W20260709 13:04:47.558480 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 102935us
W20260709 13:04:47.504616 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 81983.3us
I20260709 13:04:47.558980 12614 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:47.578873 12614 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:47.461063 13199 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:47.461459 13230 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:47.538275 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 84536.2us
I20260709 13:04:47.507617 12512 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:47.504185 12587 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:04:47.584795 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 129227us
W20260709 13:04:47.543695 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 99472.2us
I20260709 13:04:47.433447 16669 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:47.585551 12659 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:47.460191 16672 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:47.574046 16627 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:47.514117 16820 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:47.449728 16897 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:47.594920 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.587970 13199 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:04:47.549921 13200 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.978s (SENT) [suppressed 10 similar messages]
I20260709 13:04:47.452013 16842 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:47.452152 16662 raft_consensus.cc:3055] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:47.588690 12513 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:47.448855 16958 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:47.446902 16366 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:47.612396 16906 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:47.612813 16366 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:47.543867 16740 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:47.618001 16740 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:47.620232 16740 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:47.610277 16662 raft_consensus.cc:740] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:47.621614 16662 consensus_queue.cc:260] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:47.611495 13229 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:04:47.589597 16852 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:47.625188 16740 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:47.625866 12513 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:47.624269 16366 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:47.627770 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:47.533243 16846 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:47.510022 16895 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:47.446600 16840 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:47.635681 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 128142us
I20260709 13:04:47.512866 16908 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:47.607194 16669 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:47.635043 12662 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:47.690896 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 61550.2us
I20260709 13:04:47.691622 13199 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:47.602360 16627 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:47.706634 16837 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:47.711416 16837 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.711908 16837 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:47.690924 16951 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:47.631811 16792 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:47.714068 16951 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:47.715564 16672 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:47.633174 16740 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.722285 16740 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:47.724220 16851 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:47.724822 16366 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:47.727773 16585 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:47.631156 16852 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:47.730039 16852 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:47.730970 16662 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:47.732733 16908 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:47.730129 16840 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:47.726068 16846 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:47.734120 16840 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:47.734678 16840 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:47.735190 16840 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:47.735913 16846 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:47.737767 16627 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:47.717244 16951 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:47.744091 13231 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:04:47.704595 16669 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:47.648464 16820 raft_consensus.cc:697] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:47.760912 16669 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:47.939347 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:47.963300 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:47.633387 16897 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:48.579102 16839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.011s	sys 0.017s
W20260709 13:04:48.995374 16233 consensus_meta.cc:287] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 1.491s	user 0.012s	sys 0.000s
W20260709 13:04:49.028249 16837 consensus_meta.cc:287] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 1.316s	user 0.006s	sys 0.003s
I20260709 13:04:49.029855 16233 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:04:49.029547 16669 consensus_meta.cc:287] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.257s	user 0.005s	sys 0.000s
I20260709 13:04:49.088593 16669 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:49.091210 16669 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:49.091908 16820 consensus_queue.cc:237] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:49.030407 16662 consensus_meta.cc:287] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 1.278s	user 0.011s	sys 0.000s
W20260709 13:04:49.010807 16839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.303s	user 0.012s	sys 0.017s
W20260709 13:04:49.192137 12586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.003s	sys 0.018s
W20260709 13:04:49.192662 12586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.003s	sys 0.018s
I20260709 13:04:49.077597 16837 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:49.212544 16842 consensus_meta.cc:287] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 1.520s	user 0.009s	sys 0.003s
W20260709 13:04:49.229175 16627 consensus_meta.cc:287] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.491s	user 0.005s	sys 0.004s
I20260709 13:04:49.239771 16627 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.231680 16842 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:49.232978 16840 consensus_meta.cc:287] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 1.497s	user 0.013s	sys 0.001s
I20260709 13:04:49.241122 16840 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.242801 16842 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:49.243359 16840 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:49.243440 16837 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:49.231453 16991 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:49.234334 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 1.60843e+06us
I20260709 13:04:49.244365 16992 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:49.244913 16992 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:49.244977 12513 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:49.245450 16991 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:49.247655 16992 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:47.692665 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:49.248558 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.248615 16991 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:49.249289 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.249441 16991 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:49.250285 16627 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:49.237516 13199 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.526s	user 0.001s	sys 0.014s
W20260709 13:04:49.248508 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:49.250836 13199 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.540s	user 0.001s	sys 0.016s
W20260709 13:04:49.251098 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:49.251643 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 1.55999e+06us
I20260709 13:04:49.252120 16992 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:49.252303 13199 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:49.253016 16992 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.255167 16992 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:49.255685 16992 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:49.255738 16837 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:49.256281 16837 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:49.256685 16837 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:49.238713 16852 consensus_meta.cc:287] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 1.508s	user 0.004s	sys 0.006s
I20260709 13:04:49.261905 16852 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.262455 16820 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.264357 16897 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:49.264546 16852 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:49.250034 16991 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:49.264205 16820 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:49.235486 16740 consensus_meta.cc:287] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 1.512s	user 0.008s	sys 0.004s
I20260709 13:04:49.266947 16740 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.268280 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:49.269337 12618 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:49.269685 16740 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:49.270370 16991 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:49.270929 16991 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:49.271299 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:49.271522 16991 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.272154 12618 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 6.
I20260709 13:04:49.274204 16852 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.275550 16995 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.274875 16852 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.279784 16995 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.280285 16837 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.281096 16852 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:49.277197 16994 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.282272 16995 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:49.278860 16985 log.cc:927] Time spent T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.305s	user 0.006s	sys 0.000s
I20260709 13:04:49.282538 16837 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:49.282011 16994 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.284066 16991 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:49.256304 16992 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.285162 16994 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:49.286466 13197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.654s	user 0.009s	sys 0.018s
W20260709 13:04:49.286700 13197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.654s	user 0.009s	sys 0.018s
I20260709 13:04:49.287407 16992 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:49.288125 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:49.288548 13230 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:49.292233 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:49.292954 12613 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:04:49.293526 16990 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:49.293916 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:49.294060 16990 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.295173 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:49.295827 12619 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:49.296298 16990 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:49.277251 16820 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:49.299219 13197 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:49.300307 13197 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:49.300515 16837 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:49.300989 16837 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:49.301105 16852 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:49.301620 16852 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.302021 16852 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:49.309736 16852 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:47.375612 12445 rpcz_store.cc:269] 0709 13:04:20.688882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:20.736283 (+ 47401us) service_pool.cc:224] Handling call
0709 13:04:47.351425 (+26615142us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:39.267266 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:39.268104 (+   838us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:39.268176 (+    72us) write_op.cc:435] Acquired schema lock
0709 13:04:39.268204 (+    28us) tablet.cc:662] Decoding operations
0709 13:04:39.432986 (+164782us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:39.433086 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:39.433122 (+    36us) tablet.cc:685] Acquiring locks for 26 operations
0709 13:04:39.435550 (+  2428us) tablet.cc:701] Row locks acquired
0709 13:04:39.435604 (+    54us) write_op.cc:260] PREPARE: finished
0709 13:04:39.435814 (+   210us) write_op.cc:270] Start()
0709 13:04:39.435950 (+   136us) write_op.cc:276] Timestamp: P: 1783602279435741 usec, L: 0
0709 13:04:39.435984 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:04:39.436859 (+   875us) log.cc:844] Serialized 10294 byte log entry
0709 13:04:39.585722 (+148863us) op_driver.cc:464] REPLICATION: finished
0709 13:04:39.594406 (+  8684us) write_op.cc:301] APPLY: starting
0709 13:04:39.594514 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:39.596421 (+  1907us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:39.596534 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:39.601728 (+  5194us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:39.602192 (+   464us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=52
0709 13:04:39.602236 (+    44us) write_op.cc:312] APPLY: finished
0709 13:04:39.602761 (+   525us) log.cc:844] Serialized 176 byte log entry
0709 13:04:39.602987 (+   226us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:39.603205 (+   218us) write_op.cc:454] Released schema lock
0709 13:04:39.603293 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:39.607107 (+  3814us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:39.607152 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1817419,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":8340,"apply.run_cpu_time_us":6226,"apply.run_wall_time_us":12637,"num_ops":26,"prepare.queue_time_us":112311,"prepare.run_cpu_time_us":117097,"prepare.run_wall_time_us":335704,"raft.queue_time_us":984,"raft.run_cpu_time_us":7298,"raft.run_wall_time_us":10155,"replication_time_us":149540,"thread_start_us":211824,"threads_started":4,"wal-append.queue_time_us":139268,"wal-append.run_cpu_time_us":4650,"wal-append.run_wall_time_us":1031762}]]}
I20260709 13:04:49.311221 16990 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.311977 16990 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.313021 16852 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:04:49.313220 13198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.652s	user 0.006s	sys 0.009s
W20260709 13:04:49.313596 13198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.652s	user 0.006s	sys 0.009s
I20260709 13:04:49.301527 16837 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:49.315088 13198 connection.cc:256] RPC call timeout handler was delayed by -1.1938755559999663s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:04:49.315181 16989 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.315802 16989 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.318112 16839 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.318352 16989 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:49.318862 16989 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.318642 16839 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.319293 16989 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.320677 16839 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:49.321115 16989 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:49.320932 16837 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.323486 16837 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:49.314739 16990 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:49.328732 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:49.329342 12618 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:49.333968 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:49.334415 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:49.334627 12616 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:49.335016 12617 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:49.335323 13235 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:04:49.335590 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:49.336105 12616 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:49.335964 13197 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:49.336004 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:49.339062 16992 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:49.339555 12613 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:49.339691 16992 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:49.340917 16820 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:49.341912 16992 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:49.341421 16820 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.342835 16820 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:49.341871 13197 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:49.346594 13197 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:49.347460 16990 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:49.347837 16990 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.348171 16990 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:49.350839 12616 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:04:49.353816 12618 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:04:49.359284 13197 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:49.360018 16852 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:49.360373 16852 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.360656 16852 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:49.370245 16839 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.371052 16839 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.372768 16852 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.464190 16986 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:49.464953 16986 raft_consensus.cc:697] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:49.465044 16662 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.465605 16662 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.465991 16986 consensus_queue.cc:237] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.467821 16662 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:49.468329 16662 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.468822 16662 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.572374 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1604) took 2407 ms. Trace:
I20260709 13:04:49.572866 12545 rpcz_store.cc:276] 0709 13:04:47.164743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:47.171675 (+  6932us) service_pool.cc:224] Handling call
0709 13:04:47.209660 (+ 37985us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:47.230097 (+ 20437us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:47.230128 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:47.258050 (+ 27922us) log.cc:844] Serialized 26 byte log entry
0709 13:04:47.417992 (+159942us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:47.418032 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:47.418097 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:47.595153 (+177056us) raft_consensus.cc:1685] finished
0709 13:04:47.595173 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:49.349364 (+1754191us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b540026b450. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:49.572260 (+222896us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7596,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":7814,"spinlock_wait_cycles":56626560,"thread_start_us":131117,"threads_started":1,"wal-append.queue_time_us":311148,"wal-append.run_cpu_time_us":2453,"wal-append.run_wall_time_us":1039955}
I20260709 13:04:49.584610 16839 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:49.585117 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 225922us
I20260709 13:04:49.585911 13197 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:49.586746 16839 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:49.587498 16839 raft_consensus.cc:697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:49.587896 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:49.589810 16839 consensus_queue.cc:237] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.599138 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:49.603325 12622 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:49.606463 12616 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:04:49.616494 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:49.617786 12622 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:49.619025 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 2.11479e+06us
W20260709 13:04:49.628109 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 2.03812e+06us
I20260709 13:04:49.628584 16761 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:49.629221 16761 raft_consensus.cc:697] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:49.630191 16761 consensus_queue.cc:237] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.613714 16852 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:49.634532 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.636865 16841 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.637614 16841 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:49.639344 12662 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:49.640311 16841 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:04:49.636893 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.634002 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:49.646297 12616 raft_consensus.cc:2410] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:04:49.649241 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:49.648136 13197 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:49.651840 16840 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:49.653167 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.654345 13197 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:49.656056 12622 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:49.661075 16994 consensus_queue.cc:1059] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:49.662142 16986 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:49.662465 16991 raft_consensus.cc:3055] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:49.662627 16986 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.662983 16991 raft_consensus.cc:740] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:49.663120 16986 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:49.664067 16991 consensus_queue.cc:260] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:49.666945 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 47030.2us
I20260709 13:04:49.668798 16995 consensus_queue.cc:1059] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:04:49.672451 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.673218 12615 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:04:49.673908 13197 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:49.676937 12662 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:49.678341 12620 consensus_meta.cc:287] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 2.136s	user 0.018s	sys 0.005s
I20260709 13:04:49.678722 12620 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:49.679132 16992 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.679613 16992 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:49.682304 16986 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.687224 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:49.687918 12615 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:49.687954 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:49.688828 13227 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 14: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:49.697242 12615 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:04:49.699249 16851 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:49.699683 13197 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:49.699859 16851 raft_consensus.cc:697] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:49.700577 16989 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:49.701090 16851 consensus_queue.cc:237] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.701517 16989 raft_consensus.cc:697] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:49.702862 16989 consensus_queue.cc:237] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:49.704303 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.707382 16986 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:49.710000 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:49.710883 12695 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:49.712144 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:49.713918 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:49.716576 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:49.717268 12693 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:04:49.719691 16841 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:49.720463 16761 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:04:49.721021 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.721990 16761 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:49.724366 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:49.725121 12694 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 10: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:49.723758 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:49.726102 12689 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:49.726689 16233 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:49.727113 16233 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.727445 16233 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:49.728440 12659 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:49.720887 16841 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.730516 12615 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:49.731034 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:49.732226 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:49.732177 16851 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:49.732983 12695 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:49.730947 16841 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.731956 12442 catalog_manager.cc:5697] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 4 to 5, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 5 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:49.730360 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:49.735634 12690 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:49.736510 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:49.737174 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:49.738193 12691 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:04:49.741003 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:49.742002 12691 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:49.739115 12442 catalog_manager.cc:5697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 4 to 5, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 5 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:49.722555 16761 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.745921 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:49.738364 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:49.746659 12690 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:04:49.747829 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:49.746860 12694 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:04:49.748432 12690 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:49.749146 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:49.750028 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:49.749753 16761 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:49.751008 16761 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.752770 16761 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.754840 16761 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:49.729375 12659 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:49.763100 16233 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.752031 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:49.767880 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:49.768349 12691 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:49.768606 12616 raft_consensus.cc:2368] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 10. Current term is 11.
I20260709 13:04:49.771270 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:49.772131 12616 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:49.745026 12442 catalog_manager.cc:5697] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 3 to 6, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 6 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:04:49.774760 12442 catalog_manager.cc:5697] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 3 to 5, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 5 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:49.764241 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:49.751125 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:49.749185 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:49.766132 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:49.777953 12622 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:49.778309 12695 raft_consensus.cc:2393] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 14: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:49.755770 12693 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:04:49.751432 12694 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 11: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:49.777946 12690 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:49.761889 16761 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:49.785903 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:49.787415 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:49.790042 12693 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:04:49.791642 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:49.793128 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:49.794044 12613 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:49.794493 12622 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
W20260709 13:04:49.797243 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 120357us
W20260709 13:04:49.801928 12659 connection.cc:256] RPC call timeout handler was delayed by -1.2017710739999075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
W20260709 13:04:49.803047 12614 consensus_meta.cc:287] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 2.215s	user 0.015s	sys 0.012s
I20260709 13:04:49.802512 12691 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:49.805199 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:49.805750 12690 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:49.806565 12694 raft_consensus.cc:1240] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:49.807598 12693 raft_consensus.cc:1275] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:04:49.809274 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 564323us
I20260709 13:04:49.804530 12614 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.809847 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:49.810535 12691 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:49.810659 12619 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:49.805845 12617 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
W20260709 13:04:49.812940 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.819515 12659 leader_election.cc:400] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 10. Current term is 11.
I20260709 13:04:49.820387 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:49.822805 12659 leader_election.cc:403] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:04:49.822652 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:49.820556 12442 catalog_manager.cc:5697] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 5 to 6, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 6 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:49.824635 12695 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:49.795969 16761 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:49.837886 12662 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:49.839408 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 170542us
W20260709 13:04:49.841118 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 2.21941e+06us
W20260709 13:04:49.846738 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.820981 16841 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:49.859412 16990 consensus_meta.cc:287] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.510s	user 0.003s	sys 0.006s
I20260709 13:04:49.861479 12692 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:49.861807 16990 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.864341 16990 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:49.865511 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:49.866235 12617 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:49.867398 16992 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:49.867986 16992 raft_consensus.cc:3055] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:49.868317 16992 raft_consensus.cc:740] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:04:49.871738 12620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 3203) took 2873 ms (client timeout 1750 ms). Trace:
W20260709 13:04:49.872160 12620 rpcz_store.cc:269] 0709 13:04:46.998635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:47.023353 (+ 24718us) service_pool.cc:224] Handling call
0709 13:04:49.871495 (+2848142us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b5400099cd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:49.871632 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1116037376}
I20260709 13:04:49.875029 16761 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:49.875761 16761 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:49.876127 16761 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.876472 16761 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:49.878713 13200 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 2.245s	user 0.011s	sys 0.011s
W20260709 13:04:49.879393 13200 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 2.246s	user 0.011s	sys 0.011s
W20260709 13:04:49.879685 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 2.32963e+06us
I20260709 13:04:49.880964 12617 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:49.883324 16233 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:49.883487 13197 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:49.885948 13199 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:49.886891 13199 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:49.888073 12691 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:49.888792 13199 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:49.889688 16987 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:49.889954 12617 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:04:49.890094 16987 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.890498 16987 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:49.890744 16841 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:49.891127 16841 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.891476 16841 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:49.893997 16986 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:49.895341 16986 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:49.895695 16986 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:49.889179 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:49.896493 13199 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:49.897315 13199 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:49.899215 13199 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:49.904906 12691 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:49.895993 16986 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:49.924790 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:49.925480 12688 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:49.928056 12695 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:49.869344 16992 consensus_queue.cc:260] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:49.930984 16992 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:49.931622 12689 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:49.932683 16846 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:04:49.901238 16851 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:04:49.937808 17002 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:49.884388 16989 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:49.939823 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:49.961067 17017 consensus_queue.cc:1059] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:04:49.961742 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 76984.8us
I20260709 13:04:49.960801 12688 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
W20260709 13:04:49.961591 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 123767us
W20260709 13:04:49.963425 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 136752us
I20260709 13:04:49.966248 12659 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:49.959110 16846 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:49.972522 16989 raft_consensus.cc:697] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:49.972975 17018 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:49.973431 17018 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:49.973866 17018 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:49.973692 16989 consensus_queue.cc:237] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:49.977304 12510 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:49.983024 16851 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:49.983605 16851 raft_consensus.cc:697] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:49.984579 16851 consensus_queue.cc:237] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:49.988420 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 89261.6us
I20260709 13:04:49.976042 16846 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:49.994590 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:49.989212 13199 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:04:49.997591 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:49.999331 12659 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:50.000267 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 57665.5us
I20260709 13:04:49.963838 17009 consensus_queue.cc:1059] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:04:49.975914 17002 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:50.006868 17021 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:49.994149 16761 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:50.032332 16669 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:50.032994 17016 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:50.033524 17016 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.033988 17016 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:50.035373 16839 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.035912 16839 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.040199 13234 raft_consensus.cc:2368] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12.
I20260709 13:04:50.004667 17013 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 10. Current term is 11.
I20260709 13:04:50.033146 16669 raft_consensus.cc:697] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:50.041544 16761 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:04:50.047260 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 69269.6us
I20260709 13:04:50.062338 16987 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.066741 17019 raft_consensus.cc:3055] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:50.067299 17019 raft_consensus.cc:740] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:50.068485 17019 consensus_queue.cc:260] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.073331 12587 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:50.074395 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 75146.7us
I20260709 13:04:50.075047 12659 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:50.026197 17012 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:04:50.053676 17002 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:50.076292 12659 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:50.058646 17017 raft_consensus.cc:3055] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:50.079991 12587 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:50.078709 12662 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:50.060474 16761 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:50.076380 17013 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:04:50.088187 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.090523 17010 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:50.090564 12662 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:50.091146 17010 raft_consensus.cc:697] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:50.091583 16669 consensus_queue.cc:237] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.092155 17010 consensus_queue.cc:237] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.082221 16761 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:50.097892 13200 connection.cc:256] RPC call timeout handler was delayed by -1.7263718649999191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
W20260709 13:04:50.098883 13200 connection.cc:256] RPC call timeout handler was delayed by -1.530171864999943s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.221s for a response
W20260709 13:04:50.099371 13200 connection.cc:256] RPC call timeout handler was delayed by -1.2387430999999651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
W20260709 13:04:50.099769 13200 connection.cc:256] RPC call timeout handler was delayed by -1.1652164810000158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1746s for a response
W20260709 13:04:50.100176 13200 connection.cc:256] RPC call timeout handler was delayed by -1.0229085409999925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
I20260709 13:04:50.071026 17009 consensus_queue.cc:1048] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:04:50.082476 16987 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:50.080387 17017 raft_consensus.cc:740] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:50.108753 17026 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.110531 17026 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.113674 17026 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:50.115552 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 126455us
I20260709 13:04:50.102182 16761 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:50.089340 17024 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:04:50.133334 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:50.128229 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 52844.8us
I20260709 13:04:50.102788 17021 raft_consensus.cc:697] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:50.116163 17019 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:50.121930 17013 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:50.196398 12512 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:50.195745 13199 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:50.197950 12587 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:50.198736 12587 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:50.202900 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:50.203861 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:50.204524 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.205200 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:50.206053 12689 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:50.207108 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:50.204356 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:50.209137 12688 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:04:50.221902 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:49.652382 16840 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.174000 17024 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:50.231202 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:50.232430 12688 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 11: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:50.234063 12689 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:50.226011 13199 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:50.193676 16987 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:50.235102 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 144681us
I20260709 13:04:50.237361 16994 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:04:50.237942 17025 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:50.224337 16986 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.227469 17013 raft_consensus.cc:697] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:50.238970 12695 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:50.251022 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:50.251883 12695 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 11: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:50.252202 17021 consensus_queue.cc:237] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.252723 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:50.253065 12662 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:50.245623 16994 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:50.233690 17024 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:50.229668 16840 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:50.237882 17028 raft_consensus.cc:2764] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:04:50.246158 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:50.253966 16994 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:50.256867 12617 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:04:50.247162 17025 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:50.264923 17025 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:50.264940 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:50.256042 16987 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.283165 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:50.292845 12687 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
W20260709 13:04:50.299432 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 210329us
W20260709 13:04:50.307966 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 55005.7us
I20260709 13:04:50.308498 12689 raft_consensus.cc:2393] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 13: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:04:50.318795 17023 log.cc:927] Time spent T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:04:50.319224 17031 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:50.319459 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:50.323603 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.320185 12615 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
W20260709 13:04:50.327119 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 225671us
I20260709 13:04:50.331947 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:50.310197 16585 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:50.235591 17017 consensus_queue.cc:260] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.344069 17043 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:50.346334 17043 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:50.345026 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 781) took 1058 ms. Trace:
I20260709 13:04:50.320170 17020 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:50.347123 13231 rpcz_store.cc:276] 0709 13:04:49.287246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.088651 (+801405us) service_pool.cc:224] Handling call
0709 13:04:50.089002 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:50.098145 (+  9143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:50.098333 (+   188us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:50.105317 (+  6984us) log.cc:844] Serialized 26 byte log entry
0709 13:04:50.256861 (+151544us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:50.256900 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.256971 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:50.344814 (+ 87843us) raft_consensus.cc:1685] finished
0709 13:04:50.344836 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:50.344972 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8637,"raft.queue_time_us":80784,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":22263,"thread_start_us":67437,"threads_started":1,"wal-append.queue_time_us":218649}
I20260709 13:04:50.352257 16987 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:50.352936 16987 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:50.353765 17030 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:50.354437 17030 raft_consensus.cc:697] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:04:50.354555 16832 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.004s	sys 0.001s
W20260709 13:04:50.355142 16832 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.004s	sys 0.001s
I20260709 13:04:50.355438 17030 consensus_queue.cc:237] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.328532 16839 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:50.312668 17021 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 13:04:50.336170 16585 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.314568 17027 consensus_queue.cc:1059] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:04:50.302690 17013 consensus_queue.cc:237] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:50.387984 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 57692.1us
W20260709 13:04:50.389181 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 167945us
I20260709 13:04:50.346860 17043 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:50.386708 13197 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:50.353453 16987 raft_consensus.cc:697] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:50.392424 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:50.394081 12695 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:04:50.386435 16585 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:50.327721 17018 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.399953 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:50.399437 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:50.401624 12694 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:50.407384 16991 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:50.409373 17039 log.cc:927] Time spent T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:04:50.411634 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 786) took 1123 ms. Trace:
I20260709 13:04:50.412650 17025 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.397748 16989 raft_consensus.cc:3055] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:50.415199 17024 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.395653 17017 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:50.416968 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 90137.1us
I20260709 13:04:50.420943 17029 raft_consensus.cc:3055] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:50.421131 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:50.438855 12689 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:50.419225 13234 rpcz_store.cc:276] 0709 13:04:49.288143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.648992 (+360849us) service_pool.cc:224] Handling call
0709 13:04:50.411375 (+762383us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b54006a3bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:50.411534 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":891545856}
I20260709 13:04:50.422973 17020 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:50.422608 16840 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.424201 16846 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.426002 16987 consensus_queue.cc:237] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.422789 17018 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:50.456136 12687 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:04:50.427181 16994 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:50.428954 17016 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.416965 12695 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:50.461095 16840 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:50.419371 17027 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:50.461830 17027 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.462078 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 991) took 1163 ms. Trace:
I20260709 13:04:50.462299 17027 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:50.462553 12619 rpcz_store.cc:276] 0709 13:04:49.299023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.299169 (+   146us) service_pool.cc:224] Handling call
0709 13:04:49.299447 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:49.811277 (+511830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.461837 (+650560us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b5400375354. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:50.462013 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1175154560}
I20260709 13:04:50.464072 16846 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:50.431023 16841 consensus_meta.cc:287] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.004s
I20260709 13:04:50.465829 16841 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:50.468988 17024 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:50.431245 16669 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:50.438571 17029 raft_consensus.cc:740] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:50.434072 16585 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.470539 17029 consensus_queue.cc:260] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.471550 16585 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:50.435070 16820 consensus_meta.cc:287] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 1.092s	user 0.014s	sys 0.000s
I20260709 13:04:50.452251 17020 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.453598 17031 raft_consensus.cc:697] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:50.472530 17020 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:50.473222 17031 consensus_queue.cc:237] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:50.472350 16820 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.477284 16820 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:50.478331 16832 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.478940 16832 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:50.455798 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 69210us
I20260709 13:04:50.437106 16989 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:50.438920 16986 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:50.484411 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:50.436501 16761 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.461863 17016 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:50.538676 17025 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:50.501222 16832 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:50.547097 16994 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:50.551614 17020 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:50.561640 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 60343.7us
I20260709 13:04:50.564002 12618 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:50.564914 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:50.565716 13234 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 11: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:50.565863 17041 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:50.566506 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:50.566713 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:50.567512 13231 raft_consensus.cc:2368] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15.
I20260709 13:04:50.567911 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:50.568400 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:50.568967 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.569743 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:50.570364 13234 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:50.570308 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:50.571401 16994 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:50.571863 12588 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:50.571902 16994 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:50.577543 16995 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:50.578038 16995 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.578382 16995 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:50.572854 17024 raft_consensus.cc:2764] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:04:50.575789 17043 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:50.580061 16662 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:50.582013 17043 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:50.578366 12588 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:50.586954 17024 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.587428 17024 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:50.588212 17009 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:50.589221 12695 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:04:50.590597 12587 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:50.593055 13234 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:04:50.595309 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:50.617643 12616 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:50.599206 13227 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:04:50.617890 12587 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:50.618196 16991 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:50.636647 12617 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 10. Current term is 11. Ops: []
W20260709 13:04:50.640019 12662 connection.cc:256] RPC call timeout handler was delayed by -2.06263563899995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
W20260709 13:04:50.640626 12662 connection.cc:256] RPC call timeout handler was delayed by -2.0527356390000477s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
I20260709 13:04:50.640218 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:50.637953 12587 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:50.636382 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:50.642817 13229 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:50.574566 16761 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:50.644990 12694 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 7. Current term is 8. Ops: []
W20260709 13:04:50.641182 12662 connection.cc:256] RPC call timeout handler was delayed by -2.0401356390000274s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
I20260709 13:04:50.668285 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:04:50.672605 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 174514us
W20260709 13:04:50.671559 12662 connection.cc:256] RPC call timeout handler was delayed by -1.9465356389999897s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
W20260709 13:04:50.673766 12662 connection.cc:256] RPC call timeout handler was delayed by -1.9456356389999883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
W20260709 13:04:50.674229 12662 connection.cc:256] RPC call timeout handler was delayed by -1.9195356390000597s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
W20260709 13:04:50.674588 12662 connection.cc:256] RPC call timeout handler was delayed by -1.7233356389999699s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
W20260709 13:04:50.674952 12662 connection.cc:256] RPC call timeout handler was delayed by -1.6765356390000079s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1952s for a response
W20260709 13:04:50.675344 12662 connection.cc:256] RPC call timeout handler was delayed by -1.6063356390000081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
W20260709 13:04:50.675719 12662 connection.cc:256] RPC call timeout handler was delayed by -1.5568356390000417s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20850000000000002s for a response
W20260709 13:04:50.676111 12662 connection.cc:256] RPC call timeout handler was delayed by -1.5532356390000359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260709 13:04:50.676492 12662 connection.cc:256] RPC call timeout handler was delayed by -1.0699356390000503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2626s for a response
I20260709 13:04:50.647792 13234 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:50.644457 16994 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:50.654490 13256 debug-util.cc:398] Leaking SignalData structure 0x7b08002dcce0 after lost signal to thread 11446
I20260709 13:04:50.681510 12689 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:50.678833 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:50.596424 17002 consensus_queue.cc:1059] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:04:50.683614 13233 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:50.683526 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:50.639818 16991 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.647956 17009 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:50.687228 12619 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:04:50.687325 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:50.688014 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:50.686996 12662 leader_election.cc:400] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15.
I20260709 13:04:50.644949 17028 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:50.688623 12662 leader_election.cc:403] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:50.688648 12615 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:50.688796 17028 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.689682 17028 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:50.632588 16995 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:50.690856 12588 connection.cc:256] RPC call timeout handler was delayed by -2.1651026580000234s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
W20260709 13:04:50.691295 12588 connection.cc:256] RPC call timeout handler was delayed by -2.0409026579999363s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 13:04:50.691571 12588 connection.cc:256] RPC call timeout handler was delayed by -1.7790026579999676s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
I20260709 13:04:50.691608 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:04:50.691989 12588 connection.cc:256] RPC call timeout handler was delayed by -1.6674026580000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
W20260709 13:04:50.692271 12588 connection.cc:256] RPC call timeout handler was delayed by -1.628702657999952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
I20260709 13:04:50.692377 12619 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:50.692574 12588 connection.cc:256] RPC call timeout handler was delayed by -1.6142748479999227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
W20260709 13:04:50.692919 12588 connection.cc:256] RPC call timeout handler was delayed by -1.6142748479999227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
W20260709 13:04:50.693178 12588 connection.cc:256] RPC call timeout handler was delayed by -1.1859026580000318s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2621s for a response
I20260709 13:04:50.693106 12662 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:50.693977 16761 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:50.694458 17012 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.695101 17012 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:50.696244 16995 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:50.696480 17056 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:04:50.698829 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:50.684933 16994 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.690932 17009 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:50.646003 17043 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.702047 17009 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:50.701941 16994 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.708004 17024 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:50.709169 12616 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:50.681636 17027 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.712064 17027 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:50.687284 16991 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:50.713238 17043 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:50.707739 17002 raft_consensus.cc:3055] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:04:50.693581 12588 connection.cc:256] RPC call timeout handler was delayed by -1.1049026580000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2711s for a response
I20260709 13:04:50.718591 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:50.717782 12619 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:50.720691 13235 raft_consensus.cc:2368] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16.
I20260709 13:04:50.721124 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:50.724470 12662 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:50.727223 12615 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:50.718794 17002 raft_consensus.cc:740] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:50.718485 17020 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:50.739840 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:50.740479 13234 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:04:50.726511 16366 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:50.730711 16761 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:50.751235 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:50.761413 17012 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:50.763164 17012 consensus_queue.cc:1059] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:50.764186 17012 raft_consensus.cc:3055] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:50.764635 17012 raft_consensus.cc:740] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:50.765941 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:50.766203 16994 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:50.765883 17012 consensus_queue.cc:260] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:50.767045 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:50.767206 17012 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:50.767923 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:50.768702 12695 raft_consensus.cc:2393] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 9: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:50.763033 16989 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.769989 16989 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:50.770748 17010 consensus_queue.cc:1059] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:50.771600 17010 consensus_queue.cc:1059] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:50.772347 16995 raft_consensus.cc:3055] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:50.772547 17010 raft_consensus.cc:3055] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:50.772730 16995 raft_consensus.cc:740] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:50.773020 17010 raft_consensus.cc:740] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:50.774879 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:50.775477 12695 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:50.767407 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:50.725862 17009 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:50.777501 12694 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 12: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:50.778851 17009 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:50.778430 16995 consensus_queue.cc:260] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:50.780284 12587 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:50.780807 17056 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15.
I20260709 13:04:50.781064 16995 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:50.778893 17010 consensus_queue.cc:260] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.785938 16991 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:50.750180 16366 raft_consensus.cc:697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:50.787170 17010 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:50.788123 17036 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:50.792732 17036 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.793129 17036 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:50.793041 16366 consensus_queue.cc:237] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:50.789733 12692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1653) took 6854 ms (client timeout 1601 ms). Trace:
W20260709 13:04:50.795234 12692 rpcz_store.cc:269] 0709 13:04:43.934933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:43.936703 (+  1770us) service_pool.cc:224] Handling call
0709 13:04:50.789458 (+6852755us) spinlock_profiling.cc:243] Waited 5.64 s on lock 0x7b54002c9f54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:50.789630 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12973186944}
W20260709 13:04:50.802063 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.750443 16761 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.805058 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:50.805302 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:50.805698 13229 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:50.810725 17036 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:50.812518 17028 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:50.814996 17036 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:50.817891 12614 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:50.818434 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:60170 (request call id 981) took 3441 ms. Trace:
I20260709 13:04:50.818749 12614 rpcz_store.cc:276] 0709 13:04:47.376759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:47.376935 (+   176us) service_pool.cc:224] Handling call
0709 13:04:50.702658 (+3325723us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b5400375354. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9570a3d 00007fc3ae540cd0 00007fc3a7ac5254 00007fc3a7ac51e2 00007fc3a7ac5111 00007fc3a7ac508c 00007fc3a7ac4342 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:50.817785 (+115127us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b4c00212240. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7845a20 00007fc3a7856a29 00007fc3a785713f 00007fc3a781b2ab 00007fc3a7848f3c 00007fc3a78493fe 00007fc3a7ad688b 00007fc3a94d5495 00007fc3a952630f 00007fc3a9570a55 00007fc3ae540cd0
0709 13:04:50.818349 (+   564us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375581440}
I20260709 13:04:50.830071 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:50.830705 12690 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:50.833213 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:50.833413 17063 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:04:50.835160 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1034) took 1133 ms. Trace:
I20260709 13:04:50.836642 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:50.835522 12696 rpcz_store.cc:276] 0709 13:04:49.702187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.635283 (+933096us) service_pool.cc:224] Handling call
0709 13:04:50.635633 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:50.681427 (+ 45794us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:50.681460 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:50.688380 (+  6920us) log.cc:844] Serialized 26 byte log entry
0709 13:04:50.755436 (+ 67056us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:50.755747 (+   311us) log.cc:844] Serialized 14 byte log entry
0709 13:04:50.755982 (+   235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.756055 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:50.834975 (+ 78920us) raft_consensus.cc:1685] finished
0709 13:04:50.834996 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:50.835106 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36504,"prepare.queue_time_us":1566,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":36362,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":2163,"thread_start_us":30616,"threads_started":1,"wal-append.queue_time_us":33796}
I20260709 13:04:50.836889 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:50.837271 12615 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:50.837455 13234 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:50.804371 16761 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:50.842509 12614 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:04:50.848398 12615 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:04:50.830984 17043 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:50.850508 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:04:50.851224 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 124337us
I20260709 13:04:50.852304 12692 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:50.845902 13229 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:04:50.854225 13234 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:04:50.842813 16991 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:50.856644 17027 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 13:04:50.859309 13197 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:50.861311 17061 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:50.861438 13197 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:50.861907 17061 raft_consensus.cc:697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:50.863078 16837 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:50.862802 17061 consensus_queue.cc:237] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.863621 16837 raft_consensus.cc:697] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:50.864120 17059 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:04:50.864506 16837 consensus_queue.cc:237] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.866099 17059 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:50.868781 17029 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:50.871315 12692 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:50.871572 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:50.872347 12694 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:50.874480 12587 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:50.875375 17002 consensus_queue.cc:260] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.876658 17002 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:50.877765 16991 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:50.879257 17028 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:50.881757 16991 raft_consensus.cc:697] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:50.882844 16991 consensus_queue.cc:237] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:50.886260 13233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 787) took 1597 ms. Trace:
I20260709 13:04:50.886669 13233 rpcz_store.cc:276] 0709 13:04:49.288322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:50.477831 (+1189509us) service_pool.cc:224] Handling call
0709 13:04:50.478203 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:50.684856 (+206653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:50.886021 (+201165us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54005d3254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:50.886191 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":471960960}
I20260709 13:04:50.888389 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:50.888643 12694 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:04:50.890899 12587 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:50.891969 13197 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:50.892501 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:50.892628 13199 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:50.879338 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 3215) took 1094 ms. Trace:
I20260709 13:04:50.893095 17031 consensus_queue.cc:1059] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:04:50.893539 13199 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:50.899152 13199 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:50.902007 17012 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:50.902618 17012 raft_consensus.cc:697] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:50.903534 17012 consensus_queue.cc:237] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:50.904639 12621 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:50.908896 16840 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:50.894124 17031 consensus_queue.cc:1243] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:04:50.909370 16840 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.909874 16840 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:50.896361 16820 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.914590 16820 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.916286 12588 leader_election.cc:400] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12.
I20260709 13:04:50.916738 12588 leader_election.cc:403] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:04:50.917209 16820 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:50.897673 13231 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:50.897746 16990 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:50.925668 16990 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.925920 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:50.926227 16990 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:50.926625 12691 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:50.926781 16852 consensus_queue.cc:1059] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:04:50.928586 16852 raft_consensus.cc:3055] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:50.925668 12662 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:50.897585 17018 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:04:50.929813 17018 raft_consensus.cc:697] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:50.930806 17018 consensus_queue.cc:237] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.928928 16852 raft_consensus.cc:740] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:50.934052 16841 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:50.934285 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:04:50.934814 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 957504us
I20260709 13:04:50.934937 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:50.935774 12621 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 7.
I20260709 13:04:50.935834 12510 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:50.938632 13197 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:50.938926 17043 raft_consensus.cc:3055] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:50.939461 17043 raft_consensus.cc:740] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:50.939646 17027 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:50.940101 17027 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:50.940428 17027 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:50.940685 17043 consensus_queue.cc:260] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.943749 17043 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:50.944731 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:50.945187 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:50.945542 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:50.945878 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:50.946687 12621 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:04:50.947623 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:50.948249 12622 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:50.948791 17027 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.949956 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:50.950706 12616 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:04:50.951692 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:04:50.954340 13256 debug-util.cc:398] Leaking SignalData structure 0x7b08002dce00 after lost signal to thread 12479
I20260709 13:04:50.955005 12620 raft_consensus.cc:1275] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:04:50.955327 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 1.14512e+06us
I20260709 13:04:50.893734 12618 rpcz_store.cc:276] 0709 13:04:49.784892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:49.785087 (+   195us) service_pool.cc:224] Handling call
0709 13:04:50.879152 (+1094065us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b54002a76d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:50.879279 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1787767040}
I20260709 13:04:50.956921 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:50.955896 17008 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:50.957218 16740 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:50.957805 17008 raft_consensus.cc:697] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:50.958177 16740 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:50.959118 17008 consensus_queue.cc:237] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.963083 16585 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:50.963260 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 45753.9us
I20260709 13:04:50.964234 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:50.965070 16842 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.965670 16842 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:50.967235 16995 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:50.967674 16995 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:50.968080 16995 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:50.968619 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:50.969772 16792 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:50.969847 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:50.970438 16792 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.957329 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:50.957785 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:50.974864 12696 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:50.973367 12694 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:50.975615 12695 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:50.978406 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:50.979064 16992 consensus_queue.cc:1059] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:50.979866 17034 raft_consensus.cc:3055] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:50.980310 17034 raft_consensus.cc:740] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:50.954150 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:50.981069 12617 raft_consensus.cc:2368] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16.
W20260709 13:04:50.981638 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 55992.8us
I20260709 13:04:50.981732 16672 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:50.982357 16672 raft_consensus.cc:697] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:50.981173 17034 consensus_queue.cc:260] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.982898 12662 leader_election.cc:400] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16.
I20260709 13:04:50.983385 17034 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:50.912892 16761 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.983260 16672 consensus_queue.cc:237] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:50.956990 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:50.986801 12620 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:50.987583 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:50.934306 16852 consensus_queue.cc:260] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:50.991436 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 46683.5us
I20260709 13:04:50.991528 17007 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:50.992475 12510 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:50.993265 17007 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:04:50.993788 17007 raft_consensus.cc:697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:50.994856 17007 consensus_queue.cc:237] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:51.005893 13256 debug-util.cc:398] Leaking SignalData structure 0x7b08002dd720 after lost signal to thread 12571
W20260709 13:04:51.006317 13256 debug-util.cc:398] Leaking SignalData structure 0x7b08002dd6e0 after lost signal to thread 12572
W20260709 13:04:51.007432 13256 debug-util.cc:398] Leaking SignalData structure 0x7b080029eac0 after lost signal to thread 12646
W20260709 13:04:51.007754 13256 debug-util.cc:398] Leaking SignalData structure 0x7b08003fba80 after lost signal to thread 12647
W20260709 13:04:51.008831 13256 debug-util.cc:398] Leaking SignalData structure 0x7b0800408160 after lost signal to thread 12720
W20260709 13:04:51.009115 13256 debug-util.cc:398] Leaking SignalData structure 0x7b080031bba0 after lost signal to thread 12721
I20260709 13:04:50.972004 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:51.009948 12659 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:51.010895 13226 raft_consensus.cc:2393] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 12: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:50.968150 12588 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:51.011945 12659 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:51.009953 13230 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 13:04:51.010075 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 822502us
I20260709 13:04:50.918372 17029 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:51.015158 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:51.017704 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:51.019294 12690 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:04:51.020664 12587 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:51.021785 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.022651 12617 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:51.030090 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:51.032094 13256 debug-util.cc:398] Leaking SignalData structure 0x7b08003bfdc0 after lost signal to thread 13259
W20260709 13:04:51.036053 13256 debug-util.cc:398] Leaking SignalData structure 0x7b08003f9f20 after lost signal to thread 13260
I20260709 13:04:51.046036 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:51.050500 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:51.048134 12688 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:51.050868 12613 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 12: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:51.051806 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:51.048949 12695 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:04:51.052338 12688 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:51.052809 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:51.053229 12695 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:04:51.053604 13230 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 11: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:51.054057 12616 raft_consensus.cc:2410] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:51.054240 16833 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:51.050534 16792 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:51.056746 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.056665 12616 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:51.049979 12689 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:04:51.061966 17009 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:51.062532 17009 raft_consensus.cc:697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:50.961175 16740 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:04:51.063445 17009 consensus_queue.cc:237] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:51.064303 17029 raft_consensus.cc:697] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:04:51.050747 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.047964 16233 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:51.065433 16233 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:51.065917 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:51.066083 17052 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:51.063792 16761 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:51.049839 12512 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:51.072495 13226 raft_consensus.cc:1240] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:51.075417 12688 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:04:51.036054 12687 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:04:51.090306 12618 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:51.095621 12691 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:04:51.096547 12620 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
W20260709 13:04:51.101262 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 133193us
I20260709 13:04:51.101473 12694 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:51.102238 12588 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:51.103541 12588 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:51.106848 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:51.115561 13234 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:04:51.119551 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:51.122941 13233 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: []
W20260709 13:04:51.123660 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 101268us
I20260709 13:04:51.124917 12622 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:51.126735 12659 leader_election.cc:400] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16.
I20260709 13:04:51.127072 12659 leader_election.cc:403] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:04:51.121784 13199 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:51.134577 13230 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:04:51.135944 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:51.140074 13229 raft_consensus.cc:1240] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:04:51.142973 12694 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:51.136319 13199 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:51.146008 13199 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:51.113684 16740 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:51.116072 16841 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:51.102113 17030 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.118620 17031 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:51.118369 16992 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:51.150429 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:51.163551 13228 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:04:51.113942 16994 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:51.135350 16842 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:51.156544 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 106800us
I20260709 13:04:51.127517 16852 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:51.117830 17010 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:51.134764 17019 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12.
I20260709 13:04:51.168787 16233 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:51.134408 16986 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:04:51.162066 17031 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.134204 17021 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:04:51.144932 16989 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:51.171733 16792 consensus_queue.cc:1059] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:51.171864 16995 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:51.176344 16585 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:51.137068 17020 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16.
I20260709 13:04:51.192036 16842 consensus_queue.cc:1059] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:04:51.215483 16842 consensus_queue.cc:1243] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:04:51.179685 13228 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:51.184834 12622 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:51.065388 17029 consensus_queue.cc:237] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:51.152412 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 97644.6us
I20260709 13:04:51.151466 16820 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:51.134794 17052 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 13:04:51.153467 16740 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:51.159919 16841 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:51.159720 17018 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:51.144325 16366 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:04:51.182996 12696 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:51.197347 13234 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:51.145800 16990 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:51.209674 16792 raft_consensus.cc:3055] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:04:51.209774 13230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:04:51.218865 13229 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:51.196300 17031 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:51.177187 17030 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:51.201731 17010 raft_consensus.cc:697] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:51.215914 16233 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:04:51.249751 17059 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:04:51.249854 17018 raft_consensus.cc:697] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:51.222903 16740 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:51.224479 16841 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:51.196768 17061 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
W20260709 13:04:51.292785 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.236187 16761 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:04:51.234169 16792 raft_consensus.cc:740] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:51.296419 13227 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:51.236526 16820 raft_consensus.cc:697] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:04:51.308487 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 157600us
W20260709 13:04:51.310145 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 191450us
I20260709 13:04:51.322453 12659 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:51.322963 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:51.323144 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 171016us
I20260709 13:04:51.324733 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:51.233928 16840 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:51.325397 13234 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:04:51.330044 12659 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:51.335243 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:51.358326 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:51.358966 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.360664 12622 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:04:51.333662 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 122407us
W20260709 13:04:51.380859 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.392930 13232 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 12. Ops: []
W20260709 13:04:51.389884 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 127923us
I20260709 13:04:51.327162 16992 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.258452 17018 consensus_queue.cc:237] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:51.403950 16995 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:51.409821 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:51.476147 12696 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:51.410036 16820 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:51.412070 16840 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:51.414206 17070 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:04:51.333834 17027 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:51.362193 17002 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:51.396481 16366 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:04:51.360282 12588 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:51.357873 17056 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.120s
W20260709 13:04:51.498857 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 316838us
I20260709 13:04:51.495427 13233 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:04:51.405210 16792 consensus_queue.cc:260] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:51.504473 12691 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:04:51.497936 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 137918us
W20260709 13:04:51.472652 17038 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:04:51.477715 16672 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:04:51.507233 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 177280us
W20260709 13:04:51.478089 17043 consensus_meta.cc:287] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.534s	user 0.013s	sys 0.000s
W20260709 13:04:51.514822 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.478196 17083 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:51.482472 17084 raft_consensus.cc:3055] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:51.520118 12659 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:51.455278 16992 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:51.534757 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.530608 13199 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:04:51.551498 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.551630 12693 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:04:51.552167 12693 pending_rounds.cc:85] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 10
I20260709 13:04:51.552456 12693 pending_rounds.cc:107] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:04:51.552755 12693 raft_consensus.cc:2889] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:51.547187 12694 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:51.547989 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:51.565992 12688 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:04:51.454061 17010 consensus_queue.cc:237] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:51.529963 17034 consensus_meta.cc:287] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.546s	user 0.011s	sys 0.002s
W20260709 13:04:51.572361 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.609257 17097 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:04:51.610055 17075 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:04:51.621716 16992 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:51.571718 16672 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:51.624396 16672 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:51.626459 16792 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:51.629109 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.629858 17081 consensus_queue.cc:1059] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:51.632603 12614 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:04:51.633970 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:51.634850 12615 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:51.639153 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:51.639866 12619 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:51.576510 12696 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
W20260709 13:04:51.573362 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 180865us
W20260709 13:04:51.580950 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 162690us
I20260709 13:04:51.502252 17002 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:51.553462 17084 raft_consensus.cc:740] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:51.687530 12512 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:51.626583 16841 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:51.567730 17083 raft_consensus.cc:697] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:51.702397 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:51.688768 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 193824us
I20260709 13:04:51.607376 17036 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:51.639292 17041 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:51.717895 13230 raft_consensus.cc:606] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
W20260709 13:04:51.702020 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 45262.6us
I20260709 13:04:51.690255 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:51.725665 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 205625us
W20260709 13:04:51.722958 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 59758.9us
I20260709 13:04:51.727437 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:51.728123 12614 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:51.723534 13233 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:04:51.724490 12615 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:04:51.731760 12619 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 8.
I20260709 13:04:51.705439 16366 raft_consensus.cc:697] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:51.734169 12621 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:04:51.734593 12621 pending_rounds.cc:85] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 8
I20260709 13:04:51.735061 12621 pending_rounds.cc:107] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:04:51.735330 12621 raft_consensus.cc:2889] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:51.608258 17007 consensus_queue.cc:1059] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 13:04:51.567119 17088 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.172s
I20260709 13:04:51.691572 17017 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:51.743817 12618 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:51.574524 17095 consensus_queue.cc:1059] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.169s
I20260709 13:04:51.764382 12620 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:04:51.739095 16995 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:04:51.782392 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:51.727564 16585 raft_consensus.cc:3055] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:04:51.793083 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 460076us
I20260709 13:04:51.734011 16992 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:51.689231 16839 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
W20260709 13:04:51.765758 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.719612 16761 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:04:51.737886 17036 raft_consensus.cc:697] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:04:51.782125 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:51.799840 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 72653.6us
I20260709 13:04:51.807107 12614 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:51.809903 12615 raft_consensus.cc:2393] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 9: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:51.802531 17043 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:51.848363 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 45273.6us
I20260709 13:04:51.798074 16990 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:51.862461 17076 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.430s	user 0.001s	sys 0.000s
I20260709 13:04:51.862334 13197 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:51.863759 17073 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.422s	user 0.001s	sys 0.000s
W20260709 13:04:51.864980 17080 log.cc:927] Time spent T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260709 13:04:51.857158 17008 consensus_queue.cc:1059] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:04:51.868112 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:51.868038 13197 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:51.871999 12615 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:51.873660 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:51.831440 16992 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:51.876613 17092 log.cc:927] Time spent T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:04:51.878361 16992 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:51.878822 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:51.849457 17105 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:51.881052 17045 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:51.881855 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:51.882627 12618 raft_consensus.cc:2393] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 8: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:04:51.884097 17107 log.cc:927] Time spent T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:04:51.811503 16585 raft_consensus.cc:740] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:51.879908 17052 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:51.893795 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:51.853472 17083 consensus_queue.cc:237] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:51.893850 17052 raft_consensus.cc:697] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:51.833840 17017 raft_consensus.cc:697] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:51.896378 17052 consensus_queue.cc:237] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:51.942255 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:51.827373 16846 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:04:51.966605 12620 raft_consensus.cc:1240] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:04:51.968787 12618 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 8. Current term is 9. Ops: []
I20260709 13:04:51.943374 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:51.946076 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:51.971226 12614 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 12: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:51.974907 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:04:51.913739 16833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.001s	sys 0.010s
I20260709 13:04:51.853799 16837 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.091s
I20260709 13:04:51.889351 17045 raft_consensus.cc:697] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:04:52.177188 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 489921us
I20260709 13:04:52.180148 12512 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:52.185248 12620 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:51.966320 17007 raft_consensus.cc:3055] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:51.867578 17043 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:52.129899 16833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.001s	sys 0.011s
I20260709 13:04:51.968842 17041 raft_consensus.cc:697] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:52.210476 16992 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.226569 17111 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.226835 16992 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:52.227160 17111 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:52.229010 17099 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.229208 16992 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:51.861840 17084 consensus_queue.cc:260] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:51.890022 16366 consensus_queue.cc:237] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:52.195960 17007 raft_consensus.cc:740] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:52.238415 17041 consensus_queue.cc:237] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:52.244602 17106 log.cc:927] Time spent T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.362s	user 0.001s	sys 0.001s
W20260709 13:04:52.277544 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 53014us
I20260709 13:04:52.245520 17084 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:52.246034 17102 raft_consensus.cc:3055] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:52.227178 17112 consensus_queue.cc:1059] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.346s
W20260709 13:04:52.233271 16792 consensus_meta.cc:287] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.604s	user 0.009s	sys 0.002s
I20260709 13:04:52.223726 17002 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:52.285444 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
W20260709 13:04:52.283687 16740 consensus_meta.cc:287] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.988s	user 0.011s	sys 0.000s
I20260709 13:04:52.274986 16841 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:52.285437 17102 raft_consensus.cc:740] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:52.217711 16585 consensus_queue.cc:260] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:52.331194 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.220851 17036 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:52.389701 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 52238.9us
I20260709 13:04:52.232254 17099 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:52.399784 12513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.016s	sys 0.019s
W20260709 13:04:52.400303 12513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.016s	sys 0.019s
W20260709 13:04:52.400656 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 544205us
I20260709 13:04:52.311439 17111 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:52.401721 13197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.012s	sys 0.020s
W20260709 13:04:52.417601 13197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.012s	sys 0.021s
W20260709 13:04:52.418097 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 550119us
I20260709 13:04:52.421677 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:52.422478 12619 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:04:52.402077 12613 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.017s	sys 0.017s
W20260709 13:04:52.424575 12613 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.017s	sys 0.017s
I20260709 13:04:52.329727 16792 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.439760 13234 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:52.287911 17017 consensus_queue.cc:237] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:52.314554 16740 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:52.445753 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:52.464381 13200 leader_election.cc:336] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.978s (SENT)
I20260709 13:04:52.467487 12619 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:52.471975 12588 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:52.474049 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:52.457661 17083 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.018s	sys 0.011s
I20260709 13:04:52.449534 16585 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:52.303484 17045 consensus_queue.cc:237] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:52.494632 17083 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.018s	sys 0.012s
I20260709 13:04:52.490448 13200 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:52.403728 17007 consensus_queue.cc:260] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:52.529036 17095 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.048s	sys 0.092s
I20260709 13:04:52.508219 16792 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:52.539666 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 254289us
I20260709 13:04:52.542425 12512 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:52.534812 17112 consensus_queue.cc:1243] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:04:52.541644 17095 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.049s	sys 0.093s
I20260709 13:04:52.536602 16995 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:04:52.553314 17112 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.553465 17130 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:04:52.567819 17112 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:52.554275 17124 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:04:52.555241 17120 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:04:52.558086 17122 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:52.560990 17125 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:04:52.553879 17119 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:52.587581 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:52.576777 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 112447us
I20260709 13:04:52.585337 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:52.588485 13200 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.992s (SENT) [suppressed 42 similar messages]
I20260709 13:04:52.523454 17102 consensus_queue.cc:260] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:52.580229 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:52.564446 17007 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:52.563503 16908 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:52.563987 17083 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:52.586953 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:52.587078 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:04:52.558125 17086 log.cc:927] Time spent T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 1.152s	user 0.011s	sys 0.025s
I20260709 13:04:52.590579 17108 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.591068 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:52.612339 17108 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:52.612888 17099 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:52.613441 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 799) took 1466 ms. Trace:
I20260709 13:04:52.613668 13234 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:04:52.588624 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:52.579770 17095 raft_consensus.cc:3055] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:52.613906 13229 rpcz_store.cc:276] 0709 13:04:51.152063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:51.162705 (+ 10642us) service_pool.cc:224] Handling call
0709 13:04:51.169463 (+  6758us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:51.234786 (+ 65323us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:52.613156 (+1378370us) spinlock_profiling.cc:243] Waited 46.8 ms on lock 0x7b54006d01d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:52.613361 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107654400}
I20260709 13:04:52.614637 17095 raft_consensus.cc:740] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:52.615962 17095 consensus_queue.cc:260] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:52.618526 16740 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:52.619412 17116 log.cc:927] Time spent T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.381s	user 0.000s	sys 0.012s
I20260709 13:04:52.580523 17124 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:52.591270 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:52.620855 17124 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:52.591511 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:04:52.622025 17105 consensus_meta.cc:287] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.742s	user 0.007s	sys 0.005s
W20260709 13:04:52.601816 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.612572 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48978 (request call id 26) took 1403 ms. Trace:
I20260709 13:04:52.599088 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1077) took 1092 ms. Trace:
I20260709 13:04:52.611346 12547 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:52.610688 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:52.622586 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1078) took 1114 ms. Trace:
I20260709 13:04:52.614763 13233 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:52.623435 13230 rpcz_store.cc:276] 0709 13:04:51.209449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:51.209602 (+   153us) service_pool.cc:224] Handling call
0709 13:04:52.612389 (+1402787us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54005794d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9573853 00007fc3ae54160a 00007fc3a7ac77d4 00007fc3a7ac7762 00007fc3a7ac7691 00007fc3a7ac760c 00007fc3a7ac68c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:52.612485 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1111726464}
I20260709 13:04:52.624454 12691 rpcz_store.cc:276] 0709 13:04:51.507129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:51.507291 (+   162us) service_pool.cc:224] Handling call
0709 13:04:51.507622 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:51.728284 (+220662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:51.728338 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:51.804744 (+ 76406us) log.cc:844] Serialized 26 byte log entry
0709 13:04:51.979513 (+174769us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:51.979556 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:51.979626 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:52.598813 (+619187us) raft_consensus.cc:1685] finished
0709 13:04:52.598835 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:52.598994 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":138061,"spinlock_wait_cycles":58448640,"thread_start_us":338008,"threads_started":2,"wal-append.queue_time_us":482657}
I20260709 13:04:52.611080 12545 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:52.626801 12540 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:04:52.595573 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:52.637590 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1033) took 1542 ms. Trace:
I20260709 13:04:52.641893 12541 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 11: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:52.610893 17139 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:04:52.609886 17126 log.cc:927] Time spent T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 13:04:52.606813 16792 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:52.620544 17031 consensus_meta.cc:287] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.352s	user 0.010s	sys 0.000s
I20260709 13:04:52.646597 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:52.646895 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.617228 17095 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:52.627521 12687 rpcz_store.cc:276] 0709 13:04:51.508663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:51.517191 (+  8528us) service_pool.cc:224] Handling call
0709 13:04:51.520897 (+  3706us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:51.658832 (+137935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:51.658881 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:51.683114 (+ 24233us) log.cc:844] Serialized 26 byte log entry
0709 13:04:52.131031 (+447917us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:04:52.523963 (+392932us) log.cc:844] Serialized 14 byte log entry
0709 13:04:52.524817 (+   854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:52.525409 (+   592us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:52.618811 (+ 93402us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:04:52.622302 (+  3491us) raft_consensus.cc:1685] finished
0709 13:04:52.622392 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:52.622529 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":426568,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":125949,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":30860,"spinlock_wait_cycles":45914496,"thread_start_us":850839,"threads_started":3,"wal-append.queue_time_us":536265}
I20260709 13:04:52.609328 16992 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.602247 17102 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:52.608106 16846 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:52.651916 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:52.656087 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:52.673712 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:52.692552 12545 raft_consensus.cc:2393] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 14: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:04:52.665132 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.622449 17105 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:52.597029 17112 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:52.672597 13200 leader_election.cc:336] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.746s (SENT)
I20260709 13:04:52.646870 17139 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:04:52.702265 13200 leader_election.cc:336] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.816s (SENT)
I20260709 13:04:52.702874 13200 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:52.607133 16908 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:52.637996 17113 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:04:52.671648 17012 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.592283 17122 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:52.598655 17119 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:52.702394 12541 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:52.713889 17132 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:52.714424 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:52.714462 17132 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:52.709069 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 166719us
I20260709 13:04:52.722287 12512 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:52.724155 17119 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:52.725147 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:52.607244 17083 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:52.727633 17083 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:52.699751 16846 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:52.728368 16846 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:52.655766 17020 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:04:52.736536 12541 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:52.738725 17117 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:52.739647 17117 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:52.755673 12538 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:04:52.707441 17099 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.706183 17139 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:52.771215 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:52.766997 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 54550.8us
I20260709 13:04:52.671253 17031 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:52.707223 17045 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:52.694696 16992 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:52.782454 13234 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:52.765317 17010 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:52.762427 17099 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:52.712814 17012 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:52.813868 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 91665.9us
I20260709 13:04:52.808821 17140 consensus_queue.cc:1059] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:04:52.819386 16740 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:52.819912 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:52.825026 12512 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:52.834424 12662 leader_election.cc:336] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.523s (SENT)
W20260709 13:04:52.835429 12662 leader_election.cc:336] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.534s (SENT)
I20260709 13:04:52.838168 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:52.842134 12512 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:52.846717 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:52.848155 16740 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:52.850095 16908 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:52.858889 13200 leader_election.cc:336] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.891s (SENT)
W20260709 13:04:52.849156 12662 leader_election.cc:336] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.548s (SENT)
W20260709 13:04:52.861326 13200 leader_election.cc:336] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.992s (SENT)
I20260709 13:04:52.858465 16992 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:52.862474 17012 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:52.862639 16992 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:04:52.863029 17143 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:04:52.844933 16833 raft_consensus.cc:3055] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:52.863237 16992 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:52.863792 16833 raft_consensus.cc:740] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:52.864768 16833 consensus_queue.cc:260] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:52.865979 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:52.866520 12541 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:52.861774 13200 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:52.811987 17010 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:52.870754 17151 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:04:52.871359 17123 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:52.846894 17084 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:52.866787 17140 consensus_queue.cc:1059] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:04:52.865401 16992 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:52.886389 12541 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:04:52.847571 17108 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:52.893138 17123 raft_consensus.cc:3055] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:04:52.893674 17123 raft_consensus.cc:740] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:52.894709 17122 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:52.894649 17123 consensus_queue.cc:260] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:52.897971 17123 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:52.874135 17097 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:52.910522 17142 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:04:52.898115 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:52.914255 12541 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:52.914522 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.918841 17043 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:52.921700 17153 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:04:52.926597 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:52.927479 12538 raft_consensus.cc:2393] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 10: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:52.928300 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:52.928880 12538 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:52.933775 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:52.935920 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:52.937041 12543 raft_consensus.cc:2410] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:04:52.938290 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:52.938925 12544 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:52.940006 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:52.940474 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:52.940752 12544 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:04:52.941205 12538 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:04:52.942313 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:52.943028 12538 raft_consensus.cc:2368] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 10. Current term is 11.
I20260709 13:04:52.950148 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:52.951005 12538 raft_consensus.cc:2368] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12.
I20260709 13:04:52.950830 17031 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:52.952059 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:52.952888 17030 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:52.953200 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:52.962415 12538 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:52.963447 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:52.964061 12538 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:52.964986 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:52.936594 12541 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:52.966244 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:52.966761 12541 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:52.640957 12616 rpcz_store.cc:276] 0709 13:04:51.095636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:51.096044 (+   408us) service_pool.cc:224] Handling call
0709 13:04:51.114874 (+ 18830us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:51.197782 (+ 82908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:51.197829 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:51.204283 (+  6454us) log.cc:844] Serialized 26 byte log entry
0709 13:04:51.396020 (+191737us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:51.396081 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:52.635138 (+1239057us) spinlock_profiling.cc:243] Waited 77.3 ms on lock 0x7b54001054d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:52.635190 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:52.635240 (+    50us) raft_consensus.cc:1685] finished
0709 13:04:52.635253 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:52.637481 (+  2228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6347,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":18415,"spinlock_wait_cycles":177819904,"thread_start_us":159605,"threads_started":1,"wal-append.queue_time_us":414757,"wal-append.run_cpu_time_us":1605,"wal-append.run_wall_time_us":1004752}
W20260709 13:04:52.972069 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.976927 16995 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:52.977475 16995 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:04:52.979161 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.982601 17099 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:52.983752 16740 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:52.984604 17036 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:52.984787 17117 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:52.985240 17036 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:52.987120 17010 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:52.841022 16846 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:52.987576 17036 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:52.987622 17010 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:52.988914 17010 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:52.991107 17010 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:52.991920 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:04:52.992478 13200 leader_election.cc:336] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.210s (SENT)
I20260709 13:04:52.992534 12615 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:52.993471 13200 leader_election.cc:336] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.242s (SENT)
I20260709 13:04:52.882445 17084 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:52.998059 17084 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:52.999051 12540 raft_consensus.cc:2393] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 13: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:53.001036 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.001905 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:53.002724 12613 raft_consensus.cc:2410] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:04:53.002897 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:53.003418 12618 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:53.004385 12615 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:04:53.007323 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:53.007776 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.008061 12617 raft_consensus.cc:2393] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 13: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:53.008447 12538 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:53.009393 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.010185 12538 raft_consensus.cc:2393] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 11: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:53.001044 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:53.011742 12622 raft_consensus.cc:2368] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12.
W20260709 13:04:53.012737 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:52.998855 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:53.013790 12614 raft_consensus.cc:2410] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:04:52.954959 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.014662 12542 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:53.016319 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:53.016980 13229 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:04:52.961208 16842 raft_consensus.cc:3055] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:53.027091 16842 raft_consensus.cc:740] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:53.028185 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.028043 16842 consensus_queue.cc:260] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:53.028890 12538 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:04:53.029841 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:53.030699 12687 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:04:53.032940 16672 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.033049 12659 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:53.033460 16672 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:53.033854 17113 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.034451 12694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:04:53.051440 12694 raft_consensus.cc:606] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:04:53.051494 12691 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:04:53.051831 12694 raft_consensus.cc:614] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:53.035131 17013 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:53.029841 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:52.869057 16833 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:53.036396 17132 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:53.036695 17099 consensus_queue.cc:1059] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:04:53.039409 16989 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:04:53.039770 17129 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:53.040514 17031 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:04:53.042430 16820 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:04:53.042917 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.046591 12622 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:04:53.049094 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 189031us
I20260709 13:04:53.054189 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:53.029309 16842 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:53.168077 12696 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:04:53.105859 12659 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:53.064476 12547 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:53.414966 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:53.064491 12541 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:53.416035 12690 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 12: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:53.126252 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.418802 12542 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:53.126246 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.102170 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.126863 12687 raft_consensus.cc:1275] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:04:53.267480 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.185334 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:53.254531 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:53.178934 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:53.260694 12695 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:04:53.021406 12510 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:42446 dropped due to backpressure: service queue is full with 50 items [suppressed 2 similar messages]
I20260709 13:04:53.101552 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:53.182480 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:53.339138 12442 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36396 (request call id 353) took 40960 ms (client timeout 15000 ms). Trace:
I20260709 13:04:53.426259 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.427066 12541 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 11: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:53.211632 12618 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:04:53.427872 12538 raft_consensus.cc:2393] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 12: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:04:53.428092 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 322286us
I20260709 13:04:53.428576 12544 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 10: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:53.248755 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:53.429513 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.430576 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:53.432046 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:53.432770 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:53.422850 12616 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:53.077194 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.421451 12693 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:04:53.432595 13234 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:53.436322 12659 leader_election.cc:400] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12.
I20260709 13:04:53.437808 12659 leader_election.cc:403] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:53.442392 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:53.443425 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:53.447001 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:52.989426 16846 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:53.411505 16672 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:53.148144 17156 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.179101 17010 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.451184 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:53.452148 12659 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:53.456226 13234 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:53.448794 12540 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:53.456768 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.456871 12662 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:53.494843 13235 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 946) took 2439 ms (client timeout 1713 ms). Trace:
W20260709 13:04:53.495293 13235 rpcz_store.cc:269] 0709 13:04:51.013681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:51.014595 (+   914us) service_pool.cc:224] Handling call
0709 13:04:53.453021 (+2438426us) spinlock_profiling.cc:243] Waited 2.37 s on lock 0x7b54004989d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:53.453157 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5439690112}
W20260709 13:04:53.504772 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 52696.9us
I20260709 13:04:53.458253 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:53.447389 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:53.597075 12513 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.018s	sys 0.031s
I20260709 13:04:53.423640 12510 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:42446 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 943)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 937)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2995)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 924)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2991)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2992)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1632)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1633)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1636)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1617)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1630)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2997)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1629)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 925)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 934)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 944)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 939)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 942)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 938)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2993)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1616)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1614)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1626)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2973)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 931)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2977)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3000)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2996)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2978)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2980)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2981)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 921)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2994)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1615)
Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:35624 (request call id 922)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 923)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 926)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 927)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 928)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 929)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 930)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 933)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1631)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1635)
I20260709 13:04:52.981379 17124 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:53.472043 17002 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.473150 12689 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:53.436697 17036 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.459442 17111 raft_consensus.cc:3055] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:53.602037 17111 raft_consensus.cc:740] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:53.602949 17111 consensus_queue.cc:260] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:53.459597 17110 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:04:53.478323 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.480141 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:53.446518 17108 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:53.493423 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.130932 17056 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:53.506702 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:53.103371 17113 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:53.447029 16995 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:53.543179 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.520339 16672 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:53.494244 17156 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:53.593274 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:53.595191 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.466508 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:53.601637 17124 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:53.606834 12538 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:53.556277 17013 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:53.638456 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:53.639243 12541 raft_consensus.cc:2376] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10. Re-sending same reply.
I20260709 13:04:53.642186 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.642988 12541 raft_consensus.cc:2393] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 11: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:04:53.609742 12513 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.018s	sys 0.032s
I20260709 13:04:53.604235 17111 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:53.617045 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.520872 17155 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:53.511252 17043 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.503906 17010 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:53.631076 12539 consensus_meta.cc:287] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.000s
I20260709 13:04:53.673775 12539 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:04:53.547886 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:53.621488 12544 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:04:53.674381 17043 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:53.675822 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.676522 12544 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:04:53.677407 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:53.677929 17043 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:53.641791 17013 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:53.611912 17036 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:53.641045 12696 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:04:53.649358 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:53.762751 12541 raft_consensus.cc:2393] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 12: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:53.650710 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.763494 12540 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:53.765033 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:53.765818 12540 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:04:53.621238 17056 raft_consensus.cc:697] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:04:53.624457 12546 consensus_meta.cc:287] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.000s
I20260709 13:04:53.770390 12546 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:04:53.625607 17108 raft_consensus.cc:697] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:53.772003 17108 consensus_queue.cc:237] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:53.611774 17002 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:53.670737 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.708819 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:53.769615 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.776993 12687 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:53.668684 17155 raft_consensus.cc:697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:53.640337 16672 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:53.778920 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:53.779259 12544 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:53.781708 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.782533 12544 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:53.761309 16992 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.761722 17013 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:53.779649 12538 raft_consensus.cc:2368] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10.
I20260709 13:04:53.790536 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:53.791641 12544 raft_consensus.cc:2393] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 12: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:53.796600 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.797794 12689 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:04:53.798307 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:53.800529 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:53.801625 12538 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 13: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:53.802846 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.803417 16672 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:53.803814 12538 raft_consensus.cc:2393] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 12: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:04:53.804862 12546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2956) took 1226 ms (client timeout 1548 ms). Trace:
W20260709 13:04:53.805248 12546 rpcz_store.cc:269] 0709 13:04:52.578740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.578846 (+   106us) service_pool.cc:224] Handling call
0709 13:04:53.804693 (+1225847us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b5400228b54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:53.804804 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":915107584}
I20260709 13:04:53.794250 16992 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:53.806447 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:53.806682 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.807140 12546 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 10: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:53.807916 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.808914 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.809968 12545 raft_consensus.cc:1275] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:04:53.804980 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.813189 12538 raft_consensus.cc:2410] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:04:53.812222 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2970) took 1106 ms. Trace:
I20260709 13:04:53.813910 12545 rpcz_store.cc:276] 0709 13:04:52.705596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.705726 (+   130us) service_pool.cc:224] Handling call
0709 13:04:53.809650 (+1103924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:53.810357 (+   707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:53.811996 (+  1639us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400228b50. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:53.812149 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2521974656}
W20260709 13:04:53.814607 17139 consensus_meta.cc:287] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 1.024s	user 0.011s	sys 0.000s
I20260709 13:04:53.815910 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.801113 17155 consensus_queue.cc:237] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:53.809427 12546 raft_consensus.cc:2376] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9. Re-sending same reply.
I20260709 13:04:53.829021 12687 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
W20260709 13:04:53.645807 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 762224us
I20260709 13:04:53.822258 12545 raft_consensus.cc:2410] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:04:53.822407 12541 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
W20260709 13:04:53.832165 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:53.822897 12619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.000s	sys 0.014s
W20260709 13:04:53.823020 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:53.832723 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:53.823839 12544 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:04:53.837389 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:53.838349 12544 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:53.839705 12619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.000s	sys 0.015s
W20260709 13:04:53.424885 12442 rpcz_store.cc:269] 0709 13:04:12.345858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:12.346163 (+   305us) service_pool.cc:224] Handling call
0709 13:04:53.306200 (+40960037us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:49.962326 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:50.033667 (+ 71341us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:50.033738 (+    71us) write_op.cc:435] Acquired schema lock
0709 13:04:50.033768 (+    30us) tablet.cc:662] Decoding operations
0709 13:04:50.035002 (+  1234us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:50.035133 (+   131us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:50.035181 (+    48us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:04:50.036048 (+   867us) tablet.cc:701] Row locks acquired
0709 13:04:50.036108 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:04:50.036341 (+   233us) write_op.cc:270] Start()
0709 13:04:50.036539 (+   198us) write_op.cc:276] Timestamp: P: 1783602290036259 usec, L: 0
0709 13:04:50.036591 (+    52us) op_driver.cc:348] REPLICATION: starting
0709 13:04:50.070997 (+ 34406us) log.cc:844] Serialized 2462 byte log entry
0709 13:04:50.712673 (+641676us) op_driver.cc:464] REPLICATION: finished
0709 13:04:50.823972 (+111299us) write_op.cc:301] APPLY: starting
0709 13:04:50.824143 (+   171us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:51.258184 (+434041us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:51.258316 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:51.401532 (+143216us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:51.412063 (+ 10531us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:04:51.412161 (+    98us) write_op.cc:312] APPLY: finished
0709 13:04:51.412618 (+   457us) log.cc:844] Serialized 65 byte log entry
0709 13:04:51.413697 (+  1079us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:51.413861 (+   164us) write_op.cc:454] Released schema lock
0709 13:04:51.413943 (+    82us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:51.414470 (+   527us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:51.414509 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":377295,"reported_tablets":44,"spinlock_wait_cycles":19328,"child_traces":[["op",{"apply.queue_time_us":110840,"apply.run_cpu_time_us":18376,"apply.run_wall_time_us":590550,"cfile_cache_hit":22,"cfile_cache_hit_bytes":23001,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6218,"cfile_init":2,"lbm_read_time_us":17784,"lbm_reads_1-10_ms":3,"lbm_reads_lt_1ms":9,"num_ops":6,"prepare.queue_time_us":74092,"prepare.run_cpu_time_us":11942,"prepare.run_wall_time_us":353101,"raft.queue_time_us":139094,"raft.run_cpu_time_us":10195,"raft.run_wall_time_us":105204,"replication_time_us":654505,"thread_start_us":416095,"threads_started":4,"wal-append.queue_time_us":239469,"wal-append.run_cpu_time_us":17165,"wal-append.run_wall_time_us":2105955}]]}
I20260709 13:04:53.843514 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:53.851550 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:53.852789 12541 raft_consensus.cc:2410] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:04:53.854260 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:53.859980 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.860386 12689 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:04:53.860711 12546 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:53.864194 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:53.869072 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:53.870137 12541 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:53.872646 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:53.825054 17127 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.886226 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.889214 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:53.891705 12538 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 11: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:53.892151 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:53.894358 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.895301 12545 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 11: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:53.900884 17036 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:53.909857 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:53.910470 12546 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:53.911094 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2967) took 1239 ms. Trace:
I20260709 13:04:53.911442 12539 rpcz_store.cc:276] 0709 13:04:52.671331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:52.933453 (+262122us) service_pool.cc:224] Handling call
0709 13:04:53.910936 (+977483us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54003aaa54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:53.911033 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":264663808}
I20260709 13:04:53.912441 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:53.887596 17056 consensus_queue.cc:237] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:53.913098 12539 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 11: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:04:53.913784 13200 leader_election.cc:336] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 3.075s (SENT)
I20260709 13:04:53.825878 17139 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:53.935340 17124 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:53.935626 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:53.909312 16992 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:53.936357 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:53.960394 12545 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:53.959448 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:53.967095 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:53.978087 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.979174 12539 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 13: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:53.984639 12542 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
W20260709 13:04:53.959373 16842 consensus_meta.cc:287] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.532s	user 0.010s	sys 0.001s
I20260709 13:04:53.984170 17139 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:53.985653 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:53.991809 16992 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:53.998703 16992 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:53.999775 16995 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:54.005038 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2977) took 1212 ms. Trace:
I20260709 13:04:54.006103 12543 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:04:54.006400 16846 consensus_queue.cc:1059] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:04:54.007234 16846 consensus_queue.cc:1243] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:04:54.007863 16846 raft_consensus.cc:3055] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:04:54.008284 16846 raft_consensus.cc:740] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:04:53.978246 17162 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.200s	user 0.001s	sys 0.000s
I20260709 13:04:54.015385 17099 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:54.017542 17163 log.cc:927] Time spent T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:04:54.005618 12539 rpcz_store.cc:276] 0709 13:04:52.792825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.981715 (+1188890us) service_pool.cc:224] Handling call
0709 13:04:54.004953 (+ 23238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:54.060817 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1621) took 1117 ms. Trace:
I20260709 13:04:54.061339 12542 rpcz_store.cc:276] 0709 13:04:52.943046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.428905 (+485859us) service_pool.cc:224] Handling call
0709 13:04:54.060586 (+631681us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54002b9654. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:54.060743 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1128050944}
I20260709 13:04:53.896837 17127 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:54.064390 17036 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:54.074328 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.075639 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.076424 12539 raft_consensus.cc:2393] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 10: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:04:54.075639 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 161874us
I20260709 13:04:54.077025 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3000) took 1142 ms. Trace:
I20260709 13:04:54.077342 12539 rpcz_store.cc:276] 0709 13:04:52.934934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.055668 (+1120734us) service_pool.cc:224] Handling call
0709 13:04:54.076969 (+ 21301us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:54.077533 13200 leader_election.cc:336] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.537s (SENT)
W20260709 13:04:54.078568 13200 leader_election.cc:336] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.610s (SENT)
I20260709 13:04:54.078992 13200 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:54.082360 13200 leader_election.cc:336] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.656s (SENT)
I20260709 13:04:54.083621 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:53.952124 17113 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:53.962750 17124 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:54.092069 12543 raft_consensus.cc:2368] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12.
W20260709 13:04:54.087850 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.046299 16995 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:54.102072 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:04:54.102566 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.103287 12542 raft_consensus.cc:2393] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 11: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:04:54.106894 12588 leader_election.cc:336] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.502s (SENT)
I20260709 13:04:54.113679 12546 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8.
I20260709 13:04:54.114508 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2973) took 1350 ms. Trace:
I20260709 13:04:54.116210 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.117300 12539 raft_consensus.cc:2393] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 11: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:54.116007 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.123013 12542 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 10: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:54.114912 12546 rpcz_store.cc:276] 0709 13:04:52.764223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.874306 (+1110083us) service_pool.cc:224] Handling call
0709 13:04:54.114432 (+240126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:54.129967 12687 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:04:54.130733 12662 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.000s	sys 0.016s
I20260709 13:04:54.009343 16846 consensus_queue.cc:260] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:54.085258 16989 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:54.064934 17036 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:54.137984 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.138624 12538 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
W20260709 13:04:54.131165 12662 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.000s	sys 0.017s
W20260709 13:04:54.139817 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 682966us
I20260709 13:04:54.140895 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.143344 12543 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 10: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:04:54.144198 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:54.144799 12588 leader_election.cc:336] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.533s (SENT)
I20260709 13:04:54.147531 12546 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:04:54.149178 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.149832 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2996) took 1216 ms. Trace:
I20260709 13:04:54.128260 16820 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.150941 12543 rpcz_store.cc:276] 0709 13:04:52.933581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.120296 (+1186715us) service_pool.cc:224] Handling call
0709 13:04:54.149774 (+ 29478us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:54.166064 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:54.169178 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:54.169868 12538 raft_consensus.cc:2376] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10. Re-sending same reply.
I20260709 13:04:54.083405 17099 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:54.137204 16841 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.024s	sys 0.017s
I20260709 13:04:54.133713 17165 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.171752 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2980) took 1332 ms. Trace:
I20260709 13:04:54.174707 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2978) took 1376 ms. Trace:
I20260709 13:04:54.182327 12546 rpcz_store.cc:276] 0709 13:04:52.816407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.126354 (+1309947us) service_pool.cc:224] Handling call
0709 13:04:54.126760 (+   406us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.148048 (+ 21288us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.148328 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:54.182406 12542 rpcz_store.cc:276] 0709 13:04:52.797909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.133302 (+1335393us) service_pool.cc:224] Handling call
0709 13:04:54.164325 (+ 31023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.174232 (+  9907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:54.174266 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:54.174336 (+    70us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:54.174383 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.174465 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:54.174620 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:54.177825 16841 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.024s	sys 0.018s
I20260709 13:04:54.170976 16846 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:54.185675 17165 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:54.187299 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.188061 12538 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 13: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:04:54.175204 17097 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.036s	sys 0.060s
I20260709 13:04:54.114667 16995 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:54.189198 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.079787 12544 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:04:54.193140 12539 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:54.190062 12543 raft_consensus.cc:2376] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9. Re-sending same reply.
W20260709 13:04:54.197857 17097 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.036s	sys 0.060s
I20260709 13:04:54.201221 12543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee"
dest_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:35624
I20260709 13:04:54.201845 12543 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:54.202432 12543 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:54.174474 16820 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:54.264544 16908 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.020s	sys 0.044s
W20260709 13:04:54.229147 12588 leader_election.cc:336] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.505s (SENT)
W20260709 13:04:54.266356 12659 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.009s	sys 0.021s
W20260709 13:04:54.266232 13197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.005s	sys 0.025s
I20260709 13:04:54.231647 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:54.252961 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:54.370314 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.358530 12538 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
W20260709 13:04:54.359071 12614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.008s	sys 0.045s
I20260709 13:04:54.258191 12440 catalog_manager.cc:5697] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 reported cstate change: config changed from index 3 to 7, 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:54.241007 12545 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:04:54.271347 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:54.412804 12614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.009s	sys 0.045s
W20260709 13:04:54.413211 13197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.018s	sys 0.042s
I20260709 13:04:54.413836 13230 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
W20260709 13:04:54.413920 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 906489us
I20260709 13:04:54.414346 12545 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:54.325793 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2981) took 1496 ms. Trace:
I20260709 13:04:54.415014 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 923) took 1410 ms. Trace:
I20260709 13:04:54.414952 12539 rpcz_store.cc:276] 0709 13:04:52.829248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.150794 (+1321546us) service_pool.cc:224] Handling call
0709 13:04:54.192891 (+ 42097us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.193683 (+   792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.325489 (+131806us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b54000690d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:54.325710 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47158656}
I20260709 13:04:54.415442 12545 rpcz_store.cc:276] 0709 13:04:53.004793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.413852 (+1409059us) service_pool.cc:224] Handling call
0709 13:04:54.414190 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.414792 (+   602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.414965 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:54.337787 12688 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.000s	sys 0.007s
W20260709 13:04:54.414120 12659 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.011s	sys 0.049s
W20260709 13:04:54.417038 12688 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.001s	sys 0.007s
W20260709 13:04:54.417673 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.420643 12659 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:54.412269 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 183162us
W20260709 13:04:54.360944 17111 consensus_meta.cc:287] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.707s	user 0.010s	sys 0.001s
W20260709 13:04:54.422678 12588 leader_election.cc:336] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.510s (SENT)
I20260709 13:04:54.412456 12538 pending_rounds.cc:85] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 11
I20260709 13:04:54.423497 12538 pending_rounds.cc:107] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:04:54.423302 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:54.423769 12538 raft_consensus.cc:2889] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:54.424114 12540 consensus_meta.cc:287] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.648s	user 0.011s	sys 0.011s
I20260709 13:04:54.424525 12540 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:04:54.425020 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2997) took 1491 ms. Trace:
I20260709 13:04:54.425132 12544 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 13. Ops: []
W20260709 13:04:54.414536 16908 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.027s	sys 0.069s
I20260709 13:04:54.425345 12540 rpcz_store.cc:276] 0709 13:04:52.933897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.764701 (+830804us) service_pool.cc:224] Handling call
0709 13:04:54.424964 (+660263us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:54.324002 17084 consensus_meta.cc:287] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 1.325s	user 0.017s	sys 0.006s
W20260709 13:04:54.364516 13229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.951s	user 0.014s	sys 0.039s
W20260709 13:04:54.447428 13229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.016s	sys 0.042s
I20260709 13:04:54.447646 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:54.365036 12693 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.014s	sys 0.037s
W20260709 13:04:54.448397 12693 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.018s	sys 0.038s
I20260709 13:04:54.364934 12541 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
W20260709 13:04:54.365116 12621 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.004s	sys 0.015s
I20260709 13:04:54.449545 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 2994) took 1516 ms. Trace:
W20260709 13:04:54.449831 12621 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.004s	sys 0.020s
I20260709 13:04:54.449985 12538 rpcz_store.cc:276] 0709 13:04:52.932845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.188611 (+1255766us) service_pool.cc:224] Handling call
0709 13:04:54.357498 (+168887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.449298 (+ 91800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.449497 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:54.368216 12662 leader_election.cc:336] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.652s (SENT)
W20260709 13:04:54.323181 16833 consensus_meta.cc:287] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.896s	user 0.008s	sys 0.016s
W20260709 13:04:54.332229 17110 consensus_meta.cc:287] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.717s	user 0.027s	sys 0.022s
I20260709 13:04:54.462285 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.463201 12547 raft_consensus.cc:2368] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 10. Current term is 11.
I20260709 13:04:54.463507 12541 raft_consensus.cc:2410] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:04:54.290382 17166 log.cc:927] Time spent T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:04:54.450860 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:54.467631 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 99440.1us
W20260709 13:04:54.468104 12662 connection.cc:256] RPC call timeout handler was delayed by -1.287506656000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2545s for a response
W20260709 13:04:54.468451 12662 connection.cc:256] RPC call timeout handler was delayed by -1.1791720429999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2048s for a response
W20260709 13:04:54.468730 12662 connection.cc:256] RPC call timeout handler was delayed by -1.1716154309999638s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
W20260709 13:04:54.469189 12662 leader_election.cc:336] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.653s (SENT)
I20260709 13:04:54.469750 17111 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:54.472733 17110 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12.
I20260709 13:04:54.474043 12546 raft_consensus.cc:2410] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:04:54.451839 12616 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:04:54.452345 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:54.451839 12613 raft_consensus.cc:1275] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:04:54.452848 13232 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 11: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:54.453168 12545 raft_consensus.cc:1240] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 11. Ops: []
I20260709 13:04:54.477955 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 927) took 1472 ms. Trace:
I20260709 13:04:54.478397 12545 rpcz_store.cc:276] 0709 13:04:53.005856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.416478 (+1410622us) service_pool.cc:224] Handling call
0709 13:04:54.452979 (+ 36501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.477639 (+ 24660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.477870 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:54.353082 17124 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:54.233232 17156 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:54.278789 16992 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:54.448809 17031 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:54.461503 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 926) took 1456 ms. Trace:
I20260709 13:04:54.332808 17002 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:54.446760 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.465781 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:54.341332 17127 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:54.271967 17010 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:54.469532 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:54.519405 12695 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:04:54.522702 12513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.009s	sys 0.008s
W20260709 13:04:54.545718 12513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.009s	sys 0.008s
I20260709 13:04:54.526511 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:54.546183 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 553335us
I20260709 13:04:54.535135 12539 rpcz_store.cc:276] 0709 13:04:53.005540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.416326 (+1410786us) service_pool.cc:224] Handling call
0709 13:04:54.446696 (+ 30370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.461007 (+ 14311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:54.461034 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:54.461079 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:54.461118 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.461321 (+   203us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:54.461439 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:54.541363 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:54.541476 12540 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:54.527746 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:54.461503 17084 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:54.645391 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.573271 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:54.682942 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:54.698053 12694 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:04:54.679796 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1615) took 1707 ms. Trace:
I20260709 13:04:54.574717 13233 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:54.699492 12544 rpcz_store.cc:276] 0709 13:04:52.935585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.194291 (+1258706us) service_pool.cc:224] Handling call
0709 13:04:54.424966 (+230675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.425517 (+   551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.642854 (+217337us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b54003aa050. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:54.643047 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":529254784}
I20260709 13:04:54.623930 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:54.698375 13231 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:54.697000 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.703971 12546 raft_consensus.cc:2393] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 12: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:04:54.579797 12547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 2990) took 1655 ms (client timeout 2030 ms). Trace:
W20260709 13:04:54.718428 12547 rpcz_store.cc:269] 0709 13:04:52.924287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.442127 (+517840us) service_pool.cc:224] Handling call
0709 13:04:54.579488 (+1137361us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54002bb454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:54.579689 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2345553792}
I20260709 13:04:54.624372 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 928) took 1618 ms. Trace:
I20260709 13:04:54.660775 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:54.519086 16839 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.722729 12538 rpcz_store.cc:276] 0709 13:04:53.006110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.460924 (+1454814us) service_pool.cc:224] Handling call
0709 13:04:54.528408 (+ 67484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.623968 (+ 95560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:54.623996 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:54.624050 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:54.624119 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.624182 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:54.624316 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:54.723507 12622 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 11: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:54.464278 17139 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:54.697829 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 228665us
W20260709 13:04:54.736084 12662 leader_election.cc:336] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.682s (SENT)
I20260709 13:04:54.523967 17036 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:54.546446 13234 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:04:54.736578 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:54.736779 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:54.693070 16841 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.014s	sys 0.006s
I20260709 13:04:54.543483 17031 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.757230 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.758561 12539 raft_consensus.cc:2393] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 7: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:54.573362 17099 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:54.641955 16672 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:54.623693 17002 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:54.760843 12538 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10. Ops: []
I20260709 13:04:54.722766 16992 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:04:54.756605 16841 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.015s	sys 0.007s
I20260709 13:04:54.761226 12547 raft_consensus.cc:1240] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:54.757377 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.753458 12587 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:54.819499 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 66104.7us
I20260709 13:04:54.821722 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:54.775367 13231 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:54.773505 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:54.824790 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 402124us
W20260709 13:04:54.764038 12662 connection.cc:256] RPC call timeout handler was delayed by -1.1248154310000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1952s for a response
I20260709 13:04:54.573103 16995 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:54.763046 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:54.828119 12545 raft_consensus.cc:2410] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:04:54.829838 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 933) took 1811 ms. Trace:
I20260709 13:04:54.830241 12547 rpcz_store.cc:276] 0709 13:04:53.007409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.735789 (+1728380us) service_pool.cc:224] Handling call
0709 13:04:54.760984 (+ 25195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.818469 (+ 57485us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.818761 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:54.741058 17010 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 13:04:54.831346 12587 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:54.835044 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 930) took 1828 ms. Trace:
I20260709 13:04:54.835487 12546 rpcz_store.cc:276] 0709 13:04:53.006631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.733524 (+1726893us) service_pool.cc:224] Handling call
0709 13:04:54.765008 (+ 31484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.823214 (+ 58206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:54.823249 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:54.834706 (+ 11457us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:54.834767 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.834843 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:54.834970 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:54.827451 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.837594 12539 raft_consensus.cc:2393] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 12: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:54.838583 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1631) took 1804 ms. Trace:
I20260709 13:04:54.839185 12538 rpcz_store.cc:276] 0709 13:04:53.018916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.739191 (+1720275us) service_pool.cc:224] Handling call
0709 13:04:54.760588 (+ 21397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.823445 (+ 62857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.823709 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:54.840986 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.842016 17002 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:54.842561 17002 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:54.842998 17002 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:54.843515 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:54.844934 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:54.846244 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:54.848996 12694 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:04:54.847354 12544 raft_consensus.cc:2393] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 12: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:04:54.858203 12689 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.010s	sys 0.024s
W20260709 13:04:54.859421 12689 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.010s	sys 0.024s
W20260709 13:04:54.873993 12543 consensus_meta.cc:287] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.652s	user 0.010s	sys 0.000s
I20260709 13:04:54.757378 17031 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:04:54.825692 12588 leader_election.cc:336] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.536s (SENT)
I20260709 13:04:54.766856 17165 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:54.903604 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.912942 12544 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:04:54.739357 17156 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:04:54.919948 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.921200 12539 raft_consensus.cc:2410] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:04:54.756963 17036 consensus_queue.cc:1048] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 4, Time since last communication: 0.116s
I20260709 13:04:54.906487 12588 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:54.907052 13200 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.010s	sys 0.026s
I20260709 13:04:54.845541 12695 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
W20260709 13:04:54.923401 13200 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.010s	sys 0.027s
W20260709 13:04:54.923724 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 788998us
W20260709 13:04:54.924899 13200 leader_election.cc:336] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.685s (SENT)
I20260709 13:04:54.902781 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:54.925853 13200 leader_election.cc:336] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.700s (SENT)
I20260709 13:04:54.909618 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:04:54.912006 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:54.926962 13200 leader_election.cc:336] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.733s (SENT)
I20260709 13:04:54.927484 12538 raft_consensus.cc:2410] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:04:54.928045 13200 leader_election.cc:336] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.869s (SENT)
I20260709 13:04:54.918340 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:54.937264 17097 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:54.949883 17097 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:54.925946 12547 raft_consensus.cc:2376] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15. Re-sending same reply.
I20260709 13:04:54.951351 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.951980 12547 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:04:54.952831 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.953776 12547 raft_consensus.cc:2410] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:04:54.954734 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.955667 12547 raft_consensus.cc:2376] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9. Re-sending same reply.
I20260709 13:04:54.957063 12547 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:54.957962 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 950) took 1137 ms. Trace:
I20260709 13:04:54.958397 12547 rpcz_store.cc:276] 0709 13:04:53.820989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.956441 (+1135452us) service_pool.cc:224] Handling call
0709 13:04:54.956718 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.957737 (+  1019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.957909 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:54.959616 17165 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:54.961962 17097 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:54.959635 12547 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:54.964834 12539 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:04:54.935557 12587 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:54.935669 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:54.758809 16989 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.143s
I20260709 13:04:54.937435 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.969411 12546 raft_consensus.cc:2368] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12.
I20260709 13:04:54.938844 12544 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:54.970738 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1635) took 1950 ms. Trace:
I20260709 13:04:54.971145 12544 rpcz_store.cc:276] 0709 13:04:53.020304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.938212 (+1917908us) service_pool.cc:224] Handling call
0709 13:04:54.938589 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.970486 (+ 31897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.970683 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:54.972257 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:54.973155 12544 raft_consensus.cc:2393] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 12: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:04:54.946702 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 121048us
I20260709 13:04:54.950182 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:54.974037 12588 leader_election.cc:336] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.671s (SENT)
I20260709 13:04:54.974073 12694 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:04:54.918366 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.974792 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:54.975666 12545 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 11: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:54.828490 17127 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.107s
W20260709 13:04:54.988652 12588 leader_election.cc:336] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.631s (SENT)
I20260709 13:04:54.834183 16992 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:54.873255 16995 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
W20260709 13:04:54.990962 12588 leader_election.cc:336] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.638s (SENT)
I20260709 13:04:54.992146 12588 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:54.993230 12545 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:54.966466 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:54.751318 16839 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:54.757692 17139 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:54.985265 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:54.985875 12539 raft_consensus.cc:3055] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:54.986543 12544 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:04:54.934788 17175 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.579s	user 0.000s	sys 0.001s
I20260709 13:04:55.009984 12539 raft_consensus.cc:740] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:54.969278 17111 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:54.994937 12588 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:54.970569 17036 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:54.723791 12440 catalog_manager.cc:5697] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:04:54.996294 12587 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:54.997517 12615 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.013s	sys 0.013s
W20260709 13:04:55.022324 12615 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.013s	sys 0.013s
W20260709 13:04:54.964553 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:54.874571 12543 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:54.970872 17171 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:55.025906 12542 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 12. Current term is 14. Ops: []
I20260709 13:04:55.022629 12613 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:04:55.011243 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:54.971232 17165 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:55.028927 12540 raft_consensus.cc:2410] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260709 13:04:55.029740 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 326391us
I20260709 13:04:55.012663 13231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60708e41894c42b697291e905bff5dc6"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:04:55.030778 13231 raft_consensus.cc:606] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:55.016450 17176 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.254s	user 0.000s	sys 0.000s
I20260709 13:04:55.016429 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:55.018659 12539 consensus_queue.cc:260] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:55.025022 12543 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:55.016429 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:55.025277 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:55.038333 12539 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:55.027318 12544 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:04:55.028746 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:55.039235 13234 raft_consensus.cc:3055] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:55.039616 13234 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:55.037815 12545 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 11: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:55.039579 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:55.042546 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:55.044158 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:55.045372 12544 raft_consensus.cc:2410] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:04:55.047046 13199 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:55.047277 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:04:55.048070 13197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.005s	sys 0.017s
W20260709 13:04:55.048790 13197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.005s	sys 0.017s
W20260709 13:04:55.049430 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 521573us
I20260709 13:04:55.048338 12544 raft_consensus.cc:2376] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15. Re-sending same reply.
I20260709 13:04:55.017478 17036 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:55.052600 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:55.053467 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:35624 (request call id 922) took 2033 ms. Trace:
I20260709 13:04:55.056455 12543 rpcz_store.cc:276] 0709 13:04:53.004478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.200041 (+1195563us) service_pool.cc:224] Handling call
0709 13:04:55.038262 (+838221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:55.008651 12538 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:04:55.049151 13234 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:55.057936 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:55.063558 12545 raft_consensus.cc:2410] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:04:55.064628 12547 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 13:04:55.058025 12538 pending_rounds.cc:85] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 8
I20260709 13:04:55.066675 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1083) took 1623 ms. Trace:
I20260709 13:04:55.068457 13234 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 14
W20260709 13:04:55.082463 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 256369us
I20260709 13:04:55.089058 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1643) took 1106 ms. Trace:
W20260709 13:04:55.089660 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.067162 12693 rpcz_store.cc:276] 0709 13:04:53.443365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.443786 (+   421us) service_pool.cc:224] Handling call
0709 13:04:53.444178 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:53.506209 (+ 62031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:53.506241 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:53.506685 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:04:54.448831 (+942146us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:54.448872 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.448939 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:55.066461 (+617522us) raft_consensus.cc:1685] finished
0709 13:04:55.066478 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.066610 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45541,"raft.queue_time_us":59703,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":824,"spinlock_wait_cycles":1088384,"thread_start_us":927870,"threads_started":1,"wal-append.queue_time_us":1312755}
W20260709 13:04:55.090438 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 75549.6us
I20260709 13:04:55.089545 12547 rpcz_store.cc:276] 0709 13:04:53.960157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.959251 (+999094us) service_pool.cc:224] Handling call
0709 13:04:54.959526 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:55.066100 (+106574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.066405 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:55.066905 12538 pending_rounds.cc:107] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:04:55.100414 12538 raft_consensus.cc:2889] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:55.051829 17010 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:04:55.104053 12621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.000s	sys 0.026s
W20260709 13:04:55.104571 12621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.001s	sys 0.027s
W20260709 13:04:55.105063 12541 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.012s	sys 0.007s
W20260709 13:04:55.105515 12541 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.012s	sys 0.007s
W20260709 13:04:55.052989 16908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.015s	sys 0.003s
W20260709 13:04:55.111289 12662 connection.cc:256] RPC call timeout handler was delayed by -1.054615431000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
I20260709 13:04:55.125916 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1094) took 1006 ms. Trace:
W20260709 13:04:55.128249 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.126758 12696 rpcz_store.cc:276] 0709 13:04:54.119472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.119685 (+   213us) service_pool.cc:224] Handling call
0709 13:04:54.140088 (+ 20403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.140337 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:04:54.656518 (+516181us) log.cc:844] Serialized 14 byte log entry
0709 13:04:55.125431 (+468913us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:55.125492 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:55.125593 (+   101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.125682 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.125847 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41632,"prepare.queue_time_us":320504,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"thread_start_us":915783,"threads_started":2}
I20260709 13:04:55.129838 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:55.125900 12662 connection.cc:256] RPC call timeout handler was delayed by -1.0051154310000356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20850000000000002s for a response
W20260709 13:04:55.155524 12662 connection.cc:256] RPC call timeout handler was delayed by -1.0015154310000298s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260709 13:04:55.115939 17155 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.004s	sys 0.008s
I20260709 13:04:55.052408 17097 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:04:55.046186 17165 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:55.217821 17155 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.004s	sys 0.008s
I20260709 13:04:55.101621 17084 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:55.225327 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:55.209980 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 117361us
I20260709 13:04:55.273931 17155 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.274453 17155 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:55.275451 17097 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:04:55.125293 16908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.015s	sys 0.004s
I20260709 13:04:55.277115 17097 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:55.277770 16908 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:55.229544 16995 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:55.278833 16995 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:55.279085 17165 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:55.279235 16995 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:55.279698 17165 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:55.280081 17165 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:55.280419 17165 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:55.272187 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:55.281579 12543 raft_consensus.cc:2410] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:04:55.231470 17002 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:55.282639 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:55.283185 12543 raft_consensus.cc:2376] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9. Re-sending same reply.
I20260709 13:04:55.283905 17097 raft_consensus.cc:697] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:55.284458 17002 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:55.220522 17190 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:04:55.056792 17036 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:55.204289 12544 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:04:55.274551 12588 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:55.290768 12588 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:55.291441 13234 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
I20260709 13:04:55.292747 12588 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:55.213279 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 965) took 1023 ms. Trace:
I20260709 13:04:55.293036 17097 consensus_queue.cc:237] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:55.293839 12538 rpcz_store.cc:276] 0709 13:04:54.189959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.972819 (+782860us) service_pool.cc:224] Handling call
0709 13:04:54.992193 (+ 19374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:55.212899 (+220706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.213195 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:55.199572 17108 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:55.228950 16672 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:55.036083 17171 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:55.302845 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:04:55.272799 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:55.329124 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.299223 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1085) took 1676 ms. Trace:
I20260709 13:04:55.332728 12513 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:55.272126 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:55.233033 12662 leader_election.cc:336] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.900s (SENT)
I20260709 13:04:55.335299 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:55.241729 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:55.178592 12539 raft_consensus.cc:1275] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:04:55.341470 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1646) took 1358 ms. Trace:
I20260709 13:04:55.346685 12539 rpcz_store.cc:276] 0709 13:04:54.076044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.967417 (+891373us) service_pool.cc:224] Handling call
0709 13:04:54.967873 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:55.341116 (+373243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.341398 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:55.348136 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:55.350625 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:04:55.171578 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 120664us
I20260709 13:04:55.330564 12688 rpcz_store.cc:276] 0709 13:04:53.623409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.623881 (+   472us) service_pool.cc:224] Handling call
0709 13:04:53.644215 (+ 20334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:53.661300 (+ 17085us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:53.661349 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:53.661944 (+   595us) log.cc:844] Serialized 26 byte log entry
0709 13:04:54.417501 (+755557us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:54.417547 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.417639 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:55.298968 (+881329us) raft_consensus.cc:1685] finished
0709 13:04:55.298993 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.299144 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29503,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":74917,"thread_start_us":650184,"threads_started":1,"wal-append.queue_time_us":961435}
I20260709 13:04:55.365309 12543 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 13: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:55.321894 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1096) took 1146 ms. Trace:
I20260709 13:04:55.374637 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 921) took 2488 ms. Trace:
I20260709 13:04:55.382675 12542 rpcz_store.cc:276] 0709 13:04:52.886725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.184237 (+1297512us) service_pool.cc:224] Handling call
0709 13:04:54.226484 (+ 42247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:55.026340 (+799856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.374313 (+347973us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b54003ad254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:55.374555 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1837989248}
W20260709 13:04:55.387459 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 154446us
I20260709 13:04:55.365928 12689 rpcz_store.cc:276] 0709 13:04:54.175798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.176068 (+   270us) service_pool.cc:224] Handling call
0709 13:04:54.176492 (+   424us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:54.176937 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:54.176981 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:54.189576 (+ 12595us) log.cc:844] Serialized 26 byte log entry
0709 13:04:54.860828 (+671252us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:04:54.860892 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.860998 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:55.321667 (+460669us) raft_consensus.cc:1685] finished
0709 13:04:55.321688 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.321821 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":39638,"thread_start_us":602743,"threads_started":1,"wal-append.queue_time_us":864040}
I20260709 13:04:55.276942 17155 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:55.388836 12662 leader_election.cc:336] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.952s (SENT)
I20260709 13:04:55.389439 13234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:04:55.397392 13234 raft_consensus.cc:606] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:04:55.397756 13234 raft_consensus.cc:614] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:04:55.397014 12662 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:55.388546 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 392331us
W20260709 13:04:55.304756 17182 log.cc:927] Time spent T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.253s	user 0.000s	sys 0.000s
I20260709 13:04:55.325413 16839 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:55.377743 17167 log.cc:927] Time spent T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.562s	user 0.001s	sys 0.001s
I20260709 13:04:55.400951 12543 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:04:55.385421 17178 log.cc:927] Time spent T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.563s	user 0.000s	sys 0.001s
I20260709 13:04:55.401543 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 967) took 1042 ms. Trace:
I20260709 13:04:55.401790 17171 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:55.298815 17205 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.171s
W20260709 13:04:55.305141 17169 log.cc:927] Time spent T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.358s	user 0.000s	sys 0.001s
W20260709 13:04:55.393006 13200 leader_election.cc:336] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.781s (SENT)
W20260709 13:04:55.383651 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:55.323401 17187 log.cc:927] Time spent T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:04:55.431206 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.326274 16992 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:55.296880 16672 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:55.391146 12539 raft_consensus.cc:2393] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 11: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:55.443320 13234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
W20260709 13:04:55.444252 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 55461.6us
I20260709 13:04:55.434499 12545 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:04:55.401981 12543 rpcz_store.cc:276] 0709 13:04:54.358842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.365957 (+1007115us) service_pool.cc:224] Handling call
0709 13:04:55.400666 (+ 34709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:55.401308 (+   642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.401486 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:55.386077 17179 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:55.403468 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3250) took 1978 ms. Trace:
I20260709 13:04:55.446298 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:55.444671 13234 raft_consensus.cc:606] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:55.447431 12613 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:55.403827 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3254) took 1568 ms. Trace:
W20260709 13:04:55.445034 12662 leader_election.cc:336] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.030s (SENT)
I20260709 13:04:55.305876 17156 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.128s
I20260709 13:04:55.323800 12440 catalog_manager.cc:5697] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:55.696079 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1098) took 1433 ms. Trace:
W20260709 13:04:55.505470 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 458477us
I20260709 13:04:55.572847 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1153) took 2517 ms. Trace:
W20260709 13:04:55.658360 17217 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 13:04:56.007843 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:55.994705 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3255) took 1576 ms. Trace:
I20260709 13:04:55.511487 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:55.449167 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1061) took 1029 ms. Trace:
I20260709 13:04:55.448112 12618 rpcz_store.cc:276] 0709 13:04:53.835786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.836077 (+   291us) service_pool.cc:224] Handling call
0709 13:04:53.865502 (+ 29425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:53.865775 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:53.865802 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:53.887427 (+ 21625us) log.cc:844] Serialized 26 byte log entry
0709 13:04:54.339876 (+452449us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:54.339962 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.340064 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:55.403596 (+1063532us) raft_consensus.cc:1685] finished
0709 13:04:55.403621 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.403765 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":365057,"threads_started":1,"wal-append.queue_time_us":759064}
I20260709 13:04:56.008957 12539 raft_consensus.cc:2376] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12. Re-sending same reply.
W20260709 13:04:55.705188 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.009439 12617 rpcz_store.cc:276] 0709 13:04:54.419385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.419518 (+   133us) service_pool.cc:224] Handling call
0709 13:04:54.419778 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.419959 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:04:54.905193 (+485234us) log.cc:844] Serialized 14 byte log entry
0709 13:04:55.448737 (+543544us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:55.448801 (+    64us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:04:55.448861 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.448950 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.449110 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":154250,"prepare.queue_time_us":632992,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":4674,"raft.queue_time_us":223604,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":870204,"threads_started":3,"wal-append.queue_time_us":596535}
I20260709 13:04:56.010860 13199 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:56.022388 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:55.622458 17013 consensus_meta.cc:287] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.802s	user 0.014s	sys 0.008s
I20260709 13:04:55.366688 17211 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:55.520357 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1062) took 1091 ms. Trace:
I20260709 13:04:56.026949 12616 rpcz_store.cc:276] 0709 13:04:54.428914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.522907 (+ 93993us) service_pool.cc:224] Handling call
0709 13:04:54.573616 (+ 50709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.573810 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:04:54.999386 (+425576us) log.cc:844] Serialized 14 byte log entry
0709 13:04:55.519942 (+520556us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:55.520004 (+    62us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:55.520059 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.520132 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.520285 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99513,"prepare.queue_time_us":483182,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":216574,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":59,"thread_start_us":798630,"threads_started":3,"wal-append.queue_time_us":323006}
W20260709 13:04:55.995103 17219 log.cc:927] Time spent T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.328s	user 0.002s	sys 0.016s
W20260709 13:04:55.435101 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 142437us
I20260709 13:04:55.446164 12614 rpcz_store.cc:276] 0709 13:04:53.425018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.425163 (+   145us) service_pool.cc:224] Handling call
0709 13:04:53.425505 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:53.430414 (+  4909us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:53.430453 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:53.430883 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:04:54.413876 (+982993us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:54.914461 (+500585us) log.cc:844] Serialized 14 byte log entry
0709 13:04:55.112813 (+198352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.112928 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:55.403217 (+290289us) raft_consensus.cc:1685] finished
0709 13:04:55.403245 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.403400 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4516,"prepare.queue_time_us":505384,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":50048,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":19094,"thread_start_us":1628781,"threads_started":3,"wal-append.queue_time_us":1230559}
I20260709 13:04:55.326217 17189 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:55.529743 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3252) took 1695 ms. Trace:
I20260709 13:04:55.555534 17188 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:55.997987 17179 raft_consensus.cc:697] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:04:55.483418 12662 leader_election.cc:336] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.085s (SENT)
I20260709 13:04:55.507402 12543 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:04:56.035699 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 981) took 1087 ms. Trace:
I20260709 13:04:56.036041 12543 rpcz_store.cc:276] 0709 13:04:54.948426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.478879 (+530453us) service_pool.cc:224] Handling call
0709 13:04:55.506701 (+ 27822us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.035440 (+528739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.035645 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:55.521080 17010 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:55.999851 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3259) took 1537 ms. Trace:
I20260709 13:04:55.873862 16672 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:55.914754 17031 consensus_meta.cc:287] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.009s	user 0.011s	sys 0.000s
I20260709 13:04:55.504926 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:55.638602 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:55.547492 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 274247us
I20260709 13:04:55.667939 17165 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:55.498138 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:56.054432 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1065) took 1588 ms. Trace:
I20260709 13:04:56.054524 12545 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
W20260709 13:04:55.442466 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 49480us
I20260709 13:04:56.054911 12616 rpcz_store.cc:276] 0709 13:04:54.466043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.037585 (+1571542us) service_pool.cc:224] Handling call
0709 13:04:56.053958 (+ 16373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.054136 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.054172 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:56.054207 (+    35us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:04:56.054234 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.054288 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.054377 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:55.517762 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1158) took 1252 ms. Trace:
W20260709 13:04:56.055682 13200 leader_election.cc:336] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.807s (SENT)
W20260709 13:04:55.662199 17194 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 13:04:56.056560 13200 leader_election.cc:336] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.992s (SENT)
W20260709 13:04:55.660356 17210 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:04:55.433483 17056 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:04:55.449735 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.061408 17165 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:56.054955 17031 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:56.062424 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3256) took 1642 ms. Trace:
I20260709 13:04:55.448760 12542 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:04:55.454150 12587 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:56.068202 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 969) took 1621 ms. Trace:
W20260709 13:04:56.068497 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 614426us
I20260709 13:04:56.068562 12542 rpcz_store.cc:276] 0709 13:04:54.446377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.384157 (+937780us) service_pool.cc:224] Handling call
0709 13:04:55.434062 (+ 49905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.067945 (+633883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.068148 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:56.070081 12542 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 13:04:56.070365 12542 pending_rounds.cc:85] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 8
I20260709 13:04:56.070606 12542 pending_rounds.cc:107] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 7.9
W20260709 13:04:56.023110 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.070724 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:56.070858 17214 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:04:55.654368 17202 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:04:55.987938 16995 consensus_meta.cc:287] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.708s	user 0.012s	sys 0.000s
I20260709 13:04:56.073031 16995 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:56.075404 16995 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:56.066673 12615 rpcz_store.cc:276] 0709 13:04:54.419857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.419983 (+   126us) service_pool.cc:224] Handling call
0709 13:04:54.420258 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:55.023237 (+602979us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:55.046655 (+ 23418us) log.cc:844] Serialized 14 byte log entry
0709 13:04:55.498099 (+451444us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:55.553432 (+ 55333us) log.cc:844] Serialized 26 byte log entry
0709 13:04:55.553865 (+   433us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:55.553916 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.554034 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:56.062237 (+508203us) raft_consensus.cc:1685] finished
0709 13:04:56.062259 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.062371 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18331,"prepare.queue_time_us":173879,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":149938,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":100003,"thread_start_us":999294,"threads_started":2,"wal-append.queue_time_us":609545}
I20260709 13:04:56.078374 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:56.079049 12615 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:04:56.070864 12542 raft_consensus.cc:2889] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:56.081851 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 996) took 1037 ms. Trace:
I20260709 13:04:56.082178 12542 rpcz_store.cc:276] 0709 13:04:55.044462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.069426 (+1024964us) service_pool.cc:224] Handling call
0709 13:04:56.069753 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.081599 (+ 11846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.081791 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:56.023361 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1063) took 1558 ms. Trace:
I20260709 13:04:56.007417 12691 rpcz_store.cc:276] 0709 13:04:54.262232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.262410 (+   178us) service_pool.cc:224] Handling call
0709 13:04:54.262830 (+   420us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:54.359523 (+ 96693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:54.359581 (+    58us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:54.360351 (+   770us) log.cc:844] Serialized 52 byte log entry
0709 13:04:54.734195 (+373844us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:54.734242 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.734319 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:55.695833 (+961514us) raft_consensus.cc:1685] finished
0709 13:04:55.695862 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.696006 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10405,"raft.queue_time_us":7655,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":15536,"thread_start_us":373378,"threads_started":1,"wal-append.queue_time_us":688815}
I20260709 13:04:56.030588 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:56.084261 12687 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:56.084048 12617 rpcz_store.cc:276] 0709 13:04:54.465441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.022585 (+1557144us) service_pool.cc:224] Handling call
0709 13:04:56.022872 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.023037 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.023061 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:56.023104 (+    43us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:56.023137 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.023203 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.023301 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:55.431607 16820 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:56.007887 13229 rpcz_store.cc:276] 0709 13:04:53.050088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.050814 (+   726us) service_pool.cc:224] Handling call
0709 13:04:53.411916 (+361102us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:53.412316 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:53.412341 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:53.412909 (+   568us) log.cc:844] Serialized 52 byte log entry
0709 13:04:54.447846 (+1034937us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:54.447886 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:54.448130 (+   244us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:55.567019 (+1118889us) raft_consensus.cc:1685] finished
0709 13:04:55.567051 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.567267 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1455,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":17189,"thread_start_us":1034512,"threads_started":1,"wal-append.queue_time_us":1345921}
I20260709 13:04:56.025024 12620 rpcz_store.cc:276] 0709 13:04:54.418738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.418858 (+   120us) service_pool.cc:224] Handling call
0709 13:04:54.419167 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:54.903563 (+484396us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:54.903600 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:54.904111 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:04:55.355554 (+451443us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:55.355590 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.355664 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:55.883374 (+527710us) raft_consensus.cc:1685] finished
0709 13:04:55.883405 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.994632 (+111227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":112640,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":32630,"thread_start_us":915128,"threads_started":2,"wal-append.queue_time_us":977227}
W20260709 13:04:56.033799 12588 connection.cc:256] RPC call timeout handler was delayed by -1.543591306000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
W20260709 13:04:56.091065 12588 connection.cc:256] RPC call timeout handler was delayed by -1.5254502389999516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
W20260709 13:04:56.091478 12588 connection.cc:256] RPC call timeout handler was delayed by -1.5048913059999904s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
W20260709 13:04:56.091795 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.037992 17198 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
W20260709 13:04:56.092046 12588 connection.cc:256] RPC call timeout handler was delayed by -1.4867502390000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2013s for a response
W20260709 13:04:56.092370 12588 connection.cc:256] RPC call timeout handler was delayed by -1.4415237639999532s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20350000000000001s for a response
W20260709 13:04:56.092914 12588 leader_election.cc:336] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.729s (SENT)
W20260709 13:04:56.030081 12695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.006s	sys 0.017s
W20260709 13:04:56.093806 12695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.007s	sys 0.017s
I20260709 13:04:56.094188 12687 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:04:56.033866 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:56.038831 12619 rpcz_store.cc:276] 0709 13:04:54.462553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.998937 (+1536384us) service_pool.cc:224] Handling call
0709 13:04:55.999287 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:55.999479 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:55.999511 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:55.999559 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:55.999598 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.999660 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.999781 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:56.095294 12539 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:56.096485 12539 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:56.096855 12619 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:56.096999 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1000) took 1014 ms. Trace:
I20260709 13:04:56.024060 17099 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.097853 17099 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:56.098626 12588 leader_election.cc:336] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.733s (SENT)
I20260709 13:04:56.099082 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:56.041373 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1647) took 1898 ms. Trace:
W20260709 13:04:56.099928 12588 connection.cc:256] RPC call timeout handler was delayed by -1.4343175410000413s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
I20260709 13:04:56.042721 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:56.100757 12694 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:04:56.100061 12546 rpcz_store.cc:276] 0709 13:04:54.142889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.970023 (+827134us) service_pool.cc:224] Handling call
0709 13:04:55.005764 (+ 35741us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:55.006198 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:55.006239 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:55.013406 (+  7167us) log.cc:844] Serialized 26 byte log entry
0709 13:04:55.166505 (+153099us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:55.519420 (+352915us) log.cc:844] Serialized 14 byte log entry
0709 13:04:55.519690 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.519780 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:56.041141 (+521361us) raft_consensus.cc:1685] finished
0709 13:04:56.041164 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.041311 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":143318,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":3020,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":29216,"thread_start_us":404481,"threads_started":2,"wal-append.queue_time_us":411039}
I20260709 13:04:56.101948 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:04:56.100464 12588 leader_election.cc:336] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.751s (SENT)
I20260709 13:04:56.102540 12694 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:56.102885 12588 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:56.026782 17171 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:56.103669 17171 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.104065 17171 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:56.032493 12621 rpcz_store.cc:276] 0709 13:04:53.834803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.834986 (+   183us) service_pool.cc:224] Handling call
0709 13:04:53.848662 (+ 13676us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:53.848960 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:04:54.450344 (+601384us) log.cc:844] Serialized 14 byte log entry
0709 13:04:55.520611 (+1070267us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:55.520675 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:55.520736 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.520891 (+   155us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.529621 (+  8730us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":109174,"prepare.queue_time_us":973429,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":27170,"raft.queue_time_us":217435,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":57,"thread_start_us":1561622,"threads_started":3,"wal-append.queue_time_us":979333}
W20260709 13:04:55.831421 17193 log.cc:927] Time spent T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
W20260709 13:04:56.045804 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.049283 17179 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:56.053687 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1064) took 1587 ms. Trace:
I20260709 13:04:56.053687 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 994) took 1009 ms. Trace:
I20260709 13:04:56.126287 12618 rpcz_store.cc:276] 0709 13:04:54.465768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.032310 (+1566542us) service_pool.cc:224] Handling call
0709 13:04:56.053219 (+ 20909us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.053357 (+   138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.053378 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:56.053409 (+    31us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:56.053437 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.053487 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.053625 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:56.126462 12543 rpcz_store.cc:276] 0709 13:04:55.043854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.036828 (+992974us) service_pool.cc:224] Handling call
0709 13:04:56.053046 (+ 16218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.053341 (+   295us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.053369 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:56.053409 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:56.053445 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.053490 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.053625 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1503,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":87}
I20260709 13:04:55.753403 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 929) took 2747 ms. Trace:
I20260709 13:04:56.011298 17205 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
W20260709 13:04:56.057461 13200 leader_election.cc:336] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.037s (SENT)
W20260709 13:04:56.131419 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 73973.4us
W20260709 13:04:56.132187 13200 leader_election.cc:336] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.088s (SENT)
W20260709 13:04:56.133164 13200 leader_election.cc:336] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.135s (SENT)
W20260709 13:04:56.134223 13200 leader_election.cc:336] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.171s (SENT)
W20260709 13:04:56.135214 13200 leader_election.cc:336] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.202s (SENT)
W20260709 13:04:56.135362 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 94780.5us
I20260709 13:04:56.135602 13200 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:56.058140 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 574725us
W20260709 13:04:56.136439 12662 leader_election.cc:336] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.089s (SENT)
I20260709 13:04:56.136909 12662 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:56.058522 12545 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:04:56.137725 12545 pending_rounds.cc:85] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 8
I20260709 13:04:56.137980 12545 pending_rounds.cc:107] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:04:56.138212 12545 raft_consensus.cc:2889] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:56.138881 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 995) took 1094 ms. Trace:
I20260709 13:04:56.059439 12659 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:56.139810 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 80412.5us
W20260709 13:04:56.141723 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.064517 17031 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:56.064611 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:55.430195 17172 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:56.065399 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:56.065805 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:56.065236 12440 catalog_manager.cc:5697] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 1 to 11, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 11 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:56.029659 17013 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:56.056021 13235 rpcz_store.cc:276] 0709 13:04:54.265172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.265456 (+   284us) service_pool.cc:224] Handling call
0709 13:04:54.265787 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.266011 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:04:54.738666 (+472655us) log.cc:844] Serialized 14 byte log entry
0709 13:04:55.516422 (+777756us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b18004bdd20. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a91214bc 00007fc3a646f48b 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a911923a
0709 13:04:55.516662 (+   240us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:55.516715 (+    53us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:04:55.517073 (+   358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.517250 (+   177us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.517615 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":744301,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":6563,"raft.queue_time_us":108,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":125,"spinlock_wait_cycles":3223936,"thread_start_us":707539,"threads_started":2,"wal-append.queue_time_us":571514}
I20260709 13:04:56.090579 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:56.097332 12539 rpcz_store.cc:276] 0709 13:04:55.082423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.095899 (+1013476us) service_pool.cc:224] Handling call
0709 13:04:56.096178 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.096792 (+   614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.096951 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:56.103154 12616 raft_consensus.cc:1275] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:04:56.045766 12613 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:55.406296 17036 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:56.109637 12587 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:56.110936 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 44330us
I20260709 13:04:56.118852 12694 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
W20260709 13:04:56.125106 12588 connection.cc:256] RPC call timeout handler was delayed by -1.4327502390000291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
I20260709 13:04:56.099931 17099 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:04:56.152650 12588 leader_election.cc:336] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.962s (SENT)
I20260709 13:04:56.066083 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:56.153154 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 43647us
I20260709 13:04:56.146661 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 999) took 1101 ms. Trace:
I20260709 13:04:56.139263 12545 rpcz_store.cc:276] 0709 13:04:55.044179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.055262 (+1011083us) service_pool.cc:224] Handling call
0709 13:04:56.058181 (+  2919us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.138611 (+ 80430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.138815 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:56.128692 12541 rpcz_store.cc:276] 0709 13:04:53.006378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.464406 (+1458028us) service_pool.cc:224] Handling call
0709 13:04:54.464880 (+   474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:54.540021 (+ 75141us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:04:55.158481 (+618460us) log.cc:844] Serialized 14 byte log entry
0709 13:04:55.622079 (+463598us) log.cc:844] Serialized 14 byte log entry
0709 13:04:55.752890 (+130811us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:55.752967 (+    77us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:55.753040 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:55.753142 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:55.753321 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":130429,"prepare.queue_time_us":797884,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":130707,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":9621,"thread_start_us":798465,"threads_started":2,"wal-append.queue_time_us":735816}
I20260709 13:04:56.153174 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:56.153825 12542 rpcz_store.cc:276] 0709 13:04:55.045398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.082944 (+1037546us) service_pool.cc:224] Handling call
0709 13:04:56.083268 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.146012 (+ 62744us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.146310 (+   298us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:56.146359 (+    49us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:56.146403 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.146476 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.146603 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":61386,"threads_started":1}
I20260709 13:04:56.154695 17189 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:56.155300 17189 raft_consensus.cc:697] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:56.155925 12613 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:56.153847 12587 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:56.160499 12662 leader_election.cc:336] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.626s (SENT)
I20260709 13:04:56.125593 17165 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:56.166810 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:56.167838 12616 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:04:56.161119 12662 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:56.139429 17214 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:56.144155 17084 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:56.171350 12588 connection.cc:256] RPC call timeout handler was delayed by -1.3782300029999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18660000000000002s for a response
W20260709 13:04:56.177217 12588 connection.cc:256] RPC call timeout handler was delayed by -1.3227175409999745s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2053s for a response
W20260709 13:04:56.177968 12588 connection.cc:256] RPC call timeout handler was delayed by -1.2300183859999834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21789999999999998s for a response
W20260709 13:04:56.178303 12588 connection.cc:256] RPC call timeout handler was delayed by -1.0620913060000703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2621s for a response
I20260709 13:04:56.179312 12690 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:04:56.172465 17156 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:56.186620 12622 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 15: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:56.156126 17189 consensus_queue.cc:237] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:56.157788 17056 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:56.186436 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:56.196805 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:56.198889 12613 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:04:56.199334 12544 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 10: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:56.200037 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 991) took 1157 ms. Trace:
I20260709 13:04:56.200464 12544 rpcz_store.cc:276] 0709 13:04:55.042893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.289986 (+247093us) service_pool.cc:224] Handling call
0709 13:04:56.196541 (+906555us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b5800000c98. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae53f0a0 00007fc3ae53e984 00007fc3a7ab96d4 00007fc3a7ab9662
0709 13:04:56.199951 (+  3410us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28247424}
I20260709 13:04:56.201478 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:56.202296 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 989) took 1160 ms. Trace:
I20260709 13:04:56.202596 12547 rpcz_store.cc:276] 0709 13:04:55.042217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.092935 (+ 50718us) service_pool.cc:224] Handling call
0709 13:04:56.201351 (+1108416us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b5800000c98. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454e9c 00007fc3a6454a5b 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae53f0a0 00007fc3ae53e984 00007fc3a7ab96d4 00007fc3a7ab9662
0709 13:04:56.202241 (+   890us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7960832}
I20260709 13:04:56.161870 17031 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:56.169271 17215 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:56.169860 16672 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:56.211999 17223 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.210868 12662 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:56.197299 17172 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:56.206111 16820 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:56.233888 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:56.198091 17056 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:56.234799 12687 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:04:56.232102 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:56.233376 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:56.231794 12588 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:56.214195 17220 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.213922 17215 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:04:56.275521 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 43797.4us
W20260709 13:04:56.264875 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 129671us
I20260709 13:04:56.189618 17084 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:56.263934 12587 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:56.331462 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 67621.1us
I20260709 13:04:56.277724 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:56.259377 17056 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:56.291179 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:56.284055 12616 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:04:56.233462 12440 catalog_manager.cc:5697] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:56.217173 17031 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:56.234144 17156 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:04:56.310453 17013 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:56.346655 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:56.311295 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:56.347249 12622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 3261) took 1623 ms (client timeout 2100 ms). Trace:
I20260709 13:04:56.312463 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:56.312512 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:56.348704 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:56.349812 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:56.350530 12687 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 12: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:56.313460 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:56.351140 12539 raft_consensus.cc:2393] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 12: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:56.356215 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 972) took 1657 ms. Trace:
I20260709 13:04:56.356619 12540 rpcz_store.cc:276] 0709 13:04:54.698903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.736338 (+ 37435us) service_pool.cc:224] Handling call
0709 13:04:56.356035 (+1619697us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54002bb454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:56.356160 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":649508096}
I20260709 13:04:56.357591 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:56.359007 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:56.359488 12540 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:04:56.313925 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:56.360496 12541 raft_consensus.cc:2376] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12. Re-sending same reply.
I20260709 13:04:56.314574 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:56.314678 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:56.361953 12545 raft_consensus.cc:2376] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9. Re-sending same reply.
I20260709 13:04:56.317399 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:04:56.317668 17232 log.cc:927] Time spent T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 13:04:56.318373 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:56.320320 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.320744 17171 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:56.321908 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:56.378262 12544 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:56.273666 17215 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:56.326283 17227 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:04:56.396332 13197 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:56.328054 17233 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:56.284909 17222 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:56.329986 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:56.330498 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:56.332574 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 54937.5us
I20260709 13:04:56.422959 12547 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:56.424190 12588 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:04:56.333045 13200 leader_election.cc:336] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.230s (SENT)
W20260709 13:04:56.425151 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 92135.9us
I20260709 13:04:56.341082 17190 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:56.341006 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:56.343658 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:56.344857 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1742) took 1571 ms. Trace:
I20260709 13:04:56.428197 12546 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:04:56.428295 12690 rpcz_store.cc:276] 0709 13:04:54.773030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.773179 (+   149us) service_pool.cc:224] Handling call
0709 13:04:56.344656 (+1571477us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54003ea8d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:56.344768 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3116332800}
W20260709 13:04:56.347690 12622 rpcz_store.cc:269] 0709 13:04:54.724076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:54.984961 (+260885us) service_pool.cc:224] Handling call
0709 13:04:56.347049 (+1362088us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54003af2d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:56.347194 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2694903168}
I20260709 13:04:56.364218 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:56.364771 12620 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:56.365298 12542 raft_consensus.cc:2368] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10.
W20260709 13:04:56.365516 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:56.431361 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.365885 12693 raft_consensus.cc:2393] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 11: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:56.365332 12538 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:56.432168 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1656) took 1435 ms. Trace:
I20260709 13:04:56.432569 12538 rpcz_store.cc:276] 0709 13:04:55.004947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.294878 (+289931us) service_pool.cc:224] Handling call
0709 13:04:56.318243 (+1023365us) spinlock_profiling.cc:243] Waited 7.18 ms on lock 0x7b5800000c98. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae53f0a0 00007fc3ae53e984 00007fc3a7ab96d4 00007fc3a7ab9662
0709 13:04:56.432086 (+113843us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16516480}
I20260709 13:04:56.235168 17223 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:56.390594 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:56.391721 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:56.440949 12687 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:56.392953 12619 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:04:56.337438 16995 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:56.337169 16992 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:04:56.399916 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:56.451977 12691 raft_consensus.cc:2368] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 11. Current term is 12.
I20260709 13:04:56.452978 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:56.400707 12544 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:56.425670 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:56.454983 12696 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:56.345417 17031 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:56.429703 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:56.455790 12690 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:56.459831 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:56.434130 12659 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:56.436417 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:56.462224 12546 raft_consensus.cc:2376] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12. Re-sending same reply.
I20260709 13:04:56.462419 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:56.442836 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:04:56.445253 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 234434us
I20260709 13:04:56.446412 13199 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:56.274796 17220 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:56.461270 12687 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:04:56.466147 12662 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:56.458645 12691 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:56.435070 17222 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.482134 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:56.482277 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:56.488042 12546 raft_consensus.cc:2376] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12. Re-sending same reply.
I20260709 13:04:56.488565 12693 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:04:56.484498 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:56.490221 12687 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 11: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:56.491225 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:56.492090 12687 raft_consensus.cc:2368] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14.
I20260709 13:04:56.438915 17190 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:56.428611 17127 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:56.438715 17214 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:04:56.503929 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:56.504858 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:56.505929 12694 raft_consensus.cc:2393] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:56.508070 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:56.510042 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:56.511240 12687 raft_consensus.cc:2410] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:04:56.515475 12689 raft_consensus.cc:1217] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Deduplicated request from leader. Original: 12.11->[13.12-13.12]   Dedup: 13.12->[]
I20260709 13:04:56.450598 17179 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.515985 12616 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:56.516038 12689 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:04:56.516568 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:56.516943 12693 raft_consensus.cc:1240] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: []
W20260709 13:04:56.501597 17227 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:04:56.439693 17224 consensus_queue.cc:1048] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:04:56.520735 12547 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:04:56.514816 12690 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
W20260709 13:04:56.527359 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 81011.7us
W20260709 13:04:56.528779 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:56.519899 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 94014.4us
W20260709 13:04:56.550822 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.438246 16820 consensus_queue.cc:1059] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:04:56.504338 16672 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:56.587203 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:56.585632 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:56.595940 12546 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:56.501972 17222 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:56.505026 17127 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:56.639099 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:56.643639 12690 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:04:56.609661 13199 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:04:56.610707 13200 leader_election.cc:336] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.084s (SENT)
I20260709 13:04:56.653062 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:56.544870 17229 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:56.644256 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:56.639943 12512 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:56.654633 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:56.656462 12538 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:56.528709 17170 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:56.654721 12547 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
W20260709 13:04:56.611408 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.445551 17113 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 11.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
I20260709 13:04:56.589424 12587 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:56.662225 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:56.543771 17036 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:56.586766 17216 raft_consensus.cc:993] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
W20260709 13:04:56.662325 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 72986.1us
I20260709 13:04:56.616281 12544 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:56.662921 12539 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:56.660616 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:56.479900 17233 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:56.587779 16839 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:56.661460 17113 raft_consensus.cc:3055] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:56.667336 17188 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:56.585253 17220 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:56.673595 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:56.676174 12544 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 11: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:56.637979 17241 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:56.656817 17127 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:56.660672 17170 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:56.679394 13230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:04:56.681138 13230 raft_consensus.cc:606] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:56.678107 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:56.682757 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:56.683322 12544 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:04:56.684108 13234 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 7. Current term is 8. Ops: []
I20260709 13:04:56.548681 17179 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:56.711364 12696 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
W20260709 13:04:56.647336 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 181300us
W20260709 13:04:56.688980 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:56.693084 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 294307us
W20260709 13:04:56.693732 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 262434us
W20260709 13:04:56.714552 12588 leader_election.cc:336] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.866s (SENT)
I20260709 13:04:56.715039 12662 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:56.716552 12588 leader_election.cc:336] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.970s (SENT)
I20260709 13:04:56.717170 12662 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:56.689106 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1749) took 1754 ms. Trace:
W20260709 13:04:56.654592 13200 leader_election.cc:336] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.169s (SENT)
W20260709 13:04:56.717869 12588 leader_election.cc:336] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.013s (SENT)
I20260709 13:04:56.718436 12588 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:56.720489 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:56.718145 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 63728.5us
I20260709 13:04:56.721199 12544 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
W20260709 13:04:56.721429 13200 leader_election.cc:336] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.351s (SENT)
W20260709 13:04:56.722376 13200 leader_election.cc:336] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.535s (SENT)
I20260709 13:04:56.717798 12695 rpcz_store.cc:276] 0709 13:04:54.935198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:55.018742 (+ 83544us) service_pool.cc:224] Handling call
0709 13:04:55.053996 (+ 35254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:55.100911 (+ 46915us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:04:55.299659 (+198748us) log.cc:844] Serialized 14 byte log entry
0709 13:04:56.094251 (+794592us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:56.094713 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:04:56.094863 (+   150us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:56.094896 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.094975 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:56.346443 (+251468us) spinlock_profiling.cc:243] Waited 8.3 ms on lock 0x7b48001b0258. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3ae4a2aa1 00007fc3ae499b37 00007fc3ae4999ca 00007fc3ae59126f 00007fc3ae590f37 00007fc3ae5a555c 00007fc3ae5a5508 00007fc3ae5a5488 00007fc3ae5a5443 00007fc3ae5a46ec 00007fc3ad4cea96
0709 13:04:56.679294 (+332851us) raft_consensus.cc:1685] finished
0709 13:04:56.688895 (+  9601us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:56.689045 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26841,"prepare.queue_time_us":208574,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":46,"raft.queue_time_us":72175,"raft.run_cpu_time_us":17054,"raft.run_wall_time_us":1149224,"spinlock_wait_cycles":19098880,"thread_start_us":691524,"threads_started":1,"wal-append.queue_time_us":773736}
W20260709 13:04:56.720090 12588 leader_election.cc:336] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.035s (SENT)
W20260709 13:04:56.727047 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.675414 17113 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:04:56.741209 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 307150us
I20260709 13:04:56.743103 12542 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:56.683929 17170 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:56.709677 17230 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.004s	sys 0.011s
I20260709 13:04:56.748459 12696 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 11. Current term is 12. Ops: []
W20260709 13:04:56.732092 17232 log.cc:927] Time spent T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:04:56.750473 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.751005 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:56.723145 13200 leader_election.cc:336] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.678s (SENT)
W20260709 13:04:56.972246 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 249099us
W20260709 13:04:56.973786 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.501248 12440 catalog_manager.cc:5697] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:56.721984 16841 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:56.710193 17188 raft_consensus.cc:697] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 15 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:56.856556 17084 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:56.690637 17241 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:56.790793 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 181213us
W20260709 13:04:56.755033 12588 leader_election.cc:336] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.040s (SENT)
W20260709 13:04:56.980888 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 227023us
W20260709 13:04:56.981886 12588 leader_election.cc:336] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.073s (SENT)
I20260709 13:04:56.982311 12588 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:56.982349 12544 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
W20260709 13:04:56.983307 12588 leader_election.cc:336] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.086s (SENT)
I20260709 13:04:56.799813 17139 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:56.812167 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:56.985280 12547 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
W20260709 13:04:56.795138 17230 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.005s	sys 0.014s
I20260709 13:04:56.798713 17113 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 11.13, Last appended by leader: 13, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:56.810348 12659 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:04:56.986835 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 176587us
I20260709 13:04:56.796353 17261 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:04:56.869987 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 155922us
I20260709 13:04:56.856556 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:04:57.287415 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.288250 12538 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:57.027645 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:56.975407 12440 catalog_manager.cc:5697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 5 to 10, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 10 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:56.795965 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:57.294642 12539 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
W20260709 13:04:56.938745 12510 connection.cc:256] RPC call timeout handler was delayed by -3.7283584479999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
W20260709 13:04:57.296200 12510 connection.cc:256] RPC call timeout handler was delayed by -3.6851584479999246s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
W20260709 13:04:57.278292 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:57.296754 12510 connection.cc:256] RPC call timeout handler was delayed by -3.5348584480000227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260709 13:04:56.988410 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:57.297235 12510 connection.cc:256] RPC call timeout handler was delayed by -3.4295584479999661s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
W20260709 13:04:57.298038 12510 connection.cc:256] RPC call timeout handler was delayed by -3.421458447999953s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
W20260709 13:04:57.298502 12510 connection.cc:256] RPC call timeout handler was delayed by -3.2459584480000103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260709 13:04:57.298893 12510 connection.cc:256] RPC call timeout handler was delayed by -2.2775584480000362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3165s for a response
W20260709 13:04:57.299052 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:57.299271 12510 connection.cc:256] RPC call timeout handler was delayed by -1.0751584480000247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.45010000000000006s for a response
W20260709 13:04:57.299695 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:57.022185 12588 leader_election.cc:336] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.129s (SENT)
I20260709 13:04:57.300760 12588 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:56.991761 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 351885us
I20260709 13:04:57.303429 12512 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:04:57.303738 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 281539us
W20260709 13:04:57.088397 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.290598 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:57.307819 12440 catalog_manager.cc:5697] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:57.090042 12695 raft_consensus.cc:1217] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Deduplicated request from leader. Original: 11.9->[12.10-12.10]   Dedup: 12.10->[]
I20260709 13:04:57.059507 12696 raft_consensus.cc:1240] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:04:57.334455 12695 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 13:04:57.059607 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.327301 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:57.327731 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1113) took 1070 ms. Trace:
I20260709 13:04:56.792944 16989 raft_consensus.cc:1081] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:04:57.023079 16841 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:57.339077 12510 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:57.328027 12512 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:57.339756 17010 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:57.340399 12696 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:04:57.338732 12690 rpcz_store.cc:276] 0709 13:04:56.257454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.664236 (+406782us) service_pool.cc:224] Handling call
0709 13:04:56.664653 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:56.666046 (+  1393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.666079 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:56.671593 (+  5514us) log.cc:844] Serialized 26 byte log entry
0709 13:04:57.061595 (+390002us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:57.061655 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.061736 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:57.327045 (+265309us) raft_consensus.cc:1685] finished
0709 13:04:57.327098 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.327448 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":962,"raft.queue_time_us":3269,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":4630,"thread_start_us":287192,"threads_started":1,"wal-append.queue_time_us":407391}
W20260709 13:04:57.316833 12588 leader_election.cc:336] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.138s (SENT)
W20260709 13:04:57.159176 17056 consensus_meta.cc:287] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.811s	user 0.012s	sys 0.000s
I20260709 13:04:57.360817 17031 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:56.986588 17084 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:04:57.366600 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 65260.5us
I20260709 13:04:56.743095 17108 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:57.092867 17113 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:57.371698 17275 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:57.372273 17056 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:57.155637 17127 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:57.375967 17056 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:56.836397 17171 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:57.097359 17179 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:57.103648 17188 consensus_queue.cc:237] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:57.379168 16820 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.380335 16820 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:56.730669 17189 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:04:57.106861 17190 consensus_meta.cc:287] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.577s	user 0.002s	sys 0.008s
I20260709 13:04:57.336494 12440 catalog_manager.cc:5697] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 5 to 8, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 8 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:04:57.389608 17190 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:57.391052 12440 catalog_manager.cc:5697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:04:57.203891 17205 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.026s	sys 0.037s
W20260709 13:04:57.402029 17205 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.026s	sys 0.037s
I20260709 13:04:57.402279 17139 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:57.367357 17084 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:57.403349 12622 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:57.403532 17084 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:57.404631 17171 consensus_queue.cc:1059] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:04:57.214223 17215 consensus_meta.cc:287] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.790s	user 0.012s	sys 0.000s
W20260709 13:04:57.405985 12662 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.010s	sys 0.006s
I20260709 13:04:57.406986 17215 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:57.407752 12662 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.010s	sys 0.007s
W20260709 13:04:57.223371 17222 consensus_meta.cc:287] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.561s	user 0.006s	sys 0.004s
I20260709 13:04:57.380940 17218 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:04:57.204233 17233 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:57.023257 17238 consensus_queue.cc:1059] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:04:57.108461 17241 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:57.097131 17245 log.cc:927] Time spent T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:04:57.426898 17215 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:57.099040 17246 log.cc:927] Time spent T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:04:57.098347 17251 log.cc:927] Time spent T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:04:56.995160 17252 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:04:57.430455 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1751) took 1410 ms. Trace:
I20260709 13:04:57.430948 12688 rpcz_store.cc:276] 0709 13:04:56.019882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.020005 (+   123us) service_pool.cc:224] Handling call
0709 13:04:56.025331 (+  5326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:56.025699 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.025727 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:56.026167 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:04:56.320592 (+294425us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b18003e2180. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:04:56.484256 (+163664us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:56.484295 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.484687 (+   392us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:57.429701 (+945014us) raft_consensus.cc:1685] finished
0709 13:04:57.429801 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.430242 (+   441us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1087,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":9477,"spinlock_wait_cycles":3186048,"thread_start_us":163461,"threads_started":1,"wal-append.queue_time_us":775700}
W20260709 13:04:57.434744 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:56.797828 17255 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:57.436688 17255 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:57.437820 12440 catalog_manager.cc:5697] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:56.994784 17261 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:57.439760 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:57.440498 17261 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:57.439985 12440 catalog_manager.cc:5697] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 9 to 11, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 11 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.441782 17179 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:04:57.097731 17266 log.cc:927] Time spent T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:04:57.214264 17273 log.cc:927] Time spent T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 13:04:57.365725 17170 consensus_meta.cc:287] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.572s	user 0.006s	sys 0.005s
I20260709 13:04:57.364307 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1824) took 1019 ms. Trace:
W20260709 13:04:57.393018 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 87634.4us
I20260709 13:04:57.393190 12538 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:04:57.392514 17127 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:57.024792 17229 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:04:57.414315 17190 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:57.414321 17222 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:57.466369 17222 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:57.417361 16820 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:57.417905 12510 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:57.468142 12621 raft_consensus.cc:2368] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14.
W20260709 13:04:57.468564 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 80611.6us
W20260709 13:04:57.418292 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 90558.3us
I20260709 13:04:57.450098 12696 rpcz_store.cc:276] 0709 13:04:56.341985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.335636 (+993651us) service_pool.cc:224] Handling call
0709 13:04:57.336270 (+   634us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:57.355758 (+ 19488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.361712 (+  5954us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:04:57.455652 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1114) took 1014 ms. Trace:
I20260709 13:04:57.439929 17255 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:57.462807 17235 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:57.456197 17084 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:57.456625 12588 leader_election.cc:336] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.179s (SENT)
I20260709 13:04:57.473941 17179 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:57.477327 12588 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:57.478967 17222 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:57.473822 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:57.480984 16672 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:57.473835 12510 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:57.482055 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:57.483073 12696 raft_consensus.cc:2393] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 15: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:04:57.483798 12510 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:57.484056 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:57.484336 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1110) took 1227 ms. Trace:
I20260709 13:04:57.484869 17241 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:57.474480 12440 catalog_manager.cc:5697] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 8 to 10, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 10 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:57.475988 12512 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:57.453536 17170 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:57.470018 12693 rpcz_store.cc:276] 0709 13:04:56.439384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.374858 (+935474us) service_pool.cc:224] Handling call
0709 13:04:57.375419 (+   561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:57.375834 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:04:57.376308 (+   474us) log.cc:844] Serialized 14 byte log entry
0709 13:04:57.453789 (+ 77481us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:57.453834 (+    45us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:04:57.453876 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.453940 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.454082 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12620,"prepare.queue_time_us":10212,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":72,"raft.queue_time_us":1619,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":1932,"thread_start_us":75384,"threads_started":1}
W20260709 13:04:57.487634 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 642664us
I20260709 13:04:57.484732 12689 rpcz_store.cc:276] 0709 13:04:56.256783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.544209 (+287426us) service_pool.cc:224] Handling call
0709 13:04:56.544538 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:56.544782 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.544809 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:56.585724 (+ 40915us) log.cc:844] Serialized 26 byte log entry
0709 13:04:56.971571 (+385847us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:56.971627 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.971727 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:57.456354 (+484627us) raft_consensus.cc:1685] finished
0709 13:04:57.458339 (+  1985us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.484164 (+ 25825us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":376586,"threads_started":1,"wal-append.queue_time_us":471001}
I20260709 13:04:57.485965 17241 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:57.481518 16672 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:57.500572 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1115) took 1060 ms. Trace:
I20260709 13:04:57.507256 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:57.508142 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 59270us
I20260709 13:04:57.511265 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3270) took 1165 ms. Trace:
I20260709 13:04:57.508169 13234 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:57.457264 17031 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:57.518164 12621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 3272) took 1164 ms (client timeout 1530 ms). Trace:
I20260709 13:04:57.503757 12690 rpcz_store.cc:276] 0709 13:04:56.439666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.395736 (+956070us) service_pool.cc:224] Handling call
0709 13:04:57.396284 (+   548us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:57.396831 (+   547us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:04:57.397312 (+   481us) log.cc:844] Serialized 14 byte log entry
0709 13:04:57.493493 (+ 96181us) log.cc:844] Serialized 14 byte log entry
0709 13:04:57.500201 (+  6708us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:57.500244 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:57.500281 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.500343 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.500442 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23188,"prepare.queue_time_us":4922,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":86,"raft.queue_time_us":30983,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":1801,"thread_start_us":73309,"threads_started":1}
I20260709 13:04:57.511757 12616 rpcz_store.cc:276] 0709 13:04:56.345422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.355622 (+ 10200us) service_pool.cc:224] Handling call
0709 13:04:56.406667 (+ 51045us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.531077 (+124410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.510714 (+979637us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54002a7bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:57.511033 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250388224}
I20260709 13:04:57.513157 12696 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:04:57.522785 17218 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:57.523842 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:04:57.519029 12621 rpcz_store.cc:269] 0709 13:04:56.353420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.353615 (+   195us) service_pool.cc:224] Handling call
0709 13:04:57.517895 (+1164280us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54003d18d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:57.518070 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2361409280}
I20260709 13:04:57.532335 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1819) took 1258 ms. Trace:
I20260709 13:04:57.535732 17170 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:57.532778 12695 rpcz_store.cc:276] 0709 13:04:56.274465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.733803 (+459338us) service_pool.cc:224] Handling call
0709 13:04:57.089915 (+356112us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:57.335096 (+245181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.517455 (+182359us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b540041fad0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:57.532270 (+ 14815us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":817964928}
I20260709 13:04:57.548472 17238 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:57.539335 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:57.549347 17238 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:57.552853 16839 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:57.555042 17244 log.cc:927] Time spent T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.824s	user 0.014s	sys 0.000s
I20260709 13:04:57.555248 17031 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:57.557806 17274 log.cc:927] Time spent T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.451s	user 0.007s	sys 0.024s
I20260709 13:04:57.559007 17215 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:57.559854 17215 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:57.561630 16839 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:57.562925 12692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1752) took 1542 ms. Trace:
I20260709 13:04:57.564401 16839 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:57.563408 12692 rpcz_store.cc:276] 0709 13:04:56.020360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.020763 (+   403us) service_pool.cc:224] Handling call
0709 13:04:56.029804 (+  9041us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:56.138043 (+108239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.138084 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:56.138539 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:04:56.394031 (+255492us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:04:56.394094 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.394273 (+   179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:57.554109 (+1159836us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:04:57.562390 (+  8281us) raft_consensus.cc:1685] finished
0709 13:04:57.562414 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.562726 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12844,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":6040,"spinlock_wait_cycles":7682432,"thread_start_us":321103,"threads_started":2,"wal-append.queue_time_us":492093}
I20260709 13:04:57.568918 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1103) took 1313 ms. Trace:
I20260709 13:04:57.569175 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:04:57.570488 12618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:60170
I20260709 13:04:57.569449 12687 rpcz_store.cc:276] 0709 13:04:56.255161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.511932 (+256771us) service_pool.cc:224] Handling call
0709 13:04:56.531250 (+ 19318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:56.551322 (+ 20072us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:56.551352 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:56.551908 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 13:04:56.754395 (+202487us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:56.754436 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:56.754504 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:57.449257 (+694753us) raft_consensus.cc:1685] finished
0709 13:04:57.449299 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.568448 (+119149us) spinlock_profiling.cc:243] Waited 18.7 ms on lock 0x7b54002c8b50. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:57.568718 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19665,"raft.queue_time_us":21415,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":28222,"spinlock_wait_cycles":43028864,"thread_start_us":90901,"threads_started":1,"wal-append.queue_time_us":272123}
I20260709 13:04:57.571552 12618 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:57.572137 12618 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:57.573138 12613 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:57.573165 12687 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:57.552390 17268 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:04:57.575795 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 122949us
I20260709 13:04:57.533363 17255 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:04:57.585989 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 70980.3us
I20260709 13:04:57.588876 13234 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:04:57.607771 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:57.587433 17216 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:04:57.611181 12662 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.172s (SENT) [suppressed 57 similar messages]
I20260709 13:04:57.619424 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1760) took 1088 ms. Trace:
I20260709 13:04:57.622993 12693 rpcz_store.cc:276] 0709 13:04:56.531109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.495681 (+964572us) service_pool.cc:224] Handling call
0709 13:04:57.583832 (+ 88151us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:57.610193 (+ 26361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:57.610237 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:57.618993 (+  8756us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:04:57.619064 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.619155 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.619351 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:57.624404 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 140807us
I20260709 13:04:57.632567 12695 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 14. Current term is 15. Ops: []
I20260709 13:04:57.588272 17238 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:57.632123 12588 leader_election.cc:336] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.621s (SENT)
W20260709 13:04:57.637791 12662 connection.cc:256] RPC call timeout handler was delayed by -1.2683912109999937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1502s for a response
I20260709 13:04:57.641396 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1116) took 1049 ms. Trace:
I20260709 13:04:57.645056 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:57.638188 17255 consensus_queue.cc:1059] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:04:57.648439 12693 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:57.648109 12440 catalog_manager.cc:5697] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.634249 17189 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:57.648975 17255 raft_consensus.cc:3055] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:04:57.649385 12690 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:57.652961 12662 connection.cc:256] RPC call timeout handler was delayed by -1.1747912110000698s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
W20260709 13:04:57.658420 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 182630us
I20260709 13:04:57.643404 17215 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:57.663736 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:57.664768 12615 raft_consensus.cc:2393] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 14: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:57.665810 17235 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:57.666288 17270 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:57.666177 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:57.667013 17270 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:57.667562 17097 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:57.668283 17097 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:57.669077 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1066) took 3202 ms. Trace:
I20260709 13:04:57.669629 17241 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:57.670436 17241 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:57.670702 12615 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:04:57.651372 12440 catalog_manager.cc:5697] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:04:57.676666 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:57.678169 17241 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:57.669445 12620 rpcz_store.cc:276] 0709 13:04:54.466313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.090614 (+1624301us) service_pool.cc:224] Handling call
0709 13:04:56.347566 (+256952us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.439330 (+ 91764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.654377 (+1215047us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54003af2d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:04:57.668894 (+ 14517us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":590299904}
I20260709 13:04:57.674942 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:57.676365 12440 catalog_manager.cc:5697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 6 to 7, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 7 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:04:57.660069 17084 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:57.698541 17238 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:04:57.698698 12440 catalog_manager.cc:5697] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:57.682395 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 61366.6us
W20260709 13:04:57.702142 12588 leader_election.cc:336] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.711s (SENT)
I20260709 13:04:57.702620 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:57.706758 17290 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:57.708033 17010 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:04:57.709986 17236 raft_consensus.cc:3055] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:57.710516 17236 raft_consensus.cc:740] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:57.711688 17254 raft_consensus.cc:993] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:04:57.711798 17236 consensus_queue.cc:260] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:57.712766 17254 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:04:57.622051 16839 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:04:57.684659 16820 consensus_queue.cc:1059] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:04:57.685976 17127 consensus_queue.cc:1059] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:57.660246 12510 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:57.695163 12692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1762) took 1005 ms. Trace:
I20260709 13:04:57.728804 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:57.730363 12692 rpcz_store.cc:276] 0709 13:04:56.690117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.565389 (+875272us) service_pool.cc:224] Handling call
0709 13:04:57.574963 (+  9574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:57.660717 (+ 85754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:57.660743 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:57.694837 (+ 34094us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:04:57.694887 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.694961 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.695098 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:04:57.714035 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 186938us
W20260709 13:04:57.714869 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.717044 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1111) took 1459 ms. Trace:
I20260709 13:04:57.670517 17097 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:57.653505 17255 raft_consensus.cc:740] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:57.713395 17236 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:57.643908 12691 rpcz_store.cc:276] 0709 13:04:56.452012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.407376 (+955364us) service_pool.cc:224] Handling call
0709 13:04:57.407897 (+   521us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:57.408413 (+   516us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:04:57.449718 (+ 41305us) log.cc:844] Serialized 14 byte log entry
0709 13:04:57.499813 (+ 50095us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:57.499861 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:04:57.499906 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.499978 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.501056 (+  1078us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12633,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":5217,"spinlock_wait_cycles":18432384,"thread_start_us":42217,"threads_started":1,"wal-append.queue_time_us":156402}
W20260709 13:04:57.710018 17287 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:04:57.735471 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:04:57.737884 16992 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.098s	user 0.016s	sys 0.025s
W20260709 13:04:57.738335 16992 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.222s	user 0.016s	sys 0.025s
I20260709 13:04:57.738641 16992 raft_consensus.cc:697] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:57.739058 17268 raft_consensus.cc:1081] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:04:57.740520 17259 raft_consensus.cc:3055] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:57.740926 17259 raft_consensus.cc:740] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:57.717869 17205 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
W20260709 13:04:57.742172 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.741921 17259 consensus_queue.cc:260] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:57.743501 17278 raft_consensus.cc:3055] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:57.744397 17278 raft_consensus.cc:740] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:57.747612 17127 raft_consensus.cc:3055] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:04:57.748108 17127 raft_consensus.cc:740] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:57.728149 12440 catalog_manager.cc:5697] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
W20260709 13:04:57.752195 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 113306us
I20260709 13:04:57.754649 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:57.756296 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:57.756417 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:57.758496 17255 consensus_queue.cc:260] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:57.759123 12613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60708e41894c42b697291e905bff5dc6"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:60170
I20260709 13:04:57.759712 12613 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:57.759919 17255 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:04:57.760076 12613 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:57.740238 16992 consensus_queue.cc:237] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:57.762861 12662 connection.cc:256] RPC call timeout handler was delayed by -1.0757912110000234s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1716s for a response
W20260709 13:04:57.763397 12662 connection.cc:256] RPC call timeout handler was delayed by -1.0649912110000059s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1728s for a response
I20260709 13:04:57.753746 17268 consensus_queue.cc:1059] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
W20260709 13:04:57.763792 12662 connection.cc:256] RPC call timeout handler was delayed by -1.0505912109999826s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
I20260709 13:04:57.763938 13230 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:04:57.764148 17268 raft_consensus.cc:3055] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:57.764662 17268 raft_consensus.cc:740] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:04:57.765439 17172 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.014s	sys 0.038s
W20260709 13:04:57.765878 17172 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.179s	user 0.014s	sys 0.039s
I20260709 13:04:57.766736 13199 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:57.768083 16839 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:57.768533 12512 leader_election.cc:400] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 11. Current term is 12.
I20260709 13:04:57.768922 12512 leader_election.cc:403] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:57.769671 17270 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:57.769918 17084 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:04:57.770287 16995 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.130s	user 0.012s	sys 0.032s
W20260709 13:04:57.770638 16995 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.267s	user 0.013s	sys 0.032s
I20260709 13:04:57.770733 17084 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:57.771056 16995 raft_consensus.cc:697] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 13 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:57.772323 16995 consensus_queue.cc:237] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:57.743762 17259 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:57.746285 17278 consensus_queue.cc:260] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:57.777024 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:57.736274 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:57.780262 13234 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:57.780535 17278 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:57.751094 12440 catalog_manager.cc:5697] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:57.792043 12695 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:04:57.731894 12694 rpcz_store.cc:276] 0709 13:04:56.257014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.546628 (+289614us) service_pool.cc:224] Handling call
0709 13:04:56.550218 (+  3590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:56.672681 (+122463us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:04:56.712094 (+ 39413us) log.cc:844] Serialized 14 byte log entry
0709 13:04:57.573698 (+861604us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b18003d3960. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a911923a 00007fc3a9583a2a
0709 13:04:57.714797 (+141099us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:04:57.714877 (+    80us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:57.714994 (+   117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.716556 (+  1562us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54002c9054. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:04:57.716616 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.716850 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81344,"prepare.queue_time_us":39167,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":7611,"raft.queue_time_us":84202,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":185,"spinlock_wait_cycles":308928640,"thread_start_us":59343,"threads_started":1}
I20260709 13:04:57.795672 17268 consensus_queue.cc:260] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:57.764168 12662 connection.cc:256] RPC call timeout handler was delayed by -1.0343912110000701s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
W20260709 13:04:57.813638 12662 connection.cc:256] RPC call timeout handler was delayed by -1.0289912110000614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260709 13:04:57.814044 12662 connection.cc:256] RPC call timeout handler was delayed by -1.0055912110000236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
I20260709 13:04:57.727120 12618 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:57.819434 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:57.820602 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 54104.9us
I20260709 13:04:57.822539 12614 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:57.828213 12618 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:57.785859 12440 catalog_manager.cc:5697] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:57.837348 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.837239 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:57.722726 17238 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.106s
I20260709 13:04:57.749300 17127 consensus_queue.cc:260] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:57.852218 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:57.852638 17127 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:57.857883 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:57.876868 13230 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:57.877542 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:57.878109 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:57.878607 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:57.879570 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:57.879739 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:57.841480 17223 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:57.890496 13228 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:04:57.894342 17291 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:57.905799 17291 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:57.836751 12440 catalog_manager.cc:5697] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 7 to 9, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 9 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:57.908171 17291 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:57.858368 16672 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:57.912884 17084 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 11. Current term is 12.
W20260709 13:04:57.917438 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:57.866629 17241 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:04:57.908661 12440 catalog_manager.cc:5697] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 6 to 9, leader changed from <none> to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 9 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:57.926456 12440 catalog_manager.cc:5697] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 6 to 9, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 9 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:04:57.928489 12440 catalog_manager.cc:5697] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:57.902544 17179 raft_consensus.cc:2764] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Leader election decision vote started in defunct term 13: won
I20260709 13:04:57.938894 16989 consensus_queue.cc:1059] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:04:57.940886 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1118) took 1464 ms. Trace:
W20260709 13:04:57.941015 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 203072us
I20260709 13:04:57.944103 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:57.935032 12613 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:57.946591 13235 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:57.947250 12620 raft_consensus.cc:1240] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
I20260709 13:04:57.901896 17222 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:57.941514 12688 rpcz_store.cc:276] 0709 13:04:56.476596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:57.434687 (+958091us) service_pool.cc:224] Handling call
0709 13:04:57.435129 (+   442us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:04:57.452602 (+ 17473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:57.452640 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:04:57.461856 (+  9216us) log.cc:844] Serialized 52 byte log entry
0709 13:04:57.526442 (+ 64586us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b180039bc20. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c522 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
0709 13:04:57.550885 (+ 24443us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b180039bc20. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a645a2a6 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9
0709 13:04:57.552510 (+  1625us) spinlock_profiling.cc:243] Waited 8.81 ms on lock 0x7b180039bc20. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:04:57.622319 (+ 69809us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:57.653349 (+ 31030us) log.cc:844] Serialized 14 byte log entry
0709 13:04:57.732531 (+ 79182us) log.cc:844] Serialized 14 byte log entry
0709 13:04:57.940276 (+207745us) spinlock_profiling.cc:243] Waited 24.7 ms on lock 0x7b180039bc20. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a6406c0a 00007fc3afb46219 00007fc3a648ea40 00007fc3a64894e4 00007fc3a6489455 00007fc3a9571060 00007fc3a9583716 00007fc3a9594287 00007fc3a9594208
0709 13:04:57.940492 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:57.940578 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:57.940643 (+    65us) raft_consensus.cc:1685] finished
0709 13:04:57.940660 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:04:57.940819 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":306414,"prepare.queue_time_us":48245,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":110,"raft.queue_time_us":288707,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":19272,"spinlock_wait_cycles":112461568,"thread_start_us":69579,"threads_started":1,"wal-append.queue_time_us":333695}
I20260709 13:04:57.954372 12690 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:04:57.933983 13234 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:04:57.956202 12613 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:57.921813 17268 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:57.973242 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:57.976732 12693 raft_consensus.cc:2393] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 14: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:57.976640 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:57.978859 12689 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:04:57.979110 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 145723us
I20260709 13:04:57.981132 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:57.980708 17216 raft_consensus.cc:3055] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:57.995692 17216 raft_consensus.cc:740] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:04:57.982050 17261 consensus_meta.cc:287] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.541s	user 0.005s	sys 0.010s
W20260709 13:04:58.009646 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.014300 12693 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:57.980213 16672 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:58.019748 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 162079us
I20260709 13:04:58.020885 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:04:58.029115 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.029810 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:58.030087 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:58.030974 12544 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:58.032111 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:58.032917 12546 raft_consensus.cc:3055] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:04:58.033402 12546 raft_consensus.cc:740] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:58.034431 12546 consensus_queue.cc:260] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:58.035661 12546 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:04:58.037667 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:58.037919 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:58.038446 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:58.038534 12541 raft_consensus.cc:2376] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9. Re-sending same reply.
W20260709 13:04:58.038905 17298 log.cc:927] Time spent T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:04:58.039793 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:58.040045 17294 log.cc:927] Time spent T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:04:58.040755 12543 raft_consensus.cc:2410] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:04:58.041007 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:58.039912 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:58.038707 12544 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:04:58.030906 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:58.047327 12541 raft_consensus.cc:2368] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14.
I20260709 13:04:58.048713 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:58.049870 12543 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:04:58.052513 12539 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:58.032928 12545 raft_consensus.cc:2376] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11. Re-sending same reply.
I20260709 13:04:58.055070 13235 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
W20260709 13:04:58.053133 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 120765us
I20260709 13:04:57.996960 17216 consensus_queue.cc:260] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:58.067163 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:57.993072 17056 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:04:58.071918 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:58.068099 12543 raft_consensus.cc:2376] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11. Re-sending same reply.
I20260709 13:04:58.073426 12659 leader_election.cc:400] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14.
I20260709 13:04:58.074162 12659 leader_election.cc:403] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:04:58.073280 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:58.074651 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 187748us
W20260709 13:04:58.076864 13200 leader_election.cc:336] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.210s (SENT)
I20260709 13:04:58.077579 13200 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:58.078982 17127 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:58.079957 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:58.080389 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:58.080822 12541 raft_consensus.cc:2393] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 9: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:58.081635 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:58.081707 12440 catalog_manager.cc:5697] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 6 to 7, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 7 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:04:58.082864 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:58.083490 12541 raft_consensus.cc:2376] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13. Re-sending same reply.
I20260709 13:04:58.084400 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:04:58.071693 12662 leader_election.cc:336] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.606s (SENT)
I20260709 13:04:58.085464 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:04:58.090842 17301 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:04:58.093236 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:58.094532 12540 raft_consensus.cc:2410] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:04:58.094822 13232 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:04:58.098182 17216 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:58.101581 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:58.105762 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:58.106233 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:58.106755 17241 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:58.107115 12543 raft_consensus.cc:2368] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15.
I20260709 13:04:58.107241 17241 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:58.107503 12512 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:58.107784 17241 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:58.108531 17084 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:58.109251 12512 leader_election.cc:400] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14.
I20260709 13:04:58.115083 12540 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:04:58.119879 12512 leader_election.cc:403] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:04:58.101445 13199 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:58.127715 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:58.017521 17261 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:58.128887 13230 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:04:58.131304 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:58.131474 17241 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:58.132236 12542 raft_consensus.cc:2376] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8. Re-sending same reply.
I20260709 13:04:58.133378 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:58.135504 12539 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:04:58.135648 13199 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:58.138198 12538 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:04:58.134042 17241 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:58.140995 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 74026.2us
W20260709 13:04:58.142017 12662 leader_election.cc:336] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.716s (SENT)
I20260709 13:04:58.142081 16839 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:04:58.142621 16839 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.143035 16839 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:04:58.143183 12662 leader_election.cc:336] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.728s (SENT)
I20260709 13:04:58.143749 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:58.146035 12545 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:04:58.147349 12587 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:58.149224 16992 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:04:58.150586 17171 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:58.150755 16992 raft_consensus.cc:697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:58.151901 16992 consensus_queue.cc:237] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:58.149750 17291 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:04:58.154731 12588 leader_election.cc:336] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.158s (SENT)
I20260709 13:04:58.157970 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:58.157640 16839 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:58.158833 13231 raft_consensus.cc:2393] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 11: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:58.153765 13229 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:58.161588 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:58.163873 12539 raft_consensus.cc:1275] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:04:58.171200 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 155736us
I20260709 13:04:58.159827 17261 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:58.179199 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:58.181543 12617 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 13 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:04:58.182670 13199 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:58.160463 17179 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14.
I20260709 13:04:58.186175 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:58.187275 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 110500us
I20260709 13:04:58.191579 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:58.193032 12691 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:58.181804 17056 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14.
I20260709 13:04:58.179013 17031 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:58.194702 17222 raft_consensus.cc:3055] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:58.194535 17031 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:58.195079 17222 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:58.195984 17222 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:58.196691 17031 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:58.197189 17222 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:58.198295 12688 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:04:58.182099 16672 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:58.208549 17156 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:58.204424 12539 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 11: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:58.191812 17171 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:58.191648 16989 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:04:58.201956 12691 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
W20260709 13:04:58.232432 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:58.232252 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 71395.1us
I20260709 13:04:58.199206 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:58.206485 17170 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.190532 17259 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:58.249488 13199 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:04:58.244022 12538 raft_consensus.cc:2376] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 8. Re-sending same reply.
W20260709 13:04:58.239188 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.251757 12512 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:58.253142 12512 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:04:58.257987 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 114844us
I20260709 13:04:58.244350 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:58.266193 13226 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
W20260709 13:04:58.282634 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.285245 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:58.266561 12541 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
W20260709 13:04:58.292251 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.292409 17108 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:58.292961 17108 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:58.293243 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:58.295120 12617 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:58.264866 17031 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.284775 17235 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:04:58.282475 17179 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:58.304862 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:58.290443 17241 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:04:58.310655 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:58.313429 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:58.313239 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 184821us
W20260709 13:04:58.310830 12662 leader_election.cc:336] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.744s (SENT)
I20260709 13:04:58.316267 12539 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 12: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:58.318928 12620 raft_consensus.cc:1275] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:04:58.321687 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 68642.5us
W20260709 13:04:58.324258 17311 log.cc:927] Time spent T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 13:04:58.329432 12541 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
W20260709 13:04:58.330808 12588 leader_election.cc:336] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.245s (SENT)
W20260709 13:04:58.331815 12588 leader_election.cc:336] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.283s (SENT)
W20260709 13:04:58.332645 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.311444 17031 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:58.339723 17031 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:58.354238 17315 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:04:58.354909 12538 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:58.356765 12512 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:58.357575 17241 consensus_queue.cc:1059] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:04:58.311653 17235 raft_consensus.cc:697] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:58.358453 17241 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:04:58.358965 17241 raft_consensus.cc:697] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:58.359066 17235 consensus_queue.cc:237] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:58.359899 17241 consensus_queue.cc:237] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:58.361159 17255 consensus_meta.cc:287] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.001s
I20260709 13:04:58.316059 16839 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:58.361079 17084 raft_consensus.cc:3055] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:58.376782 12538 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:04:58.386722 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:58.387032 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 64004us
I20260709 13:04:58.391350 12617 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:04:58.312569 17170 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:58.404953 12546 raft_consensus.cc:1275] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
W20260709 13:04:58.408057 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.408906 12546 pending_rounds.cc:85] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 5
I20260709 13:04:58.368085 17084 raft_consensus.cc:740] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:58.422492 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:58.423204 12696 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:04:58.423146 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 124205us
I20260709 13:04:58.425226 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:58.425956 12541 raft_consensus.cc:2376] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12. Re-sending same reply.
I20260709 13:04:58.409157 12546 pending_rounds.cc:107] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:04:58.427745 12546 raft_consensus.cc:2889] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:58.440457 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 54963.6us
I20260709 13:04:58.442096 12539 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:04:58.405378 17108 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:58.471025 17179 consensus_queue.cc:1059] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:04:58.474679 17179 raft_consensus.cc:3055] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:04:58.471202 12613 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:04:58.475099 17179 raft_consensus.cc:740] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:58.476193 17179 consensus_queue.cc:260] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:58.472680 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:58.485188 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:58.429275 16672 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.494975 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:58.495710 12541 raft_consensus.cc:2376] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13. Re-sending same reply.
W20260709 13:04:58.490382 12662 leader_election.cc:336] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.762s (SENT)
I20260709 13:04:58.507908 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:58.508826 12692 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:04:58.510318 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:58.512189 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:58.513209 12690 raft_consensus.cc:2393] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 11: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:58.521446 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:58.522786 12538 raft_consensus.cc:2410] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:04:58.529417 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:58.511934 17255 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:58.536540 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:58.515161 16672 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:58.540606 16672 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:58.541527 12541 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:04:58.542141 12541 pending_rounds.cc:85] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 7
I20260709 13:04:58.542451 12541 pending_rounds.cc:107] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:04:58.542752 12541 raft_consensus.cc:2889] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:04:58.544773 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 54416.7us
W20260709 13:04:58.545823 12662 leader_election.cc:336] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.768s (SENT)
W20260709 13:04:58.547120 12662 leader_election.cc:336] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.794s (SENT)
I20260709 13:04:58.547559 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:58.518214 17179 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:04:58.571930 12662 leader_election.cc:336] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.886s (SENT)
I20260709 13:04:58.579176 12662 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:58.535936 17255 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:58.580886 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:58.579289 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:58.585328 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:04:58.588518 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 86560.7us
W20260709 13:04:58.612331 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 62740.4us
W20260709 13:04:58.615320 12662 leader_election.cc:336] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.090s (SENT)
W20260709 13:04:58.617192 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.612490 12696 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
W20260709 13:04:58.616801 12662 leader_election.cc:336] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.098s (SENT)
I20260709 13:04:58.617986 12691 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 14. Current term is 15. Ops: []
W20260709 13:04:58.620755 12662 leader_election.cc:336] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 4.242s (SENT)
I20260709 13:04:58.625404 17108 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:04:58.621330 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:04:58.626658 17323 log.cc:927] Time spent T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:04:58.628508 17170 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:58.629246 17239 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:04:58.590415 16672 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:04:58.643277 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:58.639664 12588 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:58.570521 17084 consensus_queue.cc:260] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:58.690502 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:58.700657 12543 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:04:58.717974 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:58.721235 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:58.751958 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.760604 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:04:58.763504 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.764952 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:58.765149 12618 raft_consensus.cc:2410] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:04:58.765676 12613 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:04:58.761270 12659 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:58.714178 17156 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:04:58.768162 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 147467us
I20260709 13:04:58.778957 12547 raft_consensus.cc:1240] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 6. Current term is 7. Ops: []
W20260709 13:04:58.780825 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 149482us
I20260709 13:04:58.783495 12588 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:58.785362 17188 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:58.785871 17188 raft_consensus.cc:697] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:58.786798 17188 consensus_queue.cc:237] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:58.788467 17156 raft_consensus.cc:697] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:58.790448 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:58.806176 12588 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:04:58.792151 17328 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:04:58.789919 17239 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:04:58.814396 17331 log.cc:927] Time spent T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:04:58.766722 16672 consensus_queue.cc:1048] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:04:58.821869 17189 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:58.822506 17189 raft_consensus.cc:697] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 15 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:58.823895 17338 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:58.824615 17338 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:58.801277 17084 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:58.827013 17338 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:04:58.827426 17310 log.cc:927] Time spent T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.525s	user 0.000s	sys 0.005s
I20260709 13:04:58.827716 17255 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:58.829274 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:58.810151 16992 raft_consensus.cc:2764] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:04:58.831379 17325 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
I20260709 13:04:58.823655 17189 consensus_queue.cc:237] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:58.832926 17239 raft_consensus.cc:697] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:04:58.834677 17334 log.cc:927] Time spent T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:04:58.837349 12512 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:58.830081 12540 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:58.843925 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:58.847702 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:58.789481 17156 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 11.13, Last appended by leader: 13, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:58.849900 12540 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 12: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:04:58.865171 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:58.865015 12512 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:04:58.859790 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 83632.3us
I20260709 13:04:58.866489 12659 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:04:58.868204 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:58.870844 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:58.888306 12540 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:04:58.869926 17336 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:58.891448 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:58.892482 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:58.893345 12540 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:58.887585 17172 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:04:58.890283 17241 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:58.902597 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:58.903985 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 68122.4us
W20260709 13:04:58.905167 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:58.903605 17335 log.cc:927] Time spent T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260709 13:04:58.909394 17337 log.cc:927] Time spent T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:04:58.914968 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 64115.2us
I20260709 13:04:58.916026 12512 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:58.907531 13200 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:58.909648 17172 raft_consensus.cc:697] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:04:58.902916 17339 log.cc:927] Time spent T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:04:58.955053 17170 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:04:58.910291 17241 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:58.964141 12512 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:58.967314 12512 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:58.968961 12540 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:04:58.970320 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:58.917660 17239 consensus_queue.cc:237] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:58.973487 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 49989.5us
W20260709 13:04:58.974058 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 79766.5us
I20260709 13:04:58.920043 16989 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:04:58.946168 17179 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:58.944927 17341 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:58.990808 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 83384.9us
I20260709 13:04:58.988858 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:04:58.970317 17338 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:58.996774 13200 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:59.000972 13200 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:58.981590 17259 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:04:58.975654 17336 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:04:59.003129 12540 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:58.984122 17179 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:58.980806 17222 consensus_queue.cc:1059] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:04:59.008574 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:59.006625 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:58.993436 17255 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:04:59.011442 12544 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:04:59.016393 12540 raft_consensus.cc:2376] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14. Re-sending same reply.
W20260709 13:04:59.021088 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 129714us
I20260709 13:04:59.024713 17344 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:04:59.008049 17259 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:59.010540 17179 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:59.037815 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:59.042282 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 61903.8us
I20260709 13:04:58.999145 17108 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:04:58.994906 16992 consensus_queue.cc:1059] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:04:59.001776 17188 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:04:59.005266 17189 consensus_queue.cc:1048] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:04:58.994055 16995 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:04:59.043781 12546 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
W20260709 13:04:59.051422 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 70525.9us
I20260709 13:04:59.041427 17127 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:59.008800 17341 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:59.007416 17172 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:59.043758 17259 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:59.053386 17222 raft_consensus.cc:3055] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:04:59.160712 17329 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.482s	user 0.002s	sys 0.000s
I20260709 13:04:59.088212 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:59.163429 12546 raft_consensus.cc:2393] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 7: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:59.058893 17127 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:04:59.173751 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:59.174049 17349 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.124s	user 0.002s	sys 0.000s
I20260709 13:04:59.167676 17127 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:59.174314 17223 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:59.174943 17223 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:59.108635 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 107638us
I20260709 13:04:59.059028 17216 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:59.128911 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:59.179894 12547 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
W20260709 13:04:59.088728 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 50787.8us
I20260709 13:04:59.186674 12659 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:04:59.187383 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 132562us
I20260709 13:04:59.189301 12539 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
I20260709 13:04:59.192932 17223 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:59.193764 16672 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:59.194744 16672 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:59.176748 17222 raft_consensus.cc:740] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:59.195310 16672 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:59.196434 17222 consensus_queue.cc:260] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:59.197865 17222 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:59.198302 17179 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:59.200706 17179 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:59.201700 13200 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:59.092604 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:04:59.207846 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:04:59.207341 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 114830us
W20260709 13:04:59.214097 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.216580 12547 raft_consensus.cc:1240] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:59.215281 17097 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:59.247915 17179 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:04:59.249032 17179 raft_consensus.cc:3055] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:04:59.249426 17179 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:04:59.218807 17223 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:04:59.252286 17366 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:59.252909 17366 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:59.255004 12695 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:04:59.255378 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:59.255038 17366 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:59.272854 12662 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:59.274358 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:59.274571 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:59.275957 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:59.277171 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:59.095155 17354 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.183s
I20260709 13:04:59.278716 12547 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:59.213475 17170 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:04:59.261015 17259 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:59.266275 17108 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:04:59.283823 17223 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:59.284951 17170 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:59.292999 17188 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:59.267969 17340 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:04:59.250264 17179 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:59.292467 17369 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:04:59.297942 17354 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:04:59.300130 17170 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:04:59.301605 17108 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:04:59.320461 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 47702us
I20260709 13:04:59.320612 17341 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:59.321995 17108 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:59.325376 17366 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:04:59.329576 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.339299 12588 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:59.340325 16992 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:59.340718 16992 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:59.340806 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:59.341157 16992 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:59.341657 17188 raft_consensus.cc:2764] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:04:59.341763 17179 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:04:59.343534 12588 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:59.344220 17291 raft_consensus.cc:2764] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:04:59.314661 17369 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:59.346127 17369 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:59.347132 12620 raft_consensus.cc:1217] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Deduplicated request from leader. Original: 5.5->[6.6-6.6]   Dedup: 6.6->[]
I20260709 13:04:59.347642 12620 raft_consensus.cc:1240] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:04:59.348917 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:59.350467 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:59.350549 17364 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.351102 17364 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:59.352883 12613 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:59.353138 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:59.353469 17364 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:04:59.356026 17127 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:59.357820 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:59.366425 12614 raft_consensus.cc:1240] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:59.367954 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:59.368553 12614 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:59.369169 17361 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.369712 17361 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:59.371544 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:59.371878 17361 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:59.372416 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:59.373461 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:59.374050 12615 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:04:59.374521 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:59.374909 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:59.376013 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:59.376380 12662 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:59.376972 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:59.377334 12662 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:59.378499 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:04:59.378782 17352 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:04:59.379252 17172 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:04:59.379596 17352 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:04:59.379961 17172 raft_consensus.cc:697] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:04:59.379992 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:04:59.381194 17172 consensus_queue.cc:237] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:59.382613 17127 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:59.383131 17241 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:59.383375 17364 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:59.383823 17364 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:59.384186 17364 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:59.387643 16995 raft_consensus.cc:3055] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:04:59.388083 16995 raft_consensus.cc:740] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:04:59.379243 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:59.390321 13226 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 14. Current term is 15. Ops: []
W20260709 13:04:59.392076 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.377157 17366 consensus_queue.cc:1048] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:59.396723 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:59.396166 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:59.395661 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:59.380252 17352 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:04:59.396185 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:59.402673 13199 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:04:59.406065 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:59.406411 12540 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:04:59.403857 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:59.408679 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:59.405802 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:59.415405 12543 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:04:59.418006 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:59.420105 13230 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: []
I20260709 13:04:59.420142 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:59.421108 12542 raft_consensus.cc:2393] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 7: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:04:59.388929 16995 consensus_queue.cc:260] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:59.429600 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:59.422228 13232 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
I20260709 13:04:59.423620 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:59.416275 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:59.434188 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:04:59.371884 17198 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.428723 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:59.431869 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:59.427440 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:59.419687 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:04:59.441628 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:59.389451 17108 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 13:04:59.443799 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:59.447082 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:59.449072 12544 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:04:59.329648 16672 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:59.458101 12613 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:04:59.459308 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:59.460163 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 59641.9us
I20260709 13:04:59.415772 17291 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:59.416911 17352 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:04:59.463274 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:59.465428 12618 raft_consensus.cc:2410] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:04:59.465858 13235 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:04:59.434713 17171 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:04:59.443529 12588 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:59.466872 12541 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:04:59.469383 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:59.470084 12621 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:59.473060 13233 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:59.473824 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:59.475064 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:59.475860 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:59.476612 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:59.432654 17235 consensus_queue.cc:1059] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:04:59.472358 12692 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:04:59.485848 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:04:59.490250 13235 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 13: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:04:59.466415 17352 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:04:59.479085 12540 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:04:59.499619 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:04:59.481485 17374 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 13:04:59.460000 17127 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:04:59.503332 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:59.501997 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:59.502599 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:04:59.507850 12662 connection.cc:256] RPC call timeout handler was delayed by -1.328969746000098s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
I20260709 13:04:59.480794 17189 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:04:59.475329 17171 raft_consensus.cc:697] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:04:59.526386 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:59.535795 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 133079us
I20260709 13:04:59.537288 17344 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:59.535856 12510 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:59.538144 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:59.546471 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:59.572731 13233 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 12: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:04:59.491046 17259 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:59.448592 17198 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:59.472124 17291 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:59.573900 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:59.471974 17361 consensus_queue.cc:1059] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:04:59.528044 17241 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.601073 17171 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:59.602365 17354 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:04:59.606676 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:59.630035 12692 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:04:59.607683 17364 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:59.610025 16672 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:04:59.609812 17369 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:04:59.610697 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 74936.8us
I20260709 13:04:59.614084 16989 raft_consensus.cc:3055] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:04:59.587421 17327 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:04:59.615777 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:04:59.651612 13228 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
W20260709 13:04:59.651958 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.618502 17261 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:59.653921 12689 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:04:59.631804 17383 log.cc:927] Time spent T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.111s	user 0.000s	sys 0.009s
I20260709 13:04:59.623111 17198 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:59.623255 13229 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:04:59.625028 17291 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:04:59.547480 17189 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:59.636921 13231 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:04:59.634778 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:59.653003 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:04:59.690936 12543 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:04:59.622049 13234 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:04:59.691663 13234 pending_rounds.cc:85] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: Aborting all ops after (but not including) 10
I20260709 13:04:59.692148 13234 pending_rounds.cc:107] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:04:59.692482 13234 raft_consensus.cc:2889] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:04:59.657478 17261 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:04:59.584731 17344 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:59.658891 17369 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:59.660336 17376 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:04:59.666005 12689 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:04:59.630970 17084 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:04:59.667217 12620 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 9. Current term is 11. Ops: []
I20260709 13:04:59.667997 12691 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14. Ops: []
I20260709 13:04:59.668954 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:59.671720 12614 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:04:59.705788 12621 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:04:59.634415 17108 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:04:59.682716 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 76110.2us
I20260709 13:04:59.644438 16989 raft_consensus.cc:740] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:04:59.666574 17345 log.cc:927] Time spent T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.697s	user 0.000s	sys 0.006s
I20260709 13:04:59.699465 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:04:59.701700 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 128598us
I20260709 13:04:59.702867 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:59.917929 12588 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:04:59.700138 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:04:59.631211 17241 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:04:59.695232 17189 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:04:59.699018 17127 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:04:59.771277 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:04:59.923120 12621 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:04:59.826977 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.677372 17179 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:59.824005 12615 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:04:59.762339 17343 log.cc:927] Time spent T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:04:59.837026 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:04:59.850821 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:59.851871 17364 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:04:59.777351 17371 log.cc:927] Time spent T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 13:04:59.853048 12690 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:04:59.824589 17216 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:04:59.856935 17170 consensus_meta.cc:287] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.002s
I20260709 13:04:59.908986 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:04:59.910333 12687 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 13:04:59.790333 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 148608us
I20260709 13:04:59.672834 17341 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.702872 13200 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:04:59.918674 12662 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:59.931143 12696 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
W20260709 13:05:00.011914 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 102061us
I20260709 13:04:59.938098 17291 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:04:59.989838 17223 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:05:00.062517 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 359713us
W20260709 13:05:00.069694 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 217271us
W20260709 13:05:00.040786 17345 log.cc:927] Time spent T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:05:00.063774 12621 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:04:59.935391 17179 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:00.040213 17341 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.082479 12510 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:04:59.937354 17127 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:00.094977 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 177122us
I20260709 13:05:00.000577 17352 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.000268 17216 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.005722 17170 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:00.104270 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 186913us
I20260709 13:05:00.072499 17223 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:00.074440 17354 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:00.114053 12622 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:00.121976 12588 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:00.127794 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1020) took 1298 ms. Trace:
I20260709 13:05:00.129045 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1011) took 1531 ms. Trace:
I20260709 13:05:00.133364 12538 rpcz_store.cc:276] 0709 13:04:58.592914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.593119 (+   205us) service_pool.cc:224] Handling call
0709 13:04:58.642426 (+ 49307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:58.664297 (+ 21871us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:58.664326 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:58.698187 (+ 33861us) log.cc:844] Serialized 26 byte log entry
0709 13:04:58.896137 (+197950us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:04:58.924846 (+ 28709us) log.cc:844] Serialized 14 byte log entry
0709 13:04:58.943783 (+ 18937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:58.943873 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:04:59.498759 (+554886us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b180041da60. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a645a2a6 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63129c4 00007fc3a6310acb 00007fc3a64cbdc9
0709 13:04:59.631559 (+132800us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b2400196c28. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63129c4 00007fc3a6310acb 00007fc3a64cbdc9 00007fc3a64cba55 00007fc3a64cb09d 00007fc3a90fd10e 00007fc3a911488c 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221
0709 13:05:00.124415 (+492856us) raft_consensus.cc:1685] finished
0709 13:05:00.124440 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:00.124574 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42939,"prepare.queue_time_us":28482,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":159066,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":32490,"spinlock_wait_cycles":45014656,"thread_start_us":126827,"threads_started":1,"wal-append.queue_time_us":213862}
I20260709 13:05:00.135638 12588 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:00.136744 12588 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:00.137773 17188 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:00.137988 17340 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.138161 12588 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:00.138815 17400 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:00.138587 17340 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.139245 17400 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:00.139371 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:00.139678 17400 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:00.138316 17360 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:00.124047 17393 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:00.141203 17360 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:00.141462 17393 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:00.138164 17188 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:00.130631 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 48292.2us
I20260709 13:05:00.132586 12546 rpcz_store.cc:276] 0709 13:04:58.829174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.164274 (+335100us) service_pool.cc:224] Handling call
0709 13:04:59.164602 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:59.164807 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:59.164830 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:59.165305 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 13:04:59.302445 (+137140us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:04:59.302481 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:04:59.302546 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:00.127492 (+824946us) raft_consensus.cc:1685] finished
0709 13:05:00.127521 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:00.127709 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":132730,"threads_started":1,"wal-append.queue_time_us":239181}
I20260709 13:05:00.141892 17360 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:00.142629 17188 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:00.081696 17291 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:00.157140 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 86764.3us
I20260709 13:05:00.157383 12695 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:00.126621 17261 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:00.059410 16989 consensus_queue.cc:260] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.122712 17398 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.145601 12510 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:00.147084 12692 raft_consensus.cc:1240] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:00.133126 17223 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:00.168383 12510 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:00.147656 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 243889us
W20260709 13:05:00.205780 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 43478.8us
I20260709 13:05:00.205958 17398 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:00.210168 17398 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:00.210816 17398 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:00.211485 17398 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:05:00.162019 16992 consensus_meta.cc:287] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.803s	user 0.008s	sys 0.005s
I20260709 13:05:00.212584 16992 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:00.213649 17179 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:00.214268 17179 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:00.214756 17179 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.215202 16992 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:00.201543 17353 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:00.219873 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 47858.7us
I20260709 13:05:00.221113 12614 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:00.212081 17398 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:00.226992 17398 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:00.228255 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 157869us
I20260709 13:05:00.229228 12543 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
W20260709 13:05:00.229421 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 88930.8us
W20260709 13:05:00.242303 17388 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.182s	user 0.001s	sys 0.000s
W20260709 13:05:00.242712 17391 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:05:00.218220 17353 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.242578 17352 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:00.200755 17344 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:00.219728 17379 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:00.217550 17179 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:00.218844 17393 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:00.256996 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 50143us
I20260709 13:05:00.230443 17404 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:00.263741 17341 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:00.269898 17384 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
W20260709 13:05:00.270926 17389 log.cc:927] Time spent T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
W20260709 13:05:00.272428 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:00.273433 17353 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:00.231405 17360 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:05:00.255892 16989 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:00.205580 17108 consensus_queue.cc:1059] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:05:00.228211 17398 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.285776 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:00.286638 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:00.286989 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:00.287976 17084 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:00.336354 17084 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.302826 16992 consensus_queue.cc:1059] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:00.338510 17084 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:00.341336 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:00.307030 17404 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:00.307590 17259 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.352957 17259 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.353289 17402 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:00.353367 17270 raft_consensus.cc:3055] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:00.353894 17270 raft_consensus.cc:740] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:00.354385 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:00.354785 17270 consensus_queue.cc:260] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.356107 17270 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:00.356427 17386 log.cc:927] Time spent T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.331s	user 0.002s	sys 0.000s
I20260709 13:05:00.357913 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:00.358551 13231 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:00.359858 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:00.360461 13229 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 7.
I20260709 13:05:00.361370 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:00.361963 13228 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:00.353899 17402 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.310953 12545 raft_consensus.cc:2376] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12. Re-sending same reply.
I20260709 13:05:00.312228 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:00.369306 12546 raft_consensus.cc:2410] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:05:00.314935 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:00.319346 17216 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:00.279181 17340 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:00.281838 17241 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:00.238502 17403 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:05:00.318295 17170 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:00.338294 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:00.334491 17108 raft_consensus.cc:3055] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:00.372184 12543 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:00.372531 17108 raft_consensus.cc:740] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:00.352273 17353 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:00.373481 17108 consensus_queue.cc:260] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.373379 17353 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.374872 17108 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:00.303205 12588 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:00.384967 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:00.386439 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:00.385669 13233 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:05:00.388384 12513 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:00.387382 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 180663us
I20260709 13:05:00.390667 17127 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:00.392447 17241 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:00.392899 17241 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.393603 17241 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:00.393882 17404 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:00.392854 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 85522.4us
I20260709 13:05:00.396929 12662 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:00.398432 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:00.403455 12510 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:00.405864 12542 raft_consensus.cc:2393] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 11: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:05:00.406419 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 103282us
I20260709 13:05:00.393007 17259 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:00.424322 17406 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.424476 17291 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:00.424677 17222 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:00.424934 17406 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.425098 17291 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:00.425369 17188 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.426591 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:00.427147 17406 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:00.427819 17353 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:00.427886 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:00.428602 17353 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:00.429330 17353 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:00.430092 17353 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:00.432337 17239 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:00.434520 12662 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:00.434785 17408 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:00.435284 17408 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.435725 12662 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:00.437027 12662 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:00.420934 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 190155us
I20260709 13:05:00.438472 12662 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:00.439039 13200 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:00.410668 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:00.437340 17408 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:00.439792 12662 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:00.440619 12542 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:05:00.440948 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 212254us
I20260709 13:05:00.441154 12510 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:00.408540 16992 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:00.422379 17216 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:00.454020 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:00.395853 17189 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:00.458370 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:00.409525 17419 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:00.428052 17188 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:00.439827 17170 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:00.443604 17366 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:00.443516 17403 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:00.471426 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 61347.2us
I20260709 13:05:00.406947 17416 consensus_queue.cc:1059] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:05:00.456689 17364 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:00.480034 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:00.480779 12618 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:00.484365 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:05:00.483466 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 74176.1us
I20260709 13:05:00.484653 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:00.493444 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:00.495544 13227 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:05:00.483484 12659 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:00.499892 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:00.500872 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 56401.6us
I20260709 13:05:00.502043 13199 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:00.474916 17172 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:05:00.504768 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 63693.9us
I20260709 13:05:00.506343 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:00.506672 12510 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:00.507768 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:00.508249 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:00.510000 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:00.510838 12619 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:00.512046 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:00.475010 17398 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:00.514240 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:00.475667 17404 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:00.483013 17379 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:00.518601 12510 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:00.482645 17402 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:00.460777 17216 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.522029 12694 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:00.520776 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:00.521145 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:00.523517 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:00.524811 12620 raft_consensus.cc:2393] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 14: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:00.526834 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:00.528076 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:00.528250 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:00.528669 12690 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:00.529008 12615 raft_consensus.cc:2410] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:05:00.528280 12662 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:00.532296 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:00.483587 17403 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.538419 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:00.539069 12619 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:00.539389 12690 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:00.542624 13199 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:00.517606 17366 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:00.515491 17172 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.515985 17360 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:00.516114 17416 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:00.550638 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1143) took 1074 ms. Trace:
I20260709 13:05:00.551152 12691 rpcz_store.cc:276] 0709 13:04:59.476156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.476311 (+   155us) service_pool.cc:224] Handling call
0709 13:04:59.476576 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:59.704858 (+228282us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:00.550329 (+845471us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b540012dc54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:00.550566 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":439677312}
I20260709 13:05:00.556437 17416 raft_consensus.cc:697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 13 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:00.556913 17216 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:00.557719 17110 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:00.557443 17416 consensus_queue.cc:237] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.558642 16995 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:00.561172 17425 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.561766 17425 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.563934 17425 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:00.566109 17379 raft_consensus.cc:697] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:00.567207 17379 consensus_queue.cc:237] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.569425 17417 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:00.571959 17418 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:00.573042 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:00.574322 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:00.575066 13226 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:00.575707 17410 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.576251 17410 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.578497 17410 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:00.517148 16992 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:05:00.581915 17363 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:00.585983 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 63982.6us
I20260709 13:05:00.586705 17189 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:00.587009 13231 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:00.526443 17419 consensus_queue.cc:1059] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:05:00.550009 17402 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:00.589085 17239 raft_consensus.cc:3055] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:00.589632 17239 raft_consensus.cc:740] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:00.590509 17239 consensus_queue.cc:260] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:00.596071 17364 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.596589 12617 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:05:00.596737 17364 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.599488 12692 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:05:00.574266 13232 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 11 index: 13. Preceding OpId from leader: term: 12 index: 14. (index mismatch)
W20260709 13:05:00.603351 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 60849.1us
I20260709 13:05:00.505980 17222 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:05:00.617424 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:00.477646 17400 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:00.618734 12616 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 13: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:00.626940 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:00.552780 17172 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:00.629945 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:00.632670 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 119434us
I20260709 13:05:00.636197 17108 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:00.638445 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:00.636775 17418 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.640161 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:00.640574 17418 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.641431 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:00.642272 12616 raft_consensus.cc:2410] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:05:00.642947 17418 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:00.643903 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:00.644649 12696 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 13: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:00.645468 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:00.645691 17189 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:00.646078 12696 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:00.581367 17223 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:00.647149 17408 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.646981 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:00.647718 17408 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.648149 17223 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:00.629246 16839 consensus_queue.cc:1059] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:05:00.648581 12510 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:00.649489 12616 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:00.648274 17241 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.651786 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:00.654135 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:00.655042 12691 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:05:00.649544 16839 raft_consensus.cc:3055] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:00.656273 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:00.621037 17216 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:00.614354 17360 raft_consensus.cc:697] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 7 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:00.671275 12691 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:00.618297 17366 raft_consensus.cc:697] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:00.674525 12691 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:00.676591 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:00.669404 12512 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:00.552093 17361 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:05:00.683121 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:00.684983 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:00.687886 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:00.620754 16992 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:05:00.689428 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:00.672264 17417 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:00.686977 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 140020us
I20260709 13:05:00.670641 16839 raft_consensus.cc:740] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:00.673233 17216 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.681744 17402 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:00.636878 17108 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.755002 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:00.684074 17338 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:00.759459 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:00.689554 17404 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:00.757753 17417 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.767230 16839 consensus_queue.cc:260] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.775494 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:00.760246 17216 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:00.856215 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:00.783217 17230 consensus_queue.cc:1059] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.147s
I20260709 13:05:00.785307 17408 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:00.787681 17108 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:00.762151 12691 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
W20260709 13:05:00.808997 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:00.852674 17398 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.853829 12542 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:05:00.864872 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:00.865679 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:00.875604 16989 consensus_meta.cc:287] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.555s	user 0.012s	sys 0.000s
I20260709 13:05:00.864578 17366 consensus_queue.cc:237] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:00.784941 17172 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:00.879356 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 206699us
I20260709 13:05:00.882419 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:00.853667 17189 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.899768 12512 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:00.759474 17416 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.134s
I20260709 13:05:00.910706 12695 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:00.911574 17417 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:00.912457 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:00.902962 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:00.903950 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:00.904623 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:00.856653 17338 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.906080 17414 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.901578 17398 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.913455 12542 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:05:00.902520 17404 raft_consensus.cc:697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:00.894508 17364 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:00.916989 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:00.917887 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:00.919422 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:00.920390 17402 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:05:00.925185 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:00.926440 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:00.923641 12692 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 14: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:00.918228 12510 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:00.919858 13200 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:00.913180 12696 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:00.930886 12510 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:00.912123 17172 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:00.938010 12510 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:00.917346 17417 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:00.940267 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:00.941671 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:00.944746 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:00.912463 17241 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:00.915233 17189 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:00.937788 17353 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:00.939103 17408 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:00.939396 17402 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:00.940850 17417 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.918419 17360 consensus_queue.cc:237] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.955880 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:00.946246 17400 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:00.923607 17414 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.950668 17353 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:00.965216 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:00.965263 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:00.952533 17408 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:00.966300 12538 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:00.955624 17241 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:00.967182 12510 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:00.954336 17417 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:00.972745 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:00.965942 17353 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:00.967010 17433 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:05:00.971400 17241 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.024755 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:01.026240 12541 raft_consensus.cc:2410] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 13:05:01.027153 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 87371.5us
I20260709 13:05:01.028697 17443 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:01.029524 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:01.029927 17443 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:01.030511 12688 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:05:01.030951 17443 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:00.972436 17402 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:00.992075 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:00.993742 17400 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:01.035748 12512 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:01.035637 17400 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:00.995676 17414 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:01.037583 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:01.038012 17414 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:00.996909 17189 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:01.003002 17338 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:01.038578 12541 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:01.038743 13200 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:01.039144 17338 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:00.966527 17404 consensus_queue.cc:237] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:01.012117 17398 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:00.971065 17408 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:01.033975 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:00.985948 12538 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:01.045774 12538 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:01.027179 17241 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:01.041203 17413 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:01.037822 17216 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:01.070538 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:01.075212 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 102541us
I20260709 13:05:01.077064 12510 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:01.038594 17414 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:01.084367 17402 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:01.079583 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:01.086483 12662 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:01.087286 17364 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:01.087906 17364 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:01.092140 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3308) took 1448 ms. Trace:
I20260709 13:05:01.092643 12618 rpcz_store.cc:276] 0709 13:04:59.643429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.645153 (+  1724us) service_pool.cc:224] Handling call
0709 13:04:59.666804 (+ 21651us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:00.481902 (+815098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.091849 (+609947us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b54002a7bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:01.092064 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1865629952}
I20260709 13:05:01.098942 12618 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:05:01.100404 12618 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:01.065292 17441 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:01.100961 17441 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.101428 17441 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:01.098970 17436 log.cc:927] Time spent T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:05:01.077488 17400 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:01.106680 17364 consensus_queue.cc:1059] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:01.107018 17216 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:01.107614 17364 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:01.108975 17364 raft_consensus.cc:3055] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:01.110005 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:01.110246 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:01.111083 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:01.042065 17417 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:01.112851 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:01.089354 12619 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:05:01.114439 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:01.119805 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:01.109354 17364 raft_consensus.cc:740] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:01.122881 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:01.124636 12618 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:01.131916 17188 raft_consensus.cc:3055] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:01.132534 17188 raft_consensus.cc:740] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:01.134496 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:01.139793 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:01.140487 13226 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:01.144233 17443 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:01.145574 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1706) took 1680 ms. Trace:
I20260709 13:05:01.147293 12539 rpcz_store.cc:276] 0709 13:04:59.465045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.465268 (+   223us) service_pool.cc:224] Handling call
0709 13:04:59.472504 (+  7236us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:04:59.478514 (+  6010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:04:59.478556 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:04:59.492618 (+ 14062us) log.cc:844] Serialized 26 byte log entry
0709 13:04:59.825705 (+333087us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:04:59.879220 (+ 53515us) log.cc:844] Serialized 14 byte log entry
0709 13:05:00.355540 (+476320us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:01.145059 (+789519us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b18003af1e0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a91214bc 00007fc3a646f48b 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a6489455 00007fc3a9571060 00007fc3a9583716 00007fc3a9594287
0709 13:05:01.145199 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.145296 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:01.145340 (+    44us) raft_consensus.cc:1685] finished
0709 13:05:01.145353 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.145501 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32943,"prepare.queue_time_us":55469,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":70,"raft.queue_time_us":211284,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":12847,"spinlock_wait_cycles":39733504,"thread_start_us":201691,"threads_started":2,"wal-append.queue_time_us":365244}
I20260709 13:05:01.155997 12542 raft_consensus.cc:2368] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14.
I20260709 13:05:01.156351 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:01.157138 13233 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:05:01.153821 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:01.158964 13230 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:01.163779 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:01.164628 13228 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:05:01.176285 12588 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:01.181190 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:01.183982 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:01.184862 13233 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:05:01.186769 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:01.137117 17031 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:05:01.192476 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:01.192991 17417 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:01.151482 17411 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:01.201392 12662 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:01.203116 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:01.197467 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:01.203965 12696 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:01.195852 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:01.205006 12613 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:05:01.207356 12539 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:01.145529 17428 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:05:01.151929 17356 consensus_queue.cc:1059] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:05:01.233385 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:01.181463 17400 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:01.233443 12619 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:01.236003 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:01.211074 12513 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:01.247377 12513 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:01.255074 13233 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:01.260404 13230 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:05:01.262274 12513 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:01.267804 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:01.243520 17031 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:01.291383 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:01.292192 13228 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:05:01.288923 12696 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:05:01.256083 16672 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:01.286427 17443 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:01.295737 16672 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:01.296262 17440 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:01.297048 17440 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:01.295959 17446 log.cc:927] Time spent T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:05:01.302589 17356 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.303225 17356 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:01.180001 17188 consensus_queue.cc:260] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:01.307889 13230 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:05:01.306751 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:01.296358 16672 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:01.305236 17414 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:01.256479 17417 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.262497 17400 raft_consensus.cc:697] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:01.305332 17356 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:01.321545 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:01.266114 17402 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:05:01.319514 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 185646us
I20260709 13:05:01.327903 12619 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:01.287019 17398 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:01.267156 17338 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:01.331939 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:01.332525 12691 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:01.333765 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:01.351565 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:01.233494 17364 consensus_queue.cc:260] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:01.258083 17397 consensus_queue.cc:1059] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:05:01.356612 17356 raft_consensus.cc:3055] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:05:01.357196 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.358320 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:01.359318 13230 raft_consensus.cc:2393] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 13: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:01.315799 17447 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:01.322021 17360 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:01.323906 17414 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:01.329910 17402 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:01.362236 17356 raft_consensus.cc:740] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:01.328960 17188 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:01.362870 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:01.383774 12539 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:01.323181 17156 consensus_queue.cc:1059] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:05:01.351593 17416 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:01.398324 12691 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
I20260709 13:05:01.399312 13228 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
I20260709 13:05:01.327236 17417 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:01.443483 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.382725 17402 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:01.392532 17364 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:01.372865 17360 raft_consensus.cc:697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:05:01.467463 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 201997us
I20260709 13:05:01.358480 17398 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:01.476678 12539 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:05:01.487361 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:01.490355 12539 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:01.491834 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:01.381856 17414 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:01.502919 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 171464us
I20260709 13:05:01.476554 17443 raft_consensus.cc:697] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:01.539901 17398 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:01.542260 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:01.542937 12546 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:01.543383 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1709) took 1236 ms. Trace:
I20260709 13:05:01.543670 12546 rpcz_store.cc:276] 0709 13:05:00.306651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.541977 (+1235326us) service_pool.cc:224] Handling call
0709 13:05:01.543326 (+  1349us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:01.544725 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:01.548126 17432 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.908s	user 0.019s	sys 0.040s
I20260709 13:05:01.552760 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:01.545393 12546 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:01.571811 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1127) took 2214 ms. Trace:
I20260709 13:05:01.572352 12622 rpcz_store.cc:276] 0709 13:04:59.355100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.363779 (+  8679us) service_pool.cc:224] Handling call
0709 13:05:00.113778 (+749999us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:00.143065 (+ 29287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.569583 (+1426518us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b54001caf50. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:01.569766 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1724053376}
I20260709 13:05:01.578979 17403 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:01.606563 17417 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:01.584404 17455 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:05:01.598991 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:01.608906 12691 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 14: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:01.602250 17443 consensus_queue.cc:237] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:01.499483 17400 consensus_queue.cc:237] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:01.602751 17361 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:01.561463 17241 consensus_meta.cc:287] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.500s	user 0.007s	sys 0.003s
I20260709 13:05:01.612644 17361 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:01.614744 17361 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:01.559551 17419 consensus_queue.cc:1059] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:05:01.568323 17360 consensus_queue.cc:237] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:01.620645 13233 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
W20260709 13:05:01.629848 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 126195us
W20260709 13:05:01.571322 17353 consensus_meta.cc:287] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.566s	user 0.003s	sys 0.008s
I20260709 13:05:01.636754 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 836) took 2238 ms. Trace:
W20260709 13:05:01.614761 17408 consensus_meta.cc:287] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.558s	user 0.004s	sys 0.004s
I20260709 13:05:01.637341 13234 rpcz_store.cc:276] 0709 13:04:59.394039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.394158 (+   119us) service_pool.cc:224] Handling call
0709 13:04:59.394433 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:04:59.699187 (+304754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.632559 (+1933372us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b5400511b54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:01.632747 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522626944}
I20260709 13:05:01.645264 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:01.514781 17356 consensus_queue.cc:260] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:01.659349 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:01.565677 17428 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:05:01.675727 12546 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:01.676748 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:01.684752 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 54217.4us
I20260709 13:05:01.612684 17241 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:01.682991 12619 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
I20260709 13:05:01.662480 17403 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:01.680837 17441 consensus_meta.cc:287] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.579s	user 0.005s	sys 0.006s
I20260709 13:05:01.691774 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 1049) took 1085 ms. Trace:
I20260709 13:05:01.694350 12542 rpcz_store.cc:276] 0709 13:05:00.605939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.919182 (+313243us) service_pool.cc:224] Handling call
0709 13:05:01.691592 (+772410us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54002ccc54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:01.691717 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":533403904}
I20260709 13:05:01.705094 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:01.738880 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 44473.6us
I20260709 13:05:01.738956 12542 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:01.739879 12546 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
W20260709 13:05:01.740748 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.740592 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:01.655372 17408 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:01.643503 17353 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:01.746837 12622 raft_consensus.cc:3055] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:01.748867 17467 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:01.754642 12662 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:01.928996 12622 raft_consensus.cc:740] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:05:01.933633 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 179071us
I20260709 13:05:01.755007 17342 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:01.760026 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:01.936712 13230 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 14: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:01.700304 17441 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:01.763007 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.799418 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:01.937871 12546 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:01.939183 13232 raft_consensus.cc:2393] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:01.807569 12542 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
W20260709 13:05:01.823333 16672 consensus_meta.cc:287] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.500s	user 0.009s	sys 0.000s
I20260709 13:05:01.826259 12618 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:01.826769 17239 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:01.830102 16839 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:01.832700 16989 raft_consensus.cc:3055] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:01.834929 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1791) took 1333 ms. Trace:
I20260709 13:05:01.836108 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 847) took 1263 ms. Trace:
I20260709 13:05:01.844726 13234 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: [12.14-12.14]
I20260709 13:05:01.953595 12695 rpcz_store.cc:276] 0709 13:05:00.501352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.512618 (+ 11266us) service_pool.cc:224] Handling call
0709 13:05:00.512919 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:00.911149 (+398230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.834522 (+923373us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b540018bd54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:01.834850 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":914332416}
I20260709 13:05:01.854571 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1796) took 1351 ms. Trace:
I20260709 13:05:01.861423 17440 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:01.955188 13234 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:05:01.868782 12617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 1986) took 2466 ms (client timeout 2244 ms). Trace:
I20260709 13:05:01.874269 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3317) took 1360 ms. Trace:
W20260709 13:05:01.956375 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.955344 12687 rpcz_store.cc:276] 0709 13:05:00.503329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.503669 (+   340us) service_pool.cc:224] Handling call
0709 13:05:00.518924 (+ 15255us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:00.590296 (+ 71372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:00.590340 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:00.590913 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 13:05:00.664340 (+ 73427us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:00.664401 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.547574 (+883173us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:01.854158 (+306584us) spinlock_profiling.cc:243] Waited 70.9 ms on lock 0x7b54000c7bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:01.854221 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:01.854281 (+    60us) raft_consensus.cc:1685] finished
0709 13:05:01.854296 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.854480 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5641,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":224888064,"thread_start_us":72931,"threads_started":1,"wal-append.queue_time_us":48337}
I20260709 13:05:01.956615 12616 rpcz_store.cc:276] 0709 13:05:00.513707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.642812 (+129105us) service_pool.cc:224] Handling call
0709 13:05:00.643113 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:00.650103 (+  6990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.873905 (+1223802us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b54002a80d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:01.874192 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14229376}
I20260709 13:05:01.876590 13233 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 13:05:01.879742 17352 consensus_queue.cc:1059] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:01.880944 17425 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:01.959378 16989 raft_consensus.cc:740] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:01.963629 17425 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:01.884151 17434 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.974s	user 0.003s	sys 0.014s
I20260709 13:05:01.895831 17414 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:01.797840 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 99833.8us
I20260709 13:05:01.687994 17156 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.118s
W20260709 13:05:01.970782 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:01.967549 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3052) took 1670 ms. Trace:
I20260709 13:05:01.945302 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:01.953073 13230 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:01.863104 13227 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:01.939951 12622 consensus_queue.cc:260] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:01.954110 13235 rpcz_store.cc:276] 0709 13:05:00.572887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.575148 (+  2261us) service_pool.cc:224] Handling call
0709 13:05:00.575456 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:00.588879 (+ 13423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:00.588918 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:00.589377 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:05:00.636436 (+ 47059us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:00.636477 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.835616 (+1199139us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b5400571a54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:01.835670 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:01.835729 (+    59us) raft_consensus.cc:1685] finished
0709 13:05:01.835743 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.835995 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1564,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":30065024,"thread_start_us":46678,"threads_started":1,"wal-append.queue_time_us":43621,"wal-append.run_cpu_time_us":1887,"wal-append.run_wall_time_us":1003647}
I20260709 13:05:01.698549 17403 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:01.941294 17366 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:05:01.988415 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:01.956207 12617 rpcz_store.cc:269] 0709 13:04:59.402310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.474400 (+ 72090us) service_pool.cc:224] Handling call
0709 13:05:01.868465 (+2394065us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400375854. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:01.868654 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2507856128}
I20260709 13:05:01.894235 17241 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:01.965353 12539 raft_consensus.cc:2368] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12.
I20260709 13:05:01.961825 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:01.990275 12546 raft_consensus.cc:2393] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 16: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:01.980831 12540 rpcz_store.cc:276] 0709 13:05:00.297372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.600341 (+302969us) service_pool.cc:224] Handling call
0709 13:05:00.600892 (+   551us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:00.628107 (+ 27215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:00.628152 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:00.645869 (+ 17717us) log.cc:844] Serialized 26 byte log entry
0709 13:05:00.853260 (+207391us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:01.064671 (+211411us) log.cc:844] Serialized 14 byte log entry
0709 13:05:01.070318 (+  5647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.070425 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:01.883371 (+812946us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:01.967280 (+ 83909us) raft_consensus.cc:1685] finished
0709 13:05:01.967373 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:01.967493 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36139,"prepare.queue_time_us":285463,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":31831,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":25559,"spinlock_wait_cycles":4331392,"thread_start_us":367967,"threads_started":2,"wal-append.queue_time_us":264019}
I20260709 13:05:01.995199 13235 raft_consensus.cc:1240] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:01.984978 17397 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:01.999989 17397 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.004194 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1045) took 1402 ms. Trace:
I20260709 13:05:02.004587 12540 rpcz_store.cc:276] 0709 13:05:00.604565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.003328 (+1398763us) service_pool.cc:224] Handling call
0709 13:05:02.003649 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:02.003881 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:02.003905 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:02.003946 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:02.003982 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.004033 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.004140 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:02.006211 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1047) took 1401 ms. Trace:
I20260709 13:05:02.006549 12540 rpcz_store.cc:276] 0709 13:05:00.605303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.005488 (+1400185us) service_pool.cc:224] Handling call
0709 13:05:02.005773 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:02.005930 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:02.005953 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:02.005992 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:02.006028 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.006075 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.006164 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:02.007797 12540 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:02.008306 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1050) took 1392 ms. Trace:
I20260709 13:05:02.008597 12540 rpcz_store.cc:276] 0709 13:05:00.616425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.007402 (+1390977us) service_pool.cc:224] Handling call
0709 13:05:02.007640 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:02.008112 (+   472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.008260 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:02.013435 12616 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:01.978343 17364 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:02.018908 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 275921us
I20260709 13:05:02.015524 12540 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:02.026388 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1051) took 1404 ms. Trace:
I20260709 13:05:02.026917 12540 rpcz_store.cc:276] 0709 13:05:00.622322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.015079 (+1392757us) service_pool.cc:224] Handling call
0709 13:05:02.015368 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:02.025829 (+ 10461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.026327 (+   498us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:02.028693 12540 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:01.966121 17466 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:02.018447 12542 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:02.025007 12587 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:01.939517 17467 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:01.996165 17390 raft_consensus.cc:3055] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:01.961057 16672 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:01.987179 17400 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:05:02.036676 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1052) took 1405 ms. Trace:
I20260709 13:05:02.031298 12546 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:01.964215 16989 consensus_queue.cc:260] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.040465 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1053) took 1371 ms. Trace:
I20260709 13:05:02.012389 17366 raft_consensus.cc:697] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:02.043093 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1046) took 1438 ms. Trace:
I20260709 13:05:02.011307 17352 consensus_queue.cc:1059] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:05:02.001993 17399 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:05:01.991989 17189 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
W20260709 13:05:02.050225 17471 log.cc:927] Time spent T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 13:05:02.051705 17454 log.cc:927] Time spent T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.520s	user 0.000s	sys 0.002s
I20260709 13:05:02.057134 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1054) took 1370 ms. Trace:
I20260709 13:05:02.058004 17397 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:02.059691 17445 log.cc:927] Time spent T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.893s	user 0.000s	sys 0.001s
I20260709 13:05:02.037177 17364 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.046196 12542 rpcz_store.cc:276] 0709 13:05:00.669010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.039583 (+1370573us) service_pool.cc:224] Handling call
0709 13:05:02.039878 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:02.040070 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:02.040097 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:02.040141 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:02.040187 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.040241 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.040404 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:02.009284 17188 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:05:02.061448 12546 rpcz_store.cc:276] 0709 13:05:00.604988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.010551 (+1405563us) service_pool.cc:224] Handling call
0709 13:05:02.031064 (+ 20513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:02.042861 (+ 11797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.043037 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:02.042757 12540 rpcz_store.cc:276] 0709 13:05:00.630962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.028113 (+1397151us) service_pool.cc:224] Handling call
0709 13:05:02.028536 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:02.034209 (+  5673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.036610 (+  2401us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:02.063288 17419 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:02.062716 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:02.043023 17390 raft_consensus.cc:740] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:02.147053 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 841) took 1576 ms. Trace:
I20260709 13:05:02.146925 12539 rpcz_store.cc:276] 0709 13:05:00.687296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.056252 (+1368956us) service_pool.cc:224] Handling call
0709 13:05:02.056588 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:02.056788 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:02.056818 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:02.056862 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:02.056905 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.056961 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.057074 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:02.060686 16672 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:02.205845 13231 rpcz_store.cc:276] 0709 13:05:00.570741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.571395 (+   654us) service_pool.cc:224] Handling call
0709 13:05:00.571722 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:00.587637 (+ 15915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.146785 (+1559148us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b540063a954. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:02.146986 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34332544}
W20260709 13:05:02.185356 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 61030.7us
I20260709 13:05:02.136296 16989 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:02.210657 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 145294us
I20260709 13:05:02.214809 12540 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:05:02.215482 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1057) took 1149 ms. Trace:
I20260709 13:05:02.215788 12540 rpcz_store.cc:276] 0709 13:05:01.065724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.210391 (+1144667us) service_pool.cc:224] Handling call
0709 13:05:02.210685 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:02.215214 (+  4529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.215426 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:02.213471 13230 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
W20260709 13:05:02.207984 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 118711us
I20260709 13:05:02.208252 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1055) took 1467 ms. Trace:
I20260709 13:05:02.217733 12542 rpcz_store.cc:276] 0709 13:05:00.740805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.207337 (+1466532us) service_pool.cc:224] Handling call
0709 13:05:02.207588 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:02.207799 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:02.207839 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:02.207895 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:02.207941 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.208013 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.208177 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:02.219924 12542 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:05:02.150012 17456 log.cc:927] Time spent T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.587s	user 0.001s	sys 0.001s
I20260709 13:05:02.041833 17466 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:02.209298 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.221527 12542 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:02.186913 17363 raft_consensus.cc:3055] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:05:02.226397 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.235884 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:02.228237 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:02.218302 17409 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.214458 17473 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:02.222327 17408 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:02.247818 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.249974 12616 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:02.233722 16672 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:02.232820 17363 raft_consensus.cc:740] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:05:02.256692 17402 consensus_meta.cc:287] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.772s	user 0.009s	sys 0.002s
I20260709 13:05:02.269985 17402 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.272433 17402 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:02.273172 12542 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 13:05:02.275489 17239 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:02.276062 17239 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.242872 17441 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:02.293725 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.265046 17403 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:02.265322 17487 consensus_queue.cc:1059] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:05:02.265980 17475 log.cc:927] Time spent T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:05:02.267704 17353 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:02.250638 17427 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:02.317813 16992 raft_consensus.cc:3055] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:02.318305 16992 raft_consensus.cc:740] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:05:02.318634 17477 log.cc:927] Time spent T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:05:02.319118 16992 consensus_queue.cc:260] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.246097 17366 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 11.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:02.269040 17451 log.cc:927] Time spent T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.792s	user 0.000s	sys 0.003s
I20260709 13:05:02.249780 17397 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:02.305392 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 90856.3us
I20260709 13:05:02.277860 17425 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:02.303438 17419 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:02.324746 12587 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:02.324156 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1805) took 1219 ms. Trace:
I20260709 13:05:02.247363 17409 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:02.325214 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 97015us
W20260709 13:05:02.318323 17479 log.cc:927] Time spent T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:05:02.369954 12693 rpcz_store.cc:276] 0709 13:05:01.105223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.121668 (+ 16445us) service_pool.cc:224] Handling call
0709 13:05:01.153214 (+ 31546us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:01.166589 (+ 13375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:01.166623 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:01.172908 (+  6285us) log.cc:844] Serialized 26 byte log entry
0709 13:05:01.314567 (+141659us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:01.314618 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.314677 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:02.060761 (+746084us) spinlock_profiling.cc:243] Waited 57.2 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:02.321110 (+260349us) raft_consensus.cc:1685] finished
0709 13:05:02.321140 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.324089 (+  2949us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3204,"raft.queue_time_us":27071,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":3372,"spinlock_wait_cycles":131474176,"thread_start_us":124423,"threads_started":1,"wal-append.queue_time_us":294735}
W20260709 13:05:02.375886 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 51239.1us
I20260709 13:05:02.376654 17356 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:02.328828 17397 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.387893 17397 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:02.322939 17427 raft_consensus.cc:697] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:02.413332 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:02.277421 17390 consensus_queue.cc:260] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:02.418401 12695 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:05:02.414202 12687 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:02.262501 16672 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.420871 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:02.421644 13233 raft_consensus.cc:2393] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 13: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:02.422536 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:02.423156 12689 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:05:02.425634 12694 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:05:02.425997 12692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1809) took 1319 ms. Trace:
I20260709 13:05:02.409762 17425 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:02.426380 12692 rpcz_store.cc:276] 0709 13:05:01.106472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.111161 (+  4689us) service_pool.cc:224] Handling call
0709 13:05:01.111455 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:01.111758 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:01.111784 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:01.112205 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 13:05:01.236101 (+123896us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:01.236143 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:01.236205 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:02.268288 (+1032083us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:02.417307 (+149019us) raft_consensus.cc:1685] finished
0709 13:05:02.417327 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.425936 (+  8609us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1098,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":27555,"spinlock_wait_cycles":287663360,"thread_start_us":123506,"threads_started":1,"wal-append.queue_time_us":240837}
I20260709 13:05:02.437387 17387 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:02.438097 17387 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.438618 12587 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:02.439393 17390 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:02.440182 17291 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:02.440603 17291 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:02.440924 17291 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:02.409117 17156 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
W20260709 13:05:02.454092 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.334712 17363 consensus_queue.cc:260] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:02.480053 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.414115 17473 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:05:02.414312 17419 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.496203 13233 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:05:02.494792 12587 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:02.469614 17354 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:02.498353 17239 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:02.526275 13233 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:05:02.500604 17403 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
W20260709 13:05:02.542251 17480 log.cc:927] Time spent T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:05:02.526310 17156 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:02.558691 17156 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:02.530104 17473 consensus_queue.cc:1059] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:05:02.560216 17156 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:02.560889 17473 raft_consensus.cc:3055] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:02.561352 17473 raft_consensus.cc:740] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:02.562251 17473 consensus_queue.cc:260] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.566895 17504 consensus_queue.cc:1059] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:02.509661 17427 consensus_queue.cc:237] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.523507 17354 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.527931 17188 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:05:02.593899 17409 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:02.596036 17342 raft_consensus.cc:3055] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:02.596561 17342 raft_consensus.cc:740] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:02.597584 17342 consensus_queue.cc:260] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:02.598892 17342 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:02.603415 17419 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:02.604504 17387 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:02.604609 16672 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:02.609216 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 75913.3us
I20260709 13:05:02.552784 17291 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:02.657423 12588 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.925s (SENT) [suppressed 22 similar messages]
I20260709 13:05:02.659142 17403 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.659929 17416 raft_consensus.cc:3055] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:02.659807 17403 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:02.660338 17416 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:02.667183 12622 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:02.661218 17416 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.14, Last appended by leader: 14, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.692844 17403 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:02.693542 17403 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:02.694173 17403 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.696250 17403 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:02.698302 17354 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:02.672758 17156 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.711426 17156 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:02.712651 17416 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:02.713359 13232 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 985) took 1604 ms (client timeout 1915 ms). Trace:
W20260709 13:05:02.713760 13232 rpcz_store.cc:269] 0709 13:05:01.108611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.110842 (+  2231us) service_pool.cc:224] Handling call
0709 13:05:02.713141 (+1602299us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b5400468554. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:02.713280 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1896382336}
I20260709 13:05:02.714931 13226 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:02.716396 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1187) took 1581 ms. Trace:
I20260709 13:05:02.716720 13226 rpcz_store.cc:276] 0709 13:05:01.135007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.141068 (+  6061us) service_pool.cc:224] Handling call
0709 13:05:02.714765 (+1573697us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:02.715314 (+   549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.716216 (+   902us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b5400468550. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:02.716341 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3618471680}
W20260709 13:05:02.717679 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:02.718382 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.723150 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3048) took 2435 ms. Trace:
I20260709 13:05:02.723663 12544 rpcz_store.cc:276] 0709 13:05:00.296025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.110166 (+814141us) service_pool.cc:224] Handling call
0709 13:05:01.110476 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:01.115978 (+  5502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:01.116007 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:01.116473 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:05:01.321939 (+205466us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:01.360394 (+ 38455us) log.cc:844] Serialized 14 byte log entry
0709 13:05:02.051089 (+690695us) spinlock_profiling.cc:243] Waited 62.3 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:02.722671 (+671582us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b18002b5400. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a6406c0a 00007fc3afb46219 00007fc3a648ea40 00007fc3a64894e4 00007fc3a6489455 00007fc3a9571060 00007fc3a9583716 00007fc3a9594287 00007fc3a9594208
0709 13:05:02.722836 (+   165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.722913 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:02.722950 (+    37us) raft_consensus.cc:1685] finished
0709 13:05:02.722963 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.723093 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9488,"prepare.queue_time_us":40640,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":7676,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":6314,"spinlock_wait_cycles":149950592,"thread_start_us":154124,"threads_started":1,"wal-append.queue_time_us":325405}
I20260709 13:05:02.726132 17411 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.726346 17031 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:02.726455 17458 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:02.726979 17031 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:02.727200 17458 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.729377 17458 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:02.730261 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3054) took 2432 ms. Trace:
I20260709 13:05:02.730685 12541 rpcz_store.cc:276] 0709 13:05:00.297896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.039514 (+741618us) service_pool.cc:224] Handling call
0709 13:05:01.039803 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:01.061363 (+ 21560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:01.061410 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:01.061976 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 13:05:01.169660 (+107684us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:01.169697 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.729850 (+1560153us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b54000a5fd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:02.729905 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:02.729970 (+    65us) raft_consensus.cc:1685] finished
0709 13:05:02.729981 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.730204 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48806656,"thread_start_us":92320,"threads_started":1,"wal-append.queue_time_us":180956,"wal-append.run_cpu_time_us":1948,"wal-append.run_wall_time_us":1040600}
I20260709 13:05:02.731767 17403 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:02.732383 17403 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.733418 17447 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.734100 17417 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:02.733934 17447 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.734552 17403 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:02.734639 17417 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:02.736145 17447 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:02.736716 17462 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 1.065s	user 0.003s	sys 0.000s
I20260709 13:05:02.733901 17291 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:02.737443 17411 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.738570 17352 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:02.739387 17352 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:02.741380 12618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 2004) took 1421 ms (client timeout 1526 ms). Trace:
I20260709 13:05:02.741719 17443 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:05:02.741878 12618 rpcz_store.cc:269] 0709 13:05:01.319904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.320714 (+   810us) service_pool.cc:224] Handling call
0709 13:05:02.741212 (+1420498us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b54002a6cd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:02.741324 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1089751296}
I20260709 13:05:02.742594 17352 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:02.743013 17338 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.743506 17338 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.742416 17443 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:02.740176 17411 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:02.778337 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:02.778748 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1056) took 1743 ms. Trace:
I20260709 13:05:02.779071 12691 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
W20260709 13:05:02.751873 12510 connection.cc:256] RPC call timeout handler was delayed by -1.3307732529999612s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22440000000000004s for a response
I20260709 13:05:02.750753 12622 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:05:02.751695 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:02.782199 12696 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:02.782325 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1162) took 1038 ms. Trace:
I20260709 13:05:02.757310 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:02.784040 12620 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:02.757282 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:02.784106 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:02.783032 12622 rpcz_store.cc:276] 0709 13:05:01.743499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.746434 (+  2935us) service_pool.cc:224] Handling call
0709 13:05:01.746725 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:02.663388 (+916663us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b58003aa6d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a94d50aa 00007fc3a9557447 00007fc3a956ffe7 00007fc3a95717de 00007fc3a957bb49 00007fc3a957c416 00007fc3a9578d8f 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4
0709 13:05:02.782040 (+118652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.782273 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1556132096}
I20260709 13:05:02.779637 12546 rpcz_store.cc:276] 0709 13:05:01.035373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.211086 (+1175713us) service_pool.cc:224] Handling call
0709 13:05:02.228864 (+ 17778us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:02.229129 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:05:02.253890 (+ 24761us) log.cc:844] Serialized 14 byte log entry
0709 13:05:02.778269 (+524379us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:02.778344 (+    75us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:02.778393 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.778492 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.778667 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":369090,"prepare.queue_time_us":150066,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"spinlock_wait_cycles":44416,"thread_start_us":161055,"threads_started":2,"wal-append.queue_time_us":181010}
I20260709 13:05:02.790328 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:02.790585 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:02.791065 12693 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:05:02.791239 13233 raft_consensus.cc:2393] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 13: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:02.791545 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:02.794027 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:02.736857 17417 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:02.805313 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:02.805361 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:02.807495 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:02.817901 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:02.818466 12690 raft_consensus.cc:2393] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 16: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:02.814280 17441 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.736750 17447 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:02.819295 17441 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.819527 17447 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:02.815162 17404 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.816799 17440 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:02.825151 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:02.783478 17156 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:02.796659 17369 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:05:02.822144 17404 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:02.798362 17241 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.858433 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:02.859447 12693 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:05:02.856732 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3046) took 2569 ms. Trace:
I20260709 13:05:02.862921 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:02.828238 17425 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.821435 17447 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:02.828728 17291 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:02.868748 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:02.821457 17441 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:02.872951 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:02.861460 12545 rpcz_store.cc:276] 0709 13:05:00.287083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.065414 (+778331us) service_pool.cc:224] Handling call
0709 13:05:01.065780 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:01.066011 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:01.066038 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:01.070999 (+  4961us) log.cc:844] Serialized 26 byte log entry
0709 13:05:01.326458 (+255459us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:01.368221 (+ 41763us) log.cc:844] Serialized 14 byte log entry
0709 13:05:02.856361 (+1488140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:02.856446 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:02.856491 (+    45us) raft_consensus.cc:1685] finished
0709 13:05:02.856504 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:02.856666 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1393346,"prepare.queue_time_us":41615,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":1357823,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":85,"thread_start_us":311271,"threads_started":2,"wal-append.queue_time_us":567759,"wal-append.run_cpu_time_us":2209,"wal-append.run_wall_time_us":1132647}
I20260709 13:05:02.876765 17338 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:02.878268 17404 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:02.880255 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.874137 12693 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
W20260709 13:05:02.881546 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.883214 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:02.884960 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:02.885211 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:02.885795 12696 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:02.840011 17440 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:02.887792 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:02.888010 12510 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:02.888517 13235 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:02.887055 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:02.890949 13230 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:02.892769 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:02.866851 17241 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:02.900840 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:02.868625 17127 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:05:02.862536 17156 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:02.870471 17425 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:02.913146 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:02.915071 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:02.913806 17241 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:02.911561 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:02.915726 13226 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:05:02.919747 12620 raft_consensus.cc:2410] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:05:02.913656 13230 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:02.890573 17291 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.918665 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:02.932461 17476 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.933022 17476 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.933727 17486 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:02.934437 17486 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:02.935850 17476 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:02.936141 17425 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:02.937410 17443 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:02.938511 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:02.936419 17486 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:02.936408 17476 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:02.941896 17476 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:02.942523 17440 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:02.943821 17489 log.cc:927] Time spent T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.528s	user 0.001s	sys 0.001s
I20260709 13:05:02.945010 17476 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:02.954061 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:02.969229 13199 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:02.970330 17127 consensus_queue.cc:1059] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:05:02.968629 16989 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:02.974856 16989 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.977164 16989 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:02.977888 13199 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:02.982228 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:02.983218 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:02.982381 13200 connection.cc:256] RPC call timeout handler was delayed by -1.1251232790000358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
I20260709 13:05:02.971436 17031 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:02.988569 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:02.991724 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:02.989583 17291 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:01.648746 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:02.990813 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:03.007076 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:03.010941 17364 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:03.012624 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:03.012804 16992 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:03.012933 17520 raft_consensus.cc:3055] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:03.015242 17520 raft_consensus.cc:740] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:03.016139 17520 consensus_queue.cc:260] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.017431 17520 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:03.018442 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.021878 13231 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 11 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 13:05:03.040910 16989 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:02.978785 17156 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:02.991257 17413 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:03.046650 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:03.050174 17031 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:02.997815 17387 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:03.061666 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 77503us
I20260709 13:05:03.062407 13200 leader_election.cc:400] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14.
I20260709 13:05:03.063066 13200 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:03.099510 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.109493 17413 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:03.110404 17467 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:03.110666 17413 consensus_queue.cc:1243] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer a70479a3b4114f3581095e9890f5d653 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:05:03.111891 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3047) took 2824 ms. Trace:
I20260709 13:05:03.114390 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1713) took 1834 ms. Trace:
I20260709 13:05:03.114820 12542 rpcz_store.cc:276] 0709 13:05:01.280287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.228528 (+948241us) service_pool.cc:224] Handling call
0709 13:05:02.228859 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:02.273636 (+ 44777us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:03.114065 (+840429us) spinlock_profiling.cc:243] Waited 44 ms on lock 0x7b54002ba554. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:03.114318 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101312000}
I20260709 13:05:03.103430 16989 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:03.116931 16989 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:03.117305 16989 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:03.139561 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:03.140283 12617 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:05:03.112296 12547 rpcz_store.cc:276] 0709 13:05:00.287307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:00.565043 (+277736us) service_pool.cc:224] Handling call
0709 13:05:00.565523 (+   480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:00.622660 (+ 57137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:00.622720 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:00.649517 (+ 26797us) log.cc:844] Serialized 26 byte log entry
0709 13:05:01.841975 (+1192458us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b180023e060. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:05:02.035420 (+193445us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:02.225755 (+190335us) log.cc:844] Serialized 14 byte log entry
0709 13:05:02.746024 (+520269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:03.111520 (+365496us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b54003aaa54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:03.111575 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:03.111621 (+    46us) raft_consensus.cc:1685] finished
0709 13:05:03.111635 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:03.111806 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":556630,"prepare.queue_time_us":335670,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":591472,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":13815,"spinlock_wait_cycles":86238336,"thread_start_us":355240,"threads_started":2,"wal-append.queue_time_us":1485749}
I20260709 13:05:03.146386 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:03.147344 12615 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
W20260709 13:05:03.148504 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 106459us
I20260709 13:05:03.060631 17387 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:03.150522 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 172765us
I20260709 13:05:03.151921 13199 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:03.159373 17387 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:03.179134 16989 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:03.182893 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.184449 17356 raft_consensus.cc:3055] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:03.182581 17387 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:03.191996 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:03.195425 17527 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:03.186415 17467 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:05:03.198558 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.187896 17172 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.198925 13199 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:03.188860 17356 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:03.199728 12662 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:03.201298 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 95527.2us
I20260709 13:05:03.203912 12662 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:03.196117 17527 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:03.207448 13235 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:03.207666 12662 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:03.212888 16989 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:03.198741 17428 consensus_queue.cc:1059] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:05:03.198513 17387 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.201821 17467 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:03.201126 17525 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:03.213483 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:03.205456 17419 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:03.237974 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 350031us
W20260709 13:05:03.290683 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 77283.5us
I20260709 13:05:03.235567 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 850) took 1634 ms. Trace:
I20260709 13:05:03.230597 12512 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:03.234941 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3049) took 2938 ms. Trace:
W20260709 13:05:03.286039 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 87475.1us
W20260709 13:05:03.339865 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:03.289696 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 87582.9us
I20260709 13:05:03.263414 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3055) took 1994 ms. Trace:
I20260709 13:05:03.343745 13199 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:03.344434 12510 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
W20260709 13:05:03.346287 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:03.347060 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 116573us
I20260709 13:05:03.347939 12512 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:03.345044 12539 rpcz_store.cc:276] 0709 13:05:01.269407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.206184 (+936777us) service_pool.cc:224] Handling call
0709 13:05:02.206630 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:02.745779 (+539149us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:02.777991 (+ 32212us) log.cc:844] Serialized 14 byte log entry
0709 13:05:03.213181 (+435190us) spinlock_profiling.cc:243] Waited 6.77 ms on lock 0x7b18003f16c0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a6406c0a 00007fc3afb46219 00007fc3ad44d58f 00007fc3a648c571 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd
0709 13:05:03.236149 (+ 22968us) log.cc:844] Serialized 14 byte log entry
0709 13:05:03.236320 (+   171us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:03.236785 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 13:05:03.236916 (+   131us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:03.237078 (+   162us) log.cc:844] Serialized 14 byte log entry
0709 13:05:03.237224 (+   146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:03.237404 (+   180us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:03.263090 (+ 25686us) raft_consensus.cc:1685] finished
0709 13:05:03.263120 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:03.263331 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":867055,"prepare.queue_time_us":32191,"raft.queue_time_us":888412,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":10314,"spinlock_wait_cycles":41116032,"thread_start_us":132361,"threads_started":1,"wal-append.queue_time_us":158601}
I20260709 13:05:03.347956 12510 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:03.342478 13228 rpcz_store.cc:276] 0709 13:05:01.600766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:01.846936 (+246170us) service_pool.cc:224] Handling call
0709 13:05:01.847463 (+   527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:01.848010 (+   547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:01.848054 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:03.034727 (+1186673us) spinlock_profiling.cc:243] Waited 78.7 ms on lock 0x7b2c0004cc08. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:05:03.045273 (+ 10546us) log.cc:844] Serialized 26 byte log entry
0709 13:05:03.185722 (+140449us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:03.185781 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:03.186192 (+   411us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:03.235253 (+ 49061us) raft_consensus.cc:1685] finished
0709 13:05:03.235274 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:03.235501 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4464,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"spinlock_wait_cycles":181034240,"thread_start_us":119739,"threads_started":1,"wal-append.queue_time_us":149634}
I20260709 13:05:03.234330 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:03.355732 13232 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:03.343243 12543 rpcz_store.cc:276] 0709 13:05:00.296360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.040663 (+1744303us) service_pool.cc:224] Handling call
0709 13:05:02.045456 (+  4793us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:02.743332 (+697876us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:02.743362 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:02.743888 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 13:05:02.852269 (+108381us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:02.876326 (+ 24057us) log.cc:844] Serialized 14 byte log entry
0709 13:05:03.234578 (+358252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:03.234669 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:03.234726 (+    57us) raft_consensus.cc:1685] finished
0709 13:05:03.234742 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:03.234882 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1035767,"prepare.queue_time_us":26715,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":31,"raft.queue_time_us":1037642,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":215,"thread_start_us":107978,"threads_started":1,"wal-append.queue_time_us":145664}
I20260709 13:05:03.240921 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3058) took 1968 ms. Trace:
I20260709 13:05:03.207290 17418 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:03.354841 12512 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:03.363036 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 130878us
I20260709 13:05:03.213701 17352 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:03.356773 12540 rpcz_store.cc:276] 0709 13:05:01.273004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.223154 (+950150us) service_pool.cc:224] Handling call
0709 13:05:02.223590 (+   436us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:02.744799 (+521209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:02.744832 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:02.745542 (+   710us) log.cc:844] Serialized 52 byte log entry
0709 13:05:02.922543 (+177001us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:02.947799 (+ 25256us) log.cc:844] Serialized 14 byte log entry
0709 13:05:03.240281 (+292482us) log.cc:844] Serialized 14 byte log entry
0709 13:05:03.240507 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:03.240582 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:03.240625 (+    43us) raft_consensus.cc:1685] finished
0709 13:05:03.240637 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:03.240867 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":832038,"prepare.queue_time_us":16614,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":816254,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":12922,"thread_start_us":176621,"threads_started":1,"wal-append.queue_time_us":193783}
I20260709 13:05:03.206038 17527 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:03.364375 12512 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:03.243517 17417 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:03.238085 17514 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:03.233888 17531 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:03.231119 17402 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:03.269944 17404 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.381582 17404 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.374193 17418 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.371869 17364 consensus_queue.cc:1059] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:05:03.203545 17172 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.384109 17404 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:03.385438 17467 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:03.386696 17172 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:03.368955 12513 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:03.388690 12513 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:03.389885 12513 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:03.390645 16672 raft_consensus.cc:3055] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:03.391213 16672 raft_consensus.cc:740] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:03.232854 17447 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:03.392275 17447 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.369220 17460 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:05:03.395702 17447 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:03.392409 16672 consensus_queue.cc:260] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.396340 17447 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:03.396836 16672 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:03.233621 17398 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:03.322693 17354 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:03.398329 17466 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:03.398072 17398 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:03.400241 17398 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:03.400730 17398 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:03.401162 17398 raft_consensus.cc:697] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:03.252961 17443 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:03.401965 17443 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:03.402033 17398 consensus_queue.cc:237] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.404263 17443 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:03.405050 17342 raft_consensus.cc:3055] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:03.242472 12659 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:03.357613 17338 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:03.361147 17414 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:03.375010 16989 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:03.253062 17532 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.119s
I20260709 13:05:03.375528 17241 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:03.455830 17241 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:03.456238 17241 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:03.456677 17473 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:03.382911 17418 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:03.397048 17447 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:03.461755 17447 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.462296 17447 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:05:03.462572 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.464728 17366 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:03.289116 17525 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:03.465227 17366 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.465793 17525 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:03.467319 17366 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:03.230870 17353 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:03.423393 17363 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:03.471249 17418 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:03.357389 17458 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:03.473920 17458 raft_consensus.cc:697] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:03.474898 17458 consensus_queue.cc:237] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.433271 17402 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:03.478371 17402 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:03.364902 17440 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:03.479147 17440 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.478963 17241 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.479518 17440 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:03.357776 17515 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:05:03.453608 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 211195us
I20260709 13:05:03.488727 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:03.489845 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:03.490499 12622 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:03.491441 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:03.491711 12617 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:03.492195 12621 raft_consensus.cc:2368] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 10. Current term is 11.
I20260709 13:05:03.453986 12510 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:03.214937 17427 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.164s
I20260709 13:05:03.235865 17356 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.482035 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:03.453243 17338 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:03.493309 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:03.522346 12690 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:05:03.493966 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:03.495373 12687 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:03.495882 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:03.496726 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:03.482455 16672 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:03.378557 17417 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:03.507061 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:03.530174 12621 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
W20260709 13:05:03.498862 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 124133us
I20260709 13:05:03.523783 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:03.531042 12692 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:03.531563 12689 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:05:03.531620 13197 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:03.524438 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 160024us
W20260709 13:05:03.525199 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 151143us
I20260709 13:05:03.524712 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:03.442284 17342 raft_consensus.cc:740] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:03.524507 12688 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:03.524717 17338 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:05:03.528183 12662 leader_election.cc:336] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.563s (SENT)
I20260709 13:05:03.528288 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:03.534840 12512 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:03.455325 16989 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:03.538862 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 167007us
I20260709 13:05:03.539624 12510 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:03.482483 17515 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:03.535827 12662 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:03.541787 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:03.469367 17353 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.548049 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:03.535929 13199 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:03.546855 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:03.526934 16672 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.556038 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:05:03.556989 17528 log.cc:927] Time spent T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.520s	user 0.005s	sys 0.000s
I20260709 13:05:03.547513 17515 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:03.558724 17525 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.560897 17525 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:03.561655 16672 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:03.553216 17402 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:03.562471 17402 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:03.562912 17402 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:03.570967 17417 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:03.574460 17447 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.575512 17398 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:03.551221 17485 consensus_queue.cc:1059] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:05:03.580077 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:03.580997 17485 raft_consensus.cc:3055] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:03.581463 17485 raft_consensus.cc:740] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:03.581799 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:03.575824 16672 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:03.583076 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:03.580727 17515 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.584242 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:03.548712 17414 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:03.584131 12696 raft_consensus.cc:2393] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 11: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:03.584889 12695 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:05:03.591524 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:03.555811 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:03.588496 12510 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:03.592015 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:03.537616 17514 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:03.542618 17535 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:03.555780 17466 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:03.592198 12690 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:03.542374 16989 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:03.592612 12547 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:05:03.593701 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:03.594426 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:03.595131 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:03.670924 12541 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:03.595222 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:03.545823 17356 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:03.613732 17535 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.553485 17189 consensus_queue.cc:1059] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.107s
W20260709 13:05:03.693179 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 143824us
I20260709 13:05:03.603528 13228 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:03.605057 17534 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:03.607911 17533 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.608587 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:03.709631 13229 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:03.610097 12542 raft_consensus.cc:1240] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:03.611686 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:03.608579 13226 raft_consensus.cc:1240] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:03.612601 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:03.650344 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 51430.8us
I20260709 13:05:03.712541 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:03.714100 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:03.714747 12543 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:03.647861 16672 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:03.652983 12693 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:03.585304 17407 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:03.734249 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:03.657459 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:03.659761 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.582235 17398 raft_consensus.cc:697] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:03.597036 17417 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:05:03.751566 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 145721us
I20260709 13:05:03.702196 17535 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:03.591187 17414 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:03.678066 12545 raft_consensus.cc:2393] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 11: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:03.611133 17404 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:05:03.599500 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 44522us
I20260709 13:05:03.596946 17387 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:03.692233 12687 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:05:03.601605 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:03.693223 12587 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:03.652037 17514 raft_consensus.cc:697] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 11 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:03.666121 17399 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.675983 12538 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:03.755373 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:05:03.748116 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 44874.5us
I20260709 13:05:03.796411 12659 leader_election.cc:400] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 10. Current term is 11.
I20260709 13:05:03.796906 12659 leader_election.cc:403] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:03.746905 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:03.766023 13227 raft_consensus.cc:2393] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:03.771533 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:03.799465 13230 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:03.799963 12541 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:05:03.801065 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:03.803114 12547 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
W20260709 13:05:03.804419 12662 leader_election.cc:336] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.545s (SENT)
I20260709 13:05:03.805027 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:03.806475 16672 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:03.647876 17342 consensus_queue.cc:260] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.822152 13199 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:03.810871 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 117743us
I20260709 13:05:03.825408 12587 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:03.717684 17441 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:03.582547 17485 consensus_queue.cc:260] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.837924 12543 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:03.750902 17518 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:03.840431 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:03.842617 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.790373 17414 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:03.709242 17533 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:03.868237 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:03.871639 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 49613.9us
I20260709 13:05:03.873194 13199 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:03.876528 17514 consensus_queue.cc:237] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:03.880658 17413 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:03.863632 17518 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:03.883085 17518 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:03.889426 17398 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.832633 17223 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:03.717351 17534 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.881296 12695 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:03.914134 13199 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:03.908659 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.831292 12659 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:03.916028 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 84832.6us
I20260709 13:05:03.901479 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:03.910406 12513 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:03.917649 17504 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.920838 17127 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:03.921281 17127 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.921476 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:03.921790 17127 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:03.922716 17518 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:03.925146 17533 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:03.864162 17427 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.925817 17427 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:03.927661 17404 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:03.928205 17404 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.929152 17488 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:03.929733 17488 raft_consensus.cc:697] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 13 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:03.930364 17404 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:03.930954 17534 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:03.930624 17488 consensus_queue.cc:237] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.933607 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:03.933941 12693 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:03.934233 12622 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:03.934386 17127 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.921336 17460 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:03.936420 17127 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:03.936458 17460 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.937086 17460 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:03.937793 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:03.938395 12696 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:03.939616 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:03.940106 17402 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.940887 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:03.943954 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:03.944857 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:03.945104 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:03.902909 17418 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:03.946398 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:03.946221 17418 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:03.946972 12694 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:03.947327 12690 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:05:03.928158 17427 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:03.941709 17156 raft_consensus.cc:3055] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:03.950063 17156 raft_consensus.cc:740] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:03.950954 17156 consensus_queue.cc:260] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.943302 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:03.952682 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:03.953239 12689 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:05:03.917553 17387 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 10. Current term is 11.
I20260709 13:05:03.954125 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:03.954672 12689 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:03.954787 17404 consensus_queue.cc:1059] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:03.955690 12696 raft_consensus.cc:2393] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 11: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:03.921140 17504 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.957141 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:03.943532 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:03.957741 17504 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:03.958869 12620 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 12 index: 14. Preceding OpId from leader: term: 13 index: 14. (term mismatch)
I20260709 13:05:03.959213 12620 pending_rounds.cc:85] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 13
I20260709 13:05:03.959461 12620 pending_rounds.cc:107] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 12.14
I20260709 13:05:03.959726 12620 raft_consensus.cc:2889] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:03.959890 17156 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:03.962056 17417 raft_consensus.cc:3055] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:03.962587 17417 raft_consensus.cc:740] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:03.941210 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:03.942045 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:03.963961 13233 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:03.963567 17417 consensus_queue.cc:260] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:03.964870 17417 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:03.965027 13233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 993) took 1082 ms. Trace:
I20260709 13:05:03.965349 12512 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:03.966557 17404 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:03.966991 17404 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:03.967406 17404 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:03.967634 17414 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:03.969340 17353 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:03.973335 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:03.919593 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:03.976455 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:03.867501 17241 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:03.981815 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 67830.9us
I20260709 13:05:03.844080 17189 consensus_queue.cc:1059] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:05:03.965507 13233 rpcz_store.cc:276] 0709 13:05:02.882569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:02.882943 (+   374us) service_pool.cc:224] Handling call
0709 13:05:03.964873 (+1081930us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54005794d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:03.964973 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2482785152}
W20260709 13:05:03.971112 17536 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 13:05:03.979640 12622 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:05:03.978428 13234 raft_consensus.cc:1275] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:05:03.980726 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 71733.2us
I20260709 13:05:03.977380 12614 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:05:03.983232 13199 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:03.903100 17342 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:03.949358 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:03.986999 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:03.903354 17223 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:03.993741 12546 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:03.978124 12689 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:04.002096 12513 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:03.835837 17399 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.844457 17441 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:03.976316 17414 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:04.004478 17413 raft_consensus.cc:697] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:04.021876 16672 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:04.022384 16672 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:04.014775 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:04.017792 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:04.023531 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.023973 12620 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:04.024372 16672 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:04.020620 17127 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:04.022234 17413 consensus_queue.cc:237] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:04.024736 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.026357 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.026700 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.026886 12543 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:04.027748 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.027825 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:04.028422 12543 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:04.028849 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:04.029214 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.029790 12543 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:05:04.030215 17402 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:04.030826 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.031845 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.032368 12543 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:04.032934 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:04.033143 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.024778 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:04.034139 12538 raft_consensus.cc:2368] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 10. Current term is 11.
I20260709 13:05:04.014290 13199 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:03.992097 17395 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:04.053552 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:03.994665 17223 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:04.056644 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:04.058452 12695 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:04.062049 12614 raft_consensus.cc:2410] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:05:04.015900 17241 raft_consensus.cc:2764] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:05:04.082054 17418 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:04.082947 12546 raft_consensus.cc:2376] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16. Re-sending same reply.
I20260709 13:05:04.074890 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:04.075160 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:04.085863 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:04.086422 12687 raft_consensus.cc:2393] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 15: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:03.999342 17366 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
W20260709 13:05:04.076423 17473 consensus_meta.cc:287] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.000s
I20260709 13:05:04.087949 17520 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:04.088402 17520 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.088762 17520 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:04.085893 12538 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:04.037612 17515 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:04.074898 13197 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:04.077328 17535 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:04.078003 17440 consensus_meta.cc:287] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.596s	user 0.010s	sys 0.000s
I20260709 13:05:04.105161 12694 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
W20260709 13:05:04.112246 17338 consensus_meta.cc:287] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.575s	user 0.006s	sys 0.004s
I20260709 13:05:04.112802 17338 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:04.115897 12547 raft_consensus.cc:2393] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 11: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:04.100113 17518 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:05:04.132845 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.110049 17440 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:04.139920 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.141322 12538 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:05:04.164703 12540 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 13: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:04.168435 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.139933 17338 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:04.181629 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 345077us
W20260709 13:05:04.184665 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 359358us
I20260709 13:05:04.185091 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:04.186803 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:04.188088 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:04.189278 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:04.190748 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:04.192554 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:04.198885 13227 raft_consensus.cc:2368] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14.
I20260709 13:05:04.200317 12587 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:04.198861 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:04.225137 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 342682us
W20260709 13:05:04.249140 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 50376.7us
I20260709 13:05:04.175884 17447 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:04.175426 17525 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:04.208513 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:04.216452 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:05:04.232863 17527 consensus_meta.cc:287] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.855s	user 0.011s	sys 0.000s
I20260709 13:05:04.147120 16989 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:04.209486 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:04.249404 13200 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:04.208846 12587 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:04.249944 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:04.251449 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:04.216917 17156 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:04.265415 12542 raft_consensus.cc:2376] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14. Re-sending same reply.
I20260709 13:05:04.265900 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:04.255777 13232 raft_consensus.cc:2393] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 11: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:04.233822 17399 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:04.267161 12588 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:04.264801 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 56389.9us
I20260709 13:05:04.267913 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.252238 17473 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:04.268901 12542 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:05:04.234889 17097 consensus_queue.cc:1059] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:05:04.217150 17460 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:04.469925 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 202834us
I20260709 13:05:04.302964 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:04.470840 12542 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:04.471405 12588 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:05:04.459568 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 190785us
W20260709 13:05:04.460404 12662 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.016s	sys 0.028s
I20260709 13:05:04.217967 17554 consensus_queue.cc:1059] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
W20260709 13:05:04.473188 12662 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.016s	sys 0.028s
W20260709 13:05:04.483500 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 668046us
I20260709 13:05:04.459453 17426 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:04.459645 17488 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:04.258293 17525 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:04.513510 12696 raft_consensus.cc:2368] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 14. Current term is 15.
I20260709 13:05:04.468824 17504 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:04.277976 17550 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:04.483517 17441 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:04.493825 17425 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:04.485749 17535 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:04.543959 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:04.544868 12541 raft_consensus.cc:2376] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10. Re-sending same reply.
I20260709 13:05:04.523607 12542 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:05:04.258487 17527 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:04.525677 17548 log.cc:927] Time spent T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 13:05:04.538048 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.514484 17488 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.527403 17504 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.570354 17156 raft_consensus.cc:697] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:04.612489 17504 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:04.597704 16989 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:04.600416 17527 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:04.600983 13235 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:04.571260 17550 raft_consensus.cc:697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:04.613047 17156 consensus_queue.cc:237] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:04.616425 17550 consensus_queue.cc:237] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:04.576803 17488 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:04.603010 17460 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:05:04.604564 17223 consensus_meta.cc:287] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.527s	user 0.007s	sys 0.000s
I20260709 13:05:04.620111 17223 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:04.621129 12618 raft_consensus.cc:1240] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:04.539255 17397 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:04.622485 17397 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:04.622927 17397 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:04.626192 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:04.608511 17520 consensus_meta.cc:287] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.519s	user 0.003s	sys 0.004s
I20260709 13:05:04.608933 17425 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:04.614660 17531 raft_consensus.cc:3055] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:04.615710 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 879) took 1021 ms. Trace:
I20260709 13:05:04.627297 17531 raft_consensus.cc:740] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:04.627709 13235 rpcz_store.cc:276] 0709 13:05:03.593902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.594860 (+   958us) service_pool.cc:224] Handling call
0709 13:05:03.602376 (+  7516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.614061 (+1011685us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.615453 (+  1392us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b5400571a54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:04.615653 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2296115968}
W20260709 13:05:04.609828 17417 consensus_meta.cc:287] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.644s	user 0.010s	sys 0.000s
I20260709 13:05:04.628271 17531 consensus_queue.cc:260] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:04.626981 17425 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:04.629495 17425 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:04.629849 17531 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:04.633792 17520 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:04.635142 12687 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:05:04.638476 12690 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:05:04.635739 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:04.639281 12694 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:05:04.640272 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 1059) took 1049 ms. Trace:
I20260709 13:05:04.640674 12540 rpcz_store.cc:276] 0709 13:05:03.590768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.591207 (+   439us) service_pool.cc:224] Handling call
0709 13:05:04.640048 (+1048841us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54002cc754. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:04.640176 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316165888}
I20260709 13:05:04.636868 12691 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:04.577778 17440 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:04.626834 12545 raft_consensus.cc:2376] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14. Re-sending same reply.
I20260709 13:05:04.644131 12690 raft_consensus.cc:3055] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:04.644507 12690 raft_consensus.cc:740] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:04.645274 12690 consensus_queue.cc:260] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:04.646775 12690 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:04.648152 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:04.650440 17395 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.651005 17395 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:04.652519 12691 raft_consensus.cc:1275] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:04.655248 17520 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:04.655357 17440 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.655956 17440 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:04.637953 17223 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:04.663713 12512 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:04.657436 12694 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:04.658663 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.665716 12540 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:05:04.666658 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:04.667245 12540 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:04.670668 17397 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:04.671762 17440 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:04.672690 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.673430 12546 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:04.674561 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.675462 17397 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:04.676131 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.676867 12546 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:05:04.682543 17425 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:04.612936 17404 consensus_meta.cc:287] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.645s	user 0.010s	sys 0.000s
I20260709 13:05:04.684173 17404 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:04.685511 12544 raft_consensus.cc:2368] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13.
I20260709 13:05:04.653326 17395 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:04.688817 17404 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:04.691433 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.692709 17460 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.693269 17460 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:04.696144 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.697074 12539 raft_consensus.cc:2393] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 12: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:04.697960 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:04.698797 12691 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:04.700544 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:04.701851 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.701601 17504 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:04.702070 12687 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:05:04.702414 12539 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:05:04.703265 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.703511 12512 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:04.704223 17440 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:04.704401 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:04.704842 17440 raft_consensus.cc:2764] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:05:04.705087 12539 raft_consensus.cc:2376] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9. Re-sending same reply.
I20260709 13:05:04.705888 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.705958 12512 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:04.706482 12539 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:05:04.706429 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.706728 17440 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:04.707175 17440 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:04.707345 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:04.707563 17440 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:04.707799 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.708021 12539 raft_consensus.cc:2393] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 11: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:04.708894 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.712291 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:04.712916 12687 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:05:04.708387 12547 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:04.696852 17460 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:04.714355 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.715230 12694 raft_consensus.cc:1240] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:04.714424 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.715946 12538 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 13: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:04.717883 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:04.718302 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.719179 12543 raft_consensus.cc:2410] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:05:04.720575 13235 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:05:04.720713 17520 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:04.721891 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:04.722131 12542 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:04.722143 17520 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:04.724849 17520 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:04.724951 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:04.726181 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:04.726914 13228 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 13: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:04.728190 13231 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:05:04.730370 13231 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:05:04.731050 17488 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:04.732034 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:04.732602 13228 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:04.733089 12692 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:04.733233 17488 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:04.734298 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:04.735064 13233 raft_consensus.cc:2393] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 16: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:04.736224 13199 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:04.722692 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1722) took 1008 ms. Trace:
W20260709 13:05:04.738369 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 267017us
I20260709 13:05:04.738425 12542 rpcz_store.cc:276] 0709 13:05:03.714045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.721720 (+1007675us) service_pool.cc:224] Handling call
0709 13:05:04.721963 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.722483 (+   520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.722643 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:04.739321 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:04.718586 12693 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 13: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:04.745302 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:04.746407 12695 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:04.751756 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.719928 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:04.752664 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:04.761725 12543 raft_consensus.cc:2410] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:05:04.762595 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1731) took 1003 ms. Trace:
I20260709 13:05:04.762995 12543 rpcz_store.cc:276] 0709 13:05:03.759556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.719714 (+960158us) service_pool.cc:224] Handling call
0709 13:05:04.762443 (+ 42729us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:04.764541 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.760483 12546 raft_consensus.cc:1240] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:04.768527 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1723) took 1054 ms. Trace:
I20260709 13:05:04.769331 12542 rpcz_store.cc:276] 0709 13:05:03.714297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.740514 (+1026217us) service_pool.cc:224] Handling call
0709 13:05:04.741154 (+   640us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.766901 (+ 25747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:04.766945 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:04.767012 (+    67us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:04.767068 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.767160 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:04.768290 (+  1130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:04.770242 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1724) took 1055 ms. Trace:
I20260709 13:05:04.770761 12546 rpcz_store.cc:276] 0709 13:05:03.714580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.758678 (+1044098us) service_pool.cc:224] Handling call
0709 13:05:04.758981 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.768278 (+  9297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.769773 (+  1495us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:04.772805 12542 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:05:04.773739 12513 leader_election.cc:400] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14.
W20260709 13:05:04.775025 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.785275 12513 leader_election.cc:403] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:05:04.785583 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1727) took 1070 ms. Trace:
W20260709 13:05:04.786417 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 48347.1us
I20260709 13:05:04.709450 12539 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:05:04.776997 12588 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:04.745326 12512 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:04.764578 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1725) took 1049 ms. Trace:
I20260709 13:05:04.776476 12690 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:05:04.790014 12543 rpcz_store.cc:276] 0709 13:05:03.714815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.763824 (+1049009us) service_pool.cc:224] Handling call
0709 13:05:04.764109 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.764284 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:04.764309 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:04.764350 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:04.764380 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.764430 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:04.764529 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:04.791033 12690 pending_rounds.cc:85] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 9
I20260709 13:05:04.791471 12690 pending_rounds.cc:107] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:05:04.791991 12690 raft_consensus.cc:2889] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:04.784368 12691 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:05:04.794724 12543 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:04.786093 12542 rpcz_store.cc:276] 0709 13:05:03.715290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.771372 (+1056082us) service_pool.cc:224] Handling call
0709 13:05:04.771788 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.784971 (+ 13183us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.785446 (+   475us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:04.775206 13199 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:05:04.796125 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 46568.8us
I20260709 13:05:04.783242 12547 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:04.798914 12542 raft_consensus.cc:1240] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: []
W20260709 13:05:04.780834 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 255671us
I20260709 13:05:04.800701 13228 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
W20260709 13:05:04.801990 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 56736.5us
I20260709 13:05:04.802379 12540 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:04.802961 12512 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:04.807106 12546 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:05:04.808066 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1729) took 1062 ms. Trace:
I20260709 13:05:04.809839 12546 rpcz_store.cc:276] 0709 13:05:03.745508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.772473 (+1026965us) service_pool.cc:224] Handling call
0709 13:05:04.806663 (+ 34190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.807759 (+  1096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.808005 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:04.808571 13229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.025s	sys 0.029s
W20260709 13:05:04.812441 13229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.025s	sys 0.029s
W20260709 13:05:04.811144 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:04.813761 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.814976 12546 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
W20260709 13:05:04.816229 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:04.818596 12512 leader_election.cc:400] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 14. Current term is 15.
I20260709 13:05:04.818958 12512 leader_election.cc:403] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:05:04.820958 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 44032us
I20260709 13:05:04.821795 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:04.775880 17551 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:04.783572 16992 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:04.831660 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:04.829978 12588 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:04.842309 12588 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:04.843140 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:04.845494 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:04.800410 17404 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:04.737852 17363 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 13:05:04.818428 17127 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:04.820890 17443 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:04.827935 17398 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:04.850876 12588 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:04.852103 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:04.867166 12659 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:04.830598 17458 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:04.863631 13199 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:04.869257 12659 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:04.870062 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:04.870150 12588 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:04.832264 17551 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.830113 17567 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:04.850042 17554 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:04.856246 17427 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:04.852877 17488 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:04.855391 17466 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:04.857103 17424 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:04.852557 17031 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:04.879036 12588 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:04.820472 17441 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:05:04.874606 17395 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:04.880347 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:04.880535 12616 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:04.871739 17223 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:04.876263 16992 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:04.874639 17399 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:04.877966 17387 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:04.886905 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:04.888204 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:04.820767 17515 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:05:04.820990 17241 consensus_queue.cc:1048] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:05:04.876905 16672 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:04.872522 17443 raft_consensus.cc:697] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:04.902837 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1730) took 1152 ms. Trace:
I20260709 13:05:04.827488 17447 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.045s
W20260709 13:05:04.906527 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 433996us
I20260709 13:05:04.864596 17127 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:04.901101 17404 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14.
W20260709 13:05:04.924762 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 51221.6us
I20260709 13:05:04.875639 17398 raft_consensus.cc:697] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 11 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:04.894505 17554 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:04.938791 12615 raft_consensus.cc:2410] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:05:04.908699 17567 raft_consensus.cc:697] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:04.929777 17399 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:04.871270 12662 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:04.920102 17466 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:04.931514 17395 raft_consensus.cc:697] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:04.942533 12544 rpcz_store.cc:276] 0709 13:05:03.750818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.085608 (+334790us) service_pool.cc:224] Handling call
0709 13:05:04.902632 (+817024us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b54002bb454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:04.902775 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1377205120}
I20260709 13:05:04.923197 17031 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:04.923607 17424 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:04.946463 17447 consensus_queue.cc:1243] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:05:05.007769 17424 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:04.947630 12542 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:05.009128 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:05.009675 17425 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:05.009814 12693 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:05.012653 17504 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:04.950628 17127 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:05.004037 17399 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:05.013927 17443 consensus_queue.cc:237] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.015903 17398 consensus_queue.cc:237] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.017060 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:04.948872 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:04.895262 17172 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:04.969597 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:05.026043 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:05.027077 12622 raft_consensus.cc:2368] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14.
I20260709 13:05:05.027284 12693 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:05.028263 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:05.029060 12622 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:04.972375 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1184) took 1056 ms. Trace:
I20260709 13:05:05.030638 12618 rpcz_store.cc:276] 0709 13:05:03.916387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.916510 (+   123us) service_pool.cc:224] Handling call
0709 13:05:03.949019 (+ 32509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.621468 (+672449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.972039 (+350571us) spinlock_profiling.cc:243] Waited 672 ms on lock 0x7b54001054d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:04.972296 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1545317248}
I20260709 13:05:04.978425 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 880) took 1221 ms. Trace:
I20260709 13:05:04.979585 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1211) took 1371 ms. Trace:
I20260709 13:05:04.938138 17156 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:05.032488 13229 rpcz_store.cc:276] 0709 13:05:03.757041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.757729 (+   688us) service_pool.cc:224] Handling call
0709 13:05:03.758080 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:03.773936 (+ 15856us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:05:04.267995 (+494059us) log.cc:844] Serialized 14 byte log entry
0709 13:05:04.813063 (+545068us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:04.813134 (+    71us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:04.813199 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.978097 (+164898us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b54001dfe54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:04.978169 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:04.978348 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":406643,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":129,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":116,"spinlock_wait_cycles":35873152,"thread_start_us":977001,"threads_started":2,"wal-append.queue_time_us":742199}
I20260709 13:05:04.878731 17551 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:05.043092 13197 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:04.942293 16992 raft_consensus.cc:697] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:05.006034 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:04.944716 17387 raft_consensus.cc:697] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:05.006608 17466 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:04.929570 17223 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:04.994753 17554 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:05.033878 13226 rpcz_store.cc:276] 0709 13:05:03.608550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.734093 (+125543us) service_pool.cc:224] Handling call
0709 13:05:03.734542 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:03.929313 (+194771us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:05:04.226857 (+297544us) log.cc:844] Serialized 14 byte log entry
0709 13:05:04.531901 (+305044us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:04.531954 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:04.532005 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:04.979311 (+447306us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54007c38d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:04.979370 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:04.979518 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40481,"prepare.queue_time_us":251525,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":52059,"spinlock_wait_cycles":458171008,"thread_start_us":559439,"threads_started":2,"wal-append.queue_time_us":620391}
I20260709 13:05:04.927904 17353 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 13:05:05.065357 12538 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
W20260709 13:05:05.071727 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 247304us
W20260709 13:05:05.078289 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 207058us
I20260709 13:05:05.131565 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:05.133092 12662 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:05.136849 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 190038us
W20260709 13:05:05.137838 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 243055us
I20260709 13:05:05.020522 17031 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:05.029838 17172 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:05.119478 13197 leader_election.cc:400] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14.
I20260709 13:05:05.145653 13197 leader_election.cc:403] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:05:05.042114 17504 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.140573 12512 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:05.144861 16672 raft_consensus.cc:697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:05.140583 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3068) took 1251 ms. Trace:
W20260709 13:05:05.154747 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 85067.9us
I20260709 13:05:05.156379 17397 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:05.156025 17504 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.159134 16672 consensus_queue.cc:237] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:05.102203 17097 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:05.157436 12622 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:05:05.019322 17567 consensus_queue.cc:237] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:05.176288 12662 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:05.156266 17565 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:05.172510 13197 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:05.141363 17568 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:05.142535 17488 raft_consensus.cc:697] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:05.181402 12512 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:05.151290 17172 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:05.151916 17447 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:05:05.200891 17387 consensus_queue.cc:237] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.202103 17223 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:05.202701 17488 consensus_queue.cc:237] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:05.202881 17584 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:05.203748 17425 consensus_queue.cc:1059] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:05.207813 12615 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:05:05.243726 12615 pending_rounds.cc:85] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 10
I20260709 13:05:05.244251 12615 pending_rounds.cc:107] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:05:05.244637 12615 raft_consensus.cc:2889] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:05.167050 17427 raft_consensus.cc:697] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:05.171437 17241 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:05:05.232317 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 195039us
I20260709 13:05:05.211887 17097 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:05:05.250281 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 91333us
I20260709 13:05:05.214270 17485 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:05.214478 17398 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:05.227614 17418 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:05.185523 17520 consensus_queue.cc:1059] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 13:05:05.255882 12588 leader_election.cc:400] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13.
I20260709 13:05:05.259464 17541 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:05.230722 17568 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:05.202139 17515 consensus_queue.cc:1048] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:05:05.265956 17590 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:05.263799 17413 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.272958 12588 leader_election.cc:403] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:05:05.211365 17565 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.276041 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:05.268188 17531 consensus_meta.cc:287] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.002s
I20260709 13:05:05.268743 17363 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:05:05.279086 17440 consensus_meta.cc:287] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.571s	user 0.012s	sys 0.000s
I20260709 13:05:05.268837 17418 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:05.274951 17097 raft_consensus.cc:697] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:05.283350 17568 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:05.274562 17525 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:05.232097 16992 consensus_queue.cc:237] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:05.212393 17395 consensus_queue.cc:237] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.312402 12587 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:05.316955 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:05.293246 17425 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:05.322189 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:05.324496 12690 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:05.309465 17418 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:05.329797 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:05.284646 17541 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.314636 17568 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:05.308751 17363 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.380474 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:05.386324 17585 log.cc:927] Time spent T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:05:05.387871 17579 log.cc:927] Time spent T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:05:05.389640 17570 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:05.390357 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3086) took 1386 ms. Trace:
I20260709 13:05:05.391691 17541 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:05.390717 12543 rpcz_store.cc:276] 0709 13:05:04.004423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.797424 (+793001us) service_pool.cc:224] Handling call
0709 13:05:04.797752 (+   328us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:05:04.824962 (+ 27210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:04.825006 (+    44us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:05:04.839908 (+ 14902us) log.cc:844] Serialized 78 byte log entry
0709 13:05:05.139988 (+300080us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:05.145342 (+  5354us) log.cc:844] Serialized 14 byte log entry
0709 13:05:05.169287 (+ 23945us) log.cc:844] Serialized 14 byte log entry
0709 13:05:05.182306 (+ 13019us) log.cc:844] Serialized 14 byte log entry
0709 13:05:05.192170 (+  9864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.192310 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:05.390063 (+197753us) raft_consensus.cc:1685] finished
0709 13:05:05.390083 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.390276 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63417,"prepare.queue_time_us":39151,"prepare.run_cpu_time_us":149,"prepare.run_wall_time_us":5054,"raft.queue_time_us":61492,"raft.run_cpu_time_us":388,"raft.run_wall_time_us":30348,"spinlock_wait_cycles":33363456,"thread_start_us":243628,"threads_started":1,"wal-append.queue_time_us":419653}
W20260709 13:05:05.393724 17576 log.cc:927] Time spent T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 13:05:05.398998 17363 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:05.402827 17342 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.403514 17342 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.406322 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.406803 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.407519 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.407944 17031 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.409641 12693 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14. Ops: []
W20260709 13:05:05.415169 17574 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 13:05:05.350339 17546 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:05.416831 17546 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.419059 17546 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:05.419881 17473 raft_consensus.cc:3055] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:05.420398 17473 raft_consensus.cc:740] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:05:05.425151 17458 consensus_meta.cc:287] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.002s
I20260709 13:05:05.428200 17425 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13.
I20260709 13:05:05.323798 17427 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.430574 17031 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:05.434434 17565 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:05.331146 17581 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:05.435878 17581 raft_consensus.cc:697] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:05.436769 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.436932 17581 consensus_queue.cc:237] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:05.437755 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 226553us
I20260709 13:05:05.327473 17584 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.370391 17424 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:05.371276 17097 consensus_queue.cc:237] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.309144 17440 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.408154 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:05.441635 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:05.443140 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:05.444037 13197 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:05.444428 13200 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:05.445037 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 264428us
I20260709 13:05:05.447269 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:05.457350 12687 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:05.448731 12690 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:05.364645 12691 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:05:05.461462 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:05.364782 17573 log.cc:927] Time spent T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:05:05.464457 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.304324 17413 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.470649 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.486454 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:05.439333 17172 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:05.488999 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:05.490406 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 44102us
W20260709 13:05:05.488300 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 43950.6us
I20260709 13:05:05.417457 17397 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14.
I20260709 13:05:05.446682 17458 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 14. Current term is 15.
W20260709 13:05:05.494009 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:05.513665 12618 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:05.504314 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:05.508575 13200 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:05.494555 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.520280 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:05.520475 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.520826 12541 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:05:05.521523 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:05.522018 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.523739 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:05.524904 12542 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 13: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:05.525944 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:05.527249 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:05.527735 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:05.453521 17398 raft_consensus.cc:697] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:05.465509 17515 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.529328 16672 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:05.527133 12662 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:05.504650 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:05.500295 12690 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:05:05.521541 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:05.514498 17127 consensus_meta.cc:287] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.000s
I20260709 13:05:05.536244 12613 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:05.528378 12544 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:05:05.537186 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:05.546012 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.513389 17404 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.514681 17356 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:05.586963 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:05.587231 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 51461.7us
W20260709 13:05:05.534875 17399 consensus_meta.cc:287] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.521s	user 0.007s	sys 0.003s
W20260709 13:05:05.591552 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 64497.2us
I20260709 13:05:05.465916 17241 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:05:05.492985 17598 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:05.525581 17443 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:05.587132 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 59442.6us
I20260709 13:05:05.509135 17504 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:05.421403 17473 consensus_queue.cc:260] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.464742 17584 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.534605 16989 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:05:05.593113 17551 consensus_meta.cc:287] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.000s
I20260709 13:05:05.583703 17578 raft_consensus.cc:2764] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:05:05.590873 17342 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:05.507853 17366 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 13:05:05.589604 17458 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.507805 17407 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 13:05:05.598338 17594 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:05.756078 17594 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:05.756611 17588 log.cc:927] Time spent T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:05:05.757639 17156 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.758378 17594 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:05.530578 17466 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.758256 17156 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.760325 17466 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:05.600034 17583 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:05.760802 12588 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:05.760982 17583 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:05.761885 17598 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:05.735277 17443 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.763258 17583 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:05.763851 12694 raft_consensus.cc:1240] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:05.764961 17443 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:05.588528 17127 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.765523 12547 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:05:05.766923 17127 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:05.682371 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:05.734108 12440 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36394 (request call id 340) took 24556 ms (client timeout 15000 ms). Trace:
I20260709 13:05:05.768244 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:05.769055 13228 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 16. Current term is 17. Ops: [14.11-16.12]
I20260709 13:05:05.769341 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:05.770450 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.603422 17397 consensus_queue.cc:1059] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:05:05.771476 17473 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:05.718531 17399 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:05.771530 17397 raft_consensus.cc:3055] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:05.774017 17397 raft_consensus.cc:740] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:05.774865 17397 consensus_queue.cc:260] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:05.775763 17554 consensus_meta.cc:287] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.000s
I20260709 13:05:05.776280 17397 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:05.776190 17554 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:05.776831 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.777283 12620 raft_consensus.cc:1240] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:05.778070 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:05.779212 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:05.547151 17515 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:05.693500 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.789144 12621 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:05.606530 17418 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:05.693966 12662 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:05.693600 17404 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:05.688796 16992 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:05.804842 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 111000us
I20260709 13:05:05.805649 12662 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:05.606205 17553 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:05:05.735190 12687 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:05.742578 17440 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:05.811370 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:05.733767 17520 consensus_queue.cc:1059] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:05:05.748072 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.816095 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.748502 12619 raft_consensus.cc:2410] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:05:05.734347 17419 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:05:05.749833 17599 log.cc:927] Time spent T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:05:05.695149 17427 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:05:05.750322 17602 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:05:05.748093 17584 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:05.751341 17424 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:05.752493 17172 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:05.752966 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:05:05.753612 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 52047.8us
I20260709 13:05:05.743120 17458 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:05.755584 17604 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:05:05.789408 12622 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:05.871073 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.871765 12622 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:05:05.792330 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:05.872359 17568 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:05.872678 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.848547 17554 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:05.873953 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.875231 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.799393 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:05.876369 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.876817 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:05.799268 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 283159us
I20260709 13:05:05.879200 13199 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:05.802493 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:05.881137 12544 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:05.860360 17407 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:05.882409 17407 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.883816 12618 raft_consensus.cc:1275] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:05:05.884192 12618 pending_rounds.cc:85] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 7
I20260709 13:05:05.884416 12618 pending_rounds.cc:107] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:05:05.884482 17533 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:05.884709 12618 raft_consensus.cc:2889] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:05.885056 17407 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:05.813062 17387 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:05.885913 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:05.801836 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:05.866140 17338 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:05:05.888731 17338 consensus_queue.cc:1243] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:05:05.889231 17338 raft_consensus.cc:3055] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:05.889356 12547 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:05:05.889612 17338 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:05.773502 17399 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:05.684638 17398 consensus_queue.cc:237] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.890326 17127 consensus_queue.cc:1059] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:05.890440 17338 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.891413 17127 raft_consensus.cc:3055] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:05.811769 12662 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:05.891753 17338 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:05.892323 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 80628.4us
I20260709 13:05:05.871075 17570 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:05.893407 12662 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:05.893767 17570 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:05.894508 17458 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:05.895084 17569 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:05.864207 17427 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:05.812037 12542 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:05.739545 17551 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:05.898703 17611 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.143s	user 0.002s	sys 0.000s
I20260709 13:05:05.898801 12694 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:05.899672 17551 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:05.891760 17127 raft_consensus.cc:740] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:05.850617 13197 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:05.851612 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:05.900712 17600 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:05:05.901010 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 50461.8us
I20260709 13:05:05.901271 17534 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:05.810887 17467 raft_consensus.cc:2764] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:05:05.901803 13197 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:05.902945 17541 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:05.903281 17600 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:05.904906 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:05.905192 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:05.862694 17603 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.802577 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:05.867847 13200 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:05.868613 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:05.872786 12615 raft_consensus.cc:2368] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14.
W20260709 13:05:05.900190 17606 log.cc:927] Time spent T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:05:05.855312 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:05.905995 17531 raft_consensus.cc:3055] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:05.864260 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.877410 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.858891 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:05.909895 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:05.910883 12512 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:05.917061 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 49313.4us
I20260709 13:05:05.911728 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:05:05.911660 12662 connection.cc:256] RPC call timeout handler was delayed by -1.1571462209999481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
I20260709 13:05:05.920974 12616 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 14: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:05.921746 13200 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:05.922703 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.923458 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:05.807747 17578 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:05.923326 12616 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:05:05.925661 12544 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:05.924661 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:05.914557 13231 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:05.926360 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:05.928406 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:05.929140 12622 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:05.909065 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:05.813181 17342 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:05.853533 17418 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:05.932732 12614 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:05.933157 12622 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:05.807473 17581 consensus_queue.cc:1059] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.110s
I20260709 13:05:05.941247 17127 consensus_queue.cc:260] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.942451 17581 raft_consensus.cc:3055] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:05.942539 17127 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:05.942878 17581 raft_consensus.cc:740] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:05.943794 17581 consensus_queue.cc:260] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.945200 17581 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:05.938830 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 80068.1us
I20260709 13:05:05.945796 17615 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:05.945724 17172 consensus_queue.cc:1059] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:05.946794 17387 raft_consensus.cc:3055] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:05.946463 17615 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.947158 17387 raft_consensus.cc:740] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:05.948000 17387 consensus_queue.cc:260] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:05.948909 17615 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:05.865665 17419 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.950555 17515 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:05.951265 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:05.951414 17427 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:05.934362 17447 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:05.952157 17419 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:05.813346 16992 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.934576 17578 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.953500 12690 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:05:05.955529 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:05.821985 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:05.926843 17241 consensus_queue.cc:1059] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:05:05.960685 12659 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:05.939528 17583 consensus_queue.cc:1059] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:05:05.960160 17514 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:05.916340 17569 consensus_queue.cc:1059] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:05:05.967334 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:05.968146 12538 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 11: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:05.968910 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:05.767928 12440 rpcz_store.cc:269] 0709 13:04:41.169845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:41.226384 (+ 56539us) service_pool.cc:224] Handling call
0709 13:05:05.703072 (+24476688us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:59.014244 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:59.039237 (+ 24993us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:59.039307 (+    70us) write_op.cc:435] Acquired schema lock
0709 13:04:59.039358 (+    51us) tablet.cc:662] Decoding operations
0709 13:04:59.126590 (+ 87232us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:59.126698 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:59.126725 (+    27us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:04:59.256467 (+129742us) tablet.cc:701] Row locks acquired
0709 13:04:59.256527 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:04:59.256680 (+   153us) write_op.cc:270] Start()
0709 13:04:59.256839 (+   159us) write_op.cc:276] Timestamp: P: 1783602299256624 usec, L: 0
0709 13:04:59.266499 (+  9660us) op_driver.cc:348] REPLICATION: starting
0709 13:04:59.325657 (+ 59158us) log.cc:844] Serialized 9949 byte log entry
0709 13:04:59.849522 (+523865us) op_driver.cc:464] REPLICATION: finished
0709 13:05:00.201002 (+351480us) write_op.cc:301] APPLY: starting
0709 13:05:00.224280 (+ 23278us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:00.870656 (+646376us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:00.870902 (+   246us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:00.887253 (+ 16351us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:00.887687 (+   434us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 13:05:00.887748 (+    61us) write_op.cc:312] APPLY: finished
0709 13:05:00.888270 (+   522us) log.cc:844] Serialized 220 byte log entry
0709 13:05:00.948815 (+ 60545us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:00.960909 (+ 12094us) write_op.cc:454] Released schema lock
0709 13:05:00.971447 (+ 10538us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:01.040642 (+ 69195us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:01.041920 (+  1278us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":276333,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":293584,"apply.run_cpu_time_us":45724,"apply.run_wall_time_us":865255,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108677,"num_ops":25,"prepare.queue_time_us":159314,"prepare.run_cpu_time_us":27436,"prepare.run_wall_time_us":474173,"raft.queue_time_us":145889,"raft.run_cpu_time_us":8415,"raft.run_wall_time_us":136186,"replication_time_us":565673,"spinlock_wait_cycles":1642240,"thread_start_us":375944,"threads_started":5,"wal-append.queue_time_us":256277,"wal-append.run_cpu_time_us":19923,"wal-append.run_wall_time_us":2197834}]]}
I20260709 13:05:05.920405 17531 raft_consensus.cc:740] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:05.970407 13197 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:05.970275 17531 consensus_queue.cc:260] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.973486 17614 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:05.978434 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:05.979324 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:05.979665 13234 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:05:05.980065 13235 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:05.980635 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:05.981241 13227 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:05:05.926013 17551 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:05:05.987818 12621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 1181) took 2393 ms (client timeout 1717 ms). Trace:
W20260709 13:05:05.988241 12621 rpcz_store.cc:269] 0709 13:05:03.594569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:03.595006 (+   437us) service_pool.cc:224] Handling call
0709 13:05:05.987635 (+2392629us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b54003d18d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:05.987746 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4806618368}
I20260709 13:05:05.982724 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:05.989656 12544 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:05.990759 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:05.991791 17031 consensus_queue.cc:1059] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:05.992194 17570 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:05.992857 17419 raft_consensus.cc:3055] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:05.993249 17419 raft_consensus.cc:740] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:05.994143 17419 consensus_queue.cc:260] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:05.994751 17534 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:05.995318 17534 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:05.995564 17419 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:05.997437 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:05.998108 13235 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:05.998230 12662 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:05.998945 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:05.998837 17427 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:05.999884 17427 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:06.000415 17427 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:05.915005 17568 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:05.984898 12691 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:05:05.985229 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:05.960358 17447 raft_consensus.cc:697] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:06.007249 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:05.982563 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:06.009716 12688 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:05:06.010185 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:06.012517 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:06.020372 13235 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:06.015314 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:06.017089 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:06.021230 12544 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:06.021298 12538 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:06.022405 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:06.022481 12692 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:06.023478 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:06.023974 12692 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:06.023988 12538 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:06.030092 12544 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:05:06.031441 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:06.032389 12544 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:06.025481 12692 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:05:05.982546 17598 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:06.033519 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:06.045488 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:06.041076 12588 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:06.046846 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:06.048225 12544 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:06.034621 12510 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:06.036502 12538 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:05:06.053069 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:05.932572 17603 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:06.053846 12538 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:06.015301 17514 raft_consensus.cc:3055] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:06.057550 12588 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:06.062541 12510 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:06.077153 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:06.039464 17570 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:06.082087 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:06.055464 17550 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:05:06.039631 17515 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:05:06.078344 17342 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:06.048909 13229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:06.043013 17366 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:06.045238 17598 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:06.075151 17399 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:06.077142 17575 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:06.076197 17398 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.075047 17514 raft_consensus.cc:740] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:06.084476 12544 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:05:06.134846 12544 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:05:06.135491 12544 pending_rounds.cc:85] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 6
I20260709 13:05:06.135792 12544 pending_rounds.cc:107] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:05:06.136130 12544 raft_consensus.cc:2889] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:06.082365 12510 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:06.104197 13234 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:06.112911 13229 raft_consensus.cc:606] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:06.034435 17567 consensus_queue.cc:1059] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:05:06.082698 17458 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:06.042950 17241 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:05:06.034973 17504 consensus_queue.cc:1059] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
W20260709 13:05:06.142828 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 60518.5us
I20260709 13:05:06.103353 17534 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:06.151330 12544 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
W20260709 13:05:06.151163 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 59481.2us
I20260709 13:05:06.101411 17578 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:06.122771 17366 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.153502 12510 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:06.166783 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:06.155557 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 98156us
I20260709 13:05:06.156984 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:06.169359 13234 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:06.133395 17426 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:06.144073 17575 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:06.160321 12542 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:05:06.169588 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:06.182694 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:06.129072 17598 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:06.098485 17447 consensus_queue.cc:237] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:06.191234 12588 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:06.191782 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:06.192297 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:06.196463 12621 raft_consensus.cc:2410] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 10 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
W20260709 13:05:06.182901 17629 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:05:06.198606 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:06.140681 17398 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:06.167938 17366 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:06.185196 17534 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.184192 17443 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:06.188647 17440 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:06.203169 12588 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:06.194248 17473 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:06.209439 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:06.204704 17458 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:06.218097 17413 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:06.218612 16992 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:06.206368 17565 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:06.221910 17565 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:06.222337 17565 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:06.226500 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:06.162519 17514 consensus_queue.cc:260] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:06.199546 17504 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:05:06.234601 13229 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:06.214924 17353 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:06.212004 17425 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:06.239585 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:06.246435 13228 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:05:06.249188 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:06.228613 17473 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:06.208716 17534 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:06.262776 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.239540 17514 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:06.282819 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:06.301012 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.305972 17603 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:06.310465 17534 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:06.315961 17600 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:06.324265 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 125769us
I20260709 13:05:06.325960 12510 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:06.331105 17598 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:06.332718 13234 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:06.334038 17598 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:06.324059 17443 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:06.324394 17615 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:06.341975 17443 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:06.342429 17615 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:06.344221 17443 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:06.344379 17615 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:05.160210 12539 rpcz_store.cc:276] 0709 13:05:03.889291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.789322 (+900031us) service_pool.cc:224] Handling call
0709 13:05:04.789648 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:04.789834 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:05:04.831651 (+ 41817us) log.cc:844] Serialized 14 byte log entry
0709 13:05:05.140245 (+308594us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:05.140313 (+    68us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:05.140354 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:05.140419 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:05.140528 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37115,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":3954,"raft.queue_time_us":40266,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":8587,"thread_start_us":269863,"threads_started":1}
I20260709 13:05:06.349424 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 3394) took 1466 ms. Trace:
I20260709 13:05:06.349875 12617 rpcz_store.cc:276] 0709 13:05:04.883397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.886666 (+  3269us) service_pool.cc:224] Handling call
0709 13:05:06.349229 (+1462563us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b54002a7bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:06.349363 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1501326080}
I20260709 13:05:06.340885 17366 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:06.369347 12510 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:06.371876 12510 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:06.393656 12510 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:06.373884 17353 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:06.396991 12696 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:06.397889 12510 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:06.405889 12510 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:06.407140 12510 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:06.409963 12510 leader_election.cc:400] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14.
I20260709 13:05:06.377749 17639 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:06.413717 12510 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:06.415166 17647 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:06.397038 17353 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:06.403777 17447 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:06.406795 17458 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:06.406581 17473 raft_consensus.cc:697] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:06.408680 17338 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:06.407829 17638 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:06.412372 17575 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:06.425711 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:06.409250 17443 consensus_queue.cc:1048] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:05:06.415900 17647 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:06.417151 17353 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:06.439810 17404 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:06.440745 17586 log.cc:927] Time spent T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 1.151s	user 0.003s	sys 0.000s
W20260709 13:05:06.443725 12545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3075) took 2462 ms (client timeout 1955 ms). Trace:
I20260709 13:05:06.483050 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:06.496757 12545 rpcz_store.cc:269] 0709 13:05:03.981191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.380109 (+1398918us) service_pool.cc:224] Handling call
0709 13:05:06.443500 (+1063391us) spinlock_profiling.cc:243] Waited 664 ms on lock 0x7b54002cc754. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:06.443645 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1526923648}
I20260709 13:05:06.445348 17031 raft_consensus.cc:3055] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:06.446712 17366 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:06.450628 17427 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:06.452323 17531 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:06.456549 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1202) took 1194 ms. Trace:
I20260709 13:05:06.501585 12693 rpcz_store.cc:276] 0709 13:05:05.262781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.262950 (+   169us) service_pool.cc:224] Handling call
0709 13:05:05.263272 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:05.410000 (+146728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.456329 (+1046329us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540041fad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:06.456493 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336105856}
I20260709 13:05:06.458007 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:06.457757 17565 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:06.502807 13226 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:06.504429 17565 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:06.459403 17514 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:06.464924 12688 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:05:06.465982 12689 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 13:05:06.507076 17609 log.cc:927] Time spent T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.744s	user 0.002s	sys 0.000s
I20260709 13:05:06.459204 17473 consensus_queue.cc:237] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:06.508270 17566 raft_consensus.cc:3055] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:06.508653 17566 raft_consensus.cc:740] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:06.509490 17566 consensus_queue.cc:260] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:06.465238 17447 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:06.510710 17566 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:06.473946 17581 consensus_queue.cc:1059] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:06.511464 17581 raft_consensus.cc:3055] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:06.500998 17417 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:06.511854 17581 raft_consensus.cc:740] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:06.512300 17417 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:06.474828 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:06.474061 17546 raft_consensus.cc:3055] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:06.478564 12692 raft_consensus.cc:1275] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:05:06.498576 12662 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:06.470286 17647 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:06.512771 17581 consensus_queue.cc:260] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:06.474963 17617 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.716s	user 0.002s	sys 0.000s
I20260709 13:05:06.525436 12662 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:06.526494 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:06.495908 17639 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:06.534493 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:06.530226 12544 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:05:06.530800 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:06.505141 17514 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:06.535358 12539 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:05:06.537554 12662 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:06.538942 12539 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:06.539388 12662 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:06.539752 13226 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:06.499801 17031 raft_consensus.cc:740] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:06.523607 17546 raft_consensus.cc:740] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:06.535749 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:06.543256 12662 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:06.544603 12544 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:06.500383 17342 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:06.537001 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:06.554893 12545 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:06.537425 12695 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 10. Current term is 11. Ops: []
W20260709 13:05:06.524422 17441 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.017s	sys 0.045s
I20260709 13:05:06.501250 17458 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:06.542394 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:06.542831 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:06.557773 13229 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:06.529538 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:06.559206 12588 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:06.532459 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:06.546268 12544 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:06.543092 17419 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:06.546851 17578 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:06.543363 17568 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:06.528065 17366 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:06.528687 17404 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:06.560451 12588 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:06.561332 12542 raft_consensus.cc:1275] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
W20260709 13:05:06.558769 17441 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.017s	sys 0.045s
I20260709 13:05:06.562505 12544 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:06.540987 17460 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:06.542666 17575 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:06.567670 12542 pending_rounds.cc:85] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 6
I20260709 13:05:06.586273 12542 pending_rounds.cc:107] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:05:06.586561 12542 raft_consensus.cc:2889] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:06.587496 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:06.559432 17581 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:06.563413 17504 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:06.573719 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:06.573972 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:06.591763 12545 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:06.574937 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:06.575295 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:06.575886 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:06.582747 17514 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:06.562821 17419 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:06.562484 17458 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:06.584441 17546 consensus_queue.cc:260] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:06.564963 17565 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:06.593076 12622 raft_consensus.cc:2410] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:05:06.591316 12617 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:05:06.556689 17603 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:05:06.561441 17466 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 13:05:06.568782 17649 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:05:06.602046 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.603731 12662 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:06.594594 17504 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.613783 17504 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:06.614238 17427 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:06.614863 17427 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:06.615216 17427 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:06.615571 17427 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:06.572247 17404 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:06.619443 17458 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:06.620230 17404 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:06.613291 17652 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:06.605376 17418 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:05:06.621958 17652 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:06.608489 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:06.624253 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:06.608614 17568 raft_consensus.cc:697] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:06.609089 17426 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:06.609510 17646 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:06.626617 17646 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:06.610879 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:06.590750 17366 raft_consensus.cc:697] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:06.612568 17565 raft_consensus.cc:697] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:06.611459 17645 consensus_queue.cc:1059] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:05:06.625798 12617 raft_consensus.cc:3055] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:06.636770 12617 raft_consensus.cc:740] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:06.637275 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:06.596948 17419 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:06.602665 17342 consensus_queue.cc:1059] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:05:06.623458 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:06.640607 12588 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:06.624855 12622 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:05:06.631316 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:06.640288 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:06.642247 12621 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:06.637496 12617 consensus_queue.cc:260] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:06.639348 17578 raft_consensus.cc:697] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 10 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:06.639078 12510 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:06.636476 17424 consensus_queue.cc:1059] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:05:06.667057 17593 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:06.635471 17426 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:06.709247 17417 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:06.657055 17473 consensus_queue.cc:1048] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:05:06.686065 17366 consensus_queue.cc:237] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:06.687556 17353 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:06.689055 17646 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:06.690721 17565 consensus_queue.cc:237] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:06.691948 17568 consensus_queue.cc:237] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:06.635722 17418 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:05:06.702776 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 45102.5us
W20260709 13:05:06.706202 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.707676 12617 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:06.711495 13197 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:06.714982 12621 raft_consensus.cc:1240] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:06.719578 12588 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:06.723124 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:06.723423 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:06.723845 17418 raft_consensus.cc:697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:06.724126 12622 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:05:06.724781 17646 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:05:06.709431 17645 consensus_queue.cc:1175] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "66750b8bbd4c4b3a9695951d0ede3372" responder_term: 14 status { last_received { term: 14 index: 11 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:05:06.725251 17646 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:06.725762 17646 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:06.728842 17550 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:06.722873 13197 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:06.730446 12617 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:05:06.737336 12617 pending_rounds.cc:85] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 10
I20260709 13:05:06.737721 12617 pending_rounds.cc:107] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:05:06.738022 12617 raft_consensus.cc:2889] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:06.740963 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3392) took 1858 ms. Trace:
I20260709 13:05:06.741451 12620 rpcz_store.cc:276] 0709 13:05:04.882881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:04.940195 (+ 57314us) service_pool.cc:224] Handling call
0709 13:05:04.946475 (+  6280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:05.777945 (+831470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.740702 (+962757us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b54001eaad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:06.740898 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1910234368}
I20260709 13:05:06.743585 12543 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 8. Current term is 9. Ops: [8.10-8.10]
W20260709 13:05:06.782867 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.735556 17550 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:06.784144 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:06.749387 17525 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:06.788427 17550 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:06.793411 17659 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:06.803329 17659 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:06.803956 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:06.784451 17591 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:05:06.808045 17398 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:06.808578 17550 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:06.795841 17525 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:06.809782 17525 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:06.811002 13227 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:05:06.811277 17550 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:05:06.809864 17399 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:05:06.813076 17387 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:06.813422 12620 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:05:06.816118 17353 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:06.818171 17399 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:06.818759 17399 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:06.819227 12619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 2008) took 1532 ms (client timeout 1759 ms). Trace:
W20260709 13:05:06.819759 12619 rpcz_store.cc:269] 0709 13:05:05.286787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.407298 (+120511us) service_pool.cc:224] Handling call
0709 13:05:06.818982 (+1411684us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b54003d0ed4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:06.819162 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":782159744}
I20260709 13:05:06.818171 12546 raft_consensus.cc:1240] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:06.822046 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1090) took 1301 ms. Trace:
I20260709 13:05:06.822381 12546 rpcz_store.cc:276] 0709 13:05:05.520430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.534280 (+ 13850us) service_pool.cc:224] Handling call
0709 13:05:06.817820 (+1283540us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b5800000c98. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:05:06.818006 (+   186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:06.821796 (+  3790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.821993 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7420800}
I20260709 13:05:06.829149 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:06.838776 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:06.854846 17607 log.cc:927] Time spent T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 1.093s	user 0.005s	sys 0.001s
I20260709 13:05:06.855232 17531 raft_consensus.cc:993] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:05:06.855773 17127 raft_consensus.cc:1081] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:05:06.862516 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:06.863291 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:06.863646 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:06.863945 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:06.864384 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:06.864769 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:06.864843 17397 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:06.865137 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:06.865613 13226 raft_consensus.cc:2393] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 16: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:06.867262 13231 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:05:06.871512 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:06.872046 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.872488 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:06.883677 12620 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:05:06.885308 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:06.887224 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:06.888321 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:06.888862 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:06.890096 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:06.886974 13197 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:06.891398 12618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:60170
I20260709 13:05:06.891971 12618 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:06.892129 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:06.892405 12618 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:06.890035 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:06.893299 12689 raft_consensus.cc:2393] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 14: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:06.724815 17418 consensus_queue.cc:237] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:06.903097 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:06.720124 17578 consensus_queue.cc:237] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:06.900534 12620 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:06.834918 17652 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:06.908059 12620 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:06.914749 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:06.915619 13231 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:06.902196 17659 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:06.922027 17568 consensus_queue.cc:1059] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:06.923197 17568 raft_consensus.cc:3055] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:06.923646 17568 raft_consensus.cc:740] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:06.924544 17568 consensus_queue.cc:260] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:06.923280 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:06.792558 17504 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:06.931025 17488 raft_consensus.cc:3055] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:06.909160 17550 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:06.898113 17460 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:06.962106 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:06.963423 12538 raft_consensus.cc:2410] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:05:06.965554 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:06.966480 12540 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:05:06.967288 12613 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:06.968804 12618 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:06.969635 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:06.970894 12616 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:06.971403 12547 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:06.973127 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:06.974547 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 335741us
I20260709 13:05:06.974725 12547 raft_consensus.cc:2393] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 9: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:06.931600 17488 raft_consensus.cc:740] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:06.990967 12659 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:06.992143 16672 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:06.958756 17568 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:07.001582 17603 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.002353 17603 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.003594 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:07.004506 12538 raft_consensus.cc:2393] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 12: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:07.006125 17172 consensus_queue.cc:1059] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:06.997185 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:06.974007 17550 raft_consensus.cc:697] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:07.029465 12618 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:06.936141 17427 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:07.033937 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:07.010411 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:07.038390 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:07.038539 17603 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:07.038932 17660 log.cc:927] Time spent T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:05:07.039212 17646 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.008838 17387 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:05:07.041273 17646 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:07.042225 12620 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:07.044059 12546 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:05:07.042104 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:06.971894 17650 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:07.052536 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:07.053541 12538 raft_consensus.cc:2393] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 9: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:07.058276 13200 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:07.060189 12691 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:05:07.061971 12512 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:07.064623 12512 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:06.973312 17460 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.038549 17658 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.071102 13200 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:07.075179 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:06.998975 17570 consensus_queue.cc:1059] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 13:05:07.072242 17531 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:07.108213 12693 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:05:07.070411 17441 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:05:07.082686 17127 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:07.088388 17353 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:07.069427 17447 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:05:07.130424 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 1024) took 1152 ms. Trace:
I20260709 13:05:07.075768 17591 consensus_queue.cc:1059] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:05:07.130828 13228 rpcz_store.cc:276] 0709 13:05:05.978054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.978175 (+   121us) service_pool.cc:224] Handling call
0709 13:05:07.130255 (+1152080us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b54006c02d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:07.130364 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":533045632}
I20260709 13:05:07.065512 17650 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.081864 17658 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.119236 17550 consensus_queue.cc:237] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.068109 17488 consensus_queue.cc:260] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:07.130276 17570 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:05:07.158102 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 155154us
I20260709 13:05:07.160008 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:07.160607 12547 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:07.167534 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:07.168272 13228 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:07.170421 12662 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:07.171837 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:07.151376 17514 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:07.129587 17525 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.131592 17419 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:07.176467 17419 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:07.170569 17570 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:07.177518 17663 log.cc:927] Time spent T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:05:07.178987 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.179190 17570 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:07.188136 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1202) took 1919 ms. Trace:
I20260709 13:05:07.188603 12613 rpcz_store.cc:276] 0709 13:05:05.269221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.878963 (+609742us) service_pool.cc:224] Handling call
0709 13:05:06.825655 (+946692us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:06.967731 (+142076us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.186974 (+219243us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54003d0ed4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:07.187921 (+   947us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b54003d0ed0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:07.188076 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2501800576}
W20260709 13:05:07.190966 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.191982 17652 consensus_queue.cc:1059] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:07.193199 17646 raft_consensus.cc:3055] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:07.193608 17646 raft_consensus.cc:740] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:07.195848 17399 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:07.202782 17485 raft_consensus.cc:3055] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:07.196940 17156 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:07.197458 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:07.193552 12587 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:07.151630 17504 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:07.207443 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 124734us
I20260709 13:05:07.226735 12695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d83186354414170b4775351916c56c2"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:33998
W20260709 13:05:07.220570 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.221480 17156 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:07.209163 17488 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:07.211723 17525 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:07.227533 12695 raft_consensus.cc:606] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:07.230515 12695 raft_consensus.cc:614] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:07.220749 12587 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:07.208827 17485 raft_consensus.cc:740] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:07.233321 17460 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:07.234390 17485 consensus_queue.cc:260] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:07.233196 17665 log.cc:927] Time spent T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 13:05:07.193758 17631 consensus_queue.cc:1048] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:05:07.207803 17676 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:07.239158 13200 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:07.241868 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 160698us
W20260709 13:05:07.246340 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 159379us
I20260709 13:05:07.246925 12689 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:07.249469 13200 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:07.253233 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:07.253553 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:07.253919 12689 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:05:07.235742 17485 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:07.257517 12689 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
W20260709 13:05:07.262483 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 80182.1us
I20260709 13:05:07.263993 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:07.266047 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:07.266356 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:07.267894 12541 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:05:07.277540 12689 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:05:07.283139 12541 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:07.240502 17427 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:07.240707 17676 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:07.239360 17504 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:07.245994 17398 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:07.290387 12688 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:07.291054 17677 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:07.241684 17127 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:07.290186 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1223) took 1293 ms. Trace:
I20260709 13:05:07.288087 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:07.305805 12689 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:07.306733 17658 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:07.307746 17668 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:05:07.309171 17671 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:05:07.297646 12587 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:07.239379 17646 consensus_queue.cc:260] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.299299 17404 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.320034 17646 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:07.320312 17404 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:07.322125 17666 log.cc:927] Time spent T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:05:07.301134 17650 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:07.288170 17669 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 13:05:07.295288 17676 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:07.302917 12688 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:07.269436 17580 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:07.343011 17631 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:07.303867 12588 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:07.312064 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:07.343811 17672 log.cc:927] Time spent T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:05:07.302488 17525 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:05:07.349292 17031 consensus_queue.cc:260] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:07.350767 17031 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:07.262013 17458 consensus_queue.cc:1059] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:05:07.353833 17584 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:07.354377 17458 raft_consensus.cc:3055] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:05:07.354758 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 57218.6us
I20260709 13:05:07.355391 17404 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:07.297370 13200 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:07.314585 12689 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:07.355628 12587 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:07.366324 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:07.367736 12688 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:07.310055 17504 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:05:07.298887 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:07.354871 17458 raft_consensus.cc:740] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:05:07.430835 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 71742.4us
W20260709 13:05:07.313611 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 141831us
I20260709 13:05:07.315114 13230 rpcz_store.cc:276] 0709 13:05:05.996424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.002365 (+  5941us) service_pool.cc:224] Handling call
0709 13:05:07.201877 (+1199512us) spinlock_profiling.cc:243] Waited 7.95 ms on lock 0x7b58000f6398. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:05:07.202069 (+   192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:07.202309 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:05:07.202616 (+   307us) log.cc:844] Serialized 14 byte log entry
0709 13:05:07.289866 (+ 87250us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:07.289913 (+    47us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:07.289953 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.290015 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.290122 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":742,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":95,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":70,"spinlock_wait_cycles":18292608,"thread_start_us":86887,"threads_started":1}
I20260709 13:05:07.309325 17514 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:07.433712 12662 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:07.366251 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 68986.8us
W20260709 13:05:07.435447 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 79901.2us
W20260709 13:05:07.452203 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.429988 17127 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:07.455418 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:05:07.455413 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 175972us
I20260709 13:05:07.458943 17642 consensus_queue.cc:1059] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:07.460743 17569 raft_consensus.cc:3055] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:07.461251 17569 raft_consensus.cc:740] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:07.462354 17569 consensus_queue.cc:260] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:07.437156 17514 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:07.457402 12587 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:07.449862 17399 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:07.466619 12620 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:07.466025 12513 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:07.454342 17397 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.456823 17568 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:07.435560 17580 consensus_queue.cc:1059] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:05:07.456822 16992 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:07.478021 17399 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.495332 12513 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:07.455119 17156 consensus_queue.cc:1059] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:05:07.512204 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:07.513512 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:07.514026 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:07.472126 17658 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:07.467785 17650 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:05:07.452322 17425 consensus_queue.cc:1059] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:05:07.525445 12513 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:07.490056 17568 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:07.483835 17652 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:07.537820 12695 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:07.542923 13199 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:07.546133 17677 consensus_queue.cc:1059] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:07.547130 17097 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:07.550243 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:07.550917 12545 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:07.551636 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:07.551813 17398 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:07.552022 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:07.550846 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:07.522888 17399 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:07.555732 12545 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:05:07.554457 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:07.483282 17584 consensus_queue.cc:1059] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:05:07.524905 17639 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:07.532330 17441 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:07.527223 16992 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.475940 17458 consensus_queue.cc:260] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:07.527520 17658 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:07.525015 17550 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:07.491716 17397 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.550678 17568 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:07.485525 17554 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:07.588500 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:07.577796 17673 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:07.590103 17546 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:07.590652 17673 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.582027 17658 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:07.594633 12688 raft_consensus.cc:1275] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:05:07.596427 17554 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:07.598556 16992 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:07.598806 17554 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:07.525882 17685 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:05:07.603319 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:07.614583 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:07.620193 17366 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:07.611625 17554 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:05:07.587126 17550 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.633889 17652 raft_consensus.cc:697] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:07.638934 17366 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:07.665227 17532 raft_consensus.cc:3055] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:07.665776 17532 raft_consensus.cc:740] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:07.666666 17532 consensus_queue.cc:260] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:07.670984 17626 log.cc:927] Time spent T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 1.460s	user 0.002s	sys 0.009s
I20260709 13:05:07.671303 17532 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:07.673529 17676 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.675585 17550 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:07.676240 17676 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:07.676559 17673 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:07.666473 17568 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.677421 17652 consensus_queue.cc:237] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.687078 17658 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.687690 17568 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:07.694376 17658 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:07.717119 17684 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.171s	user 0.001s	sys 0.001s
W20260709 13:05:07.724931 17686 log.cc:927] Time spent T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.150s	user 0.001s	sys 0.001s
I20260709 13:05:07.785820 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 2027) took 2077 ms. Trace:
I20260709 13:05:07.789446 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1902) took 1802 ms. Trace:
W20260709 13:05:07.794101 12659 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.740s (SENT) [suppressed 16 similar messages]
W20260709 13:05:07.797204 12690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 1211) took 1916 ms (client timeout 1862 ms). Trace:
W20260709 13:05:07.797848 12690 rpcz_store.cc:269] 0709 13:05:05.880183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.924334 (+ 44151us) service_pool.cc:224] Handling call
0709 13:05:07.796684 (+1872350us) spinlock_profiling.cc:243] Waited 26.7 ms on lock 0x7b54000c7bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:07.796897 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61473536}
W20260709 13:05:07.802383 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 257137us
I20260709 13:05:07.807732 12694 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:07.790091 12687 rpcz_store.cc:276] 0709 13:05:05.986456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.986567 (+   111us) service_pool.cc:224] Handling call
0709 13:05:05.986863 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:05.999285 (+ 12422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:05.999317 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:05.999773 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:05:06.112620 (+112847us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:06.112666 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:06.112749 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:07.670330 (+1557581us) spinlock_profiling.cc:243] Waited 7.06 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:07.788641 (+118311us) raft_consensus.cc:1685] finished
0709 13:05:07.788701 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.789186 (+   485us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12068,"raft.queue_time_us":13242,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":16232192,"thread_start_us":112564,"threads_started":1,"wal-append.queue_time_us":189162}
I20260709 13:05:07.815981 17554 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.816223 17568 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:07.625340 17172 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:05:07.817824 17659 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.817435 17568 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.818990 17659 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.817147 17554 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.826210 17418 raft_consensus.cc:3055] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:07.829448 17156 raft_consensus.cc:3055] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:07.831146 17534 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:07.831593 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.832099 17366 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:07.832227 17695 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:07.817119 17397 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:07.834250 17418 raft_consensus.cc:740] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:07.850373 17658 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:07.853909 17554 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:07.849146 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1872) took 1374 ms. Trace:
I20260709 13:05:07.786923 12615 rpcz_store.cc:276] 0709 13:05:05.708524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.931084 (+222560us) service_pool.cc:224] Handling call
0709 13:05:05.931469 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:05.953435 (+ 21966us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:05:06.109456 (+156021us) log.cc:844] Serialized 14 byte log entry
0709 13:05:06.395907 (+286451us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:06.395975 (+    68us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:06.396018 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.784910 (+1388892us) spinlock_profiling.cc:243] Waited 21.7 ms on lock 0x7b540024bb54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:07.785005 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:07.785459 (+   454us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42420,"prepare.queue_time_us":246213,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":72353,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":27019,"spinlock_wait_cycles":49808896,"thread_start_us":378872,"threads_started":3,"wal-append.queue_time_us":201827,"wal-append.run_cpu_time_us":1511,"wal-append.run_wall_time_us":1106405}
I20260709 13:05:07.878389 12693 rpcz_store.cc:276] 0709 13:05:06.474385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.563225 (+ 88840us) service_pool.cc:224] Handling call
0709 13:05:06.569489 (+  6264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:07.108691 (+539202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:07.848340 (+739649us) spinlock_profiling.cc:243] Waited 538 ms on lock 0x7b540009c754. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:07.848899 (+   559us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1238178048}
I20260709 13:05:07.888304 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:07.890033 17698 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.890043 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:07.890537 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:07.891126 17698 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:07.894570 17466 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:07.895565 17466 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.896168 17658 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.901051 17466 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:07.902949 17534 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.906715 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:07.907148 12662 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:07.907920 12547 raft_consensus.cc:2393] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 12: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:07.908906 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:07.910127 17172 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:07.910668 17172 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:07.911453 17172 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:07.906749 17418 consensus_queue.cc:260] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.913841 17695 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.915326 17418 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:07.915663 17568 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:07.860770 17156 raft_consensus.cc:740] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:07.918452 17156 consensus_queue.cc:260] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:07.920419 17156 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:07.921824 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.883206 17659 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:07.936472 17425 raft_consensus.cc:3055] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:07.937099 17425 raft_consensus.cc:740] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:07.938843 17425 consensus_queue.cc:260] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:07.939495 17514 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:07.940028 17172 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.945145 17534 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:07.946141 17569 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:07.946352 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:05:07.946780 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:07.947154 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:07.948540 17565 raft_consensus.cc:3055] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:07.958081 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:07.917409 17695 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:07.982120 17127 raft_consensus.cc:3055] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:07.984519 17127 raft_consensus.cc:740] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:07.986397 17127 consensus_queue.cc:260] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:07.989014 17127 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:07.983434 12693 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:07.990199 12615 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:07.982995 17565 raft_consensus.cc:740] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:05:07.991433 17485 consensus_meta.cc:287] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.711s	user 0.011s	sys 0.007s
I20260709 13:05:07.992076 12540 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:07.992501 17565 consensus_queue.cc:260] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:07.994455 12544 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:07.996470 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:07.997718 17575 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:07.998530 17698 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:08.000629 17514 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:08.005685 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 90787.2us
W20260709 13:05:07.978471 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 184649us
I20260709 13:05:08.002002 17631 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:08.002343 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 476816us
I20260709 13:05:08.001852 12588 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:08.009970 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:08.013818 17425 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:08.016300 17550 consensus_queue.cc:1059] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:08.017940 17575 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:08.020090 12692 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:08.021986 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:08.022346 12513 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:08.022763 12692 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:08.024179 12513 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:08.025647 12687 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:08.026911 13199 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:08.027592 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:08.027652 17578 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:08.028271 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:08.028712 17578 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.035256 17397 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.036072 17397 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.037536 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1224) took 1383 ms. Trace:
I20260709 13:05:08.038218 12621 rpcz_store.cc:276] 0709 13:05:06.654577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.655862 (+  1285us) service_pool.cc:224] Handling call
0709 13:05:06.656277 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:06.720238 (+ 63961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:08.036706 (+1316468us) spinlock_profiling.cc:243] Waited 58.5 ms on lock 0x7b54001054d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:08.037324 (+   618us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134642048}
I20260709 13:05:08.041453 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1862) took 1941 ms. Trace:
I20260709 13:05:08.042176 12694 rpcz_store.cc:276] 0709 13:05:06.100411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.100554 (+   143us) service_pool.cc:224] Handling call
0709 13:05:07.804428 (+1703874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:07.808696 (+  4268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:08.040757 (+232061us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54000c7bd0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:08.041353 (+   596us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3916100992}
I20260709 13:05:08.064880 17418 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:08.065676 17518 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.065987 17418 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:08.066705 17518 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:08.069685 17488 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:08.070566 17488 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.072490 17467 raft_consensus.cc:3055] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:08.073047 17467 raft_consensus.cc:740] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:08.074286 17685 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:08.075369 17685 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:08.076277 17631 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:08.079890 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:05:08.082883 17031 consensus_meta.cc:287] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.731s	user 0.010s	sys 0.009s
I20260709 13:05:08.084288 17698 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.086853 17514 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.087488 17514 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:08.088764 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 62177.6us
I20260709 13:05:08.090031 12587 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:08.090405 12692 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:08.090785 17366 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:08.093106 17705 log.cc:927] Time spent T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.361s	user 0.001s	sys 0.000s
I20260709 13:05:08.093811 12691 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
W20260709 13:05:08.094151 17353 consensus_meta.cc:287] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.963s	user 0.015s	sys 0.007s
I20260709 13:05:08.095013 17398 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:08.094051 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:08.044008 17565 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:08.107016 12540 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 13:05:08.115129 17447 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.115950 17447 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:08.118270 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 94228.3us
I20260709 13:05:08.119635 12513 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:08.121927 17515 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:08.126680 17649 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:08.127166 17649 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.127527 17649 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:08.129478 17650 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.130117 17650 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:08.130961 17172 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:08.089352 17569 consensus_queue.cc:1059] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:05:08.132488 17650 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:08.136509 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:08.137178 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:08.137502 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:08.138756 13230 raft_consensus.cc:2393] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 17: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:05:08.140398 17703 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.411s	user 0.000s	sys 0.002s
I20260709 13:05:08.130975 17366 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:08.141808 17546 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:08.143373 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 159447us
I20260709 13:05:08.085194 17698 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:08.143637 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:08.167050 12615 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:08.126665 12513 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:08.172238 17702 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:08.173616 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 52020.4us
I20260709 13:05:08.176061 17417 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:08.095070 17353 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:08.100471 17658 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:08.143491 17534 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.143234 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:08.142377 17578 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:08.186018 17546 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.199681 17631 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:08.143419 17553 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:08.207949 12620 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13. Ops: []
W20260709 13:05:08.208568 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 98007.1us
I20260709 13:05:08.208729 17534 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.209937 17706 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.210529 17706 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.211158 17534 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:08.212862 17706 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:08.213789 12545 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15. Ops: []
W20260709 13:05:08.214421 12647 heartbeater.cc:646] Failed to heartbeat to 127.11.44.254:44047 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.11.44.254:44047 timed out after 15.000s (SENT)
I20260709 13:05:08.179648 17397 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:08.213722 17127 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:08.194195 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:08.221434 12690 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:08.228322 12513 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:08.212931 17578 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:08.229202 17127 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:05:08.240797 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 77303.1us
I20260709 13:05:08.214133 17447 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:08.245177 12587 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:08.143085 17647 consensus_queue.cc:1059] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.101s
I20260709 13:05:08.204730 17677 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:08.267189 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:08.267926 12690 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:08.254160 17458 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:08.263546 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:08.214763 17031 consensus_queue.cc:1059] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:05:08.244122 17127 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:08.234561 17488 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:08.276866 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 250188us
I20260709 13:05:08.276598 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:08.281291 17698 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:08.282644 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:08.283278 13228 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:08.286049 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:08.286477 13232 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:05:08.287662 12546 raft_consensus.cc:1275] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:05:08.288822 13231 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:08.289386 13226 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:08.290110 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:08.290794 13233 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:08.290953 13228 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:08.292104 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:08.292888 13229 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:08.295694 17575 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:08.299074 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:08.299201 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:08.300382 17697 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:08.300854 17583 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.002s	sys 0.037s
I20260709 13:05:08.300925 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:05:08.301527 17583 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.002s	sys 0.037s
I20260709 13:05:08.301157 17697 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:08.302659 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:08.304023 17642 raft_consensus.cc:3055] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:08.304643 17642 raft_consensus.cc:740] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:08.305475 17425 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:08.306195 17425 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.308738 17425 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:08.310155 17546 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:08.276528 17447 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:08.312565 17447 raft_consensus.cc:697] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 11 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:08.312651 17647 raft_consensus.cc:3055] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:05:08.313011 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 108741us
I20260709 13:05:08.313300 17647 raft_consensus.cc:740] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:08.313971 17447 consensus_queue.cc:237] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:08.314725 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 69636.4us
I20260709 13:05:08.314930 17647 consensus_queue.cc:260] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.315634 17514 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:08.315800 17425 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.316361 17647 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:08.316475 17425 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:08.317759 17553 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:08.318207 17553 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.318562 17553 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:08.318754 17425 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:08.315672 12587 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:08.319661 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:08.320393 17631 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:08.320849 17631 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.321308 17631 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:08.321116 17682 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:08.322875 17682 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:08.322657 17652 consensus_queue.cc:1059] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:08.323279 17682 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.323711 17682 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:08.323907 17473 raft_consensus.cc:3055] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:08.324339 17473 raft_consensus.cc:740] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:08.324501 13197 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:08.325575 17473 consensus_queue.cc:260] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.303903 17697 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:08.287583 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:08.278263 13227 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
W20260709 13:05:08.343719 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:08.312474 17518 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:08.344785 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:08.346436 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:08.346619 17677 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.347364 12615 raft_consensus.cc:2410] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:05:08.347957 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:08.348745 12617 raft_consensus.cc:1275] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:05:08.348955 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:08.349133 17677 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:08.349972 12614 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 12: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:08.349195 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:08.344148 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:08.346292 17713 consensus_queue.cc:1059] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
I20260709 13:05:08.343513 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:08.344889 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:08.350484 17467 consensus_queue.cc:260] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:08.359244 17546 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:08.362679 17473 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:08.363899 13199 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:08.367455 17584 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:08.368083 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 43781.9us
I20260709 13:05:08.349120 12617 pending_rounds.cc:85] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 5
W20260709 13:05:08.373373 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:08.374599 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:08.381209 13231 raft_consensus.cc:2393] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 17: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:08.384769 12619 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:05:08.386935 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:08.389194 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:08.389427 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:08.392460 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:08.390244 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:08.423275 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:08.392081 13234 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:08.404570 12619 pending_rounds.cc:85] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 8
I20260709 13:05:08.424361 12619 pending_rounds.cc:107] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:05:08.403690 12617 pending_rounds.cc:107] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:05:08.429980 12619 raft_consensus.cc:2889] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:08.430096 12617 raft_consensus.cc:2889] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:08.437148 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:08.443758 12538 raft_consensus.cc:2393] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 9: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:08.443780 12621 raft_consensus.cc:2410] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:05:08.428244 17697 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.446882 17697 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:08.441807 17546 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:08.449958 17569 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:08.450453 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:08.451161 13231 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:08.451721 17156 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:08.452178 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:08.452807 13231 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:05:08.454368 13234 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:08.450691 17569 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.456034 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:08.456971 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:08.456833 17569 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:08.457909 12542 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:05:08.458284 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:08.458801 12543 raft_consensus.cc:1275] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:05:08.458771 17534 consensus_queue.cc:1059] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:05:08.459646 17534 consensus_queue.cc:1243] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer a11816c5d72e4d1295a242f3ced09e5f log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:05:08.460073 13229 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:08.460022 12546 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:08.461582 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:08.462177 13226 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:08.463371 17584 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.469919 17418 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:05:08.470243 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:08.450017 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 86241.4us
I20260709 13:05:08.416877 17652 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:08.401118 17650 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.481369 12615 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:05:08.481830 12615 pending_rounds.cc:85] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 7
I20260709 13:05:08.482054 12615 pending_rounds.cc:107] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:05:08.482299 12615 raft_consensus.cc:2889] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:08.465018 17127 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:08.471885 17399 consensus_meta.cc:287] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.908s	user 0.007s	sys 0.012s
I20260709 13:05:08.400136 17550 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:05:08.490870 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:08.449401 17697 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:08.440253 17677 raft_consensus.cc:3055] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:08.498360 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:08.499101 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:08.500000 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:08.491577 12540 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:08.509454 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:08.510440 13230 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 13: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:08.515957 12538 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 13: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:08.497834 17569 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.519467 16672 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.519541 17569 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:08.520392 16672 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:08.522349 17156 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.522907 17156 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.525323 12691 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:08.501381 17677 raft_consensus.cc:740] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:08.527163 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:08.528523 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:08.529229 12621 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:08.536360 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:08.537220 13233 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:08.511314 17702 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:08.550444 13226 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:08.547062 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:08.408730 17642 consensus_queue.cc:260] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.559919 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:08.529126 13228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60708e41894c42b697291e905bff5dc6"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:08.562161 13228 raft_consensus.cc:606] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:08.562532 13228 raft_consensus.cc:614] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:05:08.564126 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:08.567838 17127 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:08.548967 17584 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:08.550803 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:08.569242 12618 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:05:08.548435 17504 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:08.570691 17504 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.572525 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:08.573150 17504 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:08.574039 13232 raft_consensus.cc:3055] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:08.574281 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:08.575209 17578 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:08.578428 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:08.576043 13232 raft_consensus.cc:740] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:08.575340 16672 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:08.607255 16672 consensus_queue.cc:1059] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:05:08.609154 17658 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:08.613386 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:08.614231 13228 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:08.615195 13228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:08.618156 17366 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:08.618788 17418 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:08.619743 17366 raft_consensus.cc:3055] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:08.620119 17366 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:08.621855 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:08.529999 17652 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.622603 13231 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:05:08.621057 17366 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.623811 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:08.624307 17652 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:08.624609 17366 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:08.625640 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:08.626278 13231 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:05:08.627080 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:08.628119 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:08.554678 17467 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:08.630028 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:08.630808 12696 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 16: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:08.510013 17399 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.635628 17399 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:08.636641 12588 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:08.637902 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:08.583606 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:08.584365 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:08.585248 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:08.639747 12690 raft_consensus.cc:2393] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 11: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:08.639598 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:08.640229 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:08.641052 12618 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:05:08.641987 13231 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:08.587994 12617 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:08.643034 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:08.643643 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:08.589172 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:08.646764 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:08.646849 13232 consensus_queue.cc:260] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.595280 17575 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.595862 17514 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.549356 17553 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:08.601878 16992 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:08.664472 12659 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:08.579061 17397 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.638263 17399 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:08.642277 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:08.645403 12617 raft_consensus.cc:2393] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:08.624609 12547 raft_consensus.cc:2393] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 11: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:08.649531 12616 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:08.641453 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:08.648041 17575 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:08.672034 17575 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:08.653190 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:08.653517 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:08.680862 12691 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:08.655965 13227 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:08.588850 17682 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.682512 17550 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:08.683204 17550 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.684345 17682 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:08.618096 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
W20260709 13:05:08.685053 17717 log.cc:927] Time spent T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.239s	user 0.003s	sys 0.000s
I20260709 13:05:08.685487 12546 raft_consensus.cc:2368] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18.
I20260709 13:05:08.580768 17649 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.686411 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:08.688445 12619 raft_consensus.cc:2393] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 17: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:08.678524 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:08.605141 17697 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:08.688450 17649 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:08.689414 17697 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.663640 17553 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:08.664307 16992 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:08.692039 17711 log.cc:927] Time spent T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:05:08.693671 16992 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:08.604626 13233 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:08.652647 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:08.695748 12689 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:05:08.695494 17677 consensus_queue.cc:260] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.697420 13229 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:08.699445 17697 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:08.651885 13228 raft_consensus.cc:606] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:08.703706 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:08.705505 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:08.706367 12696 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:08.665409 17397 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.710173 17488 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.710721 17488 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:08.711987 17397 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:08.712306 17550 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:08.716341 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:08.717149 12689 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:05:08.718804 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:08.719856 12696 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 13: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:08.720948 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:08.725585 17488 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:08.679874 13197 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:08.673909 17583 raft_consensus.cc:3055] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:05:08.673158 17565 consensus_meta.cc:287] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.003s
I20260709 13:05:08.741391 17658 raft_consensus.cc:3055] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:08.774511 13232 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:08.734020 17642 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:08.748348 12513 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:08.739161 17569 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:08.666672 17514 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.677624 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:08.733774 17702 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:08.727246 17631 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:08.740661 17716 log.cc:927] Time spent T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.221s	user 0.002s	sys 0.000s
I20260709 13:05:08.607950 17650 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.872449 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1232) took 1998 ms. Trace:
I20260709 13:05:08.872999 12622 rpcz_store.cc:276] 0709 13:05:06.873713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:06.895140 (+ 21427us) service_pool.cc:224] Handling call
0709 13:05:06.900771 (+  5631us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:06.901204 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:06.901243 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:08.034635 (+1133392us) spinlock_profiling.cc:243] Waited 5.7 ms on lock 0x7b2c0004c3c8. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:05:08.035530 (+   895us) log.cc:844] Serialized 26 byte log entry
0709 13:05:08.168597 (+133067us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:08.168654 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:08.189312 (+ 20658us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:08.739509 (+550197us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:08.872028 (+132519us) raft_consensus.cc:1685] finished
0709 13:05:08.872052 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:08.872259 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":117,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":25136,"spinlock_wait_cycles":81098624,"thread_start_us":132484,"threads_started":1,"wal-append.queue_time_us":405994}
I20260709 13:05:08.874652 17650 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:08.690850 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 72809.4us
I20260709 13:05:08.876513 12662 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:08.710623 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:08.878546 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 209688us
I20260709 13:05:08.880808 12588 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:08.769701 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:08.774431 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:08.791603 17682 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:08.883455 17682 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:08.884501 17682 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:08.697463 17677 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:08.773211 17488 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:08.886405 17488 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:08.778286 12620 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:05:08.794381 17714 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:05:08.891083 17723 log.cc:927] Time spent T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.365s	user 0.002s	sys 0.000s
I20260709 13:05:08.795202 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:08.801791 13230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:08.892381 17488 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:08.892742 13230 raft_consensus.cc:606] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:08.893288 13230 raft_consensus.cc:614] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:08.895328 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:08.896164 13230 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:08.768981 17575 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.802816 17460 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:08.897990 17460 raft_consensus.cc:697] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:08.899168 17460 consensus_queue.cc:237] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:08.899658 17631 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:08.773909 17658 raft_consensus.cc:740] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:08.902367 17658 consensus_queue.cc:260] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.904654 17658 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:08.905764 17467 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:08.906467 17467 raft_consensus.cc:697] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:05:08.812633 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 132844us
I20260709 13:05:08.759374 17583 raft_consensus.cc:740] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:08.814920 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:08.835332 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:08.917626 13227 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:08.810669 17397 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:08.855177 13232 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:08.858266 17702 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:08.816828 17518 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:08.818466 17458 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:08.864878 17398 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:08.866087 17417 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:08.725030 17156 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:08.908259 13197 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:08.910979 12513 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:08.925504 13231 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:05:08.925788 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:08.927772 12615 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
W20260709 13:05:08.929551 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:08.861235 17514 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:08.937702 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:08.947417 13197 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:08.916326 17488 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:08.952463 13197 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:08.953217 12545 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:08.942445 17631 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:08.944936 17565 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:08.942632 17569 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:08.954994 17714 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:08.954903 12547 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 7.
I20260709 13:05:08.925916 17397 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.956351 17398 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:08.897598 17575 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:08.960269 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 295926us
I20260709 13:05:08.961107 17417 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:08.907403 17467 consensus_queue.cc:237] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.975313 12662 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:08.977656 17565 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:08.989271 17532 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:05:08.958441 17583 consensus_queue.cc:260] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:08.986698 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 106013us
I20260709 13:05:09.007236 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:08.973048 17631 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:08.976963 17534 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:09.011940 12659 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:09.004961 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 55167.5us
I20260709 13:05:09.010294 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:08.840662 12441 catalog_manager.cc:5697] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 9 to 13, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 13 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:08.981906 17550 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:09.020334 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:09.025975 12538 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:09.030683 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:09.017853 12689 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:05:09.033663 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:08.977101 17458 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:09.047120 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:08.970355 17518 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:09.047612 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:09.035589 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:09.046820 13231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:09.018497 17441 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:09.012444 17534 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.016961 17418 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:09.016978 17156 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:09.016768 17488 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:09.054857 13231 raft_consensus.cc:606] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:09.023957 17631 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:09.096403 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 82412.1us
W20260709 13:05:09.036965 17447 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.005s	sys 0.029s
I20260709 13:05:09.016811 17569 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:09.060549 16672 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:09.076424 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:09.035072 17583 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:09.077323 17534 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:09.020438 17650 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.048980 17514 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:05:09.100657 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:09.101330 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:09.080018 17156 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:09.100382 17578 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:09.059753 17441 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.117364 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:09.146898 13232 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:09.114614 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:09.119647 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:09.148630 12615 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:09.073424 17418 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:09.097056 12547 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
W20260709 13:05:09.105862 17447 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.005s	sys 0.029s
I20260709 13:05:09.090971 17488 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:09.126112 12588 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:09.130254 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:09.132835 12545 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:09.139986 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 151845us
I20260709 13:05:09.100857 17473 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:09.161226 12659 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:09.162088 12692 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.013s	sys 0.040s
W20260709 13:05:09.163859 12692 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.013s	sys 0.040s
I20260709 13:05:09.159981 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:09.166924 12689 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:09.171761 16672 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:09.172541 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:09.173453 13229 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:09.174729 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 48727.9us
W20260709 13:05:09.175796 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 76482.5us
W20260709 13:05:09.177145 12694 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.001s	sys 0.016s
W20260709 13:05:09.177948 12694 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.002s	sys 0.017s
I20260709 13:05:09.132002 17631 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.143074 17156 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:09.182868 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:09.184033 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:09.177471 12588 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:09.155161 17441 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:09.161428 17418 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:09.184279 17578 raft_consensus.cc:697] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:09.214726 17578 consensus_queue.cc:237] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:09.173152 17650 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:09.219504 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:09.219907 17650 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:09.220577 17650 consensus_queue.cc:1048] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:09.220947 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:09.221930 17473 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:09.222220 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:09.222972 13199 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:09.223237 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:09.224112 12691 raft_consensus.cc:2393] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 11: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:09.224507 13199 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:09.195822 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:09.198917 17551 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.165102 17488 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:09.199998 16672 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:09.200207 17398 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:09.181728 17697 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:05:09.202221 17722 log.cc:927] Time spent T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.490s	user 0.003s	sys 0.001s
I20260709 13:05:09.203719 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:05:09.203994 17417 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:09.206034 17397 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:09.206787 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:09.253944 12696 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:09.207346 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:09.254818 12695 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:09.187498 17631 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:09.257436 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:09.222116 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:09.222388 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:09.223053 12687 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:05:09.197077 12659 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:09.224118 17473 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:09.194444 17565 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:09.225904 12688 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:09.236861 17097 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:09.232939 13227 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
W20260709 13:05:09.267810 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:09.229439 13232 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
W20260709 13:05:09.261224 12618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.023s	sys 0.013s
I20260709 13:05:09.233428 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:09.234582 13199 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:09.179527 17031 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:09.236927 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:09.268769 12618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.024s	sys 0.013s
I20260709 13:05:09.269162 12538 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:09.239199 12545 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:09.201753 17702 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:09.270252 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:09.268735 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:09.271595 13233 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.006s	sys 0.028s
W20260709 13:05:09.272006 13233 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.006s	sys 0.028s
I20260709 13:05:09.255498 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:09.272534 12620 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:09.225265 16992 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:05:09.259896 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 62898.9us
I20260709 13:05:09.198464 17458 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:09.261698 16672 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:09.236970 17366 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.258445 12691 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:05:09.260846 12510 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:09.189455 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:09.153803 17569 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:09.247495 12441 catalog_manager.cc:5697] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 7 to 9, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 9 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:09.246901 17697 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:09.266430 13234 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.032s	sys 0.042s
W20260709 13:05:09.288671 13234 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.032s	sys 0.043s
I20260709 13:05:09.275909 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:09.275839 12690 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
W20260709 13:05:09.283015 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 212937us
W20260709 13:05:09.290498 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 101132us
I20260709 13:05:09.291239 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:09.298600 16672 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:09.301882 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:09.295547 17650 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:09.304144 17650 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:09.304520 17650 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:09.274636 16992 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.295380 17546 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:09.253496 17551 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:09.303395 17642 consensus_meta.cc:287] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.511s	user 0.013s	sys 0.000s
I20260709 13:05:09.295421 17697 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:09.318936 12696 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:09.295615 17702 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:09.322831 13232 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:09.323752 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:09.316825 17575 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:09.313455 16992 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:09.359659 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:09.375435 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:09.375731 16672 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:09.383591 12544 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:09.385360 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:09.383683 12543 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:05:09.295091 16989 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 13:05:09.301050 17366 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:09.323736 17702 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:09.373302 17397 raft_consensus.cc:2764] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:05:09.349990 17642 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:09.351620 17458 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:09.378135 17565 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:05:09.399747 17677 consensus_meta.cc:287] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.513s	user 0.014s	sys 0.000s
I20260709 13:05:09.415669 12441 catalog_manager.cc:5697] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:09.423966 12539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.013s	sys 0.010s
W20260709 13:05:09.424651 12539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.013s	sys 0.011s
W20260709 13:05:09.426417 17726 log.cc:927] Time spent T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:05:09.429721 17458 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:09.440380 17031 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:09.444144 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:09.445895 17551 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:09.446442 17569 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:09.451879 12441 catalog_manager.cc:5697] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:05:09.454115 17631 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:09.462924 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:09.467002 17366 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:09.407868 17702 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:09.398681 17583 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:05:09.433199 17458 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:09.416723 17565 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.457096 12687 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:09.486231 12545 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 7.
I20260709 13:05:09.484515 13229 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
W20260709 13:05:09.490017 17737 log.cc:927] Time spent T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 13:05:09.483083 17729 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
W20260709 13:05:09.484670 17727 log.cc:927] Time spent T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:05:09.486894 17031 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:09.525231 12614 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:09.513382 17532 raft_consensus.cc:2764] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:05:09.515204 17565 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:09.566916 12441 catalog_manager.cc:5697] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:09.594806 12513 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:09.599305 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:09.602074 12689 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:09.561847 17458 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:05:09.633292 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 387620us
I20260709 13:05:09.553866 17514 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:09.609513 17575 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:05:09.631880 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 319918us
I20260709 13:05:09.651389 13197 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:09.648347 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 372962us
W20260709 13:05:09.649025 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:09.656615 12587 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:09.660778 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1925) took 1077 ms. Trace:
I20260709 13:05:09.661507 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:09.656615 12659 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:09.666320 13233 raft_consensus.cc:2393] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 12: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:09.667131 12692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1921) took 1155 ms. Trace:
W20260709 13:05:09.673049 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 381860us
I20260709 13:05:09.684373 12659 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:09.686887 12588 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:09.665771 12694 rpcz_store.cc:276] 0709 13:05:08.583459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.599780 (+ 16321us) service_pool.cc:224] Handling call
0709 13:05:08.600158 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:08.600577 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:08.600609 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:08.601034 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:05:09.227862 (+626828us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:09.227901 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:09.227964 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:09.660075 (+432111us) raft_consensus.cc:1685] finished
0709 13:05:09.660256 (+   181us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:09.660684 (+   428us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":105,"thread_start_us":577375,"threads_started":1,"wal-append.queue_time_us":694406}
I20260709 13:05:09.667999 12692 rpcz_store.cc:276] 0709 13:05:08.511612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.511777 (+   165us) service_pool.cc:224] Handling call
0709 13:05:08.523625 (+ 11848us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:08.524020 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:08.524047 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:08.524569 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 13:05:09.165676 (+641107us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:09.165730 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:09.167954 (+  2224us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:09.664498 (+496544us) raft_consensus.cc:1685] finished
0709 13:05:09.664530 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:09.667048 (+  2518us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":138,"thread_start_us":640626,"threads_started":1,"wal-append.queue_time_us":774590}
I20260709 13:05:09.657279 17518 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:09.692935 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 312660us
I20260709 13:05:09.638723 17156 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:09.704015 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:09.738024 13233 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:09.701143 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:09.663666 17575 raft_consensus.cc:697] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:09.738937 12618 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:05:09.708575 16672 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:09.677609 17460 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:09.677965 17631 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:09.710981 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1050) took 1042 ms. Trace:
I20260709 13:05:09.678881 17514 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:09.711845 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 432166us
I20260709 13:05:09.693523 17677 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:09.659440 17458 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:09.741662 17441 consensus_meta.cc:287] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.549s	user 0.012s	sys 0.004s
I20260709 13:05:09.713032 12587 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:09.747299 17534 consensus_meta.cc:287] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.597s	user 0.014s	sys 0.001s
W20260709 13:05:09.760737 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 73907.4us
I20260709 13:05:09.761293 13200 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:09.783494 17575 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:09.784128 17417 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:09.799431 12614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 3432) took 1384 ms (client timeout 1824 ms). Trace:
I20260709 13:05:09.800407 17417 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:09.800976 12614 rpcz_store.cc:269] 0709 13:05:08.404461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.404612 (+   151us) service_pool.cc:224] Handling call
0709 13:05:09.789034 (+1384422us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b54003af2d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:09.789183 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2069281536}
I20260709 13:05:09.804222 17417 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:09.804467 12662 leader_election.cc:400] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18.
W20260709 13:05:09.800393 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 116275us
I20260709 13:05:09.805302 12662 leader_election.cc:403] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:05:09.827910 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 69505.9us
W20260709 13:05:09.794410 17728 log.cc:927] Time spent T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.310s	user 0.000s	sys 0.002s
I20260709 13:05:09.780130 17677 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:09.806409 17730 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.271s	user 0.001s	sys 0.001s
W20260709 13:05:09.828431 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 66372.2us
I20260709 13:05:09.835229 12659 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
W20260709 13:05:09.842736 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 136711us
I20260709 13:05:09.760646 17569 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:05:09.798928 17441 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:09.763229 17578 consensus_queue.cc:1048] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
W20260709 13:05:09.862771 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 78565.8us
I20260709 13:05:09.843328 17642 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:09.828075 17744 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.871867 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:09.872519 13232 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:09.876919 12513 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:09.840655 17677 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:09.883502 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 124535us
I20260709 13:05:09.848666 17714 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:09.840211 17467 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:09.865535 17741 log.cc:927] Time spent T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.072s	user 0.001s	sys 0.002s
I20260709 13:05:09.868810 17642 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.885927 12662 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:09.807011 17534 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:09.844835 17473 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:09.880960 17713 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:09.874020 17366 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:05:09.870854 17418 consensus_meta.cc:287] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.661s	user 0.014s	sys 0.000s
I20260709 13:05:09.867017 17417 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:09.929885 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:09.885670 17575 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:05:09.925096 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 89959.2us
I20260709 13:05:09.930158 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:09.931046 17642 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:09.939940 12543 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:09.885351 17127 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:09.954627 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:09.942570 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 146146us
I20260709 13:05:09.894956 17714 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.934902 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:09.890386 13199 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:09.945457 12695 consensus_meta.cc:287] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.678s	user 0.013s	sys 0.002s
I20260709 13:05:09.935933 17743 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:09.928170 17749 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:09.940552 17488 consensus_meta.cc:287] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.690s	user 0.010s	sys 0.003s
I20260709 13:05:09.946731 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:09.956758 17575 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:09.952564 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 54401.8us
I20260709 13:05:09.970734 17441 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:09.946883 17460 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.002931 17714 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:10.026677 17460 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:09.971156 17366 raft_consensus.cc:697] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:09.963634 12441 catalog_manager.cc:5697] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 5 to 7, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 7 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:09.964082 17417 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:09.984226 16992 consensus_meta.cc:287] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.584s	user 0.013s	sys 0.000s
I20260709 13:05:09.998448 17702 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:09.979099 17765 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:05:09.999389 17739 log.cc:927] Time spent T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.294s	user 0.003s	sys 0.000s
I20260709 13:05:09.969888 17127 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:09.953742 12547 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:09.990477 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1045) took 1383 ms. Trace:
I20260709 13:05:09.755062 13228 rpcz_store.cc:276] 0709 13:05:08.669823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.703998 (+ 34175us) service_pool.cc:224] Handling call
0709 13:05:08.704289 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:08.704534 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:05:09.284904 (+580370us) log.cc:844] Serialized 14 byte log entry
0709 13:05:09.699677 (+414773us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:09.699788 (+   111us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:09.710711 (+ 10923us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:09.710789 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:09.710916 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75031,"prepare.queue_time_us":90708,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":28907,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":32685,"thread_start_us":863832,"threads_started":2}
I20260709 13:05:09.939385 17473 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:09.956964 17740 raft_consensus.cc:993] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:05:10.024859 17488 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.058147 17740 raft_consensus.cc:1081] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:05:10.060189 17488 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:09.962976 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:10.066956 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 104246us
I20260709 13:05:10.068565 12588 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:05:10.001545 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 111572us
W20260709 13:05:10.003229 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 112971us
W20260709 13:05:10.001410 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 46557.5us
I20260709 13:05:10.069908 13199 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:10.071007 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:10.071862 12618 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:09.957007 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:09.956799 17731 log.cc:927] Time spent T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.278s	user 0.002s	sys 0.000s
W20260709 13:05:09.996306 17735 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.335s	user 0.000s	sys 0.005s
I20260709 13:05:09.885480 17744 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.007324 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3143) took 2097 ms. Trace:
W20260709 13:05:09.994354 17738 log.cc:927] Time spent T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.298s	user 0.001s	sys 0.001s
I20260709 13:05:10.083868 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:09.971223 17682 consensus_meta.cc:287] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 1.086s	user 0.015s	sys 0.003s
I20260709 13:05:10.010268 12545 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:09.931572 17753 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:09.983559 17156 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:10.007997 16989 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:10.092821 17518 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.093804 17518 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:10.095734 17744 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:10.011893 17458 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:09.952872 17418 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:09.955175 17732 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.293s	user 0.001s	sys 0.001s
I20260709 13:05:10.007364 17569 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:09.950824 17713 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.008467 12695 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:10.107542 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 1907) took 1082 ms. Trace:
W20260709 13:05:09.957367 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 244364us
I20260709 13:05:09.975648 17534 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:10.023525 17743 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.111104 13199 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:10.025014 17575 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:10.041373 12441 catalog_manager.cc:5697] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 6 to 9, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 9 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:10.050472 17650 consensus_meta.cc:287] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.746s	user 0.009s	sys 0.004s
I20260709 13:05:10.119195 17650 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.120265 17761 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.120924 17761 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.051311 17460 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:10.122395 17650 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:10.121855 12696 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:10.123211 17702 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:10.124287 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3157) took 1352 ms. Trace:
I20260709 13:05:10.052500 17417 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:10.125058 16989 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:10.125458 17569 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.124652 12542 rpcz_store.cc:276] 0709 13:05:08.772309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.772485 (+   176us) service_pool.cc:224] Handling call
0709 13:05:08.782426 (+  9941us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:08.782923 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:08.782973 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:08.783762 (+   789us) log.cc:844] Serialized 26 byte log entry
0709 13:05:09.268554 (+484792us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:09.268591 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:09.268652 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:10.124080 (+855428us) raft_consensus.cc:1685] finished
0709 13:05:10.124100 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:10.124229 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17822,"raft.queue_time_us":3687,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":17168,"thread_start_us":484301,"threads_started":1,"wal-append.queue_time_us":803771}
I20260709 13:05:10.127836 17650 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.096406 17753 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:10.128835 17650 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.054804 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:10.130167 12615 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:10.130681 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:10.131238 13235 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:10.132437 17753 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:10.036049 17366 consensus_queue.cc:237] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.120664 17714 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.042690 16992 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:10.135923 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:10.136617 13229 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:10.137603 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:10.138242 13228 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:05:10.138370 16992 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:10.057019 17473 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:10.121654 17740 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:10.046491 13234 rpcz_store.cc:276] 0709 13:05:08.606525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.610308 (+  3783us) service_pool.cc:224] Handling call
0709 13:05:08.610674 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:08.611061 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:08.611088 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:08.611558 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:05:09.289200 (+677642us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:09.289235 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:09.289294 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:09.990140 (+700846us) raft_consensus.cc:1685] finished
0709 13:05:09.990176 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:09.990362 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10968,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":651863,"threads_started":1,"wal-append.queue_time_us":799714}
I20260709 13:05:10.068953 12544 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:05:10.140607 12615 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:09.973768 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1127) took 1136 ms. Trace:
I20260709 13:05:10.142097 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:10.078058 16672 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:10.081130 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:10.142316 13197 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:10.143854 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:10.143947 12621 raft_consensus.cc:2368] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14.
I20260709 13:05:10.145274 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:10.145943 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:10.145994 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:10.086462 13232 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:10.088954 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:10.090092 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:10.090891 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:05:10.075181 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 118253us
I20260709 13:05:10.149186 12614 raft_consensus.cc:2410] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:05:10.082329 12539 rpcz_store.cc:276] 0709 13:05:07.909541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.399505 (+489964us) service_pool.cc:224] Handling call
0709 13:05:08.701229 (+301724us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b5800000c98. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:05:08.701445 (+   216us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:08.701955 (+   510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:08.701987 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:08.702500 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:05:09.474768 (+772268us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:09.474810 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:09.475044 (+   234us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:10.000152 (+525108us) raft_consensus.cc:1685] finished
0709 13:05:10.000186 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:10.007254 (+  7068us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7872,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":98,"spinlock_wait_cycles":6644480,"thread_start_us":722168,"threads_started":1,"wal-append.queue_time_us":717671}
I20260709 13:05:10.145174 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:10.150251 12621 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:05:10.153299 12513 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:10.100843 12547 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:05:10.096622 12619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:60170
I20260709 13:05:10.076601 17745 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:10.108748 12587 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:10.157025 12619 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:10.104967 12512 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:10.117492 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1795) took 1206 ms. Trace:
W20260709 13:05:10.157536 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 48856.5us
I20260709 13:05:10.129467 17569 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:10.046765 17749 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:10.139082 17650 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:10.157461 12619 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:10.107987 12695 rpcz_store.cc:276] 0709 13:05:09.025485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:09.025731 (+   246us) service_pool.cc:224] Handling call
0709 13:05:10.107481 (+1081750us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:10.160596 12615 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:10.146835 12688 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:10.159057 12587 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:10.176406 12587 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:10.177739 12587 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:10.179224 12587 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:10.169467 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:10.163329 17714 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:10.181061 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:10.182355 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:10.181265 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:10.182631 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:10.183214 13229 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:10.183959 12618 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:05:10.183319 12690 raft_consensus.cc:2368] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14.
I20260709 13:05:10.174846 12513 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:10.187666 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 45714.1us
I20260709 13:05:10.116004 17743 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:10.157730 12540 rpcz_store.cc:276] 0709 13:05:08.911033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.911138 (+   105us) service_pool.cc:224] Handling call
0709 13:05:08.939787 (+ 28649us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:08.953166 (+ 13379us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:08.953212 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:09.008955 (+ 55743us) log.cc:844] Serialized 26 byte log entry
0709 13:05:09.332577 (+323622us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:09.332717 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:09.332804 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:09.998417 (+665613us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:10.111799 (+113382us) raft_consensus.cc:1685] finished
0709 13:05:10.111825 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:10.117416 (+  5591us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2061,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":13584,"spinlock_wait_cycles":8316288,"thread_start_us":254449,"threads_started":1,"wal-append.queue_time_us":598135}
I20260709 13:05:10.068279 17765 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.215998 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:10.219215 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:10.219658 12688 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
W20260709 13:05:10.214643 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 101408us
I20260709 13:05:10.125639 16989 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:10.091830 17682 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.141966 12541 rpcz_store.cc:276] 0709 13:05:08.674009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:08.674230 (+   221us) service_pool.cc:224] Handling call
0709 13:05:08.760045 (+ 85815us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:08.786610 (+ 26565us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:05:08.810648 (+ 24038us) log.cc:844] Serialized 14 byte log entry
0709 13:05:09.268114 (+457466us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:09.287971 (+ 19857us) log.cc:844] Serialized 52 byte log entry
0709 13:05:09.288148 (+   177us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:09.288379 (+   231us) log.cc:844] Serialized 14 byte log entry
0709 13:05:09.288835 (+   456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:09.289011 (+   176us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:09.307532 (+ 18521us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b18003849a0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c3f3 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
0709 13:05:09.810249 (+502717us) raft_consensus.cc:1685] finished
0709 13:05:09.810277 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:09.810445 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22208,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":102,"raft.queue_time_us":250,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":4157,"spinlock_wait_cycles":6871936,"thread_start_us":457117,"threads_started":1,"wal-append.queue_time_us":593316}
W20260709 13:05:10.226668 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 158171us
W20260709 13:05:10.183512 17565 consensus_meta.cc:287] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.566s	user 0.012s	sys 0.002s
I20260709 13:05:10.225369 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:10.223356 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:10.229501 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 50358.5us
I20260709 13:05:10.229873 12696 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:05:10.230074 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 70046.6us
I20260709 13:05:10.229766 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:10.185899 16992 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:10.234328 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:10.235065 12696 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:10.236138 12613 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:05:10.236536 17746 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:10.239042 17713 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:10.243202 17031 consensus_meta.cc:287] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.687s	user 0.007s	sys 0.006s
I20260709 13:05:10.243554 17682 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:10.243952 17565 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:10.244546 17682 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:10.188827 17515 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:10.245478 12687 raft_consensus.cc:2393] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 12: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:10.219976 12694 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:10.186568 17488 raft_consensus.cc:2764] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:05:10.167776 17761 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:10.214578 17156 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:10.245302 17682 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:10.256475 12622 raft_consensus.cc:2393] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 9: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:10.259344 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:10.220700 17740 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:10.268630 17767 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:10.268791 12617 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:10.269395 12688 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:10.225523 16989 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:10.272300 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:10.296094 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 191257us
I20260709 13:05:10.279228 12588 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:10.288160 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:10.284919 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 110146us
I20260709 13:05:10.273525 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:10.298905 12691 raft_consensus.cc:2393] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 11: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:10.265533 12615 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:10.288056 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:10.272400 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:10.246281 17565 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:10.299762 12689 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:05:10.273129 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:10.257750 17569 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:10.300853 13233 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 14: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:05:10.302076 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 70695.6us
I20260709 13:05:10.256929 17515 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:10.269914 17697 consensus_meta.cc:287] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.879s	user 0.013s	sys 0.000s
I20260709 13:05:10.308706 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:10.298911 12619 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.323526 12613 raft_consensus.cc:2393] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 13: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:10.318406 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:10.318419 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:10.318776 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:10.273784 17682 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.326397 13230 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:05:10.331926 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:10.336766 12693 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:10.339540 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:10.269527 17753 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:10.344964 13235 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:10.243692 17031 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.308404 16992 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:10.347136 12619 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:10.303423 17745 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.309288 17740 raft_consensus.cc:697] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:10.332077 17578 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:10.355883 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 76610.7us
I20260709 13:05:10.321623 17515 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:10.362645 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:10.365532 12691 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:05:10.321393 17583 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:10.356864 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:10.308631 17767 raft_consensus.cc:697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:10.382056 12659 leader_election.cc:400] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14.
I20260709 13:05:10.382496 12659 leader_election.cc:403] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:10.358035 12512 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:10.367125 12614 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:10.369040 13227 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:10.351797 17097 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:10.376394 13226 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:05:10.376040 16989 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.378238 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:10.343396 17758 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:10.379819 17766 log.cc:927] Time spent T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:05:10.402464 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:10.340041 17682 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:10.334169 17697 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:10.310192 17642 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:10.321472 17534 consensus_queue.cc:1059] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:05:10.398864 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:10.417255 12619 raft_consensus.cc:2368] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13.
I20260709 13:05:10.387928 12696 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:10.412563 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:05:10.438887 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 80955.3us
I20260709 13:05:10.389509 17397 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.359342 17753 raft_consensus.cc:697] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:10.447312 12618 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:05:10.359556 17745 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:10.399925 16989 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:10.402817 17565 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:10.398944 17768 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:10.414671 17417 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:10.446868 17677 consensus_meta.cc:287] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.000s
I20260709 13:05:10.437381 17460 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:05:10.460142 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 57776.7us
I20260709 13:05:10.387182 16992 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:10.472996 12619 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:10.452685 17713 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:10.485291 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 103416us
I20260709 13:05:10.407399 17583 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.383864 17578 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.398742 17758 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.489506 12693 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:10.470383 12588 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:10.453080 17782 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14.
I20260709 13:05:10.462977 17702 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:10.506165 12619 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:05:10.492586 12659 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:10.401906 17097 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.468852 17780 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:10.457590 17565 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:10.467667 17156 raft_consensus.cc:697] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:10.525924 17583 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:10.495055 17713 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.526890 17156 consensus_queue.cc:237] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.494823 17460 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.529583 17031 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:10.533905 17565 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:10.504340 12588 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:10.475179 17127 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:10.504276 17550 raft_consensus.cc:993] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:05:10.490756 17417 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:10.457664 17397 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.459789 17767 consensus_queue.cc:237] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.491729 17777 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.513760 17782 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:10.515035 12689 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:10.522923 17578 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:10.475313 17677 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.523844 17785 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:10.517616 12659 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:10.457472 17776 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
W20260709 13:05:10.629027 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 111756us
I20260709 13:05:10.467358 17768 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.630872 12659 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
W20260709 13:05:10.633736 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 129452us
I20260709 13:05:10.634156 17791 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:10.602329 17127 raft_consensus.cc:1081] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:05:10.644356 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:10.642568 17417 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:10.546631 17749 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:10.653759 17578 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:10.657873 17784 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:10.654067 17397 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:10.665903 13228 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:10.670123 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:10.663765 17682 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.659068 16672 consensus_queue.cc:1059] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:10.663878 12588 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:10.584483 17780 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.667317 17677 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:10.617923 17031 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:10.690701 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:10.699855 17793 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:10.709535 17417 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:10.709403 17788 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.710175 17417 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:10.710359 17788 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:10.715075 17097 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:10.717321 17790 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:10.718012 17790 raft_consensus.cc:697] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:10.719760 17518 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:10.719862 17790 consensus_queue.cc:237] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:10.721910 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 281625us
I20260709 13:05:10.648623 17583 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:10.650671 17713 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:10.691457 17751 log.cc:927] Time spent T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.696s	user 0.004s	sys 0.000s
I20260709 13:05:10.491081 17740 consensus_queue.cc:237] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.574918 17575 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.688319 17749 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:10.630434 17473 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:10.723206 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:10.693001 17785 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:10.519099 17753 consensus_queue.cc:237] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:10.740556 17788 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:10.741194 17768 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:10.729265 17793 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.705204 17578 raft_consensus.cc:697] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:10.617782 17777 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.764987 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:10.727062 17583 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.729830 17782 raft_consensus.cc:3055] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:10.731436 17642 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:10.779145 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:10.780990 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:10.782016 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:10.783957 12616 raft_consensus.cc:2393] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 12: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:10.787503 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:10.692828 17784 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:10.787164 12619 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 13: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:05:10.789357 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 132379us
I20260709 13:05:10.761276 17460 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:10.793855 17583 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:10.796427 12620 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:10.730113 17031 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:10.787041 12512 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:10.777905 17776 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.767300 17631 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:10.801962 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:10.706319 17780 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.806399 17793 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:10.809773 17775 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:10.798228 17765 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:10.794090 17782 raft_consensus.cc:740] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:10.814600 12619 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:10.813066 17702 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:10.830964 17702 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:10.817284 12512 leader_election.cc:400] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14.
I20260709 13:05:10.817816 17783 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:10.818521 17578 consensus_queue.cc:237] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:10.819074 17784 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:10.819394 17631 raft_consensus.cc:697] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:10.804188 12659 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:10.825577 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:10.851439 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 47350.9us
I20260709 13:05:10.851747 12622 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:10.852356 12659 leader_election.cc:400] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13.
I20260709 13:05:10.833912 12512 leader_election.cc:403] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:10.852972 12659 leader_election.cc:403] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:05:10.858474 17784 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13.
I20260709 13:05:10.855891 17565 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.862697 17784 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:10.856612 17441 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:05:10.863346 17631 consensus_queue.cc:237] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.864837 17784 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:10.866335 16992 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:10.866585 17777 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:10.866715 12659 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:10.868996 17658 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:10.869505 17658 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:10.869958 17031 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:10.870146 17658 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:10.854094 12512 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:10.876319 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:10.843231 17783 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:10.881808 12512 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:05:10.872735 17467 consensus_meta.cc:287] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.952s	user 0.009s	sys 0.005s
I20260709 13:05:10.886472 17780 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:10.816490 17776 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.889925 17782 consensus_queue.cc:260] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:10.895380 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:10.834009 17775 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.898276 17575 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:10.903169 12512 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:10.876179 17795 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:10.883231 17682 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:10.885190 17518 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:10.913158 17795 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.915724 17795 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:10.885066 17783 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:10.918955 17702 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:10.914016 17772 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:10.922045 17460 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:10.922915 17460 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.925215 17460 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:10.925370 17744 raft_consensus.cc:3055] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:10.909116 17473 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:10.905723 17467 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18.
I20260709 13:05:10.915752 17518 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.935257 17518 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:10.935882 17514 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:10.936991 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:10.938102 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:10.938916 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:10.939390 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:10.939946 12696 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:05:10.940176 12687 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:10.940873 12619 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:10.927034 13199 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:10.942090 17776 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:10.942654 17532 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:10.943074 17532 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:10.943406 17532 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:10.943948 17775 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:10.929104 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:10.946468 17782 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:10.948042 17743 consensus_meta.cc:287] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.691s	user 0.009s	sys 0.004s
I20260709 13:05:10.948585 17743 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:10.932034 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:10.938030 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:10.950582 12690 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:05:10.925899 17744 raft_consensus.cc:740] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:10.952204 17744 consensus_queue.cc:260] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:10.955772 13199 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:10.960451 13199 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:05:10.959944 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 56871.7us
I20260709 13:05:11.017257 17772 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:10.979601 17441 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14.
I20260709 13:05:10.953168 17744 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:10.968461 17515 consensus_meta.cc:287] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.578s	user 0.008s	sys 0.006s
I20260709 13:05:11.039230 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:11.043155 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:10.970254 17514 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:11.017513 17534 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:05:11.032649 17569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.004s	sys 0.043s
W20260709 13:05:11.044400 17745 consensus_meta.cc:287] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.583s	user 0.004s	sys 0.009s
I20260709 13:05:11.054378 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:11.070185 12696 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:11.055648 17763 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:11.037881 17578 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.066910 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:11.055064 17515 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:11.056209 17569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.006s	sys 0.043s
I20260709 13:05:11.074417 12694 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:05:11.056219 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:11.048949 17565 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:11.055199 17534 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.081223 12513 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:11.076474 12662 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:11.082858 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:11.087404 12546 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:05:11.089115 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:11.090463 12541 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:05:11.094528 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:11.068243 17775 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:11.101436 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:11.096586 12692 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:05:11.102535 12695 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:11.097263 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 3441) took 1017 ms. Trace:
I20260709 13:05:11.097818 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:11.096267 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:11.074065 17763 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:11.104209 12616 rpcz_store.cc:276] 0709 13:05:10.080019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:10.080186 (+   167us) service_pool.cc:224] Handling call
0709 13:05:11.096911 (+1016725us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b54000992d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:11.097056 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461955328}
I20260709 13:05:11.106321 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:11.108422 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3164) took 1165 ms. Trace:
I20260709 13:05:11.110838 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:11.111480 13231 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:11.074738 17514 raft_consensus.cc:697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:11.109396 12544 rpcz_store.cc:276] 0709 13:05:09.937977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:09.938096 (+   119us) service_pool.cc:224] Handling call
0709 13:05:11.102875 (+1164779us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54003be2d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:11.103208 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244890368}
I20260709 13:05:11.079667 17569 raft_consensus.cc:697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:11.086536 17575 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:11.095108 17534 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:11.119678 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:11.123709 17575 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.120615 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:11.105154 17031 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:11.127631 13229 raft_consensus.cc:1240] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:11.122601 12659 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:11.106009 17772 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:11.116130 17127 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.133736 17532 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.135409 12696 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:11.143234 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:11.118643 17467 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:11.074910 17745 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.112905 17763 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:11.146265 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:11.075979 17518 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:11.086330 17578 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.150977 12547 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:11.143149 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:11.089251 17783 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:11.154913 13231 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:11.159364 12695 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:11.159997 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:11.179085 12688 raft_consensus.cc:2393] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 9: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:11.160410 13200 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:11.181439 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:11.185425 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:11.191468 13231 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:11.189280 12541 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:11.189388 13229 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:11.181360 12587 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:11.180790 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:11.190452 17768 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:11.198889 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:11.199505 17532 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:11.190050 17418 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:11.200947 17753 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:11.201470 17753 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.202139 17753 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:11.202472 17515 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:11.203835 17658 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.205399 12687 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:11.206116 17807 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:11.206547 17578 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:11.206709 17807 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:11.167935 17772 raft_consensus.cc:697] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:11.211972 17518 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:11.211795 17772 consensus_queue.cc:237] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.160282 17467 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.213256 17467 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:11.169725 17784 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:11.216176 17417 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:11.190174 17747 raft_consensus.cc:2764] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:05:11.160038 17127 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.219868 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:11.220367 17127 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:11.221402 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:11.224498 12688 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:11.225965 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:11.226855 12695 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:11.225984 12587 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:11.116889 17775 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.265626 12587 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:11.269519 13235 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:11.271507 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:11.278556 12659 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:11.279970 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:11.281235 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 1269) took 1142 ms. Trace:
I20260709 13:05:11.292157 12615 rpcz_store.cc:276] 0709 13:05:10.139219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:10.141808 (+  2589us) service_pool.cc:224] Handling call
0709 13:05:11.281008 (+1139200us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b54001caf54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:11.281158 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33670528}
W20260709 13:05:11.293522 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 105067us
I20260709 13:05:11.297299 13200 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:11.299115 13200 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:11.308272 13200 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:11.303962 13231 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:11.277215 17565 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:11.263926 17807 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:11.318848 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:11.316079 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:11.320161 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:11.321094 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:11.329780 13229 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:05:11.301349 17460 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:05:11.333451 17783 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:11.337423 17795 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:11.322489 17514 consensus_queue.cc:237] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:11.339273 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:11.340059 17795 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:11.289240 17583 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:11.340060 13234 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:11.284188 17749 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:11.282286 17518 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:11.342609 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:11.344091 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:11.345396 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:11.384969 12619 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:11.320998 17532 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:11.317701 17677 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:11.390357 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:11.391101 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:11.393026 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:11.393051 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:11.322512 17782 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:11.399506 13233 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:11.400645 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:11.401309 12690 raft_consensus.cc:2368] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 11. Current term is 12.
I20260709 13:05:11.317896 17740 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:11.319087 17565 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:11.401604 12687 raft_consensus.cc:2393] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 12: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:11.403612 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:11.387362 13231 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:11.291617 17418 consensus_queue.cc:1059] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.094s
I20260709 13:05:11.346148 17749 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.408263 12662 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:11.405588 13235 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:11.409440 12619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:60170
W20260709 13:05:11.408461 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 175480us
I20260709 13:05:11.416049 12619 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:11.408253 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:11.416658 12619 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:11.279717 17569 consensus_queue.cc:237] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:11.431871 12513 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:11.431303 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:11.400890 17782 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.434125 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:11.441625 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:11.442847 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:11.443946 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:11.446503 17031 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:11.411018 17565 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:11.473352 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:11.474535 12542 raft_consensus.cc:2368] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10.
I20260709 13:05:11.475867 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:11.476725 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:11.425546 17749 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:11.477638 17031 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:11.451975 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3446) took 1365 ms. Trace:
I20260709 13:05:11.453491 17575 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:11.457432 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:11.458133 12543 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:05:11.446614 17795 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:11.468252 17532 raft_consensus.cc:697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:11.434208 17441 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:11.430774 17417 consensus_queue.cc:1059] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:05:11.461740 17782 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:11.407362 17740 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:11.449265 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:11.477437 12547 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:11.457108 17682 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:11.481632 13232 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:11.451539 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:11.516479 12545 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:11.478441 12540 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:05:11.492220 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:11.492614 13230 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:05:11.495841 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:11.501886 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:11.506032 12619 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.447702 17418 raft_consensus.cc:3055] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:11.514031 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:11.510689 12538 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:11.588418 12544 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:05:11.592386 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:11.592526 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 155973us
I20260709 13:05:11.496500 12621 rpcz_store.cc:276] 0709 13:05:10.086264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:10.181010 (+ 94746us) service_pool.cc:224] Handling call
0709 13:05:10.181337 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:10.259482 (+ 78145us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:10.403383 (+143901us) log.cc:844] Serialized 14 byte log entry
0709 13:05:10.688602 (+285219us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:10.689245 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 13:05:10.689417 (+   172us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:10.689451 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:11.451311 (+761860us) spinlock_profiling.cc:243] Waited 77.7 ms on lock 0x7b54002a7bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:11.451363 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:11.451412 (+    49us) raft_consensus.cc:1685] finished
0709 13:05:11.451521 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:11.451912 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":211835,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":126875,"raft.run_cpu_time_us":395,"raft.run_wall_time_us":14036,"spinlock_wait_cycles":178749824,"thread_start_us":313474,"threads_started":3,"wal-append.queue_time_us":155970}
I20260709 13:05:11.598359 12547 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:05:11.598443 12513 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:11.602861 12694 raft_consensus.cc:2368] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14.
I20260709 13:05:11.585940 17418 raft_consensus.cc:740] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:11.608989 17418 consensus_queue.cc:260] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.610857 17418 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:11.611779 17658 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:11.458043 17518 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.613873 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:11.516716 17740 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:11.614627 12538 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:11.616518 12619 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:11.614095 17518 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:11.618793 17775 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:11.619148 17798 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.780s	user 0.002s	sys 0.002s
I20260709 13:05:11.586378 17772 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:11.620842 17772 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.621945 17532 consensus_queue.cc:237] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.622054 17583 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:05:11.614200 17812 log.cc:927] Time spent T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 13:05:11.508724 17031 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:11.648941 12688 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:05:11.628139 12513 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:11.603295 17682 raft_consensus.cc:697] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:11.595279 17458 raft_consensus.cc:3055] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:11.654975 12513 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:11.667263 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.665376 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:11.642119 17702 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:11.670990 12538 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 15: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:11.517179 17441 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.672960 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:11.666639 17534 consensus_meta.cc:287] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.543s	user 0.009s	sys 0.003s
I20260709 13:05:11.602075 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:11.684450 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 238764us
I20260709 13:05:11.699913 13197 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:11.707357 12510 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:11.706583 17682 consensus_queue.cc:237] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.664155 17775 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:11.709992 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:11.670854 17514 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:11.660529 17458 raft_consensus.cc:740] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:11.621147 17763 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.646652 17753 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:11.718519 12545 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:11.718744 12542 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:11.721406 12538 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:11.722429 12547 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:05:11.510193 17783 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.203s
I20260709 13:05:11.727846 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:11.514873 17575 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:11.729277 17816 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:05:11.745510 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:11.745728 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3447) took 1658 ms. Trace:
I20260709 13:05:11.710966 17815 consensus_queue.cc:1059] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:05:11.748251 12618 rpcz_store.cc:276] 0709 13:05:10.087053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:10.215978 (+128925us) service_pool.cc:224] Handling call
0709 13:05:10.216323 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:10.453250 (+236927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:11.745412 (+1292162us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54001cb954. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:11.745667 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":530666880}
I20260709 13:05:11.753129 13226 raft_consensus.cc:1240] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:11.757787 17825 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:11.757958 17784 consensus_meta.cc:287] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.543s	user 0.003s	sys 0.007s
I20260709 13:05:11.758685 17784 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:11.758494 17825 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.724576 17534 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.770670 17534 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:11.771427 17825 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:11.776000 17697 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:11.777999 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1260) took 1623 ms. Trace:
I20260709 13:05:11.761801 17417 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:11.778656 13228 rpcz_store.cc:276] 0709 13:05:10.154828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:10.154991 (+   163us) service_pool.cc:224] Handling call
0709 13:05:10.182087 (+ 27096us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:10.685054 (+502967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:11.777583 (+1092529us) spinlock_profiling.cc:243] Waited 484 ms on lock 0x7b540022e054. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:11.777939 (+   356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1112182528}
I20260709 13:05:11.779142 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:11.766690 17473 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:11.780189 17473 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:11.781877 12613 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:05:11.783039 17473 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:11.767161 17753 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:11.765247 17565 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.787545 12615 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:05:11.739470 17550 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:11.779317 17417 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:11.789294 17417 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:11.791013 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:11.742898 17827 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:11.793920 17827 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.796748 17827 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:11.799106 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:11.800402 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:11.801054 12542 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
W20260709 13:05:11.820351 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 52360us
I20260709 13:05:11.821942 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:11.823817 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:11.801540 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:11.815184 13232 raft_consensus.cc:2376] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11. Re-sending same reply.
I20260709 13:05:11.828110 12690 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:05:11.828817 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:11.829749 12690 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:05:11.749384 17467 consensus_meta.cc:287] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.536s	user 0.011s	sys 0.000s
I20260709 13:05:11.787654 17740 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.835825 17458 consensus_queue.cc:260] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:11.837216 12689 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 1249) took 1505 ms (client timeout 2000 ms). Trace:
I20260709 13:05:11.837658 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:11.746726 17783 consensus_queue.cc:1243] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:05:11.807982 17744 consensus_meta.cc:287] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.753s	user 0.013s	sys 0.000s
I20260709 13:05:11.844043 17127 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:05:11.842758 12689 rpcz_store.cc:269] 0709 13:05:10.331807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:10.358905 (+ 27098us) service_pool.cc:224] Handling call
0709 13:05:11.836993 (+1478088us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b540009f454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:11.837146 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":290822528}
I20260709 13:05:11.845995 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:11.853749 12687 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:11.855785 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:11.858848 13199 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:11.832516 17823 log.cc:927] Time spent T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.095s	user 0.001s	sys 0.003s
W20260709 13:05:11.832255 17804 log.cc:927] Time spent T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.688s	user 0.006s	sys 0.000s
W20260709 13:05:11.832196 17799 log.cc:927] Time spent T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.758s	user 0.001s	sys 0.008s
W20260709 13:05:11.832422 17829 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.066s	user 0.000s	sys 0.004s
W20260709 13:05:11.834578 17814 log.cc:927] Time spent T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.361s	user 0.000s	sys 0.009s
I20260709 13:05:11.803555 17758 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:11.883411 12696 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:11.886303 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:11.824497 17575 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.838495 17460 consensus_queue.cc:1059] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:05:11.911538 12687 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:11.916616 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:11.917726 13199 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:11.909632 17514 raft_consensus.cc:697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:11.919433 17514 consensus_queue.cc:237] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.920120 17740 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:11.920984 17740 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:11.894941 17744 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:11.922070 17744 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:11.856315 17366 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
W20260709 13:05:11.922454 12692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 1931) took 1779 ms (client timeout 1722 ms). Trace:
W20260709 13:05:11.923913 12692 rpcz_store.cc:269] 0709 13:05:10.143365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:10.145018 (+  1653us) service_pool.cc:224] Handling call
0709 13:05:11.922246 (+1777228us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54000c67d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:11.922382 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1814829824}
I20260709 13:05:11.893046 17458 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:11.921471 17740 raft_consensus.cc:697] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:11.924657 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:11.926024 17460 raft_consensus.cc:3055] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:11.926414 17460 raft_consensus.cc:740] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:11.927241 17460 consensus_queue.cc:260] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:11.928380 12693 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:11.850039 17467 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.923287 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3168) took 1773 ms. Trace:
I20260709 13:05:11.922444 17744 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:11.929849 12539 rpcz_store.cc:276] 0709 13:05:10.150103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.269374 (+1119271us) service_pool.cc:224] Handling call
0709 13:05:11.280023 (+ 10649us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:11.283185 (+  3162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:11.283226 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:11.283735 (+   509us) log.cc:844] Serialized 26 byte log entry
0709 13:05:11.670642 (+386907us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:11.670673 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:11.670723 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:11.923076 (+252353us) raft_consensus.cc:1685] finished
0709 13:05:11.923096 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:11.923231 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1501,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":5894,"thread_start_us":386563,"threads_started":1,"wal-append.queue_time_us":452824}
I20260709 13:05:11.937031 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:11.938071 12689 raft_consensus.cc:2376] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18. Re-sending same reply.
I20260709 13:05:11.941448 12695 raft_consensus.cc:2393] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 15: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:05:11.944351 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 122488us
I20260709 13:05:11.936388 17460 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:11.922866 17782 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:11.927078 17740 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:11.958086 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 250815us
I20260709 13:05:11.974547 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:11.974892 17763 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:11.961236 17658 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 13:05:11.958081 17441 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:11.968636 17775 raft_consensus.cc:697] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:11.958719 17702 raft_consensus.cc:697] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:12.003064 17658 raft_consensus.cc:3055] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:12.003517 17658 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:12.003934 17775 consensus_queue.cc:237] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:12.004571 17658 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:12.002516 17702 consensus_queue.cc:237] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:12.006665 17658 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:11.970009 17565 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:12.030360 12687 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:05:12.030961 12687 pending_rounds.cc:85] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 10
I20260709 13:05:12.031226 12687 pending_rounds.cc:107] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:05:12.031543 12687 raft_consensus.cc:2889] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:12.034209 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:12.034677 17467 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:12.035023 12539 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
W20260709 13:05:12.038914 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 78350us
I20260709 13:05:12.043325 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:12.043990 12692 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 14: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:12.049939 12512 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:12.050912 12512 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:12.053015 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:12.044935 12587 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:12.055876 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:12.062783 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:12.063689 12613 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:12.064746 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:12.014192 17417 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:12.065598 12620 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:12.065062 12621 raft_consensus.cc:2393] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 9: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:12.066107 12619 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:05:12.137372 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:12.085314 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1946) took 1045 ms. Trace:
I20260709 13:05:12.073844 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:12.134531 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:12.093782 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:12.077484 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:12.078064 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:12.143812 13227 raft_consensus.cc:2393] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 15: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:12.143890 12690 raft_consensus.cc:2368] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15.
I20260709 13:05:12.134294 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:12.074967 12538 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:12.076323 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:12.072072 12694 raft_consensus.cc:1275] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:12.141494 12616 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 14: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:12.147506 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:12.074378 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:12.128641 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 62099.1us
W20260709 13:05:12.048278 17749 consensus_meta.cc:287] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.556s	user 0.013s	sys 0.000s
I20260709 13:05:12.162417 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:12.140667 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.140964 12693 rpcz_store.cc:276] 0709 13:05:11.040132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.040310 (+   178us) service_pool.cc:224] Handling call
0709 13:05:11.922869 (+882559us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:11.928796 (+  5927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:12.085088 (+156292us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b54000c67d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:12.085244 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2028802816}
I20260709 13:05:12.113025 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:12.040112 17834 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:12.153232 12512 leader_election.cc:400] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14.
I20260709 13:05:12.170322 12512 leader_election.cc:403] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260709 13:05:12.161511 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.060294 17743 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:12.147936 17783 consensus_queue.cc:1059] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:05:12.173998 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:12.068373 12587 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:12.092051 17753 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:05:12.178591 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 110353us
I20260709 13:05:12.174952 12512 leader_election.cc:400] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 11. Current term is 12.
I20260709 13:05:12.080029 17682 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:12.181075 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:05:12.230196 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 216392us
I20260709 13:05:12.185745 12512 leader_election.cc:403] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:05:12.065341 17832 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:12.186622 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:12.362898 12538 raft_consensus.cc:2393] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 9: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:12.080590 17782 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:12.079698 17575 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:12.091817 17441 consensus_queue.cc:1059] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 13:05:12.328745 12616 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:12.367375 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.370785 12613 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:12.371788 12513 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:12.185122 17753 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:12.324486 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 136395us
I20260709 13:05:12.187327 17473 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:12.327934 12696 raft_consensus.cc:2410] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:05:12.083844 17031 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:12.186609 17770 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.297784 17772 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:12.329471 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:12.343350 17682 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:12.341269 17795 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.178239 17775 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:12.230376 17697 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:05:12.084803 17744 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:12.366432 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 191605us
I20260709 13:05:12.366545 12620 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:12.176671 17834 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:12.382375 12587 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:12.384143 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:12.173852 17749 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:12.386991 12622 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 3459) took 1513 ms (client timeout 1720 ms). Trace:
I20260709 13:05:12.234223 17840 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.187s
I20260709 13:05:12.374488 17783 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:12.368366 17832 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:12.482559 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:12.478582 13235 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:12.428470 12616 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:12.437352 12512 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:05:12.488651 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 51389.2us
I20260709 13:05:12.489807 12512 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:12.444250 12689 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 17. Current term is 18. Ops: []
W20260709 13:05:12.491192 12622 rpcz_store.cc:269] 0709 13:05:10.873543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:10.878134 (+  4591us) service_pool.cc:224] Handling call
0709 13:05:12.298233 (+1420099us) spinlock_profiling.cc:243] Waited 8.93 ms on lock 0x7b58001f4198. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae53f0a0 00007fc3ae53e984 00007fc3a7ab96d4 00007fc3a7ab9662
0709 13:05:12.386931 (+ 88698us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20543232}
I20260709 13:05:12.395920 17682 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:12.396556 17441 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:12.388164 17550 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.415704 17583 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.415987 17460 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:12.387564 17753 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:12.403798 17473 raft_consensus.cc:697] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 15 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:12.483556 17832 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:12.523072 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:12.523874 13235 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:12.508368 17575 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:05:12.548066 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 166048us
I20260709 13:05:12.514088 17550 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:12.403483 17770 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:12.523304 17417 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:12.454388 17772 consensus_queue.cc:1059] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 13:05:12.529304 17743 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.557901 12542 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:12.559415 12659 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:12.515596 17460 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:12.492542 17795 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:12.513942 17583 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:12.526796 17458 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:05:12.575434 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:12.558851 17745 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:12.559126 17697 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:12.584620 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:12.562529 17857 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:12.566335 17743 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:12.554450 17514 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:05:12.613154 17460 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:12.621863 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:12.613657 17860 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:12.617369 13228 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:05:12.572265 17782 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:05:12.611552 17848 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.131s	user 0.002s	sys 0.000s
W20260709 13:05:12.618760 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 101025us
I20260709 13:05:12.624336 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:12.637835 12547 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:12.623544 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 73958.8us
I20260709 13:05:12.629958 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:12.643167 12688 raft_consensus.cc:2368] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14.
I20260709 13:05:12.647778 12587 leader_election.cc:400] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15.
I20260709 13:05:12.648478 12587 leader_election.cc:403] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:05:12.648643 13228 pending_rounds.cc:85] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Aborting all ops after (but not including) 10
I20260709 13:05:12.649526 13228 pending_rounds.cc:107] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:05:12.649880 13228 raft_consensus.cc:2889] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:12.650645 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:12.656224 17550 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:12.643384 17460 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:12.648893 17752 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.657660 17460 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:12.658555 17752 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:12.660977 17752 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:12.627941 17031 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:12.667462 13199 leader_election.cc:400] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14.
I20260709 13:05:12.670357 13199 leader_election.cc:403] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:05:12.645352 17418 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:12.679587 12545 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:12.619493 17697 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:12.687630 17743 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:12.688755 17697 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:12.689203 17841 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.234s	user 0.000s	sys 0.003s
W20260709 13:05:12.666252 17854 log.cc:927] Time spent T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:05:12.693264 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:12.694680 17852 log.cc:927] Time spent T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:05:12.694823 17550 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:12.695459 17550 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:12.694873 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:12.633769 17744 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:12.696970 12691 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:12.702679 13199 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:12.645886 17857 raft_consensus.cc:697] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:12.661887 17745 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.666791 17770 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:12.661463 17460 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:12.706694 12588 leader_election.cc:400] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10.
I20260709 13:05:12.692328 17795 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:12.668423 17749 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:12.698438 17858 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:12.610090 17473 consensus_queue.cc:237] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:12.697781 17861 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.713078 12547 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:12.708482 17752 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:12.723351 17752 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:12.723649 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1812) took 1284 ms. Trace:
I20260709 13:05:12.723848 17752 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:12.724082 12546 rpcz_store.cc:276] 0709 13:05:11.439372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.442503 (+  3131us) service_pool.cc:224] Handling call
0709 13:05:12.723418 (+1280915us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54002eb3d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:12.723596 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124258176}
I20260709 13:05:12.725541 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:12.661528 17575 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:05:12.690536 17768 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14.
I20260709 13:05:12.696640 17834 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:12.713774 12588 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:12.700040 17418 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:12.717963 17782 raft_consensus.cc:697] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:12.738601 12588 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:12.753845 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:12.755307 12588 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:12.764214 17418 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:12.764940 17418 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.766755 17550 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:12.767966 12622 raft_consensus.cc:1240] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:12.769438 17857 consensus_queue.cc:237] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:12.769860 17749 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:12.770681 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:12.710493 17745 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:12.771023 17775 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14.
I20260709 13:05:12.792564 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1270) took 1457 ms. Trace:
I20260709 13:05:12.783250 12588 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:12.742146 17697 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:12.782913 17863 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:12.773860 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:12.770969 17583 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:12.780174 17860 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:12.728044 17861 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:12.790639 17745 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:12.772159 17782 consensus_queue.cc:237] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:12.789813 17418 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:12.793926 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:12.823923 12618 raft_consensus.cc:2368] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14.
W20260709 13:05:12.824407 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 118632us
I20260709 13:05:12.797277 12588 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:12.826639 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:12.807067 12616 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:12.809914 13227 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:05:12.813607 13230 raft_consensus.cc:3055] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:12.831290 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:12.832326 13230 raft_consensus.cc:740] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:12.821038 13226 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:12.793015 13229 rpcz_store.cc:276] 0709 13:05:11.334937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.382193 (+ 47256us) service_pool.cc:224] Handling call
0709 13:05:11.401075 (+ 18882us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:11.426425 (+ 25350us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:05:11.458560 (+ 32135us) log.cc:844] Serialized 14 byte log entry
0709 13:05:11.673020 (+214460us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:11.673096 (+    76us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:11.673150 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:12.792305 (+1119155us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b5400468554. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:12.792360 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:12.792500 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":35610,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":9849,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"spinlock_wait_cycles":57469952,"thread_start_us":204459,"threads_started":1,"wal-append.queue_time_us":290290}
I20260709 13:05:12.812491 17861 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:12.839082 17769 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.839623 17397 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:12.839947 17769 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:12.840202 17397 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:12.798764 17697 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:12.841770 17697 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:12.842252 17866 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.842309 17769 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:12.851900 12587 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:12.852020 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:12.853492 12691 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:12.844590 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:12.857041 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:12.859153 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:12.859752 12543 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:12.859814 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:12.860379 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:12.859983 12613 raft_consensus.cc:2368] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 11. Current term is 12.
I20260709 13:05:12.863353 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:12.863286 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:12.833150 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:12.868974 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:12.869659 12547 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:12.870141 12696 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 14: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:12.870959 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:12.872593 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:12.817539 17819 log.cc:927] Time spent T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 1.116s	user 0.005s	sys 0.000s
I20260709 13:05:12.885058 12546 raft_consensus.cc:2393] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 15: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:12.885314 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:12.886793 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:12.806475 17863 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:12.819234 17417 raft_consensus.cc:3055] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:12.891623 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:12.889163 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:12.892575 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:12.846303 17745 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:12.806675 17791 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:12.807986 17860 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:12.888193 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:12.843206 17866 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:12.902797 12622 raft_consensus.cc:2393] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:12.862787 17749 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:12.904498 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:12.906745 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:12.907143 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 130226us
I20260709 13:05:12.878939 17770 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:12.867642 17864 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:05:12.914191 12510 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.650s (SENT) [suppressed 7 similar messages]
I20260709 13:05:12.931741 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:12.804312 17682 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:12.916519 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 926) took 1180 ms. Trace:
I20260709 13:05:12.884994 17460 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:12.904201 12662 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:12.936816 12621 raft_consensus.cc:2393] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:12.938225 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:12.793555 17832 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:12.935262 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:12.928496 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:12.942811 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:12.793764 17752 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:12.945144 13226 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:12.891674 17863 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:12.933795 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:12.907792 17860 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:12.891875 17417 raft_consensus.cc:740] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:12.912849 17868 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:12.933394 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:12.934707 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:12.946192 12541 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:05:12.893606 13197 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:12.947002 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:12.943626 12614 raft_consensus.cc:2393] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 11: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:12.945554 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:12.955297 12615 raft_consensus.cc:2368] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14.
I20260709 13:05:12.944344 12622 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
W20260709 13:05:12.950570 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 74228.7us
I20260709 13:05:12.950929 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:12.936873 13232 rpcz_store.cc:276] 0709 13:05:11.727470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.727638 (+   168us) service_pool.cc:224] Handling call
0709 13:05:12.907461 (+1179823us) spinlock_profiling.cc:243] Waited 72.1 ms on lock 0x7b54005d3254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:12.907578 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":165872512}
I20260709 13:05:12.902881 17769 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 13:05:12.961597 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 68093.4us
I20260709 13:05:12.961923 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:12.962909 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:12.961781 12545 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:12.933113 17867 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:12.935045 17871 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.979332 13197 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:12.966851 12662 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:12.967578 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:12.968789 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:12.946869 17583 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:12.970929 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:12.965736 17869 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:12.975486 17752 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:12.988615 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:12.983057 12662 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:12.976222 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:12.976693 12621 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:12.977689 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:12.977689 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:12.994506 12616 raft_consensus.cc:2393] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 12: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:12.994717 17870 consensus_queue.cc:1059] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:12.980816 13226 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:12.969460 12540 raft_consensus.cc:2393] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 13: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:12.981818 12546 raft_consensus.cc:2393] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 16: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:12.983660 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:12.985379 12541 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:12.933310 17575 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:05:13.001927 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:13.000425 17870 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:13.002583 13232 raft_consensus.cc:3055] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:13.002940 13232 raft_consensus.cc:740] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:12.994493 17460 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:13.003961 13232 consensus_queue.cc:260] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:13.001820 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:13.009344 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:13.012105 17460 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:13.012679 17460 raft_consensus.cc:697] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:13.013865 17460 consensus_queue.cc:237] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:13.014883 13197 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:13.013972 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:13.020860 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 43567us
I20260709 13:05:13.019755 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:12.970031 17550 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:12.945180 17753 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:13.009121 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:13.028643 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:13.033891 17682 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:13.035166 17752 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.035835 17752 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:13.038300 17740 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:13.038873 17740 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.039309 17740 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:13.039494 17832 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:13.027136 17768 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:12.970975 17397 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:13.021268 17031 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:12.979259 17868 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:13.033897 17885 consensus_queue.cc:1059] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:05:13.025105 17575 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.050462 17575 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:13.027107 17867 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:13.047900 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:13.045753 17753 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:12.969184 17864 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:13.053236 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:13.056826 13226 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:13.060302 12694 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:13.063166 17866 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:13.065927 17864 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:13.069070 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:12.987967 17871 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:13.070171 12688 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:13.071038 12696 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:13.071516 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:13.072379 17871 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:13.073669 17418 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:13.024184 17702 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:13.077831 17417 consensus_queue.cc:260] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:13.078341 12546 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:13.079489 17417 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:13.079653 17783 consensus_meta.cc:287] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.596s	user 0.006s	sys 0.007s
I20260709 13:05:13.080190 17783 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 11. Current term is 12.
I20260709 13:05:13.088632 12547 raft_consensus.cc:1275] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:13.090830 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:13.092059 13226 raft_consensus.cc:2410] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:05:13.023484 12541 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:13.105892 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:13.108979 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:13.114697 12588 leader_election.cc:336] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997): Timed out: RequestConsensusVote RPC to 127.11.44.196:33997 timed out after 1.871s (SENT)
W20260709 13:05:13.139024 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 124282us
I20260709 13:05:13.141747 12510 leader_election.cc:400] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 11. Current term is 12.
I20260709 13:05:13.143157 12510 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:13.137173 17770 raft_consensus.cc:697] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:05:13.145994 17856 log.cc:927] Time spent T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.497s	user 0.002s	sys 0.001s
I20260709 13:05:13.146755 17770 consensus_queue.cc:237] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:13.147717 12541 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:13.148059 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:13.141791 17783 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:13.149403 13197 leader_election.cc:400] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14.
I20260709 13:05:13.153863 13230 consensus_queue.cc:260] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:13.155500 17575 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:13.157554 12547 raft_consensus.cc:1240] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:13.158613 13227 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:13.161170 13227 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:05:13.161855 17858 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15.
I20260709 13:05:13.167586 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:13.169178 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:13.162451 17831 raft_consensus.cc:3055] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:13.170392 17831 raft_consensus.cc:740] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:13.170904 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3180) took 1088 ms. Trace:
I20260709 13:05:13.171283 12540 rpcz_store.cc:276] 0709 13:05:12.082943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.162124 (+ 79181us) service_pool.cc:224] Handling call
0709 13:05:13.170552 (+1008428us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b540026b454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:13.170849 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1850384128}
I20260709 13:05:13.172515 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:13.173699 13232 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:13.175045 13228 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:05:13.176681 12539 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:13.162835 17783 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:05:13.161463 17845 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.820s	user 0.003s	sys 0.000s
I20260709 13:05:13.170261 12616 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:05:13.172358 17831 consensus_queue.cc:260] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:13.182133 12691 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:13.164166 17650 raft_consensus.cc:3055] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:13.190399 13200 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:13.110009 17749 raft_consensus.cc:697] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:13.205840 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:13.186691 12688 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:13.188316 12618 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:05:13.069089 17864 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:13.192194 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:13.186115 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:13.195921 13228 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:13.163910 12510 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:13.194337 17783 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.195351 17745 raft_consensus.cc:697] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:13.195248 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:13.239249 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:13.239853 13227 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:13.240105 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1939) took 1197 ms. Trace:
I20260709 13:05:13.240715 12689 rpcz_store.cc:276] 0709 13:05:12.042322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.042472 (+   150us) service_pool.cc:224] Handling call
0709 13:05:12.042876 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:12.491002 (+448126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.239683 (+748681us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b540009c254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:13.240035 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":922338688}
I20260709 13:05:13.201128 13232 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:13.242506 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:13.243418 13232 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:05:13.243626 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:13.244391 17853 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.758s	user 0.005s	sys 0.000s
I20260709 13:05:13.244481 13226 raft_consensus.cc:2368] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16.
I20260709 13:05:13.246008 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3463) took 2370 ms. Trace:
I20260709 13:05:13.212317 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:13.214138 17885 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:13.247802 12695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 1260) took 2045 ms (client timeout 2034 ms). Trace:
I20260709 13:05:13.218187 13200 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:13.152936 17860 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:13.231848 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 68038.2us
I20260709 13:05:13.244803 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:13.248229 12695 rpcz_store.cc:269] 0709 13:05:11.202110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.391970 (+189860us) service_pool.cc:224] Handling call
0709 13:05:13.247601 (+1855631us) spinlock_profiling.cc:243] Waited 541 ms on lock 0x7b540041fad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:13.247728 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1244843776}
I20260709 13:05:13.157598 17697 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:13.233903 12616 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:13.194726 17650 raft_consensus.cc:740] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:13.247565 13226 raft_consensus.cc:1240] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:13.216013 17768 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:13.251778 12510 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:13.254530 13232 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:13.255228 13200 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:13.183727 12542 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:13.257419 17867 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:13.258288 17860 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:13.262377 13197 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:13.202766 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 98828.7us
I20260709 13:05:13.246456 12617 rpcz_store.cc:276] 0709 13:05:10.875535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:10.877794 (+  2259us) service_pool.cc:224] Handling call
0709 13:05:11.455485 (+577691us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b58001f4198. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:05:11.455731 (+   246us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:11.456294 (+   563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:11.456332 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:12.086873 (+630541us) spinlock_profiling.cc:243] Waited 5.86 ms on lock 0x7b2c0004c3c8. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:05:12.087694 (+   821us) log.cc:844] Serialized 26 byte log entry
0709 13:05:12.281475 (+193781us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:12.281534 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:12.281971 (+   437us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:13.243753 (+961782us) spinlock_profiling.cc:243] Waited 7.67 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:13.245757 (+  2004us) raft_consensus.cc:1685] finished
0709 13:05:13.245778 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.245915 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2321,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":31311,"spinlock_wait_cycles":54420608,"thread_start_us":193215,"threads_started":1,"wal-append.queue_time_us":292720}
I20260709 13:05:13.234150 17441 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:13.274907 12510 leader_election.cc:400] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14.
I20260709 13:05:13.281427 12510 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:13.273202 13227 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:13.274782 13200 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:13.273334 12694 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:13.275661 13226 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:05:13.285230 13200 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:13.286192 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:13.286584 13200 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:13.257414 17745 consensus_queue.cc:237] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:13.289688 13200 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:13.305505 12587 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:13.291954 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:13.294878 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:13.297744 12510 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:13.283746 17749 consensus_queue.cc:237] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:13.269229 17888 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:13.280128 17772 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:13.283236 17885 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:13.346807 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 49171.7us
I20260709 13:05:13.248932 17783 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:13.352439 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:13.352981 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:13.353410 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:13.367723 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 78140.8us
I20260709 13:05:13.353879 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:13.376991 12543 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:13.298261 17713 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:13.288640 17867 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:13.377698 12540 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:13.289615 17550 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:13.355832 13232 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:13.395329 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:13.453101 12544 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:05:13.367727 17835 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:13.409060 17658 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:13.412159 13235 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 1279) took 1275 ms (client timeout 1619 ms). Trace:
I20260709 13:05:13.414232 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:13.359824 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 97533us
I20260709 13:05:13.337733 17840 consensus_queue.cc:1059] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
I20260709 13:05:13.277307 17768 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:13.347682 17772 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:13.450893 12543 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:13.318008 17575 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:13.453918 17863 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:13.485100 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 206761us
I20260709 13:05:13.497644 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:13.498848 12543 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:05:13.500036 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:13.487044 13235 rpcz_store.cc:269] 0709 13:05:12.136875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.137069 (+   194us) service_pool.cc:224] Handling call
0709 13:05:13.411935 (+1274866us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b54006d01d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:13.412070 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":776601984}
I20260709 13:05:13.491051 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:13.504541 12616 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:13.346639 17877 consensus_queue.cc:1059] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 13:05:13.336324 17860 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:13.498242 17772 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:13.349835 17883 consensus_queue.cc:1059] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.148s
W20260709 13:05:13.501965 17791 consensus_meta.cc:287] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.000s
I20260709 13:05:13.493489 17752 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:13.494932 17658 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:13.548022 17892 log.cc:927] Time spent T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 13:05:13.548964 17891 log.cc:927] Time spent T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 13:05:13.562381 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.396256 17650 consensus_queue.cc:260] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:13.552196 17550 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:13.509610 17740 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:13.563045 17791 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:13.594136 17697 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:13.594981 17658 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:13.578912 17752 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:13.596796 17783 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:13.598208 17864 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:13.598403 17650 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:13.598883 17883 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:13.599445 17883 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:13.600659 17900 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:13.572981 17575 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.568316 17860 raft_consensus.cc:697] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 13 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:13.605000 12544 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:13.598889 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:13.628150 17885 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:13.629914 13227 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:13.630527 17768 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:13.636809 17897 log.cc:927] Time spent T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:05:13.638298 17899 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:05:13.634158 17772 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:13.644941 12547 raft_consensus.cc:2393] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 12: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:13.645769 17860 consensus_queue.cc:237] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:13.646212 12659 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:13.598932 17864 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:13.652655 12659 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:13.653743 17758 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:13.654264 17758 raft_consensus.cc:697] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:13.654332 17864 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:13.601456 17827 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.655320 17758 consensus_queue.cc:237] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:13.657789 17460 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:13.651284 17863 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:13.660810 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:13.661686 13232 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 14: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:13.662626 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:13.664397 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:13.607573 17752 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.666224 17752 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:13.667380 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:13.618042 17575 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:13.670516 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:13.671305 12696 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:13.672081 17575 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:13.674801 13235 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:13.655339 17827 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:13.679179 17827 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:13.680665 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:13.683911 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:13.685112 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:13.685211 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:13.685693 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:13.686054 12614 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:13.686411 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:13.687722 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:13.688561 12617 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 14: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:13.689908 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:13.691871 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:13.692528 13231 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:13.694288 12540 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
W20260709 13:05:13.687433 17897 log.cc:927] Time spent T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.050s	user 0.002s	sys 0.000s
I20260709 13:05:13.696431 12588 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:13.697552 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:13.698596 12616 raft_consensus.cc:1240] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:13.698506 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:13.709548 12543 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:13.697062 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:13.700145 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:13.701076 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:13.712069 12545 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:13.713376 12545 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:05:13.703334 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:13.669301 17752 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:13.706413 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:13.717449 12544 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:13.717600 12614 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:05:13.714604 12620 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:13.708566 12622 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:05:13.715771 12538 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:13.720845 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:13.743708 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 47354.8us
I20260709 13:05:13.745024 12588 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:13.752887 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:13.694034 17866 consensus_queue.cc:1059] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:05:13.708415 17713 raft_consensus.cc:697] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:13.716737 17740 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:13.760479 12588 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:13.758446 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:13.785398 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:13.789389 12538 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:13.751693 17882 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:13.791803 12547 raft_consensus.cc:2393] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 13: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:13.794034 17894 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:13.794215 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:13.794865 17772 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:13.794883 12539 raft_consensus.cc:2376] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14. Re-sending same reply.
I20260709 13:05:13.795740 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:13.796269 17865 log.cc:927] Time spent T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 1.102s	user 0.002s	sys 0.002s
I20260709 13:05:13.796446 12540 raft_consensus.cc:2376] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14. Re-sending same reply.
I20260709 13:05:13.805253 12693 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:13.807555 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1947) took 1105 ms. Trace:
W20260709 13:05:13.808322 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 47948.2us
I20260709 13:05:13.780949 17883 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:13.813248 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:13.808084 12687 rpcz_store.cc:276] 0709 13:05:12.701872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.703855 (+  1983us) service_pool.cc:224] Handling call
0709 13:05:12.704252 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:12.867017 (+162765us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:05:13.028052 (+161035us) log.cc:844] Serialized 14 byte log entry
0709 13:05:13.259306 (+231254us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:13.259953 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 13:05:13.260147 (+   194us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:13.260197 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.260316 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:13.807297 (+546981us) raft_consensus.cc:1685] finished
0709 13:05:13.807327 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.807484 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":457,"prepare.queue_time_us":145149,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":24223,"raft.run_cpu_time_us":505,"raft.run_wall_time_us":117182,"thread_start_us":422307,"threads_started":3,"wal-append.queue_time_us":444292}
I20260709 13:05:13.815333 13231 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:13.817488 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:13.810914 12588 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:13.756951 17887 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.818343 17860 consensus_queue.cc:1059] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:13.818454 13231 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:13.818568 17887 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:13.819242 17860 consensus_queue.cc:1243] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer a70479a3b4114f3581095e9890f5d653 log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:05:13.819986 17860 raft_consensus.cc:3055] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:13.820362 17860 raft_consensus.cc:740] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:13.822213 13231 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:05:13.831467 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:13.812379 17772 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.834353 13231 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:13.836853 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:13.843052 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 188143us
I20260709 13:05:13.835263 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:13.815447 17840 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.888957 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:13.850488 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:13.900277 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:13.900609 12696 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
W20260709 13:05:13.901379 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 51038.1us
I20260709 13:05:13.902179 12689 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:13.906183 13199 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:13.894670 12687 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:05:13.909345 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:13.909657 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:13.910233 12693 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
I20260709 13:05:13.910429 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:13.911052 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:13.911595 12693 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:05:13.912520 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:13.913632 12688 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:13.913515 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:13.918318 12512 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:13.919126 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:13.920986 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:13.921193 12694 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:13.915866 12659 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:13.923251 12687 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:05:13.934655 13199 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:05:13.928764 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 93633.6us
I20260709 13:05:13.933952 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:13.940822 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:13.944296 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 157349us
I20260709 13:05:13.847326 17772 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:13.948276 12615 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:13.888199 17906 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:13.902604 17903 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:13.855549 17840 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:13.952683 17697 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:13.939950 17791 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:13.957666 12692 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:14.016607 17894 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:13.890928 17882 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:05:14.018621 13197 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:13.966639 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 50878.1us
I20260709 13:05:14.025913 12659 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:13.937109 17417 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:13.925634 17908 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:05:13.988003 17911 log.cc:927] Time spent T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 13:05:13.992036 17851 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 1.504s	user 0.000s	sys 0.007s
I20260709 13:05:13.945726 17783 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:05:13.994864 17921 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:13.856190 17713 consensus_queue.cc:237] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:13.998473 17909 log.cc:927] Time spent T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:05:14.000502 17906 consensus_queue.cc:1059] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:13.905649 17860 consensus_queue.cc:260] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.035113 17860 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:13.958602 17887 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:13.962764 17883 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:14.005473 17772 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:14.012428 17840 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:14.039453 17569 raft_consensus.cc:3055] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:14.032657 17658 consensus_queue.cc:1059] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:05:14.040704 12617 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:14.041186 17658 raft_consensus.cc:3055] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:14.041535 17658 raft_consensus.cc:740] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:14.042143 17532 consensus_queue.cc:1059] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:14.042337 17658 consensus_queue.cc:260] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:14.043035 17532 raft_consensus.cc:3055] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:14.015875 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:13.982141 12662 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:14.010314 17912 log.cc:927] Time spent T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:05:13.947624 17740 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:14.019208 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:14.027609 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:14.025364 17861 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:14.029881 17908 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:14.053386 17908 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:14.056140 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3188) took 1493 ms. Trace:
I20260709 13:05:14.056560 12542 rpcz_store.cc:276] 0709 13:05:12.563255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.564108 (+   853us) service_pool.cc:224] Handling call
0709 13:05:14.055944 (+1491836us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b54003be2d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:14.056078 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156903168}
I20260709 13:05:14.057152 17658 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:14.057994 12541 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:05:14.058362 17840 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:14.058754 17840 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.059108 17840 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:14.061224 13233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 927) took 2333 ms. Trace:
I20260709 13:05:14.061630 13233 rpcz_store.cc:276] 0709 13:05:11.727806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.765142 (+ 37336us) service_pool.cc:224] Handling call
0709 13:05:12.908484 (+1143342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:13.018305 (+109821us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:13.018558 (+   253us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:13.032870 (+ 14312us) log.cc:844] Serialized 26 byte log entry
0709 13:05:13.319218 (+286348us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:13.319254 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.319328 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:13.637984 (+318656us) raft_consensus.cc:1685] finished
0709 13:05:13.638007 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.060953 (+422946us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54005d3250. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:14.061140 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13144,"raft.queue_time_us":39441,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":8616,"spinlock_wait_cycles":2628531072,"thread_start_us":359685,"threads_started":2,"wal-append.queue_time_us":601143}
W20260709 13:05:14.063321 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.063403 17740 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.064102 17740 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:14.071334 13199 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:14.072522 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 933) took 1231 ms. Trace:
I20260709 13:05:14.072678 17752 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:14.072929 13228 rpcz_store.cc:276] 0709 13:05:12.840955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.176417 (+335462us) service_pool.cc:224] Handling call
0709 13:05:13.195672 (+ 19255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:13.221514 (+ 25842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.072336 (+850822us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b5400630950. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:14.072466 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43130240}
I20260709 13:05:14.076874 17870 raft_consensus.cc:3055] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:14.077347 17870 raft_consensus.cc:740] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:14.078207 17870 consensus_queue.cc:260] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.079232 17870 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:14.029683 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 77467.3us
I20260709 13:05:14.030138 17791 raft_consensus.cc:697] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:14.080942 17791 consensus_queue.cc:237] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.030572 17918 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:05:14.085505 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.089120 12541 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:14.091544 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:14.092506 12547 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:14.031333 12659 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:14.044041 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 62022us
I20260709 13:05:14.050693 13197 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:14.043459 17532 raft_consensus.cc:740] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:14.095254 12588 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:14.094146 12662 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:14.098609 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 67350.6us
W20260709 13:05:14.102067 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 51475.7us
I20260709 13:05:14.105966 17743 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:14.106469 17743 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.106834 17743 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:14.107308 17782 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:14.109531 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:14.110435 17746 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:14.110869 17746 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.111210 17746 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:14.113699 17883 raft_consensus.cc:697] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:14.115142 17883 consensus_queue.cc:237] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.117717 17864 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:14.118466 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:14.118320 17864 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.119074 12539 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:05:14.119294 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1294) took 1269 ms. Trace:
I20260709 13:05:14.119799 12618 rpcz_store.cc:276] 0709 13:05:12.850213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.850347 (+   134us) service_pool.cc:224] Handling call
0709 13:05:12.884803 (+ 34456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:13.213303 (+328500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.119073 (+905770us) spinlock_profiling.cc:243] Waited 298 ms on lock 0x7b5400375354. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:14.119239 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":684559744}
I20260709 13:05:14.120492 17863 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:14.120975 17864 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:14.121099 17863 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:14.124807 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.124356 17532 consensus_queue.cc:260] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.039906 17569 raft_consensus.cc:740] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:05:14.125313 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.123540 17863 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:14.126024 17569 consensus_queue.cc:260] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.127072 17569 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:14.127925 17879 log.cc:927] Time spent T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 1.062s	user 0.000s	sys 0.003s
I20260709 13:05:14.033524 17921 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.129835 17921 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:14.130561 13230 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:14.101032 17752 consensus_queue.cc:1059] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:05:14.117964 12662 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:14.135818 13200 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:14.140450 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1094) took 1401 ms. Trace:
I20260709 13:05:14.140846 13234 rpcz_store.cc:276] 0709 13:05:12.738784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.823405 (+ 84621us) service_pool.cc:224] Handling call
0709 13:05:12.823791 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:12.834146 (+ 10355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:12.834203 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:12.834754 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 13:05:12.984204 (+149450us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:12.984242 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:12.984303 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:14.127632 (+1143329us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b240033b3a8. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63129c4 00007fc3a6310acb 00007fc3a64cbdc9 00007fc3a64cba55 00007fc3a64cb09d 00007fc3a90fd10e 00007fc3a911488c 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221
0709 13:05:14.136115 (+  8483us) raft_consensus.cc:1685] finished
0709 13:05:14.136134 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.140383 (+  4249us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":220,"raft.run_cpu_time_us":360,"raft.run_wall_time_us":9782,"spinlock_wait_cycles":27376896,"thread_start_us":76581,"threads_started":1,"wal-append.queue_time_us":190213}
I20260709 13:05:14.143420 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:14.145747 12512 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:14.148563 12618 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:14.150064 13230 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:14.149134 12512 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:14.152403 12662 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:14.152915 17783 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:14.153327 17783 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.153689 17783 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:14.154225 17815 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 13:05:14.150564 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 55407.8us
I20260709 13:05:14.157209 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:14.138942 17888 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:14.143203 17908 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.162098 13200 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:14.125370 17795 consensus_queue.cc:1059] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:05:14.183020 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:14.141697 17864 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
W20260709 13:05:14.162024 13230 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 925) took 2423 ms (client timeout 2123 ms). Trace:
I20260709 13:05:14.184656 12622 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:05:14.190250 12622 pending_rounds.cc:85] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 10
I20260709 13:05:14.143990 17903 consensus_queue.cc:1059] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:05:14.185313 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:14.160796 17930 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:14.159832 17918 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:14.189270 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:14.210139 12690 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:05:14.190552 12622 pending_rounds.cc:107] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:05:14.211246 12622 raft_consensus.cc:2889] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:14.183780 13234 raft_consensus.cc:2376] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14. Re-sending same reply.
W20260709 13:05:14.211995 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.160144 12512 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:14.192785 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:14.170573 17763 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:14.194147 12613 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:05:14.194454 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:14.194684 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:14.213712 12619 raft_consensus.cc:2368] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14.
I20260709 13:05:14.195807 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:14.162672 17860 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:14.199406 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:14.201740 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:14.214279 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:14.161149 17772 consensus_queue.cc:1059] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 13:05:14.215075 17877 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:14.173740 17880 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:14.150842 17782 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:05:14.204001 17746 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:14.204761 17922 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:05:14.191205 13230 rpcz_store.cc:269] 0709 13:05:11.727085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.727283 (+   198us) service_pool.cc:224] Handling call
0709 13:05:12.813342 (+1086059us) spinlock_profiling.cc:243] Waited 79.6 ms on lock 0x7b5400597a20. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a94f0dc0 00007fc3a957ce18 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:13.153337 (+339995us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b4c00140400. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7845a20 00007fc3a7856a29 00007fc3a781c644 00007fc3a7843f2d 00007fc3a7843b93 00007fc3a957418b 00007fc3a9574cb5 00007fc3a956ff30 00007fc3a95717de 00007fc3a957d27c 00007fc3ae53eb17
0709 13:05:13.675395 (+522058us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b18002da440. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95b4646 00007fc3a94ee58e 00007fc3a956ff9e 00007fc3a95717de 00007fc3a957d27c 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c
0709 13:05:14.130143 (+454748us) spinlock_profiling.cc:243] Waited 453 ms on lock 0x7b58003fbcd0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a94d50aa 00007fc3a9557447 00007fc3a956ffe7 00007fc3a95717de 00007fc3a957d27c 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c
0709 13:05:14.150527 (+ 20384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2413330816}
I20260709 13:05:14.207517 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:14.199194 17887 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.163348 17833 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:14.209048 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:14.203495 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:14.161424 17906 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:14.217037 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 53308.3us
I20260709 13:05:14.160884 17417 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:05:14.209832 17918 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:14.230909 13228 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:14.234033 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:14.162678 17861 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:05:14.215517 17860 raft_consensus.cc:697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:14.215986 17763 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:14.225586 17908 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:14.248972 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:14.249099 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:14.249621 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.223552 17877 raft_consensus.cc:697] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:14.228492 17922 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:14.243410 17903 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.238834 17833 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:14.253589 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 134714us
I20260709 13:05:14.277647 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:14.286492 12616 raft_consensus.cc:2393] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:14.296108 12587 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:14.251271 17763 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:14.305997 17896 log.cc:927] Time spent T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.808s	user 0.002s	sys 0.001s
I20260709 13:05:14.306723 17795 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.307240 17795 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.309273 17795 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:14.309895 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:14.310618 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:14.335353 13226 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:14.314317 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:14.338373 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:14.340512 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 44492.7us
I20260709 13:05:14.247823 17918 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:14.323868 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:14.242604 17887 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:14.334079 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:14.367499 13234 raft_consensus.cc:2393] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 14: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:14.311831 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:14.340366 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:14.322021 17906 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:14.341459 12622 raft_consensus.cc:2393] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 11: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:14.277733 17922 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:14.347815 13235 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:14.350664 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:14.298650 17833 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:14.351768 12616 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:05:14.355166 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 111364us
I20260709 13:05:14.352174 17697 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:14.332057 17713 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:14.364288 13233 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:05:14.351292 17740 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.368710 12615 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:05:14.302261 17903 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:14.359421 17857 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.211s	user 0.008s	sys 0.025s
W20260709 13:05:14.361424 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.379001 12512 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:14.375217 17773 raft_consensus.cc:3055] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:14.407953 13231 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:14.381387 17697 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:14.412000 17857 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.264s	user 0.008s	sys 0.026s
I20260709 13:05:14.402568 17795 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:14.425771 17702 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:14.364063 17840 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:14.428011 17746 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:14.439005 12539 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
W20260709 13:05:14.433506 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 109588us
W20260709 13:05:14.440766 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.367143 17860 consensus_queue.cc:237] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.429818 17773 raft_consensus.cc:740] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:14.445547 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:14.447376 12616 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:05:14.434924 17697 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:14.501914 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.449872 13197 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:14.453505 17773 consensus_queue.cc:260] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.458575 17930 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:14.459151 17840 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:14.462656 17740 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:14.463057 12588 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:14.464282 17857 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:14.462674 17903 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:14.512151 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 49184.5us
I20260709 13:05:14.470971 17887 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:14.476240 12617 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:14.477083 17763 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:14.489355 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.375741 17877 consensus_queue.cc:237] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:14.499308 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.407061 17743 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.555238 17743 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:14.526011 17903 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:14.558007 17903 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:14.509584 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.558007 17840 consensus_queue.cc:1059] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:14.558497 17903 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:14.560307 17840 raft_consensus.cc:3055] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:14.561762 17840 raft_consensus.cc:740] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:14.562510 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:14.562604 17840 consensus_queue.cc:260] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:14.563287 13233 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:14.563984 17840 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:14.513039 12588 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:05:14.566267 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 53314.1us
I20260709 13:05:14.567580 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:14.567762 17532 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:14.526108 17763 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:14.568348 17858 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:14.569077 17858 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:14.530309 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:14.441840 17795 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.577981 17795 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:14.514456 17857 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.580698 17857 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:14.583125 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1103) took 1245 ms. Trace:
I20260709 13:05:14.583606 13227 rpcz_store.cc:276] 0709 13:05:13.337292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.337431 (+   139us) service_pool.cc:224] Handling call
0709 13:05:13.337758 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:13.630435 (+292677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.582909 (+952474us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b5400578854. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:14.583066 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":671318400}
I20260709 13:05:14.587270 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:14.587767 17682 raft_consensus.cc:3055] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:14.588225 17682 raft_consensus.cc:740] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:14.590873 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:14.592319 12513 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:14.518955 17883 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:14.413887 17713 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.516049 17880 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:14.542101 17908 consensus_queue.cc:1059] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:14.544763 17921 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:14.547500 17783 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.553032 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:14.652735 12546 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:14.515120 17773 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:14.622956 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
W20260709 13:05:14.519757 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 69964.8us
I20260709 13:05:14.623939 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:14.624330 12615 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:14.626500 12621 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:14.604517 17682 consensus_queue.cc:260] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.627214 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:14.627377 17833 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:14.439035 17702 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:14.592350 17831 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:14.593248 17941 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:14.593211 12616 raft_consensus.cc:1240] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:14.632587 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:14.621979 17862 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:14.639866 13233 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:14.701809 12614 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:05:14.662484 12662 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:14.665299 12588 leader_election.cc:400] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16.
I20260709 13:05:14.706614 12588 leader_election.cc:403] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:14.703927 12687 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:05:14.707756 12588 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:14.708518 17863 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:14.708750 17944 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.669402 13230 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:14.709185 17473 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:14.709407 17944 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:14.711962 17858 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16.
I20260709 13:05:14.713380 17918 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:14.714071 17903 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.714805 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:14.715438 12692 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
I20260709 13:05:14.716388 17903 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:14.716588 17864 consensus_queue.cc:1059] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:14.716929 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:14.717509 12614 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:14.717895 17770 raft_consensus.cc:3055] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:14.718357 17770 raft_consensus.cc:740] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:14.711999 17944 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:14.719278 17770 consensus_queue.cc:260] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.720588 17770 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:14.723807 17918 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:14.638509 17883 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:14.650193 17772 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:05:14.724608 17883 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:14.725294 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 62905.5us
I20260709 13:05:14.725670 17943 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.726325 17943 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.727931 17743 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:14.728461 17743 raft_consensus.cc:697] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:14.728576 17460 consensus_queue.cc:1059] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:14.729398 17743 consensus_queue.cc:237] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.730078 12614 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:14.731204 13197 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:14.633577 17417 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:14.736279 12539 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 13: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:14.734504 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:14.738334 12662 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:14.668692 17650 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:14.691545 17702 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:14.690832 17565 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:14.740700 17397 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:14.669737 17834 consensus_queue.cc:1059] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 13:05:14.691313 17795 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
W20260709 13:05:14.767769 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.754056 17887 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:14.755390 17930 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:14.769941 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.652061 17880 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.757637 17565 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:14.740103 17903 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
W20260709 13:05:14.784505 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.742385 17569 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:05:14.777063 17887 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:14.765698 17900 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:14.759267 17918 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
W20260709 13:05:14.793268 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 161128us
I20260709 13:05:14.778271 17397 raft_consensus.cc:697] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:14.778621 17926 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:14.775115 17417 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:14.783670 17565 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:14.795897 17418 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:14.797046 17758 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:14.805505 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 85313.9us
I20260709 13:05:14.796464 17769 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.798444 17887 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:14.814698 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:14.791010 17782 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
W20260709 13:05:14.832386 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.826992 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:14.885243 12512 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:14.917336 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:14.801401 17900 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.919611 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:14.921916 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:14.923202 12693 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:05:14.923202 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:14.926282 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:14.841444 17958 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.929375 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:14.931290 12616 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:05:14.932236 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:14.926970 12614 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:05:14.842754 17833 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:14.807638 17926 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:14.842972 17713 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:14.961983 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:14.963245 12546 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:05:14.970127 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:14.970340 17887 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.970925 12687 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:14.824024 17885 raft_consensus.cc:3055] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:14.974223 17885 raft_consensus.cc:740] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:14.975092 17885 consensus_queue.cc:260] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.843814 17880 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:14.837519 17921 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:14.864163 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:14.810325 17417 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:14.937548 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:14.895483 17938 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:14.814245 17758 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.839957 17769 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.939337 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:14.990926 12614 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:14.940769 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:14.825315 17397 consensus_queue.cc:237] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.812884 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:14.915613 17650 consensus_queue.cc:1059] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:05:14.857856 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:15.023316 12688 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:14.849076 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:14.845881 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:14.946382 17929 raft_consensus.cc:3055] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:14.946573 17883 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.947263 17900 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:14.987706 17518 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:14.952556 17926 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:05:14.928287 17922 consensus_meta.cc:287] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.539s	user 0.012s	sys 0.000s
I20260709 13:05:14.952740 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:14.953716 17783 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:14.956934 17740 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:05:14.957964 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.812654 17418 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:14.936511 17658 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:14.972023 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:14.979147 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 93829.5us
I20260709 13:05:15.069080 12615 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:14.980599 12696 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:05:14.983714 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.983842 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:14.980696 12587 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:15.071020 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 90408.3us
W20260709 13:05:15.071985 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.010061 13229 raft_consensus.cc:2376] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11. Re-sending same reply.
I20260709 13:05:14.861114 12695 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:05:15.011345 17938 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:15.012377 17880 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:15.013520 17758 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:15.014178 17769 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:15.016419 17417 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:14.934755 17763 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:15.019088 17697 consensus_meta.cc:287] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.500s	user 0.010s	sys 0.000s
I20260709 13:05:14.987808 17768 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:14.935571 17958 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:15.037500 12614 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:15.025007 12688 raft_consensus.cc:1275] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:05:15.030259 13199 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:14.950774 17918 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.166167 12688 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:15.027988 17929 raft_consensus.cc:740] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:15.055106 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:15.059101 17887 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:15.020991 17885 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:15.076222 12620 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 15: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:05:15.196635 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 166479us
W20260709 13:05:15.076706 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 149038us
I20260709 13:05:15.078711 12696 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:05:15.080049 12694 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 13:05:15.083277 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:15.084815 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:15.202515 12546 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:15.086309 12587 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:05:15.088461 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.084956 13200 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:15.204684 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 119808us
I20260709 13:05:15.205344 13200 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:15.151760 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 73997.3us
I20260709 13:05:15.157019 13231 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:15.160207 13232 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:05:15.163728 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:15.068816 17944 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.044391 17518 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:15.175745 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.075392 17857 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:15.181313 17929 consensus_queue.cc:260] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:15.181828 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:15.184350 17938 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:15.186319 17958 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:15.223276 17927 raft_consensus.cc:3055] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:15.223780 17927 raft_consensus.cc:740] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:15.224413 17883 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:15.188766 17565 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:15.154093 17882 consensus_queue.cc:1059] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:05:15.227094 17565 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:15.078843 17658 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:15.227675 17882 raft_consensus.cc:3055] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:15.228034 17882 raft_consensus.cc:740] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:15.228838 17882 consensus_queue.cc:260] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:15.192571 17418 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:15.068337 17922 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:15.045799 17702 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:15.194998 17753 raft_consensus.cc:3055] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:15.197150 13230 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:15.215132 17925 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:15.200682 12659 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:15.249078 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 48515us
I20260709 13:05:15.202576 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:15.164928 17768 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:15.203805 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:15.217711 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:15.218531 13235 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 13: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:15.217554 17770 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.214176 17518 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:15.229875 12687 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 15: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:15.075266 17740 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:15.195443 17918 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:15.282001 17532 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:15.158869 17763 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:15.208946 17713 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:15.253757 17903 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:15.158365 17697 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:15.287498 17763 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:15.288107 17697 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:15.232414 17658 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:15.233788 17773 consensus_queue.cc:1059] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:15.282681 17918 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:15.234601 17417 consensus_queue.cc:1059] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:15.235332 12693 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:15.219071 17944 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:15.209736 12616 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15. Ops: [14.10-14.10]
W20260709 13:05:15.211602 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 125376us
I20260709 13:05:15.213317 17857 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:15.247706 17783 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:15.224776 17927 consensus_queue.cc:260] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:15.270108 12692 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:15.266749 17882 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:15.246933 17753 raft_consensus.cc:740] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:15.280303 17740 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:15.231825 17682 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:15.242419 17929 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:15.450116 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 252756us
I20260709 13:05:15.451445 13199 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:15.452200 17740 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:15.453477 17740 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:15.455526 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:15.289535 12618 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:15.294857 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 89586.4us
I20260709 13:05:15.295281 17833 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:15.236759 12617 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:05:15.269129 12659 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:15.267649 17958 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:15.255872 12688 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 16. Current term is 17. Ops: []
W20260709 13:05:15.405750 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 81874.8us
I20260709 13:05:15.248956 17575 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:15.413314 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.465261 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:15.423308 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.297964 17968 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:05:15.447203 12662 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.000s	sys 0.060s
W20260709 13:05:15.476920 12662 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.000s	sys 0.061s
I20260709 13:05:15.477743 12662 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:15.304572 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 98217.1us
I20260709 13:05:15.297019 17773 raft_consensus.cc:3055] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:05:15.459052 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 190014us
I20260709 13:05:15.459733 12692 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:15.300057 17903 raft_consensus.cc:697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:15.482947 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:15.483170 12662 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:15.490267 12696 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
W20260709 13:05:15.471398 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.405325 17857 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:15.492246 13199 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:15.511263 12618 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:15.458062 17941 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.479658 17927 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:15.290447 17770 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:15.476663 17968 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.485440 17773 raft_consensus.cc:740] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:15.557235 13230 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:05:15.407490 17863 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:05:15.482101 17782 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:15.574720 17782 raft_consensus.cc:697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:15.575752 17782 consensus_queue.cc:237] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:15.576171 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:15.493269 17918 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:15.577304 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:15.577939 13226 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:15.578715 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:15.579754 13226 raft_consensus.cc:2368] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15.
I20260709 13:05:15.565675 17565 consensus_queue.cc:1059] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:05:15.568655 17834 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.590433 17834 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:15.593097 17834 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:15.569409 17697 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.594789 17697 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:15.570032 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:15.598058 12619 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:05:15.423102 17783 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:15.600793 17783 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:15.573913 17702 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:15.518913 17746 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:15.602238 17746 raft_consensus.cc:697] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:15.582691 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:15.603576 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:15.603303 17746 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:15.604173 13226 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:15.605012 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:15.582393 17903 consensus_queue.cc:237] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:15.606019 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:15.606750 13226 raft_consensus.cc:2393] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 13: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:15.607419 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:15.489256 17958 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:15.484369 17864 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 13:05:15.587724 17773 consensus_queue.cc:260] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:15.616117 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.558362 17941 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:15.589629 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:15.546428 17938 consensus_queue.cc:1059] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:05:15.601994 17960 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:15.607941 13226 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:15.566309 17968 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:15.489054 17575 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:15.476969 17833 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:15.648272 17833 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:15.619439 13230 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 14: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:15.610580 17926 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.621819 17773 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:15.626497 17941 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:15.627502 17958 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:15.630739 17930 raft_consensus.cc:3055] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:15.630959 17697 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:15.632560 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.642179 17768 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:15.645722 13226 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:05:15.694947 13226 pending_rounds.cc:85] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Aborting all ops after (but not including) 10
I20260709 13:05:15.695304 13226 pending_rounds.cc:107] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:05:15.695736 13226 raft_consensus.cc:2889] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:15.656220 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 164034us
W20260709 13:05:15.687358 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 205801us
W20260709 13:05:15.671624 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.678203 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:15.703508 12615 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:15.678929 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:15.679338 17943 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:15.731318 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:15.732173 12695 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:15.709784 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:15.711930 13226 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15. Ops: [14.10-14.10]
W20260709 13:05:15.720901 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.649663 17418 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.670293 17929 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.670861 17930 raft_consensus.cc:740] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:05:15.753469 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 179480us
I20260709 13:05:15.695180 17885 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:15.757146 13200 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:15.757581 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:15.759034 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 270985us
I20260709 13:05:15.766003 12512 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:15.770510 12615 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 14. Current term is 15. Ops: []
W20260709 13:05:15.746026 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.788313 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:05:15.789747 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 270625us
W20260709 13:05:15.762178 12510 connection.cc:256] RPC call timeout handler was delayed by -1.3305813619999753s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
W20260709 13:05:15.793087 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.669911 17926 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:15.801594 12510 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:15.803231 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:15.804414 12510 leader_election.cc:400] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14.
I20260709 13:05:15.798978 12615 raft_consensus.cc:1240] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:15.761412 17885 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:15.809289 12510 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:15.812216 12510 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:15.778916 17941 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:15.789614 17833 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.753545 17418 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:15.807049 17702 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.825457 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:15.840320 12621 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:15.830909 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:15.834399 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 77395.5us
I20260709 13:05:15.841334 12616 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
I20260709 13:05:15.837154 12619 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14. Ops: []
W20260709 13:05:15.837409 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 92157.6us
I20260709 13:05:15.827340 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:15.843616 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:15.809105 17885 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:15.843315 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:15.790716 17943 consensus_queue.cc:1059] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:05:15.807401 17834 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:15.845592 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:15.846032 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:15.809589 17783 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:15.846771 12539 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:15.843279 13226 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:15.852558 12689 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:15.837386 17922 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:15.764086 17929 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:15.878351 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.909219 12662 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:15.916831 17746 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:15.907768 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:15.917706 17746 raft_consensus.cc:697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:15.918794 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:15.919466 12689 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:15.919188 17746 consensus_queue.cc:237] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:15.920480 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:15.908969 12616 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:05:15.921578 12616 pending_rounds.cc:85] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 8
I20260709 13:05:15.921887 12616 pending_rounds.cc:107] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 9.9
W20260709 13:05:15.921052 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 108901us
I20260709 13:05:15.922154 12616 raft_consensus.cc:2889] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:15.922611 12510 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:15.897053 17740 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:15.925513 12689 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:15.923544 17943 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:15.938966 12662 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:15.927163 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:15.951578 12510 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:15.930249 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:15.934451 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:15.936349 17983 log.cc:927] Time spent T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:05:15.911744 17988 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:15.954838 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:15.953284 12510 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:15.836789 17833 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:15.993876 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 53116.4us
I20260709 13:05:15.937717 17575 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:15.986047 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:15.853744 17702 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:15.847059 17930 consensus_queue.cc:260] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:15.906610 17834 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:16.006091 17682 consensus_meta.cc:287] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.557s	user 0.009s	sys 0.000s
I20260709 13:05:16.006906 12540 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:05:16.007465 17834 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:15.907550 17989 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.095s
W20260709 13:05:16.004274 17973 log.cc:927] Time spent T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:05:16.009620 17929 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:16.005013 17702 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:16.010797 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:16.011483 12696 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:16.012717 12696 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:16.015022 17833 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:16.016283 17926 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:05:16.018214 17978 log.cc:927] Time spent T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 13:05:15.914345 17958 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:05:15.994563 17965 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:15.990435 17417 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:15.995057 17863 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:15.998191 17518 consensus_meta.cc:287] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.715s	user 0.011s	sys 0.001s
I20260709 13:05:15.998281 17988 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:15.999609 17974 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
I20260709 13:05:16.024245 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:16.029084 12621 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:16.030015 12616 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:05:16.020728 17575 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:05:16.034139 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 80954.3us
I20260709 13:05:15.985527 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:15.994241 17922 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:05:16.025758 12696 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:05:16.032126 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:16.021325 17834 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:16.010274 17929 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:05:16.023698 17702 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:16.042075 17857 consensus_meta.cc:287] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.000s
I20260709 13:05:16.044013 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:16.042683 17989 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:16.046521 12510 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:16.042613 17857 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:16.036818 12689 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:16.058887 12510 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:16.032002 17941 raft_consensus.cc:697] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:16.067343 17941 consensus_queue.cc:237] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:16.027611 17863 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:16.028581 17518 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:16.047988 17943 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:16.085955 12614 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:16.047235 17682 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.094009 17682 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:16.095115 17927 consensus_meta.cc:287] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.000s
I20260709 13:05:16.086242 17943 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:16.096349 17682 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:16.052522 17882 consensus_meta.cc:287] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.004s
I20260709 13:05:16.096654 17943 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:16.046710 17702 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:16.097916 17746 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:16.098536 17746 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:16.099360 17702 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:16.100907 17746 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:16.101233 17518 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:16.073894 17417 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:16.103829 17863 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:16.106226 17998 log.cc:927] Time spent T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:05:16.107250 17987 log.cc:927] Time spent T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:05:16.083302 17772 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:05:16.086640 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.116210 17885 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:16.132187 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.129469 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 1183) took 1044 ms. Trace:
I20260709 13:05:16.132918 12540 rpcz_store.cc:276] 0709 13:05:15.085482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.089689 (+  4207us) service_pool.cc:224] Handling call
0709 13:05:16.129269 (+1039580us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b54002bb454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:16.129397 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1836958976}
I20260709 13:05:16.117605 17515 raft_consensus.cc:3055] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:16.161815 12510 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:16.162415 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 173905us
I20260709 13:05:16.165058 12588 leader_election.cc:400] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15.
I20260709 13:05:16.165057 12510 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:16.165521 12588 leader_election.cc:403] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:05:16.166442 18015 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:16.168380 17989 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:16.169806 17989 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:16.170075 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:16.170462 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.170666 12546 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:16.171788 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:16.173866 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:16.174182 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:16.174491 12538 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:16.177193 12545 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 13:05:16.178464 12545 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:05:16.179643 12545 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:16.181001 12545 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:16.121462 17857 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:16.124483 17772 raft_consensus.cc:697] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:16.198238 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:16.199095 12540 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:16.272409 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 107478us
I20260709 13:05:16.274845 12545 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:16.278076 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:16.278789 12544 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:16.280431 12543 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:16.163805 17515 raft_consensus.cc:740] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:16.291671 12547 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:16.276902 17697 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15.
I20260709 13:05:16.298432 12544 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:05:16.171228 17749 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.123s
I20260709 13:05:16.302387 12546 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:05:16.310039 17515 consensus_queue.cc:260] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:16.310827 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:16.310437 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:16.313915 12544 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:16.314827 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:16.316009 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:16.317283 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:16.317499 12540 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:16.317833 17772 consensus_queue.cc:237] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:16.318696 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:16.320415 12540 raft_consensus.cc:1240] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:16.159667 17992 consensus_queue.cc:1059] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.134s
I20260709 13:05:16.277946 17863 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:05:16.325968 12543 raft_consensus.cc:1240] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:16.328117 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:16.330205 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:16.305931 17968 consensus_meta.cc:287] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.649s	user 0.010s	sys 0.000s
I20260709 13:05:16.334431 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:16.342654 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.344360 17885 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:16.346773 17988 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:16.348523 17753 consensus_queue.cc:260] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:16.346774 17965 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:16.352695 17515 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:16.354013 17968 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:16.355099 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:16.355337 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:16.355801 12539 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:05:16.356782 17968 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:16.356896 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:16.357498 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:16.357769 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:16.356925 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:16.358443 12621 raft_consensus.cc:2393] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 12: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:16.359073 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:16.360004 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:16.361334 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:16.363221 12541 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:05:16.364053 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:16.363570 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:16.364877 12621 raft_consensus.cc:2393] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 9: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:16.364815 12615 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:16.365474 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:16.366680 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:16.371642 17834 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:05:16.372931 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.373576 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:16.375859 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:16.372010 17418 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:16.336333 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:16.376502 12616 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:05:16.380100 12662 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:16.381145 12546 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 12: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:16.381342 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:16.381958 12616 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:16.358148 17753 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:16.384585 12662 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:16.387717 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:16.389946 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:16.390596 12543 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:16.391453 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:16.392469 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:16.392952 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:16.393002 12539 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:16.395270 12662 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:16.397392 12545 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:05:16.400015 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:16.400588 12546 raft_consensus.cc:2376] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12. Re-sending same reply.
I20260709 13:05:16.401877 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:16.402630 12539 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:16.403401 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:16.404002 12539 raft_consensus.cc:2376] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9. Re-sending same reply.
I20260709 13:05:16.405669 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:16.383360 17460 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:16.407547 17460 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:16.407635 17927 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.408283 17927 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:16.410037 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:16.410660 17927 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:16.410960 12543 raft_consensus.cc:2410] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 17 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:05:16.412326 12662 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:16.414666 17965 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:16.415035 17965 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.415351 17965 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:16.406474 12539 raft_consensus.cc:2376] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12. Re-sending same reply.
I20260709 13:05:16.406520 12546 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:16.423014 17965 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:16.428898 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:16.429819 12621 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:16.380146 17968 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:16.423249 12616 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:16.423863 12662 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:16.425206 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:16.361191 17943 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:16.386897 17418 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:16.398654 17862 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:16.446583 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:16.423514 17834 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:16.448493 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:16.449262 17922 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:16.456310 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:16.461424 18005 raft_consensus.cc:3055] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:16.461917 18005 raft_consensus.cc:740] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:16.462754 18005 consensus_queue.cc:260] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:16.463970 18005 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:16.468864 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:16.469697 12689 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 13: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:16.470703 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:16.474043 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:16.476029 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:16.477092 12696 raft_consensus.cc:2368] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 9. Current term is 10.
I20260709 13:05:16.483588 12659 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:16.441807 17968 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:16.448422 17927 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:16.491432 12512 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:16.486878 18002 consensus_queue.cc:1059] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:05:16.492620 18013 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:16.501266 12539 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:05:16.451429 17922 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:16.501708 12512 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:16.454399 17418 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:16.501271 17988 raft_consensus.cc:2764] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:05:16.502669 12512 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:16.503170 17988 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:16.503449 17862 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:16.501957 17922 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:16.503630 12512 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:16.504467 17862 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:16.505398 12512 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:16.505259 17862 consensus_queue.cc:1059] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:16.506049 17862 consensus_queue.cc:1243] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:05:16.506182 17989 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:16.506337 12512 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:16.506703 17989 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:16.507167 17989 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:16.507421 17772 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:16.502353 17418 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.509974 17418 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:16.510535 12512 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:16.511454 18015 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:16.511837 12512 leader_election.cc:400] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 9. Current term is 10.
I20260709 13:05:16.512162 12512 leader_election.cc:403] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:16.515295 18015 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:16.455312 17929 consensus_queue.cc:1059] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 13:05:16.517454 17943 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:16.451643 17834 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:16.527196 17834 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:16.503538 17988 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.528373 17988 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:16.529073 17968 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:16.533843 17770 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:16.534813 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 44364.1us
I20260709 13:05:16.535708 12659 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:16.536428 17929 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:16.536834 17929 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.537156 17929 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:16.516218 17965 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:16.537039 12659 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:16.538767 12544 raft_consensus.cc:2410] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:05:16.545885 17860 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:16.546113 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.546474 17860 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:16.548306 12659 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:16.548712 17860 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:16.549373 17927 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:16.550762 17927 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:16.552615 12659 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:16.554675 12659 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:16.559859 12616 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
W20260709 13:05:16.560236 18025 log.cc:927] Time spent T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.110s	user 0.004s	sys 0.000s
I20260709 13:05:16.560302 12616 pending_rounds.cc:85] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 14
I20260709 13:05:16.560827 12616 pending_rounds.cc:107] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 13:05:16.561061 12616 raft_consensus.cc:2889] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:16.564316 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:16.565932 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:16.566550 12615 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:16.567288 18015 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 9. Current term is 10.
I20260709 13:05:16.569176 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:16.569880 12616 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:16.572705 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:16.575702 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:16.582302 12688 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:05:16.591486 12659 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:16.592345 12621 raft_consensus.cc:1275] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:05:16.600597 12615 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:05:16.570317 17965 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:16.580274 17968 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:16.580482 17927 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:16.585839 17460 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:16.607962 12659 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:16.590875 18015 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:16.615914 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:16.603546 17746 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:16.604322 17575 consensus_queue.cc:1059] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:05:16.603981 17658 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 13:05:16.616897 17460 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:16.626889 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 1969) took 1684 ms. Trace:
I20260709 13:05:16.635676 12694 rpcz_store.cc:276] 0709 13:05:14.942421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.011381 (+ 68960us) service_pool.cc:224] Handling call
0709 13:05:15.011777 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:15.201532 (+189755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.626630 (+1425098us) spinlock_profiling.cc:243] Waited 68 ms on lock 0x7b540009c254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:16.626822 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":156428160}
I20260709 13:05:16.625326 12538 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:05:16.627960 17922 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:16.630476 18015 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:16.632987 12546 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:05:16.605235 17968 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.638703 17575 consensus_queue.cc:1243] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:05:16.639122 17963 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:16.602211 17988 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:16.651279 12546 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:16.634158 17746 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:16.658646 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 50748.3us
I20260709 13:05:16.650043 17968 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:16.634133 18002 consensus_queue.cc:1048] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:05:16.656282 17746 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:16.657723 17963 raft_consensus.cc:697] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 10 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:16.668047 18015 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:16.669939 17988 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:16.673947 18002 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:16.678972 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:16.625330 17929 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:16.648339 17989 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:16.684746 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:16.685762 12695 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:16.667084 17658 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:16.646994 17418 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:16.681268 17918 raft_consensus.cc:3055] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:16.727394 12696 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:16.729485 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:16.730239 12546 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:16.706904 17927 raft_consensus.cc:697] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:16.732321 12695 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
I20260709 13:05:16.739784 12543 raft_consensus.cc:1240] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:16.744282 17965 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:16.744907 17965 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:16.753916 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:16.754145 18030 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:05:16.756901 12694 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:05:16.757972 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:16.761760 17994 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.916s	user 0.003s	sys 0.001s
W20260709 13:05:16.763545 12618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 3506) took 1912 ms (client timeout 2203 ms). Trace:
W20260709 13:05:16.764007 12618 rpcz_store.cc:269] 0709 13:05:14.851461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.851569 (+   108us) service_pool.cc:224] Handling call
0709 13:05:16.763356 (+1911787us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b54001ca554. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:16.763481 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":843621120}
I20260709 13:05:16.765102 12512 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:16.765404 12687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 1301) took 1801 ms (client timeout 1845 ms). Trace:
W20260709 13:05:16.765885 12687 rpcz_store.cc:269] 0709 13:05:14.964161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.971753 (+  7592us) service_pool.cc:224] Handling call
0709 13:05:16.765215 (+1793462us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54002ca954. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:16.765343 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":371768192}
I20260709 13:05:16.767678 17831 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:16.768007 18013 raft_consensus.cc:3055] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:16.768204 17831 raft_consensus.cc:697] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:16.768481 18013 raft_consensus.cc:740] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:16.769248 17831 consensus_queue.cc:237] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:16.773651 12620 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:05:16.775084 17460 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:16.708243 17918 raft_consensus.cc:740] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:16.686463 18002 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:16.788546 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:16.708933 17658 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:16.795259 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 1995) took 1596 ms. Trace:
I20260709 13:05:16.792898 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:16.762387 17965 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:16.799955 17565 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:05:16.818714 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:16.786775 18015 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:05:16.795879 12691 rpcz_store.cc:276] 0709 13:05:15.199153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.199269 (+   116us) service_pool.cc:224] Handling call
0709 13:05:15.213363 (+ 14094us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:15.213583 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:05:15.516500 (+302917us) log.cc:844] Serialized 14 byte log entry
0709 13:05:15.756182 (+239682us) log.cc:844] Serialized 14 byte log entry
0709 13:05:15.762050 (+  5868us) log.cc:844] Serialized 14 byte log entry
0709 13:05:16.460111 (+698061us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b18001fd380. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a6406c0a 00007fc3afb46219 00007fc3ad44d58f 00007fc3a648c571 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd
0709 13:05:16.683165 (+223054us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b18001fd380. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a6489455 00007fc3a9571060 00007fc3a9583716 00007fc3a9594287 00007fc3a9594208
0709 13:05:16.789536 (+106371us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:16.794965 (+  5429us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:16.795013 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.795080 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:16.795197 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36927,"prepare.queue_time_us":1066635,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":104,"raft.queue_time_us":27977,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":32131,"spinlock_wait_cycles":40457728,"thread_start_us":633399,"threads_started":3,"wal-append.queue_time_us":305814}
I20260709 13:05:16.824734 17944 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:16.825637 17918 consensus_queue.cc:260] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:16.829339 17936 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:16.869999 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1116) took 1712 ms. Trace:
I20260709 13:05:16.870401 13234 rpcz_store.cc:276] 0709 13:05:15.157264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.157389 (+   125us) service_pool.cc:224] Handling call
0709 13:05:15.157735 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:15.315949 (+158214us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:05:15.711724 (+395775us) log.cc:844] Serialized 14 byte log entry
0709 13:05:16.024998 (+313274us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:16.025125 (+   127us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:16.026432 (+  1307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.869750 (+843318us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54006a3bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:16.869793 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:16.869918 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108814,"prepare.queue_time_us":133909,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"spinlock_wait_cycles":363236224,"thread_start_us":535562,"threads_started":3,"wal-append.queue_time_us":315910}
I20260709 13:05:16.829741 17925 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:16.872816 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1325) took 1321 ms. Trace:
I20260709 13:05:16.830840 17906 raft_consensus.cc:3055] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:16.873483 17906 raft_consensus.cc:740] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:16.874588 17906 consensus_queue.cc:260] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:16.830741 12588 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:16.876169 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 45523.2us
I20260709 13:05:16.876959 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:16.731340 17963 consensus_queue.cc:237] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:16.880455 17565 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.880702 17993 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:16.881132 17993 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.881057 17565 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:16.881628 17993 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:16.838608 17922 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:16.883487 17565 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:16.883664 17749 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:16.884364 17749 consensus_queue.cc:1059] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:16.885270 17749 raft_consensus.cc:3055] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:16.893606 17749 raft_consensus.cc:740] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:05:16.895093 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.895856 17906 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:16.858939 12539 raft_consensus.cc:3055] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:16.897135 12539 raft_consensus.cc:740] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:16.897797 18002 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:16.859995 17985 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:16.897996 12539 consensus_queue.cc:260] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:16.898509 17985 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:16.898947 17985 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:16.899241 12539 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:16.802948 18029 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:16.900213 18029 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:16.894603 17749 consensus_queue.cc:260] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:16.903203 17749 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:16.918321 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 953) took 1428 ms. Trace:
W20260709 13:05:16.919627 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:16.920087 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.873262 12614 rpcz_store.cc:276] 0709 13:05:15.551235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.553386 (+  2151us) service_pool.cc:224] Handling call
0709 13:05:15.568359 (+ 14973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:16.086614 (+518255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.872562 (+785948us) spinlock_profiling.cc:243] Waited 517 ms on lock 0x7b54002a71d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:16.872739 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1189798144}
I20260709 13:05:16.927205 12662 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:16.864390 17930 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:16.864987 17927 consensus_queue.cc:237] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:16.877030 17658 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:16.839964 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.878921 12588 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:16.937549 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
W20260709 13:05:16.938186 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 59334.4us
I20260709 13:05:16.938902 12588 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:16.939011 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:16.896025 17989 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:16.802802 17569 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:05:16.918802 13231 rpcz_store.cc:276] 0709 13:05:15.489899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.490621 (+   722us) service_pool.cc:224] Handling call
0709 13:05:15.490885 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:15.491070 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:05:15.519016 (+ 27946us) log.cc:844] Serialized 14 byte log entry
0709 13:05:16.917989 (+1398973us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:16.918040 (+    51us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:16.918090 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.918155 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:16.918263 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1075566,"prepare.queue_time_us":57993,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":5615,"thread_start_us":323012,"threads_started":1,"wal-append.queue_time_us":522959}
I20260709 13:05:16.934664 12539 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:05:16.835639 17418 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:16.795527 17961 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:16.799116 17772 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:16.950752 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:16.951668 12695 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:16.941257 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:16.797187 17857 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:16.960891 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3497) took 2372 ms. Trace:
I20260709 13:05:16.798295 18033 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:16.792309 18032 consensus_queue.cc:1059] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.142s
I20260709 13:05:16.962007 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:16.962661 12693 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:05:16.963403 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:16.964484 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:16.795722 17791 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.155s
I20260709 13:05:16.967510 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:16.961418 12617 rpcz_store.cc:276] 0709 13:05:14.588971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.589252 (+   281us) service_pool.cc:224] Handling call
0709 13:05:15.236453 (+647201us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:15.460868 (+224415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.960681 (+1499813us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b540009a1d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:16.960827 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1487552896}
I20260709 13:05:16.769407 18013 consensus_queue.cc:260] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:16.980463 12614 raft_consensus.cc:1217] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Deduplicated request from leader. Original: 11.7->[12.8-12.8]   Dedup: 12.8->[]
I20260709 13:05:16.984058 12614 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 13:05:16.966238 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.982035 12692 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:16.982481 12691 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:16.941759 12539 pending_rounds.cc:85] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 7
I20260709 13:05:16.988327 12539 pending_rounds.cc:107] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:05:16.988957 12539 raft_consensus.cc:2889] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:16.951258 17925 raft_consensus.cc:2764] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 13:05:17.031466 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:17.022871 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.030045 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:17.031068 12696 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:16.956847 17860 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:16.950279 17961 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:16.965358 17938 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:17.057258 12693 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 16: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:05:17.054749 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 86479.6us
I20260709 13:05:17.050288 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:17.054314 12692 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:17.055531 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:17.059653 12613 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
I20260709 13:05:17.057852 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:16.955274 17658 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:17.065536 12691 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:17.067538 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:17.068157 12618 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
I20260709 13:05:16.969224 17908 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.068717 17908 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.069792 17979 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.070386 17979 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.071143 17908 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:17.072068 17565 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:16.969604 17857 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:17.072817 17979 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:16.951447 18014 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.099s
I20260709 13:05:17.073365 17753 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.074134 18032 raft_consensus.cc:3055] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:17.073951 17753 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.074539 18032 raft_consensus.cc:740] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:17.075443 18032 consensus_queue.cc:260] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:17.076324 17753 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:17.076815 18032 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:16.969332 18002 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:16.965121 17769 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:05:17.082228 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.082867 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:17.083407 12547 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:17.071308 17877 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:05:17.072625 17565 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.047755 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:17.095600 12614 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:17.047943 17962 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.079962 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:17.099313 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:17.099974 12541 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:17.080585 12587 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:17.064280 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:17.069344 12618 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:17.089643 17769 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:16.997442 17783 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.110486 12542 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:05:17.113617 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:17.056660 17961 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:17.114302 12543 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
W20260709 13:05:17.115255 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 56118us
I20260709 13:05:17.078687 17938 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:17.121338 12512 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:17.068179 17965 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:17.094877 18013 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:17.158476 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.146314 12547 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:17.145713 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:17.155764 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1109) took 2000 ms. Trace:
I20260709 13:05:17.159775 12662 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:17.159759 12617 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:17.093237 17860 raft_consensus.cc:697] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:05:17.206528 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 1.35878e+06us
I20260709 13:05:17.211802 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.213063 13227 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:17.211951 13231 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:05:17.210345 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:17.214735 13234 raft_consensus.cc:2368] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13.
I20260709 13:05:17.212419 13228 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:17.197216 12617 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:17.217140 12659 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:17.152127 12541 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:17.149474 12614 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:17.081647 17569 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:16.981760 18033 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:17.165704 18035 log.cc:927] Time spent T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:05:17.207505 13197 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:17.224210 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 64527.9us
I20260709 13:05:17.220976 17815 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.166049 17988 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:17.226763 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.228103 13228 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 13:05:17.155336 17770 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:17.230542 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:17.235049 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.207304 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:17.236629 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.236804 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:17.135639 17834 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.238243 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:17.225883 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:17.271903 13226 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:05:17.272039 13231 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:17.165990 18029 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:17.161011 17938 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:17.254969 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.228823 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:17.156575 17753 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.112s
I20260709 13:05:17.289189 13227 raft_consensus.cc:2368] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14.
I20260709 13:05:17.206815 17943 consensus_queue.cc:1059] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 13:05:17.123121 17944 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.120337 17929 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:17.232115 17861 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:17.220675 17768 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.286939 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.337705 13226 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:17.339110 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.340097 13226 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 16: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:05:17.256011 17986 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:05:17.117655 17962 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.290026 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:17.264582 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:17.223368 18014 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:17.237355 17965 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:17.292112 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.147349 17906 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:17.253953 17763 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:17.350261 13233 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:05:17.351313 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.238833 18010 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:17.257521 17918 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:17.123267 17782 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:17.337415 13231 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:17.273675 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.345288 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.349896 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 951) took 1860 ms. Trace:
I20260709 13:05:17.123138 17783 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.292227 17979 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:17.375136 13235 rpcz_store.cc:276] 0709 13:05:15.489272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.489403 (+   131us) service_pool.cc:224] Handling call
0709 13:05:15.489808 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:15.490171 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:15.490198 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:15.490693 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:05:15.765081 (+274388us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:15.809325 (+ 44244us) log.cc:844] Serialized 14 byte log entry
0709 13:05:16.817296 (+1007971us) spinlock_profiling.cc:243] Waited 6.33 ms on lock 0x7b1800405e20. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a6406c0a 00007fc3afb46219 00007fc3a648ea40 00007fc3a64894e4 00007fc3a6489455 00007fc3a9571060 00007fc3a9583716 00007fc3a9594287 00007fc3a9594208
0709 13:05:17.335330 (+518034us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.335399 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:17.335436 (+    37us) raft_consensus.cc:1685] finished
0709 13:05:17.349694 (+ 14258us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:17.349841 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":987844,"prepare.queue_time_us":44396,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2677,"raft.queue_time_us":1136865,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":8911,"spinlock_wait_cycles":14557568,"thread_start_us":609449,"threads_started":2,"wal-append.queue_time_us":417928,"wal-append.run_cpu_time_us":2877,"wal-append.run_wall_time_us":1069756}
I20260709 13:05:17.239442 17569 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.383725 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:17.280297 17988 raft_consensus.cc:697] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 17 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:17.291739 17840 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:17.369493 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.390661 13231 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 16: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:17.391494 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.369825 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:17.344905 17746 consensus_meta.cc:287] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.670s	user 0.010s	sys 0.000s
I20260709 13:05:17.375522 17782 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.292002 17977 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:17.377452 13228 raft_consensus.cc:2393] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 14: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:17.380498 13230 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:17.288025 17885 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.276576 17880 consensus_queue.cc:1059] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.086s
I20260709 13:05:17.383266 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.344731 17861 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.385648 12619 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:17.276114 17834 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:17.384606 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 405504us
W20260709 13:05:17.396482 17968 consensus_meta.cc:287] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.731s	user 0.003s	sys 0.007s
I20260709 13:05:17.271811 17815 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.353857 17763 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:17.394492 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:17.354025 17944 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.280794 17770 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.378509 17965 raft_consensus.cc:697] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:17.409634 17840 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:17.446133 17965 consensus_queue.cc:237] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:17.447242 18037 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:05:17.447340 17840 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:17.410601 13200 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:17.376957 17906 raft_consensus.cc:697] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:17.450109 17906 consensus_queue.cc:237] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.452030 17769 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:17.453055 17565 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:17.416559 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:17.454172 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 43652.2us
I20260709 13:05:17.454432 13228 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:17.455056 17713 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:17.455381 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.456642 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.456910 17783 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:17.457576 17763 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:17.461460 17782 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:17.461889 18034 log.cc:927] Time spent T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.341s	user 0.001s	sys 0.001s
I20260709 13:05:17.467192 17834 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:17.410902 17908 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.468098 17908 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.475365 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.454543 17569 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:17.483578 17988 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.292127 18029 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:17.385916 17860 consensus_queue.cc:237] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:17.486038 18029 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:17.365754 18014 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.490760 17770 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:17.490897 18014 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:17.383919 18036 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:17.420743 17977 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.455479 13200 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:17.349864 17768 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.395797 12547 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:17.499183 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:17.500442 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3501) took 2875 ms. Trace:
I20260709 13:05:17.502661 12622 rpcz_store.cc:276] 0709 13:05:14.625224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.625347 (+   123us) service_pool.cc:224] Handling call
0709 13:05:14.625697 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:14.626006 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:14.626033 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:16.657090 (+2031057us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b2c0004c3c8. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:05:16.659517 (+  2427us) log.cc:844] Serialized 26 byte log entry
0709 13:05:16.794748 (+135231us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:16.794783 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:16.794854 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:17.492617 (+697763us) raft_consensus.cc:1685] finished
0709 13:05:17.492639 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:17.500370 (+  7731us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":328,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":7893376,"thread_start_us":134863,"threads_started":1,"wal-append.queue_time_us":337193}
I20260709 13:05:17.426513 17964 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:17.500890 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 45480.1us
I20260709 13:05:17.509104 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:17.505538 13228 raft_consensus.cc:2393] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 14: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:05:17.433157 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.413143 17746 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.388154 17979 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:17.525101 17993 consensus_meta.cc:287] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.643s	user 0.011s	sys 0.000s
I20260709 13:05:17.525772 17993 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.526921 17768 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:17.500626 17565 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:17.527473 13234 raft_consensus.cc:2393] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 17: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:17.527801 17565 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.529175 17993 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:17.530022 17962 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:17.530953 12588 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:17.492206 17753 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:17.521282 17964 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.536885 17753 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.540197 17753 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:17.439297 17968 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:17.541705 12687 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:17.543417 17968 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:17.544418 17857 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:17.544983 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:17.373835 18010 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:17.528538 17930 consensus_meta.cc:287] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.578s	user 0.004s	sys 0.002s
I20260709 13:05:17.421206 17885 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.573413 17968 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.575188 17968 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.576026 17944 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:17.577203 17968 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:17.581137 17861 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:17.582939 17746 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:17.583312 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:17.583963 12695 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:05:17.585940 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:17.586571 12691 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:17.525400 17815 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:17.523020 17900 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:17.530059 17565 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:17.590929 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:17.591596 17908 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:17.603482 13232 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:05:17.589962 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:17.605970 12690 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:17.605443 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:17.607599 12692 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:17.609036 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:17.613883 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 82984.7us
I20260709 13:05:17.615649 12619 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:05:17.618101 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.618237 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:17.160241 13229 rpcz_store.cc:276] 0709 13:05:15.155131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.155297 (+   166us) service_pool.cc:224] Handling call
0709 13:05:15.155687 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:15.155964 (+   277us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:05:15.482470 (+326506us) log.cc:844] Serialized 14 byte log entry
0709 13:05:16.551049 (+1068579us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b18002990e0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a6406c0a 00007fc3afb46219 00007fc3a648ea40 00007fc3a64894e4 00007fc3a6489455 00007fc3acf713c7 00007fc3a95839a7 00007fc3a95930bf 00007fc3a9593038
0709 13:05:16.551277 (+   228us) log.cc:844] Serialized 14 byte log entry
0709 13:05:17.114309 (+563032us) log.cc:844] Serialized 14 byte log entry
0709 13:05:17.114530 (+   221us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:17.114597 (+    67us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:17.114663 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.114766 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:17.155698 (+ 40932us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":690824,"prepare.queue_time_us":1041083,"prepare.run_cpu_time_us":119,"prepare.run_wall_time_us":121,"raft.queue_time_us":695562,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":45120,"spinlock_wait_cycles":137160576,"thread_start_us":486663,"threads_started":2,"wal-append.queue_time_us":514922}
I20260709 13:05:17.641355 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:17.649099 12692 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:05:17.652316 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:17.653172 12690 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:05:17.650672 13228 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:05:17.650470 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:17.654659 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.657142 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:17.657886 12619 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
W20260709 13:05:17.659505 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 478140us
W20260709 13:05:17.662699 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.669958 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:17.670622 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.670737 13235 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:17.671716 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.672418 13235 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
I20260709 13:05:17.673667 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:17.661463 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.625698 17565 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:17.617672 17979 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:17.671114 13197 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:17.573602 18042 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:17.705860 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.625345 18029 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:05:17.719465 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 478771us
I20260709 13:05:17.719686 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:17.719686 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:17.626920 17857 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
W20260709 13:05:17.719579 18013 consensus_meta.cc:287] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.003s
I20260709 13:05:17.731784 12513 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:17.733804 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.705471 17565 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:17.743331 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:17.746917 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.746902 12587 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:17.749538 12513 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:17.708472 18043 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:17.763993 18043 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.766413 18043 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:17.720660 17861 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:17.767510 17861 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:17.767987 17861 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:17.755985 18015 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:17.718241 17968 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.769829 17968 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:17.753249 17565 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:17.772066 17968 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:17.754573 12689 raft_consensus.cc:2410] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
W20260709 13:05:17.773387 18032 consensus_meta.cc:287] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.696s	user 0.010s	sys 0.004s
W20260709 13:05:17.774824 17985 consensus_meta.cc:287] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.875s	user 0.010s	sys 0.002s
I20260709 13:05:17.775326 17985 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.776731 12617 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:17.724634 18042 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.777791 18042 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:17.779564 18032 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:17.758325 12587 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:17.707549 17763 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.762425 17753 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:17.760339 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.782615 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:17.793054 12587 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:17.803308 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:17.800582 18058 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:17.806015 18058 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:17.806463 18058 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:17.803447 12587 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:17.807554 12662 leader_election.cc:400] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13.
I20260709 13:05:17.807971 12662 leader_election.cc:403] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:05:17.790623 12513 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:17.812237 18005 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:05:17.795131 17658 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.011s	sys 0.016s
W20260709 13:05:17.813079 13199 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.894s	user 0.018s	sys 0.022s
W20260709 13:05:17.798970 17961 consensus_meta.cc:287] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.632s	user 0.011s	sys 0.000s
I20260709 13:05:17.815425 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:17.826815 12619 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:17.790606 18060 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:17.830003 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:17.820621 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:17.791687 17944 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:17.822304 13199 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.018s	sys 0.022s
I20260709 13:05:17.823289 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:17.819984 12513 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:17.807201 18015 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.859454 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:17.812582 17575 raft_consensus.cc:3055] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:17.862704 12513 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:17.847448 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:17.810175 17753 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:17.826256 17658 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.012s	sys 0.016s
I20260709 13:05:17.854292 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:05:17.823979 17397 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.012s	sys 0.032s
I20260709 13:05:17.856403 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:17.881206 12616 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:17.882505 12659 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:17.858084 12693 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:05:17.884711 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:17.885257 12693 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:05:17.886026 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:17.858445 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:17.887306 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:17.888268 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:17.860541 12694 raft_consensus.cc:2410] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 13:05:17.827812 17927 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.006s	sys 0.023s
I20260709 13:05:17.862803 12622 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:05:17.798648 17857 consensus_queue.cc:1059] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:05:17.864064 12690 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:17.807709 17770 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:17.865264 12614 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:05:17.826237 17989 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:17.814476 17460 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:05:17.871376 12691 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:17.867373 12513 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:17.873420 18053 log.cc:927] Time spent T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:05:17.870244 17772 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:17.864331 17834 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:17.859475 17877 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.875619 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:17.873209 17753 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.835769 17985 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:17.879596 18044 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:05:17.898284 13199 connection.cc:256] RPC call timeout handler was delayed by -1.2447154080000473s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1845s for a response
W20260709 13:05:18.012315 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 204845us
I20260709 13:05:17.922264 12619 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
W20260709 13:05:17.871445 17938 consensus_meta.cc:287] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.539s	user 0.011s	sys 0.001s
I20260709 13:05:17.929979 18043 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:17.933072 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:17.831202 18005 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:17.969234 17749 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:05:18.039294 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 156892us
I20260709 13:05:18.040491 12618 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:17.864610 17575 raft_consensus.cc:740] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:05:17.975960 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 108632us
I20260709 13:05:17.889302 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:18.022822 13199 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:18.047188 13199 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:18.048074 17768 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:18.048777 17768 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:17.854507 18060 raft_consensus.cc:697] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:17.928433 17770 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.049968 17770 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:18.050107 18060 consensus_queue.cc:237] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.938472 17713 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:18.049423 17880 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:05:18.054153 17713 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.056684 12659 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:17.969945 17929 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13.
I20260709 13:05:18.058038 17929 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.059022 17840 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:18.058807 17929 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.061079 17840 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:17.975103 17857 consensus_queue.cc:1243] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:05:18.032950 13229 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:18.057806 12659 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:18.062737 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:18.062845 17927 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:18.063534 17927 raft_consensus.cc:697] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:18.063925 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:18.064718 13229 raft_consensus.cc:2393] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 14: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:18.064543 17927 consensus_queue.cc:237] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:17.867018 18015 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.025517 12587 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:17.878038 17397 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.013s	sys 0.032s
I20260709 13:05:17.978091 17772 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.844873 17961 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:17.983186 17783 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:18.065524 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:18.072309 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:18.048772 13199 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:05:17.899816 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 92385.9us
I20260709 13:05:18.075335 12662 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:18.077260 12662 leader_election.cc:400] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14.
I20260709 13:05:17.975239 17885 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:18.078685 17885 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:18.079134 17885 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.079516 17885 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:18.082808 13199 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:18.084241 17968 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:18.085426 17880 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:18.086259 17880 consensus_queue.cc:1059] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:18.080770 17929 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:18.068121 18015 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:18.069159 17772 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:18.067798 17840 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:18.092765 17840 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:18.088066 17768 raft_consensus.cc:3055] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:18.071380 17961 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:18.094414 17768 raft_consensus.cc:740] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:18.095667 17768 consensus_queue.cc:260] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.071588 17783 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.097342 17783 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:18.099813 12662 leader_election.cc:403] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:05:18.101430 12662 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:18.102813 17965 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14.
I20260709 13:05:18.103597 17965 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:18.104120 17965 raft_consensus.cc:697] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:18.105242 17965 consensus_queue.cc:237] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.107781 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:18.086839 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:18.121132 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 2135) took 1165 ms. Trace:
I20260709 13:05:18.116600 13199 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:18.133723 12662 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:18.137496 12662 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:18.127336 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 101886us
I20260709 13:05:18.143453 12587 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:18.145183 18066 log.cc:927] Time spent T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:05:18.111788 17713 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:18.148103 17565 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.121706 17918 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 13:05:18.149822 17763 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:18.045233 17749 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.121544 12613 rpcz_store.cc:276] 0709 13:05:16.955976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.081286 (+125310us) service_pool.cc:224] Handling call
0709 13:05:17.139730 (+ 58444us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b58001f4198. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:05:17.140017 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:17.141705 (+  1688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:17.141754 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:17.162921 (+ 21167us) log.cc:844] Serialized 26 byte log entry
0709 13:05:17.660101 (+497180us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:17.660142 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.660206 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:18.046392 (+386186us) raft_consensus.cc:1685] finished
0709 13:05:18.046413 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.121062 (+ 74649us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":159,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":50149,"spinlock_wait_cycles":4844416,"thread_start_us":496816,"threads_started":1,"wal-append.queue_time_us":590169}
I20260709 13:05:18.021690 17877 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:18.261328 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 123909us
I20260709 13:05:18.118338 18002 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:18.258096 17979 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:18.136943 17936 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:05:18.275997 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 132603us
I20260709 13:05:18.036494 17938 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.115140 17929 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.159261 17658 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:18.303534 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1333) took 1041 ms. Trace:
I20260709 13:05:18.294605 18058 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.299147 17877 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:18.301851 17929 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:18.227484 18015 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.033802 18044 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.250872 17791 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:18.261102 17460 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:18.039811 18043 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:18.282775 17861 consensus_meta.cc:287] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
W20260709 13:05:18.325024 18052 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.504s	user 0.000s	sys 0.001s
I20260709 13:05:18.284406 17857 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:18.355908 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:18.268726 18002 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:18.309520 18034 log.cc:927] Time spent T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:05:18.153131 17772 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.367110 17938 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:18.317062 17575 consensus_queue.cc:260] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:18.394055 17575 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:18.394752 17772 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:18.395656 18079 log.cc:927] Time spent T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:05:18.338449 18015 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:18.370865 18071 log.cc:927] Time spent T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:05:18.371704 18072 log.cc:927] Time spent T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
I20260709 13:05:18.398386 18015 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:18.373678 18082 log.cc:927] Time spent T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:05:18.356370 17857 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:18.374907 17565 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:18.375294 17658 raft_consensus.cc:697] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:18.399976 17857 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:18.401080 17658 consensus_queue.cc:237] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.339062 17460 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.403858 17460 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:18.330941 17791 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.406149 17791 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:18.399712 18058 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:18.412282 17460 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.413440 17857 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.387841 17753 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:18.376900 17749 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:18.380548 18042 consensus_meta.cc:287] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.602s	user 0.006s	sys 0.001s
I20260709 13:05:18.382540 18005 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:18.384384 17929 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:05:18.385313 18064 log.cc:927] Time spent T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.520s	user 0.000s	sys 0.001s
I20260709 13:05:18.386262 17885 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.413553 18044 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:05:18.427507 18038 log.cc:927] Time spent T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.981s	user 0.000s	sys 0.002s
I20260709 13:05:18.430910 18033 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:18.432657 17791 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:18.387339 18043 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:18.388417 18057 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:18.387355 17840 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:18.356030 17861 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.390615 17770 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:18.437361 17977 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:18.461439 17770 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:18.418411 18040 log.cc:927] Time spent T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.972s	user 0.002s	sys 0.001s
I20260709 13:05:18.462687 18036 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:18.423218 17885 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:18.464349 17769 raft_consensus.cc:3055] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:18.419967 18042 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.464838 17769 raft_consensus.cc:740] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:18.466045 17769 consensus_queue.cc:260] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.467386 17769 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:18.424065 17783 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.470868 17783 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:18.424214 18002 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:18.422966 18010 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:18.415154 17883 raft_consensus.cc:3055] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:18.458616 17861 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:18.458731 17936 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:18.418963 18092 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.463328 18036 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:18.455180 17840 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:18.417902 17857 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:18.439031 17791 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:18.475925 17883 raft_consensus.cc:740] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:18.483219 17936 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:18.482637 18042 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:18.496745 17960 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.274s	user 0.009s	sys 0.002s
W20260709 13:05:18.602193 17960 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.394s	user 0.010s	sys 0.003s
I20260709 13:05:18.603241 12613 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:18.608392 13227 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 17: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:18.486681 18092 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:18.508909 18036 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:18.576754 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:18.610013 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:05:18.610798 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:18.612226 18092 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:18.612360 18036 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:18.569825 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1869) took 1583 ms. Trace:
I20260709 13:05:18.613143 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:18.597015 17883 consensus_queue.cc:260] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:18.567737 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1871) took 1511 ms. Trace:
W20260709 13:05:18.616714 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:18.616976 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:18.304107 12615 rpcz_store.cc:276] 0709 13:05:17.262429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.333300 (+ 70871us) service_pool.cc:224] Handling call
0709 13:05:17.369618 (+ 36318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:17.494386 (+124768us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:05:17.804417 (+310031us) log.cc:844] Serialized 14 byte log entry
0709 13:05:18.120913 (+316496us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:18.121049 (+   136us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:18.121180 (+   131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.303030 (+181850us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54000203d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:18.303107 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.303451 (+   344us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74282,"prepare.queue_time_us":474365,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":10454,"raft.queue_time_us":81069,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":91315,"spinlock_wait_cycles":286209792,"thread_start_us":550477,"threads_started":2}
I20260709 13:05:18.598385 12616 raft_consensus.cc:1275] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:05:18.597922 13229 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:18.597115 13233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 963) took 1289 ms. Trace:
I20260709 13:05:18.620606 13233 rpcz_store.cc:276] 0709 13:05:17.289596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.353581 (+ 63985us) service_pool.cc:224] Handling call
0709 13:05:17.366457 (+ 12876us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:17.366797 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:17.366840 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:17.367417 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 13:05:17.664500 (+297083us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:17.664557 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.664649 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:18.578243 (+913594us) raft_consensus.cc:1685] finished
0709 13:05:18.578294 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.578679 (+   385us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19395,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":17981,"thread_start_us":296721,"threads_started":1,"wal-append.queue_time_us":450881}
I20260709 13:05:18.623901 17964 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:18.626012 18062 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:18.634768 18062 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.416049 17460 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:18.613582 12545 rpcz_store.cc:276] 0709 13:05:16.985818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.985942 (+   124us) service_pool.cc:224] Handling call
0709 13:05:17.064577 (+ 78635us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:17.064935 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:17.064965 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:17.134373 (+ 69408us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b2c00000f48. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:05:17.206113 (+ 71740us) log.cc:844] Serialized 26 byte log entry
0709 13:05:17.709727 (+503614us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:17.709784 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.709876 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:18.568840 (+858964us) raft_consensus.cc:1685] finished
0709 13:05:18.568904 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.569505 (+   601us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13081,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":48785280,"thread_start_us":453930,"threads_started":1,"wal-append.queue_time_us":1142438}
I20260709 13:05:18.614895 12539 rpcz_store.cc:276] 0709 13:05:17.055917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.058779 (+  2862us) service_pool.cc:224] Handling call
0709 13:05:17.059089 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:17.080570 (+ 21481us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:17.080602 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:17.133295 (+ 52693us) spinlock_profiling.cc:243] Waited 5.77 ms on lock 0x7b2c00000f48. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:05:17.133794 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:05:17.495150 (+361356us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:17.495208 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.495304 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:18.566451 (+1071147us) raft_consensus.cc:1685] finished
0709 13:05:18.566558 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.567326 (+   768us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27216,"raft.queue_time_us":33133,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":9142,"spinlock_wait_cycles":13264256,"thread_start_us":360996,"threads_started":1,"wal-append.queue_time_us":655028}
I20260709 13:05:18.598742 13235 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 15: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:18.629892 17791 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.642182 17791 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.630185 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:18.652189 17883 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:18.653942 12615 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:18.656891 17791 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:18.657986 17857 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:18.658989 17857 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.666337 18062 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:18.668316 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1332) took 1406 ms. Trace:
I20260709 13:05:18.668745 12617 rpcz_store.cc:276] 0709 13:05:17.262135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.276400 (+ 14265us) service_pool.cc:224] Handling call
0709 13:05:17.276679 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:17.777103 (+500424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.667771 (+890668us) spinlock_profiling.cc:243] Waited 500 ms on lock 0x7b54002a67d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:18.668123 (+   352us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1149606784}
I20260709 13:05:18.672053 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 2002) took 1087 ms. Trace:
I20260709 13:05:18.672647 12688 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:05:18.673205 12688 pending_rounds.cc:85] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 9
I20260709 13:05:18.673545 12688 pending_rounds.cc:107] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:05:18.673943 12688 raft_consensus.cc:2889] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:18.674420 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 2023) took 1892 ms. Trace:
I20260709 13:05:18.674926 12687 rpcz_store.cc:276] 0709 13:05:16.781674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.781832 (+   158us) service_pool.cc:224] Handling call
0709 13:05:16.786282 (+  4450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:17.542108 (+755826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.673856 (+1131748us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b540012e154. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:18.674183 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1736804736}
I20260709 13:05:18.672518 12689 rpcz_store.cc:276] 0709 13:05:17.584148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.590632 (+  6484us) service_pool.cc:224] Handling call
0709 13:05:18.671457 (+1080825us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b540009f454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:18.671764 (+   307us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373722880}
I20260709 13:05:18.683564 17857 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:18.685796 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1132) took 1167 ms. Trace:
I20260709 13:05:18.686440 13228 rpcz_store.cc:276] 0709 13:05:17.518445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.519182 (+   737us) service_pool.cc:224] Handling call
0709 13:05:17.519549 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:17.654167 (+134618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.685186 (+1031019us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54006c02d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:18.685536 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300777728}
I20260709 13:05:18.688329 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:18.689536 13228 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 16: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:18.690840 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 1121) took 1404 ms. Trace:
I20260709 13:05:18.694300 13199 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:18.715946 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:18.720835 12696 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:18.721355 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:18.722467 13228 raft_consensus.cc:2393] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 14: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:05:18.698712 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 54533.3us
I20260709 13:05:18.723592 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:18.724498 18039 log.cc:927] Time spent T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 1.179s	user 0.009s	sys 0.003s
I20260709 13:05:18.724653 13228 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:05:18.725919 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:18.727275 12691 raft_consensus.cc:1275] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:05:18.698504 17460 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:05:18.716423 13234 rpcz_store.cc:276] 0709 13:05:17.286428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.286597 (+   169us) service_pool.cc:224] Handling call
0709 13:05:18.690276 (+1403679us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54005794d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:18.690586 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":442056448}
I20260709 13:05:18.729759 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:18.738122 17908 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:18.739174 17908 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:18.742733 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 48905.5us
I20260709 13:05:18.758258 18057 consensus_queue.cc:1048] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:18.763031 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:18.732190 17857 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:18.768476 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 970) took 1057 ms. Trace:
I20260709 13:05:18.753767 17964 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:18.775017 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:18.757369 18011 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:18.780649 12662 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.196:33997 timed out after 2.321s (SENT) [suppressed 25 similar messages]
I20260709 13:05:18.782975 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 971) took 1067 ms. Trace:
I20260709 13:05:18.783571 13235 rpcz_store.cc:276] 0709 13:05:17.715239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.719457 (+  4218us) service_pool.cc:224] Handling call
0709 13:05:18.782683 (+1063226us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b540065e854. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:18.782897 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1996882304}
I20260709 13:05:18.785058 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:18.785660 17960 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:18.785887 17783 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.787099 17783 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:18.787099 17960 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:18.789700 17964 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.790493 17960 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:18.790731 17783 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:18.796139 13232 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 1319) took 1561 ms (client timeout 2024 ms). Trace:
W20260709 13:05:18.796617 13232 rpcz_store.cc:269] 0709 13:05:17.234688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.234805 (+   117us) service_pool.cc:224] Handling call
0709 13:05:18.795778 (+1560973us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54005d3254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:18.795948 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":767123712}
I20260709 13:05:18.793592 13235 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:18.802958 12616 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 10.
I20260709 13:05:18.806212 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:18.811926 17460 consensus_queue.cc:1059] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:18.814045 18058 raft_consensus.cc:3055] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:18.814493 18058 raft_consensus.cc:740] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:18.817158 13233 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:18.806687 12613 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:18.813076 17936 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.824374 17936 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:18.792590 17964 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:18.760756 18002 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:18.836339 12659 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:18.813091 17460 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:18.856599 18104 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:18.866462 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:18.877835 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:18.880229 12613 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:05:18.884048 12622 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:18.832983 17857 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.894035 17460 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.897034 12617 raft_consensus.cc:2410] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:05:18.815922 18058 consensus_queue.cc:260] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:18.898383 18058 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:18.901598 18080 log.cc:927] Time spent T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.602s	user 0.003s	sys 0.000s
I20260709 13:05:18.902680 13200 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:18.905401 18078 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.628s	user 0.002s	sys 0.000s
W20260709 13:05:18.910096 18108 log.cc:927] Time spent T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:05:18.910200 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2004) took 1325 ms. Trace:
I20260709 13:05:18.910645 12695 rpcz_store.cc:276] 0709 13:05:17.584757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.584872 (+   115us) service_pool.cc:224] Handling call
0709 13:05:17.585194 (+   322us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:17.585554 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:17.585606 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:17.586236 (+   630us) log.cc:844] Serialized 52 byte log entry
0709 13:05:17.885009 (+298773us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:17.885068 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.885179 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:18.904388 (+1019209us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:18.909625 (+  5237us) raft_consensus.cc:1685] finished
0709 13:05:18.909650 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.910024 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1260,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"spinlock_wait_cycles":26649344,"thread_start_us":298340,"threads_started":1,"wal-append.queue_time_us":450365}
I20260709 13:05:18.912962 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:18.914400 12690 raft_consensus.cc:2410] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:05:18.914314 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:18.915333 12693 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:18.915436 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:18.916854 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:18.917510 12691 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:18.919198 12694 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:05:18.920331 17960 consensus_queue.cc:1059] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:18.920704 12513 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:18.921342 17960 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:18.923408 17960 raft_consensus.cc:3055] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:18.873528 18104 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:18.923890 17960 raft_consensus.cc:740] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:18.924244 18104 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:18.926244 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:18.926781 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:18.927083 12688 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:18.927546 13228 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:18.928521 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:18.929076 13228 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:18.909174 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:05:18.938880 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 158415us
I20260709 13:05:18.949390 13235 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:18.942533 13232 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:18.961344 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:18.936342 18015 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:18.905431 18002 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:18.976277 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:18.971132 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:18.981335 12613 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:05:18.983616 13234 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:18.948778 17460 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:18.937058 18011 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:18.990700 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:18.950794 17783 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:19.007172 12622 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:19.007499 12617 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:19.008875 13232 raft_consensus.cc:2368] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:05:18.992960 18095 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.016485 13233 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:19.017048 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:18.935292 17960 consensus_queue.cc:260] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.017818 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:19.032011 17575 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:19.033041 17575 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.034447 17768 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:19.035694 17575 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:19.036103 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:19.036046 17861 consensus_queue.cc:1059] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:19.036921 13235 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:19.037009 17964 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:19.038146 17880 raft_consensus.cc:3055] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:19.038542 17880 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:19.040151 17783 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:19.041631 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 158296us
I20260709 13:05:19.042398 17783 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:19.042994 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:19.046357 17908 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:19.049954 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:19.050776 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:19.050945 12544 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:05:19.051215 12662 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:19.050962 12696 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:19.052426 18002 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:19.052688 13235 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:19.054759 17857 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:18.772653 13229 rpcz_store.cc:276] 0709 13:05:17.709143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.621634 (+912491us) service_pool.cc:224] Handling call
0709 13:05:18.622492 (+   858us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:18.623351 (+   859us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:05:18.624439 (+  1088us) log.cc:844] Serialized 14 byte log entry
0709 13:05:18.764167 (+139728us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:18.764223 (+    56us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:18.766460 (+  2237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.766535 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.766661 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":307,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":70,"raft.queue_time_us":13858,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":3866,"thread_start_us":125390,"threads_started":1}
W20260709 13:05:19.057847 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:19.061991 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:19.062676 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:19.062737 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:19.063840 12689 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:19.064268 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:19.065354 12696 raft_consensus.cc:1240] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:19.062855 12690 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:19.066498 17783 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:19.067620 17783 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:19.036268 17575 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:19.071233 17575 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.076961 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:19.097892 17993 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.092238 13231 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:05:19.084730 18105 log.cc:927] Time spent T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.246s	user 0.002s	sys 0.000s
I20260709 13:05:19.078003 18095 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:19.080346 13227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 973) took 1357 ms (client timeout 1776 ms). Trace:
W20260709 13:05:19.091148 13230 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 1312) took 1880 ms (client timeout 2321 ms). Trace:
I20260709 13:05:19.079073 18005 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.085670 17860 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:19.098660 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1341) took 1350 ms. Trace:
W20260709 13:05:19.078936 18109 log.cc:927] Time spent T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:05:19.006213 18011 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.053329 12662 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:19.106070 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:19.117919 12687 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:05:19.126204 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:19.127285 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:19.137329 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:19.143898 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:19.106958 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:19.127629 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:19.159787 12622 raft_consensus.cc:2410] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 13:05:19.169824 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:19.121479 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 965) took 1831 ms. Trace:
I20260709 13:05:19.128347 13228 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 8.
W20260709 13:05:19.121125 13230 rpcz_store.cc:269] 0709 13:05:17.210700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.211542 (+   842us) service_pool.cc:224] Handling call
0709 13:05:19.090761 (+1879219us) spinlock_profiling.cc:243] Waited 91.6 ms on lock 0x7b54007c38d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:19.090952 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210730752}
I20260709 13:05:19.131742 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 1335) took 1868 ms. Trace:
I20260709 13:05:19.184940 12542 raft_consensus.cc:2368] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15.
I20260709 13:05:19.171926 13231 rpcz_store.cc:276] 0709 13:05:17.290219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.392386 (+102167us) service_pool.cc:224] Handling call
0709 13:05:19.091416 (+1699030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:19.115275 (+ 23859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.117526 (+  2251us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54007c38d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:19.121392 (+  3866us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3906426752}
I20260709 13:05:19.184906 12694 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:19.185840 12691 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:19.105126 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:19.186856 13234 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
W20260709 13:05:19.120918 13227 rpcz_store.cc:269] 0709 13:05:17.723042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.760002 (+ 36960us) service_pool.cc:224] Handling call
0709 13:05:19.079859 (+1319857us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b540063a954. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:19.080269 (+   410us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1810436352}
W20260709 13:05:19.189426 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 92450.7us
W20260709 13:05:19.101465 18115 log.cc:927] Time spent T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:05:19.037550 17861 raft_consensus.cc:3055] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:19.141676 18042 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:19.128008 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:19.196539 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 361874us
I20260709 13:05:19.204219 12688 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:19.197322 12615 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 15: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:19.197546 12693 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:19.131502 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:19.142186 17575 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:19.103922 17883 consensus_queue.cc:1059] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:05:19.185930 12620 rpcz_store.cc:276] 0709 13:05:17.263000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.326312 (+ 63312us) service_pool.cc:224] Handling call
0709 13:05:19.131374 (+1805062us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b5400104ad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:19.131554 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3995277184}
I20260709 13:05:19.122277 17960 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:19.133128 17783 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:19.137681 18015 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:19.207007 12539 raft_consensus.cc:2393] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 10: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:19.199311 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:19.217854 12616 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:19.120461 18095 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:19.219950 12622 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:19.187321 12618 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:05:19.209898 12547 raft_consensus.cc:2368] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13.
I20260709 13:05:19.205651 17768 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:05:19.077761 17965 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.210623 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:19.210930 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:19.121809 17860 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:19.212445 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:19.109336 17857 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:19.127468 18011 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:19.206493 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:19.216878 13230 raft_consensus.cc:1240] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:19.218645 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:19.198648 17861 raft_consensus.cc:740] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:19.221458 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:19.219195 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:19.224748 13231 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:19.230132 13232 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:05:19.122117 12621 rpcz_store.cc:276] 0709 13:05:17.625448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.626143 (+   695us) service_pool.cc:224] Handling call
0709 13:05:17.626483 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:17.626847 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:17.626874 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:17.650520 (+ 23646us) log.cc:844] Serialized 26 byte log entry
0709 13:05:17.949485 (+298965us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:17.949548 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.949668 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:18.900602 (+950934us) spinlock_profiling.cc:243] Waited 9.86 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:18.934994 (+ 34392us) raft_consensus.cc:1685] finished
0709 13:05:18.935011 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.976043 (+ 41032us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12388,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":12275,"spinlock_wait_cycles":22680960,"thread_start_us":238916,"threads_started":1,"wal-append.queue_time_us":467601}
I20260709 13:05:19.229944 12689 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:19.242756 12659 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:19.121462 18005 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:19.115041 17993 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:19.248610 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:19.249260 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:19.296416 12696 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:05:19.216013 17575 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:19.292757 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:19.294037 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:19.294094 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:19.249404 12540 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:19.301096 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:19.302405 12543 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:19.303128 17575 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:19.306113 12545 raft_consensus.cc:2393] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 10: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:19.308018 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:19.309345 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:19.309095 17769 consensus_queue.cc:1059] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:19.310258 12689 raft_consensus.cc:2410] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:05:19.311113 17769 raft_consensus.cc:3055] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:19.311717 17769 raft_consensus.cc:740] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:05:19.311929 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 258779us
I20260709 13:05:19.312816 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:19.312834 17769 consensus_queue.cc:260] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.314297 17861 consensus_queue.cc:260] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.315064 17769 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:19.316114 17861 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:19.318965 12513 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:19.310258 13199 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:05:19.329542 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:19.332839 12694 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:19.249094 18013 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:19.217685 17936 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:05:19.332048 12547 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:19.341732 12689 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18. Ops: []
W20260709 13:05:19.341758 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 99176.1us
I20260709 13:05:19.342236 12687 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:19.339236 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:19.344408 12696 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:19.345513 12687 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 15. Current term is 16. Ops: []
W20260709 13:05:19.346606 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 98821.6us
I20260709 13:05:19.347911 18104 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.338487 17965 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:19.247395 17783 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.349751 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:19.350193 18118 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.350080 17783 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.351084 18118 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.353233 17783 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:19.353794 18119 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.356249 17993 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:19.356963 12692 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 14: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:19.357733 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 962) took 2029 ms. Trace:
I20260709 13:05:19.342859 12546 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:19.361313 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:05:19.369933 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 57230.8us
I20260709 13:05:18.543326 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:19.369194 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:19.336264 18013 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:19.365063 13226 rpcz_store.cc:276] 0709 13:05:17.289176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.352815 (+ 63639us) service_pool.cc:224] Handling call
0709 13:05:17.353169 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:17.442190 (+ 89021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:17.442235 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:17.463616 (+ 21381us) log.cc:844] Serialized 26 byte log entry
0709 13:05:17.795602 (+331986us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:17.795657 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.220828 (+1425171us) spinlock_profiling.cc:243] Waited 88.6 ms on lock 0x7b54002bfcd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:19.234150 (+ 13322us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:19.245009 (+ 10859us) raft_consensus.cc:1685] finished
0709 13:05:19.245040 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:19.318673 (+ 73633us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24159,"raft.queue_time_us":49910,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":11498,"spinlock_wait_cycles":203701632,"thread_start_us":331521,"threads_started":1,"wal-append.queue_time_us":563637}
I20260709 13:05:19.342576 17575 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:19.377081 18124 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:19.366525 18011 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:19.298657 17857 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.381418 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:19.382205 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:19.381072 13199 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:19.384588 18124 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.318172 18015 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:19.377700 18092 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:19.380079 18013 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:19.372161 18118 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:19.400722 12691 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 15: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:19.385859 18011 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:19.416540 12662 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:19.422524 17768 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:19.436929 12539 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:19.440142 17929 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:19.440701 17929 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:19.441123 17929 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:19.368662 17880 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.421504 18011 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:19.427332 18058 consensus_meta.cc:287] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.528s	user 0.013s	sys 0.002s
I20260709 13:05:19.447746 17768 raft_consensus.cc:697] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:19.455756 18015 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:19.456142 17768 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.465057 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:19.469019 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:19.447813 18118 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:19.469965 12541 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:19.470399 18118 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.470875 18118 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:19.471268 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:19.472047 12541 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:19.472901 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:19.473434 12541 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:19.419977 18119 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:19.478701 18097 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:19.479115 18119 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:19.479281 18097 raft_consensus.cc:697] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:19.416950 18095 consensus_queue.cc:1059] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:05:19.454346 17397 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.493993 12539 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:19.480398 18097 consensus_queue.cc:237] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.503196 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:19.505087 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 88601us
I20260709 13:05:19.508626 12616 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:19.512048 12540 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 13:05:19.513507 12541 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:05:19.515307 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:19.514212 12543 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
I20260709 13:05:19.450064 18042 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 13:05:19.527184 12587 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:19.528277 12587 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:19.529110 12587 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:19.530987 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:19.532369 17883 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:19.532646 17569 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:19.532999 17883 raft_consensus.cc:697] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:19.534511 17883 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.536835 12659 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:19.537866 18002 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:19.538465 18002 raft_consensus.cc:697] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:19.539499 18002 consensus_queue.cc:237] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:19.544463 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 367728us
I20260709 13:05:19.506632 17860 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:19.492743 17791 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:05:19.515726 12539 raft_consensus.cc:2376] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15. Re-sending same reply.
I20260709 13:05:19.549191 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:19.552062 12541 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:19.567384 12696 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:19.562839 13197 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:19.573339 13233 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17. Ops: []
W20260709 13:05:19.574862 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 45850.3us
I20260709 13:05:19.542362 18058 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:05:19.596726 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 49236.5us
I20260709 13:05:19.600301 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:19.600970 12539 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:19.601239 18120 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:19.595686 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:19.601751 18120 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:19.602210 18120 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:19.602219 13230 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:19.608589 13235 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:19.610482 18120 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.612852 18120 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:19.634743 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:19.569012 18055 raft_consensus.cc:2764] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 13:05:19.594607 12587 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:19.643903 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:19.568795 18005 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:19.647039 12541 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:19.511839 17397 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.651564 12539 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:19.653434 13197 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:19.650683 13231 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:05:19.673092 12547 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:19.589964 17860 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:19.683630 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:19.596249 17965 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:19.637938 18058 raft_consensus.cc:697] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:19.701985 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:19.702164 18058 consensus_queue.cc:237] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.703864 17857 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:19.706133 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:19.706872 12688 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:19.708119 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 1143) took 1025 ms. Trace:
I20260709 13:05:19.708549 13228 rpcz_store.cc:276] 0709 13:05:18.682350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.958384 (+276034us) service_pool.cc:224] Handling call
0709 13:05:19.707841 (+749457us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b5400690354. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:19.707948 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314643328}
I20260709 13:05:19.695919 18120 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:19.709421 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:19.709784 18120 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:19.710201 18120 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:19.692678 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:19.710785 12541 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:05:19.711479 17961 raft_consensus.cc:3055] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:19.711903 17961 raft_consensus.cc:740] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:19.686369 18124 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:19.694260 13197 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:19.715101 13197 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:19.716667 18042 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:19.716998 13197 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:19.690591 17936 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:19.717463 18042 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:19.717761 17936 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:19.718221 18042 raft_consensus.cc:697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:19.718304 17936 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:19.719246 18042 consensus_queue.cc:237] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.694996 17860 raft_consensus.cc:697] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:19.713294 17961 consensus_queue.cc:260] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:19.722299 17860 consensus_queue.cc:237] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:19.722999 17961 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:19.723198 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:19.723927 18118 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.695853 13231 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:05:19.696159 17965 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.681879 18095 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.725872 17965 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.726537 18095 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:19.729152 18095 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:19.693486 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:19.731240 12694 raft_consensus.cc:1240] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:19.731459 13230 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
W20260709 13:05:19.697862 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 110359us
I20260709 13:05:19.699034 17397 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:19.702864 12540 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 9.
I20260709 13:05:19.695848 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:19.735431 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:19.696585 12510 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:19.736292 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:19.731741 13199 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:19.792016 12696 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:05:19.739694 17887 raft_consensus.cc:3055] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:05:19.789471 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:19.733280 17964 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.789937 12541 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:19.801846 12690 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:05:19.803336 12539 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:19.762830 17965 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:19.804801 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 73130.7us
W20260709 13:05:19.807804 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 90880.5us
W20260709 13:05:19.830853 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:19.835390 18118 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:19.832223 17964 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.804447 17887 raft_consensus.cc:740] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:19.836766 18013 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.837867 18124 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:19.837811 17887 consensus_queue.cc:260] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.801175 17397 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:19.835646 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:19.803190 18092 raft_consensus.cc:697] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 10 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:05:19.848315 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 499516us
I20260709 13:05:19.811113 17768 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:19.854240 12616 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:05:19.856981 13197 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:19.882004 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:19.875381 12695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.006s	sys 0.009s
I20260709 13:05:19.861806 17768 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:19.895254 12695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.006s	sys 0.009s
W20260709 13:05:19.897305 12513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.021s	sys 0.026s
I20260709 13:05:19.897321 12619 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:05:19.898337 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 202253us
I20260709 13:05:19.859979 17569 raft_consensus.cc:697] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:05:19.900415 12513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.021s	sys 0.026s
I20260709 13:05:19.906600 17918 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:19.907377 18104 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:19.907325 17918 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.908805 12547 raft_consensus.cc:1275] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:05:19.905030 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 604630us
I20260709 13:05:19.912356 13197 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:19.913300 17908 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:19.915617 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:19.916695 18124 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.916563 18120 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.917414 18124 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:19.919152 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:19.920037 18124 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:19.921022 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:19.923147 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:19.925876 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:19.927407 17929 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.929356 13235 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:19.931993 12513 leader_election.cc:400] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:05:19.935765 12513 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:19.903534 17397 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:19.941035 18013 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:19.941743 17887 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:19.944474 12544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.017s	sys 0.021s
W20260709 13:05:19.945904 12544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.017s	sys 0.021s
I20260709 13:05:19.897835 17768 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:19.952430 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:19.977916 13235 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:19.979482 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:19.980619 12616 raft_consensus.cc:2410] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
W20260709 13:05:19.985239 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 49590.8us
I20260709 13:05:19.989719 12510 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:19.945032 18011 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:19.995900 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:19.997063 12617 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
W20260709 13:05:20.006286 13200 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.002s	sys 0.018s
I20260709 13:05:19.995400 12513 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:20.010937 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:20.012171 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:20.012516 13235 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 8.
W20260709 13:05:20.014371 12512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.009s	sys 0.012s
W20260709 13:05:20.014770 12512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.009s	sys 0.012s
W20260709 13:05:20.015182 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 676248us
I20260709 13:05:20.018410 12539 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
W20260709 13:05:20.023008 13200 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.003s	sys 0.018s
W20260709 13:05:20.025107 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 636600us
I20260709 13:05:19.993630 18013 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:19.995540 18124 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:20.049772 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:20.029184 12616 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:20.055388 18130 consensus_queue.cc:1059] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:20.056319 18130 consensus_queue.cc:1243] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:05:20.056995 18005 raft_consensus.cc:3055] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:20.057403 18005 raft_consensus.cc:740] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:20.057943 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:20.058387 18005 consensus_queue.cc:260] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:20.062036 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 103540us
I20260709 13:05:20.063555 12510 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:20.065075 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:20.053062 17880 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:20.065887 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1152) took 1103 ms. Trace:
I20260709 13:05:20.066354 13227 rpcz_store.cc:276] 0709 13:05:18.962406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.197065 (+234659us) service_pool.cc:224] Handling call
0709 13:05:19.208025 (+ 10960us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:19.246479 (+ 38454us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:05:19.491974 (+245495us) log.cc:844] Serialized 14 byte log entry
0709 13:05:19.901252 (+409278us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:19.911594 (+ 10342us) log.cc:844] Serialized 26 byte log entry
0709 13:05:19.911746 (+   152us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:19.911783 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.911848 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:20.065639 (+153791us) raft_consensus.cc:1685] finished
0709 13:05:20.065664 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:20.065800 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32283,"prepare.queue_time_us":354653,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":4280,"raft.queue_time_us":41035,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":8393,"thread_start_us":539474,"threads_started":2,"wal-append.queue_time_us":547903}
I20260709 13:05:20.069223 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1323) took 1156 ms. Trace:
I20260709 13:05:20.068861 17569 consensus_queue.cc:237] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:19.988649 18092 consensus_queue.cc:237] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:20.069602 12695 rpcz_store.cc:276] 0709 13:05:18.912631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.944758 (+ 32127us) service_pool.cc:224] Handling call
0709 13:05:19.001957 (+ 57199us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:19.236946 (+234989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:19.236978 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:19.318432 (+ 81454us) log.cc:844] Serialized 26 byte log entry
0709 13:05:19.896059 (+577627us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:19.896106 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.896188 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:20.069013 (+172825us) raft_consensus.cc:1685] finished
0709 13:05:20.069034 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:20.069170 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20914,"raft.queue_time_us":30929,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":150,"thread_start_us":545984,"threads_started":1,"wal-append.queue_time_us":717357}
I20260709 13:05:20.073076 12659 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:20.013404 17575 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.006s	sys 0.049s
W20260709 13:05:20.073850 17575 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.006s	sys 0.050s
I20260709 13:05:20.074317 18104 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:20.074931 18011 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:20.076042 18104 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:20.076529 18104 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.076987 18104 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:20.079224 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 63324.5us
I20260709 13:05:20.012826 18118 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:05:20.050343 17883 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.019s	sys 0.011s
I20260709 13:05:20.081755 17960 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:20.103539 18120 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:20.030360 17929 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:20.053722 18013 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:20.109264 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:20.049685 17769 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:20.110653 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 124529us
W20260709 13:05:20.107884 17883 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.019s	sys 0.012s
I20260709 13:05:20.107717 17960 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:20.073477 17460 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
W20260709 13:05:20.128072 13229 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.001s	sys 0.013s
I20260709 13:05:20.105355 17936 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:20.145607 12689 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:20.155260 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:20.158839 13227 raft_consensus.cc:2393] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 11: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:05:20.157665 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 92748.1us
I20260709 13:05:20.116114 18118 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:05:20.161094 13229 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.002s	sys 0.014s
I20260709 13:05:20.167769 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1328) took 1902 ms. Trace:
W20260709 13:05:20.106737 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 453969us
I20260709 13:05:20.146962 17960 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:20.117969 17769 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:20.154876 18122 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:20.160399 18118 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:20.185191 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:20.185454 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:20.192831 13235 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:05:20.193874 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 113898us
I20260709 13:05:20.202044 17768 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:20.210120 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:20.210430 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:20.210968 13233 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:05:20.211230 12616 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 12: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:20.213236 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:20.182513 18118 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:20.214032 12616 raft_consensus.cc:2393] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 9: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:20.244925 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:20.194857 17860 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.258134 12615 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:20.259194 17860 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:20.251032 18115 log.cc:927] Time spent T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:05:20.268867 12512 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:20.269048 12662 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:20.275287 13197 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:20.287174 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:20.288028 12616 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:20.289911 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:20.293257 17575 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:20.295228 17860 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:20.296011 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:20.296736 12615 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:20.299854 12618 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:20.304667 18104 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:20.305850 17936 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:20.307871 18169 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:20.319659 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3261) took 1191 ms. Trace:
I20260709 13:05:20.320461 17768 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:20.320292 12538 rpcz_store.cc:276] 0709 13:05:19.128131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.128363 (+   232us) service_pool.cc:224] Handling call
0709 13:05:19.128866 (+   503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:19.243969 (+115103us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:19.652027 (+408058us) log.cc:844] Serialized 14 byte log entry
0709 13:05:20.255260 (+603233us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:20.267342 (+ 12082us) log.cc:844] Serialized 26 byte log entry
0709 13:05:20.267521 (+   179us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:20.267753 (+   232us) log.cc:844] Serialized 14 byte log entry
0709 13:05:20.267935 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:20.268025 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:20.319246 (+ 51221us) raft_consensus.cc:1685] finished
0709 13:05:20.319275 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:20.319458 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19980,"prepare.queue_time_us":466187,"prepare.run_cpu_time_us":185,"prepare.run_wall_time_us":186,"raft.queue_time_us":393611,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":312,"thread_start_us":962157,"threads_started":4,"wal-append.queue_time_us":507508}
I20260709 13:05:20.313234 12615 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:20.320541 18104 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:05:20.333837 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 82064.4us
I20260709 13:05:20.334029 17965 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:20.334883 17965 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:20.337687 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3554) took 2147 ms. Trace:
I20260709 13:05:20.333856 17929 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:20.339308 17965 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:20.316156 17860 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:20.319555 18013 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:20.309000 12616 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:05:20.315304 18118 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:20.364782 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 248103us
I20260709 13:05:20.371129 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:20.371369 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:20.371129 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:20.372156 12692 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:20.377521 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:20.378435 13233 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:20.338279 12614 rpcz_store.cc:276] 0709 13:05:18.066907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.067078 (+   171us) service_pool.cc:224] Handling call
0709 13:05:18.067429 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:18.126803 (+ 59374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:18.126847 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:18.454136 (+327289us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b18003b1a00. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a645a2a6 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3ae4a2aa1 00007fc3ae499b37 00007fc3ae4999ca 00007fc3ae59126f
0709 13:05:18.738174 (+284038us) spinlock_profiling.cc:243] Waited 72.8 ms on lock 0x7b4800002dd8. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3ae4a2aa1 00007fc3ae499b37 00007fc3ae4999ca 00007fc3ae59126f 00007fc3ae590f37 00007fc3ae5a555c 00007fc3ae5a5508 00007fc3ae5a5488 00007fc3ae5a5443 00007fc3ae5a46ec 00007fc3ad4cea96
0709 13:05:19.133302 (+395128us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b18003b1a00. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a645a2a6 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a
0709 13:05:19.433362 (+300060us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b2c0004c3c8. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:05:19.503127 (+ 69765us) log.cc:844] Serialized 26 byte log entry
0709 13:05:19.852121 (+348994us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:19.852318 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.893817 (+ 41499us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:20.213807 (+319990us) raft_consensus.cc:1685] finished
0709 13:05:20.213830 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:20.213996 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58587,"raft.queue_time_us":67889,"raft.run_cpu_time_us":10271,"raft.run_wall_time_us":583662,"spinlock_wait_cycles":294712192,"thread_start_us":313501,"threads_started":1,"wal-append.queue_time_us":577613}
I20260709 13:05:20.382406 13226 raft_consensus.cc:2393] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 19: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:20.382553 18118 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:20.383195 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.385228 13231 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:20.358403 17880 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:20.412768 18141 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:20.361696 17768 consensus_queue.cc:1059] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:05:20.416476 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:20.419663 12513 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:20.430727 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 232573us
W20260709 13:05:20.431609 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.385251 17860 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:20.442461 12513 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:20.439982 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 81964us
W20260709 13:05:20.446004 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 190970us
I20260709 13:05:20.417060 18130 consensus_queue.cc:1059] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
W20260709 13:05:20.447109 18151 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:05:20.460242 12616 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260709 13:05:20.451540 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 274193us
I20260709 13:05:20.459528 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:20.461870 13230 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:20.464214 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:20.464262 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:20.464694 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:20.465245 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:20.464226 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:20.417749 18118 consensus_queue.cc:1059] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:05:20.468346 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:20.466764 13226 raft_consensus.cc:2410] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:05:20.469074 13234 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:05:20.469079 12614 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:05:20.471487 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:20.473351 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.474263 18167 raft_consensus.cc:2764] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:05:20.476502 18092 consensus_queue.cc:1059] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:20.477627 17965 raft_consensus.cc:3055] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:20.477828 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:20.478032 17965 raft_consensus.cc:740] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:20.479499 12662 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:20.480343 17887 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:20.480727 17887 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:20.481105 17887 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:20.482335 18130 raft_consensus.cc:3055] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:20.482761 18130 raft_consensus.cc:740] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:20.483605 18130 consensus_queue.cc:260] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:20.485009 18130 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:20.479755 17965 consensus_queue.cc:260] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:20.480991 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:05:20.486135 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.450790 18124 raft_consensus.cc:697] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:20.457732 17769 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:20.489084 13231 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:20.490278 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:20.462116 18121 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:20.494377 18167 raft_consensus.cc:3055] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:20.494830 18167 raft_consensus.cc:740] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:20.495726 18167 consensus_queue.cc:260] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:20.497140 18167 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:20.492985 12662 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:20.460191 17569 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:20.507225 13234 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:05:20.508349 12692 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:20.510094 12614 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:20.513144 18118 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:20.513412 18104 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:20.513790 18118 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:20.516062 18118 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:20.489400 18092 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:20.521004 13235 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:20.499640 18121 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.525444 12513 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:20.528846 18170 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:20.529428 18170 raft_consensus.cc:697] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:05:20.485970 18169 consensus_queue.cc:1175] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7ad68e814a7741488971822f2598183a" responder_term: 13 status { last_received { term: 12 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:05:20.530345 18170 consensus_queue.cc:237] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:20.532184 18163 log.cc:927] Time spent T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:05:20.533916 18121 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:20.534228 17860 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:20.511359 18013 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:20.168325 13229 rpcz_store.cc:276] 0709 13:05:18.265634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.056595 (+790961us) service_pool.cc:224] Handling call
0709 13:05:19.057057 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:19.195427 (+138370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:19.195458 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:19.214808 (+ 19350us) log.cc:844] Serialized 26 byte log entry
0709 13:05:19.487453 (+272645us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:20.166321 (+678868us) log.cc:844] Serialized 14 byte log entry
0709 13:05:20.167115 (+   794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:20.167259 (+   144us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:20.167338 (+    79us) raft_consensus.cc:1685] finished
0709 13:05:20.167379 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:20.167650 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":101862,"prepare.queue_time_us":215835,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":132016,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":6803,"thread_start_us":812159,"threads_started":2,"wal-append.queue_time_us":454431}
I20260709 13:05:20.536442 18013 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.536907 18013 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:20.537397 18005 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:20.541195 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:20.524629 17965 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:20.546504 13199 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:20.549346 17397 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:20.549396 17963 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:20.546168 17768 consensus_queue.cc:1059] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:20.566839 12545 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:05:20.568853 17768 raft_consensus.cc:3055] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:20.569315 17768 raft_consensus.cc:740] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:20.570209 17768 consensus_queue.cc:260] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:20.571655 17768 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:20.573745 17397 raft_consensus.cc:697] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:20.574949 17397 consensus_queue.cc:237] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:20.578893 18137 log.cc:927] Time spent T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.454s	user 0.002s	sys 0.000s
I20260709 13:05:20.580302 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1875) took 1200 ms. Trace:
I20260709 13:05:20.580664 12542 rpcz_store.cc:276] 0709 13:05:19.379836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.379975 (+   139us) service_pool.cc:224] Handling call
0709 13:05:19.411879 (+ 31904us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:19.510568 (+ 98689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:19.510599 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:19.531655 (+ 21056us) log.cc:844] Serialized 26 byte log entry
0709 13:05:19.861175 (+329520us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:19.861230 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.861323 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:20.578328 (+717005us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:20.580010 (+  1682us) raft_consensus.cc:1685] finished
0709 13:05:20.580041 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:20.580242 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19379,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":11620,"spinlock_wait_cycles":47484672,"thread_start_us":329080,"threads_started":1,"wal-append.queue_time_us":546075}
I20260709 13:05:20.588958 12690 raft_consensus.cc:1275] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:05:20.600457 18169 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.600986 12510 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:20.600421 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:20.601290 18169 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:20.602314 12510 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:20.604949 18005 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:20.605669 18005 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:20.605990 17746 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:20.616693 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:20.617623 12691 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:20.549711 17782 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:05:20.555878 17963 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.629724 18122 raft_consensus.cc:697] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:20.518018 17569 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:20.638654 12587 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:20.644335 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:20.646569 13234 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:05:20.651352 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:20.648474 13229 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:20.606706 18169 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:20.663120 12588 leader_election.cc:336] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.162s (SENT)
I20260709 13:05:20.708895 12588 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:20.663869 18013 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:20.554594 17960 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:20.678714 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:20.679113 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:20.680001 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:20.720332 12539 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:20.680085 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:20.681082 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:20.681468 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:20.683672 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:20.651806 17880 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:20.686605 18168 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:20.686982 12662 leader_election.cc:400] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13.
I20260709 13:05:20.691540 17769 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:20.733839 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 95298.6us
I20260709 13:05:20.648039 17963 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:20.555754 18141 consensus_queue.cc:1059] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 13:05:20.699301 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:20.700282 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:20.706719 18173 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:05:20.697708 18124 consensus_queue.cc:237] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:20.738766 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 75786.6us
I20260709 13:05:20.739538 17860 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:05:20.780820 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:20.751873 12587 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:20.651401 18135 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.771761 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:20.772593 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:20.787900 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 53169.4us
I20260709 13:05:20.782819 12547 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:20.786059 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:20.790433 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:20.791302 12541 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 15: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:20.791422 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:20.757112 17936 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:20.794498 12540 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 12: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:05:20.796432 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 144651us
I20260709 13:05:20.799445 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:20.799964 18177 log.cc:927] Time spent T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:05:20.801054 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:20.801838 12546 raft_consensus.cc:2376] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15. Re-sending same reply.
I20260709 13:05:20.802853 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:20.803491 12546 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:20.804378 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:20.805552 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:20.807101 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:20.807173 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:20.807935 12546 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:20.808318 12544 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:20.810920 12543 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:20.813048 12543 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:20.815450 17569 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:20.821907 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:20.827205 17964 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:20.793861 17993 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:20.828480 17993 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:20.829042 17993 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:20.837400 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:20.839879 12688 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:20.796566 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:20.840762 12546 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 11. Current term is 12. Ops: []
W20260709 13:05:20.841687 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 45930.2us
I20260709 13:05:20.801386 12662 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:20.847162 18120 raft_consensus.cc:3055] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:20.847798 18120 raft_consensus.cc:740] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:20.855018 18120 consensus_queue.cc:260] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:20.856314 18120 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:20.857772 12547 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:20.754603 17769 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:20.861876 17769 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:20.862733 18173 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:05:20.864481 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2030) took 1114 ms. Trace:
I20260709 13:05:20.851998 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:20.865096 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 69128.3us
I20260709 13:05:20.864938 12689 rpcz_store.cc:276] 0709 13:05:19.735624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.735989 (+   365us) service_pool.cc:224] Handling call
0709 13:05:19.789436 (+ 53447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:20.164330 (+374894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:20.849360 (+685030us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54000c7bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:20.849578 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":818631552}
I20260709 13:05:20.868481 17782 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:20.869325 17782 raft_consensus.cc:697] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:20.870276 17782 consensus_queue.cc:237] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:20.853452 12438 catalog_manager.cc:5697] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 5 to 8, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 8 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:05:20.865692 12696 raft_consensus.cc:2368] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16.
W20260709 13:05:20.854005 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:20.875608 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 46210.3us
I20260709 13:05:20.875942 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:20.876752 12541 raft_consensus.cc:2376] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16. Re-sending same reply.
I20260709 13:05:20.881639 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:20.882596 12547 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:20.889709 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:20.798596 17936 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.891855 17936 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:20.890751 12547 raft_consensus.cc:2393] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 10: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:20.881431 17768 consensus_queue.cc:1059] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:05:20.850867 17960 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:20.903246 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:20.904182 12619 raft_consensus.cc:2393] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 19: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:20.874337 12438 catalog_manager.cc:5697] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:05:20.907987 17963 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:20.854239 17887 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:20.913144 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1337) took 1335 ms. Trace:
I20260709 13:05:20.893117 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:20.918303 18178 raft_consensus.cc:3055] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:20.919338 13233 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:20.913591 13232 rpcz_store.cc:276] 0709 13:05:19.578053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.578176 (+   123us) service_pool.cc:224] Handling call
0709 13:05:19.589814 (+ 11638us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:19.641592 (+ 51778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:19.641632 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:19.679863 (+ 38231us) log.cc:844] Serialized 26 byte log entry
0709 13:05:20.081046 (+401183us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:20.160236 (+ 79190us) log.cc:844] Serialized 14 byte log entry
0709 13:05:20.160807 (+   571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:20.160934 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:20.910734 (+749800us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b18003d6360. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c3f3 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
0709 13:05:20.912846 (+  2112us) raft_consensus.cc:1685] finished
0709 13:05:20.912956 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:20.913085 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":78797,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":40,"raft.queue_time_us":6385,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":30603,"spinlock_wait_cycles":12833280,"thread_start_us":400037,"threads_started":1,"wal-append.queue_time_us":502279}
I20260709 13:05:20.881304 13197 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:20.922955 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 44336.7us
I20260709 13:05:20.894444 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:20.895434 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:20.923600 13197 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:20.917948 17936 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:20.889914 18092 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:20.900779 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:20.855373 18135 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:20.817715 18168 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:20.873180 18122 consensus_queue.cc:237] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:20.926179 12688 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:05:20.895548 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:20.937229 12538 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:20.930936 12547 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:05:20.937687 12544 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:20.929054 17397 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:20.940883 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:20.934736 17768 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:20.942332 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:20.942505 17768 raft_consensus.cc:697] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:20.942919 12540 raft_consensus.cc:2376] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16. Re-sending same reply.
I20260709 13:05:20.943451 17768 consensus_queue.cc:237] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:20.918715 18178 raft_consensus.cc:740] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:20.946477 12588 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:20.949492 13197 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:20.950083 12621 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:20.946938 12541 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:05:20.947389 17397 raft_consensus.cc:697] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:20.948149 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 981) took 1021 ms. Trace:
I20260709 13:05:20.956060 13230 rpcz_store.cc:276] 0709 13:05:19.927088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.952106 (+ 25018us) service_pool.cc:224] Handling call
0709 13:05:20.947984 (+995878us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b540014afd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:20.948095 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":599283584}
I20260709 13:05:20.956524 12545 raft_consensus.cc:2410] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:05:20.954262 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:20.961774 12546 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:20.956435 18011 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
I20260709 13:05:20.966988 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:20.937707 17575 consensus_queue.cc:1059] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:05:20.971491 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:20.977067 18179 log.cc:927] Time spent T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.156s	user 0.001s	sys 0.001s
I20260709 13:05:20.977663 13228 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:05:20.980341 17791 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:20.981326 12588 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:20.982041 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:20.982676 12547 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:20.957870 12538 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:20.985059 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:20.987613 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:20.992295 12547 raft_consensus.cc:2393] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 10: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:20.993340 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:20.994212 12692 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:20.985414 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:21.003010 17575 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.003649 17575 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:21.005090 18167 consensus_meta.cc:287] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.508s	user 0.001s	sys 0.011s
I20260709 13:05:21.005870 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:21.006464 17575 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:21.007468 18168 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:21.008019 17887 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:21.008453 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:21.009416 12695 raft_consensus.cc:2368] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 15. Current term is 16.
I20260709 13:05:20.930657 17569 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:05:21.010315 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:21.014242 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:21.015411 12547 raft_consensus.cc:2410] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:05:21.016407 12542 raft_consensus.cc:2410] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:05:21.017356 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:21.018107 12690 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:21.018342 12620 raft_consensus.cc:1275] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:05:21.016510 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:21.022936 12689 raft_consensus.cc:1240] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:21.025343 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:21.025969 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:21.026180 12538 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:21.030018 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:21.031080 12690 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:21.034885 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:21.049257 13228 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:20.937049 18092 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:21.049029 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:05:21.050720 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 174310us
I20260709 13:05:21.053921 12662 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:20.983458 18184 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:21.034549 18130 consensus_meta.cc:287] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.005s
I20260709 13:05:20.977253 18121 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:21.057420 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:21.057924 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 76664.8us
I20260709 13:05:21.059386 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:21.050927 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 208486us
I20260709 13:05:21.062608 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:21.063311 13234 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:21.037889 17569 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:21.061908 13199 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:21.075413 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:21.024516 18135 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:21.080915 18184 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:21.081157 18167 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:21.081632 18162 consensus_queue.cc:1059] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:21.082056 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:21.083144 12543 raft_consensus.cc:2368] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 10.
I20260709 13:05:21.083371 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:21.081490 18184 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:21.082357 18167 raft_consensus.cc:3055] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:21.088310 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:21.088433 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:21.072958 17887 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:21.089160 12544 raft_consensus.cc:2368] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16.
I20260709 13:05:21.099531 12538 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:05:21.098475 18135 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:21.122606 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:21.085163 17963 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:21.087245 18184 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:21.135946 12693 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:21.139777 12540 raft_consensus.cc:2393] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 10: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:21.086073 18167 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:05:21.143821 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.115697 17887 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:21.146250 12512 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:21.149430 12512 leader_election.cc:400] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 15. Current term is 16.
I20260709 13:05:21.149820 12512 leader_election.cc:403] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:21.150414 17887 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:21.155330 18168 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:21.155925 18168 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.156353 18168 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:21.166404 17936 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:21.168795 17960 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:21.172816 18167 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:21.173449 18124 consensus_queue.cc:1059] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:21.174234 18167 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:21.175172 17575 raft_consensus.cc:3055] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:21.175686 17575 raft_consensus.cc:740] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:21.178334 18092 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:21.124375 18135 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.189083 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:21.176854 17575 consensus_queue.cc:260] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:21.179754 12659 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:21.196636 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:21.197326 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:21.197747 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:21.198204 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:21.199044 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 132284us
I20260709 13:05:21.176936 18121 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:21.202591 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:21.202625 12542 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:21.199997 12587 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:21.201798 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 126491us
I20260709 13:05:21.203817 12540 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:21.131511 17791 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 13:05:21.206840 12588 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:21.192373 18135 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:21.089310 17397 consensus_queue.cc:237] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:21.216403 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:21.218678 17860 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:21.219254 17860 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.219691 17860 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:21.226534 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:21.200605 17460 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:05:21.202579 18190 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:05:21.248167 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 44868.7us
I20260709 13:05:21.249945 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:21.235707 17908 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.310s	user 0.005s	sys 0.025s
I20260709 13:05:21.256506 12662 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:21.257229 17908 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.341s	user 0.005s	sys 0.025s
I20260709 13:05:21.247608 17575 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:21.278457 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 62167.4us
I20260709 13:05:21.293603 12588 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:05:21.270241 18193 log.cc:927] Time spent T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:05:21.261492 18198 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:21.253881 18178 consensus_queue.cc:260] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:21.259181 18197 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:21.281410 17960 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 15. Current term is 16.
I20260709 13:05:21.264302 17918 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:21.262257 18190 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:21.313796 17782 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:05:21.336776 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.310304 17460 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:05:21.330634 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 118171us
I20260709 13:05:21.271382 17993 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:21.283761 17887 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:21.318960 18198 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:21.340444 17460 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.358829 12618 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:21.386631 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.364686 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:21.355362 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:21.382449 12620 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 15. Current term is 16. Ops: []
W20260709 13:05:21.440795 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 163087us
I20260709 13:05:21.441587 12547 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:05:21.339198 18189 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:21.456087 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:21.378916 18011 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.365481 18013 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:21.457898 12662 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:21.384591 17908 raft_consensus.cc:3055] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:21.491506 12619 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:21.460105 12441 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50014 (request call id 224) took 46666 ms (client timeout 15000 ms). Trace:
W20260709 13:05:21.493345 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 199915us
I20260709 13:05:21.493999 12540 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:05:21.386926 12438 catalog_manager.cc:5697] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:05:21.443046 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 233681us
I20260709 13:05:21.457095 12547 raft_consensus.cc:1275] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:05:21.457106 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:21.457707 12613 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:05:21.353847 18178 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:05:21.370389 18196 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:05:21.508841 12587 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:21.400327 18198 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:21.355698 17993 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:21.375689 18190 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.358666 17887 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:05:21.524726 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:21.539369 12541 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:21.356544 17460 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:21.390132 18194 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
W20260709 13:05:21.390787 18200 log.cc:927] Time spent T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:05:21.372924 17936 raft_consensus.cc:3055] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:21.540377 18162 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:21.350638 18207 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:21.554117 12587 leader_election.cc:400] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16.
I20260709 13:05:21.579388 12587 leader_election.cc:403] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:21.468281 17569 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:05:21.562727 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 62098.3us
I20260709 13:05:21.366904 17963 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.172s
I20260709 13:05:21.494915 17908 raft_consensus.cc:740] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:21.520303 18120 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.604745 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:21.464998 17860 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:21.458546 18211 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.129s
I20260709 13:05:21.440325 18184 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:21.613643 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:21.520517 17791 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.080s
I20260709 13:05:21.599589 17782 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:21.578226 17936 raft_consensus.cc:740] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:21.624076 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:21.625470 13234 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:05:21.628144 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:21.628224 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:21.632727 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:21.570317 17768 consensus_queue.cc:1059] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:05:21.599262 17769 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:21.629065 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:21.579485 18011 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:21.646584 13233 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 17: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:21.598224 18107 consensus_queue.cc:1059] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:05:21.643832 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:21.585985 17993 consensus_queue.cc:1059] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:05:21.573334 18190 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:21.638571 18207 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.603574 18120 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:21.619747 18199 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 13:05:21.647912 17782 raft_consensus.cc:697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:05:21.669919 12588 connection.cc:256] RPC call timeout handler was delayed by -1.0620050710000442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
W20260709 13:05:21.687600 12588 connection.cc:256] RPC call timeout handler was delayed by -1.0458050710001316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2002s for a response
W20260709 13:05:21.687947 12588 connection.cc:256] RPC call timeout handler was delayed by -1.03860507100012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
I20260709 13:05:21.688177 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:21.688795 12545 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:05:21.689841 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:21.691375 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:21.692641 12540 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260709 13:05:21.675961 18212 log.cc:927] Time spent T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:05:21.707201 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:21.708168 12542 raft_consensus.cc:2410] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:05:21.704608 13232 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:21.695132 13228 raft_consensus.cc:2376] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12. Re-sending same reply.
I20260709 13:05:21.651415 17769 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:21.718465 12618 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:21.690923 17993 consensus_queue.cc:1243] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:05:21.691075 17397 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:21.643038 12438 catalog_manager.cc:5697] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:05:21.743688 18215 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:21.744472 18215 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:21.746958 18215 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:21.752274 18120 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:05:21.493206 12441 rpcz_store.cc:269] 0709 13:04:34.793961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:34.795049 (+  1088us) service_pool.cc:224] Handling call
0709 13:05:21.459844 (+46664795us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:10.839517 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:10.840195 (+   678us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:10.840246 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:05:10.840278 (+    32us) tablet.cc:662] Decoding operations
0709 13:05:10.841203 (+   925us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:10.841291 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:10.841323 (+    32us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:05:10.842074 (+   751us) tablet.cc:701] Row locks acquired
0709 13:05:10.842126 (+    52us) write_op.cc:260] PREPARE: finished
0709 13:05:10.842304 (+   178us) write_op.cc:270] Start()
0709 13:05:10.842451 (+   147us) write_op.cc:276] Timestamp: P: 1783602310842233 usec, L: 0
0709 13:05:10.842490 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:05:10.849300 (+  6810us) log.cc:844] Serialized 2835 byte log entry
0709 13:05:11.334711 (+485411us) op_driver.cc:464] REPLICATION: finished
0709 13:05:11.728912 (+394201us) write_op.cc:301] APPLY: starting
0709 13:05:11.729041 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:11.763437 (+ 34396us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:11.763556 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:11.800217 (+ 36661us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:11.800535 (+   318us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:05:11.800809 (+   274us) write_op.cc:312] APPLY: finished
0709 13:05:11.801144 (+   335us) log.cc:844] Serialized 73 byte log entry
0709 13:05:11.835532 (+ 34388us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:11.835662 (+   130us) write_op.cc:454] Released schema lock
0709 13:05:11.835869 (+   207us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:11.836371 (+   502us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:11.836405 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":802807,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":363539,"apply.run_cpu_time_us":14174,"apply.run_wall_time_us":121370,"cfile_cache_hit":30,"cfile_cache_hit_bytes":33401,"num_ops":7,"prepare.queue_time_us":320643,"prepare.run_cpu_time_us":30198,"prepare.run_wall_time_us":205538,"raft.queue_time_us":239659,"raft.run_cpu_time_us":17866,"raft.run_wall_time_us":175097,"replication_time_us":492057,"thread_start_us":521080,"threads_started":4,"wal-append.queue_time_us":195697,"wal-append.run_cpu_time_us":21546,"wal-append.run_wall_time_us":1836155}]]}
W20260709 13:05:21.759150 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 301325us
I20260709 13:05:21.761858 12513 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:21.730268 18180 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:21.793653 13200 connection.cc:256] RPC call timeout handler was delayed by -1.2298497320000479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18080000000000002s for a response
I20260709 13:05:21.679044 18207 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:21.796865 12662 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:21.796823 18184 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:21.796592 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:21.797489 18167 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:21.797398 18216 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16.
I20260709 13:05:21.756529 17860 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:21.792522 18135 consensus_meta.cc:287] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.550s	user 0.007s	sys 0.004s
I20260709 13:05:21.799221 12438 catalog_manager.cc:5697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 12 to 14, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 14 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:05:21.800944 18217 log.cc:927] Time spent T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.293s	user 0.002s	sys 0.000s
I20260709 13:05:21.804790 18199 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.737491 17397 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:21.853191 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:21.854550 13226 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:05:21.856470 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 167874us
W20260709 13:05:21.857980 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 49724.9us
I20260709 13:05:21.833676 18184 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:21.860661 12662 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:21.861601 18189 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:21.805506 18180 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:21.834587 18135 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:21.905205 18135 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:21.885337 18226 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:21.840111 17918 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:05:21.871927 18184 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:21.906700 17918 consensus_queue.cc:1243] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer a70479a3b4114f3581095e9890f5d653 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:05:21.907759 13235 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:21.891710 12662 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:21.892606 18214 log.cc:927] Time spent T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 13:05:21.812960 17782 consensus_queue.cc:237] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:21.894444 18218 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:05:21.917073 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:21.849314 18199 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:21.910786 12619 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:21.912783 13226 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
W20260709 13:05:21.918426 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:21.918895 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 109673us
I20260709 13:05:21.919664 13227 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:05:21.875643 18215 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:05:21.915840 12538 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.008s	sys 0.008s
W20260709 13:05:21.930352 12538 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.009s	sys 0.008s
I20260709 13:05:21.877718 18190 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:21.926425 12513 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:21.914197 18167 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:21.929802 18168 consensus_meta.cc:287] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.773s	user 0.005s	sys 0.010s
I20260709 13:05:21.930503 18124 consensus_queue.cc:1059] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
W20260709 13:05:21.943822 13200 connection.cc:256] RPC call timeout handler was delayed by -1.1323474690000239s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21230000000000004s for a response
W20260709 13:05:21.945173 18220 log.cc:927] Time spent T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:05:21.935364 18184 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:21.946391 17936 consensus_queue.cc:260] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:21.947760 17575 consensus_meta.cc:287] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.642s	user 0.010s	sys 0.000s
I20260709 13:05:21.948119 17936 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:21.949113 18011 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:21.950824 18180 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:21.951359 18180 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.951794 18180 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:21.951375 18211 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:21.928447 17918 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:21.953785 17918 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.954180 17918 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:21.954442 18199 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:21.954639 17397 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:21.955389 17769 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:21.957629 12617 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:05:21.958047 12617 pending_rounds.cc:85] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 12
I20260709 13:05:21.958307 12617 pending_rounds.cc:107] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:05:21.958709 12617 raft_consensus.cc:2889] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:21.958158 18208 raft_consensus.cc:3055] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:21.963210 12539 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:21.928190 18215 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:21.964939 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:21.958671 18190 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.968133 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:21.968854 12692 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:21.964564 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:21.971728 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:21.885349 12438 catalog_manager.cc:5697] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 6 to 8, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 8 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:21.975878 12694 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:21.976358 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:21.973608 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:21.982285 12693 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:05:21.981371 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:21.985711 12695 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:21.979491 12692 raft_consensus.cc:2393] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 12: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:21.985625 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:21.966308 18208 raft_consensus.cc:740] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:21.990262 18104 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:05:22.009151 18208 consensus_queue.cc:260] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:21.976935 18190 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:21.979120 18011 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.006206 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:21.971160 18215 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:22.015733 13226 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:21.958487 18167 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:21.977149 18213 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:21.960718 18168 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:21.986912 18180 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:21.990713 17769 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:22.056852 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 2054) took 1005 ms. Trace:
I20260709 13:05:22.058715 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:22.062703 13226 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:22.063452 12616 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:05:22.016871 18013 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.020669 17918 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:22.056259 17746 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.074052 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:22.076339 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:22.060735 12690 rpcz_store.cc:276] 0709 13:05:21.051336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.061284 (+  9948us) service_pool.cc:224] Handling call
0709 13:05:21.061709 (+   425us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:21.083435 (+ 21726us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:21.083467 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:21.099315 (+ 15848us) log.cc:844] Serialized 26 byte log entry
0709 13:05:21.211124 (+111809us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:21.211159 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.019946 (+808787us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b54000c71d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:22.020023 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:22.020108 (+    85us) raft_consensus.cc:1685] finished
0709 13:05:22.020129 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:22.056782 (+ 36653us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37112064,"thread_start_us":69635,"threads_started":1,"wal-append.queue_time_us":158725}
I20260709 13:05:22.006266 18206 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:05:22.025545 18213 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:22.071509 13200 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:22.084978 17918 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:22.084693 17791 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:22.080605 18199 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:22.062402 18135 raft_consensus.cc:2764] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:05:22.060485 17769 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:22.090032 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:22.097015 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:22.020478 18011 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:22.097499 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:22.107388 12690 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:22.072121 18013 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:22.114143 18013 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:22.006835 17908 consensus_queue.cc:260] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:22.081248 17860 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:22.098071 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:22.089414 17746 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:22.120812 12695 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:05:22.121943 17746 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:22.124378 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3586) took 1175 ms. Trace:
I20260709 13:05:22.124959 12614 rpcz_store.cc:276] 0709 13:05:20.949390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.949872 (+   482us) service_pool.cc:224] Handling call
0709 13:05:21.116018 (+166146us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:21.128505 (+ 12487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:21.128553 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:21.179150 (+ 50597us) log.cc:844] Serialized 26 byte log entry
0709 13:05:21.290576 (+111426us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:21.290619 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:21.291439 (+   820us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:21.366397 (+ 74958us) raft_consensus.cc:1685] finished
0709 13:05:21.366425 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:22.124018 (+757593us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b540024bb50. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:22.124297 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":63008,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":7284,"spinlock_wait_cycles":359772416,"thread_start_us":83415,"threads_started":1,"wal-append.queue_time_us":166201}
I20260709 13:05:22.133441 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:05:22.136744 18234 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:05:22.137503 12588 leader_election.cc:400] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16.
I20260709 13:05:22.128955 18190 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:22.090858 18213 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:22.106406 18198 consensus_meta.cc:287] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.532s	user 0.012s	sys 0.000s
I20260709 13:05:22.140952 12693 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 14: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:05:22.141412 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 49466.8us
W20260709 13:05:22.142720 18233 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:05:22.143357 12687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d83186354414170b4775351916c56c2"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:05:22.081612 18180 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:05:22.157539 18198 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:22.123497 12438 catalog_manager.cc:5697] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:05:22.146003 17860 consensus_queue.cc:1059] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:22.095199 17397 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:22.150287 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 50849.5us
W20260709 13:05:22.150341 17460 consensus_meta.cc:287] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.002s
I20260709 13:05:22.170325 17460 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:22.171034 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:22.171752 12694 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 16: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:22.155085 12687 raft_consensus.cc:606] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:22.171900 17782 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:22.172320 12687 raft_consensus.cc:614] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:22.172586 18206 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:22.172732 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:22.174002 18092 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:22.156337 13200 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:22.157047 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:22.157270 18222 consensus_queue.cc:1059] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:22.175529 17460 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:22.175874 13200 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:22.176131 18222 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:22.176604 12662 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:22.153414 17965 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.163914 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:22.106578 17769 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:22.183594 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:22.187299 12622 raft_consensus.cc:2393] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 12: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:22.189028 12689 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:05:22.160892 18167 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:22.231040 12619 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 15. Current term is 16. Ops: []
W20260709 13:05:22.233081 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 57251.6us
I20260709 13:05:22.239646 12690 raft_consensus.cc:1275] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:22.245965 13200 leader_election.cc:400] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 10.
I20260709 13:05:22.247447 13200 leader_election.cc:403] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:22.251643 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:22.163308 18198 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:22.159893 18168 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:22.281889 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:22.282757 12622 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:05:22.283842 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:22.284955 13226 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:22.179471 18226 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:22.195013 18092 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:22.182659 18184 raft_consensus.cc:3055] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:22.160176 18180 consensus_queue.cc:1059] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.108s
I20260709 13:05:22.298025 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:22.300087 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:22.301004 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:22.324419 12614 raft_consensus.cc:2393] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 19: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:22.301966 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:22.290437 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:22.192107 17965 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:22.241304 17397 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:22.341169 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:22.350829 12622 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:05:22.350667 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 108776us
I20260709 13:05:22.243891 18222 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:22.380822 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:22.323674 18184 raft_consensus.cc:740] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:22.335235 12438 catalog_manager.cc:5697] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 9 to 12, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 12 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:05:22.395591 18249 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:22.397224 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:22.399049 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:22.399418 18239 log.cc:927] Time spent T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:05:22.400219 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:22.400416 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:22.402020 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:22.322808 18226 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:22.340323 17397 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:22.407069 18184 consensus_queue.cc:260] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:22.408928 18184 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:22.409648 17397 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:22.401885 17965 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:22.340502 18092 raft_consensus.cc:697] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:22.411998 18092 consensus_queue.cc:237] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:22.433426 18222 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:22.434477 18222 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:22.434659 18249 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 9. Current term is 10.
I20260709 13:05:22.403744 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:22.442516 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:22.388159 12438 catalog_manager.cc:5697] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:05:22.444291 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:22.445320 12621 raft_consensus.cc:2368] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 15. Current term is 16.
I20260709 13:05:22.445864 12438 catalog_manager.cc:5697] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 8 to 10, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 10 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:05:22.401449 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:22.404652 18215 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:22.509307 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:22.503207 17936 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:22.512089 17936 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:22.519955 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 165719us
I20260709 13:05:22.522022 13197 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:22.523766 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:22.526916 12617 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:22.529810 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 294191us
I20260709 13:05:22.536640 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:22.537380 13200 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:22.539143 12621 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 12: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:22.524367 17965 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.543628 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:22.524205 18235 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:22.544713 13235 raft_consensus.cc:2393] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 10: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:22.560783 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3297) took 1362 ms. Trace:
I20260709 13:05:22.561267 12541 rpcz_store.cc:276] 0709 13:05:21.185191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.185322 (+   131us) service_pool.cc:224] Handling call
0709 13:05:22.547079 (+1361757us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54002bb454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:22.547253 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":465427712}
I20260709 13:05:22.562245 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:22.570927 12621 raft_consensus.cc:2393] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 10: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:22.571322 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:22.524977 18213 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:22.586967 12691 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:22.588547 18213 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:22.591022 18215 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:22.561431 17860 consensus_queue.cc:1048] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 13:05:22.557902 17965 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:22.574080 18252 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:05:22.545711 12438 catalog_manager.cc:5697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 5 to 10, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 10 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:05:22.563289 17936 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:22.576439 18180 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:22.599962 18180 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.599140 12438 catalog_manager.cc:5697] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 9 to 11, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 11 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:05:22.563835 18235 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:22.600435 18180 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:22.590708 18251 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:22.613890 18251 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:22.614425 18251 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:22.615023 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:22.601506 12438 catalog_manager.cc:5697] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 4 to 15. New cstate: current_term: 15 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:05:22.615880 12614 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:22.607717 18252 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 13:05:22.603440 13200 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:22.602942 18215 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:22.574965 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:22.626452 18215 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:22.655712 18215 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:22.656667 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 53340.2us
I20260709 13:05:22.668911 12617 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:05:22.670497 13235 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:05:22.671021 12438 catalog_manager.cc:5697] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:05:22.674242 18251 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:22.677454 12617 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:05:22.646414 18252 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:05:22.682063 12621 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:22.682484 12616 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:22.684315 12617 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:22.716274 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3301) took 1529 ms. Trace:
I20260709 13:05:22.717795 12588 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:22.716876 12539 rpcz_store.cc:276] 0709 13:05:21.186445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.208282 (+ 21837us) service_pool.cc:224] Handling call
0709 13:05:22.715998 (+1507716us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b54000a5ad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:22.716183 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1657854720}
I20260709 13:05:22.728451 17993 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:22.765417 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 47696.8us
I20260709 13:05:22.730937 17769 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:22.775979 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:22.782449 13235 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:22.691013 12438 catalog_manager.cc:5697] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:05:22.770172 18251 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:22.784749 18184 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.804188 18184 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:22.815820 17769 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:22.783157 18229 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:22.774021 18222 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:22.861029 13228 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 994) took 1250 ms (client timeout 1528 ms). Trace:
W20260709 13:05:22.861548 13228 rpcz_store.cc:269] 0709 13:05:21.610416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.610560 (+   144us) service_pool.cc:224] Handling call
0709 13:05:22.860241 (+1249681us) spinlock_profiling.cc:243] Waited 60.4 ms on lock 0x7b54007c01d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:22.860962 (+   721us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139020032}
I20260709 13:05:22.866040 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:22.870950 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:22.879722 18092 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.880506 18092 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:22.884523 18092 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:22.888022 18208 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:22.893082 18235 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:22.900307 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 119656us
I20260709 13:05:22.901635 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:22.935707 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.901582 17936 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.943313 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:22.944438 12620 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:05:22.930774 18229 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:22.961325 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:22.960906 13197 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:22.924108 18180 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:22.969877 17769 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:05:22.979485 18259 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:05:22.962494 17936 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:22.979887 18184 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:22.989545 17769 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:22.986897 18272 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:23.000092 18092 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.923591 12438 catalog_manager.cc:5697] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:05:23.031980 17936 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:23.028542 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 77924.9us
I20260709 13:05:23.024940 17769 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:23.021474 18229 raft_consensus.cc:697] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:05:23.055965 18270 log.cc:927] Time spent T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:05:23.071254 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:23.072224 12620 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 14: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:23.073460 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:23.073972 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:23.074386 12619 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:23.075349 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:23.075424 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:23.076221 12614 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:05:23.078454 18262 log.cc:927] Time spent T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:05:23.080535 18240 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:23.080865 13199 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:23.081135 18240 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:23.085187 17993 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:23.086021 18240 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:23.086469 18180 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:23.087034 18207 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:23.087204 18180 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:23.087603 18180 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.082847 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3600) took 1393 ms. Trace:
I20260709 13:05:23.088124 18180 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:23.089272 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:23.088255 12618 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 3589) took 2092 ms (client timeout 1551 ms). Trace:
W20260709 13:05:23.089903 12618 rpcz_store.cc:269] 0709 13:05:21.008875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.011860 (+  2985us) service_pool.cc:224] Handling call
0709 13:05:23.088072 (+2076212us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b54002a76d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:23.088180 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":704077568}
I20260709 13:05:23.083045 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:23.083302 18251 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:23.029094 18222 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:23.083930 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:23.088224 12615 rpcz_store.cc:276] 0709 13:05:21.689187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.689418 (+   231us) service_pool.cc:224] Handling call
0709 13:05:21.721803 (+ 32385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:21.830460 (+108657us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:21.830493 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:22.629694 (+799201us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b2c0004c3c8. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:05:22.630197 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 13:05:22.778413 (+148216us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:22.778463 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.895273 (+116810us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54001eaad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:22.895320 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:23.082636 (+187316us) raft_consensus.cc:1685] finished
0709 13:05:23.082657 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:23.082790 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3130,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":5136,"spinlock_wait_cycles":251233408,"thread_start_us":147729,"threads_started":1,"wal-append.queue_time_us":146564}
I20260709 13:05:23.087522 13199 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:23.094539 12438 catalog_manager.cc:5697] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 4 to 10, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 10 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:23.097186 18222 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:23.097764 18222 raft_consensus.cc:697] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:23.098727 18222 consensus_queue.cc:237] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:23.101147 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:23.101958 13228 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:23.103492 18229 consensus_queue.cc:237] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:23.080875 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:23.082235 18254 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:23.110849 12662 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:23.118458 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:23.118896 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:23.119186 12689 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:05:23.119874 13226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:23.120448 13226 raft_consensus.cc:606] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:05:23.120680 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:23.073211 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:23.124035 12619 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:23.125454 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:23.127321 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:23.124786 12662 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:23.144512 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:23.151342 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:23.154580 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:23.143476 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:23.156210 12696 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:05:23.157662 13199 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:23.158031 12690 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:23.096441 12438 catalog_manager.cc:5697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 5 to 12. New cstate: current_term: 12 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:05:23.160928 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:23.037809 18092 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:23.144119 17782 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:23.181701 17782 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.182183 17782 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:23.160537 17768 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:23.172111 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:23.087734 18207 consensus_queue.cc:1059] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:05:23.207602 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:23.150838 18215 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.184194 18211 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:23.184693 18235 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:23.169807 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:23.217689 12615 raft_consensus.cc:2393] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:23.218482 12621 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:23.173151 18092 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:23.180918 12613 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
W20260709 13:05:23.209879 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 85130us
W20260709 13:05:23.212270 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 175378us
I20260709 13:05:23.162077 18272 raft_consensus.cc:697] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:23.183418 17964 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:23.235416 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:23.247967 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:23.216380 18211 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.241919 17964 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.257418 18211 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:23.233973 18235 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:23.280171 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 998) took 1608 ms. Trace:
I20260709 13:05:23.243950 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:23.301985 13200 leader_election.cc:336] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.646s (SENT)
I20260709 13:05:23.269891 17964 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:23.290143 13231 rpcz_store.cc:276] 0709 13:05:21.672218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.673184 (+   966us) service_pool.cc:224] Handling call
0709 13:05:21.706048 (+ 32864us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:21.725375 (+ 19327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:21.725428 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:21.755134 (+ 29706us) log.cc:844] Serialized 52 byte log entry
0709 13:05:21.924441 (+169307us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:21.935551 (+ 11110us) log.cc:844] Serialized 14 byte log entry
0709 13:05:21.935862 (+   311us) log.cc:844] Serialized 14 byte log entry
0709 13:05:22.145438 (+209576us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b1800420760. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c3f3 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
0709 13:05:23.082352 (+936914us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b1800420760. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a6489455 00007fc3a9571060 00007fc3a9583716 00007fc3a9594287 00007fc3a9594208
0709 13:05:23.279817 (+197465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:23.279903 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:23.279948 (+    45us) raft_consensus.cc:1685] finished
0709 13:05:23.279961 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:23.280115 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10902,"raft.queue_time_us":38631,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":15102,"spinlock_wait_cycles":82288384,"thread_start_us":360892,"threads_started":2,"wal-append.queue_time_us":257443,"wal-append.run_cpu_time_us":3930,"wal-append.run_wall_time_us":1149939}
I20260709 13:05:23.308602 13233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 997) took 1636 ms. Trace:
I20260709 13:05:23.220547 18215 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:23.320796 18277 log.cc:927] Time spent T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:05:23.309178 18287 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:23.324067 12696 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:23.309880 18253 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:23.316251 18207 consensus_queue.cc:1059] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
W20260709 13:05:23.332463 13200 leader_election.cc:336] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.676s (SENT)
I20260709 13:05:23.254314 12438 catalog_manager.cc:5697] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:05:23.349375 13200 leader_election.cc:336] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.683s (SENT)
I20260709 13:05:23.350054 13200 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:23.360728 13200 leader_election.cc:336] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.684s (SENT)
I20260709 13:05:23.360299 18222 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:23.315302 18272 consensus_queue.cc:237] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:23.382063 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 92887.6us
I20260709 13:05:23.328660 18287 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:23.371821 18184 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.357918 18283 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:23.403704 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1174) took 1568 ms. Trace:
I20260709 13:05:23.410091 13227 rpcz_store.cc:276] 0709 13:05:21.836434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.836611 (+   177us) service_pool.cc:224] Handling call
0709 13:05:21.851247 (+ 14636us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:21.922211 (+ 70964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:23.399973 (+1477762us) spinlock_profiling.cc:243] Waited 63.6 ms on lock 0x7b54004d8354. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:23.403607 (+  3634us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146370816}
W20260709 13:05:23.398521 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 72165.7us
I20260709 13:05:23.411918 12587 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:23.413932 18235 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:23.414165 18215 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:23.421928 18284 log.cc:927] Time spent T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:05:23.423503 18280 log.cc:927] Time spent T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 13:05:23.406893 12438 catalog_manager.cc:5697] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 8 to 10, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 10 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:05:23.427134 17965 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:23.409992 18184 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:23.412614 18283 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:23.507091 17769 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:23.508145 18248 log.cc:927] Time spent T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 1.115s	user 0.000s	sys 0.015s
I20260709 13:05:23.417117 18298 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:23.508447 18199 raft_consensus.cc:3055] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:05:23.508888 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 53220.6us
W20260709 13:05:23.478248 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 96856.3us
W20260709 13:05:23.511157 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 104968us
W20260709 13:05:23.532790 12588 leader_election.cc:336] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.528s (SENT)
I20260709 13:05:23.533710 12689 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
W20260709 13:05:23.533952 12588 leader_election.cc:336] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.686s (SENT)
I20260709 13:05:23.534507 12588 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:23.539043 17964 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:23.540737 18168 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:23.541975 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.547135 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:23.546681 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:23.542537 12588 leader_election.cc:336] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.810s (SENT)
I20260709 13:05:23.549527 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:23.511761 17460 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.520870 17782 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:23.565691 12543 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
W20260709 13:05:23.539139 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.582101 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:23.523406 17908 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:23.583847 12541 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:05:23.564689 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:23.585067 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:23.584719 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:23.546200 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:23.590366 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:23.591179 12544 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:05:23.591459 12542 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:23.592314 12539 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
W20260709 13:05:23.566279 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 1.63983e+06us
I20260709 13:05:23.585915 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:23.594528 12540 raft_consensus.cc:2393] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 12: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:23.594787 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:23.590488 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:23.597707 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:23.598143 13235 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:23.598572 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:23.600631 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 89822.1us
I20260709 13:05:23.600621 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:23.601264 12545 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:05:23.601897 12545 pending_rounds.cc:85] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 12
I20260709 13:05:23.602151 12545 pending_rounds.cc:107] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:05:23.541450 18226 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:23.544427 17960 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:23.601240 13227 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 15: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:23.542799 18298 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:23.538985 18287 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:23.602452 12545 raft_consensus.cc:2889] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:23.541328 18168 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:23.605165 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:23.566121 18122 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:23.565997 18215 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:05:23.609505 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:23.544283 18124 consensus_queue.cc:1243] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:05:23.576440 18141 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:23.644361 12659 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:23.604557 17460 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:23.618166 18278 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:23.583077 18178 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:23.618049 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:23.621632 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 79108.7us
I20260709 13:05:23.623153 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1348) took 1659 ms. Trace:
I20260709 13:05:23.596644 18130 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.636646 17782 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:23.639356 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1899) took 2513 ms. Trace:
W20260709 13:05:23.682924 12588 leader_election.cc:336] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.815s (SENT)
I20260709 13:05:23.641340 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:23.541492 17964 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:23.695420 18283 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:23.695638 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:23.696431 12540 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:23.648975 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:23.650102 13232 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:23.700100 13200 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:23.531818 18199 raft_consensus.cc:740] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:23.650688 12547 raft_consensus.cc:2376] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16. Re-sending same reply.
I20260709 13:05:23.601680 18282 consensus_queue.cc:1059] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:05:23.600412 18235 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:05:23.651036 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:23.681396 13229 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:23.640746 18302 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.683669 12588 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:23.684692 12539 raft_consensus.cc:2410] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:05:23.684731 17965 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:23.682756 12538 rpcz_store.cc:276] 0709 13:05:21.126737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.134381 (+  7644us) service_pool.cc:224] Handling call
0709 13:05:21.147622 (+ 13241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:21.160178 (+ 12556us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:05:21.334142 (+173964us) log.cc:844] Serialized 14 byte log entry
0709 13:05:21.931409 (+597267us) log.cc:844] Serialized 14 byte log entry
0709 13:05:22.394547 (+463138us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b18004bd120. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c3f3 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
0709 13:05:23.511505 (+1116958us) spinlock_profiling.cc:243] Waited 4.6 ms on lock 0x7b18004bd120. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a6406c0a 00007fc3afb46219 00007fc3a648ea40 00007fc3a64894e4 00007fc3a6489455 00007fc3a9571060 00007fc3a9583716 00007fc3a9594287 00007fc3a9594208
0709 13:05:23.626218 (+114713us) log.cc:844] Serialized 14 byte log entry
0709 13:05:23.638878 (+ 12660us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:23.638937 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:23.639002 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:23.639093 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:23.639250 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1614307,"prepare.queue_time_us":207192,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":85,"raft.queue_time_us":1583429,"raft.run_cpu_time_us":357,"raft.run_wall_time_us":16748,"spinlock_wait_cycles":15755008,"thread_start_us":776217,"threads_started":6,"wal-append.queue_time_us":638153,"wal-append.run_cpu_time_us":3211,"wal-append.run_wall_time_us":1154584}
I20260709 13:05:23.686226 17460 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:23.687816 18178 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:23.688522 18130 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:23.643203 18122 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:23.689668 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:23.750880 13228 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:23.697443 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:23.751717 12540 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:23.703649 12691 rpcz_store.cc:276] 0709 13:05:21.963296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.963603 (+   307us) service_pool.cc:224] Handling call
0709 13:05:21.976636 (+ 13033us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:22.587418 (+610782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:23.622936 (+1035518us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b54002c8654. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:23.623086 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1403064576}
I20260709 13:05:23.751976 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:23.710909 12613 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 1382) took 1412 ms (client timeout 1656 ms). Trace:
I20260709 13:05:23.752537 12538 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:23.714130 13200 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:23.652068 18237 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 1.487s	user 0.007s	sys 0.014s
I20260709 13:05:23.653532 18124 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.732901 18283 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:23.739886 12544 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:05:23.649772 18290 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:05:23.683980 18303 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:23.709380 18180 consensus_meta.cc:287] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.621s	user 0.012s	sys 0.007s
W20260709 13:05:23.741520 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 66821.6us
I20260709 13:05:23.742156 12662 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:23.746937 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:05:23.752693 12613 rpcz_store.cc:269] 0709 13:05:22.298620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.300699 (+  2079us) service_pool.cc:224] Handling call
0709 13:05:23.710627 (+1409928us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b54001e96d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:23.710815 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1969243392}
I20260709 13:05:23.761632 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:23.776283 12539 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:23.762483 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 79585.8us
I20260709 13:05:23.736129 17965 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.683703 18141 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:23.782459 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:23.750983 18282 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:23.780264 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:23.790074 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:23.790807 13232 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:23.754730 17960 raft_consensus.cc:697] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:23.798893 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:23.768791 18283 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:23.793988 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:23.745257 18167 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:05:23.788565 13227 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:23.799882 12690 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:05:23.790258 12544 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:23.807636 12687 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 16: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:23.782384 17965 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:23.813074 12690 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:05:23.775027 17964 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:23.802202 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:23.814607 12613 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:23.783890 18215 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:23.794991 17769 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:23.778312 12510 connection.cc:256] RPC call timeout handler was delayed by -1.624060333999978s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 13:05:23.820403 12510 connection.cc:256] RPC call timeout handler was delayed by -1.5835603340000262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
W20260709 13:05:23.820750 12510 connection.cc:256] RPC call timeout handler was delayed by -1.5637603339999941s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15760000000000002s for a response
W20260709 13:05:23.821069 12510 connection.cc:256] RPC call timeout handler was delayed by -1.5592603339999869s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
I20260709 13:05:23.780956 18180 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:23.773118 18312 consensus_queue.cc:1059] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:05:23.786170 18199 consensus_queue.cc:260] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:23.784030 18211 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:23.814805 12539 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:05:23.770617 18124 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:23.743052 18302 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:23.824937 18199 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:23.834648 18302 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:23.818725 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 102909us
I20260709 13:05:23.819392 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1350) took 2219 ms. Trace:
I20260709 13:05:23.835376 18011 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:23.835312 13230 rpcz_store.cc:276] 0709 13:05:21.600168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.600369 (+   201us) service_pool.cc:224] Handling call
0709 13:05:21.615482 (+ 15113us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:21.832613 (+217131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:21.832663 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:21.852449 (+ 19786us) log.cc:844] Serialized 26 byte log entry
0709 13:05:22.016908 (+164459us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:22.016934 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.016982 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:23.425711 (+1408729us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:23.814442 (+388731us) raft_consensus.cc:1685] finished
0709 13:05:23.814466 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:23.819305 (+  4839us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":129225,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":3496704,"thread_start_us":322238,"threads_started":2,"wal-append.queue_time_us":217792}
W20260709 13:05:23.821420 12510 connection.cc:256] RPC call timeout handler was delayed by -1.4566603340000484s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1695s for a response
W20260709 13:05:23.838469 12510 connection.cc:256] RPC call timeout handler was delayed by -1.4008603339999581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
W20260709 13:05:23.838811 12510 connection.cc:256] RPC call timeout handler was delayed by -1.377460334000034s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
I20260709 13:05:23.807261 18283 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:23.822538 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 117062us
I20260709 13:05:23.824553 12541 raft_consensus.cc:3055] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:23.827702 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2046) took 1740 ms. Trace:
I20260709 13:05:23.855520 12695 rpcz_store.cc:276] 0709 13:05:22.086869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.089009 (+  2140us) service_pool.cc:224] Handling call
0709 13:05:22.097181 (+  8172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:22.121203 (+ 24022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:23.827369 (+1706166us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b5400405454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:23.827618 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53627648}
I20260709 13:05:23.856884 12541 raft_consensus.cc:740] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:23.854033 13200 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:23.859408 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:23.863569 13200 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:23.817107 18215 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:23.898192 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.780707 18303 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:23.898540 12510 connection.cc:256] RPC call timeout handler was delayed by -1.2955603340000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
I20260709 13:05:23.860217 12543 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:23.899063 18310 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:23.905263 18253 consensus_queue.cc:1059] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:23.830576 18211 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:23.915238 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 51800.3us
I20260709 13:05:23.915688 12546 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
W20260709 13:05:23.917116 12510 connection.cc:256] RPC call timeout handler was delayed by -1.2793603339999891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
I20260709 13:05:23.914696 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:23.922652 12510 connection.cc:256] RPC call timeout handler was delayed by -1.1452603339999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
I20260709 13:05:23.914951 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:23.924171 12539 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:23.909029 17397 raft_consensus.cc:3055] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:05:23.923318 12510 connection.cc:256] RPC call timeout handler was delayed by -1.1038603340000464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20870000000000002s for a response
W20260709 13:05:23.933794 12510 connection.cc:256] RPC call timeout handler was delayed by -1.0624603339999794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21330000000000002s for a response
W20260709 13:05:23.934342 12510 connection.cc:256] RPC call timeout handler was delayed by -1.0309603340000422s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21680000000000002s for a response
I20260709 13:05:23.824016 18180 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:23.934777 12510 connection.cc:256] RPC call timeout handler was delayed by -1.024660334000032s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
I20260709 13:05:23.936106 12538 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:23.938910 12510 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:23.943097 12510 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:23.910718 17769 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:23.828078 18287 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:23.952270 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:23.917912 18215 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:23.960830 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:23.822218 17960 consensus_queue.cc:237] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:23.914494 18122 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:23.916662 17936 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.926640 18302 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.937536 18294 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:24.019110 18122 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.957232 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:24.019696 18122 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:23.963482 18118 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:23.975291 18312 raft_consensus.cc:3055] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:24.022544 18312 raft_consensus.cc:740] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:24.023504 18312 consensus_queue.cc:260] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.024912 18312 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:23.958992 18167 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:23.975796 18287 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.032048 18287 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:24.036962 18279 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.037626 18279 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:23.909745 18308 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.038627 18308 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.039928 18279 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:23.971312 12614 raft_consensus.cc:2393] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 17: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:24.041042 18308 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:23.971714 12510 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:23.920166 18168 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:24.042686 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 71103.8us
I20260709 13:05:23.929352 17397 raft_consensus.cc:740] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:23.976661 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:24.046979 12615 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:23.910095 18011 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 13:05:23.916568 18222 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:23.986795 18124 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:23.988603 13234 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
W20260709 13:05:23.999473 12588 leader_election.cc:336] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.204s (SENT)
I20260709 13:05:24.050313 12588 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:24.002969 18315 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:24.004833 18314 log.cc:927] Time spent T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 13:05:24.005381 18230 raft_consensus.cc:3055] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:24.005825 18302 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:24.006500 18141 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:24.007302 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 85332.5us
I20260709 13:05:24.009106 18303 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:23.930469 18310 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:24.011894 18130 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:24.012336 17936 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.017839 18178 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:24.018803 18294 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:24.020008 12613 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:23.955183 12541 consensus_queue.cc:260] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.131480 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:24.142005 12541 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:24.043473 12510 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:23.974277 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:24.045668 12540 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:24.114274 18279 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:24.102867 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 3614) took 1032 ms. Trace:
I20260709 13:05:24.144948 12659 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:24.108335 18208 raft_consensus.cc:3055] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:24.093295 18281 raft_consensus.cc:3055] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:24.136036 18278 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.047768 18308 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:24.082949 18230 raft_consensus.cc:740] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:24.049714 18287 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.118088 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:24.158252 12617 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:24.137034 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1361) took 1013 ms. Trace:
I20260709 13:05:24.050323 17768 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.139511 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:24.050041 18222 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:24.124034 13197 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:24.081665 12512 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:24.158957 12688 rpcz_store.cc:276] 0709 13:05:23.124006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.142682 (+ 18676us) service_pool.cc:224] Handling call
0709 13:05:23.143043 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:23.144855 (+  1812us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:23.144887 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:23.154814 (+  9927us) log.cc:844] Serialized 26 byte log entry
0709 13:05:23.354445 (+199631us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:23.410615 (+ 56170us) log.cc:844] Serialized 14 byte log entry
0709 13:05:23.508173 (+ 97558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:23.508253 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:24.088612 (+580359us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b1800182020. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c3f3 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
0709 13:05:24.110731 (+ 22119us) raft_consensus.cc:1685] finished
0709 13:05:24.136814 (+ 26083us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:24.136973 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116133,"prepare.queue_time_us":49013,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":1139,"raft.queue_time_us":99057,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":11178,"spinlock_wait_cycles":10085632,"thread_start_us":169818,"threads_started":1,"wal-append.queue_time_us":226688}
W20260709 13:05:24.145867 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 102483us
I20260709 13:05:24.148080 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:24.145538 12619 rpcz_store.cc:276] 0709 13:05:23.070163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.076610 (+  6447us) service_pool.cc:224] Handling call
0709 13:05:24.102613 (+1026003us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b54003af2d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:24.102780 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67022720}
I20260709 13:05:24.165086 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:24.149925 12622 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 13:05:24.151039 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 151611us
I20260709 13:05:24.166199 12510 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:24.166608 12588 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.209s (SENT) [suppressed 41 similar messages]
I20260709 13:05:24.167351 12510 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:24.109326 18315 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:24.138334 18180 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:05:24.152117 18178 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:24.152354 18295 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:24.113446 13200 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:24.193553 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 80181.5us
W20260709 13:05:24.194341 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 70521.3us
I20260709 13:05:24.194489 13200 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:24.195547 13200 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:24.155305 12659 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:24.159279 12541 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:05:24.163877 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 82361.2us
I20260709 13:05:24.158803 18122 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:24.143929 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:24.200141 12615 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:24.202536 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 47288.9us
I20260709 13:05:24.164420 18303 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:24.168788 12510 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:24.147915 18208 raft_consensus.cc:740] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:24.154942 18281 raft_consensus.cc:740] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:24.169065 18222 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:24.184299 18317 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:24.142730 17397 consensus_queue.cc:260] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:24.218639 17575 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:05:24.157733 18290 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:05:24.256274 17964 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:24.184077 18130 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:24.259168 18315 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:24.259894 18197 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:24.259663 17965 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.260429 18197 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.260991 18294 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:24.224244 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:24.240396 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 71676.9us
I20260709 13:05:24.197418 17960 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:24.214648 17769 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:24.217370 17908 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:24.264010 12510 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:24.205955 12617 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:24.168643 17768 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.161652 18287 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.217651 18303 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:24.250218 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.254007 18335 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:24.218861 18320 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:24.266469 12510 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:24.265265 13197 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:24.245062 18308 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:24.256995 17964 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.282506 12615 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:24.219028 18141 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:05:24.283355 13197 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:24.284462 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:24.160797 18278 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.262849 18197 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:24.267194 18124 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:24.294742 12510 leader_election.cc:400] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 15. Current term is 16.
I20260709 13:05:24.274909 18303 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:24.301625 18315 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:24.301934 18336 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:24.302534 13227 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:24.305835 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:24.247022 18253 consensus_queue.cc:1059] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:05:24.292496 13197 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:24.305724 17965 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:24.271530 18335 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:24.309995 12510 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:24.283186 18317 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:24.281994 17769 raft_consensus.cc:697] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:24.298817 18120 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:05:24.324105 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.329962 18310 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:24.330621 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2061) took 1166 ms. Trace:
I20260709 13:05:24.331135 12696 rpcz_store.cc:276] 0709 13:05:23.164303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.164429 (+   126us) service_pool.cc:224] Handling call
0709 13:05:23.178078 (+ 13649us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:23.324601 (+146523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.330377 (+1005776us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54002c9054. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:24.330562 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335334272}
W20260709 13:05:24.331663 18322 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:05:24.334197 18283 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:24.334789 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.336323 18283 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:24.300631 18208 consensus_queue.cc:260] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:24.338163 18208 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:24.338917 18222 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:24.340036 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.340684 18199 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:24.340957 18222 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:24.341161 18199 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:24.318656 18336 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.343569 18199 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:24.345455 18336 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:24.346982 18253 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:24.347395 18287 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:24.347522 18253 raft_consensus.cc:697] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:24.348415 18253 consensus_queue.cc:237] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.350174 17397 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:24.350895 12659 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
W20260709 13:05:24.351094 18011 consensus_queue.cc:1175] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a11816c5d72e4d1295a242f3ced09e5f" responder_term: 14 status { last_received { term: 14 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 14 index: 12 } }
I20260709 13:05:24.292665 17964 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.352108 12659 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:24.353408 18293 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:24.353672 18190 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:24.353843 18293 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.354168 18190 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.354359 18293 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:24.354595 18190 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:24.231662 18230 consensus_queue.cc:260] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.357926 18230 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:24.323104 18120 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:24.358999 18120 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:24.362142 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 1396) took 1247 ms. Trace:
I20260709 13:05:24.362569 12618 rpcz_store.cc:276] 0709 13:05:23.114918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.115024 (+   106us) service_pool.cc:224] Handling call
0709 13:05:24.361933 (+1246909us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b54002a67d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:24.362079 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1480035712}
I20260709 13:05:24.364410 12694 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:05:24.365136 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2056) took 1219 ms. Trace:
I20260709 13:05:24.319150 18335 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:24.370836 18302 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:24.372241 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:24.372601 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:24.373551 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:24.373849 13227 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:24.374222 13226 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:24.374275 12691 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:24.375103 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:24.372259 17908 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:24.375945 17908 raft_consensus.cc:697] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:24.376497 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:24.376865 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:24.377101 12693 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:05:24.377503 12689 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:24.377218 17908 consensus_queue.cc:237] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.378453 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:24.331661 18323 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:24.380781 18323 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:24.381201 18323 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:24.380025 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:24.381631 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:24.330703 17936 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:24.365427 12694 rpcz_store.cc:276] 0709 13:05:23.146197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.146333 (+   136us) service_pool.cc:224] Handling call
0709 13:05:23.146700 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:24.364173 (+1217473us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b540043f6a0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a94f0dc0 00007fc3a957b1c0 00007fc3a957c231 00007fc3a9578d8f 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c
0709 13:05:24.364850 (+   677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.365084 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43787520}
I20260709 13:05:24.387665 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:24.370739 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:24.382018 12690 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 14: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:24.375861 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:24.383863 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:24.389693 12621 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:05:24.392339 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:24.376070 18215 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.396852 13228 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:24.394374 12512 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:24.406518 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:24.408102 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:24.394937 13197 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:24.396090 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:24.412262 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 102392us
I20260709 13:05:24.413426 12510 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:24.413796 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:24.384419 18294 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:24.416148 12510 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:24.353839 17964 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:24.429168 13234 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:24.429731 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:24.430438 12689 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
W20260709 13:05:24.438629 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 243127us
W20260709 13:05:24.443080 13200 leader_election.cc:336] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.072s (SENT)
I20260709 13:05:24.444556 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:24.450011 12688 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:05:24.469770 13228 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:24.470379 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:24.468485 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.456390 12510 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:24.471529 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:24.471565 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:24.472886 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:24.473449 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:24.474210 12688 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:24.475445 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:24.410364 17936 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:24.476099 12539 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:24.476389 17936 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.464593 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:24.477901 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:24.478446 12694 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 15: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:24.478485 12540 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:24.480530 18302 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:24.481473 18302 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:24.482035 18302 raft_consensus.cc:697] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:24.483157 18302 consensus_queue.cc:237] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.410697 18278 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:24.486826 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:24.487064 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:24.452212 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:24.487593 13235 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:24.488046 12690 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:24.465378 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:24.488449 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:24.388859 18279 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 13:05:24.470937 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:24.504870 12539 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:24.395754 18198 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:24.475128 12510 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:24.467587 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1388) took 1862 ms. Trace:
I20260709 13:05:24.427340 18130 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:24.530543 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 53967.8us
I20260709 13:05:24.432104 18310 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:24.487607 12618 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 18: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:24.514568 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:05:24.516502 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.534072 13200 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:24.535702 13235 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:24.495118 12617 raft_consensus.cc:1275] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:05:24.463003 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 46036.4us
W20260709 13:05:24.538812 12588 leader_election.cc:336] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.869s (SENT)
I20260709 13:05:24.522908 12540 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:24.424916 18336 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:24.426431 18317 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:24.286211 18281 consensus_queue.cc:260] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.548492 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:24.490150 18122 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:24.548758 13200 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:24.526782 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 51743us
I20260709 13:05:24.581776 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:24.582633 12540 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:24.582733 18197 consensus_queue.cc:1059] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:24.585373 18122 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.585736 12547 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:24.586061 18122 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:24.586876 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:24.587859 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:24.588366 12547 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:24.588701 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:24.590813 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:24.591548 12617 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 15: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:24.595211 12543 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:05:24.596246 12540 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:24.596706 12543 pending_rounds.cc:85] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 6
I20260709 13:05:24.597012 12543 pending_rounds.cc:107] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:05:24.597260 12543 raft_consensus.cc:2889] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:24.526361 12616 rpcz_store.cc:276] 0709 13:05:22.605137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.685407 (+ 80270us) service_pool.cc:224] Handling call
0709 13:05:22.691991 (+  6584us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:22.695060 (+  3069us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:05:22.924263 (+229203us) log.cc:844] Serialized 14 byte log entry
0709 13:05:23.027370 (+103107us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:23.027853 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:05:23.027983 (+   130us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:23.028018 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:23.028121 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:23.408627 (+380506us) raft_consensus.cc:1685] finished
0709 13:05:23.408646 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:24.467418 (+1058772us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b540031c250. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:24.467530 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12808,"prepare.queue_time_us":168490,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":28935,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":56282,"spinlock_wait_cycles":15743104,"thread_start_us":276763,"threads_started":2,"wal-append.queue_time_us":248824,"wal-append.run_cpu_time_us":3995,"wal-append.run_wall_time_us":1204919}
I20260709 13:05:24.602391 13234 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:05:24.466042 18141 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:24.445082 18294 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.430126 18190 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.600549 12513 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:24.535315 18167 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:24.541343 18254 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.546178 18336 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:24.638942 18318 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 13:05:24.643232 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:24.545717 18130 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:24.646148 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 45721us
I20260709 13:05:24.639387 18337 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:05:24.644073 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 259995us
I20260709 13:05:24.679308 12513 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:24.640208 18283 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:24.680261 13231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:24.580343 18207 consensus_queue.cc:1059] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
I20260709 13:05:24.714440 13235 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:24.535091 18198 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.715930 13235 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:05:24.714054 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:24.718097 13228 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
W20260709 13:05:24.610699 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 62023us
I20260709 13:05:24.534739 17769 consensus_queue.cc:237] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.761831 12546 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:05:24.727026 13235 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:05:24.746944 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.780725 13231 raft_consensus.cc:606] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:24.819018 13231 raft_consensus.cc:614] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:05:24.710222 18342 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:05:24.655284 18312 consensus_meta.cc:287] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.630s	user 0.007s	sys 0.007s
I20260709 13:05:24.833694 12513 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:24.841169 13200 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:24.668553 18336 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:24.655064 18317 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:24.648376 18281 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:24.720571 17960 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:24.763170 18130 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:24.738811 18190 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:24.818809 18141 consensus_queue.cc:1059] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:05:24.765008 18294 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:24.720140 17936 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:24.732218 18215 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:24.653458 18338 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.302s
I20260709 13:05:24.675772 18254 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.852941 18337 raft_consensus.cc:697] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:05:24.909268 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 68220.7us
I20260709 13:05:24.752616 18293 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.853860 18317 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:24.875073 17960 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.923957 13200 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:24.859208 18310 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:05:24.744153 18120 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:24.910609 17908 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.938741 17960 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:05:24.952800 18340 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
I20260709 13:05:24.923257 17397 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:24.950282 17964 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:24.942502 18317 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:24.970227 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 255261us
W20260709 13:05:24.964051 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.956429 17936 raft_consensus.cc:3055] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:24.938683 13200 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:24.983179 12587 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:05:24.989928 18335 consensus_meta.cc:287] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.622s	user 0.007s	sys 0.005s
I20260709 13:05:24.950675 18339 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
W20260709 13:05:25.052619 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 69527.4us
I20260709 13:05:23.309996 13233 rpcz_store.cc:276] 0709 13:05:21.671910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.672054 (+   144us) service_pool.cc:224] Handling call
0709 13:05:21.672360 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:21.682904 (+ 10544us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:05:21.705965 (+ 23061us) log.cc:844] Serialized 14 byte log entry
0709 13:05:23.110076 (+1404111us) spinlock_profiling.cc:243] Waited 6.4 ms on lock 0x7b18003b8060. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a911923a 00007fc3a9583a2a
0709 13:05:23.308140 (+198064us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:23.308212 (+    72us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:23.308285 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:23.308374 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:23.308530 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22870,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":107,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":2768,"spinlock_wait_cycles":14718848,"thread_start_us":197717,"threads_started":1}
W20260709 13:05:25.049427 18340 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:05:25.087139 13199 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:25.089195 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3628) took 1127 ms. Trace:
I20260709 13:05:25.089641 12614 rpcz_store.cc:276] 0709 13:05:23.961859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.041686 (+ 79827us) service_pool.cc:224] Handling call
0709 13:05:24.042052 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:24.042424 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:05:24.227128 (+184704us) log.cc:844] Serialized 14 byte log entry
0709 13:05:24.476719 (+249591us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:24.478777 (+  2058us) log.cc:844] Serialized 26 byte log entry
0709 13:05:24.479303 (+   526us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:24.481059 (+  1756us) log.cc:844] Serialized 14 byte log entry
0709 13:05:24.657428 (+176369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.657532 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:25.088955 (+431423us) raft_consensus.cc:1685] finished
0709 13:05:25.088976 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:25.089129 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110990,"prepare.queue_time_us":240577,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":5982,"raft.queue_time_us":315303,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":36350,"spinlock_wait_cycles":55327104,"thread_start_us":560337,"threads_started":3,"wal-append.queue_time_us":326850}
I20260709 13:05:25.092772 18254 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:25.093436 18254 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:25.094515 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:25.095408 12696 raft_consensus.cc:2368] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 12. Current term is 13.
W20260709 13:05:25.097261 18122 consensus_meta.cc:287] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.511s	user 0.011s	sys 0.000s
I20260709 13:05:24.981817 17908 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.063901 18120 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:25.015535 18337 consensus_queue.cc:237] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.099372 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:25.100009 12696 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:05:25.101876 18350 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:25.101930 12587 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
W20260709 13:05:25.065132 12510 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:42446 dropped due to backpressure: service queue is full with 50 items
W20260709 13:05:25.073210 18323 consensus_meta.cc:287] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.683s	user 0.010s	sys 0.000s
I20260709 13:05:25.074378 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:25.106526 12620 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:05:25.078294 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.107412 12544 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
W20260709 13:05:25.079741 18353 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:05:25.081646 17964 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:25.081737 18184 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:25.049263 18335 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.093330 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.118263 13199 leader_election.cc:400] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 12. Current term is 13.
I20260709 13:05:25.118685 12540 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
W20260709 13:05:25.054965 18230 consensus_meta.cc:287] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.697s	user 0.007s	sys 0.006s
I20260709 13:05:24.999183 17936 raft_consensus.cc:740] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:25.120484 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:25.101950 18347 log.cc:927] Time spent T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:05:25.118686 13199 leader_election.cc:403] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:05:25.121421 12544 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:25.128798 12587 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:25.130077 12587 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:25.104542 18122 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.136029 13197 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:25.146864 12689 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:05:25.148923 12616 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:05:25.150538 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:25.159574 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:25.155561 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:25.162959 12614 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:05:25.145805 17993 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:25.133116 17964 raft_consensus.cc:697] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:25.116511 18120 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.043s
W20260709 13:05:25.168781 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 50918.1us
I20260709 13:05:25.116700 18323 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.147821 18352 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:25.145633 18346 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:25.181519 12615 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:05:25.109707 12510 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:42446 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3334)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1903)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3329)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1911)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3335)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3323)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1923)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3336)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1913)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3326)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1904)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1921)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3319)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1902)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3325)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1912)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1907)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1906)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3332)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1929)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3339)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1915)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1926)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1917)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3318)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1922)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1908)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1910)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1914)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3333)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3330)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1918)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1909)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3320)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3321)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3322)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3324)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3327)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3328)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3338)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1905)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1916)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1919)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1920)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1924)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1925)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1927)
I20260709 13:05:25.197431 13230 raft_consensus.cc:1240] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:25.186873 18254 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:25.201462 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.184589 17993 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.188019 18283 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:25.201227 13233 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:05:25.205137 12543 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:25.189587 18352 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.210518 12691 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:05:25.210332 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:25.213285 12543 raft_consensus.cc:2368] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16.
I20260709 13:05:25.192765 18293 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:25.195928 18130 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:25.200590 18338 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.187983 18366 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:05:25.209767 18254 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.192250 18339 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:05:25.208148 17993 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:25.215131 18352 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:25.237118 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.198305 17936 consensus_queue.cc:260] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:25.272488 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 333899us
I20260709 13:05:25.273516 13200 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:25.256470 18178 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.278241 13200 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:25.270988 18303 consensus_meta.cc:287] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.948s	user 0.008s	sys 0.005s
W20260709 13:05:25.280326 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.222877 18167 consensus_queue.cc:1059] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:05:25.277091 17397 raft_consensus.cc:697] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:25.235210 18254 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:25.242909 18184 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:05:25.234833 18278 raft_consensus.cc:3055] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:25.236341 18130 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.293187 18122 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:25.231703 18338 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.280263 18253 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:25.310717 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:25.313795 12543 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 16: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:25.287798 17936 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:25.295434 18278 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:25.268460 17964 consensus_queue.cc:237] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.283108 18178 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.286866 18303 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.310616 18337 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:25.279443 18317 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.317862 18253 raft_consensus.cc:697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:25.337080 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:25.345063 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:25.350950 12543 raft_consensus.cc:2368] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16.
I20260709 13:05:25.355374 13226 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12. Ops: []
W20260709 13:05:25.357841 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 75473.7us
I20260709 13:05:25.342862 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.359942 12539 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:25.364084 12538 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:05:25.376637 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:25.377552 12539 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:25.352602 18355 log.cc:927] Time spent T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 13:05:25.318892 18336 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.382844 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.394951 12543 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:05:25.342669 18337 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.349367 18323 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:25.401835 12539 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:25.403426 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:25.410519 13229 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:25.406459 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:25.413801 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:25.414707 13233 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:05:25.421967 12513 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:25.423583 13228 raft_consensus.cc:1240] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:25.334291 17397 consensus_queue.cc:237] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.415134 18337 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:05:25.416345 18365 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:05:25.430640 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.438099 12543 raft_consensus.cc:2393] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 15: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:25.414109 18335 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:25.414484 18130 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:25.441444 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:25.425709 18310 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:25.362107 18278 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.445389 18253 consensus_queue.cc:237] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.452603 12692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1362) took 1015 ms. Trace:
I20260709 13:05:25.454598 12692 rpcz_store.cc:276] 0709 13:05:24.437189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.437404 (+   215us) service_pool.cc:224] Handling call
0709 13:05:24.445824 (+  8420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:24.446205 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:24.446241 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:24.446813 (+   572us) log.cc:844] Serialized 26 byte log entry
0709 13:05:24.995386 (+548573us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:24.995430 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.995495 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:25.071944 (+ 76449us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b48001b0258. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3ae4a2aa1 00007fc3ae499b37 00007fc3ae4999ca 00007fc3ae59126f 00007fc3ae590f37 00007fc3ae5a555c 00007fc3ae5a5508 00007fc3ae5a5488 00007fc3ae5a5443 00007fc3ae5a46ec 00007fc3ad4cea96
0709 13:05:25.447899 (+375955us) raft_consensus.cc:1685] finished
0709 13:05:25.447922 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:25.452527 (+  4605us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1032,"raft.run_cpu_time_us":2506,"raft.run_wall_time_us":620498,"spinlock_wait_cycles":32309120,"thread_start_us":452792,"threads_started":1,"wal-append.queue_time_us":612460}
W20260709 13:05:25.460852 18371 log.cc:927] Time spent T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:05:25.466261 18303 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:25.468248 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:25.471726 18317 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:25.478231 18379 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:05:25.481356 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:25.482028 13233 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:25.482340 18178 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:25.445014 18310 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:25.483035 18310 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:25.485982 18278 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:25.487543 18346 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.488070 18346 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:25.491482 18377 log.cc:927] Time spent T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:05:25.468293 18338 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:25.494560 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:25.495136 18338 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.495651 12540 raft_consensus.cc:2368] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13.
I20260709 13:05:25.495687 18338 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.496987 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.497385 17993 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.497965 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:25.500244 18346 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:25.500644 18338 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:25.513451 13233 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:25.493443 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:25.519502 12544 raft_consensus.cc:2376] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13. Re-sending same reply.
W20260709 13:05:25.522826 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:25.523566 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.505524 12510 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:42446 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3325)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1912)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1907)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1906)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 1256)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3332)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1929)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3339)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1931)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1915)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1933)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1926)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1932)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1917)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3318)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 1258)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 1257)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1934)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1922)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1908)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1910)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1935)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1936)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1930)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1914)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 1259)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1938)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3333)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1940)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3330)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1918)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 1909)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 1260)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3320)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3321)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3322)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3324)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3327)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3328)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3338)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1905)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1916)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1919)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1920)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1924)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1925)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1927)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1255)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1937)
I20260709 13:05:25.518383 12513 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:25.534704 17993 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:25.537760 18197 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:25.538723 18197 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:25.506089 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.552043 18362 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:25.552639 18362 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.553792 13229 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:25.554823 18362 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:25.557186 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:25.557848 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:25.558705 18336 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:25.561335 12513 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:25.562668 18178 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:25.562870 18124 raft_consensus.cc:3055] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:25.547489 18384 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:25.563426 18124 raft_consensus.cc:740] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:25.563619 18384 raft_consensus.cc:697] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:25.564713 13229 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:05:25.564440 18124 consensus_queue.cc:260] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:25.532022 18369 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.225s	user 0.001s	sys 0.001s
I20260709 13:05:25.563452 18178 raft_consensus.cc:697] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:05:25.543497 17960 consensus_meta.cc:287] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.547s	user 0.010s	sys 0.002s
I20260709 13:05:25.566893 17960 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.567097 18178 consensus_queue.cc:237] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.569242 17960 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:25.569926 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.570063 12543 raft_consensus.cc:2368] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11.
W20260709 13:05:25.572037 18367 log.cc:927] Time spent T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.295s	user 0.001s	sys 0.001s
I20260709 13:05:25.564594 18384 consensus_queue.cc:237] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.549417 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:25.579228 12540 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:25.586804 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:25.589258 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:25.591240 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:25.592566 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:25.594316 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:25.596629 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:25.591984 12547 raft_consensus.cc:2376] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12. Re-sending same reply.
I20260709 13:05:25.597750 12613 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 14: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:25.598315 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.598956 12547 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:05:25.601696 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.602846 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:25.606985 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:25.610821 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:25.617509 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:25.618854 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:25.620958 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:25.622754 18197 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:25.586252 18124 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:25.624334 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:25.625046 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.636677 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.638794 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:25.640237 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:25.640477 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:05:25.641404 12662 connection.cc:256] RPC call timeout handler was delayed by -1.3490182169999798s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23260000000000003s for a response
I20260709 13:05:25.641528 13233 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:25.636972 12540 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:25.575943 18254 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.653733 18358 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.613701 17960 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.656344 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 1015) took 1272 ms. Trace:
I20260709 13:05:25.656661 18358 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:25.644544 18303 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.656900 17960 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.644354 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.663993 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48978 (request call id 37) took 1065 ms. Trace:
I20260709 13:05:25.685124 12547 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:05:25.685477 13231 rpcz_store.cc:276] 0709 13:05:24.630022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.672625 (+ 42603us) service_pool.cc:224] Handling call
0709 13:05:25.663832 (+991207us) spinlock_profiling.cc:243] Waited 66 ms on lock 0x7b54006cd4d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9573853 00007fc3ae54160a 00007fc3a7ac77d4 00007fc3a7ac7762 00007fc3a7ac7691 00007fc3a7ac760c 00007fc3a7ac68c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:25.663937 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":151830912}
I20260709 13:05:25.686106 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.644567 12588 leader_election.cc:400] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16.
I20260709 13:05:25.688841 12588 leader_election.cc:403] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:05:25.644564 12614 raft_consensus.cc:1275] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:05:25.650913 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3630) took 1170 ms. Trace:
W20260709 13:05:25.690609 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 46250.9us
I20260709 13:05:25.670449 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:25.692536 13232 raft_consensus.cc:2368] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18.
I20260709 13:05:25.692672 13233 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:25.690848 12621 rpcz_store.cc:276] 0709 13:05:24.481267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.481618 (+   351us) service_pool.cc:224] Handling call
0709 13:05:24.481920 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:24.680975 (+199055us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:24.681522 (+   547us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:24.716427 (+ 34905us) log.cc:844] Serialized 26 byte log entry
0709 13:05:25.041680 (+325253us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:25.041736 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.041828 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:25.571469 (+529641us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:25.650524 (+ 79055us) raft_consensus.cc:1685] finished
0709 13:05:25.650556 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:25.650837 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37156,"raft.queue_time_us":361724,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":7344,"spinlock_wait_cycles":39348480,"thread_start_us":350036,"threads_started":2,"wal-append.queue_time_us":366301}
I20260709 13:05:25.673843 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1240) took 1987 ms. Trace:
I20260709 13:05:25.686791 12547 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:05:25.662113 13226 rpcz_store.cc:276] 0709 13:05:24.383605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.384294 (+   689us) service_pool.cc:224] Handling call
0709 13:05:24.386512 (+  2218us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:25.355929 (+969417us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.656065 (+300136us) spinlock_profiling.cc:243] Waited 969 ms on lock 0x7b5400597254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:25.656276 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2227561216}
I20260709 13:05:25.684587 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:25.679955 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:25.683112 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.701651 12539 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:25.702934 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:25.703779 12539 raft_consensus.cc:2376] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16. Re-sending same reply.
I20260709 13:05:25.705021 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:25.706743 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:25.710860 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:25.711788 12613 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:25.713008 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:25.693518 12542 rpcz_store.cc:276] 0709 13:05:23.686113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.701346 (+ 15233us) service_pool.cc:224] Handling call
0709 13:05:24.369195 (+667849us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:24.398812 (+ 29617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:24.398862 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:24.399508 (+   646us) log.cc:844] Serialized 26 byte log entry
0709 13:05:24.610050 (+210542us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:24.970073 (+360023us) log.cc:844] Serialized 14 byte log entry
0709 13:05:24.975110 (+  5037us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.975212 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:25.185995 (+210783us) raft_consensus.cc:1685] finished
0709 13:05:25.186016 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:25.673635 (+487619us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b5400410d50. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:25.673784 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33867,"prepare.queue_time_us":472426,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":35227,"raft.run_cpu_time_us":415,"raft.run_wall_time_us":19004,"spinlock_wait_cycles":1444869888,"thread_start_us":450622,"threads_started":2,"wal-append.queue_time_us":464154}
I20260709 13:05:25.718014 12539 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 14: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:25.718977 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3318) took 1118 ms. Trace:
I20260709 13:05:25.719445 12539 rpcz_store.cc:276] 0709 13:05:24.600078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.704704 (+1104626us) service_pool.cc:224] Handling call
0709 13:05:25.718905 (+ 14201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:25.658106 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:25.696537 18354 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.032s	sys 0.069s
I20260709 13:05:25.683173 18283 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 12. Current term is 13.
W20260709 13:05:25.723728 18354 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.032s	sys 0.069s
I20260709 13:05:25.739327 18283 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:25.740144 18283 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.724747 18337 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.757478 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:25.759490 12615 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:25.761444 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:25.761893 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:25.762265 13226 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:25.684799 17960 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:25.764031 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:25.767334 13229 raft_consensus.cc:2393] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 11: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:25.767524 12540 raft_consensus.cc:2376] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14. Re-sending same reply.
I20260709 13:05:25.742136 18278 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16.
I20260709 13:05:25.769150 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.664705 18358 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:25.742504 18130 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:25.777637 12588 leader_election.cc:336] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.826s (SENT)
I20260709 13:05:25.779543 12588 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:25.783371 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.784323 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:25.789892 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:25.789610 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:25.790813 12588 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:25.792248 12615 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:25.745692 18354 consensus_queue.cc:1059] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:05:25.792642 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:25.802486 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1249) took 1334 ms. Trace:
I20260709 13:05:25.803133 12538 rpcz_store.cc:276] 0709 13:05:24.467834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.471660 (+  3826us) service_pool.cc:224] Handling call
0709 13:05:24.471994 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:25.364544 (+892550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.802102 (+437558us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b54003bddd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:25.802391 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2051074432}
I20260709 13:05:25.805470 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:25.678428 18303 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.805491 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:25.745337 18385 consensus_queue.cc:1059] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:05:25.808596 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.814280 12540 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:25.808728 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:25.809118 12588 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:25.829406 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.831146 12542 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 16: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:05:25.834252 12588 leader_election.cc:336] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.873s (SENT)
I20260709 13:05:25.834785 12588 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:25.794551 18278 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:25.769414 18310 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.796979 18358 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:25.835807 17964 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.844758 18283 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:25.844600 17964 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.847167 17964 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:25.848446 17768 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:25.850687 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3312) took 1267 ms. Trace:
I20260709 13:05:25.851287 12546 rpcz_store.cc:276] 0709 13:05:24.583439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.594106 (+ 10667us) service_pool.cc:224] Handling call
0709 13:05:24.594381 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:24.817005 (+222624us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.850321 (+1033316us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54002b9654. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:25.850610 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383702912}
I20260709 13:05:25.837620 18354 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:25.854127 18354 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:25.853257 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.855310 12546 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:25.856613 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.841709 17936 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:25.842901 18296 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:25.858868 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.859786 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:25.860020 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.860495 12542 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 16: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:25.861053 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.861217 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.861785 12542 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
W20260709 13:05:25.862455 18352 consensus_meta.cc:287] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.602s	user 0.012s	sys 0.000s
I20260709 13:05:25.862617 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:25.862879 18352 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.863897 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.864605 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3330) took 1224 ms. Trace:
I20260709 13:05:25.854691 18354 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:25.857950 17936 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:25.872234 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:25.793742 18130 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:25.881459 12543 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:25.883526 18130 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:25.880364 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:25.864910 18387 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.398s	user 0.000s	sys 0.004s
I20260709 13:05:25.886407 12546 raft_consensus.cc:2368] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16.
I20260709 13:05:25.887243 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.888434 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.874645 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:25.873452 17936 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:25.890414 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3320) took 1284 ms. Trace:
I20260709 13:05:25.891022 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:05:25.875353 18344 log.cc:927] Time spent T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 1.166s	user 0.000s	sys 0.003s
I20260709 13:05:25.880662 13226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:25.894456 13226 raft_consensus.cc:606] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:25.865357 18352 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:25.871498 17768 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:25.885645 18319 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.895993 17768 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.896385 18319 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.897591 18303 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:25.898197 18254 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:25.898662 18319 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:25.898768 18254 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:25.876230 18348 log.cc:927] Time spent T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.871s	user 0.004s	sys 0.000s
I20260709 13:05:25.875322 13228 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:25.900820 12544 raft_consensus.cc:2393] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 18: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:25.901518 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1250) took 1433 ms. Trace:
I20260709 13:05:25.901762 12621 raft_consensus.cc:2368] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18.
I20260709 13:05:25.902172 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:25.903017 12692 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:25.901917 12541 rpcz_store.cc:276] 0709 13:05:24.468103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.478565 (+ 10462us) service_pool.cc:224] Handling call
0709 13:05:24.478880 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:24.479206 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:24.479234 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:24.479676 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 13:05:24.653145 (+173469us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:24.653190 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.653266 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:25.875637 (+1222371us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:25.901239 (+ 25602us) raft_consensus.cc:1685] finished
0709 13:05:25.901261 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:25.901462 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7115,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":23772544,"thread_start_us":173099,"threads_started":1,"wal-append.queue_time_us":476307}
I20260709 13:05:25.894809 13226 raft_consensus.cc:614] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:25.865687 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:25.810807 18272 raft_consensus.cc:3055] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:25.906555 18272 raft_consensus.cc:740] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:25.907531 18272 consensus_queue.cc:260] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.908349 17768 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:25.908798 18272 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:25.909010 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3324) took 1284 ms. Trace:
I20260709 13:05:25.909444 12547 rpcz_store.cc:276] 0709 13:05:24.624931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.908168 (+1283237us) service_pool.cc:224] Handling call
0709 13:05:25.908475 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:25.908689 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:25.908724 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:25.908775 (+    51us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:25.908809 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.908866 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:25.908960 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:25.904732 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:25.864903 12542 rpcz_store.cc:276] 0709 13:05:24.639880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.863662 (+1223782us) service_pool.cc:224] Handling call
0709 13:05:25.864555 (+   893us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:25.910923 12547 raft_consensus.cc:1275] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:25.907552 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:25.911626 12542 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:25.895220 18337 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:25.912261 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3328) took 1286 ms. Trace:
I20260709 13:05:25.912673 12542 rpcz_store.cc:276] 0709 13:05:24.626165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.911085 (+1284920us) service_pool.cc:224] Handling call
0709 13:05:25.911352 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:25.912020 (+   668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.912209 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:25.913909 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1385) took 1540 ms. Trace:
I20260709 13:05:25.856810 18310 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:25.914283 13230 rpcz_store.cc:276] 0709 13:05:24.373344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.383422 (+ 10078us) service_pool.cc:224] Handling call
0709 13:05:24.386448 (+  3026us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:25.198113 (+811665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.913707 (+715594us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b5400576cd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:25.913854 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1864505216}
I20260709 13:05:25.899328 18254 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.912890 18229 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:25.916643 18254 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:25.916932 18229 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.905815 12540 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:25.917889 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3333) took 1239 ms. Trace:
I20260709 13:05:25.918210 12540 rpcz_store.cc:276] 0709 13:05:24.678904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.860824 (+1181920us) service_pool.cc:224] Handling call
0709 13:05:25.917835 (+ 57011us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:25.919042 18229 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:25.905985 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:25.919448 12540 raft_consensus.cc:1275] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:05:25.888245 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3637) took 1302 ms. Trace:
I20260709 13:05:25.920673 12540 raft_consensus.cc:1275] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:25.880143 18354 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:25.872927 12613 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:25.928052 18198 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:25.928628 13227 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:05:25.930356 18354 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:25.921334 17936 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:25.932744 12540 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:05:25.933809 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:25.934451 12540 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:25.935295 18167 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.935885 18167 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:25.938231 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:25.938838 12695 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:25.940325 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:25.941004 12691 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:25.942267 17908 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:25.942492 17936 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:25.944574 13200 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:25.946112 13200 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:25.947508 18254 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:25.948285 18011 consensus_queue.cc:1059] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:25.920146 12619 rpcz_store.cc:276] 0709 13:05:24.586297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.628396 (+ 42099us) service_pool.cc:224] Handling call
0709 13:05:24.659410 (+ 31014us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:24.966756 (+307346us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:05:25.296608 (+329852us) log.cc:844] Serialized 14 byte log entry
0709 13:05:25.433869 (+137261us) log.cc:844] Serialized 14 byte log entry
0709 13:05:25.434763 (+   894us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:25.440517 (+  5754us) log.cc:844] Serialized 26 byte log entry
0709 13:05:25.440711 (+   194us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:25.440761 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.440854 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:25.651052 (+210198us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b18003fd240. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c522 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
0709 13:05:25.864004 (+212952us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:25.888022 (+ 24018us) raft_consensus.cc:1685] finished
0709 13:05:25.888047 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:25.888186 (+   139us) inbound_call.cc:177] Queueing success response
0709 13:05:25.894008 (+  5822us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b18003fd240. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c557 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
Metrics: {"mutex_wait_us":562,"prepare.queue_time_us":41080,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":2284,"raft.queue_time_us":270835,"raft.run_cpu_time_us":455,"raft.run_wall_time_us":21965,"spinlock_wait_cycles":41648640,"thread_start_us":694852,"threads_started":3,"wal-append.queue_time_us":153668}
I20260709 13:05:25.951536 18254 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:25.935317 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:25.955067 12588 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:25.968235 12614 raft_consensus.cc:3055] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:25.968742 12614 raft_consensus.cc:740] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:25.969210 12588 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:25.955260 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3325) took 1330 ms. Trace:
I20260709 13:05:25.970340 12544 rpcz_store.cc:276] 0709 13:05:24.625227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.679650 (+1054423us) service_pool.cc:224] Handling call
0709 13:05:25.955026 (+275376us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b5400068bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:25.955188 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":458992512}
I20260709 13:05:25.971952 17936 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:25.971314 12588 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:25.973505 12544 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:25.911450 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3327) took 1285 ms. Trace:
I20260709 13:05:25.957194 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:25.957780 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:25.912856 18141 raft_consensus.cc:3055] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:25.983369 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:25.956032 12540 raft_consensus.cc:2393] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 11: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:25.959374 18167 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:25.962143 12513 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:25.984244 12618 raft_consensus.cc:2393] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 18: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:25.958631 12621 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:05:25.962854 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:25.973809 13200 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:25.966287 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:25.967051 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:25.964807 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:25.895787 12543 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
W20260709 13:05:25.987913 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 345463us
I20260709 13:05:25.988173 12616 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 13: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:25.976639 12588 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:25.982280 12613 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:05:25.981976 12547 rpcz_store.cc:276] 0709 13:05:24.625882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.910381 (+1284499us) service_pool.cc:224] Handling call
0709 13:05:25.910651 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:25.911253 (+   602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.911404 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:25.979328 12510 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:25.975286 12617 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:05:25.986263 12622 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:25.991974 12617 pending_rounds.cc:85] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 11
I20260709 13:05:25.992465 12617 pending_rounds.cc:107] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:05:25.992794 12617 raft_consensus.cc:2889] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:25.986420 13235 raft_consensus.cc:606] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:25.994150 13235 raft_consensus.cc:614] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:25.991267 12547 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:25.995481 12540 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:25.990804 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:25.997818 12662 connection.cc:256] RPC call timeout handler was delayed by -1.257815702999892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
W20260709 13:05:25.998378 12662 connection.cc:256] RPC call timeout handler was delayed by -1.144415702999936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21080000000000002s for a response
I20260709 13:05:25.969780 12614 consensus_queue.cc:260] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:25.999771 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:26.012272 12540 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:05:26.015177 12540 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:26.016386 12547 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:05:26.018143 12614 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:26.018546 12510 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:26.020120 12544 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:26.020738 12510 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:25.890793 12546 rpcz_store.cc:276] 0709 13:05:24.606220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.889695 (+1283475us) service_pool.cc:224] Handling call
0709 13:05:25.889949 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:25.890097 (+   148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:25.890123 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:25.890170 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:25.890207 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.890261 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:25.890363 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:26.024061 12691 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:05:26.026587 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:26.030283 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:26.031142 12617 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:25.970360 18279 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:26.032980 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:25.977154 18311 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:26.048329 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:26.050244 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.044674 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:26.067625 12691 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 13: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:26.052757 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:26.069769 12616 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:25.984601 18141 raft_consensus.cc:740] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:26.003098 18272 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:25.997409 18337 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:26.064222 12510 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:26.065503 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:26.046243 12618 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:05:25.998226 18302 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:25.988225 17936 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:26.089075 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:26.094574 13235 raft_consensus.cc:606] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:26.094854 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 65459.5us
I20260709 13:05:26.099189 13197 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:26.099334 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:26.033785 18130 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:26.102385 12510 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:26.102902 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:26.033511 18198 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:26.100194 12618 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:05:26.106918 13234 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:26.101007 18199 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:26.107740 18199 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:26.096539 18337 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.108538 18337 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:26.109009 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:26.101233 18303 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:26.109846 18303 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:26.111992 18303 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:26.112540 18303 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:26.112744 18120 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:26.113147 18303 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:26.090306 18167 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:26.103431 18011 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:05:26.034977 18122 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:26.101545 17993 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:26.124167 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:26.056469 18254 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:26.132823 12622 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:05:26.133375 12510 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:26.122354 18279 raft_consensus.cc:697] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:26.094534 18339 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
W20260709 13:05:26.137748 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.113166 18120 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:26.033341 18282 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 13:05:26.145179 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:26.035477 18229 consensus_queue.cc:1048] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:05:26.146131 18272 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:26.149840 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:26.115600 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 404379us
I20260709 13:05:26.115403 18198 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:26.176800 18198 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:26.155376 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.164372 12695 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 17: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:26.145223 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:26.173607 12616 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:26.183238 12696 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:26.166762 12614 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:05:26.170059 12510 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:26.171291 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:26.154492 17768 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.189291 12510 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:26.155747 17575 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:26.163655 18319 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:26.163883 18120 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:26.199177 12510 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:26.206981 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.208101 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:26.210086 12510 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:26.213791 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:26.214051 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:26.214960 12614 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:26.213121 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:26.149109 17993 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:26.135735 18303 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:26.217682 12539 raft_consensus.cc:1240] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:26.216388 13231 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:05:26.219805 12510 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:26.150877 18254 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:26.269593 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 49907.6us
I20260709 13:05:26.271034 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:26.194636 18385 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:26.271855 12540 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:26.197515 18122 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:26.273176 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:26.278090 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:26.306445 12614 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:26.298499 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:05:26.294787 18317 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.032s	sys 0.063s
I20260709 13:05:26.302906 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:26.313506 12540 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:26.314699 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:26.185662 18272 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:26.304159 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:26.307824 12695 raft_consensus.cc:2393] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 18: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:26.316363 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:05:26.301337 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.317373 13231 raft_consensus.cc:2393] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 18: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:05:26.311523 18317 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.032s	sys 0.064s
I20260709 13:05:26.310487 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:26.306473 12547 raft_consensus.cc:2410] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:05:26.322952 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:26.323738 18317 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:26.213058 18167 consensus_queue.cc:1048] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 13:05:26.304368 18178 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:26.315454 12540 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:26.332643 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:26.324035 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:26.334759 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:26.335649 12547 raft_consensus.cc:2393] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 15: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:26.327574 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:26.323987 18199 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:26.330420 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:26.305156 18354 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:26.338238 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:26.340348 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3321) took 1733 ms. Trace:
I20260709 13:05:26.308566 18400 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:26.345420 12544 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:26.344575 12541 rpcz_store.cc:276] 0709 13:05:24.606538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.903750 (+1297212us) service_pool.cc:224] Handling call
0709 13:05:25.904017 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:25.904209 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:25.909779 (+  5570us) log.cc:844] Serialized 14 byte log entry
0709 13:05:26.340028 (+430249us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:26.340090 (+    62us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:26.340131 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:26.340194 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:26.340297 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7242,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"thread_start_us":429926,"threads_started":1}
I20260709 13:05:26.346015 12689 raft_consensus.cc:3055] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:26.346457 12689 raft_consensus.cc:740] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:26.206492 17768 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:26.329425 18122 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:26.324225 18317 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:26.339964 18395 log.cc:927] Time spent T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.307s	user 0.000s	sys 0.001s
I20260709 13:05:26.218012 18319 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:26.382956 13199 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:26.383477 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:26.385761 12588 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:26.348479 12689 consensus_queue.cc:260] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:26.402577 12689 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:26.404423 13199 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:26.342885 18282 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:26.410388 12693 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:05:26.277033 18279 consensus_queue.cc:237] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:26.383001 18400 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:26.415526 17908 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:26.339371 17936 consensus_queue.cc:1059] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 13:05:26.396253 18317 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:26.436000 12587 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:26.396806 18302 raft_consensus.cc:697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:26.448848 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:26.453933 12692 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:26.396490 18199 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:26.380641 18122 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:26.419705 18389 log.cc:927] Time spent T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 13:05:26.470328 17993 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:26.471302 18402 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:26.473070 18303 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:26.448319 18339 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:05:26.474222 18399 log.cc:927] Time spent T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
W20260709 13:05:26.476233 18401 log.cc:927] Time spent T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:05:26.483340 13231 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:05:26.484540 13227 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:05:26.496497 18337 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:26.501703 18414 consensus_queue.cc:1048] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:05:26.543890 18403 log.cc:927] Time spent T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.052s	user 0.001s	sys 0.001s
I20260709 13:05:26.506517 18283 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:26.509371 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 1920) took 1452 ms. Trace:
I20260709 13:05:26.571532 12539 rpcz_store.cc:276] 0709 13:05:25.057143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.939907 (+882764us) service_pool.cc:224] Handling call
0709 13:05:25.940250 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:26.269105 (+328855us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:26.509107 (+240002us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b5400069ad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:26.509298 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":637488512}
I20260709 13:05:26.512121 13229 raft_consensus.cc:1240] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:05:26.513592 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:05:26.527992 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 92067.3us
I20260709 13:05:26.584758 17768 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:26.587993 18319 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:26.592628 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3316) took 2008 ms. Trace:
I20260709 13:05:26.456996 18366 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:26.549665 18352 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:26.545099 12689 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:26.538218 18122 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:26.543687 18405 log.cc:927] Time spent T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:05:26.502131 18317 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:26.553725 18407 log.cc:927] Time spent T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:05:26.593132 12545 rpcz_store.cc:276] 0709 13:05:24.584359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.598480 (+ 14121us) service_pool.cc:224] Handling call
0709 13:05:24.598734 (+   254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:24.599033 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:24.599060 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:24.604210 (+  5150us) log.cc:844] Serialized 26 byte log entry
0709 13:05:25.672286 (+1068076us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b18004ab180. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:05:25.976884 (+304598us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:25.976940 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.977048 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:26.592196 (+615148us) raft_consensus.cc:1685] finished
0709 13:05:26.592217 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:26.592456 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":439,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":12909312,"thread_start_us":304381,"threads_started":1,"wal-append.queue_time_us":1581570}
I20260709 13:05:26.600039 13228 raft_consensus.cc:2368] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16.
I20260709 13:05:26.351387 18354 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:26.575665 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:26.585219 18414 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:26.557008 18339 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.595925 12587 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:26.620214 12587 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:26.548101 17908 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:05:26.599272 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 423376us
I20260709 13:05:26.622310 12587 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:26.604347 18366 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:26.569389 18303 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:05:26.565321 18402 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:26.633731 18352 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:26.624651 18339 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:26.672279 12538 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.011s	sys 0.028s
W20260709 13:05:26.715504 12538 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.011s	sys 0.028s
W20260709 13:05:26.710640 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.656353 18366 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:26.726230 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 382284us
I20260709 13:05:26.728910 13197 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:26.736883 13197 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:26.742362 13197 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:26.644647 17908 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:26.645170 18198 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:26.719786 18352 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.718649 18272 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:26.717373 18130 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:26.634541 18414 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:26.721215 18278 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:26.801327 12545 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:05:26.806417 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 400444us
W20260709 13:05:26.814379 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 70634.4us
I20260709 13:05:26.782511 17397 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:26.819900 12544 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:26.820677 13197 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:26.633471 18302 consensus_queue.cc:237] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:26.855386 13234 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.012s	sys 0.021s
W20260709 13:05:26.856760 13234 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.013s	sys 0.021s
I20260709 13:05:26.782248 18011 consensus_queue.cc:1059] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:05:26.813624 18352 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:26.824437 18278 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.824090 18272 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:05:26.887096 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 501633us
I20260709 13:05:26.856698 18384 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:26.806155 17964 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:26.875819 18400 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:26.887918 18278 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:26.911063 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 487605us
I20260709 13:05:26.887430 18011 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:26.876713 17397 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
W20260709 13:05:26.890322 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:26.921095 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.895417 18303 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.893005 18272 raft_consensus.cc:697] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:26.909655 17768 raft_consensus.cc:3055] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:26.918186 12662 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:26.911790 18337 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:05:26.930800 12660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.014s	sys 0.011s
W20260709 13:05:26.933517 12660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.014s	sys 0.011s
W20260709 13:05:26.935071 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 279210us
I20260709 13:05:26.919687 18385 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:26.937510 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 315272us
I20260709 13:05:26.938239 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:26.938536 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:26.907773 17964 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.944108 12545 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
W20260709 13:05:26.954499 18413 log.cc:927] Time spent T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 13:05:26.954311 18272 consensus_queue.cc:237] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:26.955961 18402 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:26.956514 18408 log.cc:927] Time spent T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:05:26.960814 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3338) took 2071 ms. Trace:
I20260709 13:05:26.961346 12542 rpcz_store.cc:276] 0709 13:05:24.889890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.913911 (+1024021us) service_pool.cc:224] Handling call
0709 13:05:25.914237 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:25.914535 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:25.914563 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:26.016635 (+102072us) log.cc:844] Serialized 26 byte log entry
0709 13:05:26.420870 (+404235us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:26.925383 (+504513us) log.cc:844] Serialized 14 byte log entry
0709 13:05:26.928132 (+  2749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:26.928253 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:26.960540 (+ 32287us) raft_consensus.cc:1685] finished
0709 13:05:26.960567 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:26.960741 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5322,"raft.queue_time_us":3342,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":6358,"thread_start_us":670616,"threads_started":2,"wal-append.queue_time_us":628753}
I20260709 13:05:26.928424 17768 raft_consensus.cc:740] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:26.958184 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:26.931102 18310 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:26.927990 18317 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:26.933938 18178 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.999812 18414 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:27.002036 18437 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:05:27.002585 18409 log.cc:927] Time spent T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:05:26.961831 17964 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:26.929680 18303 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:27.002123 18410 log.cc:927] Time spent T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:05:27.009630 18254 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:27.015447 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 194833us
I20260709 13:05:27.002676 18437 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:26.993891 18337 raft_consensus.cc:3055] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:27.038305 18282 raft_consensus.cc:3055] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:27.043823 18141 consensus_queue.cc:260] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:27.051695 18130 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.056365 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:27.065129 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 140198us
I20260709 13:05:27.113407 13227 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 17: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:05:27.076280 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.082474 13197 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
W20260709 13:05:27.019484 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 196986us
I20260709 13:05:27.085171 18354 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:27.030308 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.088726 18337 raft_consensus.cc:740] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:27.004205 17908 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:26.948627 18385 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:26.993860 18428 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:27.080333 18402 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:05:27.144235 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:27.088804 18283 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
W20260709 13:05:27.088855 18415 log.cc:927] Time spent T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 13:05:27.078339 18293 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:27.098721 18426 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
W20260709 13:05:27.083235 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 145100us
I20260709 13:05:27.172698 12662 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:27.123337 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 98137.5us
I20260709 13:05:27.173997 12662 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:27.003732 18178 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:27.087006 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 148354us
I20260709 13:05:27.089040 18437 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:27.125428 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:27.181878 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:27.127671 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:27.095042 18282 raft_consensus.cc:740] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:27.128625 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:27.098477 18198 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:27.132635 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:27.139202 18428 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:27.139904 13197 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:27.118673 18141 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:27.152083 12588 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:27.124596 17397 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:27.128618 18180 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:05:27.212944 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1255) took 1922 ms. Trace:
I20260709 13:05:27.107313 17768 consensus_queue.cc:260] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:27.122074 18130 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:27.168020 18423 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.233942 18423 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:27.116007 18317 consensus_queue.cc:1175] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "66750b8bbd4c4b3a9695951d0ede3372" responder_term: 11 status { last_received { term: 8 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 10. Current term is 11. Ops: [10.9-10.9]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:05:27.118517 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 182836us
I20260709 13:05:27.171329 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:27.178195 12544 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:05:27.242812 12659 leader_election.cc:400] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18.
I20260709 13:05:27.243175 12659 leader_election.cc:403] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:05:27.179375 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3322) took 2555 ms. Trace:
I20260709 13:05:27.180408 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:27.246668 12539 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:05:27.185032 12687 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:05:27.184023 18414 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:27.188112 18279 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.191807 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:27.268460 12547 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:27.245091 12538 rpcz_store.cc:276] 0709 13:05:24.624327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.904871 (+1280544us) service_pool.cc:224] Handling call
0709 13:05:25.910744 (+  5873us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:25.911101 (+   357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:25.911129 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:25.988902 (+ 77773us) log.cc:844] Serialized 52 byte log entry
0709 13:05:26.716017 (+727115us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:26.716086 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:26.716184 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:27.179173 (+462989us) raft_consensus.cc:1685] finished
0709 13:05:27.179193 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:27.179321 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":240,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":661110,"threads_started":1,"wal-append.queue_time_us":863538}
I20260709 13:05:27.193187 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:27.129156 18253 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:05:27.208850 18421 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:05:27.196959 18120 consensus_meta.cc:287] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.927s	user 0.009s	sys 0.003s
I20260709 13:05:27.197991 18337 consensus_queue.cc:260] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:27.204840 12662 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:27.207419 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:27.208284 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 68456.8us
I20260709 13:05:27.284888 12691 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:27.166520 18385 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:27.285141 13197 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:27.286702 13197 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:05:27.286955 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 82194.4us
I20260709 13:05:27.287771 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:27.215284 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 63270.8us
I20260709 13:05:27.207020 18428 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:27.219604 18198 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:27.291265 18198 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:27.291692 18198 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:27.292486 18337 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:27.148753 18422 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:05:27.222158 18282 consensus_queue.cc:260] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:27.294421 18282 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:27.295423 18253 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:27.295912 18253 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:27.296329 18253 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:27.223153 17397 raft_consensus.cc:697] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:27.298254 17397 consensus_queue.cc:237] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:27.214674 12543 rpcz_store.cc:276] 0709 13:05:25.290615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:25.986945 (+696330us) service_pool.cc:224] Handling call
0709 13:05:25.987224 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:26.004877 (+ 17653us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:26.004920 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:26.005643 (+   723us) log.cc:844] Serialized 26 byte log entry
0709 13:05:26.388027 (+382384us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:26.827589 (+439562us) log.cc:844] Serialized 14 byte log entry
0709 13:05:26.827937 (+   348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:26.828048 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:27.212695 (+384647us) raft_consensus.cc:1685] finished
0709 13:05:27.212716 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:27.212854 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26473,"prepare.queue_time_us":548785,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":8154,"raft.queue_time_us":30158,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":12986,"thread_start_us":783210,"threads_started":2,"wal-append.queue_time_us":716107}
I20260709 13:05:27.224316 18431 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:05:27.232555 18442 log.cc:927] Time spent T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260709 13:05:27.205713 18122 consensus_meta.cc:287] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.583s	user 0.009s	sys 0.001s
I20260709 13:05:27.246318 12659 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:27.139132 12690 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:27.252148 18440 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18.
W20260709 13:05:27.252593 18339 consensus_meta.cc:287] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.525s	user 0.011s	sys 0.000s
I20260709 13:05:27.259287 17768 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:27.248986 13199 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:27.283565 12547 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:27.289235 12662 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:27.279834 18414 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:27.289940 18283 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:27.302484 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:27.301898 12619 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14. Ops: []
W20260709 13:05:27.282025 18435 log.cc:927] Time spent T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 13:05:27.313865 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 64984.1us
I20260709 13:05:27.309370 18447 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:27.311702 18430 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:27.318610 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:27.365183 12616 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:05:27.318782 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:27.307274 18421 raft_consensus.cc:697] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:27.328444 18417 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:27.330500 18448 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:27.334538 18400 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:27.336191 18184 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.284091 18279 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:27.309930 18278 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:27.322266 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 76075.8us
I20260709 13:05:27.423195 13197 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:27.312017 18366 consensus_meta.cc:287] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.519s	user 0.007s	sys 0.005s
I20260709 13:05:27.375069 13199 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:27.286818 18120 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:27.323559 18444 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:27.405172 18447 raft_consensus.cc:697] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:27.362917 18423 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:27.322011 18283 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:27.366966 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 64574.8us
I20260709 13:05:27.449016 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:27.449149 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:27.449853 12689 raft_consensus.cc:2393] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:27.405072 18272 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:27.424463 12614 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:27.313848 18339 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:27.450323 12588 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:27.413515 18417 raft_consensus.cc:697] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:27.323319 18414 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:27.476534 13227 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:27.404806 18354 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.441061 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:27.478317 12691 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:27.443121 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 68191.8us
I20260709 13:05:27.478535 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:27.443431 18463 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:27.424651 18450 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:27.444626 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:27.376488 18293 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:05:27.428280 18366 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:27.447199 18279 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:27.320935 18122 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:27.434036 12616 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:27.448226 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:27.459952 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:27.421761 18411 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:27.461920 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.516456 18411 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:27.517168 12545 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 13:05:27.518193 18455 log.cc:927] Time spent T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:05:27.518200 18122 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:27.522096 18459 log.cc:927] Time spent T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:05:27.471975 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 142313us
I20260709 13:05:27.496995 18463 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:27.526095 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:27.526338 18463 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:27.527195 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:27.528573 12662 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:27.474958 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:27.501081 12687 raft_consensus.cc:2393] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:27.530718 18411 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:27.441336 18444 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.531347 18444 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:27.505517 12588 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:27.429674 18254 consensus_queue.cc:1059] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 13:05:27.540464 18421 consensus_queue.cc:237] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:27.459641 18229 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:27.474256 18423 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:27.459352 18283 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:27.543910 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:27.543989 12588 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:27.544346 13229 raft_consensus.cc:1240] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:27.423784 18184 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:27.508126 12690 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:05:27.505218 18124 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.585952 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:27.567142 12588 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:27.566099 12691 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:27.592308 12687 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:05:27.566427 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:27.594697 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:27.606391 18462 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:27.607954 18198 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:27.557732 18279 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:27.611253 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:27.564477 18272 consensus_queue.cc:1059] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:05:27.565284 18432 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:27.566685 18254 raft_consensus.cc:3055] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:05:27.636749 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.565104 18461 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:27.590984 18229 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:05:27.604851 18352 consensus_meta.cc:287] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.707s	user 0.011s	sys 0.001s
I20260709 13:05:27.680507 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:27.681432 12695 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:27.506868 18354 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:27.638199 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:27.658636 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 160038us
I20260709 13:05:27.602150 18423 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:27.675278 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:27.683560 13200 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:27.687430 17397 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:27.687884 17397 raft_consensus.cc:697] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:27.687968 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:27.684108 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.556735 18450 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260709 13:05:27.620888 18439 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.721971 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:27.657135 18468 log.cc:927] Time spent T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:05:27.731233 12619 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:27.688709 17397 consensus_queue.cc:237] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:27.722500 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 242730us
I20260709 13:05:27.594350 18440 consensus_queue.cc:1048] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 13:05:27.748193 12688 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:05:27.643502 18432 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:27.753929 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 168770us
I20260709 13:05:27.584573 18253 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:27.594208 18444 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:27.643144 18254 raft_consensus.cc:740] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:27.604072 18124 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:27.653528 18229 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:27.757181 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
W20260709 13:05:27.711386 18424 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:05:27.776029 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:27.784260 12619 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:27.758700 18432 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:27.751366 18462 raft_consensus.cc:697] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:27.692193 18352 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:27.779084 12662 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:27.594599 18447 consensus_queue.cc:237] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:27.801395 18462 consensus_queue.cc:237] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:27.805953 18444 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:27.805817 18433 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 13:05:27.806741 18433 consensus_queue.cc:1243] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 11.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:05:27.751314 18439 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:27.808313 18477 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:27.808851 18477 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:27.809239 18477 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:27.810029 18439 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:27.812734 18278 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:27.815198 12662 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:27.788551 17964 consensus_meta.cc:287] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.704s	user 0.011s	sys 0.000s
I20260709 13:05:27.783202 18229 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:27.824077 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 79800.1us
I20260709 13:05:27.690631 18417 consensus_queue.cc:237] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:27.869143 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 114633us
I20260709 13:05:27.876626 17936 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:27.885960 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 318877us
I20260709 13:05:27.887866 12512 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:27.895466 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:27.896445 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:27.818598 18120 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:27.897765 12621 raft_consensus.cc:2393] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 13: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:27.898875 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:27.877942 18272 consensus_queue.cc:1243] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer a70479a3b4114f3581095e9890f5d653 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:05:27.918687 12512 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:27.912359 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:27.920745 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:27.920611 12512 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:27.925318 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:27.930649 18486 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.889204 18402 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:27.895052 18425 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.936231 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:27.933233 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:27.934274 12622 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:27.820655 17964 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:27.923830 18184 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:27.929324 18385 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:27.954193 12619 raft_consensus.cc:1240] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:27.954541 12621 raft_consensus.cc:1240] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:05:27.947954 12622 raft_consensus.cc:3055] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:27.929132 18310 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:27.955554 12622 raft_consensus.cc:740] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:05:27.958328 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 143208us
I20260709 13:05:27.939472 18411 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:27.949981 18425 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:27.947314 18402 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:27.947999 18486 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:27.962427 18124 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:27.991551 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:27.963868 17964 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:27.964095 18317 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:27.964313 18385 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:27.964205 18463 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:27.980355 12662 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:27.916543 17936 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:27.987756 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:27.866428 18254 consensus_queue.cc:260] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:27.993408 12619 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 10.
I20260709 13:05:27.998539 18447 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:27.946508 18490 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:27.994213 12622 consensus_queue.cc:260] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:27.993230 18184 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.013809 12510 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:28.002579 18385 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:28.012265 18447 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:28.016875 18490 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.017814 12622 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:28.020241 18366 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:28.021821 18491 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:28.024216 18425 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:28.026029 13233 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:28.029708 18484 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:28.027879 18447 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:28.030310 18481 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:28.030936 18490 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:28.032172 18486 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:28.006934 18354 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:28.035427 17936 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:28.039738 18472 log.cc:927] Time spent T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:05:28.028275 18253 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:28.040278 12622 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:05:28.028452 18184 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.046429 18477 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.076545 18439 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:28.017879 18476 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:05:28.002370 18124 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:28.059649 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:28.015079 18437 consensus_meta.cc:287] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.801s	user 0.011s	sys 0.000s
W20260709 13:05:28.060115 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 46381.7us
I20260709 13:05:28.081091 18483 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:28.083804 18463 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:28.058745 18402 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:28.086187 17768 consensus_meta.cc:287] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.773s	user 0.008s	sys 0.003s
I20260709 13:05:28.005761 18317 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:28.126077 18317 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:28.029726 18352 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:28.101444 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.053268 18283 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.128638 18283 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:28.077169 18491 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:28.130132 18303 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:28.130649 18491 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:28.131247 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:28.133337 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:28.098209 18481 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.134276 12544 raft_consensus.cc:2410] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:05:28.110430 12510 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:28.136294 18481 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:28.116007 18184 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:28.104027 18425 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:28.137632 12510 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:28.137869 18425 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.138459 18477 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:28.106393 18484 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:28.117918 18124 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.139349 18484 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:28.139823 18484 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:28.140658 18425 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:28.140805 18124 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:28.141252 18425 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:28.136447 18282 consensus_meta.cc:287] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.842s	user 0.010s	sys 0.002s
I20260709 13:05:28.138819 12510 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:28.114029 18130 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:28.116597 18483 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.172972 18310 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:28.118620 18437 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:28.174008 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:28.174714 12541 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:28.175421 18437 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:28.176385 18130 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:28.144910 18465 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.435s	user 0.004s	sys 0.000s
I20260709 13:05:28.149924 18229 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:28.150871 18499 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:28.181317 18229 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:28.182821 12510 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:28.185376 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:28.186179 12546 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:28.186321 18450 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.187006 18450 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.189076 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:28.110078 18439 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.152809 18278 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.190399 18278 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.190835 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:28.191701 18439 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:28.173240 18483 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:28.192508 18278 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:28.141346 18124 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:28.091370 18432 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.155058 18198 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:28.157364 18141 consensus_meta.cc:287] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.932s	user 0.005s	sys 0.006s
I20260709 13:05:28.194473 18302 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.194638 18450 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:28.194787 18432 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:28.156078 18414 consensus_meta.cc:287] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.589s	user 0.008s	sys 0.003s
I20260709 13:05:28.194998 18302 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.195676 18414 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:28.196636 12542 raft_consensus.cc:1275] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:05:28.197032 12542 pending_rounds.cc:85] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 8
I20260709 13:05:28.196717 18447 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.174252 12692 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
W20260709 13:05:28.151806 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.197324 12542 pending_rounds.cc:107] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 10.9
W20260709 13:05:28.158520 18428 consensus_meta.cc:287] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.868s	user 0.012s	sys 0.000s
I20260709 13:05:28.198087 18414 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:28.163704 18385 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.201277 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:28.207159 12542 raft_consensus.cc:2889] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:28.206259 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:28.202828 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:28.209118 12544 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:28.209429 12540 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:28.214993 12541 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:05:28.219949 12543 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
W20260709 13:05:28.221140 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 215038us
I20260709 13:05:28.223052 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
W20260709 13:05:28.235427 12538 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.000s	sys 0.019s
W20260709 13:05:28.243095 12538 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.000s	sys 0.020s
I20260709 13:05:28.238529 12662 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:28.199882 18130 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:28.243461 12546 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:28.246068 12662 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:28.250064 18446 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:05:28.253697 18477 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:05:28.256404 18447 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:28.239297 18432 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:28.263639 12662 leader_election.cc:400] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18.
I20260709 13:05:28.264626 12540 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:28.266471 12662 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:28.260797 18293 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:28.271400 12619 raft_consensus.cc:1275] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:05:28.272435 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:28.274225 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:28.274874 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:28.296829 12622 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:28.297950 12588 leader_election.cc:400] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16.
I20260709 13:05:28.298416 12588 leader_election.cc:403] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:28.246349 18414 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:28.229048 18428 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.367791 12622 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:28.247838 18499 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:05:28.362047 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 64309.2us
I20260709 13:05:28.366564 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:28.380272 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:28.382640 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:28.387660 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:28.388546 12616 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:28.389420 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:28.390587 12615 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:28.391268 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:28.391965 12618 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:28.397316 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:28.399287 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:28.399916 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:28.400717 18229 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:28.400563 18497 consensus_queue.cc:1059] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:05:28.401278 18229 raft_consensus.cc:697] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:28.401616 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:28.401914 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:28.402271 13228 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
I20260709 13:05:28.404109 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:28.406214 12540 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:28.268839 18432 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:28.448061 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:28.417253 12621 raft_consensus.cc:2410] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 12 because replica has last-logged OpId of term: 10 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 11.
I20260709 13:05:28.277495 18437 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:28.445113 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:28.451579 13227 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:05:28.451937 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:28.446072 17397 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.384187 18198 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16.
I20260709 13:05:28.447265 12616 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:28.447512 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:28.448836 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:28.449256 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:28.383919 18130 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:28.449954 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:28.450699 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:28.451052 12695 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:28.478044 12690 pending_rounds.cc:85] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 7
I20260709 13:05:28.478542 12690 pending_rounds.cc:107] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:05:28.454012 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:28.478971 12690 raft_consensus.cc:2889] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:28.378726 18141 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:28.480309 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:28.456096 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:28.481457 12691 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:28.453446 17397 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.479524 12618 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:05:28.481890 12689 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:28.483188 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:28.481886 12696 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:28.483911 13227 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:28.489464 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:28.449993 18432 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:28.489786 13197 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:28.520423 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:28.534210 12696 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:05:28.535884 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 46159.4us
I20260709 13:05:28.532645 18253 consensus_queue.cc:1048] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:05:28.538592 18385 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:28.539137 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:28.539894 13227 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 17: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:28.540313 18474 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.157s
I20260709 13:05:28.540725 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:28.542248 13231 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 10. Current term is 11. Ops: [10.12-10.12]
W20260709 13:05:28.532902 18454 log.cc:927] Time spent T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:05:28.548913 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:28.456429 18502 consensus_queue.cc:1059] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.107s
I20260709 13:05:28.553263 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:28.556665 18499 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:28.556944 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:28.558023 13232 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 16: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:05:28.559639 18479 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.748s	user 0.003s	sys 0.003s
I20260709 13:05:28.478605 18178 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:28.563481 18180 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:28.564167 18180 raft_consensus.cc:697] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:05:28.565805 18473 log.cc:927] Time spent T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1: Append to log took a long time: real 0.772s	user 0.001s	sys 0.002s
I20260709 13:05:28.572199 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:28.567818 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:28.572283 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:28.583498 12542 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:28.583501 12540 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:28.575455 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:28.580175 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1280) took 1273 ms. Trace:
I20260709 13:05:28.585809 13200 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:28.585090 12538 rpcz_store.cc:276] 0709 13:05:27.306280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.368161 (+ 61881us) service_pool.cc:224] Handling call
0709 13:05:27.368558 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:27.369012 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:27.369051 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:27.409819 (+ 40768us) log.cc:844] Serialized 26 byte log entry
0709 13:05:27.560760 (+150941us) spinlock_profiling.cc:243] Waited 9.28 ms on lock 0x7b18004818a0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:05:28.244398 (+683638us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:28.247313 (+  2915us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:28.247585 (+   272us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:28.579890 (+332305us) raft_consensus.cc:1685] finished
0709 13:05:28.579910 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:28.580115 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3265,"raft.queue_time_us":7789,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":10276,"spinlock_wait_cycles":21337856,"thread_start_us":683451,"threads_started":1,"wal-append.queue_time_us":1078374}
I20260709 13:05:28.587409 13227 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:05:28.589128 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:05:28.590077 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.589160 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:28.590394 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:28.590847 13228 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:28.592733 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:28.557320 18499 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:28.595144 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:28.596305 13227 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 19: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:28.597312 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:28.598191 13228 raft_consensus.cc:2368] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18.
I20260709 13:05:28.597321 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:28.600740 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:28.447151 18484 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.603089 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:28.604593 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:28.606060 13231 raft_consensus.cc:2393] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 14: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:28.608305 17397 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:28.602030 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:28.608474 12513 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:28.618474 12540 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:05:28.619307 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:28.619949 13235 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:28.620178 13200 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:28.622483 17397 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:28.622830 17397 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.488250 18141 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:28.486794 18130 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:28.623154 17397 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:28.626346 12687 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:28.626681 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 1032) took 1210 ms. Trace:
I20260709 13:05:28.604549 18178 raft_consensus.cc:3055] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:28.627317 12513 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:28.629669 13229 rpcz_store.cc:276] 0709 13:05:27.416506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.417706 (+  1200us) service_pool.cc:224] Handling call
0709 13:05:27.544172 (+126466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:27.566537 (+ 22365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:28.621662 (+1055125us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54002bfcd0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:28.626599 (+  4937us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240180096}
I20260709 13:05:28.600162 18486 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.638847 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:28.630740 13231 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:28.623425 13200 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:28.613526 18502 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.565405 18180 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.639526 13227 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:28.643385 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:28.644477 12689 raft_consensus.cc:2393] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 20: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:28.645349 13200 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:28.627452 18283 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:28.648243 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:28.628672 18124 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:05:28.656400 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.650658 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:28.658526 13235 raft_consensus.cc:2393] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 17: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:28.571650 18229 consensus_queue.cc:237] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.646636 18486 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:28.662443 18509 log.cc:927] Time spent T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:05:28.647897 18502 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:28.648101 17964 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:28.655095 18463 consensus_queue.cc:1048] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:05:28.703940 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:28.663359 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:28.705508 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:28.706423 12541 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:05:28.647828 18511 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:28.664469 18430 raft_consensus.cc:3055] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:28.667944 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:28.668192 12692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2107) took 1525 ms. Trace:
I20260709 13:05:28.668823 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:28.669641 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:28.670256 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:28.670419 18484 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:28.670935 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:28.657881 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:28.683291 12513 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:28.684850 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:28.685101 12662 leader_election.cc:400] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18.
I20260709 13:05:28.618081 18122 consensus_queue.cc:1059] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:05:28.633263 18178 raft_consensus.cc:740] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:28.682322 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:28.646442 18278 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.695667 18310 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:28.696929 18486 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:28.687918 18497 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:28.699146 18502 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:28.659003 18124 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.702463 18199 consensus_queue.cc:1059] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:28.702848 12587 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:28.706431 12691 raft_consensus.cc:2410] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:05:28.712380 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:28.840924 13197 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:28.714020 18337 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.655552 17768 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:28.648132 18317 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:28.717922 17397 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.731752 18254 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:28.759394 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.775216 18302 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:28.777182 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:28.779376 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1272) took 1601 ms. Trace:
I20260709 13:05:28.854343 12545 rpcz_store.cc:276] 0709 13:05:27.177918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.178022 (+   104us) service_pool.cc:224] Handling call
0709 13:05:27.178286 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:27.517595 (+339309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:28.779053 (+1261458us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54001ab8d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:28.779298 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":778822912}
I20260709 13:05:28.779837 18384 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.784895 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:28.856528 12543 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:28.787019 18319 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:28.864028 18319 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.801867 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:28.867393 12544 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:28.805075 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:28.868639 12546 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:28.826635 18430 raft_consensus.cc:740] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:28.806474 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:28.807865 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:28.807969 12510 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:28.814949 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:28.821986 12662 leader_election.cc:403] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:28.823333 12689 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:05:28.822261 12692 rpcz_store.cc:276] 0709 13:05:27.142477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.142740 (+   263us) service_pool.cc:224] Handling call
0709 13:05:27.161844 (+ 19104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:28.219245 (+1057401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:28.667975 (+448730us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54000c85d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:28.668137 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2327892224}
I20260709 13:05:28.866405 13197 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:28.825978 12617 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:28.688172 18339 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:28.834080 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 150887us
I20260709 13:05:28.834800 18429 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:28.835634 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:05:28.893676 18506 log.cc:927] Time spent T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.404s	user 0.000s	sys 0.001s
I20260709 13:05:28.874334 18481 consensus_queue.cc:1059] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:05:28.878489 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:28.841163 18497 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:28.894937 12687 raft_consensus.cc:2393] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:28.895432 18199 raft_consensus.cc:3055] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:28.895900 18199 raft_consensus.cc:740] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:28.895938 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:28.896519 18411 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:28.876124 18198 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:28.897212 18411 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.897718 18122 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:28.897847 18198 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.898336 18122 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:28.835515 18278 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.899468 18283 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:28.900009 18283 raft_consensus.cc:697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:28.900712 18122 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:28.847888 13232 raft_consensus.cc:1240] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 15. Ops: []
I20260709 13:05:28.852710 18337 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.897931 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:28.902076 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 94247.4us
I20260709 13:05:28.902217 18278 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:28.903072 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:28.903373 18337 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:28.903565 17397 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:28.904676 18425 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:28.905650 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:28.905915 13235 raft_consensus.cc:2368] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17.
I20260709 13:05:28.906402 12687 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 17: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:28.907266 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:28.907335 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:28.908185 12692 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 17: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:28.908732 12622 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:05:28.908969 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:28.908290 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:28.909924 18429 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:28.910311 18429 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:28.910928 18429 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:28.911005 12538 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
W20260709 13:05:28.911403 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 226464us
W20260709 13:05:28.852762 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 149984us
I20260709 13:05:28.912678 12587 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:28.913780 12542 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:28.814371 17964 raft_consensus.cc:697] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:28.917690 12692 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:28.839996 18124 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:28.896621 18497 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:28.710608 13200 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:28.935859 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 225369us
I20260709 13:05:28.936939 12662 leader_election.cc:400] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17.
I20260709 13:05:28.898407 18198 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:28.898619 17768 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.839143 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:28.942911 12695 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:05:28.944083 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:28.944772 12695 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:28.851301 18317 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.910379 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:28.862705 18384 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:28.821715 18437 consensus_queue.cc:1059] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:05:28.690579 18402 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.154s
W20260709 13:05:28.914965 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 48669.3us
I20260709 13:05:28.915581 17397 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:28.919924 13235 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:28.829536 18428 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:28.923064 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:28.957952 12692 raft_consensus.cc:2376] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13. Re-sending same reply.
I20260709 13:05:28.958557 17397 raft_consensus.cc:697] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:28.938246 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:28.940187 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:28.959641 12691 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:28.959375 17397 consensus_queue.cc:237] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.935636 18446 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:05:28.935245 18439 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:28.958169 13197 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:28.822041 18511 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.963809 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:28.953274 12689 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:28.900866 18283 consensus_queue.cc:237] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.961884 13197 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:28.954139 12687 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:28.949488 18317 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:28.959173 12694 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:28.948783 18011 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:28.935148 18502 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:05:28.967818 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:28.897042 18199 consensus_queue.cc:260] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.945724 18440 consensus_queue.cc:1059] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:05:28.963707 18439 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.966298 18484 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18.
I20260709 13:05:28.953676 18337 consensus_queue.cc:1059] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:05:28.936013 18178 consensus_queue.cc:260] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.970646 18428 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:28.974994 18339 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:28.987340 18440 raft_consensus.cc:3055] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:28.986896 18430 consensus_queue.cc:260] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.961211 18302 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 13:05:28.972836 18278 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:28.960779 18463 consensus_queue.cc:1059] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:05:29.012218 18428 raft_consensus.cc:697] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:29.013619 18428 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:29.007491 18440 raft_consensus.cc:740] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:28.984912 18439 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:29.008414 18339 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.010633 18337 raft_consensus.cc:3055] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:29.019222 18141 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:29.024036 18430 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:29.031944 18339 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:29.033775 18337 raft_consensus.cc:740] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:29.023679 18278 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:29.117954 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:29.123142 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 469098us
I20260709 13:05:29.123337 12541 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:05:28.923759 12543 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:29.064643 18440 consensus_queue.cc:260] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.923161 12587 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:28.937424 12662 leader_election.cc:403] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:05:29.133972 12614 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:05:29.141857 12688 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.005s	sys 0.010s
I20260709 13:05:29.142063 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:29.145684 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:29.152634 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:29.034464 18499 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:29.163396 18120 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.022s	sys 0.032s
W20260709 13:05:29.164275 18253 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.007s	sys 0.017s
I20260709 13:05:28.952409 17768 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.989666 17964 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:28.970340 18011 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.073809 18511 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:29.160588 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 448958us
I20260709 13:05:29.142338 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:29.171741 18414 raft_consensus.cc:3055] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:05:29.221216 12688 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.005s	sys 0.010s
I20260709 13:05:29.350636 18282 raft_consensus.cc:3055] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:29.138630 12687 raft_consensus.cc:2410] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:05:29.219811 18278 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:29.410045 18278 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:29.411244 18278 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:29.230880 18120 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.023s	sys 0.032s
W20260709 13:05:29.264786 18253 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.007s	sys 0.018s
I20260709 13:05:29.177187 18411 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:29.178071 18141 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:29.417737 18462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.022s	sys 0.035s
W20260709 13:05:29.418329 18462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.022s	sys 0.035s
I20260709 13:05:29.418183 18141 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:29.420722 12542 consensus_meta.cc:287] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.004s
W20260709 13:05:29.331851 12620 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.022s	sys 0.028s
W20260709 13:05:29.421751 12620 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.023s	sys 0.028s
W20260709 13:05:29.422672 13199 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.020s	sys 0.038s
I20260709 13:05:29.423827 18011 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:29.424347 12544 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:29.424495 18481 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.175175 18337 consensus_queue.cc:260] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:29.373052 18319 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:29.332500 18446 raft_consensus.cc:2764] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:05:29.343873 17768 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:29.347605 18199 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:29.352561 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.357067 18385 raft_consensus.cc:3055] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:29.312242 12539 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 15
W20260709 13:05:29.375356 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 203228us
I20260709 13:05:29.299365 18440 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:29.340763 18402 consensus_queue.cc:1059] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:29.369936 12617 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:05:29.173928 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:05:29.407286 18421 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.004s	sys 0.030s
I20260709 13:05:29.404633 18414 raft_consensus.cc:740] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:05:29.408247 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.414330 18384 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:29.442096 12540 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:29.421265 12542 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
W20260709 13:05:29.471432 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:29.443056 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 475996us
I20260709 13:05:29.405628 18282 raft_consensus.cc:740] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:29.423770 18141 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:29.435179 18130 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:29.448154 18499 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:29.427331 18278 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:29.467684 18385 raft_consensus.cc:740] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:05:29.489902 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:29.481994 18421 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.004s	sys 0.031s
I20260709 13:05:29.494277 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:29.495118 18414 consensus_queue.cc:260] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:29.497488 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 324006us
I20260709 13:05:29.497694 18180 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:29.498967 18446 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:29.502202 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.437227 18184 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 13:05:29.554412 12588 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:29.554792 18385 consensus_queue.cc:260] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:29.556798 18385 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:29.512493 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 556204us
I20260709 13:05:29.560642 18180 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:29.563552 18180 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:29.564101 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:29.513376 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.566256 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:29.522409 18254 consensus_meta.cc:287] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.662s	user 0.013s	sys 0.011s
I20260709 13:05:29.522277 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:05:29.524716 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 81536.8us
I20260709 13:05:29.526556 18178 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:29.530118 12617 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:29.425472 18481 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:29.545950 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 401087us
W20260709 13:05:29.583958 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 117281us
W20260709 13:05:29.593609 12693 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.005s	sys 0.004s
I20260709 13:05:29.593827 18319 consensus_queue.cc:1059] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:05:29.594316 12615 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.042s	sys 0.073s
I20260709 13:05:29.597685 18278 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:05:29.601197 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 43733.9us
I20260709 13:05:29.617131 13235 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:29.617234 12691 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
W20260709 13:05:29.603807 12621 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.010s	sys 0.001s
I20260709 13:05:29.619159 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:29.619653 18541 log.cc:927] Time spent T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:05:29.615403 12659 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:29.621085 12695 consensus_meta.cc:287] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.676s	user 0.014s	sys 0.005s
W20260709 13:05:29.646569 12615 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.043s	sys 0.073s
W20260709 13:05:29.654356 12621 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.011s	sys 0.001s
I20260709 13:05:29.667393 12695 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:05:29.677814 13197 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:29.678206 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:29.678368 18462 raft_consensus.cc:3055] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:29.679178 12542 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 16: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:29.678983 18282 consensus_queue.cc:260] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:29.680703 18282 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:29.681354 18432 consensus_meta.cc:287] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.103s	user 0.010s	sys 0.006s
I20260709 13:05:29.681973 18432 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:29.685745 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:29.687068 18446 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:29.689815 18429 consensus_meta.cc:287] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.778s	user 0.009s	sys 0.007s
I20260709 13:05:29.679275 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:29.700138 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 82912.5us
I20260709 13:05:29.687932 18446 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.741336 12539 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:29.698037 18497 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17.
I20260709 13:05:29.762327 12588 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:29.703122 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1294) took 1035 ms. Trace:
I20260709 13:05:29.700425 18319 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:29.679008 18462 raft_consensus.cc:740] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:05:29.778335 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 119913us
I20260709 13:05:29.697888 18428 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.693653 18474 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.105s
I20260709 13:05:29.789327 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1405) took 1112 ms. Trace:
I20260709 13:05:29.776664 18481 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:29.772982 18120 raft_consensus.cc:3055] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:29.696893 18423 consensus_queue.cc:1059] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.142s
I20260709 13:05:29.800297 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:29.832764 12546 raft_consensus.cc:2393] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 17: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:05:29.829931 18124 consensus_meta.cc:287] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.854s	user 0.005s	sys 0.017s
I20260709 13:05:29.834015 18124 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:29.836321 18283 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:29.836704 18124 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:29.837986 18537 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.838670 18537 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:29.841050 18450 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:29.841713 18450 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.842180 18450 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:29.842727 18462 consensus_queue.cc:260] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:29.844285 18462 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:29.846011 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:29.847628 18428 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:29.850836 13234 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:29.851097 18428 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:29.851601 17397 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.852105 17397 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:29.857702 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 252703us
I20260709 13:05:29.858737 13199 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:29.860445 13199 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:29.861377 18253 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:29.862380 18253 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:29.867750 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1455) took 1216 ms. Trace:
I20260709 13:05:29.868297 12621 rpcz_store.cc:276] 0709 13:05:28.651536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:28.654008 (+  2472us) service_pool.cc:224] Handling call
0709 13:05:28.655850 (+  1842us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:28.680852 (+ 25002us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:28.680901 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:28.789140 (+108239us) spinlock_profiling.cc:243] Waited 6.3 ms on lock 0x7b2c0004c3c8. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:05:28.789826 (+   686us) log.cc:844] Serialized 26 byte log entry
0709 13:05:29.688632 (+898806us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:29.688707 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:29.688797 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:29.867344 (+178547us) raft_consensus.cc:1685] finished
0709 13:05:29.867365 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:29.867664 (+   299us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25501,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":6035,"spinlock_wait_cycles":14491520,"thread_start_us":872901,"threads_started":1,"wal-append.queue_time_us":909267}
I20260709 13:05:29.867790 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1458) took 1160 ms. Trace:
I20260709 13:05:29.871035 12620 rpcz_store.cc:276] 0709 13:05:28.707741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:28.708394 (+   653us) service_pool.cc:224] Handling call
0709 13:05:28.708777 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:28.709051 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:05:29.422388 (+713337us) log.cc:844] Serialized 14 byte log entry
0709 13:05:29.777496 (+355108us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:29.794547 (+ 17051us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:29.867498 (+ 72951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:29.867592 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:29.867745 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":781346,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":16365,"raft.queue_time_us":80225,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":200,"thread_start_us":897236,"threads_started":2}
W20260709 13:05:29.874013 18547 log.cc:927] Time spent T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:05:29.874114 18253 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:29.875152 18439 consensus_meta.cc:287] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.844s	user 0.017s	sys 0.000s
I20260709 13:05:29.877457 18439 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:29.880420 18439 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:29.881160 18439 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:29.882313 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:29.883143 12620 raft_consensus.cc:2368] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17.
I20260709 13:05:29.883826 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:29.885278 12617 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:29.886410 12613 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14. Ops: []
W20260709 13:05:29.893766 18317 consensus_meta.cc:287] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.916s	user 0.006s	sys 0.014s
I20260709 13:05:29.894264 18317 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:29.896572 18317 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:29.903740 12539 raft_consensus.cc:2393] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 19: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:05:29.804627 18430 consensus_meta.cc:287] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.761s	user 0.016s	sys 0.002s
I20260709 13:05:29.772158 18429 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:29.771318 12540 rpcz_store.cc:276] 0709 13:05:28.667262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:28.702211 (+ 34949us) service_pool.cc:224] Handling call
0709 13:05:28.703242 (+  1031us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:29.498030 (+794788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:29.702788 (+204758us) spinlock_profiling.cc:243] Waited 686 ms on lock 0x7b54002ea9d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:29.703049 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1578408832}
W20260709 13:05:29.926110 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 121102us
I20260709 13:05:29.799388 18120 raft_consensus.cc:740] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:29.795761 12693 rpcz_store.cc:276] 0709 13:05:28.665219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:28.670061 (+  4842us) service_pool.cc:224] Handling call
0709 13:05:28.670340 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:28.690095 (+ 19755us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:28.690141 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:28.690717 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 13:05:29.671569 (+980852us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:29.717238 (+ 45669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:29.763379 (+ 46141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:29.772765 (+  9386us) raft_consensus.cc:1685] finished
0709 13:05:29.772787 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:29.777943 (+  5156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72541,"raft.queue_time_us":20368,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"thread_start_us":794392,"threads_started":1,"wal-append.queue_time_us":737671}
I20260709 13:05:29.811050 18446 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:29.841104 18537 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:29.961027 18339 consensus_meta.cc:287] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.905s	user 0.021s	sys 0.000s
W20260709 13:05:29.965371 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 105075us
I20260709 13:05:29.963915 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:29.975117 12621 raft_consensus.cc:1240] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17. Ops: []
W20260709 13:05:29.982187 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:29.985448 18198 consensus_meta.cc:287] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 1.018s	user 0.010s	sys 0.011s
W20260709 13:05:29.985946 13231 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 1398) took 1345 ms (client timeout 1530 ms). Trace:
I20260709 13:05:29.986009 18198 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:29.986521 13231 rpcz_store.cc:269] 0709 13:05:28.640161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:28.640296 (+   135us) service_pool.cc:224] Handling call
0709 13:05:29.985579 (+1345283us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b5400740254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:29.985741 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2644161280}
I20260709 13:05:29.994704 18229 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:29.994939 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:29.995709 18229 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:29.996452 18423 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.997057 18423 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:29.998052 18446 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:29.998222 18229 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:29.998623 18556 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:29.999236 18423 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:29.999311 18556 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:30.002621 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.003808 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:30.005271 12539 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:30.007604 12614 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:30.001534 18556 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:30.012125 18198 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:30.012995 13199 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:30.015545 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.015755 13199 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:30.016903 12613 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:05:30.020357 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.025462 18198 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:30.026350 18198 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:30.028726 18198 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:30.028961 18539 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.029731 18539 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:30.030102 18428 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:30.030855 18428 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:30.031744 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:30.031989 18539 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:30.033174 12544 raft_consensus.cc:1240] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 10. Current term is 11. Ops: []
I20260709 13:05:30.035090 12539 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:30.036507 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:30.038470 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:30.042523 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.038976 12695 raft_consensus.cc:1240] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:30.041183 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:30.043838 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.045089 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:30.045895 12542 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:30.046288 18448 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:05:30.047161 18448 consensus_queue.cc:1243] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 16.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:05:30.047676 18198 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.044507 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2133) took 1330 ms. Trace:
I20260709 13:05:30.048650 18198 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:30.048779 12689 rpcz_store.cc:276] 0709 13:05:28.714362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.152104 (+437742us) service_pool.cc:224] Handling call
0709 13:05:30.043512 (+891408us) spinlock_profiling.cc:243] Waited 50.6 ms on lock 0x7b5800210698. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:05:30.043771 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:30.044113 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:30.044137 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:30.044177 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:30.044215 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.044263 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:30.044357 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116482816}
I20260709 13:05:30.045339 18120 consensus_queue.cc:260] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:30.047909 18448 raft_consensus.cc:3055] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:30.040369 18481 raft_consensus.cc:3055] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:30.040102 18487 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:30.036568 12545 raft_consensus.cc:1240] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 15. Ops: []
I20260709 13:05:30.057809 12544 raft_consensus.cc:2393] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 20: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:30.051548 18198 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:30.060835 18120 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:30.060982 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:30.061501 12617 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:30.062654 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:30.063246 13233 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:30.065775 18487 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:30.068286 18487 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:30.059088 18481 raft_consensus.cc:740] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:30.070848 18481 consensus_queue.cc:260] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:30.072211 18481 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:30.077713 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.078125 18429 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:30.079397 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:30.080174 12545 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 9.
I20260709 13:05:29.983441 18339 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:30.085071 12614 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:05:30.093978 12542 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
W20260709 13:05:30.097752 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.088431 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:30.089571 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:30.081482 18385 consensus_meta.cc:287] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.000s
W20260709 13:05:30.083110 18011 consensus_meta.cc:287] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.658s	user 0.009s	sys 0.005s
I20260709 13:05:30.116111 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:30.117297 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:30.118966 12687 raft_consensus.cc:2410] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:05:30.119324 12689 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:30.124959 12692 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:05:30.125329 13233 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:30.117513 12546 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:30.126160 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3657) took 1459 ms. Trace:
I20260709 13:05:30.127352 12513 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:30.126657 12615 rpcz_store.cc:276] 0709 13:05:28.667363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:28.674258 (+  6895us) service_pool.cc:224] Handling call
0709 13:05:28.712405 (+ 38147us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:28.712611 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:29.669656 (+957045us) log.cc:844] Serialized 14 byte log entry
0709 13:05:30.116426 (+446770us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:30.125662 (+  9236us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:30.125788 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.125926 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:30.126089 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":113276,"prepare.queue_time_us":837726,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":4750,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":2989,"spinlock_wait_cycles":1408,"thread_start_us":1000308,"threads_started":2}
W20260709 13:05:30.128594 12662 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.530s (SENT) [suppressed 16 similar messages]
I20260709 13:05:30.128947 18499 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:30.129581 18499 raft_consensus.cc:697] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:30.131732 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:30.132474 13231 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:30.135664 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 1412) took 1439 ms. Trace:
I20260709 13:05:30.137055 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:30.059520 18448 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:30.144066 13235 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:30.136204 12691 rpcz_store.cc:276] 0709 13:05:28.695867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.141197 (+445330us) service_pool.cc:224] Handling call
0709 13:05:30.135438 (+994241us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54002ca954. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:30.135590 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":929036032}
I20260709 13:05:30.162842 12659 leader_election.cc:400] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17.
I20260709 13:05:30.163973 12617 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:30.088997 18450 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:30.165131 12543 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:30.163321 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:30.166582 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:30.168800 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:30.173177 12542 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:30.138821 18011 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:30.179870 12687 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 16: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:30.180255 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:30.202551 12542 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:30.205232 18450 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:30.205754 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 50055.1us
I20260709 13:05:30.206324 18448 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:30.207472 12659 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:30.207791 18448 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:30.209223 17397 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:30.211287 18339 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:30.193713 18462 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.213995 12542 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14. Ops: []
W20260709 13:05:30.215430 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 553571us
W20260709 13:05:30.220726 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.221822 13231 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:30.225098 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:30.217092 18414 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:30.217204 17908 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:30.189219 18499 consensus_queue.cc:237] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:30.217836 18462 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:30.219561 18430 consensus_queue.cc:1059] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:05:30.256035 12543 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
W20260709 13:05:30.253660 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.230499 18385 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:30.259600 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 131037us
I20260709 13:05:30.224472 18487 consensus_queue.cc:1059] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:05:30.228091 18319 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:05:30.263274 18481 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:30.306900 12588 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:30.315966 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:30.262763 17908 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:30.338263 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 135702us
I20260709 13:05:30.280481 18385 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:30.304775 18484 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:30.356896 12545 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:30.342837 18282 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:30.355060 18178 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.336519 18477 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:30.340138 18198 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:30.343063 18539 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:30.381754 18178 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:30.401582 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 117418us
I20260709 13:05:30.545091 18477 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:30.371106 18282 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.550273 18198 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:30.354733 18481 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:30.627480 18537 consensus_queue.cc:1059] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:30.628747 18432 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:30.629942 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:30.652649 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.631405 12513 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:30.632628 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.363952 18293 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.304s
W20260709 13:05:30.660825 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:30.661206 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:30.639966 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 388616us
I20260709 13:05:29.853859 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:30.666062 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:30.643965 18124 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:30.667243 13234 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 1035) took 2117 ms (client timeout 1798 ms). Trace:
I20260709 13:05:30.647538 18282 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:30.666805 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 304243us
W20260709 13:05:30.670262 13234 rpcz_store.cc:269] 0709 13:05:28.538194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:28.540442 (+  2248us) service_pool.cc:224] Handling call
0709 13:05:30.382749 (+1842307us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400630954. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:30.655675 (+272926us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2448424704}
I20260709 13:05:30.656354 18578 raft_consensus.cc:3055] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:30.677116 12539 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:30.655910 18319 raft_consensus.cc:3055] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:05:30.676221 12662 leader_election.cc:336] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.931s (SENT)
I20260709 13:05:30.652696 18430 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:30.671797 18570 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.318s	user 0.000s	sys 0.010s
W20260709 13:05:30.674283 18562 log.cc:927] Time spent T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.349s	user 0.011s	sys 0.005s
W20260709 13:05:30.684734 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 44351.6us
I20260709 13:05:30.680687 18319 raft_consensus.cc:740] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:30.686645 18339 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:30.673974 18337 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:30.688789 18448 consensus_queue.cc:1059] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:30.681317 12662 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:30.693306 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.687572 18198 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:30.677115 18578 raft_consensus.cc:740] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:05:30.708398 18567 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.300s	user 0.008s	sys 0.008s
W20260709 13:05:30.709824 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.665854 18539 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:30.735116 18462 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:30.703241 18278 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:30.680464 18124 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:30.762462 18566 log.cc:927] Time spent T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:05:30.764006 18124 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:30.764420 18444 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.765380 18477 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:30.766814 17908 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:30.771973 18539 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:30.772644 18437 raft_consensus.cc:3055] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:30.773092 18437 raft_consensus.cc:740] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:30.744956 18011 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:30.774164 18437 consensus_queue.cc:260] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:30.775636 18437 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:30.776259 18578 consensus_queue.cc:260] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:30.765043 18444 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:30.777890 18578 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:30.774559 18319 consensus_queue.cc:260] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:30.696605 18430 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:30.764323 18569 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 13:05:30.755867 18565 log.cc:927] Time spent T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.450s	user 0.000s	sys 0.004s
W20260709 13:05:30.820372 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 65987.8us
I20260709 13:05:30.735762 18339 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:30.779234 18549 log.cc:927] Time spent T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.864s	user 0.001s	sys 0.002s
W20260709 13:05:30.831849 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.752717 18385 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:30.778945 18583 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:30.837452 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:30.839823 12539 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:30.764045 18502 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.828966 18462 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:30.848850 12618 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:30.892921 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:30.893935 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:30.894263 12659 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:30.895468 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:30.896138 12616 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:30.896564 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:30.897799 12695 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:05:30.897938 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:30.898784 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 222591us
W20260709 13:05:30.900808 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.756749 18278 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:30.903478 12618 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 16 index: 16. (index mismatch)
I20260709 13:05:30.907145 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:30.907517 12622 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:30.907862 12687 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
W20260709 13:05:30.908960 18575 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
I20260709 13:05:30.851743 18583 raft_consensus.cc:697] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:30.909519 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:30.910455 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:30.852035 18502 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:30.912052 18563 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.557s	user 0.012s	sys 0.008s
I20260709 13:05:30.908973 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:30.913813 18565 log.cc:927] Time spent T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:05:30.917929 18499 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.918651 18499 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:30.929661 18484 raft_consensus.cc:3055] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:30.930341 18484 raft_consensus.cc:740] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:30.932523 12620 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:30.933286 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1296) took 1795 ms. Trace:
I20260709 13:05:30.933688 12538 rpcz_store.cc:276] 0709 13:05:29.137867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.149142 (+ 11275us) service_pool.cc:224] Handling call
0709 13:05:29.149838 (+   696us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:29.316494 (+166656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:29.316630 (+   136us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:29.364145 (+ 47515us) log.cc:844] Serialized 26 byte log entry
0709 13:05:29.779142 (+414997us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:29.779253 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:29.779374 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:30.626043 (+846669us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:30.914034 (+287991us) raft_consensus.cc:1685] finished
0709 13:05:30.914055 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:30.933093 (+ 19038us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":54634,"raft.run_cpu_time_us":558,"raft.run_wall_time_us":101685,"spinlock_wait_cycles":7018368,"thread_start_us":461186,"threads_started":2,"wal-append.queue_time_us":490688}
I20260709 13:05:30.937103 18444 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:30.946640 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:30.873741 18319 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:30.945784 18582 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:30.951736 12618 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 9.
I20260709 13:05:30.903383 18481 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:30.913740 18178 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:30.913537 18502 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:30.970841 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:30.953081 18582 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:30.931376 18484 consensus_queue.cc:260] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:30.987012 12616 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:05:30.910559 18583 consensus_queue.cc:237] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:30.990937 12618 raft_consensus.cc:1240] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:30.995816 18278 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:30.999171 18339 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:05:30.999969 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 606049us
I20260709 13:05:30.988241 18582 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:31.005685 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:31.006361 18430 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:31.006562 13234 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
W20260709 13:05:31.009743 12512 connection.cc:256] RPC call timeout handler was delayed by -1.1714621869999746s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
I20260709 13:05:30.988384 18462 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:31.010252 12512 connection.cc:256] RPC call timeout handler was delayed by -1.1223804859999973s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.167s for a response
I20260709 13:05:31.010533 18462 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.012655 18462 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:31.022053 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:31.024294 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:31.025116 12688 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:31.030527 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:31.031316 12692 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
W20260709 13:05:31.030386 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 46163.8us
I20260709 13:05:31.033281 18581 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:31.035640 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:31.036494 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:31.037292 12621 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:31.044234 12695 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:31.056062 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:31.056741 12694 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:31.058802 12689 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 17: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:31.059161 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:31.059939 13231 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
I20260709 13:05:31.061195 12696 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:31.063035 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:31.065706 12692 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:05:31.069911 17397 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.046598 18477 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.074671 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:31.070456 17397 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.056612 18502 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:31.107514 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.064378 18484 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:31.110327 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:31.058981 18585 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:31.116838 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 166354us
I20260709 13:05:31.120849 12694 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:05:31.137847 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:31.138514 12695 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:05:31.142069 12688 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
W20260709 13:05:31.154614 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 81675.5us
I20260709 13:05:31.155848 12512 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:31.156983 18124 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:31.158421 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:31.134461 12513 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:31.165751 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.067020 18590 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:31.173720 12512 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:31.110466 18385 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.111814 18587 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:31.112727 18539 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:31.175109 12696 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 16 index: 16. (index mismatch)
I20260709 13:05:31.175055 12695 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
W20260709 13:05:31.182034 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.187674 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:31.194672 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:31.122562 18477 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:31.196735 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 62396.9us
I20260709 13:05:31.179205 18124 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:31.172679 18282 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:31.208340 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 74899.4us
I20260709 13:05:31.173362 18502 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.204562 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:31.193769 18586 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:31.181671 18385 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:31.211683 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.212612 12689 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:05:31.199682 18124 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.216022 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:31.169886 18585 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:31.221285 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 54015.2us
I20260709 13:05:31.222414 12512 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:31.222945 18585 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:31.223917 12512 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:31.224753 18178 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:31.225198 18178 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:31.225631 18178 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:31.226497 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:31.227072 18282 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:31.185791 18539 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.228139 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:31.228718 12695 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
W20260709 13:05:31.229839 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.230206 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:31.229509 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:31.231324 12613 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:05:31.231568 12512 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:31.232390 18586 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:31.233868 12512 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:31.234737 18586 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:31.235464 18582 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.236513 18178 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:31.237433 12512 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:31.237890 12688 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:31.238248 18586 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:31.215975 18124 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:31.231411 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:31.223738 18585 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:31.211349 18578 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:31.189208 18587 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:31.269294 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:31.270680 12690 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:31.271935 18573 log.cc:927] Time spent T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.727s	user 0.007s	sys 0.016s
I20260709 13:05:31.263805 18487 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.269948 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:31.273378 18487 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:31.274451 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 90153.3us
I20260709 13:05:31.274618 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:31.275218 12688 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:31.276083 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:31.273432 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:31.282312 12692 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:31.279719 12690 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:31.292891 12696 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:31.293203 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:31.292943 12688 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:31.294579 18124 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.296864 18124 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:31.298278 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 60929us
I20260709 13:05:31.279160 18178 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:31.264875 18582 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:31.276888 18432 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:31.305828 12696 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:05:31.276261 18487 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:31.279484 18430 consensus_queue.cc:1059] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:05:31.280081 18437 consensus_queue.cc:1059] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:05:31.305403 18586 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.309754 18585 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:31.323973 18585 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.324386 18477 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:31.326218 18585 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:31.329052 18587 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:31.330439 18385 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:31.332089 18586 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.333178 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:31.334431 18586 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:31.310395 18178 consensus_queue.cc:1059] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:05:31.335294 18430 raft_consensus.cc:3055] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:05:31.335709 18430 raft_consensus.cc:740] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:31.335978 18178 raft_consensus.cc:3055] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:31.336383 18178 raft_consensus.cc:740] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:31.336719 12512 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:31.339134 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:31.339632 12692 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:05:31.341678 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:31.344388 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:31.344933 12621 raft_consensus.cc:2368] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 20. Current term is 21.
I20260709 13:05:31.344708 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:31.343708 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:31.345453 12616 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:31.348232 18437 raft_consensus.cc:3055] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:31.348711 18437 raft_consensus.cc:740] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:31.349582 18437 consensus_queue.cc:260] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:31.351032 18437 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:31.352938 13199 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:31.344632 18584 consensus_queue.cc:1059] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:05:31.356415 13199 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:31.356571 12690 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:31.356726 18584 raft_consensus.cc:3055] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:05:31.359829 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 43986.9us
I20260709 13:05:31.360849 12659 leader_election.cc:400] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 20. Current term is 21.
I20260709 13:05:31.361502 12659 leader_election.cc:403] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:31.356424 12512 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:31.358390 12587 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:31.344792 18385 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:31.361454 18283 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:31.366125 18283 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.366554 18283 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:31.359333 17964 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:31.369644 17964 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:31.372402 12662 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:31.372628 12512 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:31.377759 18582 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 20. Current term is 21.
I20260709 13:05:31.378806 12587 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:31.380098 12587 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:31.380316 18588 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:31.380862 18588 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.381208 18588 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:31.381450 18278 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:31.381784 18587 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:31.381985 18278 raft_consensus.cc:697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:31.382236 18587 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:31.382692 18587 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:31.382987 18278 consensus_queue.cc:237] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:31.386993 18524 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:31.387517 18524 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:31.387935 18524 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:31.371723 17964 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:31.390529 12621 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:31.391096 18539 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:31.371827 18586 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:31.357200 18584 raft_consensus.cc:740] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:31.399539 12587 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:31.359328 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:31.398787 13200 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:31.336589 18430 consensus_queue.cc:260] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:31.396561 18586 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:31.405220 18481 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.419826 12541 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 13:05:31.424193 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 60958.7us
I20260709 13:05:31.413093 18582 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:31.427551 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:31.429226 12540 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:31.417325 18586 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:05:31.429983 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 70292.8us
I20260709 13:05:31.415241 18282 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:31.360777 18178 consensus_queue.cc:260] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:31.430476 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.431083 18508 consensus_queue.cc:1059] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:05:31.431701 18588 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:31.433420 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.428718 18582 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:31.434063 12538 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:05:31.436043 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:31.418650 18481 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.444208 12541 raft_consensus.cc:2393] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 15: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:31.445083 13199 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:31.443713 18450 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:31.442802 18582 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:31.440155 18477 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.449697 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:31.457386 12540 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:31.454381 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:31.458333 12662 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:31.437192 18339 consensus_queue.cc:1059] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 13:05:31.446892 18508 raft_consensus.cc:3055] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:31.444314 18282 raft_consensus.cc:697] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:31.440281 18011 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
W20260709 13:05:31.472334 18605 log.cc:927] Time spent T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:05:31.473345 18481 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:31.475581 18011 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:31.478688 18283 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.482594 18588 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:31.484905 12695 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:31.461853 18477 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.463445 18508 raft_consensus.cc:740] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:31.486750 18508 consensus_queue.cc:260] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:31.487660 18477 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:31.487788 18508 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:31.494385 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:31.495923 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:31.496621 13235 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:31.497195 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:31.499629 13234 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:31.499753 12541 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:31.476531 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:31.502998 12538 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 10.
I20260709 13:05:31.501935 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:31.510911 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 57362.5us
I20260709 13:05:31.511353 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:31.481047 17964 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.477346 18587 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:31.508319 12544 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
W20260709 13:05:31.485471 18540 log.cc:927] Time spent T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.815s	user 0.014s	sys 0.005s
I20260709 13:05:31.521251 17397 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:31.514451 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:31.517794 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:31.542354 12662 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:31.547039 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:31.514261 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:31.514078 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:31.545454 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:31.516104 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:31.538749 12541 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:31.551339 12540 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:05:31.461706 18430 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:31.550302 12690 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
I20260709 13:05:31.554541 12694 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 17: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:31.556342 12545 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:31.542053 17397 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:05:31.558455 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 113423us
I20260709 13:05:31.559691 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:31.509393 18319 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:31.514966 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:31.560909 18579 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:31.523902 18178 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:31.568120 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:31.573205 12690 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:31.560886 13199 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:31.510870 18283 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:31.448776 18584 consensus_queue.cc:260] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.578944 18579 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.579679 18579 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.524715 18499 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:31.585701 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:31.586747 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 90501.1us
I20260709 13:05:31.586053 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:31.546118 18539 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:31.586530 12547 raft_consensus.cc:2393] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 16: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:31.588127 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:31.588411 12694 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:31.588735 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.562093 18462 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:31.591486 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:31.532546 18581 consensus_queue.cc:1059] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:05:31.592032 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:31.593904 17397 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:31.591502 12587 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:31.595223 18278 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:31.595584 18278 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.595937 18278 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:31.596486 12688 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:31.597265 18283 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:05:31.599586 17964 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:31.524145 18524 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.603120 12694 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:31.604507 12587 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:31.605674 18560 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:31.606381 18560 raft_consensus.cc:697] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:31.607416 18582 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:31.607532 18560 consensus_queue.cc:237] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:31.608767 12689 raft_consensus.cc:2393] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 10: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:31.592516 18462 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:31.610657 18462 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:31.592782 12538 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:31.591077 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 49857us
I20260709 13:05:31.594425 12543 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:31.569806 18450 raft_consensus.cc:697] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:31.589774 18319 raft_consensus.cc:697] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:31.624506 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:31.633759 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:31.624193 18385 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.638823 12544 raft_consensus.cc:2393] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 11: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:31.639143 17397 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:31.613963 18499 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.643535 17397 raft_consensus.cc:697] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:31.644218 18615 raft_consensus.cc:3055] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:31.646574 18615 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:31.646600 18319 consensus_queue.cc:237] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:31.647571 18615 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.648918 18615 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:31.647078 12662 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:31.650173 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:31.653735 12588 connection.cc:256] RPC call timeout handler was delayed by -1.3176989880000747s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
I20260709 13:05:31.654917 12543 raft_consensus.cc:2393] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 14: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:05:31.637833 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 50193.9us
I20260709 13:05:31.592722 18539 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:31.635205 18557 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:31.652899 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 92149.6us
W20260709 13:05:31.662364 12588 connection.cc:256] RPC call timeout handler was delayed by -1.1466989880000256s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17980000000000002s for a response
W20260709 13:05:31.662760 12588 connection.cc:256] RPC call timeout handler was delayed by -1.0944989880000549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
W20260709 13:05:31.663058 12588 connection.cc:256] RPC call timeout handler was delayed by -1.0674989880000112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1886s for a response
I20260709 13:05:31.663151 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:31.645548 18587 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:31.660878 13197 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:31.666249 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:31.646028 18582 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:31.666426 17397 consensus_queue.cc:237] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.670292 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:31.668622 18437 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:31.673244 12687 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:31.675251 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:31.655812 18524 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:31.677434 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:31.658190 18579 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:31.680879 13199 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:31.660395 18591 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.679836 13235 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:31.680119 18283 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:05:31.663635 18588 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.690021 18588 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.691972 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:31.687269 18437 raft_consensus.cc:697] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:31.687592 18617 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:31.684078 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:31.688786 18283 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:31.701584 18283 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.702023 18283 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:31.704814 12538 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
W20260709 13:05:31.705428 18571 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.851s	user 0.005s	sys 0.015s
I20260709 13:05:31.705067 18278 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.706838 18502 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:31.706935 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:31.707893 13231 raft_consensus.cc:2410] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:05:31.708390 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 2122) took 1595 ms. Trace:
I20260709 13:05:31.708626 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:31.709268 13234 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:31.708763 12693 rpcz_store.cc:276] 0709 13:05:30.113004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.116182 (+  3178us) service_pool.cc:224] Handling call
0709 13:05:30.161061 (+ 44879us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:30.190998 (+ 29937us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:30.191047 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:30.196400 (+  5353us) log.cc:844] Serialized 26 byte log entry
0709 13:05:30.307408 (+111008us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:30.307446 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.307513 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:31.704741 (+1397228us) spinlock_profiling.cc:243] Waited 8.66 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:31.708087 (+  3346us) raft_consensus.cc:1685] finished
0709 13:05:31.708112 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.708330 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5042,"raft.queue_time_us":14616,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":12863,"spinlock_wait_cycles":19927424,"thread_start_us":97962,"threads_started":1,"wal-append.queue_time_us":505328}
I20260709 13:05:31.692078 18588 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:31.682956 13197 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:31.642352 18385 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.651599 18499 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:31.699039 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:31.720707 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:31.675702 18450 consensus_queue.cc:237] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.721517 12541 raft_consensus.cc:2393] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 20: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:31.721711 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:31.722404 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:31.722896 18499 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:31.723004 12622 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:31.699409 18437 consensus_queue.cc:237] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:31.699671 18591 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.700378 12621 raft_consensus.cc:2393] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 14: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:31.715041 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:31.718341 13234 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:31.707718 18278 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:31.724001 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:31.643108 18282 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.725230 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:31.726028 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:31.729487 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:31.745144 12688 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:05:31.731854 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:31.746920 12541 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:31.728087 12659 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:31.736624 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:31.738129 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:31.738778 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:31.736752 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:31.750108 12693 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:31.750519 12543 raft_consensus.cc:2393] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 17: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:31.741942 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:31.752025 12538 raft_consensus.cc:2393] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 15: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:05:31.756460 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 61245.1us
I20260709 13:05:31.758229 13200 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:31.750080 12545 raft_consensus.cc:2376] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17. Re-sending same reply.
I20260709 13:05:31.759979 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:31.766063 12541 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:05:31.766570 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:31.740487 18587 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:31.775990 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:31.771762 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:31.776083 13232 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:31.673257 18557 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:31.783388 12541 raft_consensus.cc:2393] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 10: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:31.770147 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:31.778697 13235 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:31.785969 12662 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:31.788897 12694 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:31.789295 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:31.777801 12587 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:31.779831 12513 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:31.793036 12538 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:31.788921 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:31.797646 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:31.797756 12543 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:31.768955 18579 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:31.805657 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:31.799376 13200 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:31.801728 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:31.804435 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:31.802911 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:31.729316 18524 consensus_queue.cc:1059] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:05:31.803785 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:31.775938 18587 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.819531 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:31.800752 18599 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:31.820870 18599 raft_consensus.cc:697] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:31.741899 18499 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:05:31.759649 17964 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:05:31.821415 18587 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:31.760128 18339 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
W20260709 13:05:31.823576 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 140688us
I20260709 13:05:31.828637 13234 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:31.829308 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:31.829771 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:31.804634 18617 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:31.812310 18579 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.801640 18278 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:31.832146 13199 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:31.824183 18484 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:31.851358 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:31.854050 12616 raft_consensus.cc:2393] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 17: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:31.857606 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:31.841611 18448 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:05:31.864939 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.842325 18278 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.842527 18579 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:31.832754 18617 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:31.873122 18632 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:31.875077 18627 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:05:31.878051 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 78754.6us
I20260709 13:05:31.883831 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:31.887151 12616 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:31.843861 18124 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:05:31.889501 13200 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:31.892545 13200 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:31.844231 18625 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:05:31.876569 18278 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:31.897131 18624 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:31.888881 18627 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.906472 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:31.882342 18617 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:31.907521 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:31.890718 18539 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:31.918382 18591 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:31.918978 18385 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:31.939442 13226 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:31.922358 18557 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:31.924748 18579 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:31.930141 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 80836.2us
I20260709 13:05:31.947817 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:31.930135 18624 raft_consensus.cc:697] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:31.908397 18577 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:31.908957 18612 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:31.908061 18616 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:31.934598 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:31.950165 12620 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:31.936810 12693 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
W20260709 13:05:31.933987 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 101931us
I20260709 13:05:31.886204 18484 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:31.942787 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:31.956400 12616 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:31.940096 18627 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:31.962606 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:05:31.963538 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 222881us
W20260709 13:05:31.967350 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 117543us
I20260709 13:05:31.968811 12689 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 16. Current term is 17. Ops: [16.16-16.16]
I20260709 13:05:31.949754 18612 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.971478 12540 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 15. Current term is 16. Ops: []
W20260709 13:05:31.964056 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 91093.2us
I20260709 13:05:31.959082 18508 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:31.975248 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:31.976464 12544 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:05:31.979290 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:31.980751 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:31.983151 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:31.949726 18577 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:31.985888 18577 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:31.988039 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:31.958699 18484 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:31.993206 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:31.994896 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:32.001658 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:32.002776 12620 raft_consensus.cc:2410] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 12 because replica has last-logged OpId of term: 10 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 11.
I20260709 13:05:32.004093 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:32.006744 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:32.007617 12615 raft_consensus.cc:2410] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:05:32.008551 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:32.009874 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:32.010522 12619 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:32.012049 18510 raft_consensus.cc:3055] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:32.012657 18510 raft_consensus.cc:740] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:32.012104 18624 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.013890 18630 consensus_queue.cc:1059] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:05:32.020704 18608 log.cc:927] Time spent T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.458s	user 0.001s	sys 0.000s
I20260709 13:05:31.966598 13229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:32.022185 13229 raft_consensus.cc:606] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:32.022527 13229 raft_consensus.cc:614] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:32.024595 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:32.025228 12692 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:32.025595 18011 raft_consensus.cc:3055] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:32.025996 18011 raft_consensus.cc:740] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:32.026260 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:32.026964 18283 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.027786 18508 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:32.029206 18283 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:31.900774 18599 consensus_queue.cc:237] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.064128 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:32.065397 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:32.067634 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:32.032593 18586 consensus_meta.cc:287] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.000s
I20260709 13:05:31.996001 18484 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:32.072765 18586 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:32.074033 12546 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:32.074353 13228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:32.074934 13228 raft_consensus.cc:606] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:05:32.075139 18586 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:32.075278 13228 raft_consensus.cc:614] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:32.076592 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:32.078580 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:32.079278 12692 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:32.079922 18627 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.066473 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:32.081013 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:32.081737 12693 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:32.082895 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:32.083652 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:32.083914 18591 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:32.084443 13227 raft_consensus.cc:2393] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 11: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:31.989223 18612 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:32.034400 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:05:32.035883 18598 log.cc:927] Time spent T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.816s	user 0.001s	sys 0.003s
I20260709 13:05:32.035693 18510 consensus_queue.cc:260] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.017379 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:32.026862 18011 consensus_queue.cc:260] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.011415 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:32.082141 12588 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:32.055955 18278 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.056501 18508 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:32.005190 12618 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:32.058872 18587 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.026886 12613 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 9.
I20260709 13:05:32.062772 13229 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:05:32.062850 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:32.097072 13230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:32.011149 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:32.144994 13230 raft_consensus.cc:606] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:32.029464 18461 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:32.030766 18462 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:32.029156 12662 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:32.069679 18579 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:32.166913 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 137825us
I20260709 13:05:32.066412 12622 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 13:05:32.085675 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:32.170603 12622 pending_rounds.cc:85] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 11
I20260709 13:05:32.145736 13230 raft_consensus.cc:614] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:32.170826 12615 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:32.171593 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:32.170826 12662 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:32.144932 13226 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:32.151238 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:32.146867 12619 raft_consensus.cc:2393] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 14: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:32.071491 12616 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:32.178560 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:32.178169 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:32.182075 12546 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:32.181969 12545 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:32.181656 12690 raft_consensus.cc:2368] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 11. Current term is 12.
I20260709 13:05:32.114121 18584 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:32.142473 18636 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.184872 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:05:32.193441 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 111393us
I20260709 13:05:32.170900 12622 pending_rounds.cc:107] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 10.12
I20260709 13:05:32.188813 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:32.109012 18588 raft_consensus.cc:3055] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:32.191255 12541 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
W20260709 13:05:32.111332 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.194268 13231 raft_consensus.cc:2410] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 18 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:05:32.171751 18590 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:32.194576 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.148810 18627 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:32.176750 18124 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.197633 12622 raft_consensus.cc:2889] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:32.176824 18591 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:32.172103 18430 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:32.171545 18618 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.056020 18617 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.208644 18613 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.207365 18124 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:32.102320 18484 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.198314 18011 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:32.094820 18577 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.216733 18577 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:32.217667 18633 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.218279 18633 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.205297 18636 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.221141 18633 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:32.221803 18587 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:32.222510 18636 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:32.222739 18462 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:32.186069 18510 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:32.202677 12662 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:32.203625 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:32.189884 18508 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:05:32.199752 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.196650 18588 raft_consensus.cc:740] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:32.214866 18124 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:32.241724 13233 raft_consensus.cc:1240] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:32.236532 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:32.242591 12542 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:05:32.206261 18430 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.243870 13200 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:32.240914 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:32.246349 12547 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:05:32.258008 18587 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.258828 18587 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:32.255702 18633 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:32.264626 18633 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.265050 18633 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:32.268692 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 66101.4us
I20260709 13:05:32.203166 18590 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:32.209201 18613 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.230491 18591 raft_consensus.cc:697] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 13 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:32.241217 18282 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:32.271382 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:32.273311 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:32.248831 18430 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:32.300992 18633 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.310693 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:32.314538 18484 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:32.211719 18618 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.321596 12621 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:05:32.275674 18462 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:32.328902 12546 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:32.331641 12695 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:32.333343 18278 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:32.322839 18612 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.336762 12545 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:05:32.330698 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:32.371234 12662 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:32.339037 12691 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
I20260709 13:05:32.264340 18588 consensus_queue.cc:260] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:32.341751 18617 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:32.343459 18633 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:32.344115 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:32.373456 13200 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:32.375746 12547 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:32.344244 18591 consensus_queue.cc:237] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:32.351011 18622 log.cc:927] Time spent T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.530s	user 0.004s	sys 0.002s
I20260709 13:05:32.351646 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:32.356171 18627 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:05:32.358727 18319 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.007s	sys 0.011s
I20260709 13:05:32.367664 12695 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 21.
W20260709 13:05:32.376811 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 108145us
I20260709 13:05:32.376688 13200 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:32.383150 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:32.380044 18337 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:32.387792 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:32.388484 12545 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:32.378430 18432 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:32.390578 18432 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:32.390951 18432 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:32.378028 18462 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:32.385537 18319 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.008s	sys 0.011s
I20260709 13:05:32.383826 18484 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:32.398039 18337 raft_consensus.cc:697] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:32.398295 12588 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:32.423272 18337 consensus_queue.cc:237] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.423767 12588 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:32.425959 18462 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:32.427340 12588 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:32.428226 18560 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:32.428568 18560 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:32.429108 18560 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:32.402483 13232 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:32.410444 12621 raft_consensus.cc:1240] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:32.421803 18588 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:32.431380 12616 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:32.449441 12547 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:05:32.439247 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:32.443569 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:32.444900 13232 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:32.439428 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:32.429612 12588 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:32.432911 12587 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:32.470029 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:32.470738 12662 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:32.469897 13229 raft_consensus.cc:2393] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 19: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:32.473869 13228 raft_consensus.cc:2368] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20.
I20260709 13:05:32.475216 13231 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:32.437633 18124 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:05:32.477135 18651 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:32.477648 18651 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:32.398476 17964 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:32.481473 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:32.482206 12691 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:32.482419 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:32.483156 12693 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:32.483227 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:32.483901 12692 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:32.435094 18620 raft_consensus.cc:3055] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:32.484702 18620 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:32.485178 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:32.429891 18282 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:32.482424 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:32.476603 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 47094.4us
I20260709 13:05:32.493424 12693 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:05:32.493551 17964 raft_consensus.cc:697] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:32.486775 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:32.485651 18620 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.494390 12690 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:32.497172 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:32.498035 12694 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:32.496048 17964 consensus_queue.cc:237] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.489169 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:32.499730 13227 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:32.494987 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:32.478092 18651 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:32.492012 18587 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:32.493693 12588 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:32.430713 18278 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:32.409252 18557 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.494858 18282 raft_consensus.cc:697] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 15 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:32.487349 12688 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:32.501464 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:32.526883 12690 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:05:32.501056 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:32.527751 12693 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:32.527666 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:32.495769 12687 raft_consensus.cc:2376] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20. Re-sending same reply.
I20260709 13:05:32.531805 12696 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:32.511741 12694 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
W20260709 13:05:32.516093 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 47284.5us
I20260709 13:05:32.540449 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:32.428565 18462 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:32.556788 12690 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:05:32.559029 12587 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:32.563443 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:32.564303 12539 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:32.566182 12616 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:05:32.568187 18124 consensus_queue.cc:1059] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:32.569095 18124 raft_consensus.cc:3055] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:32.569427 18124 raft_consensus.cc:740] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:32.543596 12693 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:05:32.488220 18653 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:32.524482 18278 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:32.534159 12543 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:05:32.528661 13227 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:32.496228 18620 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:32.538051 12688 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:32.526258 18577 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:32.539378 12545 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:32.440613 18430 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.541381 12696 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:05:32.523067 12692 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:05:32.600199 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:32.600850 12622 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:32.570283 18124 consensus_queue.cc:260] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.602804 18124 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:32.604962 18654 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:32.605687 18654 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:32.606076 18654 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:32.607012 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:32.607281 18430 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:32.608240 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:32.539608 18557 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:32.571065 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 77523.4us
I20260709 13:05:32.612238 12588 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:32.572583 12687 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:05:32.613786 12687 raft_consensus.cc:606] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:32.572528 12587 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:32.640362 12622 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:32.621399 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:32.593736 12691 raft_consensus.cc:1275] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:05:32.586087 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:32.596099 12695 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:05:32.586241 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:32.624550 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:32.570143 13199 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:32.651827 13229 raft_consensus.cc:2393] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 14: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:32.670629 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:32.596311 12512 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:32.651422 13232 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
W20260709 13:05:32.672742 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 102687us
I20260709 13:05:32.491431 12443 catalog_manager.cc:5697] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 6 to 9, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 9 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:32.595834 12662 leader_election.cc:400] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20.
I20260709 13:05:32.668735 12622 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 16. Current term is 17. Ops: [16.16-16.16]
I20260709 13:05:32.681183 12659 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:32.701092 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.697184 12662 leader_election.cc:403] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:05:32.697446 12621 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:32.686043 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 89816.7us
I20260709 13:05:32.686892 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:32.700670 13199 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:32.589315 18653 raft_consensus.cc:697] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:32.589733 18278 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:32.592765 18618 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:32.573794 18524 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:05:32.710026 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 165423us
I20260709 13:05:32.679445 18599 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.715284 12512 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:32.623615 18612 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:32.721438 12662 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:32.724624 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:32.685981 18587 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.701258 18636 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:32.725329 12620 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:05:32.680227 18617 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:32.726332 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:32.733659 12614 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:05:32.704789 18499 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:32.599637 18319 consensus_queue.cc:1059] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.125s
I20260709 13:05:32.569536 18432 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.726641 12443 catalog_manager.cc:5697] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:32.731652 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:32.723714 18656 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:32.715749 18536 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20.
I20260709 13:05:32.742444 12543 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:05:32.703892 18626 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.030s
I20260709 13:05:32.708002 18339 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.029s
I20260709 13:05:32.743793 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:32.718159 18590 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:32.730886 12546 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:32.713308 18462 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:32.711429 18630 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 13:05:32.729390 18524 raft_consensus.cc:697] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:32.735002 18499 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.751773 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:32.778021 13228 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:32.753882 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:32.729316 18636 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.737056 18557 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:32.576972 18282 consensus_queue.cc:237] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:32.742630 18613 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:32.727178 18599 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.786580 12622 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:05:32.759315 18589 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:32.732924 18587 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.783761 12443 catalog_manager.cc:5697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:32.765439 18590 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:32.742220 18617 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.780486 18499 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:32.803578 12443 catalog_manager.cc:5697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 6 to 7, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 7 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:32.813019 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:32.783043 18636 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:32.789775 18462 raft_consensus.cc:697] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:32.798529 18590 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:32.829735 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 114221us
W20260709 13:05:32.831712 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 116509us
I20260709 13:05:32.833300 12512 leader_election.cc:400] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 11. Current term is 12.
W20260709 13:05:32.833348 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 221216us
I20260709 13:05:32.833729 12512 leader_election.cc:403] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:05:32.819334 18557 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:05:32.837867 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 265404us
I20260709 13:05:32.838840 12443 catalog_manager.cc:5697] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 7 to 9, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 9 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:05:32.827623 18590 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:32.848344 18124 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:32.848971 12443 catalog_manager.cc:5697] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:32.853026 12614 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 11.
I20260709 13:05:32.855830 12588 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:32.837069 18557 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:32.798481 18653 consensus_queue.cc:237] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.859860 12588 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:32.859001 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 118873us
I20260709 13:05:32.862442 12662 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:32.865922 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:32.867327 18497 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:32.867766 18497 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.868151 18497 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:32.861147 18557 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:05:32.844238 12438 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36394 (request call id 341) took 26998 ms (client timeout 15000 ms). Trace:
I20260709 13:05:32.875124 12662 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:32.865636 18659 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.134s	user 0.001s	sys 0.001s
I20260709 13:05:32.900393 18669 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:32.900548 18124 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 11. Current term is 12.
I20260709 13:05:32.901923 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:32.902578 12614 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:32.903188 12620 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:32.903497 18669 raft_consensus.cc:697] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:32.904443 18669 consensus_queue.cc:237] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:32.904856 18293 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:32.858508 18524 consensus_queue.cc:237] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:32.931985 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 94694.7us
I20260709 13:05:32.908916 18664 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:05:32.934526 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 51461.3us
I20260709 13:05:32.886775 18666 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:05:32.936820 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:32.936105 12543 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:32.937875 12587 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:32.872936 18462 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.918102 18673 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:32.957124 18578 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:05:32.959489 18661 log.cc:927] Time spent T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:05:32.943729 18664 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.960474 18664 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:32.961155 12621 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
W20260709 13:05:32.966228 18670 log.cc:927] Time spent T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:05:32.966904 18677 consensus_queue.cc:1059] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:32.973851 18617 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:32.974189 18663 log.cc:927] Time spent T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:05:32.978466 18654 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.983148 18666 consensus_queue.cc:1059] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:32.985534 18591 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:32.986317 18651 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:32.988175 18579 raft_consensus.cc:3055] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:32.946058 18587 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:32.933990 12512 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:32.952034 18599 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:32.997812 18669 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:33.029182 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 169166us
W20260709 13:05:33.034087 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 100208us
I20260709 13:05:33.035575 13228 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:33.038980 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:33.039595 12616 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17. Ops: []
W20260709 13:05:33.029974 18560 consensus_meta.cc:287] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.600s	user 0.007s	sys 0.004s
I20260709 13:05:33.047084 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:33.056763 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:33.058310 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 120540us
I20260709 13:05:33.022672 18579 raft_consensus.cc:740] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:33.052771 18599 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:33.077131 18599 raft_consensus.cc:697] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 21 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:33.077534 18672 consensus_queue.cc:1059] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:33.052695 18591 raft_consensus.cc:697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:33.073493 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:33.078734 12691 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:33.078251 18599 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.075165 12588 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:33.080803 12695 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:33.082788 18591 consensus_queue.cc:237] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.085944 18430 raft_consensus.cc:993] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:05:33.086530 18430 raft_consensus.cc:1081] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:05:33.036504 18589 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.039816 18584 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:05:33.049005 18588 consensus_meta.cc:287] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.614s	user 0.009s	sys 0.002s
I20260709 13:05:33.116202 12588 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:33.090903 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:33.095180 18654 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:33.101986 18676 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:33.129282 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:33.103283 18651 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:33.103937 18673 raft_consensus.cc:3055] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:33.108243 18278 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:33.074425 18432 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:33.136049 12695 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:05:33.143707 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:33.125365 18584 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.147034 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:33.129987 18677 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:33.049296 18669 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.148453 12512 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:33.162756 12613 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:33.061609 18560 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:33.137017 18673 raft_consensus.cc:740] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:33.200042 12689 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
I20260709 13:05:33.163272 18588 raft_consensus.cc:3055] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:33.130204 18589 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:33.211774 12615 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:33.172731 18502 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:33.161024 18584 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:33.218350 18673 consensus_queue.cc:260] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.219229 18669 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:33.164961 18654 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:33.225822 12618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:41084
I20260709 13:05:33.238758 12618 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:33.238961 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:33.239238 12618 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:33.228366 18589 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:33.206389 18591 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:05:33.192139 18672 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:33.160485 18666 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.073s
W20260709 13:05:33.271118 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.229763 18499 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:33.232344 18502 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.212502 18588 raft_consensus.cc:740] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:33.270673 18672 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.278650 18502 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:33.304903 18577 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:33.305542 18577 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.307869 18577 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:33.317032 18499 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:33.319607 18579 consensus_queue.cc:260] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.320938 18579 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:33.290184 18672 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:33.291235 18673 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:33.335446 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:05:33.335647 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 94265.1us
I20260709 13:05:33.336153 12691 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:33.336615 12588 connection.cc:256] RPC call timeout handler was delayed by -1.0825317400000358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
I20260709 13:05:33.337522 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:33.340122 18676 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:33.342391 18676 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:33.342891 18676 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:33.347551 18664 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:33.329869 18665 raft_consensus.cc:3055] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:33.357920 18665 raft_consensus.cc:740] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:33.359054 18665 consensus_queue.cc:260] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:33.338579 12618 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:33.316915 18636 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.367739 18578 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.382802 12618 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:33.383318 12693 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:33.390635 18578 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:33.394392 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:33.357409 18664 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:33.361083 18577 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.403564 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:33.393366 18578 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:33.329399 18590 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.399655 18668 consensus_queue.cc:1059] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:05:33.410122 18668 raft_consensus.cc:3055] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:33.410472 18668 raft_consensus.cc:740] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:33.411423 18668 consensus_queue.cc:260] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.412751 18668 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:33.414722 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:33.416411 12617 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14. Ops: []
W20260709 13:05:33.419816 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:33.403960 18557 consensus_meta.cc:287] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.512s	user 0.013s	sys 0.000s
I20260709 13:05:33.427863 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:33.442231 12542 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:33.442057 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:33.442816 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:33.443790 12510 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:33.417824 18684 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:05:33.402855 18656 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.032s	sys 0.033s
I20260709 13:05:33.445514 12545 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 18: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:33.447037 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:33.450162 12541 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:05:33.360800 18588 consensus_queue.cc:260] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.453373 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:33.453904 12538 raft_consensus.cc:1275] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:05:33.408808 18591 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:33.408998 18560 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:33.455096 12588 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:33.458556 12543 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:05:33.452158 18497 consensus_meta.cc:287] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.584s	user 0.023s	sys 0.000s
W20260709 13:05:33.445983 18656 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.033s	sys 0.033s
I20260709 13:05:33.425156 18430 consensus_queue.cc:1059] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:05:33.469631 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:33.470328 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:33.470451 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:33.472805 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:33.406275 18577 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.454891 18524 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:33.475944 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:33.482920 12613 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:33.476341 12510 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:33.455770 18599 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:33.458112 18651 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:33.478530 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:33.480633 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:33.488687 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:05:33.489176 18692 log.cc:927] Time spent T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 13:05:33.489370 12617 raft_consensus.cc:2376] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16. Re-sending same reply.
I20260709 13:05:33.490485 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:32.882336 12438 rpcz_store.cc:269] 0709 13:05:05.719462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:05.741247 (+ 21785us) service_pool.cc:224] Handling call
0709 13:05:06.697903 (+956656us) spinlock_profiling.cc:243] Waited 44.2 ms on lock 0x7b5400235fd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e3090 00007fc3a9581f3a 00007fc3af3381cc 00007fc3af43637e 00007fc3ad8f72a4 00007fc3ad8f7232 00007fc3ad8f7161 00007fc3ad8f70dc 00007fc3ad8f6392 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:32.680380 (+25982477us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:24.882533 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:24.954128 (+ 71595us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:24.954180 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:05:24.954199 (+    19us) tablet.cc:662] Decoding operations
0709 13:05:25.065067 (+110868us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:25.065287 (+   220us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:25.065317 (+    30us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:05:25.067049 (+  1732us) tablet.cc:701] Row locks acquired
0709 13:05:25.067109 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:05:25.067332 (+   223us) write_op.cc:270] Start()
0709 13:05:25.067527 (+   195us) write_op.cc:276] Timestamp: P: 1783602325067250 usec, L: 0
0709 13:05:25.067571 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:05:25.068443 (+   872us) log.cc:844] Serialized 7908 byte log entry
0709 13:05:25.895732 (+827289us) op_driver.cc:464] REPLICATION: finished
0709 13:05:26.468838 (+573106us) write_op.cc:301] APPLY: starting
0709 13:05:26.468989 (+   151us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:26.509373 (+ 40384us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:26.509495 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:27.524910 (+1015415us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:27.525294 (+   384us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 13:05:27.525352 (+    58us) write_op.cc:312] APPLY: finished
0709 13:05:27.534335 (+  8983us) log.cc:844] Serialized 180 byte log entry
0709 13:05:27.607520 (+ 73185us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:27.607779 (+   259us) write_op.cc:454] Released schema lock
0709 13:05:27.607883 (+   104us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:27.608491 (+   608us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:27.608541 (+    50us) write_op.cc:454] Released schema lock
0709 13:05:28.564952 (+956411us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
Metrics: {"mutex_wait_us":2526825,"reported_tablets":47,"spinlock_wait_cycles":101692672,"child_traces":[["op",{"apply.queue_time_us":523569,"apply.run_cpu_time_us":50352,"apply.run_wall_time_us":1152611,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87767,"num_ops":20,"prepare.queue_time_us":452056,"prepare.run_cpu_time_us":30153,"prepare.run_wall_time_us":514135,"raft.queue_time_us":321072,"raft.run_cpu_time_us":14641,"raft.run_wall_time_us":359348,"replication_time_us":827899,"spinlock_wait_cycles":26667776,"thread_start_us":1084446,"threads_started":5,"wal-append.queue_time_us":571967,"wal-append.run_cpu_time_us":26408,"wal-append.run_wall_time_us":3040395}]]}
I20260709 13:05:33.491611 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:33.480495 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:33.481317 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:33.442795 18557 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:33.451740 18510 consensus_queue.cc:1059] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:05:33.445159 18664 consensus_queue.cc:1059] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 13:05:33.484372 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:33.466899 18178 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:33.486724 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.455802 18666 consensus_queue.cc:1059] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:05:33.475626 18654 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:33.444921 18669 consensus_queue.cc:1059] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:05:33.512079 18011 raft_consensus.cc:3055] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:33.514187 18011 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:33.514642 18669 raft_consensus.cc:3055] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:33.515096 18669 raft_consensus.cc:740] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:33.515129 18011 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.16, Last appended by leader: 16, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:33.515825 18687 log.cc:927] Time spent T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:05:33.516157 18669 consensus_queue.cc:260] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:33.516808 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 631573us
I20260709 13:05:33.518610 13197 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:33.503469 18620 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:33.519688 18620 raft_consensus.cc:697] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:05:33.520284 18686 log.cc:927] Time spent T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.124s	user 0.002s	sys 0.000s
I20260709 13:05:33.520665 18620 consensus_queue.cc:237] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.522855 18618 consensus_queue.cc:1059] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:33.523491 13200 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:33.523877 18618 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:33.467332 18656 raft_consensus.cc:697] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:33.478937 18587 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:33.531188 12662 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:33.497685 12510 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:33.473114 18497 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:33.502722 18510 raft_consensus.cc:3055] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:33.503433 12622 raft_consensus.cc:2393] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 11: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:05:33.503667 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 792026us
W20260709 13:05:33.542537 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.504750 18429 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:33.483893 18524 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:33.509356 18293 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.512548 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:33.525743 18624 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:33.557531 13197 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:33.558513 12688 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:33.560184 13197 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:33.488721 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:33.527458 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:33.529795 12619 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:33.536934 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:33.561981 12546 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:05:33.562315 12545 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:33.517413 18669 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:33.544476 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:33.546085 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:33.547549 12693 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:05:33.565276 12695 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 17: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:33.566167 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:33.506362 18584 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:33.525527 18618 raft_consensus.cc:3055] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:33.525475 12691 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
I20260709 13:05:33.530751 18011 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:33.532339 18581 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.566506 12695 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:05:33.526871 18178 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.572929 18584 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:33.557116 18524 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:33.566260 18293 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:33.577911 18429 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:33.579803 12545 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:33.585137 18656 consensus_queue.cc:237] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:33.586282 17964 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:33.593721 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:33.539112 18510 raft_consensus.cc:740] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:33.589700 18618 raft_consensus.cc:740] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:33.625818 18618 consensus_queue.cc:260] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.567713 18624 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.626856 18618 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:33.595232 13228 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:05:33.595683 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:33.612504 18581 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.596490 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:33.630945 13232 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:33.597666 13227 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:05:33.602232 13197 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:33.536598 18430 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:33.632881 18430 raft_consensus.cc:697] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:33.633961 18590 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:33.634483 18577 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:33.634351 18430 consensus_queue.cc:237] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.609553 18339 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 13:05:33.525756 18626 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:05:33.609084 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:33.592607 18697 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:05:33.615432 18677 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:33.599656 18283 consensus_queue.cc:1059] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:05:33.606264 18613 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:33.638666 13231 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:33.610633 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:33.661657 12695 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:33.665267 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:33.666349 13231 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
W20260709 13:05:33.638914 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 114621us
I20260709 13:05:33.626911 18624 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:33.613305 18636 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:33.637593 18510 consensus_queue.cc:260] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:33.686496 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:33.686693 12619 raft_consensus.cc:1240] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:33.686743 12546 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:05:33.688860 12545 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:05:33.691360 12619 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 16. Current term is 17. Ops: []
W20260709 13:05:33.678203 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 180654us
I20260709 13:05:33.639443 17964 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:33.679513 12620 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:33.694375 12510 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:33.695667 12510 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:33.699956 18672 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.701100 12621 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 18: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:33.702396 18672 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:33.706503 18178 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:33.689756 18502 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.712878 18502 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:33.713395 18178 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:33.710067 18510 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:33.716581 18588 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:33.719434 18688 log.cc:927] Time spent T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.384s	user 0.003s	sys 0.000s
I20260709 13:05:33.723636 18497 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:33.679881 18337 consensus_queue.cc:1059] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:05:33.696060 18590 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:33.727769 12695 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:33.731909 12510 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:33.738435 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.740779 12510 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:33.744509 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:33.748013 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:33.748378 13227 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:33.748594 12694 raft_consensus.cc:2410] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:05:33.747530 12510 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:33.750700 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:33.753386 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:33.754745 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:33.755148 12510 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:33.756117 12510 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:33.756954 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:33.757015 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:33.757710 13228 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:33.760560 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:33.761667 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:33.762264 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:33.746716 18700 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:33.766909 13230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:33.767915 13230 raft_consensus.cc:606] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:33.769810 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:33.770936 12513 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:33.745360 18626 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.772394 18499 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:33.772997 18499 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.772099 18626 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.773698 18339 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.774367 18339 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.775992 18626 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:33.773468 18499 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:33.778204 13226 raft_consensus.cc:2410] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 19 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:05:33.747061 18178 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:33.748593 18581 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:33.782814 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:33.772027 18584 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:05:33.761783 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:33.788678 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:33.791100 13230 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:05:33.798123 13228 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:33.796310 12588 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:33.792629 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:33.800964 12696 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:33.795373 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:05:33.802171 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 46094.6us
I20260709 13:05:33.803813 18673 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:33.804046 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:33.804359 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:33.804802 13234 raft_consensus.cc:2368] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15.
W20260709 13:05:33.804935 18685 log.cc:927] Time spent T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.475s	user 0.003s	sys 0.000s
I20260709 13:05:33.805729 18584 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:33.806754 18581 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:33.807106 18633 consensus_queue.cc:1059] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:05:33.808153 18691 log.cc:927] Time spent T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.433s	user 0.002s	sys 0.000s
I20260709 13:05:33.761874 18590 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:33.808377 18630 raft_consensus.cc:3055] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:33.809135 18630 raft_consensus.cc:740] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:33.808063 12545 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:05:33.785523 18502 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:33.752705 18676 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.816253 18676 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:33.817906 18524 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:33.819022 18680 log.cc:927] Time spent T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.537s	user 0.002s	sys 0.000s
I20260709 13:05:33.819388 13230 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:33.820060 18524 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:33.803241 12510 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:33.822932 18587 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:33.824110 18587 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:33.824376 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:33.826856 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.828397 13199 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:33.831379 18620 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:33.832283 18684 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.833914 12588 leader_election.cc:400] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15.
I20260709 13:05:33.835120 13230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:33.839056 12510 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:33.834939 12513 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:33.843055 13230 raft_consensus.cc:606] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:33.843434 13230 raft_consensus.cc:614] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:33.844841 12618 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:05:33.848945 12510 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:33.839169 18510 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:33.852617 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:33.842011 18502 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:33.850085 18599 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:33.858259 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:33.846030 18636 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:33.856514 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:05:33.848511 18590 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:33.860201 18178 raft_consensus.cc:2764] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:05:33.865756 18011 consensus_queue.cc:1059] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:33.866590 18011 consensus_queue.cc:1243] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer a11816c5d72e4d1295a242f3ced09e5f log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:05:33.866657 18699 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.015s
I20260709 13:05:33.867293 18584 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:33.855470 18510 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.868037 18510 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:33.869817 12512 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:33.871057 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:33.847153 18613 consensus_queue.cc:1059] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 13:05:33.873034 18613 raft_consensus.cc:3055] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:33.873466 18613 raft_consensus.cc:740] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:33.874425 18613 consensus_queue.cc:260] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.875408 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:33.875830 18613 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:33.875970 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:33.847831 18684 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:33.882313 18684 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:33.883613 18278 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:33.884879 18293 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:33.885499 12614 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:05:33.885916 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:33.887373 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:33.887921 12695 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:33.890942 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:33.855063 18587 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:33.879591 18624 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.892200 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:33.885929 12614 pending_rounds.cc:85] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 12
I20260709 13:05:33.863176 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:33.885936 12690 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:33.897823 12614 pending_rounds.cc:107] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:05:33.898855 12614 raft_consensus.cc:2889] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:33.899897 12687 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
W20260709 13:05:33.901790 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 43610.2us
I20260709 13:05:33.905702 12693 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:33.909143 12695 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:05:33.909797 12510 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:33.897408 18579 consensus_queue.cc:1059] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:05:33.912227 18502 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:33.915599 12510 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:33.898074 18587 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.919421 18587 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:33.896695 18668 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:33.927371 18624 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:33.928077 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:33.928915 12622 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:33.935088 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:33.921531 12587 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:33.897706 18590 raft_consensus.cc:697] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 17 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:33.944022 12510 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:33.911574 12659 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:33.951045 12510 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:33.952970 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 106939us
I20260709 13:05:33.956285 12510 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:33.958549 13199 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:33.916100 18584 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:05:33.950397 18654 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:33.964157 12690 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:33.951431 18178 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:05:33.964767 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 52012.7us
I20260709 13:05:33.952142 18599 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:33.968086 12659 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:33.969645 18178 raft_consensus.cc:697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:33.970389 12622 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:33.970232 18510 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.952620 18668 raft_consensus.cc:697] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:33.963286 18579 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:33.973456 13197 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:33.959726 18429 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:33.961797 18699 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:33.959965 18700 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:33.975147 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:33.976639 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.954362 18684 consensus_queue.cc:1059] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:05:33.977870 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:33.981730 12690 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
I20260709 13:05:34.009991 18684 raft_consensus.cc:3055] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:34.010456 18684 raft_consensus.cc:740] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:34.011309 18684 consensus_queue.cc:260] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:34.012504 18684 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:34.013054 18497 raft_consensus.cc:3055] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:33.983317 18590 consensus_queue.cc:237] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.013495 18497 raft_consensus.cc:740] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:34.014595 18497 consensus_queue.cc:260] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.016227 18497 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:34.002607 13200 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:34.006145 18484 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.018285 18484 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.019155 18624 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:34.019733 18624 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:34.020143 18624 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:34.020767 18484 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:34.003458 18560 raft_consensus.cc:3055] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:34.021622 18560 raft_consensus.cc:740] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:34.022022 12695 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:05:34.022697 18560 consensus_queue.cc:260] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.023968 18560 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:34.018419 13200 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:34.030079 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:34.027213 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:34.031121 13230 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 14: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:34.004191 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:34.027213 12587 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:34.027863 13232 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:34.037175 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:34.038048 13230 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:33.978772 18293 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:34.044330 12662 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:34.046228 12690 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:05:34.045406 12622 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:05:33.979239 18618 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.979979 18699 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:33.979868 18337 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:34.059573 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:33.998651 18557 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:34.063043 12662 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:34.059206 12692 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:34.073916 12695 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:05:33.990316 18668 consensus_queue.cc:237] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:34.043403 18581 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.086630 12695 pending_rounds.cc:85] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 9
I20260709 13:05:34.063328 13233 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:34.059665 12587 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:34.066071 18508 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:34.069214 18699 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:34.068833 18636 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:34.006166 18587 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:34.105690 12695 pending_rounds.cc:107] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:05:34.067797 18651 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:34.060912 18293 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.093914 18499 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:33.994985 18630 consensus_queue.cc:260] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.085796 18584 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:33.997596 18178 consensus_queue.cc:237] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.113199 12695 raft_consensus.cc:2889] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:34.130841 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:05:34.133756 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 73547.3us
I20260709 13:05:34.135847 12587 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:34.132411 12690 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:05:34.090297 18577 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:34.066252 17964 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:05:34.071913 18618 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:34.118324 18714 log.cc:927] Time spent T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 13:05:34.116356 18293 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:34.151208 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:34.153013 12587 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:34.156355 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:05:34.152936 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 93830.1us
I20260709 13:05:34.125941 18636 raft_consensus.cc:697] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:34.126451 18510 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:34.119196 18499 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:34.141917 18124 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.146982 18577 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.170713 12694 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:34.113006 18581 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:34.151456 18694 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:34.174301 12587 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:34.155184 18654 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:34.120316 18584 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:34.116761 18712 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 13:05:34.132097 18587 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:34.154249 18337 raft_consensus.cc:697] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:34.154271 18651 raft_consensus.cc:697] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:34.192167 18510 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.161460 18617 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:05:34.198711 12619 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:34.235198 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:34.236411 12621 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:34.163311 18588 consensus_queue.cc:1059] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 13:05:34.201138 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.163190 18656 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:34.175401 18577 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:34.202814 18618 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:34.202670 18636 consensus_queue.cc:237] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.173305 18524 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:05:34.205961 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 94061.6us
I20260709 13:05:34.175704 18124 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.198442 18581 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:34.258404 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:34.259217 12690 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:34.230392 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 273890us
I20260709 13:05:34.189034 18664 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:34.155834 18624 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.249989 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:34.266394 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:05:34.248555 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 77249.9us
I20260709 13:05:34.176182 18557 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:05:34.177296 18672 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:05:34.252013 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:34.196403 18699 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.257205 12617 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:05:34.258451 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:34.261863 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:34.263469 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:34.274518 12688 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:34.274529 12546 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
W20260709 13:05:34.259707 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 74793.2us
I20260709 13:05:34.266888 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:34.267835 12692 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:05:34.268551 12691 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:34.248428 18579 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.269371 12694 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:05:34.276289 18579 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.276657 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:34.277184 12691 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:34.271027 12542 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:34.271986 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:34.278493 18579 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:34.279280 12545 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 15: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:34.281209 18581 consensus_queue.cc:1059] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:34.255402 18524 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.286355 12512 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:34.286841 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:34.293658 18664 raft_consensus.cc:697] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:34.293912 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:34.294584 12545 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:34.294749 18664 consensus_queue.cc:237] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:34.295742 18684 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:34.296298 18684 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.287770 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:34.298040 12543 raft_consensus.cc:2393] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 16: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:34.287966 13234 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 16. Preceding OpId from leader: term: 17 index: 16. (term mismatch)
I20260709 13:05:34.298743 13234 pending_rounds.cc:85] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372: Aborting all ops after (but not including) 15
I20260709 13:05:34.298985 13234 pending_rounds.cc:107] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372: Aborting uncommitted NO_OP operation due to leader change: 16.16
I20260709 13:05:34.299144 18124 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:34.299218 13234 raft_consensus.cc:2889] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:34.301146 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:34.301469 18430 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:05:34.302073 18651 consensus_queue.cc:237] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:34.238659 18510 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.304397 18624 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:34.305078 18510 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:34.305552 12688 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:34.305750 13229 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:34.306545 18699 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:34.293483 18712 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:34.307386 18684 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:34.311960 13230 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:34.312187 12688 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:34.263955 18588 consensus_queue.cc:1243] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:05:34.327433 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:34.328094 12619 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:34.329299 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:34.331604 13230 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:34.321293 12690 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:34.286827 12691 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:34.322853 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:34.336771 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:34.339530 18124 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:34.262144 18694 raft_consensus.cc:697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:34.314086 18337 consensus_queue.cc:237] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.345245 18694 consensus_queue.cc:237] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:34.286154 18673 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:34.250584 18656 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.357228 13197 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:34.353155 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.352341 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:34.361682 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:34.361888 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:34.361927 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:34.314845 18524 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:34.360685 12512 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:34.365978 12543 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:34.334173 18462 raft_consensus.cc:3055] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:05:34.366144 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:34.359035 18704 log.cc:927] Time spent T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:05:34.369896 12512 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:34.428656 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 58805.2us
I20260709 13:05:34.350380 18673 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.366998 12690 raft_consensus.cc:2368] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 14. Current term is 15.
I20260709 13:05:34.374754 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:34.358491 18430 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.383347 18560 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:34.364944 18669 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 13:05:34.383857 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:34.384295 18730 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.385445 18499 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:34.364753 18590 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:34.387326 18724 log.cc:927] Time spent T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:05:34.388641 18731 raft_consensus.cc:3055] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:34.393038 18665 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:34.399677 18722 log.cc:927] Time spent T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.198s	user 0.005s	sys 0.000s
W20260709 13:05:34.405357 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.288887 18620 consensus_queue.cc:1059] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:05:34.368429 18124 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:05:34.408038 18656 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:34.408797 18723 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:34.373230 18339 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:34.412720 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 43589.4us
I20260709 13:05:34.439167 12695 raft_consensus.cc:1217] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Deduplicated request from leader. Original: 11.7->[12.8-14.9]   Dedup: 12.8->[14.9-14.9]
W20260709 13:05:34.448146 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.448037 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:34.350740 18654 raft_consensus.cc:697] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:05:34.452121 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 183852us
I20260709 13:05:34.541244 12695 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 13:05:34.453506 12543 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:34.458210 12689 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 18: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:05:34.462566 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 54109.1us
I20260709 13:05:34.412261 18462 raft_consensus.cc:740] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:34.452630 18587 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.530791 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:34.546945 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:34.464246 18731 raft_consensus.cc:740] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:05:34.562475 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.583333 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:34.589462 12542 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:34.594638 12512 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:34.594908 12545 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 15: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:34.598380 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:34.599411 12689 raft_consensus.cc:2393] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 14: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:34.580202 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:34.591281 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:34.457144 18430 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.517068 18499 raft_consensus.cc:697] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:34.549299 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:34.459792 18560 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.604483 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:34.619551 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:34.620335 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:34.590871 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:34.609990 13233 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:05:34.537364 18723 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.648649 12691 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:05:34.593215 18653 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.636711 12588 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:34.465065 18730 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.590382 18584 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:34.592336 18178 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.590258 18735 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.165s
I20260709 13:05:34.621274 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:34.666723 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:34.593022 18484 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:34.679730 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 137073us
I20260709 13:05:34.719976 13199 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:34.580314 18656 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.098s
I20260709 13:05:34.696074 12542 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
W20260709 13:05:34.707931 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 71319us
W20260709 13:05:34.708567 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 104838us
I20260709 13:05:34.722213 12621 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:34.706163 18723 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:34.706884 18707 log.cc:927] Time spent T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.539s	user 0.004s	sys 0.000s
W20260709 13:05:34.714541 18703 log.cc:927] Time spent T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:05:34.731264 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:34.707176 18726 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:34.736768 13199 leader_election.cc:400] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 14. Current term is 15.
I20260709 13:05:34.737303 13199 leader_election.cc:403] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:05:34.608866 18587 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.742619 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:34.704270 18618 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:05:34.728641 18124 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:34.753479 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.730986 18673 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:34.763867 12662 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:34.752388 18581 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:34.739158 18656 consensus_queue.cc:1243] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 17.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 13:05:34.769163 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.740068 18633 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:34.772310 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:34.716388 18653 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.695659 18731 consensus_queue.cc:260] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:34.781293 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:34.721437 18178 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.778931 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:34.779533 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:34.779860 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:34.778991 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 184480us
I20260709 13:05:34.783330 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:34.812376 12539 raft_consensus.cc:2368] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15.
I20260709 13:05:34.784250 12541 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:34.750267 18726 raft_consensus.cc:697] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:34.784718 12545 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:34.770519 18715 log.cc:927] Time spent T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:05:34.785018 12540 raft_consensus.cc:2393] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 11: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:34.731104 18484 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.822235 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:34.822989 12547 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:34.812134 12544 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:34.706667 18462 consensus_queue.cc:260] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:34.813275 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.813848 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:34.827270 12541 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:34.814284 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:34.768396 18430 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:34.707824 18654 consensus_queue.cc:237] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:34.768219 18124 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.768761 18729 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 14. Current term is 15.
I20260709 13:05:34.738477 18499 consensus_queue.cc:237] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:34.768448 18736 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:34.862080 12541 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:34.835568 12621 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:34.861945 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:34.863322 12540 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 10.
W20260709 13:05:34.833444 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.854892 12547 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:34.866338 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:34.867352 12689 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
W20260709 13:05:34.859470 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 75714.4us
I20260709 13:05:34.873083 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:34.870577 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:34.873991 12619 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:34.817921 18731 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:34.817948 18432 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:34.875136 12539 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 18: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:34.876824 12547 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:05:34.848177 18741 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.216s	user 0.000s	sys 0.000s
I20260709 13:05:34.836890 18462 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:34.908810 12545 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:05:34.836369 18178 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:34.845958 18739 log.cc:927] Time spent T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
W20260709 13:05:34.910415 18293 consensus_meta.cc:287] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.745s	user 0.008s	sys 0.002s
W20260709 13:05:34.911291 18524 consensus_meta.cc:287] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.003s
I20260709 13:05:34.911734 18524 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:34.780310 18673 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:05:34.881346 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 2241) took 1411 ms. Trace:
I20260709 13:05:34.915395 12615 rpcz_store.cc:276] 0709 13:05:33.469527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.469705 (+   178us) service_pool.cc:224] Handling call
0709 13:05:34.881115 (+1411410us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b540009a1d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:34.881254 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":954320768}
I20260709 13:05:34.883376 18591 raft_consensus.cc:3055] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:34.849251 18560 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:34.892407 18587 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:34.893602 18726 consensus_queue.cc:237] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:34.784060 18745 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.118s
I20260709 13:05:34.901877 18653 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:34.903059 18730 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:34.820884 18734 consensus_queue.cc:1059] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.236s
I20260709 13:05:34.910892 18293 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:34.849114 18577 consensus_meta.cc:287] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.000s
I20260709 13:05:34.912652 12512 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:34.837204 18484 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:34.917762 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 153996us
I20260709 13:05:34.922099 12544 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:34.918104 18591 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:34.890712 18432 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:05:34.917358 18715 log.cc:927] Time spent T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:05:34.929239 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:34.931041 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 60544.7us
I20260709 13:05:34.950389 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:34.932418 12692 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.012s	sys 0.005s
W20260709 13:05:34.951408 12692 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.012s	sys 0.005s
W20260709 13:05:34.922708 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 175113us
I20260709 13:05:34.942417 12662 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:34.921051 18590 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:34.956076 18591 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.957453 18591 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:34.944671 18524 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:34.965763 18484 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:34.915463 18723 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.968603 18293 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:34.969892 18723 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:34.970413 18124 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:34.973541 12622 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:34.926110 18624 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.025s
I20260709 13:05:34.974406 18588 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.975118 18588 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:34.948307 18432 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:34.947180 18577 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.980160 18577 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:34.945990 18747 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:34.981025 18747 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.981437 18747 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:34.989372 18590 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:34.989856 18124 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:34.992753 12540 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:34.993883 12662 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:34.994766 12588 leader_election.cc:400] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15.
I20260709 13:05:34.995272 12588 leader_election.cc:403] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 13:05:34.995600 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:34.996865 12662 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:34.998805 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:35.000108 12588 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:35.007097 18694 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:35.003657 18665 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:05:35.003736 18293 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:35.002662 18745 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:35.013252 18588 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:35.003738 18591 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15.
I20260709 13:05:35.019482 18747 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:34.998883 18676 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:35.026543 12539 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:05:35.026600 12547 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:05:35.027513 12543 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:35.022666 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:35.003003 18577 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:35.033643 18591 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:35.034125 18591 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:35.034569 18591 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:35.035281 18747 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:35.042976 18584 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:35.044234 12696 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:05:35.043628 18591 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:35.044618 18624 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:35.046247 18432 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:35.046887 18577 raft_consensus.cc:697] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:35.049130 18591 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:35.049926 18745 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:35.048767 18577 consensus_queue.cc:237] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:35.062165 18745 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:35.064680 18745 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:35.050344 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:35.055094 12692 raft_consensus.cc:1275] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:35.067853 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:05:35.077553 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.079156 18747 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.099579 12620 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:35.101372 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:35.102006 12620 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
W20260709 13:05:35.103734 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 111883us
I20260709 13:05:35.066860 18432 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:35.080708 18712 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.107185 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:35.081143 18734 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:35.109527 12510 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:35.110232 12617 raft_consensus.cc:1275] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:05:35.120173 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:35.121109 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:35.120200 12617 pending_rounds.cc:85] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 7
I20260709 13:05:35.121922 12617 pending_rounds.cc:107] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:05:35.122180 12617 raft_consensus.cc:2889] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:35.111023 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:35.112362 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:35.116001 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.123253 12545 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:05:35.123273 12541 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:35.105067 18591 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.127120 18726 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:35.128110 18432 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.131139 18590 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:35.131433 12510 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:35.131462 18432 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:35.132581 18590 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:35.133093 18590 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.133463 18590 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:35.135129 18432 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:35.135762 12588 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:35.106976 18626 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:35.080907 18700 consensus_queue.cc:1048] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:05:35.113215 18712 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:35.142441 18587 consensus_queue.cc:1048] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:35.144726 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:35.102334 18747 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:35.153797 18590 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:35.140216 18278 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:35.155375 18278 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.155718 18278 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:35.157838 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:35.138867 18591 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:35.128909 18734 raft_consensus.cc:697] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:35.164295 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:35.164857 12615 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:05:35.159585 18510 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:35.167866 18740 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.534s	user 0.001s	sys 0.001s
I20260709 13:05:35.152036 18712 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:35.147521 18626 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:35.171113 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:35.171687 12692 raft_consensus.cc:1240] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:35.180531 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:35.181146 12692 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:35.174124 12695 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:05:35.176009 18630 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:35.176254 18734 consensus_queue.cc:237] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:35.178031 12587 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:35.190488 12587 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:35.179006 18747 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:35.187021 12690 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 19: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:35.178574 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:35.190388 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:35.194342 12695 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:05:35.201277 18588 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:35.206514 18557 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:35.208860 12541 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:35.213495 12588 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:35.216317 12690 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:35.225519 12587 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:35.229768 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 1068) took 1203 ms. Trace:
I20260709 13:05:35.230274 13226 rpcz_store.cc:276] 0709 13:05:34.026563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.026694 (+   131us) service_pool.cc:224] Handling call
0709 13:05:35.229509 (+1202815us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b54007c38d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:35.229695 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1471429504}
I20260709 13:05:35.231714 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 1297) took 1101 ms. Trace:
I20260709 13:05:35.231848 12541 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:35.232172 13230 rpcz_store.cc:276] 0709 13:05:34.130394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.130573 (+   179us) service_pool.cc:224] Handling call
0709 13:05:35.231560 (+1100987us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54006c02d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:35.231660 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":407791872}
I20260709 13:05:35.235742 18636 raft_consensus.cc:993] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:05:35.236935 18636 raft_consensus.cc:1081] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:05:35.243325 18626 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:35.244860 13234 raft_consensus.cc:3055] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:35.245263 13234 raft_consensus.cc:740] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:05:35.252206 12588 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.196:33997 timed out after 1.709s (SENT) [suppressed 20 similar messages]
I20260709 13:05:35.255491 12544 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:35.257958 12615 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:35.259449 12692 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:35.260803 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:35.262444 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:35.267218 12692 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:35.251226 13234 consensus_queue.cc:260] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:35.179581 18510 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:35.209630 18665 consensus_queue.cc:1059] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:05:35.210017 18654 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:35.222851 18711 log.cc:927] Time spent T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 1.311s	user 0.002s	sys 0.007s
I20260709 13:05:35.281474 18557 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:35.289791 18557 raft_consensus.cc:697] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:35.290787 18557 consensus_queue.cc:237] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:35.294288 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1295) took 1496 ms. Trace:
I20260709 13:05:35.294740 13235 rpcz_store.cc:276] 0709 13:05:33.797920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.798063 (+   143us) service_pool.cc:224] Handling call
0709 13:05:33.830125 (+ 32062us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:33.830653 (+   528us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:33.830695 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:33.831191 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 13:05:33.901055 (+ 69864us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:33.901098 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:33.901174 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:35.113325 (+1212151us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:35.293973 (+180648us) raft_consensus.cc:1685] finished
0709 13:05:35.293993 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:35.294209 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1344,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":5978368,"thread_start_us":69473,"threads_started":1,"wal-append.queue_time_us":80113}
W20260709 13:05:35.296835 13232 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 1058) took 1550 ms (client timeout 1709 ms). Trace:
I20260709 13:05:35.281598 13234 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:35.301043 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:35.206542 18694 consensus_queue.cc:1059] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 13:05:35.308633 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:35.312814 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:35.317922 13234 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:05:35.283108 18588 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:35.314394 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:35.322276 12545 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:35.322834 12622 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:35.307057 12659 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:35.323081 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:35.323369 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:35.323772 12619 raft_consensus.cc:2393] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 17: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:35.323774 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:35.315937 12620 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:35.297269 13232 rpcz_store.cc:269] 0709 13:05:33.746044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.746160 (+   116us) service_pool.cc:224] Handling call
0709 13:05:35.296656 (+1550496us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b5400750dd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:35.296769 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315198848}
I20260709 13:05:35.321401 13234 pending_rounds.cc:85] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: Aborting all ops after (but not including) 11
I20260709 13:05:35.326608 13234 pending_rounds.cc:107] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:05:35.287209 18654 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:35.330327 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:35.337302 12617 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:35.286535 18591 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:35.339936 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:35.329167 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:35.341143 12615 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:35.334374 13234 raft_consensus.cc:2889] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:35.330437 12662 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:35.341419 12541 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:35.288292 18510 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:35.345598 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 93382.3us
I20260709 13:05:35.351805 12620 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:35.343508 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 1072) took 1020 ms. Trace:
I20260709 13:05:35.353262 13234 rpcz_store.cc:276] 0709 13:05:34.323381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.325702 (+  2321us) service_pool.cc:224] Handling call
0709 13:05:34.326014 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:35.244770 (+918756us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54004680a0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a94f0dc0 00007fc3a957b1c0 00007fc3a957c231 00007fc3a9578d8f 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c
0709 13:05:35.343227 (+ 98457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.343453 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391618432}
I20260709 13:05:35.343708 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:35.322163 18588 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.348295 12512 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:35.330886 18508 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:35.361629 12659 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:35.381997 12692 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:35.363991 12510 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:35.296835 18278 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:35.336664 18577 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:05:35.408897 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:35.356997 18747 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.333250 18745 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 13:05:35.345242 18462 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:35.393452 12541 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
W20260709 13:05:35.357942 18627 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:05:35.416096 12538 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:05:35.360687 18588 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:35.408337 18783 log.cc:927] Time spent T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:05:35.380055 18508 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.430897 12662 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:35.408474 18484 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:35.385838 18727 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:35.359989 18665 consensus_queue.cc:1059] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:05:35.394305 18584 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:05:35.477900 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 43681.2us
I20260709 13:05:35.360778 18734 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.410382 18746 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 13:05:35.394073 18124 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:35.394392 18624 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
W20260709 13:05:35.487414 18775 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:05:35.487864 18755 log.cc:927] Time spent T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:05:35.489378 18278 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:35.490947 18654 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:35.475878 18293 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:05:35.484066 18750 log.cc:927] Time spent T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:05:35.506014 18700 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:35.473073 18484 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:35.513078 12617 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:35.433452 18747 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:35.530843 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.437294 18508 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:35.477386 18584 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.520252 12688 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:05:35.509493 18588 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:35.570151 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:35.578675 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:35.578931 13234 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:35.570150 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:35.436300 18282 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 13:05:35.482503 18727 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:35.568743 18484 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:35.544813 18579 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.624320 18579 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:35.627398 18579 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:35.628480 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:35.629129 12615 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:35.574440 13230 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:35.572705 17964 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.577498 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:35.584087 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:35.584883 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:35.630863 13199 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:35.566399 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:35.538992 18734 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:35.571770 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:35.636860 13231 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:35.615445 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:35.616462 18745 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.617172 18588 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:35.620736 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 1474) took 1246 ms. Trace:
I20260709 13:05:35.642954 12691 rpcz_store.cc:276] 0709 13:05:34.373993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.374471 (+   478us) service_pool.cc:224] Handling call
0709 13:05:35.620543 (+1246072us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b54000c67d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:35.620653 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":458652928}
W20260709 13:05:35.621663 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.654567 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:35.655867 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:35.657160 12614 raft_consensus.cc:1217] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Deduplicated request from leader. Original: 16.11->[18.12-18.12]   Dedup: 18.12->[]
I20260709 13:05:35.657853 12614 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:05:35.659128 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:35.623144 18727 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:35.584611 13226 raft_consensus.cc:2410] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:05:35.585023 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:35.666306 13233 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:35.587425 12617 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:05:35.571549 18700 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:35.674098 12614 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:60170
I20260709 13:05:35.675221 12614 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:35.675828 12614 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:35.567610 18293 raft_consensus.cc:697] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:35.640024 13229 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:35.640316 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:35.577229 18584 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:35.634722 13235 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:35.630355 18577 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:35.690548 18577 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:35.632230 18736 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.644265 18624 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:35.720038 12618 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:35.643536 18730 consensus_queue.cc:1059] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 13:05:35.694164 18712 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.664667 18745 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:35.639804 17964 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:35.803047 13233 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:35.785477 12614 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:35.875876 13229 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 13:05:35.882459 13229 pending_rounds.cc:85] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Aborting all ops after (but not including) 13
I20260709 13:05:35.882754 13229 pending_rounds.cc:107] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:05:35.883004 13229 raft_consensus.cc:2889] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:35.876861 13235 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:35.889380 12614 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:35.826123 18630 consensus_meta.cc:287] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.635s	user 0.012s	sys 0.000s
I20260709 13:05:35.720507 18665 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.171s
I20260709 13:05:35.826792 18497 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:35.900889 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 255964us
I20260709 13:05:35.902688 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:35.715436 18736 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:35.911010 13227 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:35.888808 18577 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:35.825722 18712 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:35.893683 18124 raft_consensus.cc:697] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:35.965978 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:35.967103 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:35.961930 18011 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:35.961007 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:35.971863 13231 raft_consensus.cc:2393] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 17: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:35.971961 12547 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:05:35.965150 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:35.972786 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:35.973232 13233 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:05:35.973451 12541 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:35.968312 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:35.969890 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:35.970736 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:35.979139 12539 raft_consensus.cc:1275] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:35.980796 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:35.981590 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:35.981869 13226 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:05:35.982254 13228 raft_consensus.cc:2376] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16. Re-sending same reply.
I20260709 13:05:35.984414 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:35.986160 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:35.986781 13228 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:35.991643 18590 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:35.989343 18653 raft_consensus.cc:3055] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:35.995712 18653 raft_consensus.cc:740] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:35.996537 18653 consensus_queue.cc:260] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:35.998123 18806 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.998597 18745 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:35.998662 18806 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:36.001029 18806 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:05:36.003015 18789 log.cc:927] Time spent T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.085s	user 0.002s	sys 0.000s
I20260709 13:05:36.002890 18508 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.004155 12692 raft_consensus.cc:2393] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 20: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:35.997316 18800 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:36.006389 18508 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:36.006937 18800 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.008881 18736 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:36.009483 18736 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:35.971333 18283 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:36.010695 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2003) took 1232 ms. Trace:
I20260709 13:05:35.968381 18732 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.011087 17964 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:36.011147 12543 rpcz_store.cc:276] 0709 13:05:34.778094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.778583 (+   489us) service_pool.cc:224] Handling call
0709 13:05:34.778903 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:35.028094 (+249191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.010466 (+982372us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b5400079ed4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:36.010632 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":571179776}
I20260709 13:05:36.013137 18672 raft_consensus.cc:3055] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:35.896924 18293 consensus_queue.cc:237] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:35.914713 18497 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:36.005236 18712 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:35.949402 18798 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.927646 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:36.015638 13197 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:35.964426 18577 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:35.982704 18788 log.cc:927] Time spent T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.371s	user 0.000s	sys 0.001s
I20260709 13:05:36.035338 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:36.036918 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:36.037655 13197 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:36.044178 13235 raft_consensus.cc:3055] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:36.045468 13235 raft_consensus.cc:740] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:05:36.018180 18784 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.386s	user 0.001s	sys 0.000s
I20260709 13:05:36.021027 18282 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.051128 12541 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:05:36.053653 12588 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:36.066299 12588 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:36.068043 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:36.055723 13228 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:05:36.060161 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:36.017409 18651 raft_consensus.cc:3055] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:36.050180 13235 consensus_queue.cc:260] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.018553 18591 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:36.029242 18672 raft_consensus.cc:740] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:36.071251 18754 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:36.090260 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:36.083067 13235 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:05:36.071528 12547 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:36.103422 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:36.105415 12588 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:36.110091 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:36.043995 18712 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:36.112425 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.980779 18011 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.011107 18283 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.121430 12620 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:36.121608 13231 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
I20260709 13:05:36.127900 18700 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:36.128651 18747 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:36.042834 18732 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.083292 18653 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:36.090313 18806 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.137589 18806 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:36.140194 18806 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:36.142194 18734 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:36.043493 18798 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:36.163735 18747 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:36.166999 18747 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:36.167806 18798 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:36.155120 18672 consensus_queue.cc:260] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:36.109287 18746 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:36.156312 18712 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.169251 18746 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.169427 18712 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.171434 18746 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:36.158622 18624 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:05:36.160964 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 55644.9us
I20260709 13:05:36.172859 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:36.175228 12588 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:36.004132 18584 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.082592 18524 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:36.073153 17964 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:36.183076 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:36.168905 18747 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:36.114156 18664 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:36.070881 18807 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:36.071179 18651 raft_consensus.cc:740] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:36.185236 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:36.205927 12614 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
W20260709 13:05:36.206327 12513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.011s	sys 0.019s
W20260709 13:05:36.206678 12513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.011s	sys 0.019s
I20260709 13:05:36.187207 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:36.206727 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:36.207008 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:36.207465 12617 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 17: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:36.168841 18672 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:36.046619 18577 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.172888 18731 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:36.207691 13232 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:05:36.208010 12614 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 17: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:36.204125 12545 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:05:36.211198 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:36.221153 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:36.222083 12615 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:36.223245 13197 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:36.223399 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:36.172029 18712 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:36.212080 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:36.203497 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:36.207001 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 506013us
I20260709 13:05:36.214378 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:36.214546 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:36.118464 18591 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.264510 12693 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:05:36.225862 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:36.233534 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:05:36.264695 12587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.004s	sys 0.017s
I20260709 13:05:36.090214 18282 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.182940 18524 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:36.264997 13199 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.005s	sys 0.017s
I20260709 13:05:36.232823 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:36.300760 13199 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.005s	sys 0.017s
I20260709 13:05:36.194952 18676 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:36.269281 12547 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:36.311570 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:36.268860 12587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.005s	sys 0.017s
W20260709 13:05:36.312655 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 670259us
I20260709 13:05:36.227041 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:36.272899 12662 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:36.275101 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:36.367363 12690 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:05:36.279277 13230 raft_consensus.cc:2393] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 20: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:36.279951 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:36.194759 18734 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:05:36.218065 18510 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.011s	sys 0.020s
I20260709 13:05:36.301091 13228 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:36.233351 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:36.303781 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:36.301158 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 662058us
I20260709 13:05:36.211218 18746 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:36.268404 12513 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:36.360318 12587 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:36.297423 18613 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:36.372803 12545 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:36.372934 12617 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
W20260709 13:05:36.287983 18484 consensus_meta.cc:287] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.649s	user 0.011s	sys 0.000s
I20260709 13:05:36.379606 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:36.308775 18524 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:36.386632 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 118330us
I20260709 13:05:36.286535 18731 raft_consensus.cc:697] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:36.380158 13199 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:36.387559 12618 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:05:36.380710 12587 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:36.217870 18806 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.156s
W20260709 13:05:36.380620 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 107851us
I20260709 13:05:36.386634 18746 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:36.386734 18432 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:36.388782 12619 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:36.393713 18803 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:36.396016 18726 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:36.398833 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:36.399480 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:36.405015 18727 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:36.419386 12545 raft_consensus.cc:2410] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260709 13:05:36.377682 18510 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.011s	sys 0.024s
I20260709 13:05:36.429057 18577 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:36.419850 18727 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.418577 18812 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:05:36.430132 18727 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:36.434685 18591 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:36.435446 18591 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:36.436280 18591 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:36.436985 18591 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:36.438055 12693 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:05:36.439730 12688 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:05:36.372417 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 145498us
I20260709 13:05:36.300179 18736 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 13:05:36.376358 18497 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:36.411463 12513 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:36.281891 18807 consensus_queue.cc:1059] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.122s
I20260709 13:05:36.381386 18613 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.417528 12694 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:36.377611 18676 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.186107 18754 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:36.229387 13231 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:05:36.419714 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:36.224994 18618 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.152s
I20260709 13:05:36.419224 18432 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.466602 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:36.467381 12694 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:05:36.468024 18432 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:36.468497 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:36.469022 18790 log.cc:927] Time spent T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 13:05:36.399720 18508 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:36.469882 18508 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.470355 18508 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:36.471452 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3422) took 1160 ms. Trace:
I20260709 13:05:36.424367 18803 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.471918 12544 rpcz_store.cc:276] 0709 13:05:35.311417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.327768 (+ 16351us) service_pool.cc:224] Handling call
0709 13:05:35.328213 (+   445us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:05:35.328585 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:35.328613 (+    28us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:05:35.341937 (+ 13324us) log.cc:844] Serialized 78 byte log entry
0709 13:05:35.670830 (+328893us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:35.711419 (+ 40589us) log.cc:844] Serialized 14 byte log entry
0709 13:05:35.908812 (+197393us) log.cc:844] Serialized 14 byte log entry
0709 13:05:35.969997 (+ 61185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.970275 (+   278us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:36.471171 (+500896us) raft_consensus.cc:1685] finished
0709 13:05:36.471209 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.471384 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69678,"prepare.queue_time_us":174050,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":96,"raft.queue_time_us":373141,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":4373,"thread_start_us":448444,"threads_started":2,"wal-append.queue_time_us":724266}
I20260709 13:05:36.475415 18803 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:36.446151 12688 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:05:36.477995 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:36.478893 12688 raft_consensus.cc:2410] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:05:36.479193 12544 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 12. Current term is 14. Ops: []
I20260709 13:05:36.479319 18282 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:36.480044 12688 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 13:05:36.480391 18807 consensus_queue.cc:1243] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer a70479a3b4114f3581095e9890f5d653 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:05:36.424387 18462 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:05:36.481742 18807 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:36.417253 18810 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:36.483549 18810 raft_consensus.cc:697] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:36.484979 18282 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:36.485639 18282 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:36.437546 18591 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.488656 18282 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:36.452050 13235 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
W20260709 13:05:36.455770 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 44365.1us
I20260709 13:05:36.417438 18178 consensus_queue.cc:1059] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:05:36.438531 18726 raft_consensus.cc:697] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:36.489854 12688 raft_consensus.cc:1240] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:36.490942 12513 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:36.403646 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:36.459370 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:36.492118 18726 consensus_queue.cc:237] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.401193 18484 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:36.486032 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:36.216679 18753 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.005s	sys 0.015s
I20260709 13:05:36.482298 18807 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.494194 12689 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:36.494639 12694 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:36.495343 18484 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:36.424154 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:36.449066 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:36.496276 18807 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:36.484578 18810 consensus_queue.cc:237] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.496487 12693 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:36.497977 12693 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:36.498541 18795 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:36.486104 18746 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:36.499634 18745 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:36.500379 18618 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:36.502090 12588 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:36.501489 18753 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.888s	user 0.005s	sys 0.015s
I20260709 13:05:36.501371 12694 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:36.503684 18807 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:36.504101 18807 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.504617 18807 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:36.490581 18730 consensus_queue.cc:1059] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:05:36.472287 18731 consensus_queue.cc:237] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.508639 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:36.509111 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 85053.5us
I20260709 13:05:36.509403 13230 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:05:36.512743 12662 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:36.513967 12662 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:36.514254 13230 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:05:36.516752 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:36.518628 12661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.020s	sys 0.069s
W20260709 13:05:36.518931 12661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.020s	sys 0.069s
I20260709 13:05:36.195325 18624 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.462792 18613 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:36.556833 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:36.557801 13233 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:05:36.547969 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:36.549961 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:36.549301 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:36.548893 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:36.562089 13230 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:36.562479 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:36.532425 12662 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:36.565387 12662 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:36.571341 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:36.572326 13235 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:36.540742 18806 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:36.574903 18432 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:36.540957 18590 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:05:36.575383 18432 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.575853 18432 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:36.523102 18746 raft_consensus.cc:3055] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:36.576728 18746 raft_consensus.cc:740] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:36.572007 18462 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:36.577541 18746 consensus_queue.cc:260] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.578303 18462 raft_consensus.cc:697] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:36.578841 18746 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:36.579218 18462 consensus_queue.cc:237] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.580581 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:36.540230 18700 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:36.518468 18584 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:36.199425 18124 consensus_queue.cc:237] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.541960 18745 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:36.541687 18626 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.586896 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:36.550310 18744 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:36.612943 18754 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.003s
W20260709 13:05:36.604280 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.557579 18591 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:36.618944 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:36.521668 18484 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:36.587242 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:36.577404 18684 raft_consensus.cc:3055] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:36.612581 13233 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:36.621096 13230 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
W20260709 13:05:36.620561 18781 log.cc:927] Time spent T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 1.009s	user 0.000s	sys 0.004s
I20260709 13:05:36.626379 12513 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:36.574957 18806 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:36.620471 18484 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:36.621311 18744 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.667356 18484 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:36.668684 18700 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:05:36.669490 18813 log.cc:927] Time spent T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 13:05:36.670782 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:36.671401 12621 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:05:36.671550 13230 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 19: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:36.671754 12621 pending_rounds.cc:85] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 8
I20260709 13:05:36.671990 12621 pending_rounds.cc:107] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:05:36.672233 12621 raft_consensus.cc:2889] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:36.672456 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1533) took 1019 ms. Trace:
I20260709 13:05:36.619922 18626 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.672788 12616 rpcz_store.cc:276] 0709 13:05:35.652943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.682440 (+ 29497us) service_pool.cc:224] Handling call
0709 13:05:35.682735 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:35.711631 (+ 28896us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:05:35.711660 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:35.719851 (+  8191us) log.cc:844] Serialized 26 byte log entry
0709 13:05:36.035240 (+315389us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:36.035277 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.035342 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:36.672257 (+636915us) raft_consensus.cc:1685] finished
0709 13:05:36.672279 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.672405 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103300,"raft.queue_time_us":31869,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":55899,"thread_start_us":150376,"threads_started":1,"wal-append.queue_time_us":498049}
I20260709 13:05:36.674669 18626 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:36.675567 18484 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:36.677856 18484 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:36.679612 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:36.686775 13230 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:36.621768 18684 raft_consensus.cc:740] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:36.682667 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:36.718335 13233 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:36.720831 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:36.724591 12547 raft_consensus.cc:1275] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:05:36.735468 12543 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:36.762779 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 57451.9us
I20260709 13:05:36.765492 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:36.651736 18584 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:36.836423 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:36.853680 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 151602us
I20260709 13:05:36.854651 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:36.858546 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:36.859094 12662 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:36.859357 12547 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:36.869704 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:36.867652 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:36.879544 12543 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:05:36.882766 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:36.921108 12547 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:36.922283 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:36.923030 12547 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:36.669548 18744 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:36.890419 12512 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
W20260709 13:05:36.868778 18429 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.051s	sys 0.120s
I20260709 13:05:36.696141 18700 raft_consensus.cc:697] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 17 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:36.866899 18812 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:36.906350 12619 raft_consensus.cc:1275] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:05:36.909276 12691 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.020s	sys 0.027s
W20260709 13:05:36.973035 12691 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.020s	sys 0.027s
I20260709 13:05:36.964700 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1353) took 2351 ms. Trace:
I20260709 13:05:36.941634 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:36.975942 12541 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 11.
I20260709 13:05:36.977255 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:36.978593 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:36.681388 18800 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:36.855283 18747 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:36.962145 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 71865.5us
W20260709 13:05:36.967550 12587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.012s	sys 0.028s
W20260709 13:05:36.903681 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 44665.5us
I20260709 13:05:36.872670 18791 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:36.694101 13230 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:36.884754 18497 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.988379 12512 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:36.988404 12662 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:36.995456 12662 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:36.902709 18484 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:37.002731 12512 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:36.973694 12546 rpcz_store.cc:276] 0709 13:05:34.590455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.591711 (+  1256us) service_pool.cc:224] Handling call
0709 13:05:34.592070 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:34.770543 (+178473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:34.770575 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:34.811111 (+ 40536us) log.cc:844] Serialized 52 byte log entry
0709 13:05:35.237842 (+426731us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b18004662a0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:05:35.345415 (+107573us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:35.642715 (+297300us) log.cc:844] Serialized 14 byte log entry
0709 13:05:36.046949 (+404234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.599873 (+552924us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54003bddd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:36.599933 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:36.617031 (+ 17098us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:36.941299 (+324268us) raft_consensus.cc:1685] finished
0709 13:05:36.941325 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.941754 (+   429us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1118,"prepare.queue_time_us":48419,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":4087,"raft.queue_time_us":389344,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":50126,"spinlock_wait_cycles":451766144,"thread_start_us":769130,"threads_started":3,"wal-append.queue_time_us":736082}
W20260709 13:05:36.989063 12587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.012s	sys 0.028s
I20260709 13:05:36.997411 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:37.004238 12695 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:36.907639 18577 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:05:36.958580 18429 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.051s	sys 0.121s
I20260709 13:05:36.856150 18178 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.105s
I20260709 13:05:36.900589 18590 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:36.964427 18293 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:36.875422 18584 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:36.986915 18508 consensus_meta.cc:287] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.516s	user 0.012s	sys 0.000s
I20260709 13:05:37.027812 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:37.046883 13199 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.010s	sys 0.032s
I20260709 13:05:37.038395 12695 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:37.049226 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:37.006036 18800 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:05:37.050442 13199 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.010s	sys 0.032s
W20260709 13:05:37.045547 18734 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.006s	sys 0.035s
I20260709 13:05:37.007040 18676 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:37.021018 18293 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.019627 18736 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.073155 13199 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:37.001746 18803 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:05:37.047143 18524 consensus_meta.cc:287] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.636s	user 0.002s	sys 0.008s
I20260709 13:05:37.007493 18497 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:37.075999 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 58215.8us
I20260709 13:05:36.992408 18812 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:37.066893 18781 log.cc:927] Time spent T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:05:37.014565 18484 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.048775 18429 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:37.051059 18588 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.004362 18747 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.049969 18744 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.984974 18684 consensus_queue.cc:260] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:37.085248 18624 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:37.066807 18734 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.007s	sys 0.035s
I20260709 13:05:37.096153 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:37.087323 18617 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:37.001430 18791 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.069408 17964 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.020033 18577 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:37.101106 12585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.024s	sys 0.028s
I20260709 13:05:37.045353 18590 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.079875 18293 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:37.136528 18590 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:37.109086 18429 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:37.137719 18827 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:37.109764 18591 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:37.138248 18827 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.138760 18827 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:37.138612 18591 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.139377 18429 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:37.141180 18591 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:37.104971 18810 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.015s	sys 0.023s
W20260709 13:05:37.142050 18810 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.016s	sys 0.025s
I20260709 13:05:37.142086 18814 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:37.142953 18814 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.051316 18508 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:37.146421 18613 consensus_meta.cc:287] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.564s	user 0.005s	sys 0.005s
I20260709 13:05:37.066004 18800 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:37.147178 18800 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:37.147491 18508 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:37.148203 18508 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:37.148739 18508 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.082166 18676 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:37.099033 18672 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:37.128612 12585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.024s	sys 0.029s
I20260709 13:05:37.062474 18700 consensus_queue.cc:237] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.119308 18178 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:37.228365 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2014) took 2445 ms. Trace:
W20260709 13:05:37.230005 13227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 1444) took 1651 ms (client timeout 2174 ms). Trace:
I20260709 13:05:37.229207 12540 rpcz_store.cc:276] 0709 13:05:34.782936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.863928 (+ 80992us) service_pool.cc:224] Handling call
0709 13:05:34.864201 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:34.993209 (+129008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.228044 (+2234835us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54000695d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:37.228288 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":295205248}
I20260709 13:05:37.134339 18577 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:37.107836 18588 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:37.111971 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 2185) took 1031 ms. Trace:
I20260709 13:05:37.233371 12689 rpcz_store.cc:276] 0709 13:05:36.080619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.080818 (+   199us) service_pool.cc:224] Handling call
0709 13:05:36.081189 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:36.494627 (+413438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.111589 (+616962us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54000c80d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:37.111861 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":949372672}
W20260709 13:05:37.146559 18829 log.cc:927] Time spent T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 13:05:37.021242 18815 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:37.123389 12688 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:05:37.226994 18653 consensus_meta.cc:287] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 1.090s	user 0.004s	sys 0.011s
W20260709 13:05:37.153172 18826 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
I20260709 13:05:37.217917 12541 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:37.260842 12615 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
W20260709 13:05:37.141813 18817 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.369s	user 0.001s	sys 0.000s
I20260709 13:05:37.161072 18806 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:37.218722 12616 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 12. Current term is 14. Ops: []
I20260709 13:05:37.219367 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:37.222536 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.099887 18630 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:05:37.090415 18736 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.091522 18803 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:37.096937 18524 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.119649 18734 raft_consensus.cc:697] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:05:37.230484 13227 rpcz_store.cc:269] 0709 13:05:35.578485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.580140 (+  1655us) service_pool.cc:224] Handling call
0709 13:05:37.229800 (+1649660us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b5400511b54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:37.229928 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":627089664}
I20260709 13:05:37.241109 18815 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:37.236279 18819 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.467s	user 0.001s	sys 0.000s
I20260709 13:05:37.237524 18588 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:37.241909 13234 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.014s	sys 0.033s
W20260709 13:05:37.310942 13234 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.014s	sys 0.033s
I20260709 13:05:37.153803 18613 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.116124 18744 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:37.227481 18753 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.013s	sys 0.031s
W20260709 13:05:37.323367 18753 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.014s	sys 0.032s
I20260709 13:05:37.324826 13229 raft_consensus.cc:2368] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 18. Current term is 19.
I20260709 13:05:37.325114 18791 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:37.326144 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 1446) took 1093 ms. Trace:
I20260709 13:05:37.326503 13229 rpcz_store.cc:276] 0709 13:05:36.232798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.232929 (+   131us) service_pool.cc:224] Handling call
0709 13:05:37.325931 (+1093002us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b54006315d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:37.326086 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2191977728}
W20260709 13:05:37.327037 18664 consensus_meta.cc:287] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 1.122s	user 0.010s	sys 0.002s
I20260709 13:05:37.327428 18664 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:37.329458 18800 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.330435 18508 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:37.332386 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2029) took 1300 ms. Trace:
I20260709 13:05:37.334795 12622 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 16. Current term is 17. Ops: []
W20260709 13:05:37.242007 18723 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.021s	sys 0.021s
I20260709 13:05:37.217406 18665 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:37.273003 13200 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.002s	sys 0.043s
W20260709 13:05:37.339247 13200 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.002s	sys 0.043s
W20260709 13:05:37.278271 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 275582us
I20260709 13:05:37.228854 18178 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:37.172472 17964 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:37.279999 18462 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.012s	sys 0.015s
W20260709 13:05:37.270140 18124 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.011s	sys 0.034s
I20260709 13:05:37.145373 18814 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:37.297662 13235 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.008s	sys 0.022s
I20260709 13:05:37.234570 18672 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.229635 18676 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.320099 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 2184) took 1241 ms. Trace:
I20260709 13:05:37.329493 18812 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:37.321857 18484 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:37.322933 18744 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:37.332904 12539 rpcz_store.cc:276] 0709 13:05:36.031655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.031945 (+   290us) service_pool.cc:224] Handling call
0709 13:05:36.032281 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.032628 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.032659 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:36.033107 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:05:36.419313 (+386206us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:36.419362 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.419438 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:37.332056 (+912618us) raft_consensus.cc:1685] finished
0709 13:05:37.332087 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.332249 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9198,"raft.queue_time_us":680,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":10610,"thread_start_us":327870,"threads_started":1,"wal-append.queue_time_us":823701}
W20260709 13:05:37.343804 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.344611 13200 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:37.294601 18587 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:37.309427 18815 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:05:37.343823 18723 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.021s	sys 0.021s
I20260709 13:05:37.355413 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 2266) took 1175 ms. Trace:
I20260709 13:05:37.357787 12691 rpcz_store.cc:276] 0709 13:05:36.079255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.079447 (+   192us) service_pool.cc:224] Handling call
0709 13:05:36.079916 (+   469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.084752 (+  4836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.084801 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:36.117874 (+ 33073us) log.cc:844] Serialized 26 byte log entry
0709 13:05:36.973506 (+855632us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:36.973698 (+   192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.973795 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:37.319846 (+346051us) raft_consensus.cc:1685] finished
0709 13:05:37.319870 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.320034 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4291,"raft.queue_time_us":12369,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":1974,"thread_start_us":791114,"threads_started":1,"wal-append.queue_time_us":1076274}
I20260709 13:05:37.351694 18584 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:37.362478 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:37.349857 18462 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.013s	sys 0.015s
W20260709 13:05:37.349675 18124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.011s	sys 0.035s
W20260709 13:05:37.349185 18745 consensus_meta.cc:287] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.731s	user 0.007s	sys 0.003s
I20260709 13:05:37.401101 18745 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:37.347922 18178 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:37.401973 12547 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:05:37.403700 12694 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:37.404769 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 2170) took 2540 ms. Trace:
W20260709 13:05:37.369838 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 374453us
I20260709 13:05:37.405336 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:37.348153 18624 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.321192 18613 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:37.406586 12547 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:05:37.406868 18624 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.387845 12621 rpcz_store.cc:276] 0709 13:05:36.180250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.180380 (+   130us) service_pool.cc:224] Handling call
0709 13:05:36.199765 (+ 19385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:36.672639 (+472874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.355099 (+682460us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b540009a1d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:37.355338 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1083806592}
I20260709 13:05:37.409192 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:37.409991 12621 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:37.364023 18820 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:37.398828 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:37.367060 18497 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:37.371239 18835 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.399417 18676 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:37.365538 18834 consensus_queue.cc:1059] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 13:05:37.406571 12662 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:37.442358 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:37.406565 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:37.345834 18665 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:37.452354 18744 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:05:37.399152 18727 consensus_meta.cc:287] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.968s	user 0.010s	sys 0.005s
I20260709 13:05:37.453987 18727 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.368691 18653 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:37.418951 18617 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:37.455435 18653 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.456856 13232 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 13:05:37.386054 18827 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.424494 18557 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:05:37.426555 18839 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.107s	user 0.002s	sys 0.001s
I20260709 13:05:37.459000 18653 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:37.405124 12687 rpcz_store.cc:276] 0709 13:05:34.864283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.865417 (+  1134us) service_pool.cc:224] Handling call
0709 13:05:35.621933 (+756516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:35.890226 (+268293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:35.891236 (+  1010us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:35.898733 (+  7497us) log.cc:844] Serialized 26 byte log entry
0709 13:05:36.366379 (+467646us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:36.366432 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.366529 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:37.331616 (+965087us) raft_consensus.cc:1685] finished
0709 13:05:37.331635 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.404441 (+ 72806us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b54000c67d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:37.404691 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":59764,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":17775,"spinlock_wait_cycles":1739137792,"thread_start_us":665675,"threads_started":2,"wal-append.queue_time_us":701389}
I20260709 13:05:37.426551 12588 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:37.332859 18651 consensus_queue.cc:260] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:37.460172 18651 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:37.460515 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:37.461777 12588 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:37.461944 12621 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:37.462921 18676 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:37.454314 12662 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:37.453018 18744 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.463668 18832 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:37.464437 18832 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:37.464824 18832 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:37.465220 18832 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:37.465327 18744 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:37.466076 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1375) took 1187 ms. Trace:
I20260709 13:05:37.466419 12662 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:37.466442 18664 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:37.467358 18744 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:37.468127 18744 raft_consensus.cc:697] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:37.466578 12545 rpcz_store.cc:276] 0709 13:05:36.278558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.434030 (+155472us) service_pool.cc:224] Handling call
0709 13:05:36.434387 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.459131 (+ 24744us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.459182 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:36.510156 (+ 50974us) log.cc:844] Serialized 26 byte log entry
0709 13:05:36.972695 (+462539us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:36.972738 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.972812 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:37.407448 (+434636us) spinlock_profiling.cc:243] Waited 86 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:37.465700 (+ 58252us) raft_consensus.cc:1685] finished
0709 13:05:37.465733 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.466003 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13171,"raft.queue_time_us":13346,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":10957,"spinlock_wait_cycles":197863168,"thread_start_us":398804,"threads_started":1,"wal-append.queue_time_us":757216}
I20260709 13:05:37.469440 18744 consensus_queue.cc:237] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.473245 18827 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:37.473289 18462 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:37.473861 12662 leader_election.cc:400] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 18. Current term is 19.
I20260709 13:05:37.474277 12662 leader_election.cc:403] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:37.474162 18462 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:37.475023 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:37.475878 13228 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:37.474809 18462 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:37.482481 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:37.483518 12621 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:37.484010 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:37.485590 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:37.486757 18557 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:37.487217 18557 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:37.487658 18557 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:37.493750 18727 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:37.500880 12613 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:05:37.501468 12613 pending_rounds.cc:85] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 9
I20260709 13:05:37.501760 12613 pending_rounds.cc:107] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:05:37.502022 12613 raft_consensus.cc:2889] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:37.509821 18827 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:05:37.513034 12621 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:05:37.409284 18624 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:37.403723 18747 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:37.542042 13198 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.11.44.254:44047, user_credentials={real_user=slave}} blocked reactor thread for 93275.1us
I20260709 13:05:37.550263 13233 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 13:05:37.550474 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:37.543548 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:37.544437 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:37.552673 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 174029us
W20260709 13:05:37.545905 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 451580us
I20260709 13:05:37.508952 18462 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.559351 12659 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:37.535679 18497 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:05:37.563105 12587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.014s	sys 0.026s
I20260709 13:05:37.392781 18587 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:37.553680 18432 consensus_meta.cc:287] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.977s	user 0.006s	sys 0.008s
W20260709 13:05:37.555493 18807 consensus_meta.cc:287] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 1.050s	user 0.010s	sys 0.006s
I20260709 13:05:37.568192 18524 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:37.545413 18124 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:05:37.567130 12587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.014s	sys 0.026s
I20260709 13:05:37.576576 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:37.385988 18734 consensus_queue.cc:237] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.585186 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1316) took 1037 ms. Trace:
I20260709 13:05:37.585740 13234 rpcz_store.cc:276] 0709 13:05:36.548272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.548395 (+   123us) service_pool.cc:224] Handling call
0709 13:05:36.548693 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:36.548901 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:05:37.311334 (+762433us) log.cc:844] Serialized 14 byte log entry
0709 13:05:37.584734 (+273400us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:37.584804 (+    70us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:37.584860 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.584949 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.585115 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":458369,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":14754,"thread_start_us":1035125,"threads_started":2}
I20260709 13:05:37.558281 18731 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:37.594941 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:37.591962 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3769) took 1171 ms. Trace:
I20260709 13:05:37.591642 13200 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:37.574030 18746 consensus_meta.cc:287] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.995s	user 0.012s	sys 0.000s
I20260709 13:05:37.563081 18800 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:37.574479 18497 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.589171 18613 raft_consensus.cc:3055] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:37.617775 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:37.579672 18745 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:37.440052 18835 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:37.599231 18676 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.596902 18664 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.615262 18497 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:37.602092 18524 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.625803 12587 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:37.628978 17964 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:37.618047 18846 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.627121 18731 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
W20260709 13:05:37.631785 18842 log.cc:927] Time spent T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:05:37.632097 18833 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.185s
I20260709 13:05:37.633718 18462 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:37.634835 18664 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.670674 18664 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:37.671339 18664 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:37.671778 18664 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.672194 18664 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:37.559846 18484 consensus_queue.cc:1059] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
W20260709 13:05:37.675621 18844 log.cc:927] Time spent T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:05:37.676921 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1319) took 1097 ms. Trace:
I20260709 13:05:37.677297 13235 rpcz_store.cc:276] 0709 13:05:36.579715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.582629 (+  2914us) service_pool.cc:224] Handling call
0709 13:05:36.582968 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.583373 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.583410 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:36.583960 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 13:05:37.350212 (+766252us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:37.350259 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.350328 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:37.676664 (+326336us) raft_consensus.cc:1685] finished
0709 13:05:37.676686 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.676845 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2932,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":108,"thread_start_us":586655,"threads_started":1,"wal-append.queue_time_us":883441}
I20260709 13:05:37.679148 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:37.655906 18814 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:05:37.686271 18814 consensus_queue.cc:1243] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer a11816c5d72e4d1295a242f3ced09e5f log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:05:37.686651 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:37.687850 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:37.688840 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:37.691016 18011 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:37.691349 18664 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.692021 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 2265) took 1512 ms. Trace:
I20260709 13:05:37.692444 12622 rpcz_store.cc:276] 0709 13:05:36.179766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.179905 (+   139us) service_pool.cc:224] Handling call
0709 13:05:36.204794 (+ 24889us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:37.335296 (+1130502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.691790 (+356494us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54001caf54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:37.691946 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2598190336}
I20260709 13:05:37.694005 18835 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:37.652112 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:37.589036 18432 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.694815 12621 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:37.695742 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:37.696653 18432 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:37.599252 18651 consensus_queue.cc:1059] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:05:37.697451 12695 raft_consensus.cc:2368] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:05:37.622340 18560 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:05:37.698030 18651 raft_consensus.cc:3055] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:37.698429 18651 raft_consensus.cc:740] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:37.665059 18524 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.699244 18651 consensus_queue.cc:260] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.700857 18651 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:37.595674 18124 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:37.701165 18856 consensus_queue.cc:1175] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7ad68e814a7741488971822f2598183a" responder_term: 17 status { last_received { term: 17 index: 14 } last_committed_idx: 14 last_received_current_leader { term: 17 index: 14 } }
W20260709 13:05:37.702960 18841 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:05:37.703619 18124 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:37.589792 18807 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.706041 18807 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:37.706410 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:37.661070 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:37.620883 18613 raft_consensus.cc:740] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:37.706827 18557 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.708103 18613 consensus_queue.cc:260] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.623446 18803 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:37.623116 18736 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:37.693878 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:37.720700 12622 raft_consensus.cc:2393] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 19: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:37.613736 18810 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:05:37.656946 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:37.640362 12659 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:37.711052 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:37.615051 18508 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:05:37.696832 12621 raft_consensus.cc:2410] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
W20260709 13:05:37.729067 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 88832.4us
I20260709 13:05:37.722529 13235 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:37.725682 12547 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
W20260709 13:05:37.718128 18293 consensus_meta.cc:287] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.576s	user 0.008s	sys 0.002s
I20260709 13:05:37.731958 12659 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:37.731526 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:37.637151 18588 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260709 13:05:37.735991 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:37.738389 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:37.709020 18557 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:37.718957 18807 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.720547 18664 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:37.768118 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:37.652987 18676 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:37.770970 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:37.772403 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:37.664850 18800 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:05:37.775204 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:37.778450 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 152791us
I20260709 13:05:37.737648 18524 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:37.787262 18746 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:37.799126 18746 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:37.801594 18591 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:37.802299 18676 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:37.802143 18591 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:37.787047 18664 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:05:37.804405 18591 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:37.737315 18293 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:37.805876 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:37.806811 18293 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:37.807307 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:37.807554 18848 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.808513 18848 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:37.810636 18848 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:37.810909 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.810724 18178 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:37.797924 18853 consensus_queue.cc:1059] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:05:37.812386 18853 raft_consensus.cc:3055] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:37.812752 18853 raft_consensus.cc:740] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:37.813134 18178 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:37.767867 18432 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:37.808018 12622 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:37.737908 18803 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:37.709197 18846 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:37.825793 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.801350 18746 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:37.740583 18613 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:37.855908 12547 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:05:37.814116 18850 log.cc:927] Time spent T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:05:37.839787 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:37.860874 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:37.771819 18807 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.866047 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:37.866673 12696 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:37.869254 18803 raft_consensus.cc:697] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:37.870380 18846 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:37.870608 18807 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:37.870260 18803 consensus_queue.cc:237] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:37.873714 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1537) took 1668 ms. Trace:
I20260709 13:05:37.874230 12616 rpcz_store.cc:276] 0709 13:05:36.205122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.675416 (+470294us) service_pool.cc:224] Handling call
0709 13:05:36.675698 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:37.281534 (+605836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.873404 (+591870us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b54003d09d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:37.873648 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1089992576}
I20260709 13:05:37.875499 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:37.879899 18832 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:37.813629 18853 consensus_queue.cc:260] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:37.882304 18853 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:37.882769 18832 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:37.879937 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1315) took 1332 ms. Trace:
I20260709 13:05:37.886065 13232 rpcz_store.cc:276] 0709 13:05:36.547924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.550137 (+  2213us) service_pool.cc:224] Handling call
0709 13:05:36.550538 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:37.457373 (+906835us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.879684 (+422311us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b5400740254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:37.879877 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2083607424}
I20260709 13:05:37.856033 18814 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:37.887446 18814 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:37.890005 18857 log.cc:927] Time spent T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.267s	user 0.000s	sys 0.000s
I20260709 13:05:37.890372 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1387) took 1015 ms. Trace:
I20260709 13:05:37.890779 12544 rpcz_store.cc:276] 0709 13:05:36.875220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.876470 (+  1250us) service_pool.cc:224] Handling call
0709 13:05:36.876724 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:37.217834 (+341110us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:05:37.258293 (+ 40459us) log.cc:844] Serialized 14 byte log entry
0709 13:05:37.614652 (+356359us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:37.614707 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:37.614752 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.890066 (+275314us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b54000794d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:37.890111 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.890319 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10012,"prepare.queue_time_us":40659,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":3612,"raft.queue_time_us":3856,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":4448,"spinlock_wait_cycles":698213632,"thread_start_us":355960,"threads_started":1,"wal-append.queue_time_us":415394}
W20260709 13:05:37.893347 12617 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 2273) took 1704 ms (client timeout 1671 ms). Trace:
W20260709 13:05:37.893971 12617 rpcz_store.cc:269] 0709 13:05:36.189036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.211794 (+ 22758us) service_pool.cc:224] Handling call
0709 13:05:37.893130 (+1681336us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54002a6cd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:37.893273 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242150656}
I20260709 13:05:37.895571 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:37.896314 12617 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
W20260709 13:05:37.898272 18865 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 13:05:37.889305 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1534) took 1690 ms. Trace:
I20260709 13:05:37.905014 13230 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:05:37.897336 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:37.906289 12617 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:37.816815 18432 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:37.595750 12619 rpcz_store.cc:276] 0709 13:05:36.421013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.000053 (+579040us) service_pool.cc:224] Handling call
0709 13:05:37.000455 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:37.000733 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:05:37.446750 (+446017us) log.cc:844] Serialized 14 byte log entry
0709 13:05:37.591579 (+144829us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:37.591634 (+    55us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:05:37.591697 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.591767 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.591893 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7107,"raft.queue_time_us":12549,"thread_start_us":563528,"threads_started":2}
I20260709 13:05:37.926364 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:37.907989 12692 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 2218) took 2228 ms (client timeout 2229 ms). Trace:
I20260709 13:05:37.903143 12614 rpcz_store.cc:276] 0709 13:05:36.198783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.302433 (+103650us) service_pool.cc:224] Handling call
0709 13:05:36.302904 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:36.517610 (+214706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.517644 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:36.517690 (+    46us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:36.517722 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.889084 (+1371362us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54003d0ed4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:37.889129 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.889250 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493278080}
I20260709 13:05:37.909652 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:37.928499 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:37.926556 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.930037 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:37.929219 12617 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
W20260709 13:05:37.927017 12692 rpcz_store.cc:269] 0709 13:05:35.636008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.640060 (+  4052us) service_pool.cc:224] Handling call
0709 13:05:37.864474 (+2224414us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b54003e8fd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:37.864602 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":735564672}
I20260709 13:05:37.936685 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:37.853816 18293 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:37.964263 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:37.937659 12692 raft_consensus.cc:2393] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 13: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:37.857164 18508 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.968189 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:37.968242 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:37.971560 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:37.972375 12696 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:37.957268 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.983708 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:37.969031 12622 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:05:37.993016 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:37.994066 12545 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:38.016753 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:38.023564 12619 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:37.933709 18432 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:38.057518 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:38.057781 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:38.058229 12547 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:05:38.063619 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:38.064463 12691 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:05:38.067901 12696 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
W20260709 13:05:38.062927 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 462023us
I20260709 13:05:38.069516 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:38.074707 12694 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:38.070583 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:38.076587 12544 raft_consensus.cc:2393] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 17: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:38.029043 18814 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:38.028841 18800 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:38.138331 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 1088) took 1960 ms. Trace:
I20260709 13:05:38.010407 18796 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:38.142864 12614 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:05:38.158351 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1541) took 1569 ms. Trace:
I20260709 13:05:38.057181 18484 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.154670 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:38.010634 18508 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:37.993198 18293 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:38.158819 12614 rpcz_store.cc:276] 0709 13:05:36.588829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.029179 (+1440350us) service_pool.cc:224] Handling call
0709 13:05:38.142544 (+113365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:38.158009 (+ 15465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.158284 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:38.155331 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:38.083280 18587 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:38.194674 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:38.227895 12545 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:38.168324 12512 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:38.231360 18866 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.233170 18584 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.161794 18630 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:38.234361 12619 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:05:38.330435 18584 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:38.331579 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 163340us
I20260709 13:05:38.332073 12619 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:05:38.332813 18584 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:38.180549 12547 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:38.332952 12512 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:38.330417 18866 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:38.334275 18584 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:38.149947 13226 rpcz_store.cc:276] 0709 13:05:36.178050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.178234 (+   184us) service_pool.cc:224] Handling call
0709 13:05:36.199751 (+ 21517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.200411 (+   660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.200439 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:36.209629 (+  9190us) log.cc:844] Serialized 26 byte log entry
0709 13:05:37.337795 (+1128166us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b18002a2a40. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:05:37.563108 (+225313us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:37.601901 (+ 38793us) log.cc:844] Serialized 14 byte log entry
0709 13:05:38.137661 (+535760us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b18002a2a40. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a6406c0a 00007fc3afb46219 00007fc3a648ea40 00007fc3a64894e4 00007fc3a6489455 00007fc3a9571060 00007fc3a9583716 00007fc3a9594287 00007fc3a9594208
0709 13:05:38.137888 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.138001 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.138055 (+    54us) raft_consensus.cc:1685] finished
0709 13:05:38.138075 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.138256 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28388,"prepare.queue_time_us":40615,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2560,"raft.queue_time_us":5924,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":11699,"spinlock_wait_cycles":35727360,"thread_start_us":225073,"threads_started":1,"wal-append.queue_time_us":1530666}
I20260709 13:05:38.334666 18584 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:38.335093 18584 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:38.336115 18866 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:38.336257 12619 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:05:38.207921 18700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.015s	sys 0.026s
W20260709 13:05:38.337790 18700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.014s	user 0.016s	sys 0.026s
I20260709 13:05:38.338266 12512 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:38.338660 12619 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:05:38.339258 12512 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:38.340294 18497 consensus_meta.cc:287] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.000s
I20260709 13:05:38.340700 18497 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:38.181941 18484 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:38.365459 18849 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:38.370481 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 298698us
I20260709 13:05:38.373318 17964 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:38.373916 17964 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:38.374514 18627 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:38.374737 18624 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:38.375140 18627 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:38.376248 17964 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:38.376616 18613 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.377154 18613 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:38.378856 18293 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:38.379210 18613 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:38.379572 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:38.375231 18624 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:38.369958 12512 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:38.382344 18587 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:38.382784 18587 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.383008 18499 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:38.383121 18587 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:38.383587 18624 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:38.384295 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:38.384718 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:38.384929 13226 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:05:38.369691 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 354359us
I20260709 13:05:38.387609 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:38.381461 12614 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:38.390385 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 2276) took 1011 ms. Trace:
I20260709 13:05:38.390853 12614 rpcz_store.cc:276] 0709 13:05:37.378695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.361789 (+983094us) service_pool.cc:224] Handling call
0709 13:05:38.381171 (+ 19382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.390053 (+  8882us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.390310 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:38.158886 18800 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:38.161926 18796 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:38.377372 18627 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:38.453536 18815 consensus_meta.cc:287] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.056s	user 0.008s	sys 0.002s
I20260709 13:05:38.454155 18888 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:38.454066 18815 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:38.454756 18888 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:38.455242 18888 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:38.456382 18815 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:38.458097 18508 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:38.459908 18800 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:38.462052 18587 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:38.419055 18484 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:05:38.419978 18867 log.cc:927] Time spent T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.264s	user 0.000s	sys 0.000s
W20260709 13:05:38.426191 18877 log.cc:927] Time spent T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.356s	user 0.001s	sys 0.000s
W20260709 13:05:38.427117 18870 log.cc:927] Time spent T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
W20260709 13:05:38.439203 18880 log.cc:927] Time spent T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
W20260709 13:05:38.443367 18651 consensus_meta.cc:287] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.742s	user 0.013s	sys 0.000s
I20260709 13:05:38.342679 18881 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:05:38.446605 18827 consensus_meta.cc:287] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.936s	user 0.009s	sys 0.005s
I20260709 13:05:38.450942 18497 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:38.451437 18429 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:38.462860 18796 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:38.415205 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:38.465873 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 3767) took 2064 ms. Trace:
I20260709 13:05:38.468586 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1536) took 2263 ms. Trace:
I20260709 13:05:38.487953 12620 rpcz_store.cc:276] 0709 13:05:36.204857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.579463 (+374606us) service_pool.cc:224] Handling call
0709 13:05:37.900577 (+1321114us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:37.900807 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:37.900843 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:37.900898 (+    55us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:37.900943 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.901019 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.468306 (+567287us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54002a6cd0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:38.468497 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3037575424}
I20260709 13:05:38.470775 12694 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:38.476585 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:38.490501 12539 raft_consensus.cc:2410] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:05:38.487589 12618 rpcz_store.cc:276] 0709 13:05:36.401822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.558229 (+156407us) service_pool.cc:224] Handling call
0709 13:05:38.465621 (+1907392us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54000203d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:38.465794 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2948636032}
I20260709 13:05:38.498905 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2038) took 1137 ms. Trace:
I20260709 13:05:38.486444 18651 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.485414 18881 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:38.512880 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 134706us
I20260709 13:05:38.528695 13226 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:38.512282 18651 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:38.508438 12543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.054s	sys 0.072s
I20260709 13:05:38.487751 18827 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 18. Current term is 19.
I20260709 13:05:38.499487 12540 rpcz_store.cc:276] 0709 13:05:37.361698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.394459 (+ 32761us) service_pool.cc:224] Handling call
0709 13:05:37.394841 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:37.444507 (+ 49666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:37.444535 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:37.445015 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 13:05:37.613952 (+168937us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:37.614006 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.614108 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.498616 (+884508us) raft_consensus.cc:1685] finished
0709 13:05:38.498644 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.498829 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49199,"raft.queue_time_us":49880,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":93252,"thread_start_us":53954,"threads_started":1,"wal-append.queue_time_us":396116}
I20260709 13:05:38.514602 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:38.487954 18584 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:38.543440 12543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.054s	sys 0.073s
I20260709 13:05:38.518044 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 1095) took 1076 ms. Trace:
I20260709 13:05:38.542649 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:38.521184 18499 raft_consensus.cc:697] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 19 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:05:38.548342 12615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 2271) took 2352 ms (client timeout 2679 ms). Trace:
I20260709 13:05:38.543977 13229 rpcz_store.cc:276] 0709 13:05:37.441274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.444369 (+  3095us) service_pool.cc:224] Handling call
0709 13:05:37.444727 (+   358us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:37.720397 (+275670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:37.720437 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:37.730121 (+  9684us) log.cc:844] Serialized 52 byte log entry
0709 13:05:37.789390 (+ 59269us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:37.790306 (+   916us) log.cc:844] Serialized 14 byte log entry
0709 13:05:38.362103 (+571797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.362196 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.517723 (+155527us) raft_consensus.cc:1685] finished
0709 13:05:38.517753 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.517967 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1226235,"prepare.queue_time_us":564,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":704418,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":23756,"thread_start_us":165883,"threads_started":2,"wal-append.queue_time_us":168477}
W20260709 13:05:38.548898 12615 rpcz_store.cc:269] 0709 13:05:36.188346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.222955 (+ 34609us) service_pool.cc:224] Handling call
0709 13:05:38.540522 (+2317567us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54001ea5d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:38.540679 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2384417664}
W20260709 13:05:38.544971 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 78679.4us
I20260709 13:05:38.556223 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:38.558928 12544 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
W20260709 13:05:38.547991 18853 consensus_meta.cc:287] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.663s	user 0.011s	sys 0.001s
I20260709 13:05:38.560135 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:38.560124 12659 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:38.553839 18732 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:38.566452 12659 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:38.568228 18508 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:38.568390 18815 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:38.570281 18881 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:38.565258 18587 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:38.567495 18827 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:05:38.572762 18746 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.005s	sys 0.011s
I20260709 13:05:38.572438 18484 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:05:38.590538 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.590732 18484 raft_consensus.cc:697] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 20 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:38.591866 18587 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.591681 18484 consensus_queue.cc:237] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:38.597923 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 73978.3us
I20260709 13:05:38.592379 18587 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:38.593782 18746 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.006s	sys 0.011s
I20260709 13:05:38.589040 18827 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:38.616736 18827 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:38.622344 18892 raft_consensus.cc:3055] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:38.622876 18892 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:05:38.623112 18884 log.cc:927] Time spent T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:05:38.623849 18892 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:38.612947 18651 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:38.638782 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:38.615803 18812 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:38.617862 18890 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:38.640910 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:38.647166 18587 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:38.587539 18499 consensus_queue.cc:237] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:38.649634 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:38.660620 12620 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:38.660746 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:38.649217 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:38.661711 12619 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:38.665331 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:38.666299 12614 raft_consensus.cc:2368] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18.
I20260709 13:05:38.667162 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:38.668349 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:38.669059 12659 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:38.668437 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1451) took 2075 ms. Trace:
I20260709 13:05:38.669543 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:38.672636 12614 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:38.669788 13231 rpcz_store.cc:276] 0709 13:05:36.593109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.650865 (+ 57756us) service_pool.cc:224] Handling call
0709 13:05:36.651348 (+   483us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.662954 (+ 11606us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:05:37.894770 (+1231816us) spinlock_profiling.cc:243] Waited 62 ms on lock 0x7b18004a00e0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a6489455 00007fc3acf713c7 00007fc3a95839a7 00007fc3a95930bf 00007fc3a9593038
0709 13:05:38.391562 (+496792us) log.cc:844] Serialized 14 byte log entry
0709 13:05:38.596218 (+204656us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:38.613332 (+ 17114us) log.cc:844] Serialized 26 byte log entry
0709 13:05:38.613533 (+   201us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:38.613611 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.613702 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.668167 (+ 54465us) raft_consensus.cc:1685] finished
0709 13:05:38.668260 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.668377 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7873,"prepare.queue_time_us":349819,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":2697,"raft.queue_time_us":8478,"raft.run_cpu_time_us":348,"raft.run_wall_time_us":55366,"spinlock_wait_cycles":142689536,"thread_start_us":612954,"threads_started":2,"wal-append.queue_time_us":171750}
I20260709 13:05:38.665392 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:38.645186 18888 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:38.680733 12618 pending_rounds.cc:85] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 8
I20260709 13:05:38.681596 12618 pending_rounds.cc:107] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:05:38.681877 12618 raft_consensus.cc:2889] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:38.692090 12619 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:38.655112 18899 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:38.695770 18899 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:38.698180 18899 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:38.702811 18827 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:38.709227 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:38.711844 18827 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:38.712795 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:38.663053 18890 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:38.715986 18890 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:38.718199 18432 consensus_meta.cc:287] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.648s	user 0.011s	sys 0.000s
I20260709 13:05:38.718695 18432 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:38.713649 12614 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:38.724678 12614 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:38.727914 18888 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:38.731248 18684 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:38.653913 18812 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:38.737685 18812 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:38.676739 18584 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:38.740875 18672 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:38.721378 18432 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:38.751308 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:38.752075 13231 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:38.758823 18283 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:38.760705 13197 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:38.762215 18881 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:38.762639 18881 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.763079 18881 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:38.763377 13231 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:05:38.766311 18837 log.cc:927] Time spent T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 1.380s	user 0.018s	sys 0.019s
I20260709 13:05:38.767768 18283 consensus_queue.cc:1059] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:38.769064 18732 raft_consensus.cc:3055] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:38.769421 18732 raft_consensus.cc:740] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:38.770620 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:38.770712 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:38.771466 12543 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:38.771972 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:38.772286 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:38.773526 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:38.775033 18584 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:38.775723 12616 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:38.775723 18584 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:38.777704 18874 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.778191 18874 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:38.779686 18584 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:38.781360 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:38.782717 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:38.784185 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:38.784878 12622 raft_consensus.cc:2368] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 17. Current term is 18.
I20260709 13:05:38.786392 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:38.787456 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:38.770358 18732 consensus_queue.cc:260] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:38.791625 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.793681 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:38.787914 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:38.788571 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:38.789604 13197 leader_election.cc:400] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 17. Current term is 18.
I20260709 13:05:38.795846 13197 leader_election.cc:403] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:38.800009 13200 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:38.835284 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:38.836167 13231 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:05:38.843489 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:38.845436 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:38.842849 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:38.847167 13197 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:38.837877 18907 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:05:38.841353 18712 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.800201 18888 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.799989 18626 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 17. Current term is 18.
I20260709 13:05:39.054315 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:39.084236 18908 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.323s	user 0.000s	sys 0.000s
I20260709 13:05:39.085340 18891 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:39.085942 18891 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:39.088091 18891 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:38.844874 18627 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:05:39.097937 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.099743 18627 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.100394 18627 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:39.043880 18654 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.102561 18654 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:38.856909 18624 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:39.107334 18732 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:39.075763 18712 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:39.112632 18712 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:39.132404 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:39.135996 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:39.136968 13229 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:39.166765 13229 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 21. Current term is 22. Ops: [21.14-21.14]
W20260709 13:05:39.175771 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.208997 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:39.114662 18888 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:39.241762 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:39.242857 18891 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:39.297128 13229 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:05:39.184151 18587 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:39.209856 18654 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:39.310345 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:39.316566 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:39.319702 18910 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:05:39.303160 18891 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:39.310207 18587 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:38.854034 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:39.331353 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 241280us
I20260709 13:05:39.332393 12618 raft_consensus.cc:2410] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:05:39.351284 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:39.352214 13234 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
W20260709 13:05:39.363412 12695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 2197) took 2346 ms (client timeout 1740 ms). Trace:
I20260709 13:05:39.366849 12513 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:05:39.363958 12695 rpcz_store.cc:269] 0709 13:05:37.017493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.048883 (+ 31390us) service_pool.cc:224] Handling call
0709 13:05:39.363206 (+2314323us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b54002ca454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:39.363340 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1488714624}
I20260709 13:05:39.367983 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:39.370163 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:39.370981 12618 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:39.412726 13229 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:05:39.416446 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.394873 18499 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:39.409314 18654 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:39.476585 18881 consensus_meta.cc:287] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.713s	user 0.008s	sys 0.003s
I20260709 13:05:39.477519 18881 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:39.481091 18881 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:39.454008 18712 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:39.437868 18654 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:39.471939 18888 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:39.492838 18891 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:39.499121 18712 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:39.501766 18283 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.502434 18587 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:39.502355 18283 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:39.503978 18712 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:39.504473 18283 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:39.508008 18654 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:39.509486 18912 log.cc:927] Time spent T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:05:39.511572 18723 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.512163 18723 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:39.515172 18723 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:39.516202 12692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 2205) took 1522 ms. Trace:
I20260709 13:05:39.516592 12692 rpcz_store.cc:276] 0709 13:05:37.993807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.993979 (+   172us) service_pool.cc:224] Handling call
0709 13:05:37.994269 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.365273 (+371004us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:38.365303 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:38.365368 (+    65us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:38.365399 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.515983 (+1150584us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b540022fe54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:39.516029 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.516146 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":427,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":852347136}
I20260709 13:05:39.522046 13226 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
W20260709 13:05:39.524230 18836 log.cc:927] Time spent T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 2.147s	user 0.009s	sys 0.016s
I20260709 13:05:39.523538 18627 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:39.526492 13230 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 1101) took 1874 ms (client timeout 1868 ms). Trace:
I20260709 13:05:39.526885 13231 raft_consensus.cc:2393] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:39.528010 18627 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:05:39.526888 13230 rpcz_store.cc:269] 0709 13:05:37.652519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.688635 (+ 36116us) service_pool.cc:224] Handling call
0709 13:05:39.526324 (+1837689us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b540063a954. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:39.526438 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":390781184}
I20260709 13:05:39.529492 18665 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:39.542876 18579 raft_consensus.cc:3055] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:39.543414 18579 raft_consensus.cc:740] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:39.547089 18892 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:05:39.590479 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 218314us
I20260709 13:05:39.592753 12513 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:39.596127 12513 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:39.610597 12662 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:39.613358 12662 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:39.632691 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.638172 18484 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:39.638918 18484 raft_consensus.cc:697] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:39.639699 18497 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:39.642203 18700 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:39.643005 18700 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.643581 18700 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:39.643227 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:39.645220 13230 raft_consensus.cc:2410] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:05:39.642100 18429 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:39.645987 18827 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:39.646371 18429 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:39.544299 18579 consensus_queue.cc:260] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:39.646534 18726 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:39.641083 18484 consensus_queue.cc:237] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:39.636983 18432 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:39.654719 18432 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:39.655705 12541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3438) took 2696 ms (client timeout 2073 ms). Trace:
W20260709 13:05:39.656241 12541 rpcz_store.cc:269] 0709 13:05:36.958740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.978376 (+ 19636us) service_pool.cc:224] Handling call
0709 13:05:39.655147 (+2676771us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54002cc754. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:39.655379 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413441408}
I20260709 13:05:39.672854 18827 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:39.673280 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1393) took 1258 ms. Trace:
I20260709 13:05:39.673877 18827 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:39.673765 12542 rpcz_store.cc:276] 0709 13:05:38.463750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.463887 (+   137us) service_pool.cc:224] Handling call
0709 13:05:39.655429 (+1191542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.655884 (+   455us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.655913 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.655970 (+    57us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:39.656006 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.656078 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.672865 (+ 16787us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54002cc750. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:39.673042 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2739316480}
I20260709 13:05:39.685961 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 2270) took 3497 ms. Trace:
I20260709 13:05:39.677788 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:39.677945 18587 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.688639 18432 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:39.689312 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 2210) took 1545 ms. Trace:
I20260709 13:05:39.689250 18587 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:39.689882 12696 rpcz_store.cc:276] 0709 13:05:38.143886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.146235 (+  2349us) service_pool.cc:224] Handling call
0709 13:05:38.146610 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.146849 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:05:38.538306 (+391457us) log.cc:844] Serialized 14 byte log entry
0709 13:05:38.776107 (+237801us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b1800414580. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a91214bc 00007fc3a646f48b 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a911923a
0709 13:05:39.688412 (+912305us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.688540 (+   128us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:39.688665 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.688786 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.689024 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":870716,"prepare.queue_time_us":442919,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":871253,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":220,"spinlock_wait_cycles":7320320,"thread_start_us":498823,"threads_started":3,"wal-append.queue_time_us":139431}
I20260709 13:05:39.692342 18587 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:39.677666 18827 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:39.695475 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:39.696573 13228 raft_consensus.cc:2393] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 19: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:39.696412 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:39.699505 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 1.03032e+06us
I20260709 13:05:39.701048 12659 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:39.687830 12613 rpcz_store.cc:276] 0709 13:05:36.187212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.187370 (+   158us) service_pool.cc:224] Handling call
0709 13:05:36.187725 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:37.502735 (+1315010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.683556 (+2180821us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54001cbe54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:39.684028 (+   472us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3018883840}
I20260709 13:05:39.702725 18827 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:39.703258 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:39.703688 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:39.704396 12613 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 20: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:39.707242 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:39.711592 13228 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:39.709985 13232 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:05:39.710636 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:39.717388 13235 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:39.718163 12614 raft_consensus.cc:2393] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 18: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:05:39.710686 12616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 2279) took 2295 ms (client timeout 1929 ms). Trace:
I20260709 13:05:39.718604 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 2195) took 2723 ms. Trace:
W20260709 13:05:39.718694 12616 rpcz_store.cc:269] 0709 13:05:37.415015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.875231 (+460216us) service_pool.cc:224] Handling call
0709 13:05:39.710266 (+1835035us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b54001eaad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:39.710460 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2068858624}
I20260709 13:05:39.719161 12688 rpcz_store.cc:276] 0709 13:05:36.995478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.996599 (+  1121us) service_pool.cc:224] Handling call
0709 13:05:36.996861 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:37.241310 (+244449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.718050 (+2476740us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b5400236ed4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:39.718416 (+   366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279100160}
I20260709 13:05:39.705771 12659 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:39.743695 13228 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
W20260709 13:05:39.741988 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 57762.8us
I20260709 13:05:39.744946 18827 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:39.748116 18827 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:39.749521 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 2214) took 1365 ms. Trace:
I20260709 13:05:39.751605 12659 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:39.748585 18827 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:39.768445 13199 connection.cc:256] RPC call timeout handler was delayed by -1.104472171999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1713s for a response
I20260709 13:05:39.759408 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:39.771739 13197 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:39.774075 12659 leader_election.cc:400] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18.
I20260709 13:05:39.761726 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:39.777393 13227 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:05:39.762521 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:39.773272 18924 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:39.773514 13197 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:39.781868 18723 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.798871 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:39.788920 18924 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:39.750236 12693 rpcz_store.cc:276] 0709 13:05:38.383912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.384487 (+   575us) service_pool.cc:224] Handling call
0709 13:05:38.384765 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.385082 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:05:38.586253 (+201171us) log.cc:844] Serialized 14 byte log entry
0709 13:05:39.726329 (+1140076us) log.cc:844] Serialized 14 byte log entry
0709 13:05:39.736863 (+ 10534us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.739575 (+  2712us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:39.741762 (+  2187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.749146 (+  7384us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.749334 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1767400,"prepare.queue_time_us":247820,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":95,"raft.queue_time_us":897879,"raft.run_cpu_time_us":484,"raft.run_wall_time_us":3501,"thread_start_us":435812,"threads_started":3,"wal-append.queue_time_us":171467}
I20260709 13:05:39.804162 18723 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:39.788759 18484 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:39.809537 18700 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:39.810294 18732 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:39.811034 18732 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:39.812512 18700 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:39.807384 18924 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:39.818219 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 44978.5us
I20260709 13:05:39.820072 18283 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:39.822178 13197 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:39.829507 18918 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:39.831723 18922 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:39.832489 18922 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:39.833161 18922 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:39.833693 18283 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.836165 18874 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:39.837069 18712 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:39.826354 18893 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.839480 18723 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:39.795361 18432 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:05:39.844054 18923 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.823791 18732 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:39.849116 18484 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.853364 18283 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:39.854038 18484 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:39.855432 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 1331) took 1012 ms. Trace:
I20260709 13:05:39.855816 13231 rpcz_store.cc:276] 0709 13:05:38.843140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.843258 (+   118us) service_pool.cc:224] Handling call
0709 13:05:39.855047 (+1011789us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b5400597254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:39.855259 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1568793344}
I20260709 13:05:39.856534 18484 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:39.859002 18923 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:39.862249 18923 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:39.856169 18283 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:39.870095 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:39.871201 12615 raft_consensus.cc:2410] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:05:39.872599 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:39.873517 12621 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:05:39.873598 18893 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:39.857190 18484 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:39.878698 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:39.847435 18712 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:39.882314 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:39.882951 18712 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:39.883447 13234 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:05:39.884533 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1545) took 2459 ms. Trace:
W20260709 13:05:39.885803 12538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 1385) took 3067 ms (client timeout 1520 ms). Trace:
W20260709 13:05:39.886204 12538 rpcz_store.cc:269] 0709 13:05:36.818575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.836017 (+ 17442us) service_pool.cc:224] Handling call
0709 13:05:39.885418 (+3049401us) spinlock_profiling.cc:243] Waited 2.75 s on lock 0x7b54003be7d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:39.885602 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6315748608}
I20260709 13:05:39.886818 18651 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.887367 13234 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:05:39.887794 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:39.887610 18651 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:39.889386 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:39.890321 13230 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:39.895241 18827 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:39.898247 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:39.899657 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.901180 18484 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:39.902565 12588 connection.cc:256] RPC call timeout handler was delayed by -1.3079344950000404s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1948s for a response
W20260709 13:05:39.914978 12588 connection.cc:256] RPC call timeout handler was delayed by -1.2809344949999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
W20260709 13:05:39.915596 12588 connection.cc:256] RPC call timeout handler was delayed by -1.2809344949999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
I20260709 13:05:39.903581 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2046) took 2245 ms. Trace:
I20260709 13:05:39.904163 18928 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.905395 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:39.905725 18874 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:39.906687 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:39.897275 18651 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:39.885830 18926 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.086s	user 0.004s	sys 0.000s
W20260709 13:05:39.933887 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.916289 12546 rpcz_store.cc:276] 0709 13:05:37.657800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.657954 (+   154us) service_pool.cc:224] Handling call
0709 13:05:37.658268 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:37.703571 (+ 45303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:37.703603 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:37.703647 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:37.703685 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.903087 (+2199402us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b540026aa54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:39.903162 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.903385 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103691136}
I20260709 13:05:39.928364 13197 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:39.928679 18484 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:39.937208 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:39.937938 13230 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:39.936225 18651 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.938614 18874 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:39.938648 18712 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:39.939637 18651 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:39.941159 18874 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:39.941255 18712 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:39.941833 12621 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:39.949048 18928 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:39.849346 18497 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:39.960107 18746 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:39.960783 18732 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:39.961234 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:39.969870 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:39.970023 18746 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:39.970610 12615 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:39.971347 18928 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:39.966990 18497 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:39.972491 18746 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:39.975986 12621 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
W20260709 13:05:39.977877 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 95765.1us
I20260709 13:05:39.965828 18732 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:39.986061 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:39.988071 13230 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:05:39.977105 18497 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:40.002592 12614 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 13:05:39.884959 12617 rpcz_store.cc:276] 0709 13:05:37.364840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.012868 (+648028us) service_pool.cc:224] Handling call
0709 13:05:38.013153 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:38.013360 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:05:38.082259 (+ 68899us) log.cc:844] Serialized 14 byte log entry
0709 13:05:38.522532 (+440273us) log.cc:844] Serialized 14 byte log entry
0709 13:05:39.692533 (+1170001us) spinlock_profiling.cc:243] Waited 8.32 ms on lock 0x7b1800258460. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a6489455 00007fc3a9571060 00007fc3a9583716 00007fc3a9594287 00007fc3a9594208
0709 13:05:39.753886 (+ 61353us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:39.789470 (+ 35584us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:39.795569 (+  6099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.800616 (+  5047us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.824471 (+ 23855us) inbound_call.cc:177] Queueing success response
0709 13:05:39.871904 (+ 47433us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b1800258460. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c522 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
Metrics: {"prepare.queue_time_us":24150,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":97,"raft.queue_time_us":223621,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":15693,"spinlock_wait_cycles":22888576,"thread_start_us":486175,"threads_started":2,"wal-append.queue_time_us":505683,"wal-append.run_cpu_time_us":2019,"wal-append.run_wall_time_us":1053126}
I20260709 13:05:39.993402 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:39.994341 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:39.983285 18732 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:40.010113 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:39.989984 18651 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:40.015604 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:40.020269 12622 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 17: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:40.020896 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:40.021705 18579 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:40.022392 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:40.022440 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:40.023375 12692 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:40.028754 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:40.017282 18712 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.030098 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:40.030139 12540 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:40.030264 18712 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:40.031955 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:40.032951 12545 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 15: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:40.029168 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:40.030979 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.017604 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:40.035138 18812 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:40.035614 18827 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:40.035827 18812 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:40.034008 12696 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
I20260709 13:05:40.007450 18484 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:40.029053 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:40.049881 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:40.051014 18893 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:40.052338 12546 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:05:40.055469 18924 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:40.056440 12693 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:40.059746 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:40.063938 18922 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:40.066358 12540 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:40.069114 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:40.070287 18922 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:40.073101 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:40.044446 18827 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:40.074930 18712 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:40.075487 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:40.076011 12615 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:40.077688 12622 raft_consensus.cc:1240] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:40.074564 18827 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:40.108394 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 69885.7us
I20260709 13:05:40.105751 12662 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:40.089032 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 59140.4us
I20260709 13:05:40.109530 13197 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:40.115345 18712 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:40.115980 18712 raft_consensus.cc:697] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:40.117622 18812 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:40.117776 18651 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.118378 18651 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:40.120718 18651 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:40.113529 18484 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:40.122084 12688 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:40.123581 18484 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:40.117163 18712 consensus_queue.cc:237] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:40.126113 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:40.126322 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:40.126744 12620 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:40.127648 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:40.130308 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:40.132200 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:40.134078 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:40.135619 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:40.134155 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:40.140256 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:40.141017 12618 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:40.142382 12692 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:05:40.149879 18893 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:40.150657 18922 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:40.151165 18812 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:40.151983 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 118188us
I20260709 13:05:40.152824 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:40.146867 12513 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:40.153972 18932 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:40.153975 18584 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:40.154598 18932 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:40.155150 18932 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:40.156471 18732 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:40.158402 12662 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:40.151778 18812 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:40.160933 18812 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:40.161979 18584 raft_consensus.cc:697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:40.163067 18584 consensus_queue.cc:237] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:40.174949 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.169842 12688 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:40.170135 18923 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:40.150542 18893 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:40.180176 18893 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:40.182214 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:40.182601 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:40.182999 12620 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:40.183301 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:40.183972 12618 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:05:40.185026 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:40.185941 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:40.186578 12619 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:05:40.185663 12621 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:40.185519 12588 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:40.200400 12617 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:40.198185 12693 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:40.184005 12512 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:40.221474 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:40.221846 18923 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.222723 13233 raft_consensus.cc:1240] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:40.222514 18923 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:40.224813 18923 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:40.225590 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:40.226438 12622 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:40.227157 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:40.234786 12621 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:05:40.177125 18924 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:40.239534 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 55786.4us
W20260709 13:05:40.243142 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 136634us
W20260709 13:05:40.243345 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 57965.1us
I20260709 13:05:40.250169 13234 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:05:40.251894 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 69412.4us
I20260709 13:05:40.254546 12659 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:40.245675 18651 raft_consensus.cc:2764] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 13:05:40.259701 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.261502 12688 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:40.264271 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:40.264874 12621 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:40.273408 18796 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:40.275054 12659 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:40.276572 18924 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:40.277031 18924 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.276693 18928 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:05:40.280900 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.279183 18924 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:40.283336 18579 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:40.283860 18579 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:40.283659 18932 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:40.284288 18579 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:40.295816 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.285629 18124 consensus_queue.cc:1059] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:05:40.286589 18925 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:40.290062 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:40.292647 18732 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:40.276991 18893 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:05:40.297660 18812 consensus_queue.cc:1059] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:40.334149 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:40.343405 12621 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
W20260709 13:05:40.348451 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 70884.6us
I20260709 13:05:40.356884 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:40.363376 13197 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:40.367591 12688 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 17. Current term is 18. Ops: []
W20260709 13:05:40.365934 13199 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.195:34641 timed out after 1.857s (SENT) [suppressed 32 similar messages]
I20260709 13:05:40.376389 12588 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:40.365856 18827 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:40.383778 12539 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:40.389535 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:40.365661 18124 consensus_queue.cc:1243] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:05:40.388401 18796 raft_consensus.cc:697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 17 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:40.410174 18827 consensus_queue.cc:1059] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:40.410723 18796 consensus_queue.cc:237] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:40.411726 18827 raft_consensus.cc:3055] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:40.412117 18827 raft_consensus.cc:740] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:40.411999 18945 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:40.413717 12546 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:40.409185 12588 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:40.414146 18937 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:05:40.415232 18924 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:40.416105 13200 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:40.416427 18856 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:40.417400 18924 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:40.423408 12693 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
W20260709 13:05:40.433182 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.438022 18011 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:40.439047 12659 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:40.441651 18932 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:40.446545 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:40.447012 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 71626.4us
W20260709 13:05:40.446276 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 97568us
I20260709 13:05:40.456250 12659 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:40.455482 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:40.459875 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 54749.5us
I20260709 13:05:40.441788 18937 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:40.446520 18011 raft_consensus.cc:697] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:40.452450 18651 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:40.484887 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:40.413414 18827 consensus_queue.cc:260] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:40.485953 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.457777 18856 raft_consensus.cc:697] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:40.489910 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:40.493510 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:40.495862 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:40.493057 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:40.497304 12622 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:40.500175 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.500874 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.501434 18746 raft_consensus.cc:3055] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:40.481815 18651 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:40.502013 18746 raft_consensus.cc:740] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:40.502195 18651 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:40.503041 18746 consensus_queue.cc:260] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:40.504061 18746 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:40.487000 18893 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.507776 13231 raft_consensus.cc:1217] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Deduplicated request from leader. Original: 13.11->[15.12-15.12]   Dedup: 15.12->[]
I20260709 13:05:40.508508 13231 raft_consensus.cc:1240] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 13:05:40.513120 12546 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 13:05:40.513711 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:40.514206 12512 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:40.514420 12618 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:40.515357 12512 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:40.516333 12512 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:40.516384 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:40.518203 18947 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:40.518586 12662 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:40.518786 18947 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:40.519212 18947 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:40.520427 18932 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:40.521461 18932 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:40.522171 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:40.522333 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.522596 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:40.523710 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.524107 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.524904 12689 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:40.527639 18579 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:40.531020 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:40.532110 12544 raft_consensus.cc:2410] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:05:40.531023 18945 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:40.533294 13200 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:40.533588 18945 raft_consensus.cc:697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:40.534198 12539 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:40.534343 12538 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:40.534744 18945 consensus_queue.cc:237] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:40.535336 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:40.535558 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:40.514241 12588 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:40.536427 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:40.536779 12540 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:40.532023 18579 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:40.537050 12545 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:40.502027 18432 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:40.482106 18732 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:40.535423 18812 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:40.540693 18812 raft_consensus.cc:697] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:40.541639 18812 consensus_queue.cc:237] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:40.545034 12615 raft_consensus.cc:2376] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18. Re-sending same reply.
I20260709 13:05:40.507737 18893 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:40.501511 12696 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:05:40.501060 12695 raft_consensus.cc:2368] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:05:40.523751 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:40.534359 13200 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:40.652215 18956 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:05:40.634685 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 120445us
W20260709 13:05:40.655037 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.517503 12512 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:40.642103 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.642557 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:40.644289 18627 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:40.644726 12689 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:05:40.644367 18011 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:40.645349 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:40.672101 12546 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:40.645406 18849 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:40.645215 18856 consensus_queue.cc:237] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:40.646904 12693 raft_consensus.cc:2393] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:40.632603 12694 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:05:40.656620 18956 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.657404 12613 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:05:40.658574 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.671094 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.684289 12696 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:40.674556 12616 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:40.642966 18432 raft_consensus.cc:697] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:40.646696 18827 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:40.638118 18928 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:40.688441 18283 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:40.688953 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.690243 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:40.693069 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 175652us
I20260709 13:05:40.696386 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.660765 18627 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.704191 12695 raft_consensus.cc:2410] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:05:40.705933 12690 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:40.718039 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:40.723901 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 205382us
I20260709 13:05:40.691520 18956 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:40.711391 18627 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:40.784085 12689 raft_consensus.cc:1240] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 13:05:40.784968 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 250693us
I20260709 13:05:40.786443 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:40.796332 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 91547.4us
I20260709 13:05:40.703491 18928 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:40.780514 18924 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.706928 18849 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:40.798928 12662 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:40.716650 18954 consensus_queue.cc:1059] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.103s
I20260709 13:05:40.815191 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.818578 12618 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:40.836047 18432 consensus_queue.cc:237] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:40.814872 18924 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:40.842610 18924 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:40.845943 12443 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36398 (request call id 355) took 67413 ms (client timeout 15000 ms). Trace:
I20260709 13:05:40.849112 18732 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:40.852448 18849 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:40.854382 18955 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.223s	user 0.000s	sys 0.001s
I20260709 13:05:40.854249 12547 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:05:40.855698 18953 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.175s
W20260709 13:05:40.857605 18952 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.060s	user 0.001s	sys 0.001s
I20260709 13:05:40.858180 18949 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:05:40.858811 18949 raft_consensus.cc:697] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:40.859841 18949 consensus_queue.cc:237] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:40.861732 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 67537.2us
I20260709 13:05:40.863297 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.820919 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.870504 12687 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:05:40.813719 18843 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:05:40.883811 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:40.884796 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.888978 12693 raft_consensus.cc:2393] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:40.890794 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.891731 12690 raft_consensus.cc:2393] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:40.862349 18893 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:40.892680 12512 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:40.896020 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.893887 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.914290 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.878497 18484 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:40.923676 12689 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:05:40.924636 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.925485 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:40.923013 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 60425.9us
I20260709 13:05:40.931628 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:40.932397 12615 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
W20260709 13:05:40.933835 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 51033.4us
I20260709 13:05:40.935237 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.937508 12696 raft_consensus.cc:1240] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 13:05:40.942937 12512 leader_election.cc:400] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:05:40.943454 12512 leader_election.cc:403] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:40.947544 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.892302 18283 raft_consensus.cc:697] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:05:40.950047 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 185537us
I20260709 13:05:40.951078 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:40.952886 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:40.952724 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 76261.4us
I20260709 13:05:40.955024 12659 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:40.957953 12659 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:40.958950 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:40.960780 12659 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:40.933128 18893 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:40.963119 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:40.964846 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.972227 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.974610 12690 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:05:40.970060 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 271160us
I20260709 13:05:40.981492 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:40.987218 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.954272 18484 raft_consensus.cc:697] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:05:40.990263 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 295889us
I20260709 13:05:40.978632 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:40.993144 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:41.002525 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:40.975950 18925 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:41.007251 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:40.846586 12443 rpcz_store.cc:269] 0709 13:04:33.380896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:33.381142 (+   246us) service_pool.cc:224] Handling call
0709 13:05:40.784646 (+67403504us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:33.095845 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:33.096564 (+   719us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:33.096629 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:05:33.096669 (+    40us) tablet.cc:662] Decoding operations
0709 13:05:33.097625 (+   956us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:33.097728 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:33.097763 (+    35us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:05:33.098454 (+   691us) tablet.cc:701] Row locks acquired
0709 13:05:33.098504 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:05:33.098670 (+   166us) write_op.cc:270] Start()
0709 13:05:33.098818 (+   148us) write_op.cc:276] Timestamp: P: 1783602333098601 usec, L: 0
0709 13:05:33.098857 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 13:05:33.210506 (+111649us) log.cc:844] Serialized 2525 byte log entry
0709 13:05:33.614367 (+403861us) op_driver.cc:464] REPLICATION: finished
0709 13:05:34.010226 (+395859us) spinlock_profiling.cc:243] Waited 7.45 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a646f0ac 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3acfafef0
0709 13:05:34.266001 (+255775us) write_op.cc:301] APPLY: starting
0709 13:05:34.288642 (+ 22641us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:34.399638 (+110996us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:34.399679 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:34.710482 (+310803us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:34.710962 (+   480us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:05:34.711049 (+    87us) write_op.cc:312] APPLY: finished
0709 13:05:34.711575 (+   526us) log.cc:844] Serialized 65 byte log entry
0709 13:05:34.759065 (+ 47490us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:34.770108 (+ 11043us) write_op.cc:454] Released schema lock
0709 13:05:34.783866 (+ 13758us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:34.834639 (+ 50773us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:34.834670 (+    31us) write_op.cc:454] Released schema lock
0709 13:05:35.282768 (+448098us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b5400235fd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957632a 00007fc3a94fbf14 00007fc3a94fbec3 00007fc3a94fbe38 00007fc3a94fbdf3 00007fc3a94fb0dc 00007fc3a9524e16 00007fc3a950ccbb 00007fc3a94f739d 00007fc3a94fad75
Metrics: {"mutex_wait_us":1793962,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":625400,"apply.run_cpu_time_us":19587,"apply.run_wall_time_us":581660,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29219,"num_ops":6,"prepare.queue_time_us":225579,"prepare.run_cpu_time_us":39088,"prepare.run_wall_time_us":219446,"raft.queue_time_us":104975,"raft.run_cpu_time_us":30646,"raft.run_wall_time_us":1687452,"replication_time_us":515324,"spinlock_wait_cycles":51318016,"thread_start_us":698300,"threads_started":5,"wal-append.queue_time_us":240869,"wal-append.run_cpu_time_us":13885,"wal-append.run_wall_time_us":2278560}]]}
I20260709 13:05:40.969044 18893 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:41.009162 12690 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:05:41.013191 12694 raft_consensus.cc:2410] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:05:41.013528 12696 raft_consensus.cc:2393] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 20: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:40.989753 18924 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:05:41.017016 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 54444.8us
I20260709 13:05:41.026253 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:41.034428 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 55885.2us
I20260709 13:05:41.035909 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.039902 18973 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:41.040505 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:41.041230 13233 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 22.
I20260709 13:05:41.045033 12513 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:41.041844 18484 consensus_queue.cc:237] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:41.045687 18924 raft_consensus.cc:697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:41.046777 18924 consensus_queue.cc:237] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:41.050735 18946 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:41.051283 18946 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.051713 18946 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:41.053845 18124 raft_consensus.cc:3055] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:41.054376 18124 raft_consensus.cc:740] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:41.055441 18124 consensus_queue.cc:260] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:41.056811 18124 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:41.057241 18651 consensus_meta.cc:287] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.555s	user 0.006s	sys 0.003s
W20260709 13:05:41.057969 18947 consensus_meta.cc:287] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.004s
I20260709 13:05:41.059185 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.028484 18925 raft_consensus.cc:697] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:41.060302 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.060662 12436 catalog_manager.cc:5697] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 8 to 16. New cstate: current_term: 16 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:05:41.070537 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.076463 12690 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 21.
I20260709 13:05:41.079396 18510 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:41.080054 18510 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.080544 18510 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:41.081692 18969 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:05:41.083024 18971 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.115s
I20260709 13:05:41.082618 12436 catalog_manager.cc:5697] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 6 to 12, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 12 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.085945 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:41.086524 12694 raft_consensus.cc:2376] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19. Re-sending same reply.
I20260709 13:05:41.087868 12694 raft_consensus.cc:1240] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:05:41.084828 12436 catalog_manager.cc:5697] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:05:41.095064 12436 catalog_manager.cc:5697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:05:41.090473 18925 consensus_queue.cc:237] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:41.102533 18928 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:41.103793 18283 consensus_queue.cc:237] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:41.071508 12546 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:41.013118 18893 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:41.129447 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.150152 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.103338 12436 catalog_manager.cc:5697] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:05:41.162863 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:41.074738 18651 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:41.191973 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 83066.7us
I20260709 13:05:41.182199 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.076607 18947 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:41.194295 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:05:41.195298 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 260743us
I20260709 13:05:41.201413 12512 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:41.202310 12689 raft_consensus.cc:2393] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 19: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:05:41.210446 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.231187 12617 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16. Ops: []
W20260709 13:05:41.233139 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 70359.5us
I20260709 13:05:41.235388 12512 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:41.172190 18954 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:41.247305 12688 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:41.242216 12691 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:41.252331 12689 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:05:41.228843 18969 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:05:41.268504 12510 leader_election.cc:336] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.671s (SENT)
I20260709 13:05:41.269368 12510 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:41.277844 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.280522 12691 raft_consensus.cc:2410] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
W20260709 13:05:41.289397 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 54130us
I20260709 13:05:41.295456 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:41.296350 12689 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:41.257005 18961 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:41.307246 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 288766us
W20260709 13:05:41.307580 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 109566us
I20260709 13:05:41.306228 12662 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:41.272490 18812 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:05:41.309805 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 45921.6us
I20260709 13:05:41.271526 18969 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:41.298650 18949 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:41.315541 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.251725 18627 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:41.349280 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.350436 18892 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.152s
I20260709 13:05:41.351574 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.316531 18584 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.354941 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.315222 18961 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:41.362371 18979 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:05:41.363540 18961 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:41.303587 18965 consensus_queue.cc:1059] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 13:05:41.356310 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.315102 18969 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:41.387914 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.388737 12694 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
W20260709 13:05:41.395287 18980 log.cc:927] Time spent T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
W20260709 13:05:41.395946 18827 consensus_meta.cc:287] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.688s	user 0.006s	sys 0.004s
W20260709 13:05:41.396090 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 134795us
I20260709 13:05:41.396814 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:41.388388 18746 consensus_meta.cc:287] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.884s	user 0.014s	sys 0.001s
I20260709 13:05:41.398344 12543 raft_consensus.cc:2410] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 16 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:05:41.398993 12695 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:41.399724 18947 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:41.401299 18627 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:41.402108 18651 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:41.376581 18584 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:41.406505 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.407533 12693 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 16: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:41.408401 18584 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:41.410491 18956 consensus_meta.cc:287] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.622s	user 0.004s	sys 0.008s
I20260709 13:05:41.411041 18956 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:41.413199 18956 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:41.414237 12618 raft_consensus.cc:2368] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20.
I20260709 13:05:41.420776 12694 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:41.420644 18510 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:41.424894 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 70756.6us
I20260709 13:05:41.426107 12662 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:41.427719 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 124804us
I20260709 13:05:41.432178 12689 raft_consensus.cc:2410] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:05:41.438674 12692 raft_consensus.cc:2393] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 14: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:05:41.438422 18977 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:05:41.447003 12687 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:41.448988 12687 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:05:41.451027 12510 leader_election.cc:336] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.844s (SENT)
I20260709 13:05:41.452288 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:41.454911 12510 leader_election.cc:336] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 2.028s (SENT)
I20260709 13:05:41.455873 12510 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:41.457428 18812 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:41.458438 18812 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:41.460022 18925 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:41.465953 12694 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:05:41.468839 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:41.263671 12436 catalog_manager.cc:5697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 14 to 18, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 18 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:41.496171 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:41.493593 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.504742 12540 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:41.505249 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:41.509166 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 83179.7us
I20260709 13:05:41.511775 12545 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:41.504393 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.513604 12689 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 15: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:41.516072 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.503327 12694 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:05:41.518347 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.519482 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.520048 12694 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:41.521421 12694 raft_consensus.cc:1275] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:41.517410 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:41.473788 18893 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:41.528548 12545 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 22.
I20260709 13:05:41.531050 12694 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18. Ops: []
W20260709 13:05:41.539330 18988 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:05:41.541507 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.503674 18925 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:05:41.544193 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 232081us
I20260709 13:05:41.544772 12546 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:41.549139 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.558976 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:41.563184 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:41.563858 12587 leader_election.cc:336] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Timed out: RequestConsensusVote RPC to 127.11.44.195:34641 timed out after 1.507s (SENT)
I20260709 13:05:41.492779 18946 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:41.570514 12587 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:41.569964 18960 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:41.560294 18969 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:41.580247 18928 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:41.581704 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.582871 12696 raft_consensus.cc:2410] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
W20260709 13:05:41.584286 18987 log.cc:927] Time spent T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:05:41.586515 18510 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:41.589159 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.589205 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:41.591737 12694 raft_consensus.cc:2410] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 21 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:05:41.592326 18928 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:41.600335 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.592260 12588 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:41.609983 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.611538 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.531385 12436 catalog_manager.cc:5697] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 8 to 11, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 11 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:05:41.613051 12588 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:41.613734 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:41.613941 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:41.614982 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 53832.9us
I20260709 13:05:41.615419 12687 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
W20260709 13:05:41.615700 12587 leader_election.cc:336] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Timed out: RequestConsensusVote RPC to 127.11.44.195:34641 timed out after 1.540s (SENT)
W20260709 13:05:41.616343 12587 leader_election.cc:336] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Timed out: RequestConsensusVote RPC to 127.11.44.195:34641 timed out after 1.595s (SENT)
I20260709 13:05:41.621192 12696 raft_consensus.cc:2393] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 19: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:41.623939 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:41.625793 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:41.626505 13233 raft_consensus.cc:2410] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:05:41.625247 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:41.627329 12689 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:05:41.628216 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.628994 18973 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:41.629459 18969 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:41.636759 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.638057 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.639071 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.644340 12687 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 16: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:05:41.639761 12587 leader_election.cc:336] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Timed out: RequestConsensusVote RPC to 127.11.44.195:34641 timed out after 1.747s (SENT)
I20260709 13:05:41.645104 12588 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:41.645380 18956 consensus_queue.cc:1059] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:41.646407 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:41.646656 18956 consensus_queue.cc:1059] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:41.647279 12696 raft_consensus.cc:2410] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 22 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:05:41.647541 18956 consensus_queue.cc:1059] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:41.648319 18953 raft_consensus.cc:3055] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:41.648707 18953 raft_consensus.cc:740] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:41.648566 18956 consensus_queue.cc:1059] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:41.649658 18651 raft_consensus.cc:3055] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:41.649623 18928 consensus_queue.cc:1059] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:41.650308 18651 raft_consensus.cc:740] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:41.619938 18976 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:41.651113 18651 consensus_queue.cc:260] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:41.652376 18651 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:41.658293 18956 raft_consensus.cc:3055] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:41.658686 18956 raft_consensus.cc:740] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:41.659049 18893 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:41.659812 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:41.662410 18827 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:41.662819 18827 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:41.663120 18946 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:41.663213 18827 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:41.664448 12436 catalog_manager.cc:5697] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 10 to 15, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 15 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:41.666424 12436 catalog_manager.cc:5697] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:41.668161 12436 catalog_manager.cc:5697] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 12 to 16, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 16 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:05:41.659459 18956 consensus_queue.cc:260] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:41.675674 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:41.673664 13200 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:41.677505 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:41.678241 12545 raft_consensus.cc:2368] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 21. Current term is 22.
I20260709 13:05:41.678911 12690 raft_consensus.cc:1275] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:05:41.681324 12694 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:41.682852 13231 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:05:41.685752 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:41.686066 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:41.688830 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:41.689812 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:41.693912 18874 raft_consensus.cc:3055] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:05:41.694247 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 73989.9us
I20260709 13:05:41.694408 18874 raft_consensus.cc:740] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:41.694583 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:41.695128 13199 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:41.695396 12544 raft_consensus.cc:2393] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 17: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:41.695283 18874 consensus_queue.cc:260] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:41.688369 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:41.696507 18993 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:41.697145 18993 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:41.697552 18993 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:41.697965 18973 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:41.696559 18874 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:41.700156 18994 consensus_queue.cc:1059] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:41.651078 18976 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:41.701236 18994 raft_consensus.cc:3055] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:41.701592 18994 raft_consensus.cc:740] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:41.702697 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:41.702518 18994 consensus_queue.cc:260] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:41.703452 12546 raft_consensus.cc:2368] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 22. Current term is 23.
I20260709 13:05:41.704084 18994 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:41.704371 18976 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:41.704574 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:41.705772 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:41.706583 12545 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
W20260709 13:05:41.717614 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.701634 18945 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:05:41.711477 18953 consensus_queue.cc:260] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:41.714352 18892 raft_consensus.cc:3055] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:41.715214 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 3812) took 1219 ms. Trace:
I20260709 13:05:41.735965 12617 rpcz_store.cc:276] 0709 13:05:40.495690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.495877 (+   187us) service_pool.cc:224] Handling call
0709 13:05:40.501848 (+  5971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:41.246684 (+744836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:41.714984 (+468300us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b54001e96d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:41.715159 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1668565248}
I20260709 13:05:41.715451 18993 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:41.741712 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:41.715694 18961 consensus_queue.cc:1059] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:41.682595 18283 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:41.697326 18968 consensus_queue.cc:1059] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:41.757256 12662 leader_election.cc:400] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 21. Current term is 22.
I20260709 13:05:41.757683 12662 leader_election.cc:403] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:41.759713 12662 leader_election.cc:400] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 22. Current term is 23.
I20260709 13:05:41.760171 12662 leader_election.cc:403] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:41.755360 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:41.713548 12689 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 22.
W20260709 13:05:41.733780 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 88741.9us
I20260709 13:05:41.762415 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.735697 18892 raft_consensus.cc:740] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:05:41.742677 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 95373.7us
I20260709 13:05:41.764184 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:41.764791 13233 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:41.761487 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:41.682850 18849 consensus_queue.cc:1059] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
I20260709 13:05:41.766698 12588 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:41.770215 12662 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:41.767110 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:41.773082 18925 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:41.773216 18968 raft_consensus.cc:3055] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:41.773700 18968 raft_consensus.cc:740] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:41.774611 18968 consensus_queue.cc:260] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:41.775949 18968 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:41.776813 18993 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:41.778656 12510 leader_election.cc:336] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 2.679s (SENT)
I20260709 13:05:41.779135 12510 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:41.785732 18283 raft_consensus.cc:697] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:41.737576 18796 consensus_queue.cc:1048] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:05:41.786855 18283 consensus_queue.cc:237] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:41.790926 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:41.792269 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:41.794744 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.795271 18953 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:41.795917 18510 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 21. Current term is 22.
I20260709 13:05:41.797922 12436 catalog_manager.cc:5697] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 10 to 13, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 13 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:05:41.799736 12436 catalog_manager.cc:5697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 7 to 13. New cstate: current_term: 13 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:05:41.801503 12616 raft_consensus.cc:1275] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:41.802835 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:41.767349 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:41.802748 12436 catalog_manager.cc:5697] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 11 to 15, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 15 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:41.741240 18700 consensus_queue.cc:1059] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:05:41.805305 18827 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:41.806350 12622 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:41.768635 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:05:41.808568 12543 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 2058) took 1279 ms (client timeout 1569 ms). Trace:
I20260709 13:05:41.808753 12547 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:05:41.809022 12543 rpcz_store.cc:269] 0709 13:05:40.529411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.632388 (+102977us) service_pool.cc:224] Handling call
0709 13:05:41.808337 (+1175949us) spinlock_profiling.cc:243] Waited 742 ms on lock 0x7b5400069ad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:41.808494 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1705729280}
I20260709 13:05:41.810173 18827 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:41.810585 12543 raft_consensus.cc:1275] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:05:41.803920 12693 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:41.811863 12619 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:41.812249 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.769160 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:41.814754 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 2220) took 1334 ms. Trace:
I20260709 13:05:41.815274 12688 rpcz_store.cc:276] 0709 13:05:40.479919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.480037 (+   118us) service_pool.cc:224] Handling call
0709 13:05:40.489266 (+  9229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:41.247810 (+758544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:41.814532 (+566722us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b540012e154. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:41.814698 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1742802304}
I20260709 13:05:41.769037 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:41.803483 12618 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:41.793324 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:41.817363 12538 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:05:41.786118 13199 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:41.823922 12687 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:41.828930 12693 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
W20260709 13:05:41.814792 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 47985.5us
I20260709 13:05:41.831472 12694 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 23.
W20260709 13:05:41.834815 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 71926.2us
I20260709 13:05:41.835583 12588 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:41.836403 12588 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:41.837220 12588 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:41.838101 12622 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18. Ops: []
W20260709 13:05:41.839743 18995 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.448s	user 0.000s	sys 0.004s
I20260709 13:05:41.840613 12619 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:05:41.841487 12621 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:05:41.842746 18874 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:05:41.843595 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.845899 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:41.853302 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:41.853478 12615 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:41.855073 18950 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:05:41.846052 12618 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:41.831578 12512 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:41.852291 12659 leader_election.cc:400] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20.
I20260709 13:05:41.857641 12659 leader_election.cc:403] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:05:41.859009 12616 raft_consensus.cc:1275] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:05:41.859476 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 64622.3us
I20260709 13:05:41.859942 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:41.862229 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:41.863413 13231 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:41.865202 12615 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 13:05:41.805317 12436 catalog_manager.cc:5697] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 9 to 15, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 15 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:05:41.854552 12538 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:41.868782 12689 raft_consensus.cc:3055] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:41.870978 12689 raft_consensus.cc:740] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:41.875775 12613 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:05:41.876209 12613 pending_rounds.cc:85] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 12
I20260709 13:05:41.845391 18432 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 22. Current term is 23.
I20260709 13:05:41.855964 19004 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:41.876420 12613 pending_rounds.cc:107] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:05:41.897249 12613 raft_consensus.cc:2889] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:41.897454 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 111428us
I20260709 13:05:41.858115 18874 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:41.889725 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 52613.8us
I20260709 13:05:41.863909 18973 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:41.870836 18956 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:41.863854 18971 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:41.894148 12689 consensus_queue.cc:260] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:41.909498 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 77986.4us
I20260709 13:05:41.874203 18796 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:41.927953 18971 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:41.926645 18973 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:41.928483 18971 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:41.930294 18973 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:41.931766 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 153173us
I20260709 13:05:41.872416 18960 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20.
I20260709 13:05:41.917923 13197 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:41.926628 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:41.896018 18700 consensus_queue.cc:1243] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:05:41.931990 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 178599us
I20260709 13:05:41.899799 18928 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:41.938210 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:41.897082 19004 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:41.942981 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:41.903607 18874 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:41.882854 18827 consensus_queue.cc:1059] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.051s
W20260709 13:05:41.944517 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 46284.7us
I20260709 13:05:41.956651 13199 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:41.890900 18925 consensus_queue.cc:1048] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:05:41.933593 18484 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:41.934499 18949 raft_consensus.cc:2764] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:05:41.977905 13199 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:41.995042 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:41.995141 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:41.997581 13228 raft_consensus.cc:2393] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 18: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:42.001739 18973 consensus_queue.cc:1059] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:41.943521 19008 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:41.950798 19004 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:41.979247 18011 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:41.939760 18924 consensus_queue.cc:1059] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:05:41.899622 18856 consensus_queue.cc:1059] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:05:42.012367 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:42.021593 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 87372.4us
I20260709 13:05:42.022586 12587 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:05:42.004745 18985 log.cc:927] Time spent T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:05:42.036051 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 157894us
W20260709 13:05:42.038954 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 61185.3us
I20260709 13:05:42.040248 13199 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:42.041020 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:42.042261 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:42.005883 19008 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.042910 12618 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 11.
I20260709 13:05:41.979142 18918 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260709 13:05:42.087778 13235 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:42.038766 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:42.048061 12613 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:42.086133 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:42.086201 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:42.090391 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:42.092931 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:41.998935 18484 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:42.039227 18978 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:42.102241 19017 raft_consensus.cc:3055] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:42.141999 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:42.051576 18924 consensus_queue.cc:1243] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Peer a11816c5d72e4d1295a242f3ced09e5f log is divergent from this leader: its last log entry 18.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 13:05:42.103112 19001 log.cc:927] Time spent T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:05:42.103449 18925 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:42.103736 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:41.987819 12436 catalog_manager.cc:5697] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 7 to 16. New cstate: current_term: 16 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:05:42.103834 18892 consensus_queue.cc:260] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:42.043972 18961 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:42.024650 18627 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.082s
I20260709 13:05:42.145992 12614 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:05:42.092046 19008 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:42.149132 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:05:42.150328 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 110185us
I20260709 13:05:42.150527 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:42.152036 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:42.179797 13199 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:42.181413 13199 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:42.154402 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:42.157605 13232 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:05:42.160775 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.153971 12622 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18. Ops: []
W20260709 13:05:42.170047 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 212209us
I20260709 13:05:42.142350 19017 raft_consensus.cc:740] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:42.184962 18432 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:42.185509 19017 consensus_queue.cc:260] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:42.186816 19017 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:42.153252 18985 log.cc:927] Time spent T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 13:05:42.190588 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.166126 18651 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:42.198143 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:42.209331 13226 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:05:42.200654 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:42.212770 13199 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:42.213792 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:42.200248 18892 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:42.185580 12662 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:42.247910 13233 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 23.
I20260709 13:05:42.215381 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:42.191895 18856 raft_consensus.cc:3055] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:05:42.255143 18962 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:42.255662 19013 log.cc:927] Time spent T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:05:42.259770 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:42.210322 18843 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:42.248932 12620 raft_consensus.cc:2376] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18. Re-sending same reply.
W20260709 13:05:42.265445 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 78924.4us
I20260709 13:05:42.265385 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:42.282680 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:42.311627 12662 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:42.300724 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:42.263422 18994 consensus_meta.cc:287] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.557s	user 0.010s	sys 0.008s
W20260709 13:05:42.325417 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.324950 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:42.329841 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:42.333698 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:42.265430 18856 raft_consensus.cc:740] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:42.353434 18712 raft_consensus.cc:3055] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:42.357807 18712 raft_consensus.cc:740] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:42.358783 18712 consensus_queue.cc:260] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:42.360266 18712 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:42.362603 19012 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
W20260709 13:05:42.365087 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 342557us
I20260709 13:05:42.273530 18432 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:42.369197 12587 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:42.340919 18651 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.411564 18651 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:42.413882 18651 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:42.376832 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:42.415041 12621 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:42.389858 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:42.417145 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:42.419857 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:42.420610 13231 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 19: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:05:42.423892 18968 consensus_meta.cc:287] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.647s	user 0.011s	sys 0.001s
I20260709 13:05:42.393805 18484 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:42.398993 12587 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:42.402376 19024 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:05:42.403542 19018 log.cc:927] Time spent T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:05:42.403900 19022 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:05:42.404794 19016 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
W20260709 13:05:42.405700 19020 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:05:42.407109 19021 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.414510 18651 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:42.346957 12436 catalog_manager.cc:5697] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:05:42.435659 12614 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:42.438374 13226 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:05:42.439954 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:42.409368 18856 consensus_queue.cc:260] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:42.448376 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:42.452154 18947 raft_consensus.cc:3055] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:42.476810 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:05:42.448434 18956 consensus_meta.cc:287] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.522s	user 0.010s	sys 0.000s
I20260709 13:05:42.492805 12621 raft_consensus.cc:1275] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:05:42.500938 12541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.003s	sys 0.008s
I20260709 13:05:42.449440 19021 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:42.503023 19014 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:42.504746 19021 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:42.479561 18947 raft_consensus.cc:740] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:42.506345 18947 consensus_queue.cc:260] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:42.507958 18947 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:42.478888 18971 consensus_meta.cc:287] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.550s	user 0.011s	sys 0.000s
W20260709 13:05:42.513952 18953 consensus_meta.cc:287] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.718s	user 0.004s	sys 0.008s
W20260709 13:05:42.514004 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 115084us
I20260709 13:05:42.514971 12619 raft_consensus.cc:2410] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:05:42.514348 12436 catalog_manager.cc:5697] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:42.516628 12613 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:42.516440 12436 catalog_manager.cc:5697] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 11 to 13, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 13 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:42.517132 12587 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:42.448192 19022 raft_consensus.cc:697] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:05:42.525730 12541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.004s	sys 0.008s
I20260709 13:05:42.542138 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:05:42.542744 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 505821us
I20260709 13:05:42.544479 13230 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:42.545619 12621 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:42.545447 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:42.546150 12622 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
W20260709 13:05:42.524631 18874 consensus_meta.cc:287] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
W20260709 13:05:42.523238 18976 consensus_meta.cc:287] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.818s	user 0.010s	sys 0.001s
I20260709 13:05:42.527316 18960 raft_consensus.cc:3055] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:42.557826 12662 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:42.560418 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:42.513952 18971 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:42.580062 12618 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16. Ops: []
W20260709 13:05:42.568302 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 51235.2us
W20260709 13:05:42.573992 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.574103 19022 consensus_queue.cc:237] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:42.574568 12436 catalog_manager.cc:5697] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:05:42.549412 19017 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:42.584465 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:42.598388 12436 catalog_manager.cc:5697] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 6 to 13, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 13 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:05:42.603538 18971 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:42.603812 12436 catalog_manager.cc:5697] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 10 to 13, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 13 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:05:42.604643 19032 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:42.606163 19032 consensus_queue.cc:1048] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:42.606725 12436 catalog_manager.cc:5697] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 10 to 13, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 13 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:42.608309 12616 raft_consensus.cc:2393] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:42.608683 19021 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.609217 19021 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:42.608919 12436 catalog_manager.cc:5697] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 9 to 17, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 17 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:05:42.610534 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:42.611141 12616 raft_consensus.cc:2376] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18. Re-sending same reply.
I20260709 13:05:42.607571 19032 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:42.616552 19032 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:42.616983 19032 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:42.619901 12689 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:42.611488 19021 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:42.625028 13227 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:42.626194 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:42.626793 13228 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:42.630357 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:42.631093 13230 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:05:42.631651 12614 raft_consensus.cc:1275] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 13:05:42.632025 12614 pending_rounds.cc:85] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 8
I20260709 13:05:42.632237 12614 pending_rounds.cc:107] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 13:05:42.632454 12614 raft_consensus.cc:2889] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:42.632473 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 50818.2us
I20260709 13:05:42.635702 12619 raft_consensus.cc:1275] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:05:42.559527 18960 raft_consensus.cc:740] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:42.525528 19004 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:42.647873 19004 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:42.520062 19008 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:42.614167 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:42.599597 19031 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 17.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.028s
I20260709 13:05:42.558972 18432 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 13:05:42.567268 18976 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:42.644964 13228 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:42.651433 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:42.651787 12620 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:42.652352 12619 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:42.653785 13226 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:05:42.566195 18874 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:42.655555 18627 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:42.662513 13229 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:42.648669 18961 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:05:42.670048 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 729718us
I20260709 13:05:42.670167 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:42.672086 13226 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:42.674286 18874 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:42.677803 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 465134us
I20260709 13:05:42.679047 13199 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:42.679844 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.680295 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:42.681741 18812 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:42.682437 18978 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:42.682689 18976 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:42.683921 18978 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:42.684391 18978 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:42.684783 18993 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:05:42.685423 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.686482 12617 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:42.668174 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:42.702584 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 144859us
I20260709 13:05:42.703414 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:42.703523 12689 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:05:42.704146 12689 pending_rounds.cc:85] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 12
I20260709 13:05:42.704712 12689 pending_rounds.cc:107] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:05:42.705458 12689 raft_consensus.cc:2889] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:42.710708 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3467) took 1010 ms. Trace:
I20260709 13:05:42.717458 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:42.720899 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 77449.9us
I20260709 13:05:42.723255 12688 raft_consensus.cc:1240] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:05:42.711321 12539 rpcz_store.cc:276] 0709 13:05:41.678350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.678471 (+   121us) service_pool.cc:224] Handling call
0709 13:05:41.688343 (+  9872us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:41.688534 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:05:41.764177 (+ 75643us) log.cc:844] Serialized 14 byte log entry
0709 13:05:41.983455 (+219278us) log.cc:844] Serialized 14 byte log entry
0709 13:05:42.400875 (+417420us) spinlock_profiling.cc:243] Waited 7.96 ms on lock 0x7b18004558c0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c522 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
0709 13:05:42.669772 (+268897us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b18004558c0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a6406c0a 00007fc3afb46219 00007fc3a648ea40 00007fc3a64894e4 00007fc3a6489455 00007fc3a9571060 00007fc3a9583716 00007fc3a9594287 00007fc3a9594208
0709 13:05:42.688118 (+ 18346us) log.cc:844] Serialized 14 byte log entry
0709 13:05:42.688270 (+   152us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:42.688316 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:42.688366 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:42.688428 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:42.688530 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58494,"prepare.queue_time_us":41830,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":734597,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":7296,"spinlock_wait_cycles":83157120,"thread_start_us":121507,"threads_started":2,"wal-append.queue_time_us":129636}
I20260709 13:05:42.729511 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:42.734333 12587 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:42.713994 18969 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.715344 18993 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:42.715159 18796 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:42.741189 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3469) took 1062 ms. Trace:
I20260709 13:05:42.742218 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:42.716859 18924 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:42.716727 18997 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:42.757773 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 77542.1us
I20260709 13:05:42.758803 13199 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:42.765645 19004 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:42.792207 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 121542us
W20260709 13:05:42.788717 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 190732us
I20260709 13:05:42.741626 12541 rpcz_store.cc:276] 0709 13:05:41.678996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.679122 (+   126us) service_pool.cc:224] Handling call
0709 13:05:41.688125 (+  9003us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:41.693945 (+  5820us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:05:41.755161 (+ 61216us) log.cc:844] Serialized 14 byte log entry
0709 13:05:42.728202 (+973041us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:42.728257 (+    55us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:42.740940 (+ 12683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:42.741010 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:42.741128 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":172831,"prepare.queue_time_us":44549,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":181884,"thread_start_us":743456,"threads_started":2,"wal-append.queue_time_us":810883}
I20260709 13:05:42.832404 12512 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:42.792052 19008 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:42.833861 19030 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:42.834432 19030 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:42.836540 19030 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:42.837044 19023 consensus_queue.cc:1059] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.104s
I20260709 13:05:42.841511 13229 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:05:42.775758 19027 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:42.846629 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 175416us
I20260709 13:05:42.852695 12513 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:42.847536 18949 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:42.728705 18960 consensus_queue.cc:260] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:42.848127 19032 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:42.848086 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:42.774960 18584 raft_consensus.cc:3055] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:42.847255 19023 consensus_queue.cc:1059] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:42.756443 18969 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:42.872090 18945 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:42.872484 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:42.872705 18956 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:42.845702 19033 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:42.872936 18949 raft_consensus.cc:697] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:05:42.857184 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 98474.9us
I20260709 13:05:42.851895 18924 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:42.894924 12510 leader_election.cc:336] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.929s (SENT)
I20260709 13:05:42.794731 18997 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:42.903120 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 160965us
I20260709 13:05:42.794865 18993 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:42.877370 19021 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:42.874780 18584 raft_consensus.cc:740] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:42.872331 18950 consensus_queue.cc:1059] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:42.872524 12588 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:42.765538 18796 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:42.872068 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 130180us
I20260709 13:05:42.928622 13199 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:42.898612 12510 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:42.929695 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 57260.2us
I20260709 13:05:42.928843 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:42.893359 18432 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.890100 18956 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:42.922209 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:42.933535 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 50855.2us
I20260709 13:05:42.890736 18953 consensus_queue.cc:1059] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:05:42.934754 12538 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:42.935246 12587 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:42.936604 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:42.937413 12539 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:42.937925 12541 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:05:42.907212 18978 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:42.940301 13200 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:42.907491 18945 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:42.947077 18975 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:42.933818 18484 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:42.955437 18969 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:42.955353 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 161990us
I20260709 13:05:42.956146 19038 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:42.932293 18827 consensus_queue.cc:1059] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:05:42.936941 18956 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:42.958078 19032 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:42.934176 19039 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.970647 12691 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:05:42.939031 19017 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:42.960304 19004 raft_consensus.cc:3055] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:42.941171 18432 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:42.972486 12510 leader_election.cc:336] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.952s (SENT)
I20260709 13:05:42.963762 19027 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:42.943471 19023 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:42.974891 19045 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:42.980441 19033 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.959554 18950 consensus_queue.cc:1243] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:05:42.971557 12587 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:42.944886 18924 consensus_queue.cc:1059] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:05:42.976199 18712 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
W20260709 13:05:43.009405 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 93591.6us
I20260709 13:05:42.965797 18978 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:42.975060 18484 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:43.021214 13199 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:43.022526 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 51049.2us
I20260709 13:05:43.023759 12587 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:43.017264 18978 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:42.986505 19004 raft_consensus.cc:740] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:43.008838 19027 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.030171 19004 consensus_queue.cc:260] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:43.030721 12587 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:43.031502 19004 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:43.031728 18976 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:43.032056 18874 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:43.032486 18976 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:43.032832 18874 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:43.033417 18874 raft_consensus.cc:697] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:43.027972 18918 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:43.027743 19041 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
W20260709 13:05:43.028394 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 55944.8us
I20260709 13:05:43.028498 19042 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
W20260709 13:05:43.042428 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.016482 18945 raft_consensus.cc:697] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 23 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:42.990522 19017 raft_consensus.cc:697] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:05:43.047057 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.015316 19023 raft_consensus.cc:697] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:05:43.062362 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.012279 19033 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:42.988308 18947 consensus_queue.cc:1059] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:05:43.013062 19038 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:43.068962 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:43.069073 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:43.035840 18978 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:43.016119 18796 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:43.040647 18928 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.036s	user 0.028s	sys 0.035s
I20260709 13:05:43.043555 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:43.095834 13235 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:43.089076 12617 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:42.986527 18949 consensus_queue.cc:237] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:43.097159 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 76048.9us
I20260709 13:05:43.098129 13199 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:43.034435 18874 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.102300 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:43.104295 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.988529 19039 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.080718 19031 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:43.097036 18928 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.096s	user 0.029s	sys 0.035s
I20260709 13:05:43.119467 12617 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:43.082055 18976 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:05:43.110221 18947 consensus_queue.cc:1243] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 18.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 13:05:43.128607 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 98046.4us
I20260709 13:05:43.108362 18975 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:05:43.089838 19045 consensus_queue.cc:1059] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 13:05:43.115300 18928 raft_consensus.cc:697] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:43.110085 18969 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:05:43.147920 12690 raft_consensus.cc:1240] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:05:43.129453 19042 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.152554 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:43.153627 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:43.170405 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:43.127508 18849 consensus_queue.cc:1059] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:05:43.172463 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:05:43.179225 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.174620 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:43.122525 19031 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:43.183851 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 85849.5us
W20260709 13:05:43.165364 19048 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:05:43.112433 19038 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.209345 19038 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:43.187091 12693 raft_consensus.cc:3055] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:43.187922 19033 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:43.190167 18973 raft_consensus.cc:3055] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:43.210062 12693 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:43.210254 18973 raft_consensus.cc:740] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:43.192474 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:43.194802 18997 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:43.195694 18925 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:43.197968 18928 consensus_queue.cc:237] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:43.196084 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:43.200383 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:43.202308 19032 raft_consensus.cc:3055] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:43.206719 19039 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:43.177616 19023 consensus_queue.cc:237] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.155494 18945 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.217168 18627 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:43.211083 12693 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.224692 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:43.186450 18893 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.232807 12696 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:43.247051 12617 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:43.148496 19017 consensus_queue.cc:237] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.218361 18963 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:43.220049 19045 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.261368 12539 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:05:43.148705 13226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:43.169693 19052 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.091s
I20260709 13:05:43.264132 12693 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:43.264153 13226 raft_consensus.cc:606] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:43.238005 18976 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.266774 13226 raft_consensus.cc:614] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:43.215881 18892 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:05:43.234134 19032 raft_consensus.cc:740] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:43.168995 19042 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:43.267545 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:43.267558 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 124171us
I20260709 13:05:43.271492 12622 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:43.253221 18432 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:43.272013 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:43.220376 19056 consensus_queue.cc:1059] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:05:43.221773 18925 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.276721 12687 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:43.278273 13227 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:43.286525 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:43.292378 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:43.294085 12618 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:43.296893 19042 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:43.298378 19031 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:43.304309 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:43.305425 12618 raft_consensus.cc:2410] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:05:43.303632 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:43.320725 12620 raft_consensus.cc:2410] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 13:05:43.320603 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:43.319638 12693 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 13:05:43.262570 18893 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.262440 18627 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.304924 18892 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:43.267155 18963 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.272660 18976 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.272665 19045 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:43.359107 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 87184us
I20260709 13:05:43.348192 18892 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:43.360119 12510 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:43.331059 19031 consensus_queue.cc:1059] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:05:43.363422 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:43.365886 12659 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:43.364694 19056 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:43.367543 19056 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.369200 19056 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:43.364547 19052 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:43.371003 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:43.351928 18432 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:05:43.378480 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:43.361593 18892 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:43.379069 13226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:43.387603 12510 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:43.379966 19070 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:43.387825 13226 raft_consensus.cc:606] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:43.379177 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:43.397269 13226 raft_consensus.cc:614] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:43.370369 19071 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:43.400498 12510 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:43.401151 19073 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.400449 19070 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:43.401726 19073 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:43.402977 19070 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:43.404107 19073 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:43.404289 12510 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:43.395483 19057 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.157s	user 0.001s	sys 0.001s
I20260709 13:05:43.357731 19032 consensus_queue.cc:260] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:43.387154 18945 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:43.404667 19064 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:43.414855 19031 raft_consensus.cc:3055] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:43.396734 18950 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:43.370147 19052 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:43.465939 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 100139us
I20260709 13:05:43.429704 18961 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.415479 19026 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.467573 12510 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:43.441975 19070 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:43.471673 19031 raft_consensus.cc:740] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:43.439160 19071 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:43.489894 12510 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:43.496853 18976 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:43.493378 18925 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:43.499661 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:43.500586 13227 raft_consensus.cc:2410] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:05:43.500936 18124 raft_consensus.cc:3055] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:43.501327 18124 raft_consensus.cc:740] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:43.502260 18124 consensus_queue.cc:260] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:43.503760 18124 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:43.504367 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 631699us
I20260709 13:05:43.507158 18924 consensus_queue.cc:1059] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:43.508733 18925 raft_consensus.cc:3055] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:43.509341 18925 raft_consensus.cc:740] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:43.510234 18925 consensus_queue.cc:260] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:43.511122 18893 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:43.512631 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:43.486420 18961 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.513957 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:43.517699 13226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:43.514367 18627 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:43.517879 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:43.513350 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:43.518252 13226 raft_consensus.cc:606] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:05:43.515193 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:43.518680 13226 raft_consensus.cc:614] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:43.519150 18961 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:43.520677 13232 raft_consensus.cc:2393] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 21: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:43.523847 19023 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:43.524813 19023 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.527050 19023 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:43.527491 19023 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:43.527967 19023 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.529315 18963 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:43.530285 18950 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:43.531200 19041 raft_consensus.cc:3055] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:43.531384 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:43.476801 19043 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:43.534436 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 44639.3us
W20260709 13:05:43.508687 18956 consensus_meta.cc:287] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.520s	user 0.006s	sys 0.003s
I20260709 13:05:43.540594 12510 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:43.541011 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:43.531661 19041 raft_consensus.cc:740] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:43.539189 19053 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:43.543295 19053 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.543419 19041 consensus_queue.cc:260] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:43.544775 19041 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:43.545650 19073 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:43.546211 19073 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.546784 19045 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:43.548075 18953 raft_consensus.cc:3055] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:43.493070 19077 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:43.548772 12620 raft_consensus.cc:2393] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 13: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:43.548607 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:43.554849 12618 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:43.549218 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.491747 19032 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:43.528005 19078 log.cc:927] Time spent T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.056s	user 0.002s	sys 0.000s
I20260709 13:05:43.474325 18949 consensus_queue.cc:1059] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:05:43.556041 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:43.557834 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:43.493865 18947 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:43.537858 19023 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:43.539211 19070 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:43.575567 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:43.550364 18953 raft_consensus.cc:740] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:05:43.545642 18510 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:05:43.575596 13231 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:43.533810 18918 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:43.590870 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:43.554028 19077 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:43.535269 18978 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:43.595921 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 62494.9us
I20260709 13:05:43.610906 12662 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:43.595974 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:43.596710 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.487911 19026 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.490461 19071 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:43.612108 13231 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:43.579911 19053 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:43.616817 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:43.551541 18956 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.584786 19084 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:43.587435 19073 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:43.583211 18849 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:43.630393 12662 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:43.764493 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:43.885758 12614 raft_consensus.cc:2410] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 19 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
W20260709 13:05:43.885778 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 255477us
I20260709 13:05:43.887590 12662 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:43.889022 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:43.889734 12662 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:43.811321 18484 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:43.889060 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:43.893247 12614 raft_consensus.cc:2393] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 13: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:43.893908 12545 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:43.750069 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1597) took 1084 ms. Trace:
I20260709 13:05:43.635543 19085 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:43.891309 12662 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:43.713881 19071 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:43.904487 19032 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:43.905159 19032 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.905674 19032 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:43.611090 19077 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:43.705942 19075 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:05:43.690848 19084 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:43.710317 19036 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.807s	user 0.004s	sys 0.000s
I20260709 13:05:43.726280 19026 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:43.715231 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:43.716706 18584 consensus_queue.cc:260] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:43.707350 19069 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
W20260709 13:05:43.664582 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.721299 18892 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:43.689934 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 149401us
I20260709 13:05:43.901744 19045 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:43.925009 12510 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:43.901726 18432 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:43.691290 13230 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:43.730993 18978 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:05:43.722321 19086 log.cc:927] Time spent T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:05:43.617861 18510 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:43.583684 19031 consensus_queue.cc:260] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:43.851663 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:43.549896 19043 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:43.748603 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:43.806691 19087 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:05:43.725284 18856 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:43.939045 19023 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:43.754515 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.939792 19023 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:43.941354 18960 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:43.843928 13229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4432abbae9994c048d249abe3143fa09"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:43.943131 13229 raft_consensus.cc:606] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:05:43.943446 13229 raft_consensus.cc:614] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:43.758209 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:43.819722 13199 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:43.944296 12616 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
W20260709 13:05:43.944682 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 125082us
W20260709 13:05:43.814352 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.763736 19017 consensus_queue.cc:1059] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 13:05:43.852584 18827 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.950753 12541 raft_consensus.cc:1240] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
W20260709 13:05:43.854777 19088 log.cc:927] Time spent T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:05:43.856405 19008 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:43.873744 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:43.874570 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:43.876438 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:43.956451 12538 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:43.877797 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:43.840670 12618 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:05:43.701189 18953 consensus_queue.cc:260] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.910146 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:43.913574 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:43.993239 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 83795.7us
I20260709 13:05:43.920644 12545 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:05:43.706089 18956 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:43.910862 12619 rpcz_store.cc:276] 0709 13:05:42.665809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.665948 (+   139us) service_pool.cc:224] Handling call
0709 13:05:42.666265 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:42.666587 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:42.666614 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:42.675094 (+  8480us) log.cc:844] Serialized 26 byte log entry
0709 13:05:43.439916 (+764822us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b18003b3b00. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:05:43.562104 (+122188us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:43.562166 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:43.562259 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:43.733682 (+171423us) raft_consensus.cc:1685] finished
0709 13:05:43.733702 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:43.749993 (+ 16291us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1381,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":20736,"spinlock_wait_cycles":31870208,"thread_start_us":121928,"threads_started":1,"wal-append.queue_time_us":1026405}
W20260709 13:05:43.931265 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 453816us
I20260709 13:05:43.931461 18950 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:43.947299 13229 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:05:43.933185 12510 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:43.901996 19021 consensus_queue.cc:1059] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
W20260709 13:05:43.951797 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.959877 19031 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:43.961584 19008 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.954119 19045 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.987504 19052 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:43.967872 18963 consensus_queue.cc:1059] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:43.987695 19043 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:44.026136 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:44.026973 19008 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:44.028043 12688 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:05:43.986900 19023 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:43.985396 19084 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:43.952781 18994 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:43.973996 18973 consensus_queue.cc:260] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.949331 18510 raft_consensus.cc:697] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 21 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:43.955758 18827 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:43.891893 19011 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:43.996317 19042 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:44.003870 12546 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:44.006626 12659 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:44.062872 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 56319.5us
W20260709 13:05:44.007557 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 74474.5us
I20260709 13:05:44.007736 18950 raft_consensus.cc:2764] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:05:44.008028 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:44.007551 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:44.008666 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:44.008842 19098 raft_consensus.cc:3055] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:44.016707 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:43.986220 19091 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.098s	user 0.001s	sys 0.003s
I20260709 13:05:44.018520 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:44.023944 13199 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:44.041936 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:43.998143 18978 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.031s
I20260709 13:05:44.051491 12621 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:05:44.053856 19032 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:44.067996 12689 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:44.070807 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:44.072217 12620 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:44.073338 12695 raft_consensus.cc:2393] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:05:44.075057 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 51207us
I20260709 13:05:44.074973 12616 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:05:44.078914 12691 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 13:05:44.075812 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 133213us
I20260709 13:05:44.080955 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:44.081473 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:44.082050 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:44.080404 12510 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:44.082438 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:44.023401 19045 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:44.083063 12688 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:05:44.082883 13200 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:44.084472 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:44.087319 12620 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:44.087211 12510 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:44.066489 19042 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:44.093331 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 69505.7us
I20260709 13:05:44.093470 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:44.094908 18124 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:44.095247 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:44.092939 19021 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.105261 19021 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:44.105865 18947 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:44.106164 19101 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:05:44.106457 18947 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:44.092690 18796 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:44.107329 18796 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.107728 19021 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:44.074362 18960 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:44.109057 12696 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:05:44.073232 19098 raft_consensus.cc:740] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:44.109752 12693 raft_consensus.cc:2368] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19.
I20260709 13:05:44.104152 12689 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:05:44.117444 13199 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:44.121903 18124 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:44.098206 12587 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:44.077762 18976 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.117318 13200 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:44.108480 18947 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:44.126231 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:44.083446 18968 raft_consensus.cc:2764] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 13:05:44.107810 18796 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:44.131548 12696 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 17: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:44.110113 19042 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:44.097502 19031 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.133605 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:44.090484 18950 consensus_queue.cc:1048] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 13:05:44.128057 18973 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:44.161685 13200 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:44.170188 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 72088.6us
I20260709 13:05:44.171216 12587 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:44.171622 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:44.172344 12689 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
W20260709 13:05:44.169904 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 221642us
I20260709 13:05:44.138214 18993 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:05:44.177925 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:44.180701 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 84804us
I20260709 13:05:44.146076 18962 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:44.183847 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.186712 13229 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:05:44.187741 12687 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:05:44.152907 18892 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:44.130684 18976 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:44.192261 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:44.194193 18124 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:44.194870 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:44.197726 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:44.198025 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:44.198470 12687 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:44.200047 12538 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:44.199496 12512 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:44.204361 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.182984 19023 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:44.206367 12512 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:44.213195 12538 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:44.187402 18962 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.170496 18968 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:05:44.222682 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.214124 12659 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:44.142270 19031 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:44.238065 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.239121 12547 raft_consensus.cc:2393] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 19: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:44.229521 12538 raft_consensus.cc:2410] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 13:05:44.232405 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.236181 12539 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:44.196985 18956 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:44.212752 18849 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:44.202203 19071 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:44.258653 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 111748us
I20260709 13:05:44.226840 18945 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:44.191924 19017 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:05:44.234042 18962 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:44.175963 18510 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:44.197266 18892 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:05:44.268827 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.275487 12547 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:44.263913 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.279716 12538 raft_consensus.cc:2410] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 16 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 7.
I20260709 13:05:44.273743 19081 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:44.314563 19081 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:44.315078 19081 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:44.316519 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:44.317211 12694 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:05:44.319183 12587 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:44.319756 19026 raft_consensus.cc:3055] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:44.320299 19026 raft_consensus.cc:740] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:44.207293 19098 consensus_queue.cc:260] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:44.327286 19098 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:44.329869 19060 consensus_queue.cc:1175] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a11816c5d72e4d1295a242f3ced09e5f" responder_term: 19 status { last_received { term: 16 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 18. Current term is 19. Ops: [18.11-18.11]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:05:44.331642 19021 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.331930 19031 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:44.332199 19021 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:44.332973 19008 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:05:44.334300 19021 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:44.337451 19045 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:44.262302 19077 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:44.297657 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.340759 12547 raft_consensus.cc:2393] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 15: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:44.266341 18945 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:44.300863 19111 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:05:44.257480 18950 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
W20260709 13:05:44.301589 19108 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:05:44.301875 19109 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.119s
I20260709 13:05:44.348215 19109 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:44.348608 19109 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.348977 19109 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:44.302479 19106 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:44.349784 19106 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.350196 19106 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:44.302852 19095 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:44.353963 19095 raft_consensus.cc:697] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:44.354930 19095 consensus_queue.cc:237] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:44.357990 19077 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:44.358820 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.359478 12547 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
I20260709 13:05:44.360356 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.362401 19023 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:05:44.363320 19023 consensus_queue.cc:1243] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 17.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 13:05:44.364468 19093 log.cc:927] Time spent T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.650s	user 0.002s	sys 0.000s
I20260709 13:05:44.306553 18976 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:44.281301 19112 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:05:44.308540 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:44.309661 12621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 2343) took 1749 ms (client timeout 1739 ms). Trace:
I20260709 13:05:44.257805 18956 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:44.371548 12621 rpcz_store.cc:269] 0709 13:05:42.559844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.559999 (+   155us) service_pool.cc:224] Handling call
0709 13:05:44.309454 (+1749455us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54001045d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:44.309594 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3426053888}
I20260709 13:05:44.326220 19027 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:44.296561 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 61468.9us
I20260709 13:05:44.345420 18945 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:44.384068 12510 connection.cc:256] RPC call timeout handler was delayed by -1.9882284389999541s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19630000000000003s for a response
I20260709 13:05:44.379739 13200 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:44.399554 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.344473 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.368558 18968 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:44.372488 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.409874 12538 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
W20260709 13:05:44.418622 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 217217us
W20260709 13:05:44.421667 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:44.422156 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.424311 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:44.426198 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:44.432480 12613 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:44.434648 12588 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:44.440204 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:44.441327 12618 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:44.444864 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.321310 19026 consensus_queue.cc:260] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:44.447072 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:44.449640 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:44.370992 19011 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:05:44.451177 12662 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:44.425194 18978 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:44.466598 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:44.470367 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:44.473627 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:44.475942 12662 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:44.478518 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:44.430792 18968 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:44.465842 19027 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:44.473789 18976 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:44.493346 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.487608 19077 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:44.487552 19021 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:44.504719 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:44.505295 12613 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:05:44.507001 12538 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:44.479945 12618 raft_consensus.cc:2393] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 18: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:44.510875 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:44.520123 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.521489 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.525610 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.537276 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.549950 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:44.562433 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.513080 19021 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:44.576666 12588 leader_election.cc:336] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.569s (SENT)
I20260709 13:05:44.577170 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:44.569818 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 112588us
I20260709 13:05:44.549866 18963 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:44.568290 19034 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:44.563617 19077 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.591732 18968 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:44.592412 18963 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:44.593729 19042 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:44.595491 18963 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:44.595803 19042 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:44.597359 18849 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:44.597750 12617 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:44.591403 19077 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:44.598718 18962 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:44.600134 19077 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:44.601706 12539 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
W20260709 13:05:44.602646 19121 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:05:44.602733 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.604089 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.593466 13233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1493) took 1040 ms. Trace:
I20260709 13:05:44.606565 13233 rpcz_store.cc:276] 0709 13:05:43.553383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.553687 (+   304us) service_pool.cc:224] Handling call
0709 13:05:43.554123 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:43.573641 (+ 19518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:43.573677 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:43.574136 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:05:44.311609 (+737473us) spinlock_profiling.cc:243] Waited 6.7 ms on lock 0x7b18004c7aa0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:05:44.519449 (+207840us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:44.519495 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.519572 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:44.593173 (+ 73601us) raft_consensus.cc:1685] finished
0709 13:05:44.593193 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.593397 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23331,"raft.queue_time_us":26456,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3259,"spinlock_wait_cycles":15409024,"thread_start_us":207655,"threads_started":1,"wal-append.queue_time_us":985808}
I20260709 13:05:44.616292 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:44.616858 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:44.618533 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.621770 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:44.622489 12688 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:44.627084 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.628444 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.629509 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.630494 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.631559 18849 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.632304 18849 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:44.634356 18849 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:44.636025 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.638263 12539 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:05:44.609721 18973 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:44.620436 18962 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:44.643087 18968 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:05:44.689220 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.665887 18796 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:44.676779 19021 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:44.702299 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 1384) took 1185 ms. Trace:
I20260709 13:05:44.701177 12688 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:44.679003 12538 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:05:44.702777 13232 rpcz_store.cc:276] 0709 13:05:43.511983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.513125 (+  1142us) service_pool.cc:224] Handling call
0709 13:05:44.697604 (+1184479us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b54005794d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:44.697778 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4170496}
I20260709 13:05:44.704520 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.705107 12540 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:44.699918 18968 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:44.708393 18968 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:44.710369 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:44.716701 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.684464 19135 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.719897 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:44.666050 19106 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:44.720775 12688 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 17: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:44.728356 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:44.753808 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.756319 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:44.757194 13227 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 23.
I20260709 13:05:44.757036 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:44.759730 13228 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:44.762408 12513 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:44.763409 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:44.763825 12513 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:44.764180 13232 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 16: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:44.764657 18893 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:44.765202 18893 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.765944 18893 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:44.768702 12513 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:44.769502 18712 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.769908 18124 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:44.770033 18712 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:44.771184 18925 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:44.776774 18956 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:44.787599 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.792191 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:44.795676 18584 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:44.796834 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:44.797454 12614 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:05:44.808370 12540 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:44.810132 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:44.833734 12689 raft_consensus.cc:2410] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:05:44.810618 19085 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:44.814960 19026 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:44.817219 18796 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:44.722684 19135 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:44.845700 12540 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:44.774420 18712 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:44.832165 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:44.851329 13230 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
W20260709 13:05:44.836122 19138 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
W20260709 13:05:44.850083 19140 log.cc:927] Time spent T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 13:05:44.850256 19130 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:05:44.850659 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:44.860682 19125 log.cc:927] Time spent T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 13:05:44.861341 19139 log.cc:927] Time spent T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 13:05:44.865538 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 168103us
W20260709 13:05:44.872156 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.859432 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:44.828133 19022 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.004s	sys 0.004s
I20260709 13:05:44.703121 19081 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:44.877632 13228 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:44.881314 13228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:44.882756 13228 raft_consensus.cc:606] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:05:44.883718 13228 raft_consensus.cc:614] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:44.884160 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:44.884810 12690 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:44.886068 12687 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:44.892151 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:44.898914 13230 pending_rounds.cc:85] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: Aborting all ops after (but not including) 14
I20260709 13:05:44.899123 19106 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:44.899350 13230 pending_rounds.cc:107] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 13:05:44.901010 12614 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:44.901444 13230 raft_consensus.cc:2889] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:44.906574 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:44.907244 12691 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:44.881419 12513 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:44.909363 18124 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:44.912422 12659 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:44.746717 19109 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:44.902109 19022 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.004s	sys 0.005s
I20260709 13:05:44.919445 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:44.973608 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:44.978053 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.977072 13197 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:44.853574 19085 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:44.985639 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:44.996106 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.997416 12614 raft_consensus.cc:2393] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 13: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:45.002676 12587 leader_election.cc:400] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19.
I20260709 13:05:45.003150 12587 leader_election.cc:403] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:05:45.003962 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 82944.7us
I20260709 13:05:44.923388 19031 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:45.010035 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:45.001026 18975 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:45.002417 19140 log.cc:927] Time spent T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 13:05:45.025419 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.924252 18945 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:45.003310 18796 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:45.009840 18849 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:45.018371 19031 raft_consensus.cc:697] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:05:45.032287 19132 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
I20260709 13:05:45.048393 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:45.048813 19135 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:45.049518 19136 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:05:45.051100 19081 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:45.051649 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:45.027025 19106 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19.
I20260709 13:05:45.055737 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:45.056399 12695 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:05:45.058116 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:45.042891 19123 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:45.059207 12587 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:45.061049 12695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:05:45.066195 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 1611) took 1318 ms. Trace:
I20260709 13:05:45.070082 12617 rpcz_store.cc:276] 0709 13:05:43.747974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.748267 (+   293us) service_pool.cc:224] Handling call
0709 13:05:45.065992 (+1317725us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b54002954d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:45.066125 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1522347904}
I20260709 13:05:45.074136 12539 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:45.039268 18796 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:45.065064 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:45.077414 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:45.076095 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1435) took 2158 ms. Trace:
I20260709 13:05:45.089141 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:45.091544 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.092614 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:45.093209 12540 raft_consensus.cc:2376] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18. Re-sending same reply.
I20260709 13:05:45.094311 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:45.095671 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:45.090021 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:45.067061 19123 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.122690 18124 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.102298 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:45.121732 12588 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:45.122645 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:45.123452 18124 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:45.125907 12510 leader_election.cc:336] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.739s (SENT)
I20260709 13:05:45.126317 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:45.131916 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 66944.3us
I20260709 13:05:45.099258 12538 raft_consensus.cc:2393] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 12: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:45.123714 12540 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:05:45.096349 12620 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:45.164923 12588 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:45.090459 12542 rpcz_store.cc:276] 0709 13:05:42.917241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.917358 (+   117us) service_pool.cc:224] Handling call
0709 13:05:42.936703 (+ 19345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:43.342962 (+406259us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:43.343015 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:43.346036 (+  3021us) log.cc:844] Serialized 26 byte log entry
0709 13:05:43.466685 (+120649us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:43.467038 (+   353us) log.cc:844] Serialized 14 byte log entry
0709 13:05:43.472461 (+  5423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.061168 (+1588707us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b5400069ad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:45.061217 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:45.061258 (+    41us) raft_consensus.cc:1685] finished
0709 13:05:45.075841 (+ 14583us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.076021 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19346,"prepare.queue_time_us":3287,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":29078,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":8716,"spinlock_wait_cycles":446240512,"thread_start_us":310549,"threads_started":2,"wal-append.queue_time_us":212618,"wal-append.run_cpu_time_us":15295,"wal-append.run_wall_time_us":1499633}
I20260709 13:05:45.166844 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:45.076934 19118 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:45.184401 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:45.073205 19045 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.168336 12662 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:45.188971 12662 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:45.172129 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 63287.9us
I20260709 13:05:45.190461 13197 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:45.172973 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:45.175508 18124 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:45.129374 19123 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:45.177759 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:45.225919 12618 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:45.192768 18976 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:45.192531 19098 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:45.246708 19151 log.cc:927] Time spent T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:05:45.216753 19010 log.cc:927] Time spent T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 1.009s	user 0.002s	sys 0.001s
W20260709 13:05:45.251609 19131 log.cc:927] Time spent T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.401s	user 0.003s	sys 0.000s
I20260709 13:05:45.252080 19034 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:45.252584 19034 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:45.255810 19110 log.cc:927] Time spent T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1: Append to log took a long time: real 0.981s	user 0.004s	sys 0.000s
W20260709 13:05:45.258713 19120 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.714s	user 0.003s	sys 0.000s
I20260709 13:05:45.193960 18124 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:45.265530 18124 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.266014 18124 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:45.268028 18124 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:45.274755 18953 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:45.275069 12546 raft_consensus.cc:1275] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:05:45.275513 12546 pending_rounds.cc:85] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 10
I20260709 13:05:45.275746 12546 pending_rounds.cc:107] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:05:45.275964 12546 raft_consensus.cc:2889] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:45.278035 18827 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:45.282279 19032 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:45.282362 18945 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:45.178581 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:45.292927 12691 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
W20260709 13:05:45.181581 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 45953.4us
I20260709 13:05:45.195549 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:45.172642 19106 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:45.196811 19085 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:45.197433 19148 log.cc:927] Time spent T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:05:45.202303 19022 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:45.203030 18712 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:45.206416 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:45.176489 18960 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:45.208932 19143 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:45.210625 18796 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:45.211128 12615 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 2314) took 3170 ms (client timeout 1963 ms). Trace:
W20260709 13:05:45.213272 19133 log.cc:927] Time spent T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
W20260709 13:05:45.214828 19145 log.cc:927] Time spent T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.365s	user 0.000s	sys 0.001s
W20260709 13:05:45.215163 19144 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
W20260709 13:05:45.472147 12615 rpcz_store.cc:269] 0709 13:05:42.040674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.040786 (+   112us) service_pool.cc:224] Handling call
0709 13:05:45.210877 (+3170091us) spinlock_profiling.cc:243] Waited 1.89 s on lock 0x7b5400099cd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:45.211026 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4336412032}
I20260709 13:05:45.219937 12695 raft_consensus.cc:606] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:45.220674 19109 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:45.282085 19031 consensus_queue.cc:237] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:45.178897 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:45.295315 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:45.141332 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.300612 12659 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:45.483148 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 182639us
W20260709 13:05:45.286325 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 93166.7us
I20260709 13:05:45.328945 12618 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
W20260709 13:05:45.428447 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.283778 19045 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:45.443048 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 247581us
I20260709 13:05:45.445015 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:45.489914 12539 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:45.490089 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:45.359575 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:45.491444 12538 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:45.358537 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:45.493171 12542 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:05:45.490680 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3492) took 1280 ms. Trace:
I20260709 13:05:45.498811 13197 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:45.185698 19118 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.466207 12540 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
W20260709 13:05:45.219506 19092 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.418s	user 0.001s	sys 0.002s
I20260709 13:05:45.477663 12695 raft_consensus.cc:614] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:45.442669 19119 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:45.490918 12693 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:45.471622 18893 consensus_meta.cc:287] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.704s	user 0.013s	sys 0.004s
I20260709 13:05:45.502205 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:45.496714 12544 rpcz_store.cc:276] 0709 13:05:44.209824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.212238 (+  2414us) service_pool.cc:224] Handling call
0709 13:05:45.369856 (+1157618us) spinlock_profiling.cc:243] Waited 3.24 ms on lock 0x7b5800000c98. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae53f0a0 00007fc3ae53e984 00007fc3a7ab96d4 00007fc3a7ab9662
0709 13:05:45.490586 (+120730us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7461120}
I20260709 13:05:45.503329 12588 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:45.542557 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:45.520629 12587 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:45.521772 19008 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:45.523402 19045 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:45.549721 19107 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:45.549983 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1455) took 1173 ms. Trace:
I20260709 13:05:45.550743 19081 consensus_queue.cc:1059] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:05:45.503582 19154 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.333s	user 0.001s	sys 0.003s
I20260709 13:05:45.528476 18928 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:45.550349 12547 rpcz_store.cc:276] 0709 13:05:44.376523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.376638 (+   115us) service_pool.cc:224] Handling call
0709 13:05:44.426357 (+ 49719us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:44.426684 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:44.426712 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:44.444534 (+ 17822us) log.cc:844] Serialized 52 byte log entry
0709 13:05:44.698011 (+253477us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:05:45.007434 (+309423us) log.cc:844] Serialized 14 byte log entry
0709 13:05:45.007765 (+   331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.007894 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:45.214561 (+206667us) spinlock_profiling.cc:243] Waited 5.22 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:45.549635 (+335074us) raft_consensus.cc:1685] finished
0709 13:05:45.549745 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.549911 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":305736,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":2844,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":23226,"spinlock_wait_cycles":13897344,"thread_start_us":523366,"threads_started":2,"wal-append.queue_time_us":405521}
I20260709 13:05:45.552322 18928 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:45.553539 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 2357) took 1119 ms. Trace:
I20260709 13:05:45.554606 18928 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:45.514391 19011 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.555496 19011 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:45.556744 19143 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:45.557356 12620 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:05:45.516491 19118 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:45.557528 19143 raft_consensus.cc:697] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:45.558686 19143 consensus_queue.cc:237] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:45.532644 12538 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:45.562846 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 2348) took 1136 ms. Trace:
I20260709 13:05:45.563239 12616 rpcz_store.cc:276] 0709 13:05:44.426175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.427245 (+  1070us) service_pool.cc:224] Handling call
0709 13:05:44.427613 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:44.575678 (+148065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:44.575706 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:44.581149 (+  5443us) log.cc:844] Serialized 26 byte log entry
0709 13:05:44.688738 (+107589us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:44.718670 (+ 29932us) log.cc:844] Serialized 14 byte log entry
0709 13:05:44.718887 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.718955 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:45.213993 (+495038us) spinlock_profiling.cc:243] Waited 6.47 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:45.562589 (+348596us) raft_consensus.cc:1685] finished
0709 13:05:45.562676 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.562790 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35107,"prepare.queue_time_us":30824,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":29,"raft.queue_time_us":70253,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":10150,"spinlock_wait_cycles":14877568,"thread_start_us":206445,"threads_started":2,"wal-append.queue_time_us":241861}
I20260709 13:05:45.546290 18796 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.568929 18796 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:45.496338 18827 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:45.477329 18712 raft_consensus.cc:697] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:45.547487 12588 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:45.547770 12512 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:45.548976 18856 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:45.553959 12619 rpcz_store.cc:276] 0709 13:05:44.434255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.570265 (+136010us) service_pool.cc:224] Handling call
0709 13:05:44.575223 (+  4958us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:44.612524 (+ 37301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:44.612573 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:44.617501 (+  4928us) log.cc:844] Serialized 26 byte log entry
0709 13:05:45.011363 (+393862us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:45.032452 (+ 21089us) log.cc:844] Serialized 14 byte log entry
0709 13:05:45.032674 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.032746 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:45.209439 (+176693us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:45.553186 (+343747us) raft_consensus.cc:1685] finished
0709 13:05:45.553306 (+   120us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.553458 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3433,"prepare.queue_time_us":21041,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":14934,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":10031,"spinlock_wait_cycles":9820928,"thread_start_us":335506,"threads_started":1,"wal-append.queue_time_us":411278}
W20260709 13:05:45.537798 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 370258us
I20260709 13:05:45.565415 12693 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
W20260709 13:05:45.570521 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.553349 19081 raft_consensus.cc:3055] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:05:45.546401 19148 log.cc:927] Time spent T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:05:45.539898 18994 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.582984 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3487) took 1379 ms. Trace:
W20260709 13:05:45.591265 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 43836.9us
I20260709 13:05:45.590826 12546 rpcz_store.cc:276] 0709 13:05:44.203484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.203658 (+   174us) service_pool.cc:224] Handling call
0709 13:05:44.228232 (+ 24574us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.276351 (+1048119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.582653 (+306302us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000a5fd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:45.582904 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2406664448}
I20260709 13:05:45.595906 12510 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:45.602061 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:45.576426 18827 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.604434 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2301) took 1249 ms. Trace:
I20260709 13:05:45.578285 19045 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.607645 12694 rpcz_store.cc:276] 0709 13:05:44.354619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.354781 (+   162us) service_pool.cc:224] Handling call
0709 13:05:44.355146 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:44.367137 (+ 11991us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:05:44.367198 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:44.367804 (+   606us) log.cc:844] Serialized 26 byte log entry
0709 13:05:44.575651 (+207847us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:44.575688 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.575748 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:45.212694 (+636946us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:45.597243 (+384549us) raft_consensus.cc:1685] finished
0709 13:05:45.597278 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.604343 (+  7065us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11555,"raft.queue_time_us":12929,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5035,"spinlock_wait_cycles":14659456,"thread_start_us":157187,"threads_started":1,"wal-append.queue_time_us":319629}
I20260709 13:05:45.610544 12588 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:45.581709 18849 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:45.598097 18856 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:45.581863 19081 raft_consensus.cc:740] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:45.620755 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:45.624202 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 2356) took 1190 ms. Trace:
I20260709 13:05:45.619154 19146 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:45.600153 19011 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:45.632702 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:45.634928 12510 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:45.631093 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2074) took 1242 ms. Trace:
I20260709 13:05:45.638154 12541 rpcz_store.cc:276] 0709 13:05:44.388550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.794390 (+405840us) service_pool.cc:224] Handling call
0709 13:05:44.794846 (+   456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:44.795125 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:05:45.014651 (+219526us) log.cc:844] Serialized 14 byte log entry
0709 13:05:45.630619 (+615968us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:45.630673 (+    54us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:45.630744 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.630845 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.631003 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":260288,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":9528,"raft.queue_time_us":91084,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":68,"thread_start_us":806373,"threads_started":3,"wal-append.queue_time_us":460944}
I20260709 13:05:45.597679 19032 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:45.613348 18928 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:45.615396 18827 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:45.617249 18849 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.624876 12613 rpcz_store.cc:276] 0709 13:05:44.433973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.540273 (+106300us) service_pool.cc:224] Handling call
0709 13:05:44.564252 (+ 23979us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:44.671125 (+106873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:44.671162 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:44.673897 (+  2735us) log.cc:844] Serialized 26 byte log entry
0709 13:05:44.725502 (+ 51605us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:44.748622 (+ 23120us) log.cc:844] Serialized 14 byte log entry
0709 13:05:44.847187 (+ 98565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.847261 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:45.623896 (+776635us) raft_consensus.cc:1685] finished
0709 13:05:45.623928 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.624131 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99667,"prepare.queue_time_us":116008,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":112052,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":6617,"thread_start_us":129865,"threads_started":2,"wal-append.queue_time_us":301591}
I20260709 13:05:45.604184 18994 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:45.630299 19107 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:45.660081 12688 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:45.665618 18124 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:45.666055 12587 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:45.611294 19017 consensus_queue.cc:1059] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:05:45.665647 12693 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:05:45.654356 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1453) took 1460 ms. Trace:
I20260709 13:05:45.667544 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:45.622762 19119 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:45.548641 18893 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:45.657719 19008 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:45.675228 19008 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:45.677219 18993 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:45.677840 18993 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:45.678654 18856 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:05:45.679901 19162 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:05:45.668742 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:05:45.669811 12545 rpcz_store.cc:276] 0709 13:05:44.193688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.193898 (+   210us) service_pool.cc:224] Handling call
0709 13:05:45.258625 (+1064727us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b5800000c98. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:05:45.258828 (+   203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.259022 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:05:45.259379 (+   357us) log.cc:844] Serialized 14 byte log entry
0709 13:05:45.654011 (+394632us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:45.654064 (+    53us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:45.654110 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.654183 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.654299 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3538,"prepare.queue_time_us":216,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"spinlock_wait_cycles":8679680,"thread_start_us":390698,"threads_started":1}
I20260709 13:05:45.629797 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:45.698244 12694 raft_consensus.cc:2393] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:45.654821 18849 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:45.624788 19045 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:45.666383 18945 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:05:45.611667 19123 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:45.654668 19157 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:45.734103 12539 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14. Ops: []
W20260709 13:05:45.737846 12662 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.009s	sys 0.033s
W20260709 13:05:45.738904 12662 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.009s	sys 0.033s
W20260709 13:05:45.739559 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 550619us
I20260709 13:05:45.695607 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:05:45.735559 12513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.033s	sys 0.039s
I20260709 13:05:45.669586 19064 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:45.740414 12513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.034s	sys 0.039s
W20260709 13:05:45.744395 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 114683us
I20260709 13:05:45.653692 18928 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:45.655556 19032 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:45.740379 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:45.754225 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:45.754894 18893 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:45.754940 13230 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:05:45.686707 19081 consensus_queue.cc:260] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:45.766506 19045 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:45.768389 19135 raft_consensus.cc:3055] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:45.769037 19135 raft_consensus.cc:740] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:45.770877 19022 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:45.771939 12662 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:45.772114 18993 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:45.774286 13233 raft_consensus.cc:1240] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:45.775357 19135 consensus_queue.cc:260] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:45.777104 19135 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:45.777196 19022 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:45.777653 19022 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.778020 19022 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:45.778235 19081 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:45.779718 13226 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:05:45.698853 18712 consensus_queue.cc:237] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:45.783699 19157 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:45.784257 19157 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:45.785262 18874 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.785902 18874 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:45.786399 19157 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:45.786877 19008 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:45.787127 19157 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:45.787684 19157 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:45.788359 19008 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.789161 18874 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:45.789660 19157 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:45.785920 19022 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:45.790789 12513 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:45.791095 19032 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:45.750083 18584 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.791860 19022 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:45.792052 18893 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:45.792657 18893 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.792104 18584 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:45.793001 18893 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:45.793202 19032 consensus_queue.cc:1059] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:45.794263 19011 raft_consensus.cc:3055] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:45.794610 19011 raft_consensus.cc:740] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:45.794708 18584 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:45.746268 19142 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:05:45.795511 19011 consensus_queue.cc:260] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:45.749917 19052 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:45.801959 12621 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:05:45.788906 19008 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:45.807577 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:45.743888 18856 raft_consensus.cc:697] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 13 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:45.794621 19123 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:45.807250 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:45.817178 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:45.823081 13233 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:45.750254 18956 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.067s
I20260709 13:05:45.805706 19017 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:45.819947 12692 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:05:45.817407 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:45.823334 12694 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
W20260709 13:05:45.832795 19034 consensus_meta.cc:287] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.002s
I20260709 13:05:45.816883 18960 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:45.833271 19034 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:45.833544 18960 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:45.833833 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:45.830454 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:45.806246 19146 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:05:45.839046 19017 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:45.841212 19017 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:45.843366 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:45.817937 18856 consensus_queue.cc:237] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:45.845275 19034 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:45.845985 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:45.822072 18928 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:45.797434 18796 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:45.821647 19118 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:45.852192 19118 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:45.818198 18994 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:45.816591 19157 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:05:45.853204 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:45.814448 18584 consensus_queue.cc:1059] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:05:45.853829 12690 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:45.854399 18584 raft_consensus.cc:3055] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:45.854758 18584 raft_consensus.cc:740] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:45.855671 18584 consensus_queue.cc:260] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:45.851891 18960 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:45.857977 18584 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:45.858644 18960 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:45.861635 12587 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:45.863268 18928 consensus_queue.cc:1059] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:45.863735 19118 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:45.864277 18928 raft_consensus.cc:3055] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:45.837649 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:45.866680 12690 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:45.866680 12542 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:45.867987 12587 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:45.829128 12662 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 2.042s (SENT) [suppressed 43 similar messages]
I20260709 13:05:45.872506 19017 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:45.864820 18928 raft_consensus.cc:740] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:45.882134 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:45.864321 19118 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.895205 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:45.899394 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:45.905143 13226 raft_consensus.cc:2410] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 13:05:45.871659 18893 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:45.896528 19118 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:45.896279 19017 raft_consensus.cc:697] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:45.913297 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:45.915159 13230 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:45.895771 18849 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:45.928750 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 292457us
I20260709 13:05:45.912083 18796 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.943420 13233 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:45.966460 19081 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:45.967391 19081 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:45.969949 18796 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:45.975131 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:45.969975 19017 consensus_queue.cc:237] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:45.977965 18956 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:45.978958 18956 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:45.987583 13230 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:45.990486 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:45.991966 13197 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:45.993878 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:45.989269 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 45117.7us
I20260709 13:05:45.996872 13197 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:45.991449 12619 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:05:45.996409 12513 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:45.998364 13197 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:46.006974 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:46.007932 12613 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:46.012174 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:46.014371 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:46.016537 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:45.996752 18796 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:46.039034 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:46.043360 18124 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:46.044186 18124 raft_consensus.cc:697] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 17 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:46.045235 18124 consensus_queue.cc:237] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:46.056332 12691 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.013s	sys 0.025s
W20260709 13:05:46.059930 12691 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.013s	sys 0.025s
I20260709 13:05:45.919646 18928 consensus_queue.cc:260] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:46.071482 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:46.068823 13200 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.005s	sys 0.017s
W20260709 13:05:46.072570 13200 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.005s	sys 0.018s
W20260709 13:05:46.069478 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 459864us
I20260709 13:05:46.086467 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:46.089072 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:46.090183 12545 raft_consensus.cc:2368] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20.
I20260709 13:05:46.098827 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:46.099753 12538 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:46.103149 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:46.104131 12538 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
W20260709 13:05:46.105422 12659 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.012s	sys 0.015s
W20260709 13:05:46.105840 12659 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.012s	sys 0.015s
W20260709 13:05:46.109745 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 604183us
I20260709 13:05:46.092527 19008 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:46.126395 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:46.102548 18994 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:46.131160 19173 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:46.116015 19081 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:46.131196 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:46.137733 12547 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 18: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:46.088629 19064 consensus_queue.cc:1059] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:05:46.117193 18975 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:46.156702 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 411309us
I20260709 13:05:46.160135 12542 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
W20260709 13:05:46.161962 13199 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.011s	sys 0.006s
W20260709 13:05:46.166462 13199 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.011s	sys 0.006s
W20260709 13:05:46.167078 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.169466 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:46.169751 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:46.170295 12687 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:05:46.170673 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:46.171077 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:05:46.172966 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:46.177718 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.178233 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:05:46.173527 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.137485 19173 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:46.199369 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:46.200340 12613 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:46.201414 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:46.202033 13233 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:46.203421 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:46.204228 12613 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:46.207386 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:46.143303 18994 raft_consensus.cc:697] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:46.216513 13233 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
I20260709 13:05:46.216369 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:46.211177 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:46.219053 12687 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:05:46.220523 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:46.221318 12687 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:05:46.218786 12513 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:46.137392 19008 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 13:05:46.178264 19081 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.139194 18827 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:46.228029 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 398920us
I20260709 13:05:46.275956 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:46.228919 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:46.280278 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:46.281060 12690 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:46.281662 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:46.281935 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:46.229929 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:46.230158 12618 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:46.230686 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:46.231521 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:46.284842 12617 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:46.231959 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:46.232157 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:46.225292 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:46.279584 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:46.211674 18893 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:46.198312 19173 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:46.289296 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:46.290508 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:46.292815 12696 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:46.294413 12616 raft_consensus.cc:2393] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 18: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:46.286353 12619 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
W20260709 13:05:46.287670 18712 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.021s	sys 0.027s
I20260709 13:05:46.327152 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:46.338232 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:46.327934 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:46.340548 12616 raft_consensus.cc:2393] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 13: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:46.226503 18849 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:46.346805 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:46.298327 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:46.336898 12615 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:46.350656 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:05:46.330909 13232 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.017s	sys 0.022s
I20260709 13:05:46.271080 19166 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:05:46.352881 13232 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.017s	sys 0.023s
I20260709 13:05:46.329370 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:46.355499 12620 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
W20260709 13:05:46.356393 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.349252 12588 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:46.359012 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:46.360234 12588 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:46.280450 19034 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:46.343307 18712 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.021s	sys 0.027s
I20260709 13:05:46.323457 19168 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:46.371820 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 363234us
I20260709 13:05:46.393808 13197 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:46.395515 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:46.279234 19081 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:46.361315 19181 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.371426 18849 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:46.391638 12659 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:46.408226 12696 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:46.378952 19166 raft_consensus.cc:697] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 20 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:46.436693 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:46.439455 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 47969.7us
I20260709 13:05:46.440768 12659 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:46.442904 12614 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.018s	sys 0.029s
W20260709 13:05:46.443431 12614 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.018s	sys 0.029s
I20260709 13:05:46.392480 19183 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:05:46.401918 19135 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:46.450160 13199 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:46.411867 18956 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:46.456913 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 383650us
I20260709 13:05:46.417235 19032 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:46.383992 19034 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:46.403259 19168 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:46.436474 18849 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:46.465551 19022 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:46.459007 19177 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:46.501941 18827 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:46.502360 19177 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:46.502667 18827 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:46.502827 19177 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:46.503201 18827 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:46.497656 19008 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.506042 19008 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:46.458884 18712 raft_consensus.cc:2764] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:05:46.435909 18994 consensus_queue.cc:237] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:46.501420 19166 consensus_queue.cc:237] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:46.482466 19045 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:05:46.499688 19179 log.cc:927] Time spent T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 13:05:46.433409 19181 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:46.513110 18584 consensus_meta.cc:287] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.655s	user 0.004s	sys 0.006s
I20260709 13:05:46.518815 19081 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:46.525471 19008 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:46.474552 19135 raft_consensus.cc:697] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:05:46.657877 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 217193us
W20260709 13:05:46.659101 12544 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.004s	sys 0.004s
W20260709 13:05:46.659588 12544 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.004s	sys 0.004s
W20260709 13:05:46.660310 12545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.000s	sys 0.009s
W20260709 13:05:46.660768 12545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.000s	sys 0.009s
W20260709 13:05:46.661533 12539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.002s	sys 0.006s
W20260709 13:05:46.662252 12539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.003s	sys 0.006s
I20260709 13:05:46.679172 12690 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:46.493221 13200 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:46.696339 12694 raft_consensus.cc:2410] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 13:05:46.699641 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:46.700357 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:46.703850 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 210719us
I20260709 13:05:46.501138 19022 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:46.707486 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 48604.3us
I20260709 13:05:46.726406 19022 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:46.741858 19034 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:46.748054 19031 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:46.748667 19031 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.749058 19031 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:46.643813 18827 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:46.759979 12617 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
I20260709 13:05:46.499058 19032 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:46.730931 19026 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:46.779017 19181 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:46.783777 19008 consensus_queue.cc:1059] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:46.785161 13200 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:05:46.797797 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.810689 19199 raft_consensus.cc:3055] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:05:46.813620 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 529508us
W20260709 13:05:46.807205 19118 consensus_meta.cc:287] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.888s	user 0.013s	sys 0.000s
I20260709 13:05:46.816298 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:46.818480 12542 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:05:46.824780 12513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.013s	sys 0.025s
W20260709 13:05:46.826411 12513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.014s	sys 0.025s
I20260709 13:05:46.810782 19008 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:05:46.852464 12689 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.026s	sys 0.062s
W20260709 13:05:46.853032 12689 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.027s	sys 0.062s
I20260709 13:05:46.858338 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:46.860131 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:46.864172 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:46.865092 12538 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:46.862437 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2319) took 1040 ms. Trace:
I20260709 13:05:46.860980 12541 raft_consensus.cc:2376] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16. Re-sending same reply.
I20260709 13:05:46.801136 19026 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:46.872033 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:46.848364 19056 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.011s	sys 0.077s
I20260709 13:05:46.812763 19199 raft_consensus.cc:740] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:46.874729 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:46.881451 12688 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:05:46.875056 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:46.880560 19056 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.011s	sys 0.077s
I20260709 13:05:46.886755 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:46.856194 12542 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
W20260709 13:05:46.887164 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 166981us
I20260709 13:05:46.899104 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:46.900004 12620 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:46.902379 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:46.903430 12616 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:46.906811 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:46.909060 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:46.914772 12588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.006s	sys 0.012s
I20260709 13:05:46.878348 19026 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:46.873284 18827 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:05:46.923506 12662 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.031s	sys 0.068s
I20260709 13:05:46.844712 19118 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:46.916128 19123 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:46.914300 12659 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:46.817126 19135 consensus_queue.cc:237] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:46.914919 19211 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:05:46.948779 12511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.032s	sys 0.013s
W20260709 13:05:46.950366 12511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.032s	sys 0.013s
I20260709 13:05:46.931843 18849 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:46.953444 18124 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.012s	sys 0.021s
W20260709 13:05:46.955304 18124 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.012s	sys 0.021s
W20260709 13:05:46.924642 12662 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.032s	sys 0.069s
I20260709 13:05:46.877344 19008 raft_consensus.cc:697] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:46.915416 19168 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:46.924042 12588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.006s	sys 0.012s
I20260709 13:05:46.938125 12622 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 18: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:46.934715 19209 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:46.927845 19123 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:46.966224 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 606031us
W20260709 13:05:46.917227 13197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.006s	sys 0.013s
I20260709 13:05:46.975517 12662 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:46.928381 18827 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:46.979008 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:46.964582 19188 log.cc:927] Time spent T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:05:46.989629 12588 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:46.960469 19056 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:46.974339 12538 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:46.996321 12588 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:46.977442 19209 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.976718 19207 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:46.981787 19167 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:46.982055 19180 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.949070 19211 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:46.936422 19199 consensus_queue.cc:260] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:46.978916 13197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.007s	sys 0.013s
I20260709 13:05:46.987875 19142 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:05:47.009500 19204 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
W20260709 13:05:47.025005 19212 log.cc:927] Time spent T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:05:47.025276 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:47.026042 12617 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
W20260709 13:05:47.026427 19202 log.cc:927] Time spent T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:05:47.035808 19211 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:47.036764 19210 log.cc:927] Time spent T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:05:47.038152 18124 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.038883 18124 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:46.998011 19056 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:47.009047 19208 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:47.007035 19209 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:47.054513 19199 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:47.005532 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 134475us
I20260709 13:05:47.067747 13199 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:47.068179 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:47.068998 19223 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:47.011305 19034 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:05:47.069555 19223 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:47.043088 19173 consensus_meta.cc:287] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.693s	user 0.005s	sys 0.011s
I20260709 13:05:47.070600 19173 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.041460 18124 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:47.072794 19173 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:46.994683 19214 consensus_queue.cc:1048] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:05:47.018738 19207 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.077159 19207 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:47.014298 19180 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:47.079468 19177 consensus_meta.cc:287] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.576s	user 0.012s	sys 0.000s
I20260709 13:05:47.079800 19180 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:47.007465 12662 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:47.081419 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 74032.5us
I20260709 13:05:47.082243 12662 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:47.005362 19216 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:05:47.012677 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 618907us
I20260709 13:05:47.056803 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:47.090301 13197 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:47.057948 19032 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:47.057680 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:47.042990 19031 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:47.093185 13229 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
I20260709 13:05:47.059293 19056 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:47.045262 19022 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:47.043565 18827 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:47.044611 19118 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:47.091037 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:47.043985 19123 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:47.094801 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 98570.5us
I20260709 13:05:47.097723 12513 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:47.089299 12688 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:05:47.042306 19176 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:47.089623 12662 leader_election.cc:400] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20.
I20260709 13:05:47.099466 13197 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:47.092051 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:47.103191 12662 leader_election.cc:403] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:05:47.016746 19167 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.101584 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:47.106840 12690 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 17: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:47.103624 12687 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:47.108265 12662 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:47.104668 12588 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:47.113982 12510 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:47.115953 12510 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:47.117379 18124 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:47.117923 18124 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:47.118345 18124 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:47.108175 13199 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:47.092075 19034 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:47.119504 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:47.095592 19214 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:47.126080 12544 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:05:47.127704 12662 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:47.128837 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:47.129624 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:47.130734 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:47.133337 12662 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:47.096058 19203 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:47.136145 19181 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:47.144523 12538 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:05:47.021059 19008 consensus_queue.cc:237] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.146379 18945 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:47.146984 18945 raft_consensus.cc:697] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:47.147854 18945 consensus_queue.cc:237] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.136864 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:47.150861 18950 raft_consensus.cc:3055] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:47.151232 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:47.151441 18950 raft_consensus.cc:740] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:47.152364 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:47.080070 19177 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.162972 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2312) took 1673 ms. Trace:
I20260709 13:05:47.100553 19216 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:47.165951 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.173887 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:47.142452 12545 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:47.138028 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:47.070060 19223 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:47.186189 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:47.192219 12691 rpcz_store.cc:276] 0709 13:05:45.489301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.492003 (+  2702us) service_pool.cc:224] Handling call
0709 13:05:45.492736 (+   733us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:46.063917 (+571181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:46.063969 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:46.999522 (+935553us) spinlock_profiling.cc:243] Waited 58 ms on lock 0x7b2c00103488. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:05:46.999934 (+   412us) log.cc:844] Serialized 26 byte log entry
0709 13:05:47.093973 (+ 94039us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:47.094024 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:47.095339 (+  1315us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:47.162612 (+ 67273us) raft_consensus.cc:1685] finished
0709 13:05:47.162639 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:47.162899 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42745,"raft.queue_time_us":52414,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":133422336,"thread_start_us":639625,"threads_started":2,"wal-append.queue_time_us":160951}
I20260709 13:05:47.201092 12544 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
W20260709 13:05:47.202447 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 69179us
I20260709 13:05:47.122722 18827 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:47.122910 19123 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:47.142895 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:47.211247 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:47.216495 12620 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:47.217893 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:47.131496 19207 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:47.219442 19207 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.219978 19207 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:47.082129 19208 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.224633 19208 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:47.226648 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:47.153478 19142 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:47.152665 18950 consensus_queue.cc:260] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:47.131366 19224 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:47.135989 18960 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:47.136237 18975 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:47.160322 19056 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:47.155398 19167 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:47.159795 19217 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:47.153730 19168 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:47.131970 18796 consensus_queue.cc:1059] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.098s
I20260709 13:05:47.214040 19181 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:05:47.254717 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.232795 19123 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.215049 19205 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:47.157932 18994 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:05:47.235201 19224 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:47.251675 19216 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:47.249503 18124 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:47.251935 19217 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.214582 19226 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:05:47.200826 19176 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.259784 19056 raft_consensus.cc:697] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:47.300060 12620 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 13:05:47.305879 18124 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:47.297801 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 67749us
I20260709 13:05:47.269752 19123 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:47.309659 13228 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 13:05:47.311457 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.307910 12662 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:47.267256 19168 raft_consensus.cc:697] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:47.276366 19205 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.275732 19224 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:47.328511 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:47.294435 19217 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:47.251616 18975 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.300418 19203 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:47.314703 19118 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:47.365074 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 112813us
I20260709 13:05:47.375511 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:47.376204 13228 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:47.295331 19216 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:47.382676 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 74831.6us
I20260709 13:05:47.385614 12662 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:47.331305 19209 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:47.374251 19031 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:47.395335 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:47.375651 19237 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:47.377194 19022 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:47.399179 19237 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:47.383131 19236 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:47.403522 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:47.409296 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:47.404795 19045 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:47.372084 19203 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.406925 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:47.413022 13232 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:05:47.373855 19118 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.411638 13229 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 21: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:47.415552 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:47.413995 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 3886) took 1208 ms. Trace:
I20260709 13:05:47.421506 12662 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:47.418308 12622 rpcz_store.cc:276] 0709 13:05:46.206973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.207115 (+   142us) service_pool.cc:224] Handling call
0709 13:05:47.413799 (+1206684us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54001054d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:47.413942 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1678292864}
I20260709 13:05:47.428030 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:47.432296 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:47.433002 13229 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:47.401422 19177 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:47.434129 13197 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:47.435014 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:47.427954 19085 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:47.417282 19045 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:05:47.441542 19228 log.cc:927] Time spent T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:05:47.442152 19211 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:47.436271 18928 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:47.446190 19176 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:47.446458 19231 log.cc:927] Time spent T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:05:47.447799 19118 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:47.415764 19205 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:47.398352 19026 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:47.490975 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 56932.1us
I20260709 13:05:47.491837 13197 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:47.378090 19056 consensus_queue.cc:237] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:47.493103 13197 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:47.417052 19236 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.410388 19237 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:47.410169 19168 consensus_queue.cc:237] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.451835 19217 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.460135 12510 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:47.501124 13229 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:05:47.454207 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 2297) took 1065 ms. Trace:
I20260709 13:05:47.464848 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:47.466653 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:47.468611 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 47181.5us
I20260709 13:05:47.502007 12695 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:47.501827 12694 rpcz_store.cc:276] 0709 13:05:46.388639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.401257 (+ 12618us) service_pool.cc:224] Handling call
0709 13:05:47.453947 (+1052690us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54002ca454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:47.454096 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":594417024}
I20260709 13:05:47.484719 12690 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:05:47.502110 12688 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:05:47.485777 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:47.503592 13197 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:47.470319 18960 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:47.504546 19176 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:47.442263 19232 log.cc:927] Time spent T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:05:47.459087 19203 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:05:47.504806 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 44758.9us
I20260709 13:05:47.507128 12510 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:47.509999 12510 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:47.509615 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:47.492128 19026 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:47.455825 19209 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:47.514346 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:47.457590 19216 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:47.454629 18975 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:47.516777 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:47.501387 19199 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:47.483253 19211 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.519014 19205 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:47.513595 18945 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:47.514232 19176 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:47.508050 19243 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:47.540270 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:47.541849 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:47.542237 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:47.544148 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:47.544787 12541 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:47.519169 19177 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:47.548352 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:47.521639 19085 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:47.547079 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:47.549461 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:47.523577 18960 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:05:47.550566 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:47.548880 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:47.551311 12541 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:47.517601 19242 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:47.559412 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:47.560031 12538 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:47.560288 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:47.555554 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:47.556470 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:47.561331 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:47.561455 12687 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:47.557118 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:47.562340 12691 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:47.562371 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:47.558086 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:47.573104 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:47.575769 12694 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: []
I20260709 13:05:47.587867 13232 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:47.605032 12691 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:05:47.602432 12687 raft_consensus.cc:2368] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 19. Current term is 20.
I20260709 13:05:47.567767 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:47.606791 12547 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:47.576314 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:47.603482 12544 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:47.565375 13231 raft_consensus.cc:2368] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15.
I20260709 13:05:47.560853 13234 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:47.545532 19176 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:47.618294 19176 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:47.632485 12544 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
W20260709 13:05:47.567628 19191 log.cc:927] Time spent T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.820s	user 0.005s	sys 0.000s
I20260709 13:05:47.649183 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:47.649814 12538 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:05:47.645668 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:47.647744 12621 raft_consensus.cc:2368] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:05:47.655061 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:47.655725 12544 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:05:47.559092 18849 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:47.563360 19164 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:47.663890 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:46.867367 12689 rpcz_store.cc:276] 0709 13:05:45.822104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.822371 (+   267us) service_pool.cc:224] Handling call
0709 13:05:45.822772 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.823048 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:05:46.322763 (+499715us) log.cc:844] Serialized 14 byte log entry
0709 13:05:46.853800 (+531037us) log.cc:844] Serialized 14 byte log entry
0709 13:05:46.861920 (+  8120us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:46.862010 (+    90us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:05:46.862080 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:46.862183 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:46.862353 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18214,"prepare.queue_time_us":640163,"prepare.run_cpu_time_us":130,"prepare.run_wall_time_us":133,"raft.queue_time_us":94116,"raft.run_cpu_time_us":404,"raft.run_wall_time_us":27312,"thread_start_us":1001991,"threads_started":2}
I20260709 13:05:47.717764 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:47.648825 18827 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20.
I20260709 13:05:47.615577 19207 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:47.716606 19032 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:47.729518 19032 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.722635 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:47.741026 12544 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:47.743563 12538 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:47.751996 12690 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
I20260709 13:05:47.757357 12544 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 22.
I20260709 13:05:47.763641 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:47.750980 19032 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:47.752045 19223 consensus_meta.cc:287] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.538s	user 0.011s	sys 0.000s
I20260709 13:05:47.768327 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:47.765647 12512 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:47.722966 18849 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:47.778645 19251 log.cc:927] Time spent T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:05:47.716354 19237 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.722339 19164 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.761323 19217 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:47.737118 19224 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.784919 19223 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.771560 19236 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:47.798853 19045 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.806422 19211 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:47.804679 12547 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:47.789602 12512 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:47.814006 19176 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.820029 12695 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:05:47.805073 19123 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.772657 19085 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.830066 12512 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:47.831058 19123 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:47.831692 19123 raft_consensus.cc:2764] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:05:47.832409 12542 raft_consensus.cc:2368] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15.
I20260709 13:05:47.832917 19085 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:47.835474 19085 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:47.835911 12512 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:47.839226 19123 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:47.840701 12512 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:47.847208 19164 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:47.848842 18849 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:47.850212 19207 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:47.820916 19249 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:47.852262 19223 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:47.853196 13228 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 19: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:47.854084 19224 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:47.826252 19178 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.854923 19178 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.856961 19178 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:47.860440 19237 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:47.868816 19176 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:47.838493 19257 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:47.883693 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:47.884752 12691 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:05:47.888837 12691 pending_rounds.cc:85] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 10
I20260709 13:05:47.889073 12691 pending_rounds.cc:107] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:05:47.889295 12691 raft_consensus.cc:2889] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:47.890479 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:47.892150 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:47.892742 12694 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:47.887559 12512 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:47.893345 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:47.893440 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:47.894464 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:47.875646 19123 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:47.900913 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 2358) took 2809 ms. Trace:
I20260709 13:05:47.898972 12694 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:05:47.896050 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:47.905443 12689 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:05:47.880092 19249 raft_consensus.cc:697] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:47.897540 12512 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:47.905500 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:47.901415 12614 rpcz_store.cc:276] 0709 13:05:45.091182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.314795 (+223613us) service_pool.cc:224] Handling call
0709 13:05:45.442120 (+127325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:45.458077 (+ 15957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.458118 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:45.458617 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 13:05:45.919525 (+460908us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:46.446612 (+527087us) log.cc:844] Serialized 14 byte log entry
0709 13:05:46.455771 (+  9159us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:47.900469 (+1444698us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b54002a8ad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:47.900522 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:47.900566 (+    44us) raft_consensus.cc:1685] finished
0709 13:05:47.900669 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:47.900837 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8513,"prepare.queue_time_us":554551,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":1664,"raft.queue_time_us":9153,"raft.run_cpu_time_us":309,"raft.run_wall_time_us":15237,"spinlock_wait_cycles":34895488,"thread_start_us":895122,"threads_started":2,"wal-append.queue_time_us":632270,"wal-append.run_cpu_time_us":3025,"wal-append.run_wall_time_us":1369009}
I20260709 13:05:47.912429 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:47.917088 12512 leader_election.cc:400] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 19. Current term is 20.
I20260709 13:05:47.917729 12512 leader_election.cc:403] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:47.924564 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:47.925194 12691 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:47.899798 19178 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:47.921314 13200 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:47.895038 19164 consensus_queue.cc:1059] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:05:47.910857 18945 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:47.931835 19176 consensus_queue.cc:1059] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:05:47.933346 19236 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:47.934805 18978 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:47.936939 18978 raft_consensus.cc:697] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:47.942382 18994 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:47.914911 18827 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:47.955014 12689 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:47.957365 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:47.932546 19257 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 19. Current term is 20.
I20260709 13:05:47.947245 18827 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.963850 12689 raft_consensus.cc:2393] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:47.968500 12691 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:47.969631 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:47.930464 19123 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:05:47.948520 19172 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.961320 19178 raft_consensus.cc:3055] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:47.972781 19045 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:47.948246 18994 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.974762 19172 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:47.981242 19172 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:47.984970 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1407) took 2077 ms. Trace:
I20260709 13:05:47.971400 18827 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:47.985697 12621 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 2369) took 1701 ms (client timeout 1963 ms). Trace:
W20260709 13:05:47.990260 12621 rpcz_store.cc:269] 0709 13:05:46.284298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.288978 (+  4680us) service_pool.cc:224] Handling call
0709 13:05:47.985442 (+1696464us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400099cd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:47.985630 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3095600512}
I20260709 13:05:47.979074 12689 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 23. Current term is 24. Ops: []
I20260709 13:05:47.986970 13226 rpcz_store.cc:276] 0709 13:05:45.907150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.907907 (+   757us) service_pool.cc:224] Handling call
0709 13:05:45.913201 (+  5294us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:45.913587 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.913617 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:45.918283 (+  4666us) log.cc:844] Serialized 52 byte log entry
0709 13:05:46.387588 (+469305us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:46.413627 (+ 26039us) log.cc:844] Serialized 14 byte log entry
0709 13:05:46.697116 (+283489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:46.697469 (+   353us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:47.982551 (+1285082us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b18004d9fe0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c3f3 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
0709 13:05:47.984617 (+  2066us) raft_consensus.cc:1685] finished
0709 13:05:47.984728 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:47.984884 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":290428,"prepare.queue_time_us":27047,"prepare.run_cpu_time_us":219,"prepare.run_wall_time_us":222,"raft.queue_time_us":283187,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":23297,"spinlock_wait_cycles":59871104,"thread_start_us":417395,"threads_started":1,"wal-append.queue_time_us":786025}
I20260709 13:05:47.995044 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:47.977713 19178 raft_consensus.cc:740] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:05:48.000017 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 77121.5us
I20260709 13:05:48.001681 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:48.002131 12547 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:05:48.002226 12544 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:47.985440 18994 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:48.009835 12544 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:48.012688 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:48.014386 12539 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:05:47.975093 19249 consensus_queue.cc:237] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:47.973102 18978 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:48.015121 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:48.021035 12544 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:05:48.027639 13200 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:48.029033 19172 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:48.031514 19177 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:48.032039 19177 raft_consensus.cc:697] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:48.032841 19177 consensus_queue.cc:237] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:48.023162 19258 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:05:48.039388 18827 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:48.041268 12694 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:48.042975 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:48.027966 19178 consensus_queue.cc:260] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:48.056953 13200 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:48.058480 19172 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:05:48.073732 19203 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:48.074235 19203 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.074616 19203 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:48.072317 12512 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:48.081323 18124 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:48.081816 18124 raft_consensus.cc:697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:05:48.080463 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 646504us
I20260709 13:05:48.083747 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:48.102476 18124 consensus_queue.cc:237] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:48.082408 19181 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.086225 19178 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:48.116644 19186 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 1.654s	user 0.005s	sys 0.000s
I20260709 13:05:48.111116 18928 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.117702 18928 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:48.118913 19167 raft_consensus.cc:3055] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:48.119410 19167 raft_consensus.cc:740] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:48.119771 18928 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:48.109098 19146 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.015s
I20260709 13:05:48.120499 19167 consensus_queue.cc:260] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:48.121835 19181 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:48.126204 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:48.085206 18893 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 13:05:48.137948 12662 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:48.158373 12662 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:48.139377 19011 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:48.141126 18950 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:48.164073 13233 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:48.164427 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:48.143659 12691 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:05:48.144016 12695 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:48.147744 13226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:48.148583 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:48.152134 13199 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:48.149904 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:48.150671 13227 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:48.154793 12694 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:48.166528 13234 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:48.148660 18712 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.099619 19118 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:48.171852 13199 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:48.172649 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:48.173177 12544 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 21. Current term is 22. Ops: []
I20260709 13:05:48.176820 13199 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:48.111701 19056 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:48.181066 12662 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:48.183859 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:48.184544 13228 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:48.185617 13199 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:48.165428 19214 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:48.186700 12543 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:48.186918 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:48.188766 12512 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:48.169795 19045 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:48.192203 12662 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:48.175093 19208 raft_consensus.cc:3055] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:48.178061 19243 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:48.196478 19085 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:48.239951 19243 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:48.244278 19243 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:48.244359 19085 raft_consensus.cc:697] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:48.185958 18978 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:48.246165 18978 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:48.245762 19085 consensus_queue.cc:237] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:48.249907 18827 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:48.173861 19223 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:05:48.177953 18712 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:48.246551 18978 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:48.258029 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1640) took 1132 ms. Trace:
I20260709 13:05:48.258437 12616 rpcz_store.cc:276] 0709 13:05:47.125632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.301037 (+175405us) service_pool.cc:224] Handling call
0709 13:05:47.301345 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:47.395667 (+ 94322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:47.395700 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:47.395744 (+    44us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:47.395773 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.257776 (+862003us) spinlock_profiling.cc:243] Waited 94.1 ms on lock 0x7b54002a67d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:48.257821 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:48.257956 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216484096}
I20260709 13:05:48.259366 18712 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:48.259979 13226 raft_consensus.cc:606] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:05:48.260509 13226 raft_consensus.cc:614] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:48.257261 18796 raft_consensus.cc:3055] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:05:48.203890 18893 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:48.203445 19045 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.262478 19045 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:48.261130 18796 raft_consensus.cc:740] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:48.263646 18796 consensus_queue.cc:260] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:48.265110 18796 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:05:48.241760 19198 log.cc:927] Time spent T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 1.495s	user 0.004s	sys 0.000s
I20260709 13:05:48.182613 19118 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:48.188616 19056 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:48.197600 19172 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:48.238734 19208 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:48.277655 12546 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
W20260709 13:05:48.284582 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 99108.8us
W20260709 13:05:48.295222 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.296131 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:48.296798 12616 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:48.276620 19172 raft_consensus.cc:697] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:48.284500 19223 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:48.300289 19172 consensus_queue.cc:237] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:48.305330 12616 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:48.279497 19208 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:48.310169 19243 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:48.310979 19208 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:48.312654 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:48.316648 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 124575us
I20260709 13:05:48.318240 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:48.278173 19181 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:48.272326 19118 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:48.275661 19056 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:48.320509 12546 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:48.320777 19217 consensus_queue.cc:1059] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:05:48.321736 19171 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:48.322417 19171 raft_consensus.cc:697] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:48.322731 12546 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:05:48.323402 19171 consensus_queue.cc:237] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:48.324047 18993 consensus_queue.cc:1059] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:05:48.312882 19243 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:48.321864 19211 raft_consensus.cc:3055] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:48.325551 19211 raft_consensus.cc:740] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:48.326507 19211 consensus_queue.cc:260] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:48.327726 19211 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:48.330668 19224 raft_consensus.cc:3055] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:48.331116 19224 raft_consensus.cc:740] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:48.332026 19224 consensus_queue.cc:260] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:48.333804 12510 leader_election.cc:336] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.963s (SENT)
I20260709 13:05:48.333314 19224 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:48.184043 19167 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:48.337915 19223 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:48.338492 19223 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:48.340623 19223 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:48.355041 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:48.357225 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:48.359935 13234 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:05:48.358634 19203 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:48.362403 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:48.362985 13228 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:05:48.363107 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:48.317589 12662 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:48.364935 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:48.366816 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:48.367558 12694 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:48.368417 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:48.370584 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:48.372138 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:48.383353 13233 raft_consensus.cc:2393] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 13: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:48.384193 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:05:48.384442 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 66999.1us
I20260709 13:05:48.385363 12662 leader_election.cc:400] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15.
I20260709 13:05:48.385856 12662 leader_election.cc:403] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:05:48.386289 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:48.386902 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.389685 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:48.390182 13232 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 13. (term mismatch)
I20260709 13:05:48.390570 13232 pending_rounds.cc:85] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: Aborting all ops after (but not including) 12
I20260709 13:05:48.390477 12615 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:48.391018 13232 pending_rounds.cc:107] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260709 13:05:48.391311 13232 raft_consensus.cc:2889] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:48.394932 13229 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:05:48.407436 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:48.408646 12513 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:48.416924 12694 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:05:48.418246 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:48.418519 13199 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:48.410493 12513 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:48.422125 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:48.398772 19181 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:48.427181 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:48.411746 19164 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:48.389009 19178 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 13:05:48.411567 19237 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15.
I20260709 13:05:48.448186 12659 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:48.450059 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:48.455755 12621 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
W20260709 13:05:48.446754 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 977175us
I20260709 13:05:48.458456 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:48.459178 12694 raft_consensus.cc:2393] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 16: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:48.461503 12692 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:48.462975 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:48.428745 19180 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:05:48.469015 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 385286us
I20260709 13:05:48.418084 18827 consensus_queue.cc:1059] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
W20260709 13:05:48.520431 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 45682.8us
I20260709 13:05:48.526247 12662 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:48.420285 19021 consensus_queue.cc:1059] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:05:48.439800 18945 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:48.475832 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 2370) took 2184 ms. Trace:
I20260709 13:05:48.523643 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:48.564097 12691 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:48.439338 19181 raft_consensus.cc:697] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:48.557714 12619 rpcz_store.cc:276] 0709 13:05:46.291848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.351022 (+ 59174us) service_pool.cc:224] Handling call
0709 13:05:46.353692 (+  2670us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:46.386377 (+ 32685us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:46.386432 (+    55us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:47.878058 (+1491626us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b2c0004c3c8. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:05:47.878664 (+   606us) log.cc:844] Serialized 52 byte log entry
0709 13:05:47.932711 (+ 54047us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:48.000989 (+ 68278us) log.cc:844] Serialized 14 byte log entry
0709 13:05:48.462112 (+461123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.462177 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:48.462216 (+    39us) raft_consensus.cc:1685] finished
0709 13:05:48.475532 (+ 13316us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:48.475768 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":492055,"prepare.queue_time_us":112177,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":889,"raft.queue_time_us":499971,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":59685,"spinlock_wait_cycles":38558976,"thread_start_us":95176,"threads_started":2,"wal-append.queue_time_us":47942}
I20260709 13:05:48.582544 12621 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:05:48.582612 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:48.582386 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:48.594723 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:48.599481 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 261238us
I20260709 13:05:48.523274 18928 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:48.604781 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:48.476387 19257 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.112s
I20260709 13:05:48.606201 13200 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:48.462599 19123 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.133s
I20260709 13:05:48.571480 19180 raft_consensus.cc:697] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:48.575460 19203 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:48.593152 19216 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:48.593765 19107 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:48.602240 19142 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:48.600734 19219 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.644925 19177 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:48.645610 19219 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:48.623366 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:48.646461 19177 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.646975 19177 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:48.615136 19199 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:48.648952 19177 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:48.606784 19011 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:48.649536 19011 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:48.641827 19181 consensus_queue.cc:237] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:48.650055 19011 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:48.654552 12693 raft_consensus.cc:2410] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:05:48.570003 19045 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:48.523941 19034 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:05:48.669996 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 67271.3us
I20260709 13:05:48.673250 12587 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:48.653053 19216 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:48.676096 19216 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:48.689162 13232 raft_consensus.cc:2410] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:05:48.689142 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:48.690209 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:48.692368 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.693138 12687 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:05:48.691133 12619 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:05:48.617033 19135 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.070s
W20260709 13:05:48.698396 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 172226us
I20260709 13:05:48.700651 12662 leader_election.cc:400] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15.
I20260709 13:05:48.697218 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:48.701789 12662 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:48.655553 19223 consensus_queue.cc:1059] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.074s
I20260709 13:05:48.708472 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:48.712205 12617 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:48.655529 19107 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:48.715816 12695 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: []
W20260709 13:05:48.704778 19267 log.cc:927] Time spent T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 13:05:48.717978 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:48.665201 19142 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:48.720151 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:48.703431 19216 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:48.728286 12696 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:05:48.730544 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:48.731256 12619 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:05:48.711052 19034 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:48.755240 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 230222us
I20260709 13:05:48.756690 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:48.758971 12588 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:05:48.772146 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.773967 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:48.738121 13197 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:48.735918 12662 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:48.715721 19118 consensus_queue.cc:1059] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.047s
I20260709 13:05:48.777998 12617 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:05:48.778592 12687 raft_consensus.cc:3055] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:48.781314 12687 raft_consensus.cc:740] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:48.762703 19172 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.742065 19216 raft_consensus.cc:697] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:05:48.799091 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 61089.5us
I20260709 13:05:48.725071 19017 consensus_queue.cc:1059] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 13:05:48.782110 12687 consensus_queue.cc:260] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:48.803575 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 67728.1us
I20260709 13:05:48.762432 19269 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:48.714282 19180 consensus_queue.cc:237] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:48.821844 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:48.765471 19270 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:48.769910 19181 consensus_queue.cc:1059] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.057s
I20260709 13:05:48.822584 12546 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:48.802515 13197 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:48.777231 19171 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.823953 19286 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:48.765992 19184 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
W20260709 13:05:48.800060 19265 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 13:05:48.738386 19214 consensus_queue.cc:1059] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.068s
W20260709 13:05:48.843200 12693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 2284) took 2675 ms (client timeout 1928 ms). Trace:
W20260709 13:05:48.843644 12693 rpcz_store.cc:269] 0709 13:05:46.167667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.168123 (+   456us) service_pool.cc:224] Handling call
0709 13:05:48.842961 (+2674838us) spinlock_profiling.cc:243] Waited 2.48 s on lock 0x7b54000c80d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:48.843108 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5692663168}
I20260709 13:05:48.805037 12687 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:48.830463 13232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
W20260709 13:05:48.831867 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 54591.1us
I20260709 13:05:48.806303 19118 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:05:48.821918 18978 consensus_meta.cc:287] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.002s
W20260709 13:05:48.806915 19272 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
I20260709 13:05:48.828852 18856 raft_consensus.cc:3055] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:48.850525 18856 raft_consensus.cc:740] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:48.801373 19280 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:05:48.848611 13232 raft_consensus.cc:606] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:48.831748 19017 raft_consensus.cc:3055] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:48.829588 19282 raft_consensus.cc:2764] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:05:48.851156 19216 consensus_queue.cc:237] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:48.853543 19278 log.cc:927] Time spent T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
W20260709 13:05:48.849663 19271 log.cc:927] Time spent T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:05:48.853102 18856 consensus_queue.cc:260] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:48.854512 19276 log.cc:927] Time spent T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:05:48.832002 19171 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:48.854874 19045 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:48.860297 12546 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
W20260709 13:05:48.848325 19224 consensus_meta.cc:287] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.002s
I20260709 13:05:48.803926 12588 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:48.862735 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:48.897087 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 93655.9us
I20260709 13:05:48.899389 19142 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:48.900031 19142 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:48.847675 19219 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:48.858935 19017 raft_consensus.cc:740] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:48.901713 19224 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:48.902235 19224 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:48.902396 19017 consensus_queue.cc:260] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:48.902984 19171 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:48.903621 19017 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:48.904357 19224 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:48.827822 19270 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:48.905754 19270 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:48.865161 19118 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:48.907971 19274 log.cc:927] Time spent T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:05:48.885111 19207 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.908535 19118 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:48.877465 19217 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:48.875662 13200 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:48.875999 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 73577.1us
I20260709 13:05:48.843274 19034 consensus_queue.cc:1059] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
W20260709 13:05:48.882198 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.804561 19172 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:48.886806 13232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:48.922783 13232 raft_consensus.cc:606] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:48.923130 13232 raft_consensus.cc:614] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:48.923434 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:48.924064 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:48.924475 12695 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 17: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:48.838469 19199 consensus_queue.cc:1059] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:05:48.923458 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:48.925606 12613 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:48.893963 18856 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:48.927256 12540 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:05:48.914165 13197 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:48.928372 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:48.921620 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:48.938207 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:48.939087 12617 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:48.873733 19135 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:48.909054 19207 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:48.958880 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:48.959318 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:48.970153 12540 raft_consensus.cc:2393] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 16: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:48.970412 12687 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 13:05:48.970839 12687 pending_rounds.cc:85] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 13
I20260709 13:05:48.960991 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:48.971045 12687 pending_rounds.cc:107] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 13:05:48.971899 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:48.968194 19291 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.961473 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:48.962423 12542 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:48.961588 12617 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:48.963627 12622 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:05:48.963748 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:48.964463 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:48.962951 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:48.977703 12619 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:48.965122 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:48.967813 12618 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:05:48.979228 12613 raft_consensus.cc:2393] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 13: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:48.966182 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:48.971004 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:48.983399 12540 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:48.983852 12541 raft_consensus.cc:2393] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 16: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:48.972970 19172 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:48.852550 18978 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:48.977238 12687 raft_consensus.cc:2889] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:48.992424 18978 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:48.975944 19291 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:48.984779 18950 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:05:48.994295 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 79596.3us
I20260709 13:05:48.995235 19291 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:48.997722 19085 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:49.006160 19085 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:49.008950 19085 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:48.997946 19181 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.009667 19223 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:49.010000 19181 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:49.011413 18994 raft_consensus.cc:3055] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:49.011799 18994 raft_consensus.cc:740] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:49.012750 19181 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:49.012595 18994 consensus_queue.cc:260] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:48.983306 12539 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:49.050344 12619 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
W20260709 13:05:48.999752 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.997232 12659 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:49.052577 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 55402.5us
I20260709 13:05:49.053349 12659 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:49.013972 12538 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 16. Current term is 17. Ops: []
W20260709 13:05:49.014221 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 101048us
I20260709 13:05:48.954448 19146 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:49.015122 12588 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:49.015662 19290 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:49.019201 18993 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:48.922147 19217 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:48.966499 19283 raft_consensus.cc:3055] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:48.958755 18928 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:49.026747 12545 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:05:49.027267 19207 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:49.027498 19275 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:49.030117 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:49.034951 12541 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:05:49.038286 19184 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:05:48.959260 19118 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:49.042681 19168 raft_consensus.cc:3055] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:48.978996 19107 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:49.114542 19211 raft_consensus.cc:3055] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:49.115018 19211 raft_consensus.cc:740] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:49.115494 13200 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:49.115834 19211 consensus_queue.cc:260] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:48.975225 19135 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:49.050004 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 243880us
I20260709 13:05:49.117625 12662 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:49.058226 13197 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:49.118857 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 60672us
I20260709 13:05:49.118968 19292 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:49.061425 13232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd40576623a84072be59a32d23cda14b"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:49.119576 19292 raft_consensus.cc:697] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 20 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:49.119966 13232 raft_consensus.cc:606] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:49.120347 13232 raft_consensus.cc:614] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:49.120677 19217 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:49.120590 19292 consensus_queue.cc:237] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:49.021361 19269 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:49.119482 19224 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:05:49.065012 12588 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:49.122190 19224 raft_consensus.cc:697] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:49.050122 19249 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:49.122924 18827 raft_consensus.cc:3055] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:49.122871 19249 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:49.061338 19171 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:49.123569 18827 raft_consensus.cc:740] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:49.125461 12689 raft_consensus.cc:3055] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:05:49.125845 12689 raft_consensus.cc:740] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:49.126566 12689 consensus_queue.cc:260] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:49.127754 12689 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:49.063655 19146 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:49.087185 18994 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:49.061251 19293 raft_consensus.cc:2764] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:05:49.092533 19275 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:49.070091 19284 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:49.069677 19283 raft_consensus.cc:740] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:49.137035 19283 consensus_queue.cc:260] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:49.138670 19283 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:49.139230 19107 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:49.083711 18928 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:49.142643 19118 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:49.105293 19168 raft_consensus.cc:740] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:49.065848 12659 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:49.145654 19168 consensus_queue.cc:260] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:49.146683 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 80915.3us
I20260709 13:05:49.147382 19168 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:49.123224 19224 consensus_queue.cc:237] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:49.121152 19217 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:49.149036 19217 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:49.150810 19181 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:49.151280 19181 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.151640 19181 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:49.156466 19297 log.cc:927] Time spent T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:05:49.137264 19146 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:49.163017 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:49.163645 12687 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:05:49.163687 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:49.164721 12693 raft_consensus.cc:2393] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 17: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:49.165264 12695 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:05:49.184975 13226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:49.185778 13226 raft_consensus.cc:606] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:49.186209 13226 raft_consensus.cc:614] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:49.107082 12541 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 15. Current term is 16. Ops: []
W20260709 13:05:49.220243 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:49.220119 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 50013.3us
W20260709 13:05:49.221529 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 105220us
W20260709 13:05:49.221987 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 157019us
W20260709 13:05:49.220240 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 100824us
I20260709 13:05:49.227459 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:49.228209 12615 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
W20260709 13:05:49.220167 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 102663us
I20260709 13:05:49.233289 13233 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18. Ops: []
W20260709 13:05:49.117501 19295 log.cc:927] Time spent T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.147s	user 0.003s	sys 0.000s
I20260709 13:05:49.237602 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:49.238488 12613 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:49.239699 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:49.241364 12693 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:49.242854 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:49.243566 12615 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:49.253150 12689 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 13:05:49.253830 12689 pending_rounds.cc:85] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 14
I20260709 13:05:49.254206 12689 pending_rounds.cc:107] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:05:49.254029 12587 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:49.254631 12689 raft_consensus.cc:2889] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:49.256527 12619 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:49.260070 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:05:49.275068 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.277312 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:49.273315 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:49.280143 12620 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:49.282718 13231 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:05:49.284629 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:49.289547 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:49.296777 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:49.297783 13234 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:49.298305 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:49.302735 12693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:05:49.303625 12693 raft_consensus.cc:606] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:49.304345 12659 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:49.306020 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 52489.3us
I20260709 13:05:49.248098 19211 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:49.273268 19172 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:05:49.321884 19085 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:49.322402 19085 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.322851 19085 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:49.322476 19270 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:49.273800 19237 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 22 current term: 22 is higher.
I20260709 13:05:49.325242 12616 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:49.330796 19249 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:49.333866 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:49.335234 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.308686 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:49.294000 19290 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:05:49.312081 19275 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:49.293622 19146 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:05:49.351807 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 431512us
I20260709 13:05:49.294261 19167 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:49.233753 19171 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:49.255379 19223 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.342464 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:49.343267 12696 raft_consensus.cc:2393] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 13: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:49.334149 12659 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:49.360369 12688 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:05:49.361771 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 56405.6us
I20260709 13:05:49.363713 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:49.364337 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:49.249083 19219 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.301900 19135 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:49.355993 12588 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:49.358304 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:49.313870 18993 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:49.294801 19203 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:49.362892 12659 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:49.360836 19011 consensus_meta.cc:287] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.710s	user 0.012s	sys 0.010s
I20260709 13:05:49.360308 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:49.378252 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.386332 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:05:49.388402 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 309505us
I20260709 13:05:49.274039 19269 consensus_queue.cc:1059] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
W20260709 13:05:49.408751 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 71545us
I20260709 13:05:49.410102 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:05:49.415241 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:05:49.408740 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 52826.1us
I20260709 13:05:49.352046 19146 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.414196 13199 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:49.347456 12615 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:05:49.353294 19229 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:49.423064 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:49.424388 12622 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:05:49.425668 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:49.425915 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:49.422459 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:49.374666 19034 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:05:49.419793 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 56964.7us
I20260709 13:05:49.365685 19142 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:49.428845 19146 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:49.374666 19275 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:49.409461 19216 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:49.460990 12693 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:49.407526 18950 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
W20260709 13:05:49.454926 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 144806us
I20260709 13:05:49.455909 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:49.429180 18928 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:49.375778 19171 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:49.438128 19282 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:49.431527 19287 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:49.412536 18993 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:49.375211 19214 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:05:49.433432 19045 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.451526 12588 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:49.442597 19034 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.437472 19164 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:49.396819 19219 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:49.375312 19167 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:49.394883 19223 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:49.466729 19229 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:49.440131 19203 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:49.513290 19299 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:05:49.523581 19203 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:49.525063 19223 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:49.525851 19197 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.000s	sys 0.027s
W20260709 13:05:49.526247 19197 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.000s	sys 0.027s
W20260709 13:05:49.514050 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 62599.1us
I20260709 13:05:49.527576 12588 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:49.523617 19167 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:49.528662 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:49.529464 19107 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:49.520679 19164 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:49.532615 18928 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:49.533128 18928 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.533483 18928 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:49.534384 19164 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:49.537284 19107 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:05:49.515899 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 74696.4us
I20260709 13:05:49.426951 19011 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:49.520766 19226 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:49.515376 19034 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:49.541340 19226 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:49.541817 19226 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:49.543215 19011 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:49.545881 12695 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:49.464212 19275 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:49.463105 19224 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
I20260709 13:05:49.450434 19230 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.060s
I20260709 13:05:49.479094 19282 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:49.554862 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:49.550314 18856 consensus_meta.cc:287] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.592s	user 0.015s	sys 0.001s
I20260709 13:05:49.595602 13226 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:49.596880 13234 raft_consensus.cc:2410] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:05:49.460269 19298 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
W20260709 13:05:49.598871 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.603236 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:49.603888 18124 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.604525 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:05:49.601028 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 120138us
I20260709 13:05:49.511709 19216 consensus_queue.cc:1059] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:05:49.605458 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:49.606407 12690 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 23: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:49.606673 13200 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:49.604454 18124 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:49.555392 19282 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:49.516845 19045 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:49.549204 19085 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:49.652201 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:49.652897 12540 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:49.654313 12547 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:49.654829 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:49.656275 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:49.657033 12542 raft_consensus.cc:2410] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 14 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:05:49.658665 12542 raft_consensus.cc:1275] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:05:49.659739 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:49.598724 19275 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:49.616554 19034 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:49.618853 19181 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:49.623703 18993 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:49.626556 19308 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 13:05:49.627493 19300 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:05:49.547740 18928 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:49.666177 18124 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:49.670243 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:49.707518 12543 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:49.708222 18928 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:49.706326 19226 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:49.635215 19211 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.089s
I20260709 13:05:49.720937 19172 raft_consensus.cc:993] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:05:49.568094 19269 consensus_queue.cc:1243] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:05:49.673465 19178 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.695601 19216 consensus_queue.cc:1243] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 17.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:05:49.683463 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 253697us
I20260709 13:05:49.699263 19045 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:49.723611 19135 consensus_queue.cc:1059] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:05:49.699653 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 56139.6us
W20260709 13:05:49.700596 19289 log.cc:927] Time spent T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:05:49.700444 19286 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:49.691005 18950 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:05:49.701844 19306 log.cc:927] Time spent T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:05:49.702848 19181 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:49.703328 19034 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:49.703359 12687 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19. Ops: []
W20260709 13:05:49.664708 19273 log.cc:927] Time spent T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:05:49.721540 19172 raft_consensus.cc:1081] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:05:49.722357 19229 consensus_queue.cc:1059] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:49.697356 19219 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:49.730850 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 264223us
I20260709 13:05:49.734277 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:49.753150 12542 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 24.
I20260709 13:05:49.753285 13197 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:49.754546 13200 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:49.734599 12510 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:49.740450 13232 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.014s	sys 0.013s
W20260709 13:05:49.762048 13232 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.018s	sys 0.013s
W20260709 13:05:49.771075 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.770848 13197 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:49.782150 12510 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:49.795418 19123 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:49.799463 19123 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:49.803576 19123 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:49.807430 19123 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.808151 19123 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:49.811421 19123 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:49.765959 18994 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:49.806547 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:49.774725 19168 consensus_meta.cc:287] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.627s	user 0.011s	sys 0.002s
I20260709 13:05:49.740934 19178 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:49.776186 19298 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:49.827351 19123 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:05:49.829311 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 52262.6us
W20260709 13:05:49.830072 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 59314.1us
I20260709 13:05:49.843235 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:49.844568 19216 raft_consensus.cc:2764] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:05:49.849262 13229 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:49.852981 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:49.774314 19146 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:49.836697 19275 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:49.832211 19269 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:49.855273 19146 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:49.855443 19269 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:49.858635 19085 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:49.859977 19171 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:49.865342 19290 raft_consensus.cc:3055] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:49.865849 19290 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:05:49.866302 19217 consensus_meta.cc:287] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.717s	user 0.012s	sys 0.002s
I20260709 13:05:49.821939 19322 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:49.867214 19322 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:49.866705 19290 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:49.867583 19322 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:49.868147 19290 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:49.830729 19289 log.cc:927] Time spent T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:05:49.766403 18827 consensus_queue.cc:260] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:49.872874 19017 raft_consensus.cc:3055] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:49.873533 18827 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:49.774439 19315 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:49.875613 19315 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:49.876262 19315 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:49.877089 12615 raft_consensus.cc:3055] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:49.877506 12615 raft_consensus.cc:740] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:49.878306 12615 consensus_queue.cc:260] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:49.873343 19017 raft_consensus.cc:740] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:49.880512 19017 consensus_queue.cc:260] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:49.882843 19226 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:49.866734 19217 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:49.887677 19269 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:49.888154 19135 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:49.890478 13231 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:49.901583 19217 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:49.902045 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:49.903728 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:49.905057 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:49.905221 19178 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:49.906404 12615 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:49.826766 12510 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:49.914677 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:49.918113 12615 raft_consensus.cc:1275] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:05:49.918699 12615 pending_rounds.cc:85] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 9
I20260709 13:05:49.919319 12615 pending_rounds.cc:107] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:05:49.919716 12615 raft_consensus.cc:2889] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:49.923589 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:49.925249 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:49.926430 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 99759.3us
I20260709 13:05:49.927284 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:49.930409 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:49.936136 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:49.936760 12689 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:49.939734 12615 raft_consensus.cc:1275] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:05:49.940894 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:49.941475 12616 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:49.946628 13233 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:49.948769 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:49.951618 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:49.954234 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:49.956120 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:49.956393 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:49.956938 12544 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:49.957038 12540 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:05:49.954861 12542 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
W20260709 13:05:49.948274 19284 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:05:49.970544 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:49.948666 19017 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:49.935681 19256 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:49.946655 19081 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:49.981659 19081 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:49.957883 19249 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:49.990271 19270 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:49.991099 19315 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:49.963534 19324 consensus_queue.cc:1059] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
W20260709 13:05:49.996186 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.963702 18945 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:05:49.997925 19085 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.998456 19085 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:50.000560 19085 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:49.996179 19324 raft_consensus.cc:3055] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:50.002645 19324 raft_consensus.cc:740] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:50.003499 19324 consensus_queue.cc:260] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:50.007735 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:50.008621 12692 raft_consensus.cc:2393] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 24: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:49.958225 12613 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:60170
I20260709 13:05:50.012478 12613 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:50.012885 12613 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:49.952250 18950 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:49.973286 12616 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:05:49.977890 19298 consensus_queue.cc:1048] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:49.976052 19292 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:05:50.016738 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 93213.5us
I20260709 13:05:49.979033 19118 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:49.980784 19256 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:50.013453 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:50.036571 12692 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:49.950486 19207 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:50.016742 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:50.019289 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:50.019483 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:50.039070 13234 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:50.020202 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:50.039609 13199 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:50.026811 13197 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:50.040151 13231 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 23.
I20260709 13:05:49.989115 19322 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:50.046954 13199 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:50.069047 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:50.071656 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:50.074853 13227 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:05:50.057940 19224 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:50.083932 13226 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:50.053849 19180 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:49.962839 19282 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:50.085525 13231 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
I20260709 13:05:50.086549 19180 raft_consensus.cc:697] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:50.086889 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:50.059468 19207 raft_consensus.cc:697] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:50.093631 19217 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:50.099351 19282 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:50.106374 19322 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:50.145442 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:50.148475 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:50.149675 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:50.150079 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:50.152529 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:50.149706 12542 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:50.154309 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:50.155213 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:50.155884 12539 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:50.156626 12542 raft_consensus.cc:2393] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 18: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:50.157691 12539 raft_consensus.cc:1275] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:05:50.159324 12513 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:50.163591 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:50.166008 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:50.167429 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:50.168965 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:50.155161 12538 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:50.174060 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:50.176963 12542 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:50.175659 12513 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:50.177883 12539 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:50.185429 12687 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:50.188549 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:50.192981 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.194124 12615 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:05:50.194276 19081 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:50.196898 18796 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:50.197083 18945 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:50.198211 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 273563us
I20260709 13:05:50.197947 18796 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:50.198541 19207 consensus_queue.cc:237] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:50.236858 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.239745 12538 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:05:50.242267 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:50.243326 13235 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:05:50.244588 18945 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:50.250370 19180 consensus_queue.cc:237] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:50.239151 12543 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:50.260082 12539 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:50.265875 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:50.271375 19256 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:50.272437 19178 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:50.274209 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.277940 19315 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:50.278432 19315 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:50.278988 19315 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:50.279368 19270 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.280103 19270 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:50.281833 19123 consensus_queue.cc:1059] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:05:50.287106 12543 raft_consensus.cc:2410] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
W20260709 13:05:50.277333 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 63162us
I20260709 13:05:50.258857 18945 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:50.296766 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:50.306847 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 118881us
I20260709 13:05:50.309612 12542 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
W20260709 13:05:50.316021 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 46572.3us
I20260709 13:05:50.318336 19292 consensus_queue.cc:1048] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:50.325937 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:50.326934 12622 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:50.327219 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 157973us
I20260709 13:05:50.329921 19270 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:50.339890 19226 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:50.340996 19226 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:50.330293 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:50.347924 13200 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:50.349705 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:50.350673 12617 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:50.352149 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:50.353117 13233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 1160) took 1071 ms. Trace:
I20260709 13:05:50.353135 12621 raft_consensus.cc:2368] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 16. Current term is 17.
I20260709 13:05:50.348229 12620 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:05:50.306713 18796 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:50.367014 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:50.367404 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:50.367309 19286 consensus_queue.cc:1048] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:50.368595 12695 raft_consensus.cc:2393] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 24: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:50.353616 13233 rpcz_store.cc:276] 0709 13:05:49.281504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.292872 (+ 11368us) service_pool.cc:224] Handling call
0709 13:05:49.293199 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:49.951238 (+658039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.352578 (+401340us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b5400511b54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:50.352923 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1502104960}
W20260709 13:05:50.374768 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 63463.4us
I20260709 13:05:50.378160 12688 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:05:50.385555 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:50.386574 12616 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 12.
I20260709 13:05:50.387281 13197 leader_election.cc:400] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 16. Current term is 17.
I20260709 13:05:50.389530 19224 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:50.391471 12588 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:50.394497 12696 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 17: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:50.395742 18796 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:50.395939 13234 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:05:50.396241 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:50.396662 18796 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:50.399757 18796 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:50.397181 12689 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:50.407063 18827 consensus_meta.cc:287] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.008s
I20260709 13:05:50.408070 18827 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:05:50.408419 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:50.410306 19226 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:50.411741 19217 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:50.412281 19217 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:50.412982 19226 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:50.377352 12662 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:50.417928 19214 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:50.424870 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:50.425802 12695 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:05:50.427155 12588 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:50.429034 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:50.430682 12588 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:50.431416 19172 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:50.432852 12694 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:05:50.435190 19270 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:05:50.439316 19118 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:50.417462 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:50.440523 19284 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:50.447461 19178 raft_consensus.cc:3055] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:50.514817 19178 raft_consensus.cc:740] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:50.373413 12513 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:50.517041 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 162169us
I20260709 13:05:50.450035 12539 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
I20260709 13:05:50.462606 19123 consensus_queue.cc:1059] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:50.394590 12613 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:50.472327 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:50.554179 12620 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:50.555075 12622 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:50.516153 19178 consensus_queue.cc:260] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:50.475205 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:50.565296 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:50.566918 12621 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:05:50.570542 12689 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:05:50.571820 12543 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:50.513983 19284 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:50.494122 19172 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:50.512676 19270 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:50.574455 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:50.577678 12615 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 13:05:50.584510 12613 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:50.582437 12615 pending_rounds.cc:85] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 10
I20260709 13:05:50.567534 19118 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:50.597350 12622 raft_consensus.cc:2410] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:05:50.599450 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:50.589480 12615 pending_rounds.cc:107] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 13:05:50.601830 12615 raft_consensus.cc:2889] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:50.605197 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:50.605882 19017 raft_consensus.cc:2764] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
W20260709 13:05:50.607085 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 176527us
I20260709 13:05:50.608896 12588 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:50.610023 19287 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.611029 19287 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:50.607210 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:50.607128 12687 raft_consensus.cc:2393] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 19: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:50.582031 19270 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:05:50.619419 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:50.579905 19172 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:50.623679 18124 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:50.623931 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:50.624271 18124 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:50.624728 18124 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:50.625701 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 141001us
I20260709 13:05:50.627285 19207 consensus_queue.cc:1059] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:50.628202 12512 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:50.629874 19349 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:50.630352 19349 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.591823 19118 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:50.621479 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:50.629361 19207 raft_consensus.cc:3055] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:50.637267 19118 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:50.630798 19349 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:50.639650 19207 raft_consensus.cc:740] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:50.661613 19178 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:50.663162 19287 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:50.666149 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 248659us
I20260709 13:05:50.667116 19279 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:05:50.674548 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:50.676033 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:50.678618 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 58717us
I20260709 13:05:50.688320 12620 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:50.687762 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:50.697904 19284 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:50.707837 19350 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:50.708647 19350 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:50.682507 19279 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.716840 12538 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 24.
I20260709 13:05:50.718835 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:50.719844 12687 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:05:50.680126 19217 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:50.728966 19217 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:50.705969 12659 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:50.730794 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 46302.5us
I20260709 13:05:50.731555 12659 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:50.712545 19315 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:50.754304 19315 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:50.739355 12659 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:50.695006 19291 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:50.741707 19011 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:50.742297 18827 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:50.763377 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:50.769732 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 56076.4us
W20260709 13:05:50.772142 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.714779 19279 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:50.801640 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:50.803059 12620 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:50.804040 12617 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
W20260709 13:05:50.806730 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 73920.8us
I20260709 13:05:50.789115 18124 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:50.771987 19011 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.818449 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:50.819311 19171 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:50.819877 19338 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.827646 12694 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 20: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:50.755787 19315 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:50.830682 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:50.821478 12662 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:50.829221 18124 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:50.687405 19256 consensus_queue.cc:1059] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.140s
W20260709 13:05:50.835649 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 226903us
I20260709 13:05:50.833402 19171 raft_consensus.cc:697] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:50.845044 12614 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:50.846470 19338 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:50.854270 19171 consensus_queue.cc:237] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:50.858024 19282 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.018s
I20260709 13:05:50.798206 19214 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.862304 19214 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:50.849260 19338 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:50.864588 19214 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:50.871212 19315 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:50.874823 19290 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.875653 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:50.875535 19290 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:50.877437 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:50.878113 13231 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
I20260709 13:05:50.878737 12587 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:50.879767 19216 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:05:50.880716 19359 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:50.881183 19359 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:50.881541 19359 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:50.803117 19291 raft_consensus.cc:697] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:50.882812 19291 consensus_queue.cc:237] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:50.883492 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:50.864634 19326 raft_consensus.cc:3055] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:50.885900 19326 raft_consensus.cc:740] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:50.886502 13229 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:50.886969 19326 consensus_queue.cc:260] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:50.861606 19350 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:50.861074 19207 consensus_queue.cc:260] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:50.889261 19207 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:50.891112 19172 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:50.892864 19270 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:50.888291 19326 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:50.903354 19118 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:50.898730 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:50.828254 19011 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:50.904507 19290 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:50.896870 19172 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:50.906769 12542 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:05:50.907826 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:50.926651 13234 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 23.
I20260709 13:05:50.908896 18796 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:50.909777 12617 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
W20260709 13:05:50.910187 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.844342 12659 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:50.914537 12547 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:50.915467 19315 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:50.916224 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:50.934867 12618 raft_consensus.cc:2368] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 16. Current term is 17.
I20260709 13:05:50.921815 12538 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:05:50.922008 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:50.922222 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 101009us
I20260709 13:05:50.923748 13229 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:05:50.926374 19270 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:50.929149 13232 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
W20260709 13:05:50.951902 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 120326us
I20260709 13:05:50.949972 12588 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:50.933112 19256 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.953969 18827 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:50.982213 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:50.985989 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:50.980638 12513 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:50.985625 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:51.002084 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:50.995824 12695 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21.
W20260709 13:05:51.008605 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.948207 18796 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:50.978267 19270 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:50.941032 19279 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:51.028687 13200 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:50.976195 19359 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:51.033018 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:51.034415 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 104885us
I20260709 13:05:50.985664 19322 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:51.048413 19322 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:51.054078 19279 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:51.059131 19349 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:51.060354 19249 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:51.062004 19294 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:51.038259 12513 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:51.035745 12587 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:51.041783 19270 raft_consensus.cc:697] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:51.042284 19324 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:51.046286 19359 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:51.010699 19256 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:51.026722 19214 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:51.032086 19207 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:51.072322 19226 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:05:51.093374 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 94032.6us
I20260709 13:05:50.986094 19338 consensus_queue.cc:1048] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:05:51.103060 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:51.110090 19322 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:51.113782 19217 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:51.114886 19217 raft_consensus.cc:697] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:51.116062 19217 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:51.099817 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:05:51.121806 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 130480us
I20260709 13:05:51.123011 12662 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:51.124092 19338 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:51.124475 19322 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.125135 19322 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:51.127069 12588 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:51.130569 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:51.131321 12619 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:05:51.132820 19322 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:51.134071 19118 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:51.134509 18796 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:51.135228 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:51.136333 13199 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:51.139910 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:51.076661 19326 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:05:51.143646 12543 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:51.148696 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:51.087675 19214 raft_consensus.cc:697] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:51.092777 19226 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.150604 19207 raft_consensus.cc:697] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 19 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:51.140908 19172 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.151566 19349 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:51.159272 19226 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:51.156316 19326 raft_consensus.cc:697] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 23 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:51.163605 19322 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:51.171985 19284 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:51.158355 19118 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:51.198596 12696 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
W20260709 13:05:51.199249 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 63177.1us
I20260709 13:05:51.199910 12587 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:51.205449 12542 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
W20260709 13:05:51.211726 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 84727.3us
W20260709 13:05:51.220445 19368 log.cc:927] Time spent T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:05:51.221706 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:51.222689 12618 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:51.223896 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:51.226212 12613 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:05:51.227594 12621 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:05:51.229063 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:51.243055 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:51.187448 19172 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:51.219434 19291 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:51.273752 19291 raft_consensus.cc:697] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:05:51.274842 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 58106us
I20260709 13:05:51.230397 19171 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:51.283550 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:51.292582 12622 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:05:51.241084 19207 consensus_queue.cc:237] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:51.245395 19118 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:51.290863 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 45153.1us
I20260709 13:05:51.233340 19270 consensus_queue.cc:237] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:51.242858 19214 consensus_queue.cc:237] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:51.307271 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 247531us
I20260709 13:05:51.311686 12659 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:51.312668 12659 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:51.312731 19293 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:51.314594 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:51.244270 19011 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:51.324127 12662 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:51.325296 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:51.324784 19293 raft_consensus.cc:697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:51.320282 19171 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:51.293319 19326 consensus_queue.cc:237] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:51.317176 19291 consensus_queue.cc:237] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:51.334203 18827 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:51.340639 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:51.342108 12688 raft_consensus.cc:2368] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 13. Current term is 14.
I20260709 13:05:51.358424 12621 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:51.364022 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:51.366320 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 43690.1us
W20260709 13:05:51.370807 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 52757us
I20260709 13:05:51.328851 19293 consensus_queue.cc:237] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:51.375017 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.384366 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:51.397794 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:51.399273 12690 raft_consensus.cc:2393] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 23: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:51.400382 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:51.400826 13199 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:51.401077 12690 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 20: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:51.402143 19375 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:51.402443 13199 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:51.409884 12621 raft_consensus.cc:2393] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 17: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:51.384491 19338 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:51.410527 12544 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:05:51.422137 19287 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:51.422753 19287 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.376740 18827 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:51.425716 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:51.423180 19287 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:51.432139 12622 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 20: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:51.391832 19180 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:51.423864 19171 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:51.440829 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:51.444152 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.426795 19338 raft_consensus.cc:697] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:51.435562 19172 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:51.424868 19381 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:05:51.462627 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:51.463268 18827 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:51.464864 19256 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:51.464913 19386 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.469702 19380 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:51.471760 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:51.472164 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:51.473021 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:51.474491 19338 consensus_queue.cc:237] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:51.477718 19118 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:51.480132 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:51.487094 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:51.487748 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:51.488209 19378 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:05:51.488075 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:51.529014 12541 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:51.450898 19180 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:51.488909 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:51.489897 12622 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 13:05:51.492200 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.501807 13199 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:51.503408 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:51.516799 12692 raft_consensus.cc:2393] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 14: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:51.532886 12539 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:05:51.515069 12659 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:51.519774 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:51.534948 12542 raft_consensus.cc:2368] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 13. Current term is 14.
I20260709 13:05:51.523319 12616 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:51.518262 13200 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:51.525830 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:51.542811 12540 raft_consensus.cc:2393] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 18: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:51.544787 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:51.551775 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.553380 12688 raft_consensus.cc:2393] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 19: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:51.555732 12539 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:05:51.632193 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:51.555727 19011 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:51.521842 19226 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:51.588593 19118 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.677958 19118 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:51.678912 12544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 2135) took 1538 ms (client timeout 1857 ms). Trace:
W20260709 13:05:51.679386 12544 rpcz_store.cc:269] 0709 13:05:50.140456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.162929 (+ 22473us) service_pool.cc:224] Handling call
0709 13:05:51.678715 (+1515786us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54002eb8d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:51.678831 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2771181952}
I20260709 13:05:51.528293 19386 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:51.635380 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:51.631233 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:51.642340 12690 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:51.646591 19207 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:51.646651 19320 consensus_queue.cc:1059] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 13:05:51.648764 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:51.651783 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:51.628793 19322 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:05:51.670296 19381 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:51.672750 19382 log.cc:927] Time spent T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
I20260709 13:05:51.718784 12587 leader_election.cc:400] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 13. Current term is 14.
I20260709 13:05:51.653715 12510 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:51.773300 12587 leader_election.cc:403] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:05:51.743255 12692 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:05:51.706180 19282 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:51.754549 19207 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:51.762581 12618 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 22: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:51.765972 19320 raft_consensus.cc:3055] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:05:51.686205 19361 log.cc:927] Time spent T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:05:51.779659 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:51.779176 19282 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.784343 19207 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:51.790776 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 249920us
I20260709 13:05:51.790936 19164 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:51.792471 12510 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:51.793797 19207 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:51.794169 19320 raft_consensus.cc:740] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:51.795521 19320 consensus_queue.cc:260] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:51.797084 19320 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:51.808692 13233 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:05:51.820401 12444 catalog_manager.cc:5697] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 11 to 12, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 12 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:51.824834 19388 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.119s	user 0.003s	sys 0.000s
I20260709 13:05:51.829169 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:51.836704 19322 raft_consensus.cc:697] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:51.714781 19180 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:51.713282 19226 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:51.681461 19118 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:51.801400 12588 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.857s (SENT) [suppressed 2 similar messages]
I20260709 13:05:51.849812 12541 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:51.711355 19011 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:51.867268 12542 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:51.883893 12616 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
I20260709 13:05:51.784451 19282 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:51.877871 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 479939us
W20260709 13:05:51.892850 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 344168us
I20260709 13:05:51.868933 18827 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:51.907017 13197 leader_election.cc:400] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 16. Current term is 17.
I20260709 13:05:51.885982 19118 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 13. Current term is 14.
W20260709 13:05:51.904654 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 75049.9us
I20260709 13:05:51.854101 19207 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:05:51.882020 19011 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:51.916536 13197 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:51.924443 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 406207us
I20260709 13:05:51.929201 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:51.955454 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.909914 19171 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:05:51.912866 19338 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:05:51.969976 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:51.984908 13229 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 23.
I20260709 13:05:51.934654 19381 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:05:51.981984 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 480218us
I20260709 13:05:51.995795 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:51.919656 18827 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:51.993413 19384 log.cc:927] Time spent T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.385s	user 0.000s	sys 0.006s
W20260709 13:05:52.011300 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 77181.3us
I20260709 13:05:52.014370 12510 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:51.997440 19381 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.019012 13199 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:52.022789 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:52.024085 19405 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:52.035292 19399 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.024854 19405 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:51.924609 19322 consensus_queue.cc:237] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:52.045190 12691 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.003s	sys 0.008s
W20260709 13:05:52.079173 12691 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.004s	sys 0.008s
I20260709 13:05:52.078652 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:05:52.078645 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 59765.8us
I20260709 13:05:52.038276 19381 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:52.040182 19164 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:52.118408 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:52.121096 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:52.035995 19399 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:52.130175 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:52.117743 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2370) took 1115 ms. Trace:
I20260709 13:05:52.132313 12689 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:05:52.139185 19365 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:52.140605 19409 log.cc:927] Time spent T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:05:52.141322 19407 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.141976 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:52.141922 19407 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:52.143781 12694 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.024s	sys 0.012s
W20260709 13:05:52.148998 12694 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.025s	sys 0.012s
I20260709 13:05:52.127560 19386 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:52.150770 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 349394us
I20260709 13:05:52.148125 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:52.170130 12588 leader_election.cc:400] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 13. Current term is 14.
W20260709 13:05:52.170768 12687 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.000s	sys 0.033s
W20260709 13:05:52.171123 12687 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.000s	sys 0.033s
I20260709 13:05:52.180363 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:52.183836 19299 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:52.184499 19299 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.184963 19299 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:52.186172 19291 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.186961 13231 raft_consensus.cc:1240] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:52.186723 19291 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:52.188027 19395 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:05:52.188894 19291 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:52.220587 12588 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:52.225176 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:52.234355 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:52.243345 12617 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:05:52.245342 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:05:52.247820 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 529208us
I20260709 13:05:52.179316 19011 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:52.131557 12691 rpcz_store.cc:276] 0709 13:05:50.972495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.972631 (+   136us) service_pool.cc:224] Handling call
0709 13:05:50.992761 (+ 20130us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:51.037067 (+ 44306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.037114 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:51.116342 (+ 79228us) log.cc:844] Serialized 52 byte log entry
0709 13:05:51.305363 (+189021us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:51.374456 (+ 69093us) log.cc:844] Serialized 14 byte log entry
0709 13:05:52.079685 (+705229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.079764 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:52.079814 (+    50us) raft_consensus.cc:1685] finished
0709 13:05:52.079831 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.087486 (+  7655us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53648,"prepare.queue_time_us":139622,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":52109,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":3970,"thread_start_us":929616,"threads_started":3,"wal-append.queue_time_us":266376}
I20260709 13:05:52.271908 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:52.239156 19226 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:52.272809 13228 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21.
W20260709 13:05:52.288918 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 274661us
I20260709 13:05:52.290059 12510 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:52.279145 19385 log.cc:927] Time spent T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
W20260709 13:05:52.278501 19287 consensus_meta.cc:287] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.833s	user 0.011s	sys 0.001s
W20260709 13:05:52.284996 19284 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.007s	sys 0.020s
I20260709 13:05:52.272214 19207 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:52.292155 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 357400us
W20260709 13:05:52.315392 19284 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.008s	sys 0.020s
I20260709 13:05:52.325534 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:52.314010 18827 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:52.318073 19364 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:52.365746 19324 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.353742 19365 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.375990 19324 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:52.376107 19365 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:52.366132 19326 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:52.381866 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 91830us
I20260709 13:05:52.382993 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:52.323616 19207 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:52.319748 19287 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:52.374254 19279 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260709 13:05:52.424695 19401 log.cc:927] Time spent T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.278s	user 0.001s	sys 0.000s
I20260709 13:05:52.423138 19279 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:52.468887 19417 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
W20260709 13:05:52.466825 19402 log.cc:927] Time spent T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.246s	user 0.000s	sys 0.001s
W20260709 13:05:52.381398 19270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.023s	sys 0.027s
W20260709 13:05:52.602535 19270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.024s	sys 0.027s
I20260709 13:05:52.561882 19425 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:52.603756 19324 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:52.593933 19412 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.609882 19226 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:52.610515 19226 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:52.611470 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:52.612620 19226 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:52.615108 19399 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:52.594409 19279 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:52.621718 18827 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:52.622362 18827 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:52.624531 18827 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:52.627558 19422 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.628146 19422 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:52.629315 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:52.609313 19412 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:52.630015 12695 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:05:52.631562 19412 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:52.632865 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2366) took 1669 ms. Trace:
I20260709 13:05:52.633385 19392 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:52.634078 19392 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:52.634348 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:52.635129 12687 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:52.635736 19432 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.636308 19432 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:52.523406 19414 log.cc:927] Time spent T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
W20260709 13:05:52.561923 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 336810us
I20260709 13:05:52.561512 12510 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:52.393163 19364 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:52.577381 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 187133us
I20260709 13:05:52.467551 19298 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.597743 19293 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:52.599377 19407 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:52.600757 19011 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:52.639376 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:52.641299 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 79901.7us
I20260709 13:05:52.652947 12510 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:52.649994 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:52.640688 12588 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:52.670900 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:52.645287 12444 catalog_manager.cc:5697] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 9 to 10, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 10 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:05:52.671378 12510 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:52.669504 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:52.672746 12618 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:05:52.673422 12613 raft_consensus.cc:2393] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 14: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:52.637528 19419 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.680815 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:52.669780 19291 consensus_queue.cc:1059] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:05:52.633262 12694 rpcz_store.cc:276] 0709 13:05:50.963857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.963980 (+   123us) service_pool.cc:224] Handling call
0709 13:05:50.987352 (+ 23372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.086724 (+ 99372us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:05:51.295232 (+208508us) log.cc:844] Serialized 14 byte log entry
0709 13:05:51.646769 (+351537us) spinlock_profiling.cc:243] Waited 1.3 ms on lock 0x7b180040d440. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c522 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
0709 13:05:51.692547 (+ 45778us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:52.168762 (+476215us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:52.168852 (+    90us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:52.168905 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.632654 (+463749us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b54004349d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:52.632702 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.632812 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9686,"prepare.queue_time_us":244667,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":7198,"raft.queue_time_us":28865,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":162412288,"thread_start_us":1007501,"threads_started":3,"wal-append.queue_time_us":163416}
I20260709 13:05:52.692873 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:52.694231 12614 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:52.644495 19363 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.641453 19425 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:52.631570 19389 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:52.688861 13197 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:52.638659 19432 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:52.707944 12690 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 24. Current term is 25. Ops: []
I20260709 13:05:52.673491 19164 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:52.660013 19392 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:52.717362 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:52.650722 19321 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.068s
I20260709 13:05:52.642333 19298 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:52.722385 19226 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:52.722893 13226 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:05:52.700678 19326 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:52.642584 19293 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:52.734421 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:52.749475 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:52.643086 19011 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:52.691798 19217 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:52.717458 19291 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:52.702188 19365 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:52.741326 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:52.700424 19256 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:52.641106 19364 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:52.678043 19419 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:52.757699 12695 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:05:52.757476 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:52.733459 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.767592 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:52.732149 19180 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:52.777176 19432 raft_consensus.cc:3055] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:52.777665 19432 raft_consensus.cc:740] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:52.723868 19363 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:52.778563 19432 consensus_queue.cc:260] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:52.779835 19432 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:52.780584 19363 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:52.760210 19291 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.782203 19291 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:52.782435 12687 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22.
I20260709 13:05:52.782500 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:52.785722 19256 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:52.787314 19287 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:52.787757 19415 log.cc:927] Time spent T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.418s	user 0.009s	sys 0.005s
I20260709 13:05:52.778579 19364 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:52.788141 19256 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:52.790302 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:52.790910 12692 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:52.791450 19207 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:52.735322 19389 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:52.792616 19424 log.cc:927] Time spent T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:05:52.790181 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:52.795460 19279 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:52.797358 19180 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.797665 19226 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:52.797998 19180 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:52.799955 19226 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:52.802851 19207 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:05:52.806066 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:52.816651 19011 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:52.823531 19298 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:52.835965 12692 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:05:52.844607 19392 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:52.845760 19412 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:52.846333 19412 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:52.846550 19338 consensus_queue.cc:1059] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:52.848238 19338 raft_consensus.cc:3055] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:52.848805 19338 raft_consensus.cc:740] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:52.849130 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:52.850198 19405 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:52.850869 19389 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:52.851493 19419 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:52.851956 19408 log.cc:927] Time spent T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.476s	user 0.002s	sys 0.010s
I20260709 13:05:52.853507 19422 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:52.854115 19422 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.854570 19422 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:52.855683 19279 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:52.856575 19422 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:52.773166 19217 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:52.861048 19217 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:52.863086 19164 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:52.865259 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:52.756912 19284 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:52.856225 19291 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:52.874100 19284 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:52.866945 19338 consensus_queue.cc:260] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:52.876256 19284 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:52.876457 19338 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:52.884575 19293 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:52.885531 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:52.876283 19291 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:52.888269 12615 raft_consensus.cc:1275] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:05:52.890167 19320 consensus_meta.cc:287] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 1.051s	user 0.014s	sys 0.001s
W20260709 13:05:52.891743 19381 consensus_meta.cc:287] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.760s	user 0.013s	sys 0.001s
W20260709 13:05:52.893301 19299 consensus_meta.cc:287] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.708s	user 0.014s	sys 0.000s
I20260709 13:05:52.894184 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:52.895591 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:52.896484 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:52.896694 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:52.915589 12687 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:05:52.897404 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:52.897948 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:52.826059 19172 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:52.898658 19171 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:52.899478 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:52.941751 13231 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:05:52.900132 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:52.901176 13199 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:52.905262 12618 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:52.944639 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:52.937068 12619 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:05:52.848440 19412 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:05:52.951112 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 50020.8us
I20260709 13:05:52.954895 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:52.957229 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:52.957598 13231 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 19: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:52.959132 12659 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:52.962348 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:52.963157 13235 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:52.913475 19419 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:52.914808 19217 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:52.967270 12662 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:52.970170 19171 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:52.973636 18827 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:05:52.975540 19433 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.083s	user 0.004s	sys 0.000s
I20260709 13:05:52.980141 12662 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:52.950546 19291 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:52.957882 19298 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:52.958163 19432 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:52.999208 12662 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:52.923271 19381 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:52.979730 18827 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:05:53.005999 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 334689us
I20260709 13:05:52.941895 19299 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:52.958642 19426 consensus_queue.cc:1048] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:05:53.007115 12510 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:53.018276 12510 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:53.021054 13234 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 20: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:53.001547 19011 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:05:53.007263 19282 consensus_meta.cc:287] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.107s	user 0.006s	sys 0.012s
I20260709 13:05:52.990564 19217 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:53.044668 13232 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 22: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:53.045827 19427 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:53.008023 19432 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:53.000301 19291 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:53.007375 18827 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:53.050714 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:53.051286 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:53.055706 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 413885us
I20260709 13:05:53.049301 19432 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:53.057906 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:53.057723 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:53.059226 12618 raft_consensus.cc:2410] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 18 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:05:53.022020 19324 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:53.061753 12588 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:53.060734 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:53.062703 12616 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:05:53.059345 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:53.001868 19419 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:53.033424 19011 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.010468 19164 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:05:53.052800 19422 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:53.065186 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:53.057840 19410 log.cc:927] Time spent T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.247s	user 0.000s	sys 0.005s
W20260709 13:05:53.069098 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.071820 19365 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:53.083735 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:53.074352 13197 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:53.077291 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:53.088047 12587 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:53.089608 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:53.060741 19326 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.064990 19284 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:53.070089 19226 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:05:53.070914 19011 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:53.099547 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:53.100386 12617 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:53.050624 19282 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:53.103700 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:53.115408 12618 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
W20260709 13:05:53.197350 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 481223us
I20260709 13:05:53.114131 19386 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.212253 12613 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:05:53.216635 12688 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 20: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:53.105283 19363 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:53.106953 19411 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:53.111148 19432 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:53.090207 19365 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:53.110863 19364 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:05:53.237453 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 147934us
I20260709 13:05:53.237072 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:53.263388 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 175416us
I20260709 13:05:53.237015 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:53.275484 13226 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:05:53.097265 19326 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:53.094825 19440 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.141s
I20260709 13:05:53.283455 12617 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:05:53.227829 19412 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.317919 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:53.218855 19407 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:53.400411 12695 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:05:53.405766 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:53.402740 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:53.236588 19386 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:53.277683 19427 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:53.329699 19395 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:05:53.425092 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:53.435935 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 136197us
I20260709 13:05:53.437355 12691 raft_consensus.cc:1275] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:53.437667 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:53.438524 12694 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:05:53.443373 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:53.444538 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:53.449144 13229 consensus_meta.cc:287] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.000s
I20260709 13:05:53.418367 19299 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:53.486366 13235 consensus_meta.cc:287] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.003s
I20260709 13:05:53.487056 13235 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
I20260709 13:05:53.488085 13231 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 13:05:53.416278 19412 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:53.457752 19172 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:53.458173 19419 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:53.462888 19365 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:53.493777 19180 consensus_meta.cc:287] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.679s	user 0.011s	sys 0.000s
I20260709 13:05:53.468665 19389 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:53.469192 19291 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:53.470080 19282 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:53.435343 19427 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:53.471482 19436 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:05:53.473415 19462 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.473986 19320 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:53.474524 19423 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:53.478188 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:53.453917 13229 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:53.423089 19381 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:53.496975 19364 raft_consensus.cc:697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:53.467283 19386 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:53.411623 19407 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:53.457368 19421 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
W20260709 13:05:53.529115 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 329256us
I20260709 13:05:53.534089 19299 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:53.534174 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:53.538250 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:05:53.528923 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 211383us
I20260709 13:05:53.514958 19432 raft_consensus.cc:697] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 22 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:53.542871 12689 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:53.549620 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:53.508168 19172 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:53.572634 12588 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:53.526803 19180 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:53.556627 12512 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:53.576694 12690 raft_consensus.cc:2393] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 22: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:53.532956 19389 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:53.584493 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:53.585038 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:53.573823 19458 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:05:53.564440 19338 consensus_meta.cc:287] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.679s	user 0.012s	sys 0.000s
I20260709 13:05:53.587342 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:53.583401 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:53.589438 12542 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:53.589403 12696 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:05:53.590380 12689 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 24. Current term is 25. Ops: [24.16-24.16]
I20260709 13:05:53.592002 12538 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 13:05:53.592417 12538 pending_rounds.cc:85] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 11
I20260709 13:05:53.592037 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.592604 19432 consensus_queue.cc:237] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:53.592636 12538 pending_rounds.cc:107] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 13:05:53.594658 12538 raft_consensus.cc:2889] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:53.596293 13233 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 22: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:53.597687 19180 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:53.597693 19389 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:53.555478 19462 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:53.602032 19412 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:53.604895 19462 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:53.606581 19364 consensus_queue.cc:237] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:53.598140 19460 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 13:05:53.613817 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.614602 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.628369 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:53.552392 19423 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:53.633044 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:53.585552 19164 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.563987 19299 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:53.662415 19453 log.cc:927] Time spent T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:05:53.663861 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.664865 12540 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:05:53.580451 19472 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 13:05:53.628141 19226 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:05:53.675204 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 57617.3us
W20260709 13:05:53.675938 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 89295.6us
I20260709 13:05:53.678175 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.679735 12544 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 13:05:53.675670 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 88632us
I20260709 13:05:53.685714 12542 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 25.
I20260709 13:05:53.630091 19326 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:53.683714 12587 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:53.692910 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:53.682066 19460 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:05:53.691272 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.677506 19226 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:53.701264 12547 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:53.687335 19462 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:53.707705 12538 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:53.708468 19452 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:53.709052 19365 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:53.710644 19427 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:53.711752 19172 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:53.753353 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.753723 19365 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:53.754413 12538 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:53.755831 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.700279 19363 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:53.756812 19363 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:53.756850 19407 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:53.757676 19363 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:53.718163 19226 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:53.762539 19011 consensus_meta.cc:287] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.651s	user 0.010s	sys 0.000s
I20260709 13:05:53.715137 12546 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
I20260709 13:05:53.763172 19011 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:53.763715 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:53.764319 12546 raft_consensus.cc:2376] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20. Re-sending same reply.
I20260709 13:05:53.716342 12695 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:53.718387 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.720624 12694 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22.
W20260709 13:05:53.722644 19449 log.cc:927] Time spent T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
W20260709 13:05:53.723667 19442 log.cc:927] Time spent T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.394s	user 0.001s	sys 0.000s
I20260709 13:05:53.714238 19423 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:53.728813 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:53.730305 13234 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 1540) took 1801 ms (client timeout 1902 ms). Trace:
I20260709 13:05:53.732158 19465 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.732336 13197 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:53.778138 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 45890.3us
I20260709 13:05:53.777954 19465 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:53.779574 13197 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:53.732808 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:53.780123 19465 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:53.780843 19180 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:53.781257 19180 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.735430 19291 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.739130 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:53.781870 19291 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:53.782332 19380 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:05:53.782879 12613 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:53.783004 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:53.784135 19291 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:53.770275 13234 rpcz_store.cc:269] 0709 13:05:51.928786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.928898 (+   112us) service_pool.cc:224] Handling call
0709 13:05:53.730093 (+1801195us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001dfe54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:53.730224 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2508706048}
I20260709 13:05:53.784579 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:53.740077 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:53.780854 12614 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:53.787335 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:53.742002 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:05:53.743881 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.789527 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.790303 12547 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:05:53.791879 13230 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 20: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:53.756072 19365 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:53.668183 19469 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.075s
I20260709 13:05:53.666383 19164 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:53.751513 12587 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:53.766639 19299 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:53.766461 12546 raft_consensus.cc:1275] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:05:53.771910 12542 raft_consensus.cc:1275] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:05:53.766930 19452 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:53.775053 19172 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:53.776304 12538 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:05:53.766222 19011 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:53.765547 19363 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:53.812383 19363 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:53.797212 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:53.814224 12688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 1635) took 2408 ms (client timeout 3148 ms). Trace:
W20260709 13:05:53.814615 12688 rpcz_store.cc:269] 0709 13:05:51.405434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.589934 (+184500us) service_pool.cc:224] Handling call
0709 13:05:53.813961 (+2224027us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54000c7bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:53.814091 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3367544704}
I20260709 13:05:53.815513 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.816186 12538 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
W20260709 13:05:53.817063 18827 consensus_meta.cc:287] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.758s	user 0.008s	sys 0.000s
I20260709 13:05:53.767220 12544 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 13.
I20260709 13:05:53.818241 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.819700 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.820616 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.820797 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.821843 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.821913 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.822919 19164 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:53.823056 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.823137 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.823856 12538 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:05:53.799741 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:53.824659 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.817484 18827 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:53.825263 12547 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:53.802567 12540 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 24. Current term is 25. Ops: []
I20260709 13:05:53.803260 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:53.785120 19180 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:53.804979 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 53693.7us
I20260709 13:05:53.824225 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.803933 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:53.827060 12546 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:05:53.826234 12696 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:05:53.827064 12587 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:53.803099 13197 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:53.807399 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.808691 19307 raft_consensus.cc:3055] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:05:53.788682 19380 raft_consensus.cc:697] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:53.810242 19474 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:53.833374 12545 raft_consensus.cc:2410] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 13:05:53.824136 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 1177) took 1803 ms. Trace:
W20260709 13:05:53.834128 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 134945us
I20260709 13:05:53.834460 12538 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:05:53.837173 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.837949 12544 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:53.834319 13229 rpcz_store.cc:276] 0709 13:05:52.021199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.043959 (+ 22760us) service_pool.cc:224] Handling call
0709 13:05:53.823990 (+1780031us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b54006a3bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:53.824084 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1984826624}
I20260709 13:05:53.838655 18827 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:53.838835 12613 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:05:53.839031 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.840562 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.845239 19380 consensus_queue.cc:237] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:53.838557 19363 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:05:53.850191 19363 raft_consensus.cc:697] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 22 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:53.851241 19363 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:53.854401 19180 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:53.856665 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:53.856755 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:53.858904 13229 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 20: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:53.864269 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:53.865074 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:53.870215 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:53.871037 13235 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 21: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:53.862064 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1476) took 1173 ms. Trace:
I20260709 13:05:53.872701 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.831039 19423 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.877969 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:53.880924 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:53.881064 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:53.871326 13228 rpcz_store.cc:276] 0709 13:05:52.688669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.689658 (+   989us) service_pool.cc:224] Handling call
0709 13:05:52.714950 (+ 25292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:52.731310 (+ 16360us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:05:52.731340 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:52.814195 (+ 82855us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b18003b5240. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a645a2a6 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a
0709 13:05:52.815077 (+   882us) spinlock_profiling.cc:243] Waited 9.21 ms on lock 0x7b2c0004cc08. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:05:52.815730 (+   653us) log.cc:844] Serialized 26 byte log entry
0709 13:05:53.090907 (+275177us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:53.090961 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.091047 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:53.861803 (+770756us) raft_consensus.cc:1685] finished
0709 13:05:53.861823 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:53.862005 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8559,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":8860,"spinlock_wait_cycles":24467200,"thread_start_us":274704,"threads_started":1,"wal-append.queue_time_us":710987}
I20260709 13:05:53.885108 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:53.886070 12621 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:53.832921 19307 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:53.892694 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:53.836747 19474 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:53.894790 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:53.857296 19180 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:53.896147 12510 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:53.904398 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 64402us
I20260709 13:05:53.887480 19298 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:05:53.909773 19324 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:53.910244 19324 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.910596 19324 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:53.918581 19324 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:53.920858 19324 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:53.922437 12510 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:53.924120 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.925637 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:53.925974 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 45136.8us
I20260709 13:05:53.926192 12540 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:53.927215 19324 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:53.927644 12588 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:53.928217 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.927945 19432 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:53.929024 12540 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:05:53.929615 19470 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:53.835397 19438 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:05:53.930230 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.931062 12540 raft_consensus.cc:2410] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:05:53.932181 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.933614 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:53.935870 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:53.936371 12540 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:53.937888 19452 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:53.938977 19307 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:53.940220 19307 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:05:53.928828 12588 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:53.944973 12540 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:05:53.948249 12547 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:05:53.948972 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:53.950151 12540 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 21: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:53.893285 19482 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:53.898800 19291 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:53.896320 19474 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:53.897538 19472 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:53.966343 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:53.967557 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:53.893632 19423 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:53.983503 12588 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:53.944514 19465 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:05:54.002856 12588 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:54.006986 13234 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 19: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:54.000808 13200 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:53.981899 19291 raft_consensus.cc:697] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:53.937368 19226 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:53.984998 19458 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:53.980266 19364 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:05:54.022807 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 158101us
I20260709 13:05:54.037014 19441 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:54.020532 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:54.050288 18827 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:54.008770 19284 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:54.037796 19441 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:54.018543 19468 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:05:54.049019 19422 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.018s	sys 0.060s
I20260709 13:05:53.965682 19472 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:54.035193 19270 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:54.060009 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:54.062021 18827 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:54.069965 19226 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:54.070175 19217 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:54.051581 19482 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:54.074443 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:54.059312 19422 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.018s	sys 0.060s
I20260709 13:05:54.034910 19381 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:05:54.078497 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:54.059950 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:54.055902 19284 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:54.057468 19364 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:54.081310 12662 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:54.059572 19386 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:54.061640 19270 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.094960 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:54.067442 19426 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:05:54.101963 18827 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:54.099386 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:54.105909 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:54.107237 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:54.107846 13227 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:54.110459 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:54.108361 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:54.087797 19422 raft_consensus.cc:697] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:54.111752 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:54.092919 19284 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:54.092906 19364 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.096604 19226 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:54.121043 18827 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:54.103302 19270 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:54.123092 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:54.124454 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:54.126466 13197 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:54.099272 19466 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:54.130522 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:54.112401 19214 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:54.131090 12619 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:54.113336 19386 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:54.131991 19484 consensus_queue.cc:1059] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:05:54.132508 13197 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:54.160158 13197 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:54.133255 19403 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:05:54.140985 19422 consensus_queue.cc:237] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:54.164407 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:54.146245 12694 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:05:54.149909 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:54.150177 19469 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:54.112767 19426 raft_consensus.cc:697] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 24 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:54.152839 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:54.154014 18827 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:05:54.154313 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:54.158100 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:54.158252 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:54.120126 19364 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:54.108579 19467 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:05:54.163938 13197 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:54.092636 19482 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:54.145381 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:54.127491 19171 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:54.168934 12696 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:54.165201 12691 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:05:54.181953 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:54.176965 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:54.164542 19180 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:54.191012 12622 raft_consensus.cc:2393] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 17: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:54.159114 19427 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:54.191650 12662 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:54.193676 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:54.194891 12662 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:54.195960 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:54.197216 13227 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:05:54.198022 19011 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:54.198458 19466 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:54.220321 19011 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.220822 19011 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:54.222245 19472 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:54.223951 19441 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:54.186219 19479 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:54.199112 19375 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:54.228432 19375 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:54.228909 19375 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:54.199554 19171 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:54.230082 19171 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:54.230536 19171 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:54.200181 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:54.174937 19469 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:54.232815 12662 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:54.234002 19469 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:54.234375 12662 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:54.225850 19472 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:54.235913 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:54.236580 19472 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:54.237323 12512 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:54.237532 19282 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:54.238445 19282 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:54.237895 18827 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:05:54.239588 18827 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:54.239771 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:54.240190 18827 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:05:54.200516 19488 log.cc:927] Time spent T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:05:54.129891 19291 consensus_queue.cc:237] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:54.166976 19380 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:54.198948 19482 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:54.186566 19214 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:05:54.242290 12662 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:54.227363 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:54.238919 19282 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:54.258170 19386 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:54.237739 19466 consensus_queue.cc:1048] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:05:54.238592 19441 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:05:54.281484 19472 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:54.267342 12617 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:54.274765 12512 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:54.282228 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:54.303890 12616 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:54.266292 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:54.311065 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:54.311165 19501 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:54.312472 19507 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:54.314648 12619 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
I20260709 13:05:54.329659 12620 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:05:54.314693 12512 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:54.331058 12512 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:54.265647 19467 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:54.325668 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:54.268088 19445 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:54.271152 19469 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:54.275827 19438 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:54.218860 19427 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:54.342242 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:54.313608 19214 raft_consensus.cc:697] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 25 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:54.336299 12512 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:54.347785 18827 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:54.362866 19505 log.cc:927] Time spent T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:05:54.364758 19427 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:54.333117 19482 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:54.334931 19467 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.377123 12695 raft_consensus.cc:2393] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 14: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:54.349011 19422 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:54.258996 19426 consensus_queue.cc:237] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:54.385749 18827 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:05:54.391682 13232 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 1180) took 2269 ms (client timeout 2956 ms). Trace:
W20260709 13:05:54.381346 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 74466.3us
W20260709 13:05:54.386266 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 144055us
I20260709 13:05:54.312716 19501 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:54.389344 19422 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.393491 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:54.393721 19504 log.cc:927] Time spent T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 13:05:54.392169 13232 rpcz_store.cc:269] 0709 13:05:52.117409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.117546 (+   137us) service_pool.cc:224] Handling call
0709 13:05:54.385979 (+2268433us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b540063a954. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:54.386210 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2100772608}
I20260709 13:05:54.398097 19456 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:54.393697 12659 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:54.398200 19502 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.399231 19502 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:54.385550 19375 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:54.398749 19456 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:54.401830 19456 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:54.402298 19375 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:54.403184 19507 raft_consensus.cc:697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:54.404418 19507 consensus_queue.cc:237] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:54.410156 19456 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:54.401410 19502 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:54.412822 19375 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:54.413278 12540 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:05:54.385977 19467 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:54.429286 19164 raft_consensus.cc:3055] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:54.429853 19164 raft_consensus.cc:740] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:54.430109 19214 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:54.430742 19164 consensus_queue.cc:260] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:54.375316 19425 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:54.432188 19164 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:54.351576 19445 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:54.354665 19508 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:54.434554 19474 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:54.438176 12659 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:54.439083 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 45619.3us
I20260709 13:05:54.470634 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:54.419821 19422 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:54.479395 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:54.496632 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:54.497313 12696 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 21: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:54.481256 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:54.482123 19411 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:54.499342 19411 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:54.503063 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:54.481803 19011 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:54.481317 12659 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:54.503846 19364 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:54.505007 12659 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:54.506980 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:54.487763 19284 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:54.452831 19456 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:54.467082 19423 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:54.452847 19375 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:54.491333 19501 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:54.468030 19508 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:54.492304 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:54.494306 13234 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:05:54.538677 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:54.495963 19445 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:54.478658 19180 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:54.491336 13232 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:05:54.514500 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:54.492653 19270 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:54.530648 12615 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:54.534336 13233 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:54.452682 19171 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:54.541414 12693 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 20: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:54.544486 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:54.506702 19364 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:54.535768 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:54.560990 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:54.561702 13234 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:54.535086 19279 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:54.540316 19508 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:54.562827 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:54.558465 12513 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:54.566205 12695 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 20: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:54.567008 12617 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:54.567233 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:54.568461 12513 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:54.570353 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:54.572167 12691 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 24 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 13:05:54.572271 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:54.556284 19180 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:54.550360 19507 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.030s
I20260709 13:05:54.570302 19441 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:54.593657 19513 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:54.586496 19484 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:54.545609 19467 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:54.600857 12694 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 16. Current term is 17. Ops: []
I20260709 13:05:54.565292 19226 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.033s
I20260709 13:05:54.619963 19011 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:54.630389 12689 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:05:54.633764 12587 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:05:54.634089 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 127492us
I20260709 13:05:54.634990 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:54.635751 12659 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:54.636663 12690 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:54.635861 19438 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:54.665436 19438 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:54.665952 19279 consensus_queue.cc:1059] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:05:54.667114 19279 raft_consensus.cc:3055] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:54.667474 19279 raft_consensus.cc:740] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:54.667775 19438 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:54.668290 19279 consensus_queue.cc:260] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:54.670059 19500 log.cc:927] Time spent T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:05:54.656068 19291 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.014s
I20260709 13:05:54.674443 19270 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:54.655750 19472 consensus_queue.cc:1059] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:05:54.676079 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:54.676518 19284 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:54.680785 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:54.637893 19498 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:05:54.682253 12444 catalog_manager.cc:5697] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 8 to 12, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 12 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:05:54.680104 19513 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:54.659673 19432 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:54.684283 19432 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:54.686496 19432 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:54.686965 19256 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:54.657656 12587 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:54.769800 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 112338us
I20260709 13:05:54.660616 19467 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:54.660784 19214 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:05:54.661067 19171 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:54.656715 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:54.676097 19472 raft_consensus.cc:3055] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:54.689493 19508 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:54.687994 19279 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:54.614885 19482 consensus_queue.cc:1059] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
W20260709 13:05:54.711838 19515 log.cc:927] Time spent T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:05:54.717414 19180 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:54.722671 19474 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:54.654615 19502 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:54.731545 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1483) took 1830 ms. Trace:
I20260709 13:05:54.740280 13199 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:54.742139 13197 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:54.742751 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:54.811492 13231 rpcz_store.cc:276] 0709 13:05:52.900641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.979372 (+ 78731us) service_pool.cc:224] Handling call
0709 13:05:53.487757 (+508385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:53.488588 (+   831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:54.731369 (+1242781us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b5400570dd0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:54.731489 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1168311680}
I20260709 13:05:54.743150 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:54.685107 12444 catalog_manager.cc:5697] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 2 to 9, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 9 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:54.747988 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:54.750303 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:54.751698 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:54.815296 12694 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:05:54.815726 12690 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:54.743647 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:54.752816 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:54.816421 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:54.753849 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:54.755666 12540 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20. Ops: [19.12-19.12]
W20260709 13:05:54.816774 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 76591.9us
I20260709 13:05:54.817112 12694 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:54.818320 13199 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:54.755735 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:54.756652 12691 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:54.758294 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:54.763605 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:54.719017 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:54.696034 12688 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:54.765875 12510 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:54.785470 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 128851us
I20260709 13:05:54.777400 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:54.790663 12622 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
W20260709 13:05:54.816146 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 74092.2us
W20260709 13:05:54.825203 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 59392.2us
I20260709 13:05:54.827739 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:54.829306 12695 raft_consensus.cc:1240] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:54.829677 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:54.798756 19511 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:54.790809 19284 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:54.796507 19498 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:54.849982 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:54.850847 12691 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:05:54.843410 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:54.843672 12587 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:54.828871 19180 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:54.839721 19511 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:54.765275 19282 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:54.769114 19422 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:54.852636 19511 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:54.831178 19299 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:54.796838 19256 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:54.809770 19472 raft_consensus.cc:740] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:54.900283 12692 raft_consensus.cc:1240] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:54.897645 19299 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:05:54.901638 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.848651 19498 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.909926 19498 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:54.916332 19419 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:54.917191 19419 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:54.865125 19494 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:54.901749 19299 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:54.921104 19419 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:54.847029 19425 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.922312 19425 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:54.924470 19425 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:54.926215 19422 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:54.917891 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:54.928871 19282 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:54.853457 19284 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:54.929930 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:54.931337 19284 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:54.891234 19427 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.933578 19427 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:54.934289 19472 consensus_queue.cc:260] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:54.935485 19472 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:54.935758 19427 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:54.936839 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:54.865440 19510 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:54.865893 19482 consensus_queue.cc:1059] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:05:54.853024 19469 consensus_queue.cc:1059] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.091s
I20260709 13:05:54.938191 19470 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:54.890942 19508 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:54.939810 19470 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:54.941099 19164 raft_consensus.cc:3055] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:54.941690 19164 raft_consensus.cc:740] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:54.941170 19256 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:54.931380 12691 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:05:54.865921 19324 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:54.945366 12694 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:54.947463 12587 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:54.947675 12694 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:05:54.866611 19502 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.853116 19214 raft_consensus.cc:697] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:54.955845 19507 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:05:54.846130 19445 consensus_queue.cc:1059] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.104s
I20260709 13:05:54.995044 12694 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:05:54.942492 19164 consensus_queue.cc:260] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:54.958590 19324 raft_consensus.cc:697] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 20 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:54.958899 19284 consensus_queue.cc:1059] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:05:54.994506 19450 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.994246 19507 raft_consensus.cc:697] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:55.033713 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3574) took 1449 ms. Trace:
I20260709 13:05:55.038533 12539 rpcz_store.cc:276] 0709 13:05:53.584168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.584282 (+   114us) service_pool.cc:224] Handling call
0709 13:05:55.033492 (+1449210us) spinlock_profiling.cc:243] Waited 724 ms on lock 0x7b5400229054. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:55.033653 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1665564544}
I20260709 13:05:54.971742 19502 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:55.037674 19214 consensus_queue.cc:237] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.042392 19423 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.004s
W20260709 13:05:55.050220 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 223545us
I20260709 13:05:55.051383 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:55.052495 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 196107us
I20260709 13:05:55.038893 19470 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:55.055968 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 207406us
I20260709 13:05:55.059645 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:55.060704 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:55.071556 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 222523us
I20260709 13:05:55.057757 13199 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:55.080762 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:55.093127 13230 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:05:55.040277 19450 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.148145 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:55.150965 12538 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:05:55.154402 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:55.154598 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 69919.4us
W20260709 13:05:55.155905 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.066833 19324 consensus_queue.cc:237] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:55.165846 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 108186us
I20260709 13:05:55.175554 13230 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 16. (term mismatch)
I20260709 13:05:55.196355 13199 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:55.186914 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:55.188512 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 145666us
I20260709 13:05:55.177778 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:55.194141 13229 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:05:55.178737 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:55.160737 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:55.176122 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:55.182052 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:55.196089 13230 pending_rounds.cc:85] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Aborting all ops after (but not including) 15
I20260709 13:05:55.190349 12444 catalog_manager.cc:5697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 7 to 8, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 8 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:55.202404 13230 pending_rounds.cc:107] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Aborting uncommitted NO_OP operation due to leader change: 24.16
I20260709 13:05:55.202517 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:55.202754 13230 raft_consensus.cc:2889] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:55.195350 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 418526us
I20260709 13:05:55.206303 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:55.206975 13229 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:55.208343 12510 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:55.178247 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:55.212458 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:55.205691 13199 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:55.218567 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:55.220491 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:55.219693 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:55.195029 19422 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:55.155011 19180 raft_consensus.cc:697] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:55.204820 19284 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:55.215519 19270 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:55.160555 19256 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:55.226580 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:55.219410 19445 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:55.178004 19536 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:55.182935 19320 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:05:55.221544 19421 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:55.294296 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:55.218466 19452 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:55.196130 19299 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.164903 19507 consensus_queue.cc:237] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:55.255875 19425 consensus_queue.cc:1059] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.057s
I20260709 13:05:55.299921 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:55.365177 19526 log.cc:927] Time spent T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.242s	user 0.001s	sys 0.001s
I20260709 13:05:55.413968 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:55.421613 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 216052us
W20260709 13:05:55.314771 19527 log.cc:927] Time spent T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:05:55.274972 19470 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:05:55.318190 19530 log.cc:927] Time spent T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:05:55.276566 19445 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:05:55.418237 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 197824us
I20260709 13:05:55.314591 19502 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:55.290289 19536 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:55.434607 19536 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:55.427894 19445 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:05:55.438875 19511 consensus_meta.cc:287] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.541s	user 0.011s	sys 0.000s
I20260709 13:05:55.439360 19511 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.441987 19502 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:55.442512 19502 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.443018 12547 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:05:55.444607 19502 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:55.445760 19320 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:05:55.447315 19320 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:05:55.447583 19543 log.cc:927] Time spent T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:05:55.447664 19536 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.448949 19539 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.449465 19539 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.450917 19536 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:55.451589 19539 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:55.424764 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 227225us
I20260709 13:05:55.367626 19469 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:55.318642 12436 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36394 (request call id 342) took 22495 ms (client timeout 15000 ms). Trace:
I20260709 13:05:55.420607 19452 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:55.289665 19521 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.138s
I20260709 13:05:55.460638 19299 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:55.461035 12539 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:55.375187 19172 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:05:55.424331 19498 consensus_meta.cc:287] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.001s
I20260709 13:05:55.424410 19465 raft_consensus.cc:3055] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:55.424021 19450 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:55.459529 19452 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:55.460774 12538 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:55.227195 19474 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.200s
W20260709 13:05:55.462070 19279 consensus_meta.cc:287] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.670s	user 0.001s	sys 0.010s
I20260709 13:05:55.459067 19392 raft_consensus.cc:3055] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:05:55.318598 19542 consensus_queue.cc:1059] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.136s
I20260709 13:05:55.332783 19422 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:55.462466 19465 raft_consensus.cc:740] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:55.290325 19522 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.162s
I20260709 13:05:55.291271 19256 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.497850 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:55.498931 12691 raft_consensus.cc:2393] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 19: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:55.427688 19270 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:55.488051 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 270849us
I20260709 13:05:55.504221 12513 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:55.487213 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 278947us
I20260709 13:05:55.464462 19511 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:55.462671 19172 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:55.447811 19320 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.496429 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:55.367126 19180 consensus_queue.cc:237] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.499408 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:55.497257 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:55.509789 12539 raft_consensus.cc:3055] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:05:55.529995 12539 raft_consensus.cc:740] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:55.531133 12539 consensus_queue.cc:260] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.532732 12539 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:55.535099 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:55.535609 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:55.510515 12588 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:55.511816 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:55.494508 19472 consensus_meta.cc:287] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.002s
I20260709 13:05:55.513916 12696 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 19. Current term is 20. Ops: [17.12-19.13]
I20260709 13:05:55.486618 19392 raft_consensus.cc:740] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:55.464046 19498 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:55.487601 19456 raft_consensus.cc:3055] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:55.522306 12512 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:55.522779 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 2371) took 1299 ms. Trace:
I20260709 13:05:55.523128 12691 raft_consensus.cc:1275] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:05:55.547883 19511 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:55.528038 12513 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:55.545524 12620 raft_consensus.cc:2393] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 17: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:55.548319 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:55.549144 12692 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:55.505257 19235 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:55.487807 19118 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260709 13:05:55.552294 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:55.524252 19172 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:55.528656 19532 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.553872 12693 rpcz_store.cc:276] 0709 13:05:54.214757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.215648 (+   891us) service_pool.cc:224] Handling call
0709 13:05:55.512777 (+1297129us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b54001b5654. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:55.512988 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691288832}
I20260709 13:05:55.542147 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:55.566201 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 44010us
I20260709 13:05:55.515296 19421 consensus_queue.cc:1059] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:05:55.587878 19470 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:05:55.522367 19270 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:55.596544 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 44352us
I20260709 13:05:55.554034 19456 raft_consensus.cc:740] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:55.558099 19472 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:55.558274 19425 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:05:55.618821 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 76785.8us
I20260709 13:05:55.623148 12588 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:55.619119 19532 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.617957 19432 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:55.576396 19235 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:55.455873 12436 rpcz_store.cc:269] 0709 13:05:32.842634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.872473 (+ 29839us) service_pool.cc:224] Handling call
0709 13:05:33.358166 (+485693us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b5400002490. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6455640 00007fc3af32cb76 00007fc3af436c3e 00007fc3ad8f72a4 00007fc3ad8f7232 00007fc3ad8f7161 00007fc3ad8f70dc 00007fc3ad8f6392 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:55.318365 (+21960199us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:43.249473 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:43.364757 (+115284us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:43.375221 (+ 10464us) write_op.cc:435] Acquired schema lock
0709 13:05:43.378012 (+  2791us) tablet.cc:662] Decoding operations
0709 13:05:43.510559 (+132547us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:43.510655 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:43.510687 (+    32us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:05:43.512410 (+  1723us) tablet.cc:701] Row locks acquired
0709 13:05:43.512456 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:05:43.512633 (+   177us) write_op.cc:270] Start()
0709 13:05:43.512787 (+   154us) write_op.cc:276] Timestamp: P: 1783602343512562 usec, L: 0
0709 13:05:43.512822 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:05:43.513530 (+   708us) log.cc:844] Serialized 9062 byte log entry
0709 13:05:44.014211 (+500681us) spinlock_profiling.cc:243] Waited 7.06 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a646f0ac 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b
0709 13:05:45.253553 (+1239342us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:45.970536 (+716983us) op_driver.cc:464] REPLICATION: finished
0709 13:05:47.447349 (+1476813us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b180009bda0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c3f3 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
0709 13:05:47.447546 (+   197us) write_op.cc:301] APPLY: starting
0709 13:05:47.447661 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:47.913027 (+465366us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:47.931943 (+ 18916us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:48.414144 (+482201us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:48.624245 (+210101us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:05:48.682614 (+ 58369us) write_op.cc:312] APPLY: finished
0709 13:05:48.826283 (+143669us) log.cc:844] Serialized 204 byte log entry
0709 13:05:49.171081 (+344798us) spinlock_profiling.cc:243] Waited 9.44 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a646f0ac 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b
0709 13:05:49.526718 (+355637us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:49.527018 (+   300us) write_op.cc:454] Released schema lock
0709 13:05:49.527103 (+    85us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:49.527512 (+   409us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:49.527546 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11885,"reported_tablets":47,"spinlock_wait_cycles":53982592,"child_traces":[["op",{"apply.queue_time_us":784232,"apply.run_cpu_time_us":67408,"apply.run_wall_time_us":2079962,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100313,"num_ops":23,"prepare.queue_time_us":102487,"prepare.run_cpu_time_us":31186,"prepare.run_wall_time_us":901402,"raft.queue_time_us":712996,"raft.run_cpu_time_us":45686,"raft.run_wall_time_us":437349,"replication_time_us":2457508,"spinlock_wait_cycles":63010048,"thread_start_us":2126881,"threads_started":5,"wal-append.queue_time_us":1331320,"wal-append.run_cpu_time_us":54819,"wal-append.run_wall_time_us":3618063}]]}
I20260709 13:05:55.637953 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 2401) took 1076 ms. Trace:
I20260709 13:05:55.671545 12688 rpcz_store.cc:276] 0709 13:05:54.561434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.561606 (+   172us) service_pool.cc:224] Handling call
0709 13:05:55.637754 (+1076148us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54001b6054. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:55.637887 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":255026048}
I20260709 13:05:55.628022 19469 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:55.642365 12620 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:55.555255 19465 consensus_queue.cc:260] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:55.630097 19363 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:55.637061 19279 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:05:55.620110 19450 consensus_queue.cc:1059] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 13:05:55.644277 19270 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:55.662775 19422 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:55.693032 19452 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:55.641935 19532 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:55.725039 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 131482us
I20260709 13:05:55.727334 12539 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 17. (term mismatch)
I20260709 13:05:55.727902 12539 pending_rounds.cc:85] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 16
I20260709 13:05:55.660928 19445 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.728132 12539 pending_rounds.cc:107] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 23.17
I20260709 13:05:55.716677 19465 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:55.631950 19392 consensus_queue.cc:260] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.723049 19452 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.666294 19456 consensus_queue.cc:260] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:55.731112 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 105895us
I20260709 13:05:55.730460 12539 raft_consensus.cc:2889] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:55.739768 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 211819us
I20260709 13:05:55.729943 19422 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:55.742015 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:55.744768 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:55.747889 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:55.736979 19452 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:55.747815 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:55.751222 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:55.753485 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:55.754096 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:55.754884 13230 raft_consensus.cc:1240] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:55.752468 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:55.757014 12620 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:55.757915 12512 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:55.748255 19545 log.cc:927] Time spent T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:05:55.774379 19235 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:55.760215 12691 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:05:55.760800 19553 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.775324 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2402) took 1196 ms. Trace:
I20260709 13:05:55.775581 19553 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.775772 12695 rpcz_store.cc:276] 0709 13:05:54.579439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.580037 (+   598us) service_pool.cc:224] Handling call
0709 13:05:54.594208 (+ 14171us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:54.844004 (+249796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.775119 (+931115us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b54002373d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:55.775269 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":540233600}
I20260709 13:05:55.776482 19445 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:55.749037 19555 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:55.777882 19555 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:55.774547 19546 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:05:55.712457 19502 consensus_queue.cc:1175] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a70479a3b4114f3581095e9890f5d653" responder_term: 19 status { last_received { term: 18 index: 11 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:05:55.770174 19498 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:55.757102 19320 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:55.770587 19559 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:05:55.772739 19256 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:55.813251 12688 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:55.761128 13231 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:55.813643 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:55.781031 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:55.814903 19472 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:55.815510 19472 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.817519 19472 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:55.819089 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:55.820175 19510 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:55.820668 19510 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:55.812903 19553 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:55.814916 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:55.822894 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 1678) took 1075 ms. Trace:
I20260709 13:05:55.823412 12689 rpcz_store.cc:276] 0709 13:05:54.746989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.750084 (+  3095us) service_pool.cc:224] Handling call
0709 13:05:55.822638 (+1072554us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b54001b5b54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:55.822815 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1047927552}
I20260709 13:05:55.825115 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:55.827951 19484 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:55.759172 12512 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:55.774739 12542 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:05:55.788645 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:55.758438 12662 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:55.794543 12695 raft_consensus.cc:1240] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 13. Current term is 14. Ops: []
W20260709 13:05:55.805193 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 137948us
I20260709 13:05:55.794241 19546 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:55.811964 13233 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:05:55.798280 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:55.755120 19421 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 13:05:55.831771 12510 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:55.817904 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:55.818068 19561 log.cc:927] Time spent T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:05:55.818034 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:55.830814 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 71723us
I20260709 13:05:55.789454 19324 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:55.839727 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 81389.5us
I20260709 13:05:55.846494 19324 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.839509 19546 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:55.855657 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:55.844185 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:55.844578 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:55.845263 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:55.857484 12539 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 25.
I20260709 13:05:55.845744 19472 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:55.845924 19498 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:55.847925 19452 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.842180 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:55.844100 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:55.750140 19422 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.790606 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:55.862776 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.839349 12621 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:05:55.857864 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:55.859778 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:55.863897 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:55.864466 12613 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:55.810281 19363 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:55.855958 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:55.867692 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:55.867934 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:55.869992 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:55.863199 12691 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:55.870958 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:55.873319 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:55.874281 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:55.813164 19555 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:55.876425 12617 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:55.876680 13199 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:55.878372 12510 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:55.839705 19532 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:55.877069 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:55.892234 19560 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:55.892997 19552 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:55.861901 19498 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.893801 19552 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.895488 19498 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:55.896621 19552 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:55.856822 19214 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:55.885954 19363 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:55.900332 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:55.900852 19363 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:55.902081 19256 consensus_queue.cc:1059] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:05:55.903198 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:55.904011 12690 raft_consensus.cc:2376] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17. Re-sending same reply.
I20260709 13:05:55.905081 13233 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:55.879691 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:55.880384 12542 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:55.882196 12617 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:05:55.885453 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:55.898007 19555 consensus_queue.cc:1059] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:05:55.913065 12546 raft_consensus.cc:2393] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 18: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:55.908474 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:55.909761 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:55.880366 12510 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:55.911644 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:55.870224 19507 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:55.906201 12618 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:05:55.912449 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:55.903255 19256 raft_consensus.cc:3055] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:55.876055 19564 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:55.920269 12692 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:55.883062 19484 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:55.934176 19549 consensus_queue.cc:1059] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:55.935412 19422 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:55.935289 19549 consensus_queue.cc:1059] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:55.936578 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:55.937932 19172 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.940554 19172 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:55.941671 19510 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:55.942026 19324 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:55.943936 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:55.908552 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:55.871815 19472 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.930714 12689 raft_consensus.cc:1240] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:55.918725 19565 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:55.932826 19507 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:55.862828 19427 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.053s
I20260709 13:05:55.954121 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:55.941902 12690 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:56.003394 12692 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
W20260709 13:05:55.973435 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 53945.2us
W20260709 13:05:56.022826 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 142572us
I20260709 13:05:56.023689 12587 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:55.975574 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:55.961004 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 85581.9us
I20260709 13:05:55.965780 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:55.998162 12659 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:55.922912 19256 raft_consensus.cc:740] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:56.025889 12659 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:56.026295 12620 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:05:55.948238 19510 raft_consensus.cc:3055] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:05:56.028268 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 52805.8us
I20260709 13:05:55.914364 19363 consensus_queue.cc:1059] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.106s
I20260709 13:05:56.031985 12659 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:55.952716 19284 raft_consensus.cc:3055] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:05:56.039942 12510 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:56.030948 19324 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:56.032532 19510 raft_consensus.cc:740] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:56.030247 19422 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:56.036520 19421 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:56.023878 19450 consensus_queue.cc:1059] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:05:56.036696 19284 raft_consensus.cc:740] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:56.039023 19559 consensus_queue.cc:1059] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260709 13:05:56.074292 19559 consensus_queue.cc:1243] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Peer a11816c5d72e4d1295a242f3ced09e5f log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:05:56.075085 19576 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:05:56.050637 19484 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:56.076673 19484 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:56.077145 19484 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:56.080083 19472 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:56.074398 19574 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:56.082352 19574 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.082748 19574 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:56.084029 12615 raft_consensus.cc:2410] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:05:56.084379 19551 consensus_queue.cc:1059] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.061s
I20260709 13:05:56.074194 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:56.090088 19284 consensus_queue.cc:260] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:56.098541 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.103765 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:56.092370 19284 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:56.102185 13200 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:56.131697 13200 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:05:56.097034 19541 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:05:56.071769 19421 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.052927 19511 raft_consensus.cc:3055] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:56.106145 19214 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:05:56.046867 19555 consensus_queue.cc:1059] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:05:56.096810 19559 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:56.146412 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 114549us
I20260709 13:05:56.137327 19172 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:56.139016 19320 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:05:56.137724 19392 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:05:56.144337 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 120727us
I20260709 13:05:56.151867 12587 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
W20260709 13:05:56.148659 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 122591us
I20260709 13:05:56.148665 12659 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:56.140568 19421 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:56.100903 19422 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:56.154626 12659 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:56.140895 19511 raft_consensus.cc:740] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:56.136163 19484 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:56.088310 19256 consensus_queue.cc:260] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:56.159138 12587 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:56.149813 19452 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:56.164965 12588 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:56.154165 19427 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:56.151259 19320 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:56.164641 12659 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:56.162979 19214 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:56.222375 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:56.234453 13235 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:56.163425 19465 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:56.232579 19507 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:56.263355 19465 raft_consensus.cc:697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:56.264518 19465 consensus_queue.cc:237] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:56.239058 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:56.169528 19282 consensus_queue.cc:1059] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:05:56.146620 19510 consensus_queue.cc:260] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:56.202306 19324 raft_consensus.cc:3055] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:05:56.252552 19484 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:56.202472 19320 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:56.255652 19422 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:56.168591 19576 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
I20260709 13:05:56.209816 19565 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:56.313115 19565 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:56.315626 19565 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:56.259473 19583 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:56.158883 19559 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:56.318662 19559 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:56.319753 19469 consensus_meta.cc:287] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.628s	user 0.011s	sys 0.000s
I20260709 13:05:56.320286 19469 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:56.236230 19511 consensus_queue.cc:260] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:56.261960 19546 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:56.321769 19511 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:56.306540 19324 raft_consensus.cc:740] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:56.323539 19324 consensus_queue.cc:260] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:56.168290 19578 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:05:56.324929 19324 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:56.300503 19427 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:56.326058 19427 raft_consensus.cc:697] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:56.327039 19427 consensus_queue.cc:237] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:56.266091 19573 log.cc:927] Time spent T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260709 13:05:56.267242 19577 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:05:56.330915 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:56.160516 19363 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.062s
I20260709 13:05:56.331509 19456 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:56.332979 13226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:56.333851 13226 raft_consensus.cc:606] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:56.334224 13226 raft_consensus.cc:614] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:56.278087 19586 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:56.284334 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:56.287966 19532 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:05:56.292832 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 259117us
W20260709 13:05:56.301591 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 99383us
I20260709 13:05:56.342142 19571 raft_consensus.cc:3055] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:56.342655 19571 raft_consensus.cc:740] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:56.343547 19571 consensus_queue.cc:260] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:56.344988 19571 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:56.345302 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3580) took 2683 ms. Trace:
I20260709 13:05:56.261272 19574 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:56.310462 19508 raft_consensus.cc:3055] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:56.345901 19472 raft_consensus.cc:3055] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:56.346251 19508 raft_consensus.cc:740] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:56.346450 19472 raft_consensus.cc:740] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:56.347775 19574 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:56.347427 19508 consensus_queue.cc:260] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:56.348235 19576 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.305410 13234 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:56.348729 19508 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:56.348778 19576 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:56.305483 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:56.350407 13234 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:05:56.307654 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:56.353317 12542 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:56.311825 19423 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.354430 19423 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:56.337983 19586 raft_consensus.cc:697] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 15 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:56.356962 19565 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:56.357435 19586 consensus_queue.cc:237] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:56.312120 19510 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:56.297957 19555 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:56.344089 19282 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.368600 19581 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:56.368446 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:56.302935 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 141382us
W20260709 13:05:56.360591 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.375078 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:56.345811 12541 rpcz_store.cc:276] 0709 13:05:53.662255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.672012 (+  9757us) service_pool.cc:224] Handling call
0709 13:05:53.689187 (+ 17175us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:53.794572 (+105385us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:05:54.742464 (+947892us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b18002b4140. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a6489455 00007fc3acf713c7 00007fc3a95839a7 00007fc3a95930bf 00007fc3a9593038
0709 13:05:54.968891 (+226427us) log.cc:844] Serialized 14 byte log entry
0709 13:05:55.167376 (+198485us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:55.197139 (+ 29763us) log.cc:844] Serialized 26 byte log entry
0709 13:05:55.197334 (+   195us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:55.197387 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:56.344952 (+1147565us) spinlock_profiling.cc:243] Waited 99.7 ms on lock 0x7b54004100d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:56.345006 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:56.345056 (+    50us) raft_consensus.cc:1685] finished
0709 13:05:56.345078 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:56.345220 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":306016,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":3910,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":18888,"spinlock_wait_cycles":272094848,"thread_start_us":354771,"threads_started":2,"wal-append.queue_time_us":261843,"wal-append.run_cpu_time_us":2482,"wal-append.run_wall_time_us":1106462}
I20260709 13:05:56.357645 19565 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:56.378741 19581 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:56.381599 19565 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:56.388200 19590 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:56.389734 19363 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:56.390379 19363 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:56.394342 19363 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:56.389030 19590 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:56.397446 19590 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:56.362301 19576 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:56.364094 19421 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:56.404222 19421 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:56.410365 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:56.412181 19320 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:56.412724 12692 raft_consensus.cc:1275] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:05:56.414027 19441 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 24 current term: 24 is higher.
I20260709 13:05:56.414150 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:56.415289 19164 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:05:56.415684 19320 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:56.415778 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:56.416352 13235 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:05:56.357492 19423 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:56.377390 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:56.425287 12690 raft_consensus.cc:2393] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:56.323398 19546 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:56.366854 19568 log.cc:927] Time spent T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1: Append to log took a long time: real 0.569s	user 0.002s	sys 0.000s
I20260709 13:05:56.427757 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:56.444195 12617 raft_consensus.cc:2393] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 18: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:05:56.454864 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 290122us
I20260709 13:05:56.455976 12588 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:05:56.460942 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.478047 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:56.480454 13235 raft_consensus.cc:2410] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 23 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 16.
I20260709 13:05:56.481834 12588 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:56.442811 19532 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.428897 19422 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:56.361963 19555 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:56.423213 19282 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:56.426435 19590 consensus_queue.cc:1048] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:05:56.492607 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:56.493788 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:56.484961 19270 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:56.347437 19472 consensus_queue.cc:260] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:56.503086 12547 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:05:56.503494 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:56.505373 13231 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 17. Current term is 18. Ops: [17.16-17.16]
I20260709 13:05:56.500149 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:56.492607 19465 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:56.508121 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:56.508363 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:56.515266 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:56.518582 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.519379 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:56.519994 12541 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 11.
I20260709 13:05:56.520805 19555 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:56.521617 19472 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:56.529408 13229 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 25. Current term is 26. Ops: []
I20260709 13:05:56.532382 19282 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:56.503661 19422 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:56.533388 12513 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:56.535876 19256 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:56.538457 19555 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:56.520766 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:05:56.538476 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.544880 13229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:56.492995 19532 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:56.546500 12662 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:56.518404 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:56.545818 13229 raft_consensus.cc:606] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:56.574913 12546 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
W20260709 13:05:56.579366 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.581598 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:56.582209 12617 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:56.583628 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:56.583983 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:56.584666 12617 raft_consensus.cc:2368] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:05:56.584512 12588 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:56.582267 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:56.588109 12513 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:56.588618 12546 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 17. Current term is 18. Ops: [17.16-17.16]
W20260709 13:05:56.594398 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.595644 12616 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:05:56.580972 19511 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 13:05:56.598598 19590 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:56.599083 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3616) took 1392 ms. Trace:
I20260709 13:05:56.599165 19590 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:56.599570 12545 rpcz_store.cc:276] 0709 13:05:55.207111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.427507 (+220396us) service_pool.cc:224] Handling call
0709 13:05:55.434752 (+  7245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:55.528741 (+ 93989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:55.528788 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:55.528847 (+    59us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:55.528900 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:56.598832 (+1069932us) spinlock_profiling.cc:243] Waited 93.7 ms on lock 0x7b54002ccc54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:56.598880 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:56.598996 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215596800}
I20260709 13:05:56.642684 12543 raft_consensus.cc:1275] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:05:56.617739 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:56.623703 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:56.617072 12538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3619) took 1409 ms (client timeout 1776 ms). Trace:
I20260709 13:05:56.610373 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:56.613050 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:56.609858 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:05:56.644161 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 49897.9us
I20260709 13:05:56.646817 12588 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:56.578996 19574 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.613595 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:56.643486 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 50898.2us
I20260709 13:05:56.609038 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:56.649232 12588 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:56.644838 12538 rpcz_store.cc:269] 0709 13:05:55.207805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.218321 (+ 10516us) service_pool.cc:224] Handling call
0709 13:05:56.616846 (+1398525us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b54000695d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:56.616991 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":555258112}
I20260709 13:05:56.612972 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:56.655057 12688 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:05:56.659497 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:56.629333 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:56.587145 19421 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.701736 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:56.704912 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 45525.7us
I20260709 13:05:56.705255 19284 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:56.706208 12588 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:05:56.679910 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 163476us
I20260709 13:05:56.707367 19284 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:56.708236 19284 consensus_queue.cc:1059] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:05:56.708461 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:56.709123 19465 raft_consensus.cc:3055] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:05:56.711179 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:56.601498 19590 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:56.611012 19474 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:56.713236 12588 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:56.717993 12588 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:56.663714 12541 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20. Ops: []
I20260709 13:05:56.610891 19591 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:56.612689 19472 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:56.714972 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 60961us
I20260709 13:05:56.651968 19324 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:56.614398 19422 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:56.742888 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:56.660651 19560 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:56.701284 19586 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:56.732863 12662 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:56.612259 19532 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:56.614178 19555 consensus_queue.cc:1059] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.121s
I20260709 13:05:56.711627 19465 raft_consensus.cc:740] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:56.656240 19470 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:56.742080 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:56.756781 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:56.710597 19320 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:56.718801 19580 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:56.652233 19549 consensus_queue.cc:1059] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.104s
I20260709 13:05:56.769536 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:56.780464 12544 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:56.741165 19432 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:05:56.714322 19421 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:56.798548 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 56569.1us
I20260709 13:05:56.758311 19270 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:56.791523 12617 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:05:56.814400 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:56.728724 19576 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 13:05:56.761300 19427 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:05:56.757771 19423 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:56.807267 12588 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:56.703425 19574 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:56.763939 19324 raft_consensus.cc:697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:56.796814 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:56.754866 19472 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:56.798060 19484 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:56.864658 19508 consensus_meta.cc:287] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.000s
I20260709 13:05:56.819806 19586 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:56.818687 19563 consensus_queue.cc:1059] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:05:56.867362 19590 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:56.871877 19581 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:56.792889 19320 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:56.877422 19603 log.cc:927] Time spent T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:05:56.760277 19560 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:56.800360 19432 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:56.906762 19432 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:05:56.887557 19586 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:56.878301 19423 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:56.908897 19586 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:05:56.911147 19601 log.cc:927] Time spent T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:05:56.891201 19590 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:56.914461 19590 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:56.851135 19465 consensus_queue.cc:260] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:56.878427 19577 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:05:56.895478 12588 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.615s (SENT) [suppressed 5 similar messages]
I20260709 13:05:56.879472 12622 raft_consensus.cc:2410] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:05:56.890867 19510 consensus_queue.cc:1059] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
I20260709 13:05:56.887866 19484 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:56.947062 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.955991 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:56.957644 12617 raft_consensus.cc:2410] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 13:05:56.959282 19525 log.cc:927] Time spent T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 1.909s	user 0.007s	sys 0.000s
I20260709 13:05:56.960033 19560 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:56.905790 19508 raft_consensus.cc:3055] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Stepping down as leader of term 19
W20260709 13:05:56.962981 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 167416us
I20260709 13:05:56.968817 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2405) took 2366 ms. Trace:
I20260709 13:05:56.973205 19421 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:56.991092 19320 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:56.963835 19508 raft_consensus.cc:740] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:56.999935 19508 consensus_queue.cc:260] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:57.005071 19606 log.cc:927] Time spent T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:05:57.005982 19421 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:57.006539 19421 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:57.009056 19421 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:57.016115 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:57.016649 13227 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:57.018910 13229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5161235af1b440278d598161e1de2453"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:56.969283 12687 rpcz_store.cc:276] 0709 13:05:54.597791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.599906 (+  2115us) service_pool.cc:224] Handling call
0709 13:05:54.603414 (+  3508us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:54.614601 (+ 11187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:54.614636 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:54.632535 (+ 17899us) log.cc:844] Serialized 52 byte log entry
0709 13:05:54.791919 (+159384us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:54.791968 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:54.792032 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:56.835640 (+2043608us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:56.962274 (+126634us) raft_consensus.cc:1685] finished
0709 13:05:56.962294 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:56.963796 (+  1502us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11110,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":2155,"spinlock_wait_cycles":4128128,"thread_start_us":145966,"threads_started":1,"wal-append.queue_time_us":383993}
I20260709 13:05:57.022794 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:57.024792 12659 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:57.014840 19421 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:57.019567 19566 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:57.029587 19421 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:57.029932 19566 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:57.031865 19566 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:57.032163 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:57.033021 13231 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 18: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:57.031881 19421 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:57.033834 19472 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:57.034698 19574 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:56.966677 19324 consensus_queue.cc:237] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:57.019637 13229 raft_consensus.cc:606] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:57.040226 19363 raft_consensus.cc:3055] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:57.040699 19363 raft_consensus.cc:740] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:57.041484 19363 consensus_queue.cc:260] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:57.042697 19363 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:57.039727 19560 consensus_queue.cc:1059] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:05:57.001422 19508 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:57.051534 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:57.078219 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 110231us
W20260709 13:05:57.084471 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.096756 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4006) took 1192 ms. Trace:
I20260709 13:05:57.097388 12619 rpcz_store.cc:276] 0709 13:05:55.856258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.856386 (+   128us) service_pool.cc:224] Handling call
0709 13:05:55.864784 (+  8398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:55.864952 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:55.864978 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:55.865018 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:05:55.865209 (+   191us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.865288 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:57.048248 (+1182960us) spinlock_profiling.cc:243] Waited 8.1 ms on lock 0x7b540007bcd0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:57.048333 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18625792}
I20260709 13:05:57.143460 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:57.144447 13231 raft_consensus.cc:2393] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 18: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:57.086445 19320 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.145686 19320 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:57.149158 19320 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:05:57.169508 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:57.177677 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:57.200673 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.204697 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2399) took 2673 ms. Trace:
I20260709 13:05:57.206533 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:57.206570 12510 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:57.207196 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:57.205983 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:57.205253 12696 rpcz_store.cc:276] 0709 13:05:54.531648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.537706 (+  6058us) service_pool.cc:224] Handling call
0709 13:05:55.513505 (+975799us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:55.545644 (+ 32139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:57.202725 (+1657081us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b54001b5650. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:57.204509 (+  1784us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2236679424}
I20260709 13:05:57.086093 19421 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:57.223693 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:57.259204 12538 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:57.224864 13231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:57.140064 19592 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:57.235093 12541 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:57.213312 19380 raft_consensus.cc:3055] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:05:57.215250 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:57.277302 12540 raft_consensus.cc:2410] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:05:57.270404 19164 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:05:57.260062 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 53583.5us
I20260709 13:05:57.260980 13231 raft_consensus.cc:606] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:57.283455 12510 leader_election.cc:400] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:05:57.284340 12510 leader_election.cc:403] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:05:57.270967 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 375493us
I20260709 13:05:57.140930 19432 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:57.213501 19554 raft_consensus.cc:3055] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:57.285890 19164 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:57.294205 19554 raft_consensus.cc:740] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:57.294577 19164 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:57.293212 19546 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:57.301331 19180 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:57.291445 19581 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:05:57.293035 13231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd40576623a84072be59a32d23cda14b"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:05:57.290663 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 2193) took 1459 ms. Trace:
I20260709 13:05:57.291922 12510 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:57.211211 19586 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:57.303808 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.307025 13231 raft_consensus.cc:606] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:57.309378 13231 raft_consensus.cc:614] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:57.266357 19592 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:57.275418 19380 raft_consensus.cc:740] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:57.319238 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:57.307415 12540 rpcz_store.cc:276] 0709 13:05:55.831131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.211149 (+1380018us) service_pool.cc:224] Handling call
0709 13:05:57.290593 (+ 79444us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:57.320290 13200 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:57.315431 12541 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:05:57.324744 12615 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
I20260709 13:05:57.277166 19591 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:57.326509 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:57.326651 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:57.326745 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:57.328154 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:05:57.332178 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.332280 12687 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:05:57.335322 19470 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.286453 19551 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:57.337231 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:57.345095 12622 raft_consensus.cc:2393] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 17: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:57.345854 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:57.340301 19320 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:57.341238 19510 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:57.350060 19586 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:57.288623 19590 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:57.350239 19510 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:57.351624 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:57.319901 19592 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:57.274959 19421 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:57.361459 12619 raft_consensus.cc:2393] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 18: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:57.493723 12694 raft_consensus.cc:2393] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 23: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:57.330065 19472 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:57.329412 19507 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:57.538480 19507 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:57.330353 19555 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:57.542470 19421 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:57.515260 19616 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.342684 19591 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:57.534194 19607 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.495s	user 0.001s	sys 0.000s
I20260709 13:05:57.506220 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:57.614742 12694 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:57.341008 19470 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:57.600874 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:57.316862 19180 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:57.598934 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.355014 19551 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:57.625663 13233 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.050s	sys 0.137s
I20260709 13:05:57.567162 19546 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
W20260709 13:05:57.627707 13233 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.050s	sys 0.137s
I20260709 13:05:57.631428 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:57.544356 19616 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:57.686856 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2439) took 1164 ms. Trace:
I20260709 13:05:57.687835 12689 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 13. Current term is 14. Ops: []
I20260709 13:05:57.689306 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:57.690048 12691 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:57.690992 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:57.691183 19574 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.691794 19574 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:57.692380 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:57.692945 12691 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:05:57.664019 19586 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:57.687348 12690 rpcz_store.cc:276] 0709 13:05:56.522498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.522676 (+   178us) service_pool.cc:224] Handling call
0709 13:05:56.522968 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:56.523302 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:56.523341 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:56.523818 (+   477us) log.cc:844] Serialized 26 byte log entry
0709 13:05:56.761271 (+237453us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:56.761342 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:56.761748 (+   406us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:57.686577 (+924829us) raft_consensus.cc:1685] finished
0709 13:05:57.686618 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:57.686782 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1183,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":236967,"threads_started":1,"wal-append.queue_time_us":444399}
I20260709 13:05:57.725392 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:57.684995 19546 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:57.731108 12691 raft_consensus.cc:2368] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:05:57.611008 19380 consensus_queue.cc:260] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:57.697724 19510 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:57.730755 19508 consensus_meta.cc:287] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.591s	user 0.010s	sys 0.001s
I20260709 13:05:57.783367 19616 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:57.792490 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 422492us
I20260709 13:05:57.735639 19586 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:57.789351 19380 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:57.752195 19546 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:57.799333 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:57.795090 19363 consensus_meta.cc:287] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.752s	user 0.009s	sys 0.004s
W20260709 13:05:57.797711 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 505833us
W20260709 13:05:57.815773 19324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.010s	sys 0.043s
W20260709 13:05:57.818712 12662 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.008s	sys 0.006s
I20260709 13:05:57.809849 19207 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:57.812630 19581 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.821187 12510 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:05:57.819069 12662 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.008s	sys 0.006s
W20260709 13:05:57.826833 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 638155us
W20260709 13:05:57.819635 19324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.010s	sys 0.044s
W20260709 13:05:57.827349 12660 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.010s	sys 0.006s
W20260709 13:05:57.830742 12660 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.010s	sys 0.006s
W20260709 13:05:57.834578 19164 consensus_meta.cc:287] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.539s	user 0.012s	sys 0.001s
I20260709 13:05:57.835011 19164 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:57.832640 19419 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.838245 19419 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:57.819351 19591 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:57.837745 12620 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:57.849222 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1758) took 1218 ms. Trace:
I20260709 13:05:57.839102 19547 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.849923 12620 rpcz_store.cc:276] 0709 13:05:56.630515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.837199 (+1206684us) service_pool.cc:224] Handling call
0709 13:05:57.837508 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:57.848871 (+ 11363us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:57.849146 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:57.866153 19624 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:57.866789 19624 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:57.867570 19626 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:57.848949 19470 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:57.869906 19171 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:57.870685 19171 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:57.873384 12691 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:57.826746 19207 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:57.875216 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:57.876436 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:57.876528 19207 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:57.877266 12688 raft_consensus.cc:2410] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:05:57.839599 19510 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:57.877849 19619 log.cc:927] Time spent T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:05:57.879282 12688 raft_consensus.cc:1275] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:05:57.879156 19510 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:57.884192 12688 raft_consensus.cc:1240] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:57.885519 12691 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 22. Current term is 23. Ops: []
I20260709 13:05:57.888283 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:57.889802 19547 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:57.898478 19180 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:57.839996 19574 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:57.905236 19546 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:57.894954 19547 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:57.965230 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.966150 12695 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
I20260709 13:05:57.850081 19164 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:58.015264 12693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:05:58.016166 12693 raft_consensus.cc:606] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:58.016592 12693 raft_consensus.cc:614] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:57.831559 19581 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:58.048506 19586 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:58.060344 19510 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:58.073750 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 710248us
W20260709 13:05:58.067838 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 271367us
W20260709 13:05:58.068753 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 268619us
I20260709 13:05:58.026455 19624 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:58.064441 19164 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:58.101334 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.107528 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:58.109651 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.099334 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:58.111562 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:58.112599 12689 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21.
I20260709 13:05:58.108496 12693 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:05:57.967031 19171 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:58.104326 19551 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:58.120143 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:58.118151 19632 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:58.127451 19591 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.127763 19632 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:58.128266 19625 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.128123 19591 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:58.128777 19625 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:58.129987 19632 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:58.130477 19511 raft_consensus.cc:3055] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:05:58.130820 19625 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:58.131161 19279 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.131212 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1753) took 1519 ms. Trace:
I20260709 13:05:58.130592 19591 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:58.118489 19629 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:58.098546 19547 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:58.132424 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:05:58.131083 19511 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:05:58.104712 19363 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.131934 12616 rpcz_store.cc:276] 0709 13:05:56.612341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.624229 (+ 11888us) service_pool.cc:224] Handling call
0709 13:05:56.655225 (+ 30996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:56.761792 (+106567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:56.761824 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:56.761867 (+    43us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:05:56.761898 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.130983 (+1369085us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54002a6cd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:58.131032 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.131156 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":244537728}
I20260709 13:05:57.997453 19587 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.141341 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:05:58.148633 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 327697us
I20260709 13:05:58.133181 19631 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.131879 19279 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:58.151770 12510 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:58.133669 19624 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:58.118984 19164 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:58.139446 19591 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:58.177826 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:58.169831 12587 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:58.185400 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:58.152318 19171 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.190029 12620 raft_consensus.cc:2368] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:05:58.150616 19363 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:58.201820 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:58.203238 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:58.166244 19635 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.164777 19631 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:58.191284 19586 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:58.220342 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:58.222007 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:58.197850 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:58.186735 19636 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:58.149945 19547 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:58.163543 19633 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:05:58.152494 19587 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:58.166951 19624 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:58.224381 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:58.226768 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2189) took 2409 ms. Trace:
I20260709 13:05:58.270628 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:58.187197 19574 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
W20260709 13:05:58.223431 19604 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 1.357s	user 0.005s	sys 0.015s
I20260709 13:05:58.317833 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:58.317171 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 220900us
I20260709 13:05:58.315421 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:58.220772 19586 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.200929 19171 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:58.220206 19625 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:58.342083 19625 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:58.188503 19591 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:58.322125 12543 rpcz_store.cc:276] 0709 13:05:55.816967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.817088 (+   121us) service_pool.cc:224] Handling call
0709 13:05:55.817363 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:56.643162 (+825799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.226553 (+1583391us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x7b54002ea9d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:58.226715 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1839376256}
I20260709 13:05:58.344233 19554 consensus_queue.cc:260] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:58.345589 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:58.346242 12543 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:05:58.346318 19591 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:58.346926 19591 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:58.347249 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:58.347465 19484 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:58.347374 19591 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:58.348270 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:58.349233 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:58.146471 19629 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:58.327589 12539 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:05:58.327768 13197 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:58.327757 12545 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:05:58.329461 19279 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:58.330117 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:58.335697 12546 raft_consensus.cc:2410] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 25 because replica has last-logged OpId of term: 24 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 16.
I20260709 13:05:58.192124 19511 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:58.382110 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 54418us
I20260709 13:05:58.383003 13197 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:58.367620 12547 raft_consensus.cc:1275] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:05:58.363168 12544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 2179) took 3277 ms (client timeout 1615 ms). Trace:
W20260709 13:05:58.394025 12544 rpcz_store.cc:269] 0709 13:05:55.085972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.086467 (+   495us) service_pool.cc:224] Handling call
0709 13:05:58.362854 (+3276387us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b54003ab454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:58.363017 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3465425152}
I20260709 13:05:58.351334 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1759) took 1720 ms. Trace:
I20260709 13:05:58.353322 12692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2440) took 1746 ms. Trace:
I20260709 13:05:58.395889 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:58.429420 12544 raft_consensus.cc:2410] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:05:58.349337 19591 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:58.450163 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 111706us
I20260709 13:05:58.450941 12512 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:58.317406 19207 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:58.314360 19510 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:58.460574 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:58.445127 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:58.345387 19554 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:58.408170 12618 rpcz_store.cc:276] 0709 13:05:56.630834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.350417 (+1719583us) service_pool.cc:224] Handling call
0709 13:05:58.350735 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:58.350939 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:58.350975 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:58.351029 (+    54us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:58.351074 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.351149 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.351267 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:58.411552 12692 rpcz_store.cc:276] 0709 13:05:56.607315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.615105 (+  7790us) service_pool.cc:224] Handling call
0709 13:05:56.615423 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:56.775169 (+159746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:56.775199 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:56.776187 (+   988us) log.cc:844] Serialized 26 byte log entry
0709 13:05:57.307614 (+531427us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:05:57.307656 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.352804 (+1045148us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400405454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:58.352871 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:58.352936 (+    65us) raft_consensus.cc:1685] finished
0709 13:05:58.352956 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.353248 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3507,"raft.queue_time_us":13629,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":22424,"spinlock_wait_cycles":335206784,"thread_start_us":458999,"threads_started":1,"wal-append.queue_time_us":859978}
I20260709 13:05:58.317876 19546 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:58.449896 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:58.332559 19380 consensus_meta.cc:287] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.003s
I20260709 13:05:58.452520 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:58.474850 12512 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:05:58.441493 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 58570.8us
W20260709 13:05:58.453207 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 198119us
I20260709 13:05:58.455892 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:58.356648 19590 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:58.368968 19586 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:58.358331 19465 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:05:58.465158 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 295238us
I20260709 13:05:58.469837 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:58.487200 12543 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:05:58.449419 19180 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:58.476555 12622 raft_consensus.cc:2410] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:05:58.463598 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:58.344274 19625 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:58.220118 19635 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:58.479728 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:58.452615 19472 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:58.490569 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.485508 19629 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:58.454913 19642 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:58.465739 19511 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:05:58.459236 19580 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:58.506253 19580 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:58.509104 19580 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:58.458459 19591 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.509859 19591 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:58.518954 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.470433 19636 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:05:58.478328 19484 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.465404 19637 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:58.533752 19590 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:58.536355 19164 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:58.470969 19470 consensus_queue.cc:1048] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 13:05:58.536643 19590 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:58.537050 19164 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:58.464051 19207 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:58.471231 19510 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:58.524871 19625 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:05:58.540836 19580 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:58.552273 19637 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:58.571372 19643 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:58.481961 19546 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:58.532045 19644 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:58.575654 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 100874us
W20260709 13:05:58.583412 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 131737us
I20260709 13:05:58.583635 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3632) took 2156 ms. Trace:
I20260709 13:05:58.592581 12617 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:05:58.530701 19472 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:58.591923 12542 rpcz_store.cc:276] 0709 13:05:56.427046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.427328 (+   282us) service_pool.cc:224] Handling call
0709 13:05:56.457290 (+ 29962us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:56.499535 (+ 42245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:56.499565 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:56.503132 (+  3567us) log.cc:844] Serialized 26 byte log entry
0709 13:05:56.652832 (+149700us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:56.652887 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:56.652983 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:58.222667 (+1569684us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:58.577921 (+355254us) raft_consensus.cc:1685] finished
0709 13:05:58.577952 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.583550 (+  5598us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36330,"raft.queue_time_us":36499,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":7663,"spinlock_wait_cycles":33704320,"thread_start_us":141119,"threads_started":1,"wal-append.queue_time_us":316525}
I20260709 13:05:58.599539 12588 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:58.540395 19484 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:58.599800 12540 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:05:58.580461 19656 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.582680 19474 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:58.642717 12542 raft_consensus.cc:1275] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:05:58.584578 19470 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.643157 12542 pending_rounds.cc:85] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 9
I20260709 13:05:58.650923 12542 pending_rounds.cc:107] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:05:58.651191 12542 raft_consensus.cc:2889] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:58.673914 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 197952us
I20260709 13:05:58.675230 13197 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:58.584271 19580 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:58.683518 13197 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:58.640216 19631 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:58.643114 19646 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:05:58.684856 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 85395.8us
I20260709 13:05:58.674332 19590 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:58.705973 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:58.706754 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 2396) took 1379 ms. Trace:
I20260709 13:05:58.715675 12694 rpcz_store.cc:276] 0709 13:05:57.327811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.505965 (+178154us) service_pool.cc:224] Handling call
0709 13:05:58.706568 (+1200603us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5400250154. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:58.706693 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26989440}
I20260709 13:05:58.590591 19643 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:58.708536 19547 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:58.687881 19642 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:58.729488 19654 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:58.736779 19654 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:58.701787 19422 raft_consensus.cc:3055] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:05:58.739427 19422 raft_consensus.cc:740] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:58.739760 19510 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:58.734337 19587 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:58.593613 19644 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:58.743458 19644 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:58.651836 19656 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:58.752096 19656 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:58.754273 19580 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:58.674305 19470 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:58.756810 19470 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:58.690316 19171 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:58.651556 19474 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:58.733505 19635 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:58.759654 19646 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:58.760263 19474 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:58.761909 19646 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:58.686208 19629 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:05:58.721218 13227 raft_consensus.cc:2393] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 19: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:58.768887 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:58.776804 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:58.779740 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:58.769665 12542 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:58.780642 13226 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 25. Current term is 26. Ops: []
I20260709 13:05:58.684676 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:58.782898 13197 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:58.697896 19581 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:58.788717 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:58.728801 19640 log.cc:927] Time spent T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1: Append to log took a long time: real 0.336s	user 0.000s	sys 0.001s
I20260709 13:05:58.686197 19591 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:58.780472 19646 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:58.790366 19657 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.795161 19657 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:58.797151 19592 consensus_meta.cc:287] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.282s	user 0.011s	sys 0.003s
I20260709 13:05:58.797653 19592 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:58.799820 19592 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:58.690465 19658 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:58.801035 19658 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:58.801733 19629 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:58.803496 19658 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:58.804761 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:58.805186 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.734889 19472 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:58.806998 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 122404us
I20260709 13:05:58.807176 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:58.810482 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:58.807777 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:58.811584 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:58.801764 12690 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21. Ops: []
I20260709 13:05:58.809024 12694 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:05:58.790966 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:58.749341 19643 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:58.793938 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:58.710250 19650 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:58.810736 12620 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:05:58.814421 13226 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:58.696204 19507 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:58.789903 19645 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 13:05:58.837770 13226 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:05:58.813288 13227 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
I20260709 13:05:58.797464 19657 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:58.820808 13235 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:58.823935 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:58.840963 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:58.825733 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:58.841928 12622 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:05:58.812757 19591 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:58.830343 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
W20260709 13:05:58.833817 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 229284us
W20260709 13:05:58.835810 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 54665.6us
W20260709 13:05:58.837917 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.794275 19164 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:05:58.839723 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:58.841302 19284 raft_consensus.cc:3055] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:05:58.821004 19380 raft_consensus.cc:993] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:05:58.842116 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:58.848624 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:58.822062 19628 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:58.852270 13229 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:58.837604 19650 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:58.794606 19646 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:58.856635 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:58.838104 19653 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:05:58.855628 12696 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:05:58.858879 12689 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:05:58.843046 19507 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.864017 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:58.821538 19180 consensus_queue.cc:1059] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:05:58.866596 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:58.868884 12696 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:58.869437 12620 raft_consensus.cc:2393] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 18: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:58.868050 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:58.865878 19661 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:58.871253 19661 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:05:58.871623 19661 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:58.875586 19646 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:58.840847 19586 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:58.878868 19586 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:58.881119 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:58.882319 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:58.861512 19652 raft_consensus.cc:1081] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:05:58.885257 12613 raft_consensus.cc:2393] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 20: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:58.886747 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:58.889916 19657 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:05:58.855628 19284 raft_consensus.cc:740] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:58.895709 19284 consensus_queue.cc:260] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:58.897532 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:58.898654 19650 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:58.899343 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:58.899513 12620 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:05:58.900166 13234 raft_consensus.cc:2410] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:05:58.901473 13231 raft_consensus.cc:2393] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 21: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:58.902073 19472 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.902999 19472 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:05:58.905007 19613 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 1.959s	user 0.004s	sys 0.014s
I20260709 13:05:58.911373 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4016) took 2544 ms. Trace:
I20260709 13:05:58.911785 12614 rpcz_store.cc:276] 0709 13:05:56.366836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.366961 (+   125us) service_pool.cc:224] Handling call
0709 13:05:56.367330 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:56.371732 (+  4402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:56.371765 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:56.372235 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:05:56.785850 (+413615us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:56.785911 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:56.786009 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:58.904470 (+2118461us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:58.911031 (+  6561us) raft_consensus.cc:1685] finished
0709 13:05:58.911050 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.911282 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3990,"raft.queue_time_us":14722,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":4294400,"thread_start_us":361563,"threads_started":1,"wal-append.queue_time_us":514311}
I20260709 13:05:58.863209 19419 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:58.867790 19507 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:58.915812 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1714) took 1028 ms. Trace:
I20260709 13:05:58.916204 12691 rpcz_store.cc:276] 0709 13:05:57.887323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.915043 (+1027720us) service_pool.cc:224] Handling call
0709 13:05:58.915350 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:58.915505 (+   155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:58.915535 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:58.915576 (+    41us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:05:58.915606 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.915656 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.915759 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:58.916816 19507 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:58.917325 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:58.920755 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:58.941619 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:58.942658 12696 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:05:58.947499 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:58.896997 19284 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:05:58.951030 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:58.951718 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.952466 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:58.950032 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:58.953299 13234 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:58.958388 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:58.966135 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:58.949694 19628 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:58.973300 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1765) took 2304 ms. Trace:
I20260709 13:05:58.980368 19654 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:58.982288 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:58.982937 12542 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:58.983723 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:58.984365 12542 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 18: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:58.985013 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:58.986616 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:58.987257 12614 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:05:58.988266 12662 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:58.989156 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:58.973734 12615 rpcz_store.cc:276] 0709 13:05:56.669035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.716467 (+ 47432us) service_pool.cc:224] Handling call
0709 13:05:56.758016 (+ 41549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:57.325187 (+567171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.973068 (+1647881us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54001ca054. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:58.973242 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1289476352}
I20260709 13:05:58.990146 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:58.991140 12617 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 20: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:58.988318 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:58.992676 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:58.990610 12510 leader_election.cc:400] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:05:58.994156 12510 leader_election.cc:403] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:58.990716 12620 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
I20260709 13:05:58.993639 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:58.996760 12542 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:58.997546 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:58.998499 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:58.999193 12542 raft_consensus.cc:2410] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:05:59.000728 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:59.001335 12617 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 21.
I20260709 13:05:59.006067 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:59.006304 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:59.006919 12620 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:59.008019 12617 raft_consensus.cc:2393] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 19: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:05:59.008972 12622 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 16. (term mismatch)
I20260709 13:05:59.009462 12622 pending_rounds.cc:85] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 15
I20260709 13:05:59.009770 12622 pending_rounds.cc:107] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 17.16
I20260709 13:05:59.010082 12622 raft_consensus.cc:2889] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:59.013155 19562 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.013752 19562 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:59.014869 19423 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:59.015918 19562 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:59.016314 19522 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:59.016733 19522 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.017066 19522 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:59.017419 19624 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:59.019706 19465 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:05:59.014879 19422 consensus_queue.cc:260] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:59.022789 19422 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:58.971047 19628 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:05:59.032373 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 44170.3us
W20260709 13:05:59.036629 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 46143.9us
I20260709 13:05:59.038945 19164 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 18
W20260709 13:05:59.047257 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:59.065552 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.065408 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.033229 19628 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:59.078012 13231 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 21.
I20260709 13:05:59.079381 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.067421 12510 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:59.082755 12510 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:59.055514 19482 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.053808 19624 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.086251 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.090243 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2205) took 1884 ms. Trace:
I20260709 13:05:59.090746 12547 rpcz_store.cc:276] 0709 13:05:57.206276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.207752 (+  1476us) service_pool.cc:224] Handling call
0709 13:05:58.367129 (+1159377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:58.390557 (+ 23428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.090023 (+699466us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54003ab450. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:59.090177 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2665512192}
W20260709 13:05:59.092598 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.094240 19581 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:59.094769 19581 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:59.094128 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:59.095861 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:59.099112 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.099745 13231 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:05:59.104759 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.105413 13231 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:05:59.102748 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:59.095166 19581 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:59.112691 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:59.085696 19562 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:59.112726 12513 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:59.107414 12510 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:59.117774 12513 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:59.119702 12662 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:59.122141 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:59.114421 19560 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:59.111542 19555 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:59.124182 19214 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:59.116053 19562 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:59.098351 19624 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:59.123771 19630 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:05:59.123600 19324 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:05:59.198295 12539 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:05:59.163071 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.200083 12542 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:59.124799 19626 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:05:59.098424 19482 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:59.166522 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:59.202772 12547 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:59.134151 19279 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:59.110150 19625 consensus_queue.cc:1059] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:05:59.162659 19591 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:05:59.158990 19560 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:59.203608 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:59.160880 19555 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.168227 19562 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:59.123677 19651 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.088s
I20260709 13:05:59.208983 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:59.216729 12539 raft_consensus.cc:2376] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14. Re-sending same reply.
I20260709 13:05:59.213984 19472 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:59.217741 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:59.218341 19676 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:05:59.218421 12538 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21.
I20260709 13:05:59.219465 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.220026 12538 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:05:59.220826 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.221056 19482 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:59.212707 19555 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:59.221936 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:59.222205 19678 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:05:59.201061 19465 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:59.223006 19465 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:59.225190 19465 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:59.202355 19626 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:59.226035 19626 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:59.226691 19624 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:59.227236 19380 raft_consensus.cc:3055] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:05:59.227610 19380 raft_consensus.cc:740] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:05:59.214924 19324 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:59.228399 19380 consensus_queue.cc:260] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:59.231827 19555 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:59.210512 19560 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:59.214157 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:05:59.217777 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.236090 12542 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:05:59.236963 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.225584 19637 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:59.204576 19279 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:59.243155 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 125472us
I20260709 13:05:59.244433 12513 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:59.170838 19661 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:59.253139 12547 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:05:59.255829 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.236574 19380 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:59.263622 12547 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:59.266479 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.268038 12547 raft_consensus.cc:2410] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
W20260709 13:05:59.259994 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 412348us
I20260709 13:05:59.242513 19279 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:59.275650 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.269032 12513 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:59.276337 12547 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:05:59.256287 19562 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:59.277837 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.279039 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.279553 19562 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:59.280120 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:59.281311 12541 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:59.283413 19324 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:59.283875 19324 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.284252 19324 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:59.286165 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:59.286974 13227 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 18: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:05:59.287902 19661 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:59.288893 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:59.246776 19547 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.032s
I20260709 13:05:59.293830 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.296209 12547 raft_consensus.cc:2393] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 15: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:59.295221 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.276677 19422 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:05:59.271981 19432 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:59.304667 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.305351 12547 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:05:59.306213 12662 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:59.301520 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 2394) took 1978 ms. Trace:
I20260709 13:05:59.307413 12690 rpcz_store.cc:276] 0709 13:05:57.323300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.732825 (+409525us) service_pool.cc:224] Handling call
0709 13:05:57.733144 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:58.812985 (+1079841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.301213 (+488228us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540009c754. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:59.301413 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2457158912}
I20260709 13:05:59.275189 19555 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:59.317028 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.315125 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:59.315755 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:05:59.313516 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.318470 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:59.319828 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.321812 12662 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:59.327334 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:59.327051 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:59.325531 12617 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
I20260709 13:05:59.325790 12614 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:59.335325 12588 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:59.342798 12541 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:05:59.352763 12588 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:05:59.355182 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.312769 19635 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 13:05:59.350675 19631 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:05:59.350005 19432 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:59.321118 19674 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:05:59.318950 19465 consensus_queue.cc:1048] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 13:05:59.319196 19502 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:05:59.379784 12588 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:59.382421 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3653) took 1064 ms. Trace:
I20260709 13:05:59.395596 12540 rpcz_store.cc:276] 0709 13:05:58.317582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.440969 (+123387us) service_pool.cc:224] Handling call
0709 13:05:59.382191 (+941222us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540026af54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:59.382344 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":303163136}
I20260709 13:05:59.389161 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.389467 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:59.328090 19511 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:59.375227 19632 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:05:59.387248 12614 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:05:59.397284 12588 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:59.398658 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:59.349325 19661 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:59.403892 12588 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:59.402117 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:59.402324 12617 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:05:59.405236 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.406327 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:59.406589 12540 raft_consensus.cc:2393] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 16: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:59.406900 12617 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:59.405030 12510 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:59.411402 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.410286 12620 raft_consensus.cc:2393] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 15: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:59.407732 12662 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:59.381894 19634 raft_consensus.cc:993] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:05:59.423053 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1713) took 1536 ms. Trace:
I20260709 13:05:59.426885 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:59.427548 12620 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:59.427309 12688 rpcz_store.cc:276] 0709 13:05:57.887042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.888816 (+  1774us) service_pool.cc:224] Handling call
0709 13:05:58.707802 (+818986us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:58.707982 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:58.708005 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:58.708060 (+    55us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:05:58.708091 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.708143 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.422851 (+714708us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b5400250150. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:59.422984 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1882775936}
I20260709 13:05:59.428697 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:59.425226 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:59.422024 19562 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:59.386070 19432 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.438247 19432 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:59.439355 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.441061 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.379470 19631 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:59.426337 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.432149 19562 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.434175 19685 raft_consensus.cc:1081] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:05:59.399178 19643 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:59.455178 12617 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:05:59.412910 19653 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:59.409260 19661 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:59.442878 19686 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:05:59.412981 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:59.412751 19591 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.469390 19679 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.475530 19592 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:59.475847 19679 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:59.476414 19592 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:05:59.477298 19284 consensus_meta.cc:287] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.000s
I20260709 13:05:59.409219 19522 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:59.479482 19592 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:59.479831 19522 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:59.481863 19643 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:59.483039 12659 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:59.484954 19643 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:59.486763 19575 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:05:59.487736 19164 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:05:59.488454 19164 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:05:59.489524 12538 raft_consensus.cc:2410] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 19 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:05:59.446219 19214 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:05:59.413311 12512 leader_election.cc:400] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
W20260709 13:05:59.490854 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 77686.5us
I20260709 13:05:59.491851 12512 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:59.493316 12622 raft_consensus.cc:2410] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:05:59.493722 12688 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19. Ops: []
I20260709 13:05:59.470470 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:59.448511 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.494979 13231 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21.
I20260709 13:05:59.447042 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:59.451292 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.399230 19511 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.444917 19626 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:59.472852 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:59.499125 12696 raft_consensus.cc:2393] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 16: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:59.413121 19507 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:05:59.437656 19616 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:59.454665 19631 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:05:59.454901 19562 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:05:59.459960 12619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 2457) took 2123 ms (client timeout 1655 ms). Trace:
W20260709 13:05:59.506130 12619 rpcz_store.cc:269] 0709 13:05:57.325847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.326395 (+   548us) service_pool.cc:224] Handling call
0709 13:05:59.449330 (+2122935us) spinlock_profiling.cc:243] Waited 33.3 ms on lock 0x7b5400375854. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:59.449463 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":76571392}
I20260709 13:05:59.461198 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:59.463969 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:59.464890 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:59.465907 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:59.466972 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:59.467911 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:59.507937 12694 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:05:59.469173 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:59.509143 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:59.509748 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:59.496587 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.472015 12540 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 13:05:59.511938 13231 raft_consensus.cc:2410] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 19 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:05:59.403755 19419 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:59.512569 12693 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 21.
I20260709 13:05:59.513149 12617 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:05:59.513484 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:59.474357 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 61462.2us
I20260709 13:05:59.516245 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:59.516585 12510 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:59.517867 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:59.518930 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:59.445376 19674 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:05:59.496178 12542 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:05:59.525192 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.525941 12542 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:59.527067 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:59.502861 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:59.502936 12659 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:59.474879 19661 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:59.498819 19511 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:59.495941 12615 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:05:59.500492 13235 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:05:59.528035 12696 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
I20260709 13:05:59.520004 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:59.521346 12541 raft_consensus.cc:2393] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 18: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:59.523595 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:59.524034 12540 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:59.504473 19214 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:05:59.522184 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.462636 19653 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.505642 19616 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.545676 19653 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:59.545840 19616 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:05:59.546236 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.499970 19164 raft_consensus.cc:697] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:59.547887 19164 consensus_queue.cc:237] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:59.530510 19624 consensus_queue.cc:1059] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:05:59.551853 19624 consensus_queue.cc:1243] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:05:59.552453 19363 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:59.553354 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.553807 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.537601 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:59.518172 19419 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:59.541342 19679 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:05:59.541595 12695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 2395) took 2218 ms (client timeout 2091 ms). Trace:
W20260709 13:05:59.529830 19687 log.cc:927] Time spent T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:05:59.530081 19674 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:05:59.542644 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:59.542383 19581 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:59.514886 19422 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:05:59.505389 19522 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:59.536860 19482 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:05:59.529610 19507 raft_consensus.cc:697] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:05:59.553673 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.532838 12693 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:05:59.639396 19507 consensus_queue.cc:237] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:59.556242 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.641721 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.643105 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.565740 12696 raft_consensus.cc:2393] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:05:59.566045 12695 rpcz_store.cc:269] 0709 13:05:57.323492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.504654 (+181162us) service_pool.cc:224] Handling call
0709 13:05:59.541386 (+2036732us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b540016f3d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:05:59.541505 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384744704}
I20260709 13:05:59.474380 19591 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:59.647644 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.649101 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.565068 19637 raft_consensus.cc:3055] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:05:59.649902 19637 raft_consensus.cc:740] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:59.569795 12659 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:59.650952 19637 consensus_queue.cc:260] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:59.651219 19482 raft_consensus.cc:697] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 17 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:05:59.654306 19482 consensus_queue.cc:237] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:59.651389 19522 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:59.658845 19522 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:59.652019 19680 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:05:59.663928 19546 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:59.670202 19484 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:59.472595 19632 raft_consensus.cc:697] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:05:59.563542 19419 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:59.579391 19585 consensus_queue.cc:1059] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:05:59.580425 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.582020 12539 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 19: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:59.536197 19521 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:59.578684 12588 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:05:59.703020 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 124442us
I20260709 13:05:59.582823 19581 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:05:59.599902 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.649295 19591 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:59.600847 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.601713 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.601951 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.602845 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.710557 13227 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:05:59.603652 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.622922 19626 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:05:59.652325 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 82634.9us
W20260709 13:05:59.673683 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 172017us
I20260709 13:05:59.713272 12659 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:59.650486 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.675246 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:59.681746 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:59.682899 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.686685 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:59.707041 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:59.708928 13233 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:05:59.778049 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:05:59.777027 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:59.781934 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1757) took 3168 ms. Trace:
I20260709 13:05:59.785862 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:05:59.754443 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.788084 12696 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:59.777992 12690 raft_consensus.cc:2410] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:05:59.672637 19422 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:59.792320 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:59.793735 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:05:59.794132 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 77856.2us
I20260709 13:05:59.794580 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:59.796164 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 82988.3us
W20260709 13:05:59.714846 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.804482 12659 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:59.782459 12621 rpcz_store.cc:276] 0709 13:05:56.613538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:56.631005 (+ 17467us) service_pool.cc:224] Handling call
0709 13:05:56.631412 (+   407us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:56.887613 (+256201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:56.887646 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:56.895350 (+  7704us) log.cc:844] Serialized 52 byte log entry
0709 13:05:58.707388 (+1812038us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b18004b0dc0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:05:58.833495 (+126107us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:58.833540 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.781490 (+947950us) spinlock_profiling.cc:243] Waited 256 ms on lock 0x7b54003d13d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:59.781574 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:59.781653 (+    79us) raft_consensus.cc:1685] finished
0709 13:05:59.781673 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.781853 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3325,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":5299,"spinlock_wait_cycles":593124992,"thread_start_us":125883,"threads_started":1,"wal-append.queue_time_us":1929092}
I20260709 13:05:59.797804 13231 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 23.
I20260709 13:05:59.699295 19663 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:59.702569 19521 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.811223 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:59.833822 12617 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:59.835215 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:59.836133 12617 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:05:59.812019 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:05:59.817543 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:59.645295 19279 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:59.704646 19479 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:05:59.820277 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:05:59.823448 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.838424 12540 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
W20260709 13:05:59.777689 19560 consensus_meta.cc:287] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.544s	user 0.011s	sys 0.000s
I20260709 13:05:59.810366 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:59.828612 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:59.839571 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:05:59.713716 19363 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:05:59.822047 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:05:59.835403 12659 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:05:59.840312 12695 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:05:59.842146 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:59.838795 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:59.842561 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:05:59.818670 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:59.841280 12512 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:59.845268 12621 raft_consensus.cc:2393] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 15: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:05:59.780457 19625 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:59.841773 19164 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:59.850661 12690 raft_consensus.cc:2393] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:05:59.853099 12659 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:59.701203 19324 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:59.857813 12659 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:59.855067 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:59.860409 12617 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:05:59.803169 19422 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:59.685954 19432 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:59.807571 19591 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:05:59.853312 12692 raft_consensus.cc:1240] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 14. Current term is 16. Ops: []
I20260709 13:05:59.831883 19585 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:05:59.871955 19693 raft_consensus.cc:2764] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:05:59.872232 19324 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:59.858713 19643 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:05:59.873019 19643 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.873152 19279 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:59.873524 19643 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:05:59.874269 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:05:59.866058 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.874913 13230 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:59.877514 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:05:59.877808 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.878196 13231 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:05:59.878929 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:05:59.879362 12696 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:05:59.880112 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.881736 19617 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:05:59.850965 19479 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:59.886237 19637 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:59.888725 12543 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18. Ops: []
I20260709 13:05:59.864174 19164 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:59.892020 12547 raft_consensus.cc:2368] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 18. Current term is 19.
I20260709 13:05:59.893508 13231 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:05:59.831840 19629 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.844295 19521 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:05:59.860044 19630 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:05:59.870169 19432 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:59.871605 19484 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:05:59.872082 19585 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:05:59.843026 19363 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.907516 19631 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:59.908888 12613 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15. Ops: []
I20260709 13:05:59.898177 19632 consensus_queue.cc:237] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:59.789475 12587 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:05:59.894404 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 326670us
I20260709 13:05:59.894903 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:05:59.914215 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4029) took 1106 ms. Trace:
I20260709 13:05:59.914745 12616 rpcz_store.cc:276] 0709 13:05:58.808208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.808329 (+   121us) service_pool.cc:224] Handling call
0709 13:05:58.815942 (+  7613us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:58.876572 (+ 60630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:58.876609 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:58.876655 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:58.876691 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.913939 (+1037248us) spinlock_profiling.cc:243] Waited 60.4 ms on lock 0x7b54001eaad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:05:59.914008 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.914160 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138875776}
I20260709 13:05:59.927925 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:05:59.929705 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 140308us
I20260709 13:05:59.881268 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:05:59.897132 12540 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:05:59.902248 19164 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:05:59.861462 19578 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:59.930541 12587 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:05:59.940389 12587 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:05:59.846370 19560 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:59.940415 13200 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:05:59.844007 19663 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:59.852653 19616 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:05:59.950752 12691 raft_consensus.cc:2368] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 21. Current term is 22.
I20260709 13:05:59.952069 19616 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:05:59.946950 12587 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:05:59.942867 19578 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.913480 19363 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:05:59.924623 19585 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:05:59.859630 19625 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:59.917856 19630 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:05:59.944087 19613 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:05:59.939548 19508 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:05:59.944777 19628 consensus_meta.cc:287] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.859s	user 0.011s	sys 0.000s
I20260709 13:05:59.948515 19465 raft_consensus.cc:2764] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:05:59.943550 19432 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:05:59.948081 19672 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.824s	user 0.005s	sys 0.000s
I20260709 13:05:59.989871 19551 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:00.011798 19551 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.961410 19578 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:00.023569 13197 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:00.025429 13197 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:05:59.948868 19284 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:05:59.999066 12543 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 15. Current term is 16. Ops: []
I20260709 13:05:59.919201 19629 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:05:59.965474 13200 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:00.018589 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 177363us
W20260709 13:06:00.019327 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 161587us
I20260709 13:06:00.033489 12512 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:06:00.021858 12546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 1603) took 1801 ms (client timeout 1814 ms). Trace:
I20260709 13:06:00.022784 19551 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:00.037832 12546 rpcz_store.cc:269] 0709 13:05:58.219976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.220095 (+   119us) service_pool.cc:224] Handling call
0709 13:06:00.012927 (+1792832us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400228154. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:00.021783 (+  8856us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":262969088}
I20260709 13:05:59.965723 19630 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:05:59.966773 19631 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:00.022944 19653 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:00.008618 19680 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:00.009792 19484 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:00.011199 19560 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:00.042286 12659 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:00.015139 19508 raft_consensus.cc:697] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:00.014084 19432 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:00.041676 12512 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:00.102747 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 138540us
W20260709 13:06:00.105041 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 62869.7us
W20260709 13:06:00.103293 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 77991.3us
I20260709 13:06:00.030203 19284 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.107702 13197 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:00.007441 19511 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:00.038745 19685 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:06:00.091974 19672 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:06:00.008185 19422 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:00.110493 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 68935.5us
I20260709 13:06:00.111387 12620 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 21: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:00.120114 12512 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:00.121284 12512 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:00.123750 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:00.092931 19680 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.114634 19284 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:00.130120 19626 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:00.132694 12512 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:00.137842 19626 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:00.140980 12512 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:00.142904 12512 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:00.109716 19522 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:05:59.993718 19628 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.147831 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:00.117347 19627 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:05:59.998449 19562 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:00.106231 19432 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:06:00.119517 19692 log.cc:927] Time spent T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:06:00.046123 19661 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:00.153970 12695 raft_consensus.cc:2368] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 19. Current term is 20.
I20260709 13:06:00.114750 19320 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:06:00.153429 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 163882us
I20260709 13:06:00.156286 12512 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:00.146438 19284 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.230367 13230 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:06:00.172290 19653 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:00.172991 19508 consensus_queue.cc:237] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.178773 19422 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:00.155383 19479 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:00.186583 19629 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:00.189702 19419 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.262259 19419 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:00.265362 19207 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:00.200398 19521 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.267374 19661 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:00.268723 19521 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:00.148092 19560 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:00.198864 19685 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:00.153793 19680 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:00.119196 19324 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:00.210680 12618 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:00.208314 12616 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:06:00.162083 19691 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
W20260709 13:06:00.162631 19698 log.cc:927] Time spent T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 13:06:00.236079 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 130674us
I20260709 13:06:00.199447 19663 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:00.251386 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 95162.9us
I20260709 13:05:59.155164 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:00.269821 12694 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:06:00.274292 19214 raft_consensus.cc:3055] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:00.275094 19562 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:00.208158 19522 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:00.194063 19511 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:00.285426 12587 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:00.287853 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 180229us
I20260709 13:06:00.290403 19324 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.295635 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 1588) took 1520 ms. Trace:
I20260709 13:06:00.201859 19551 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.279327 19637 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:06:00.482424 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.482662 12615 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:00.230288 19320 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:00.492818 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 197092us
I20260709 13:06:00.541378 13200 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:00.519847 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3669) took 1004 ms. Trace:
I20260709 13:06:00.525303 13229 rpcz_store.cc:276] 0709 13:05:58.775290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.776583 (+  1293us) service_pool.cc:224] Handling call
0709 13:06:00.295483 (+1518900us) spinlock_profiling.cc:243] Waited 74.7 ms on lock 0x7b5400576cd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:00.295584 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":171806592}
I20260709 13:06:00.533601 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:00.547617 19284 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:00.490371 19625 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:00.474368 19421 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:00.549173 19421 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:00.551681 19421 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:00.532292 19324 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:06:00.558774 19578 consensus_meta.cc:287] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.513s	user 0.006s	sys 0.003s
I20260709 13:06:00.559303 19578 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:00.559551 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:00.560479 12696 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:06:00.531718 19508 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:00.558965 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:00.493220 19522 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:00.539913 19511 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:00.475375 19214 raft_consensus.cc:740] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:00.525034 19626 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:00.529911 12621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:60170
I20260709 13:06:00.548547 12619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5161235af1b440278d598161e1de2453"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:60170
I20260709 13:06:00.564851 12616 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
I20260709 13:06:00.574347 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 2218) took 1359 ms. Trace:
I20260709 13:06:00.574777 12541 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:00.588096 12539 rpcz_store.cc:276] 0709 13:05:59.215128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.217405 (+  2277us) service_pool.cc:224] Handling call
0709 13:06:00.574069 (+1356664us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b54000a5fd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:00.574260 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":791637248}
W20260709 13:06:00.575891 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 290597us
I20260709 13:06:00.577104 12621 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:00.589389 12621 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:00.589627 12587 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:00.583374 12619 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:00.563196 13199 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:00.566226 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3670) took 1050 ms. Trace:
I20260709 13:06:00.593775 12619 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:00.593245 12542 rpcz_store.cc:276] 0709 13:05:59.516040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.526810 (+ 10770us) service_pool.cc:224] Handling call
0709 13:06:00.566029 (+1039219us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54000a55d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:00.566173 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620098944}
W20260709 13:06:00.530726 19643 consensus_meta.cc:287] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.657s	user 0.011s	sys 0.003s
I20260709 13:06:00.572938 19511 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:00.604391 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 63157.9us
W20260709 13:06:00.604748 19363 consensus_meta.cc:287] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.637s	user 0.006s	sys 0.002s
I20260709 13:06:00.605232 19363 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:00.605662 19511 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:00.606479 19554 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:00.591738 19633 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:00.607424 19363 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:00.608170 13197 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:00.608620 19628 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:00.610180 19479 consensus_queue.cc:1059] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:00.610963 19627 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:00.611068 19522 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.524742 19693 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:06:00.612198 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 49079.2us
I20260709 13:06:00.573716 19214 consensus_queue.cc:260] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:00.578076 19691 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 13:06:00.561538 19578 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:00.562132 19585 consensus_meta.cc:287] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.001s
I20260709 13:06:00.605597 13200 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:00.578265 19320 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:06:00.619448 19630 consensus_meta.cc:287] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.000s
I20260709 13:06:00.566879 19551 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:00.576653 19547 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:00.657316 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 51827.4us
I20260709 13:06:00.661204 13200 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:00.619024 19562 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:00.622678 19380 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:00.619750 19700 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:00.641395 19363 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:00.562018 19508 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.650204 19681 raft_consensus.cc:3055] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:00.574568 19685 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.090s
I20260709 13:06:00.662570 19479 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:00.719237 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2239) took 1203 ms. Trace:
I20260709 13:06:00.860069 12545 rpcz_store.cc:276] 0709 13:05:59.515285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.916659 (+401374us) service_pool.cc:224] Handling call
0709 13:05:59.917102 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:59.931610 (+ 14508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.931661 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:59.943239 (+ 11578us) log.cc:844] Serialized 26 byte log entry
0709 13:06:00.287668 (+344429us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:00.384163 (+ 96495us) log.cc:844] Serialized 14 byte log entry
0709 13:06:00.522401 (+138238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.522517 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:00.717949 (+195432us) raft_consensus.cc:1685] finished
0709 13:06:00.718056 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:00.718781 (+   725us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57673,"prepare.queue_time_us":185058,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":33365,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":17573,"thread_start_us":329096,"threads_started":1,"wal-append.queue_time_us":682656}
I20260709 13:06:00.862172 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:00.863161 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:06:00.729835 12614 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.001s	sys 0.005s
W20260709 13:06:00.863888 12614 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.002s	sys 0.006s
I20260709 13:06:00.724992 12587 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:00.825227 19320 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.730875 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:00.867909 19419 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:00.868680 19320 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:00.732405 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:00.869982 12615 raft_consensus.cc:2393] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 18: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:00.733026 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4032) took 1344 ms. Trace:
I20260709 13:06:00.870767 12613 rpcz_store.cc:276] 0709 13:05:59.388495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.388691 (+   196us) service_pool.cc:224] Handling call
0709 13:05:59.388994 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.909328 (+520334us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.732470 (+823142us) spinlock_profiling.cc:243] Waited 520 ms on lock 0x7b540031cc54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:00.732838 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1195094272}
I20260709 13:06:00.871752 19502 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:00.734036 12617 raft_consensus.cc:1240] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:00.861186 12510 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:00.734840 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3674) took 1056 ms. Trace:
I20260709 13:06:00.873291 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:06:00.747047 12547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3665) took 1423 ms (client timeout 1800 ms). Trace:
I20260709 13:06:00.750288 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3652) took 2432 ms. Trace:
I20260709 13:06:00.759020 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4031) took 1949 ms. Trace:
I20260709 13:06:00.762141 12621 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.764284 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 2482) took 1450 ms. Trace:
W20260709 13:06:00.767135 12691 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 2417) took 1292 ms (client timeout 1678 ms). Trace:
W20260709 13:06:00.639832 12659 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.000s	sys 0.010s
W20260709 13:06:00.938521 12659 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.000s	sys 0.017s
I20260709 13:06:00.771557 12692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 2412) took 1300 ms. Trace:
I20260709 13:06:00.941756 12692 rpcz_store.cc:276] 0709 13:05:59.471385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.539292 (+ 67907us) service_pool.cc:224] Handling call
0709 13:05:59.539565 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.868104 (+328539us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.770848 (+902744us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b54000c71d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:00.771283 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":721140608}
I20260709 13:06:00.779071 12588 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:00.945083 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 187855us
W20260709 13:06:00.789286 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 128043us
I20260709 13:06:00.790686 12513 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:00.792235 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:00.792428 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1723) took 1297 ms. Trace:
I20260709 13:06:00.797322 19164 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:00.798985 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:00.801390 12546 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:00.802927 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:00.804033 19171 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:00.804952 19207 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.952605 19207 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.956275 19207 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:00.659296 19214 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:00.806996 19256 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:00.962057 19256 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.964769 19256 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:00.664839 19547 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.967451 19547 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:00.656780 19585 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.664093 19630 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.969105 12687 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:00.970481 19585 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:00.971016 19630 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:00.620584 19643 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.971663 12543 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:00.973908 19643 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:00.975029 12688 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:00.680531 19681 raft_consensus.cc:740] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:00.976719 13200 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:00.976969 19681 consensus_queue.cc:260] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.978348 19681 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:00.978628 13200 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:00.979564 19284 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:00.683837 19680 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:00.815285 19432 consensus_meta.cc:287] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.573s	user 0.005s	sys 0.005s
I20260709 13:06:00.985980 19432 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.988374 19432 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:00.820323 19508 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:00.821941 19554 raft_consensus.cc:3055] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:00.989125 19554 raft_consensus.cc:740] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:00.989459 12620 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:00.990772 19554 consensus_queue.cc:260] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.991423 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:00.670706 19562 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.992655 19634 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:00.993579 19634 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:00.994102 19634 raft_consensus.cc:697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:00.994323 19562 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:00.669103 19380 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.995435 19380 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:00.995291 19634 consensus_queue.cc:237] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.946724 12694 rpcz_store.cc:276] 0709 13:05:59.495448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.577240 (+ 81792us) service_pool.cc:224] Handling call
0709 13:05:59.577597 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:00.315778 (+738181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.791820 (+476042us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b54000c7bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:00.792243 (+   423us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1591367040}
I20260709 13:06:00.824345 19423 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:06:00.678707 19707 log.cc:927] Time spent T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:06:00.650175 19712 consensus_queue.cc:1059] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.104s
I20260709 13:06:00.748649 12619 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.010655 19712 raft_consensus.cc:3055] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:01.011293 19712 raft_consensus.cc:740] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:06:00.833199 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 63836.4us
I20260709 13:06:01.013127 19508 consensus_queue.cc:1059] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:01.013712 12662 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:01.015515 19508 raft_consensus.cc:3055] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:01.015971 19508 raft_consensus.cc:740] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:00.845513 19522 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:00.855036 13235 raft_consensus.cc:3055] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:00.856885 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:01.016763 13235 raft_consensus.cc:740] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:01.017076 19522 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:00.854857 13234 raft_consensus.cc:1240] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 14. Current term is 16. Ops: []
I20260709 13:06:01.018251 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:00.858089 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:01.019059 13234 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:06:00.542532 12540 rpcz_store.cc:276] 0709 13:05:59.515800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.938733 (+422933us) service_pool.cc:224] Handling call
0709 13:05:59.939129 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:59.941390 (+  2261us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:00.096072 (+154682us) log.cc:844] Serialized 14 byte log entry
0709 13:06:00.519354 (+423282us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:00.519436 (+    82us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:00.519500 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.519598 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:00.519764 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11221,"prepare.queue_time_us":232580,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":111,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":7928,"thread_start_us":565878,"threads_started":2}
W20260709 13:06:00.859243 19674 consensus_meta.cc:287] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.158s	user 0.009s	sys 0.004s
I20260709 13:06:01.020154 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:01.020447 19674 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.878803 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4050) took 1052 ms. Trace:
I20260709 13:06:01.022964 19674 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:01.021821 12614 rpcz_store.cc:276] 0709 13:05:59.812814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.812951 (+   137us) service_pool.cc:224] Handling call
0709 13:05:59.813239 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:59.832071 (+ 18832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:59.832104 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:59.832552 (+   448us) log.cc:844] Serialized 26 byte log entry
0709 13:06:00.030933 (+198381us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:00.864433 (+833500us) log.cc:844] Serialized 14 byte log entry
0709 13:06:00.864954 (+   521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.865130 (+   176us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:00.865211 (+    81us) raft_consensus.cc:1685] finished
0709 13:06:00.865228 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:00.865521 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":654937,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":506,"raft.queue_time_us":20370,"raft.run_cpu_time_us":360,"raft.run_wall_time_us":10524,"thread_start_us":928973,"threads_started":2,"wal-append.queue_time_us":140494}
I20260709 13:06:00.874334 12695 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:01.024170 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:01.025103 12614 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 22: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:00.876587 12618 rpcz_store.cc:276] 0709 13:05:58.809272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.809387 (+   115us) service_pool.cc:224] Handling call
0709 13:05:59.449826 (+640439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:00.290664 (+840838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.745650 (+454986us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b5400375854. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:00.758609 (+ 12959us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b5400375850. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:00.758829 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3221500672}
I20260709 13:06:01.026917 12588 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:00.884965 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:01.028362 13229 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
I20260709 13:06:00.876861 12622 rpcz_store.cc:276] 0709 13:05:59.314092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.315265 (+  1173us) service_pool.cc:224] Handling call
0709 13:06:00.763724 (+1448459us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54002a80d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:00.764054 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":379709696}
I20260709 13:06:00.883148 19502 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:00.876338 12547 rpcz_store.cc:269] 0709 13:05:59.323779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.325951 (+  2172us) service_pool.cc:224] Handling call
0709 13:06:00.746455 (+1420504us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b54002baf54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:00.746805 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1296510336}
I20260709 13:06:01.029877 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:00.890226 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 165691us
I20260709 13:06:01.029963 19631 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:01.039260 12587 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:00.876462 12544 rpcz_store.cc:276] 0709 13:05:58.316397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.518644 (+202247us) service_pool.cc:224] Handling call
0709 13:06:00.013124 (+1494480us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:00.013360 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:06:00.156768 (+143408us) log.cc:844] Serialized 14 byte log entry
0709 13:06:00.483635 (+326867us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:00.483705 (+    70us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:06:00.483764 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.483936 (+   172us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:00.748246 (+264310us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b5400228150. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:00.748617 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":160870,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":113,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":38264,"spinlock_wait_cycles":3292239104,"thread_start_us":351506,"threads_started":2,"wal-append.queue_time_us":440077}
I20260709 13:06:01.042263 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:01.043630 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:01.044817 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:01.045861 19423 consensus_queue.cc:1059] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:00.891777 19693 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:00.893649 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:00.875069 12510 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:00.912290 12545 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 21: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:00.914028 12617 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
W20260709 13:06:00.914618 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:00.914685 19714 log.cc:927] Time spent T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.225s	user 0.003s	sys 0.001s
I20260709 13:06:00.918776 19324 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.923915 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:00.924335 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:00.924582 12621 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:00.924343 12613 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 16. Current term is 18. Ops: []
W20260709 13:06:00.926782 19696 log.cc:927] Time spent T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 1.058s	user 0.001s	sys 0.010s
W20260709 13:06:00.941252 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 821850us
I20260709 13:06:00.781275 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:06:00.949218 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 158899us
I20260709 13:06:00.949529 19700 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:00.949983 12538 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:06:00.950726 19164 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.951857 12542 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:00.925393 13197 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:01.003614 19171 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:00.992100 19554 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:01.010741 12615 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:01.018033 13235 consensus_queue.cc:260] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:00.863368 13231 raft_consensus.cc:2393] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:01.068414 12695 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 22.
W20260709 13:06:00.876937 12691 rpcz_store.cc:269] 0709 13:05:59.474483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.509380 (+ 34897us) service_pool.cc:224] Handling call
0709 13:06:00.766569 (+1257189us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54002373d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:00.766839 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1010044288}
I20260709 13:06:01.013363 19712 consensus_queue.cc:260] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.011683 12619 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:01.030867 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:01.045516 12544 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:06:01.024794 19508 consensus_queue.cc:260] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:01.062954 12540 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:01.063943 13233 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 22: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:00.873526 12541 rpcz_store.cc:276] 0709 13:05:59.678183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:59.959826 (+281643us) service_pool.cc:224] Handling call
0709 13:06:00.574597 (+614771us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:00.588851 (+ 14254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.734400 (+145549us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b54000a5fd0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:00.734643 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1383400832}
I20260709 13:06:01.076339 19432 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:01.077365 13235 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:01.077924 12547 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:06:01.078958 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:01.079739 12547 raft_consensus.cc:2393] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 20: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:01.080021 19164 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:01.030061 19502 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.083797 19502 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:01.084177 19284 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:06:01.084878 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 43651.7us
I20260709 13:06:01.057542 19629 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:01.088240 19629 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.089996 13230 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:01.090931 19629 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:01.091126 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:01.091253 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:01.092574 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:01.093389 19171 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:01.096019 12546 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 22: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:01.096985 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:01.097713 12620 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:01.098031 19700 raft_consensus.cc:697] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 19 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:01.099393 19324 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:01.099118 19700 consensus_queue.cc:237] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.064204 19631 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:01.101255 19631 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.102034 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:01.102823 12614 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 21: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:01.103252 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:01.104049 12621 raft_consensus.cc:2393] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 20: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:01.104635 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:01.105293 12618 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:01.105422 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:01.102064 19631 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:01.106357 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:01.106954 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:01.107672 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:01.108062 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:01.108357 19631 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:01.108672 13233 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:06:01.108790 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:01.109380 13231 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:01.110703 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:01.111112 19681 consensus_queue.cc:1059] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:01.111884 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:01.112310 19547 raft_consensus.cc:3055] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:01.112732 19547 raft_consensus.cc:740] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:06:01.113440 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 188375us
I20260709 13:06:01.114068 19547 consensus_queue.cc:260] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.112732 19693 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:01.115322 19547 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:06:01.116168 19685 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:01.116354 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:01.117264 13230 raft_consensus.cc:2393] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 26: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:01.119808 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:01.120236 19712 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:01.120714 12691 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 22: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:01.103878 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:01.101253 12542 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
I20260709 13:06:01.127890 12538 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:06:01.134675 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:01.135735 19551 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 18.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.003s
I20260709 13:06:01.135769 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:01.137988 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 45612.5us
I20260709 13:06:01.136067 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:01.140506 13233 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 22: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:01.137461 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:01.153235 12618 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:01.058516 19380 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.147621 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:01.158043 12543 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:01.161687 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:01.162750 12621 raft_consensus.cc:2393] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 19: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:06:01.165426 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 146756us
W20260709 13:06:01.168066 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.165825 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:01.170061 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:01.172731 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:01.169288 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:01.181918 13232 raft_consensus.cc:2368] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 21. Current term is 22.
I20260709 13:06:01.175768 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:01.188735 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:01.159230 19324 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:01.194365 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.156673 19630 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:01.194845 12620 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:01.192070 12614 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:01.198698 12544 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:01.157613 19423 consensus_queue.cc:1059] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 13:06:01.203073 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:01.206318 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 331496us
I20260709 13:06:01.196578 19164 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.211549 12687 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:01.215569 12438 catalog_manager.cc:5697] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 12 to 21, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 21 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:06:01.218650 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 188923us
I20260709 13:06:01.226186 19479 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.226881 19479 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.235085 19630 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.204555 19693 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:01.219839 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:01.254913 12688 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 21: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:06:01.256531 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 45103.5us
I20260709 13:06:01.229362 19479 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:01.256254 19585 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:01.259117 12691 raft_consensus.cc:2393] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 20: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:01.260399 12687 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21.
I20260709 13:06:01.261919 19164 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:01.266448 19380 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:01.274343 19725 log.cc:927] Time spent T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
W20260709 13:06:01.274840 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:01.277719 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.219494 19324 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.281769 19711 consensus_queue.cc:1059] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 13:06:01.283267 19680 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:01.283483 19324 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:01.284051 19680 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.284826 12687 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:01.286470 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:01.286885 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:01.287497 12696 raft_consensus.cc:2376] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20. Re-sending same reply.
I20260709 13:06:01.286497 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:01.288558 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:01.289310 12688 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:01.289880 19715 consensus_queue.cc:1059] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:01.290697 12690 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:06:01.291376 12588 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:01.291616 19554 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.292486 19284 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:01.292913 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:01.264232 19693 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.295046 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:01.295574 19693 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:01.295904 12687 raft_consensus.cc:2368] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 21. Current term is 22.
W20260709 13:06:01.296458 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 102410us
I20260709 13:06:01.297914 19554 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.271504 19674 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.300561 19674 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.302429 19629 raft_consensus.cc:3055] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:01.302778 19674 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:01.304560 12662 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:01.258073 19320 consensus_queue.cc:1059] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:06:01.305135 19522 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:01.305843 19502 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:01.312309 12691 raft_consensus.cc:1275] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:06:01.297288 13231 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
I20260709 13:06:01.319391 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:01.320506 13228 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:06:01.307423 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:01.307807 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:01.322278 13235 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:06:01.324221 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:01.306036 19685 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:01.307912 19680 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:01.293272 19284 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:01.293306 19635 raft_consensus.cc:3055] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:01.302848 19629 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:01.351051 12688 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:06:01.363128 19576 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:01.396667 19576 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:01.398334 12691 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:01.398617 19576 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:01.399426 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:01.400038 12691 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 26.
I20260709 13:06:01.393543 19635 raft_consensus.cc:740] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:01.382465 12692 raft_consensus.cc:2393] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 20: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:06:01.367515 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 60219.5us
I20260709 13:06:01.370378 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:01.367405 19632 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:01.404175 12696 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 21.
I20260709 13:06:01.404304 19632 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.398082 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:01.404677 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:01.404935 19632 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:01.405413 12688 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 22: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:01.407003 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:01.408128 19631 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:01.408955 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:01.410480 12687 raft_consensus.cc:1275] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:06:01.410808 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:01.412142 19706 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:01.412230 19432 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:01.368469 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:01.325739 19508 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:01.362941 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 58495.9us
I20260709 13:06:01.371690 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:01.371177 12659 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:01.431001 12690 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 21: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:01.320948 19423 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 18.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.109s
I20260709 13:06:01.372552 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:01.435400 12662 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:01.343379 19164 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:01.448006 19737 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:01.450636 19635 consensus_queue.cc:260] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.451766 19635 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:01.452978 19631 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:01.453801 12693 raft_consensus.cc:2368] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21.
W20260709 13:06:01.454555 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 43867us
I20260709 13:06:01.455478 12588 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:01.456331 19554 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:01.456624 19551 raft_consensus.cc:3055] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:01.457093 19551 raft_consensus.cc:740] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:01.449091 19737 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.461187 19737 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:01.463397 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.463449 19681 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:01.464061 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.464272 19681 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.470777 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:01.471899 13228 raft_consensus.cc:2393] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 24: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:01.465499 12512 leader_election.cc:400] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 19. Current term is 20.
I20260709 13:06:01.474551 12512 leader_election.cc:403] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:01.475441 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:01.474637 19681 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:01.437259 19547 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:06:01.479732 12544 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:01.480489 12547 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:06:01.437547 19630 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:01.480516 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 45266.9us
I20260709 13:06:01.482499 12689 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 21.
I20260709 13:06:01.486182 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:01.487066 12545 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:01.488647 19214 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:01.488785 19700 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 19. Current term is 20.
I20260709 13:06:01.489142 19214 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:01.489670 19214 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:01.494354 12588 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:01.495287 19284 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:01.495774 19284 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:01.466130 19715 raft_consensus.cc:3055] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:01.496168 12588 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:01.496417 19715 raft_consensus.cc:740] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:01.496184 19284 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:01.480950 19631 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:01.499181 19631 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:01.501184 19214 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.504069 19214 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:01.505235 19284 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.496161 12544 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:06:01.363194 19685 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.511556 19284 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:01.516052 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:01.518985 19522 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:01.519810 19522 raft_consensus.cc:697] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 24 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:01.517271 12662 leader_election.cc:400] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 21. Current term is 22.
W20260709 13:06:01.530879 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 65652.1us
I20260709 13:06:01.537961 12662 leader_election.cc:403] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 13:06:01.513403 19685 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:01.521347 19522 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.531981 19482 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:01.529395 19502 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:01.521404 19284 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:01.554169 19214 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:01.554209 19482 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.554229 19679 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:01.529080 19629 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 18.17, Last appended by leader: 17, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.468279 19576 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.558746 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:01.561218 12438 catalog_manager.cc:5697] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 4 to 15, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 15 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:01.561961 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:01.562646 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:01.563341 19380 raft_consensus.cc:3055] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:06:01.563772 12444 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36396 (request call id 354) took 83879 ms (client timeout 15000 ms). Trace:
I20260709 13:06:01.573458 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:01.580720 12587 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:01.582571 12545 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
W20260709 13:06:01.606292 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 52838.8us
I20260709 13:06:01.622663 12689 raft_consensus.cc:2393] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 19: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:06:01.604840 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.624095 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:01.613090 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:01.613090 12693 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21.
I20260709 13:06:01.627523 12687 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:06:01.628892 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:01.630873 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.604818 19171 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.636863 12547 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:01.523036 19551 consensus_queue.cc:260] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.640717 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:01.640926 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:01.641480 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:06:01.638540 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 267579us
I20260709 13:06:01.618839 19380 raft_consensus.cc:740] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:01.642921 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:01.643121 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:01.643299 19706 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:01.643532 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:01.644447 12689 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:06:01.644799 19432 consensus_queue.cc:1048] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:01.644929 19715 consensus_queue.cc:260] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.645493 19632 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.646392 12438 catalog_manager.cc:5697] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 8 to 11, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 11 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:01.648386 19631 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:06:01.650590 12692 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:01.652709 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:01.654609 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:01.670842 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:01.680166 13227 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:01.680550 12687 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 23: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:01.680699 12543 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 25.
I20260709 13:06:01.671664 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:01.671880 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.681766 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:01.678407 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:01.682678 12544 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:06:01.684266 13229 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:06:01.685045 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:01.685598 13235 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:01.687409 12438 catalog_manager.cc:5697] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 8 to 11, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 11 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:01.693902 13232 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 26.
I20260709 13:06:01.700419 12688 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:06:01.622786 19284 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.707149 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:01.704941 12546 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:01.704190 12659 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:01.714713 12544 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:01.716986 19693 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:01.676769 19629 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:01.674382 19171 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:01.750591 12691 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:06:01.748867 19576 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:01.753648 12688 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:01.731739 19551 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:01.733801 19679 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:01.726289 19547 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:01.759645 12438 catalog_manager.cc:5697] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:01.749207 19502 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:06:01.770820 19284 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:01.773703 19171 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:01.773962 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:01.774351 19547 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:01.776506 19547 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:01.777510 19482 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:01.777431 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:01.737145 19380 consensus_queue.cc:260] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.778393 12546 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 22: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:01.779023 19380 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:01.780115 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:01.780845 12546 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:06:01.782292 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:01.782953 12546 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:01.794188 19632 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:01.619098 12444 rpcz_store.cc:269] 0709 13:04:37.680236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:37.680403 (+   167us) service_pool.cc:224] Handling call
0709 13:06:01.559216 (+83878813us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:55.640239 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:55.641094 (+   855us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:55.641161 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:05:55.641188 (+    27us) tablet.cc:662] Decoding operations
0709 13:05:55.651628 (+ 10440us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:55.651773 (+   145us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:55.651813 (+    40us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:05:55.652656 (+   843us) tablet.cc:701] Row locks acquired
0709 13:05:55.652715 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:05:55.652927 (+   212us) write_op.cc:270] Start()
0709 13:05:55.653115 (+   188us) write_op.cc:276] Timestamp: P: 1783602355652841 usec, L: 0
0709 13:05:55.653162 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 13:05:55.663953 (+ 10791us) log.cc:844] Serialized 2137 byte log entry
0709 13:05:56.336501 (+672548us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:05:56.954897 (+618396us) op_driver.cc:464] REPLICATION: finished
0709 13:05:57.683043 (+728146us) write_op.cc:301] APPLY: starting
0709 13:05:57.693940 (+ 10897us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:57.870310 (+176370us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:57.870360 (+    50us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:57.873355 (+  2995us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:58.024111 (+150756us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:05:58.049866 (+ 25755us) write_op.cc:312] APPLY: finished
0709 13:05:58.050324 (+   458us) log.cc:844] Serialized 57 byte log entry
0709 13:05:58.325376 (+275052us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:58.377057 (+ 51681us) write_op.cc:454] Released schema lock
0709 13:05:58.455852 (+ 78795us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:58.497294 (+ 41442us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:58.497376 (+    82us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3326080,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":650888,"apply.run_cpu_time_us":30060,"apply.run_wall_time_us":873550,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25037,"num_ops":5,"prepare.queue_time_us":304836,"prepare.run_cpu_time_us":13682,"prepare.run_wall_time_us":180733,"raft.queue_time_us":368270,"raft.run_cpu_time_us":56068,"raft.run_wall_time_us":338975,"replication_time_us":1253830,"spinlock_wait_cycles":41625856,"thread_start_us":991582,"threads_started":5,"wal-append.queue_time_us":365599,"wal-append.run_cpu_time_us":79546,"wal-append.run_wall_time_us":3528097}]]}
I20260709 13:06:01.801149 13235 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:01.803460 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:01.804402 13226 raft_consensus.cc:2393] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 17: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:06:01.814908 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 242268us
I20260709 13:06:01.824049 13227 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 23.
W20260709 13:06:01.830384 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:01.837890 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 189093us
I20260709 13:06:01.765540 12438 catalog_manager.cc:5697] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 11 to 14, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 14 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:01.845270 12587 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:01.846271 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 329458us
I20260709 13:06:01.821882 19679 raft_consensus.cc:697] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:01.859767 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:01.858928 13199 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:01.838840 19171 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.834704 19576 consensus_queue.cc:1059] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:06:01.872614 12438 catalog_manager.cc:5697] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 9 to 17, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 17 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:01.882957 12544 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 26.
I20260709 13:06:01.886373 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:01.888568 12620 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:01.889143 12543 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:06:01.894493 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:01.895614 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:01.897073 12688 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:01.892218 12659 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:01.889999 13199 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:01.896371 12438 catalog_manager.cc:5697] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 16 to 18, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 18 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:01.896392 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:01.900314 12547 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:01.885674 19706 raft_consensus.cc:697] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 21 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:06:01.902377 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 406331us
W20260709 13:06:01.904224 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:01.907001 19712 consensus_meta.cc:287] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.786s	user 0.014s	sys 0.000s
I20260709 13:06:01.891302 19423 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:01.902887 12438 catalog_manager.cc:5697] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 13 to 14, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 14 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:01.910175 19715 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:01.886595 19632 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:01.916847 12617 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:01.888115 19207 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.922940 13230 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:06:01.926218 12622 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:06:01.929382 12438 catalog_manager.cc:5697] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 10 to 18, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 18 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:01.920161 19423 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.949772 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:01.924078 19632 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:01.958678 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.953701 19423 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:01.962915 19214 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 21. Current term is 22.
I20260709 13:06:01.969748 12438 catalog_manager.cc:5697] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:01.969913 19423 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.971186 19706 consensus_queue.cc:237] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:01.972396 19423 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:01.954979 19635 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 13:06:01.976140 19738 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:01.977401 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 95221.9us
I20260709 13:06:01.977748 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:01.978310 12690 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:01.980180 13200 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:01.981778 19585 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:01.984005 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:01.984581 12543 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:01.912281 19171 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:01.976199 12547 raft_consensus.cc:1240] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:01.992928 12690 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:06:01.971221 12438 catalog_manager.cc:5697] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 12 to 14, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 14 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:01.995507 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 103749us
I20260709 13:06:01.997943 12696 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 22.
I20260709 13:06:01.994275 13199 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:01.986406 19632 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:02.010844 13200 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:06:01.998595 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 123007us
I20260709 13:06:01.927500 12538 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
W20260709 13:06:01.998087 19508 consensus_meta.cc:287] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.569s	user 0.004s	sys 0.009s
I20260709 13:06:02.021793 12546 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 22.
I20260709 13:06:02.024225 12438 catalog_manager.cc:5697] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 8 to 17. New cstate: current_term: 17 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:02.023187 12659 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:01.995400 19432 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:01.940886 19207 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:01.943987 19741 consensus_queue.cc:1059] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.070s
I20260709 13:06:01.996614 19738 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:06:02.012645 19712 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:01.993706 19635 consensus_queue.cc:1059] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.031s
I20260709 13:06:02.057072 12544 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:06:02.053004 19585 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.961354 19679 consensus_queue.cc:237] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:02.053190 19479 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader election won for term 26
W20260709 13:06:02.067421 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 138800us
I20260709 13:06:02.068151 12543 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:06:02.056707 19508 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:06:02.076382 12438 catalog_manager.cc:5697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 13 to 14, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 14 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.077906 13197 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:02.085451 13197 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:02.086690 13197 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:02.069097 19743 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:06:02.088024 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 97495.6us
I20260709 13:06:02.088343 19743 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:02.089083 19207 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:02.091573 19171 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:02.092059 19479 raft_consensus.cc:697] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:02.083084 12438 catalog_manager.cc:5697] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 7 to 15. New cstate: current_term: 15 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:02.095890 12659 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:02.079995 19712 raft_consensus.cc:697] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:02.110845 19502 raft_consensus.cc:3055] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:02.111352 19502 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:02.067752 19585 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:02.114007 19585 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:02.096225 19423 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:06:02.114815 12512 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.195:34641 timed out after 1.790s (SENT) [suppressed 19 similar messages]
I20260709 13:06:02.115007 19423 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.115641 19423 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:02.118284 12588 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:02.126861 13199 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:06:02.151093 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 45752us
I20260709 13:06:02.092936 19380 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:06:02.156636 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 72340.6us
I20260709 13:06:02.154628 12438 catalog_manager.cc:5697] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:06:02.165393 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 47227.5us
I20260709 13:06:02.166249 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:02.103906 19744 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:02.162086 12438 catalog_manager.cc:5697] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 7 to 17. New cstate: current_term: 17 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:02.174307 13200 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:02.167081 19284 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:02.176199 19712 consensus_queue.cc:237] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:02.167064 19753 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:02.177695 19741 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:06:02.178553 19739 consensus_queue.cc:1059] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:02.179556 12659 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:02.180272 19737 raft_consensus.cc:3055] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:02.180682 19737 raft_consensus.cc:740] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:02.181007 12659 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:02.182264 19171 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:02.182732 19743 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:02.182996 19171 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:02.177795 19753 raft_consensus.cc:697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 21 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:02.183893 19482 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:02.176010 19479 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:02.184577 19482 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:02.185982 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:02.186138 19632 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:02.186978 19482 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:02.182508 12659 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:02.188331 19632 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:02.188977 19171 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:02.184597 19753 consensus_queue.cc:237] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:02.190222 12662 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:06:02.192378 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.193244 12662 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:02.176331 19284 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:02.175450 12438 catalog_manager.cc:5697] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.179685 19739 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:02.150120 19758 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:02.161337 19551 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:02.196616 12588 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:02.212172 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:02.217062 19755 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:02.217618 19755 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:02.218344 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 45718.5us
I20260709 13:06:02.193735 19576 consensus_queue.cc:1059] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:06:02.224152 12545 raft_consensus.cc:1275] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:06:02.207525 19508 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:02.228083 12545 raft_consensus.cc:1275] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:06:02.259173 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 84748.9us
I20260709 13:06:02.217954 19755 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:02.272608 13197 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:02.259402 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:02.248023 12662 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:02.274626 12689 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:02.246115 12513 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:02.277359 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:02.278168 12545 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:06:02.227272 19551 raft_consensus.cc:697] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:02.280102 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:02.280794 12543 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:02.282922 19744 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:02.284298 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:02.285171 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:02.250226 19576 raft_consensus.cc:3055] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:02.285815 13228 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:02.285967 19576 raft_consensus.cc:740] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:02.286870 19576 consensus_queue.cc:260] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:02.288226 19576 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:02.289116 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:02.224507 19746 raft_consensus.cc:2764] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260709 13:06:02.292311 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:02.292600 19508 raft_consensus.cc:697] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 20 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:06:02.292915 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 66847.1us
I20260709 13:06:02.293694 19508 consensus_queue.cc:237] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:02.294616 12694 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:02.295235 19207 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:02.252534 19758 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.295818 19207 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:02.296448 19758 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:02.297477 12512 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:02.297933 19207 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:02.298405 19482 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:02.298804 19758 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:02.301550 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:02.302729 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:02.305015 12543 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:06:02.306861 13228 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:06:02.302204 12688 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
W20260709 13:06:02.311414 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 65436.2us
I20260709 13:06:02.314842 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:02.315481 12690 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 21.
I20260709 13:06:02.315608 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:02.311280 12587 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:02.234920 19747 log.cc:927] Time spent T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.171s	user 0.004s	sys 0.000s
I20260709 13:06:02.321704 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:02.310068 12438 catalog_manager.cc:5697] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 9 to 20, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 20 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.328979 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:02.324076 12659 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:02.331487 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:02.238184 19432 raft_consensus.cc:3055] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:02.330966 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:02.330806 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:02.332405 12696 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:02.336455 12546 raft_consensus.cc:2410] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:06:02.333038 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:02.337248 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:02.249401 19674 raft_consensus.cc:3055] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:02.331487 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:02.246919 19629 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:02.360582 12622 raft_consensus.cc:2410] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:06:02.360492 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:02.359500 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:02.359578 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:02.361634 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:02.359891 12692 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:06:02.362139 12538 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:06:02.343788 12545 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:06:02.366595 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:02.366997 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:02.367725 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:02.368484 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:02.370754 12438 catalog_manager.cc:5697] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 9 to 16. New cstate: current_term: 16 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:02.225071 19632 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:02.377810 12540 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:06:02.378108 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:02.380251 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:02.385804 12688 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 21: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:02.385846 12543 raft_consensus.cc:2410] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 21 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:06:02.389966 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:02.390766 13227 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:02.334976 19214 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:02.397173 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:02.400254 13228 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:06:02.401124 12541 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:06:02.401831 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:02.359889 19760 consensus_queue.cc:1059] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.081s
I20260709 13:06:02.402840 19760 consensus_queue.cc:1059] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:02.336448 19432 raft_consensus.cc:740] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:02.336936 19741 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:02.398530 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:02.393471 12438 catalog_manager.cc:5697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 10 to 19, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 19 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:02.366860 19674 raft_consensus.cc:740] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:02.220139 19739 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:02.234419 19423 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:02.321898 19630 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 13:06:02.359570 19754 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:02.378829 19482 raft_consensus.cc:697] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 20 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:02.336498 19715 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.068s
I20260709 13:06:02.411314 12438 catalog_manager.cc:5697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 8 to 17. New cstate: current_term: 17 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:02.280776 19551 consensus_queue.cc:237] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:02.254276 19737 consensus_queue.cc:260] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:02.398708 19751 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:02.399031 19214 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.408010 19738 raft_consensus.cc:3055] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:02.408165 19741 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.440685 13229 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
W20260709 13:06:02.423269 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 124223us
I20260709 13:06:02.375394 19207 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:06:02.421880 19769 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:02.435146 19214 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:06:02.457784 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 76650.5us
I20260709 13:06:02.437197 19738 raft_consensus.cc:740] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:06:02.458022 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 58648.8us
I20260709 13:06:02.457981 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:02.437407 19741 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:02.459601 13227 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 23.
W20260709 13:06:02.453734 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 121939us
I20260709 13:06:02.460708 19284 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:02.435858 19482 consensus_queue.cc:237] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:02.449966 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 129349us
I20260709 13:06:02.486210 12512 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:02.467891 19423 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:02.468497 13230 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:06:02.456753 19769 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:02.473794 19432 consensus_queue.cc:260] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:02.445896 19751 raft_consensus.cc:697] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:02.480211 19739 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:02.480620 19502 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:02.481493 19737 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:02.481050 19738 consensus_queue.cc:260] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:02.423055 19632 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:02.490672 12662 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:02.495936 12687 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:02.497080 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:02.553104 12693 raft_consensus.cc:2393] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 21: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:02.526479 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:02.490228 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:02.529779 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:02.554257 12616 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:02.530588 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:02.477746 19749 raft_consensus.cc:3055] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:06:02.538653 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 175006us
W20260709 13:06:02.556668 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 66029.6us
I20260709 13:06:02.550916 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:02.527851 19585 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:02.616887 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:02.560741 12622 raft_consensus.cc:2393] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 12: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:02.528321 19769 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:02.532302 19547 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.628327 13228 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 20. Current term is 21. Ops: []
W20260709 13:06:02.628692 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.617763 19629 raft_consensus.cc:697] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:02.639971 12662 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:02.619760 19432 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:02.643651 12615 raft_consensus.cc:2368] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 21. Current term is 22.
I20260709 13:06:02.646245 12613 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:06:02.646136 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:02.560819 19749 raft_consensus.cc:740] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:06:02.648844 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 101897us
I20260709 13:06:02.649477 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:02.623198 13232 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:02.653510 12662 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:02.621250 19773 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:02.637456 19738 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:02.659911 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:02.657969 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:02.669893 19751 consensus_queue.cc:237] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:02.672587 12613 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:06:02.672290 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 212661us
I20260709 13:06:02.657521 19171 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:02.660892 19502 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:02.672145 19207 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:02.721679 19753 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:02.739724 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:02.734320 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:02.660771 19547 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:02.740463 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:02.742316 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:02.750043 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:02.750958 12618 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 22: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:02.669147 19749 consensus_queue.cc:260] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:02.768916 12622 raft_consensus.cc:2393] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 12: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:02.739621 19171 raft_consensus.cc:697] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 21 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:02.743541 19744 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:02.764648 19748 log.cc:927] Time spent T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.662s	user 0.000s	sys 0.004s
I20260709 13:06:02.782608 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:02.792034 12620 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
I20260709 13:06:02.730322 19755 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:02.797979 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.781327 19753 raft_consensus.cc:697] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 23 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:02.807101 19744 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:02.815114 19547 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:02.816107 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:02.818219 19171 consensus_queue.cc:237] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:02.780933 19207 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.821003 19674 consensus_queue.cc:260] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:02.824314 19749 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:02.860492 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:02.831144 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 194170us
I20260709 13:06:02.863638 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:02.870340 12614 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:06:02.772046 19629 consensus_queue.cc:237] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:02.886821 12689 consensus_meta.cc:287] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.570s	user 0.006s	sys 0.005s
W20260709 13:06:02.887265 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 153093us
I20260709 13:06:02.888223 12512 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:02.887267 12689 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:06:02.896210 19753 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:02.898142 19776 log.cc:927] Time spent T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:06:02.900514 19789 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:02.900952 19780 log.cc:927] Time spent T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:06:02.901285 19789 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:02.904031 19789 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:02.910233 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1629) took 1243 ms. Trace:
I20260709 13:06:02.910732 13231 rpcz_store.cc:276] 0709 13:06:01.666663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.666818 (+   155us) service_pool.cc:224] Handling call
0709 13:06:01.667135 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:01.690720 (+ 23585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:01.690753 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:01.709657 (+ 18904us) log.cc:844] Serialized 26 byte log entry
0709 13:06:01.995542 (+285885us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:01.995585 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:01.995650 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:02.630400 (+634750us) spinlock_profiling.cc:243] Waited 4.55 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:06:02.909895 (+279495us) raft_consensus.cc:1685] finished
0709 13:06:02.909917 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:02.910142 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9315,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":9534,"spinlock_wait_cycles":10465024,"thread_start_us":247473,"threads_started":1,"wal-append.queue_time_us":331627}
I20260709 13:06:02.879031 19674 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:02.932793 12616 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:06:02.953949 19755 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:02.916630 19632 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:02.960482 12512 leader_election.cc:400] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21.
I20260709 13:06:02.960958 12512 leader_election.cc:403] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:02.959887 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:02.962548 12617 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 19: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:02.910277 19794 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:02.961290 13197 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:02.968879 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:02.969157 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.894572 19207 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:02.951512 19746 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:02.933947 19800 raft_consensus.cc:2764] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
I20260709 13:06:02.977756 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:02.981786 12693 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:06:02.982079 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:02.982844 12616 raft_consensus.cc:2368] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
W20260709 13:06:02.978955 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 230622us
I20260709 13:06:02.975813 12587 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:02.985138 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:02.986173 19744 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:02.986418 19786 log.cc:927] Time spent T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:06:02.986853 19214 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:02.988175 19799 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:06:02.988942 19214 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:02.967707 19632 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:02.985155 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:02.991844 19632 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:02.993269 12688 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 26. Current term is 27. Ops: []
I20260709 13:06:02.994242 19632 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:02.989636 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.989989 19758 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:02.997432 12617 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:02.974349 19787 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:02.973584 19743 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.005769 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:02.974978 19751 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.950018 19741 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:02.984066 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:03.010435 12620 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:02.986856 19207 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:03.015703 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:03.017620 12691 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
W20260709 13:06:03.017887 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 65436.8us
I20260709 13:06:03.016275 19787 raft_consensus.cc:697] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:03.018811 12512 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:02.981366 19794 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:03.019131 19787 consensus_queue.cc:237] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.020380 12512 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:03.020978 19794 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:03.004304 19746 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.006568 19769 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.013742 19784 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21.
I20260709 13:06:03.016517 19214 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:03.021539 19794 raft_consensus.cc:2764] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:06:03.021853 19207 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:03.021625 19743 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.030498 19207 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.030953 19207 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:03.032297 19743 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:03.021917 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:03.035126 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:03.035749 12615 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:06:03.025014 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:03.024621 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:03.028558 19751 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:03.028563 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:03.028635 19214 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.040555 19214 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:03.040704 19751 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:03.013698 19758 raft_consensus.cc:697] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:03.041666 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:03.042330 19758 consensus_queue.cc:237] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:03.042735 13197 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:03.027109 12613 raft_consensus.cc:1240] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:03.028743 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:03.028697 19631 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 13:06:03.026507 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:03.047744 12615 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:06:03.050472 12588 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:03.035153 12622 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:06:03.053996 19771 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:03.054558 19771 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.054948 19771 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:03.055091 19679 consensus_queue.cc:1059] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:06:03.026013 19769 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:03.056802 19679 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:03.042344 12621 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:06:03.057845 19777 raft_consensus.cc:3055] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:03.058301 19777 raft_consensus.cc:740] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:03.058912 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:03.059190 19777 consensus_queue.cc:260] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.059847 12618 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:06:03.061489 12620 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:06:03.060905 19777 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:03.062031 12588 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:03.062894 19789 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:03.063280 12588 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:03.063344 12659 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:03.064234 19789 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:03.067664 19576 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:03.068121 19576 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.068521 19576 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:03.070848 13226 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 12.
I20260709 13:06:03.072146 12513 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:03.072260 19741 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:03.073160 19482 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:03.073753 19482 raft_consensus.cc:697] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:03.074610 19482 consensus_queue.cc:237] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.074916 19773 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:06:03.076259 19791 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.233s	user 0.000s	sys 0.002s
W20260709 13:06:03.083181 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 61684.3us
I20260709 13:06:03.088937 12621 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:03.090174 13199 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:03.094225 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:03.095227 12616 raft_consensus.cc:2393] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:03.095276 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:03.090564 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 75104.9us
I20260709 13:06:03.096571 12662 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:03.096585 12659 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:03.105760 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:03.106581 12694 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:03.108047 19771 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.109750 19634 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:03.110246 12689 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:06:03.092943 19760 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:03.096179 12693 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:06:03.108105 19207 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:03.111867 19554 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:03.112310 19554 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.112680 19554 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:03.113622 19207 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:03.113902 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:03.116080 19746 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:03.125517 12687 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 17: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:03.131541 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:03.105201 19214 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.130460 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:03.145740 19423 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:06:03.147547 19795 consensus_queue.cc:1048] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:06:03.148492 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:03.149047 12616 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:06:03.150137 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 59536.2us
I20260709 13:06:03.151963 19803 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:03.129614 19773 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:03.129783 19743 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.159691 12694 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:06:03.164844 12616 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 22.
I20260709 13:06:03.166268 13197 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:03.166946 12588 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:03.163825 12512 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:03.143280 19508 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:03.175271 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:03.177232 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:03.178156 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:03.178810 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:03.155579 19744 raft_consensus.cc:3055] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:06:03.179823 12690 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:03.131304 19746 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:06:03.172567 12587 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:03.195513 12689 raft_consensus.cc:1240] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:06:03.197300 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:03.194918 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:03.192885 19787 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:03.193215 19760 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:03.194554 19632 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:03.187391 19744 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:03.229069 19788 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:03.194459 19773 raft_consensus.cc:697] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 23 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:03.206121 19771 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:03.245885 19508 raft_consensus.cc:697] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 21 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:03.247349 12588 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:06:03.248351 19807 log.cc:927] Time spent T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:06:03.248437 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:03.307201 12538 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:06:03.249239 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:03.278658 19758 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.251384 12539 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:06:03.252947 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:03.197404 19794 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:03.257513 12690 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 22.
I20260709 13:06:03.269312 12512 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:03.293708 19787 raft_consensus.cc:697] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:03.168521 19743 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:03.275414 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 77916.6us
I20260709 13:06:03.277197 12687 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
W20260709 13:06:03.299595 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 292786us
I20260709 13:06:03.302433 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:03.278543 19741 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:03.310153 12689 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:03.344200 12542 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:06:03.250849 12544 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:06:03.312462 12688 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:06:03.309437 12545 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:06:03.348376 12616 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:06:03.287459 19769 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.272841 19784 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:03.192902 12662 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:03.361644 12538 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:06:03.313928 19760 raft_consensus.cc:697] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:03.337284 19632 raft_consensus.cc:697] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:06:03.370033 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 177212us
W20260709 13:06:03.371897 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 124620us
I20260709 13:06:03.401827 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:03.428994 12689 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 22.
W20260709 13:06:03.440385 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 171197us
I20260709 13:06:03.440590 12616 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:06:03.363130 19754 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 13:06:03.444067 12588 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:03.441900 12512 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:03.369272 19795 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.369462 19547 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:03.353521 19758 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:03.433457 19738 consensus_meta.cc:287] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.767s	user 0.012s	sys 0.000s
I20260709 13:06:03.400657 19753 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:03.363631 19769 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:03.519126 19788 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:03.438577 19576 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:03.520581 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.493496 19787 consensus_queue.cc:237] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.497274 19760 consensus_queue.cc:237] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.447074 19214 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:03.496308 19806 log.cc:927] Time spent T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:06:03.447058 19799 consensus_queue.cc:1059] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:06:03.371012 19794 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:03.367897 19380 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
I20260709 13:06:03.521432 19423 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.371248 19784 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:03.401453 19744 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:03.550232 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:03.449994 19773 consensus_queue.cc:237] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.432425 19797 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:06:03.506002 19812 log.cc:927] Time spent T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.071s	user 0.000s	sys 0.002s
I20260709 13:06:03.441998 19482 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.447657 19771 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 13:06:03.447441 19508 consensus_queue.cc:237] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:03.403167 19746 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:03.527141 19706 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.551509 19674 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:03.530740 12512 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:03.561381 19795 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:03.561218 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 117261us
I20260709 13:06:03.635453 12588 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:03.570194 19802 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:03.573838 19547 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:03.552054 19554 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.638813 12588 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:03.410409 19741 raft_consensus.cc:697] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:06:03.589736 19818 log.cc:927] Time spent T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:06:03.639710 12614 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:06:03.644691 12622 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:06:03.602332 19799 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.656229 13229 raft_consensus.cc:2368] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 17. Current term is 18.
I20260709 13:06:03.607708 19482 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.641805 19743 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:03.651435 19795 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:03.653640 19674 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.639945 19746 raft_consensus.cc:697] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:03.654340 19819 consensus_queue.cc:1059] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:03.637257 19171 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:03.654891 19758 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:03.654847 12620 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:06:03.637475 19706 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.657313 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:03.590916 19632 consensus_queue.cc:237] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.652621 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:03.689458 12621 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:06:03.639576 19284 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:03.637475 19797 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.643503 19479 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:06:03.669934 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 63194us
I20260709 13:06:03.710744 12510 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:03.672457 13231 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:06:03.712643 12510 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:03.655715 19784 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:03.678534 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 276734us
I20260709 13:06:03.721608 12662 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:03.686507 12614 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:06:03.590400 19423 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:03.691009 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 243072us
I20260709 13:06:03.659564 19770 raft_consensus.cc:3055] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:03.668354 19788 raft_consensus.cc:697] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 22 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:03.707665 19674 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:03.708143 19482 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:03.708595 19746 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 18.17, Last appended by leader: 17, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.709183 19547 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:03.709501 19576 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:03.676707 19795 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:03.662569 19799 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:03.731356 13197 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:03.733143 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:03.710903 19819 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:03.735002 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:03.755769 19794 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:03.710004 19502 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.755906 19819 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:03.756582 19819 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:03.756443 19502 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.756690 19826 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:06:03.756108 12622 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:03.756599 19784 raft_consensus.cc:3055] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:03.758302 19784 raft_consensus.cc:740] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:03.759073 19744 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:03.759132 19784 consensus_queue.cc:260] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:03.737583 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 154981us
W20260709 13:06:03.762092 19817 log.cc:927] Time spent T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
W20260709 13:06:03.724431 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 85708.6us
I20260709 13:06:03.725003 19479 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.764665 19479 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:03.728590 19753 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 13:06:03.751243 19706 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:03.765458 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:03.727473 19770 raft_consensus.cc:740] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:03.770121 19770 consensus_queue.cc:260] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:03.753799 19815 log.cc:927] Time spent T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1: Append to log took a long time: real 0.234s	user 0.000s	sys 0.003s
W20260709 13:06:03.751881 19823 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:06:03.776444 12614 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:06:03.727842 19822 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:03.778329 12622 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:03.781909 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:06:03.797874 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 66633.9us
I20260709 13:06:03.798290 12613 raft_consensus.cc:2393] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 12: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:03.786599 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:03.799360 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 86793.8us
I20260709 13:06:03.787446 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:03.788102 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:03.800382 12545 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:03.800391 12510 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:03.789122 12544 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:06:03.789734 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:03.790382 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:03.790693 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:03.791040 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:03.791790 19830 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:03.792059 19794 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:03.732730 19828 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.775364 19795 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:03.797927 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:03.782187 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:03.820737 12619 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:06:03.810238 12622 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:03.821110 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:03.756040 19799 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:03.821848 12544 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:06:03.776429 19547 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:06:03.834650 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 119824us
I20260709 13:06:03.837212 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:03.838315 13200 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:03.803869 19830 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.807956 19423 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:03.818298 19770 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:03.844105 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:03.791138 19819 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:03.857069 12545 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:06:03.847324 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:03.807729 19479 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:03.821346 19803 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:03.847214 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:03.862609 13227 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 12.
I20260709 13:06:03.772535 19741 consensus_queue.cc:237] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:03.828444 19380 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
W20260709 13:06:03.866542 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 66225us
I20260709 13:06:03.868861 12510 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:03.845952 19830 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:03.865499 19479 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.871641 19743 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:03.872690 19479 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:03.874327 19833 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:03.874886 12619 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 22.
I20260709 13:06:03.874995 19825 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:03.877753 19479 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:03.878964 19479 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.823268 19828 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.889518 19828 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:03.859254 19423 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:03.890524 19423 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:03.890949 19423 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:03.895668 19831 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:03.896445 19831 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:03.906698 12510 leader_election.cc:400] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:06:03.907219 12510 leader_election.cc:403] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:03.909152 12510 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:03.874895 19833 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:03.957068 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 95107.8us
I20260709 13:06:03.912568 19547 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:03.858753 19788 consensus_queue.cc:237] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:03.975461 12588 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:03.935139 12510 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:03.962674 13200 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:03.980046 19547 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:03.980542 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 46014us
I20260709 13:06:03.981949 12510 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:03.982728 19547 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:03.983947 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:03.984745 13227 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 23.
I20260709 13:06:03.985352 12510 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:03.986186 19547 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:03.986438 12588 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:03.987602 19835 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:03.991364 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:03.990536 13200 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:03.988147 19835 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.912699 19836 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:03.993196 13200 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:03.954636 19833 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:03.998644 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:03.998845 12613 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260709 13:06:03.969620 19824 log.cc:927] Time spent T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:06:03.999522 12542 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 19: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:03.999855 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:03.987908 19547 consensus_queue.cc:1059] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:04.003479 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:04.010779 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:03.963152 19829 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:03.966406 19825 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:03.963323 19837 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:06:03.963583 19819 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:04.014643 12620 raft_consensus.cc:2393] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 21: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:03.988567 19795 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:03.971554 19769 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:03.964694 19831 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:03.995550 19502 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:03.994949 19380 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:04.012692 19828 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:04.001861 19787 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:04.023931 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:04.024009 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:04.022527 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:04.001979 19835 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:04.026464 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:04.035883 12545 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:06:04.027577 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:04.036190 12544 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:06:04.029711 12539 raft_consensus.cc:2368] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 17. Current term is 18.
I20260709 13:06:04.051206 12542 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22.
I20260709 13:06:04.061786 19828 raft_consensus.cc:697] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:04.063261 19828 consensus_queue.cc:237] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.064976 19835 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.026296 19380 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.070456 19380 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:04.075230 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:04.076013 13227 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:04.076225 19784 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:04.080652 12588 leader_election.cc:400] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 17. Current term is 18.
I20260709 13:06:04.081115 12588 leader_election.cc:403] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:04.081883 19749 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 17. Current term is 18.
I20260709 13:06:04.084901 13227 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 24.
W20260709 13:06:04.062167 19841 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:06:04.086410 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:06:04.092737 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.086707 12588 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:04.098235 13226 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:04.022993 19836 raft_consensus.cc:3055] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:04.102317 13229 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:06:04.023186 19795 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.022775 19845 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:04.120756 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:04.085714 19835 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:04.096758 19679 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.125794 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:04.134150 12544 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:06:04.101979 19749 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:04.136562 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:04.137643 12544 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:04.122414 19795 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:04.140754 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:04.139926 13226 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
W20260709 13:06:04.141330 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 144103us
I20260709 13:06:04.110888 19836 raft_consensus.cc:740] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:04.144176 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:04.145283 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:04.145533 13232 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:04.145977 12543 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 24.
I20260709 13:06:04.146862 13227 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:06:04.124639 19744 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:04.026613 19829 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.169948 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:04.207472 12692 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 21 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:04.155439 19634 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.206683 12541 raft_consensus.cc:2410] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:06:04.161342 19769 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.136631 19679 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:04.148773 19749 raft_consensus.cc:697] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 24 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:04.125906 19845 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.178041 19773 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:04.174095 19744 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.205238 19680 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.022s
I20260709 13:06:04.175352 19777 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:06:04.178223 19755 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.051s
I20260709 13:06:04.241649 12539 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:06:04.242149 19857 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:04.217705 19634 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.239089 19773 raft_consensus.cc:697] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:04.250475 13232 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:04.226575 19828 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.231304 19849 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.263284 19857 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.283998 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:04.228662 19769 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:04.270561 19848 log.cc:927] Time spent T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:06:04.271492 19634 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:04.329857 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:04.330556 12544 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:04.330969 19769 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:04.330112 19773 consensus_queue.cc:237] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.279621 19680 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.269500 19554 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:04.272285 19820 raft_consensus.cc:3055] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:04.335635 19863 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.336279 19863 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.220961 19836 consensus_queue.cc:260] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:04.271862 19380 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.319149 19502 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.285729 19749 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.356617 12543 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:06:04.282162 19828 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.346068 19820 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:04.282763 19849 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.347554 19680 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.358382 19836 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:04.371143 19820 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.364614 13231 raft_consensus.cc:2368] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17.
I20260709 13:06:04.372864 19845 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:04.379664 12544 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 27.
I20260709 13:06:04.370429 19744 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:04.381366 19863 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:04.397763 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:04.398618 12543 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 22.
I20260709 13:06:04.407622 19829 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:04.407744 19760 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.408696 19760 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:04.410218 19860 log.cc:927] Time spent T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:04.410732 19857 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:04.411690 19760 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:04.361193 19502 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.417878 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:04.421147 19679 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:04.426220 12543 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:06:04.404505 19820 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:06:04.422310 19423 consensus_meta.cc:287] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.531s	user 0.013s	sys 0.000s
I20260709 13:06:04.424113 19502 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:04.419945 19830 consensus_meta.cc:287] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.513s	user 0.002s	sys 0.009s
I20260709 13:06:04.421250 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:04.429438 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:04.443883 13227 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 23.
I20260709 13:06:04.415647 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:06:04.416627 19850 log.cc:927] Time spent T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:06:04.434664 19479 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:04.436014 19849 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:04.442739 13232 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22.
I20260709 13:06:04.457587 12547 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:06:04.461931 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:04.462714 12545 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:04.467676 12544 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:06:04.466717 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:04.469728 12547 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:04.427518 19795 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.471355 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:04.472100 12542 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:04.442039 19423 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.477378 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:04.478920 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:04.479291 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:04.479792 12618 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:06:04.481189 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:04.476711 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:04.482213 12616 raft_consensus.cc:2393] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:04.455775 19830 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.487584 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:04.487953 12545 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:06:04.488255 12620 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:04.488375 12588 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:04.488858 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:04.489630 12545 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22.
I20260709 13:06:04.489439 19479 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.471405 19828 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:04.489941 19868 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:04.499706 19868 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.474823 19680 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:04.505812 12538 raft_consensus.cc:2393] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 17: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:04.493901 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:04.490823 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:04.506893 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:04.512087 12588 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:04.514412 12588 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:04.514537 12547 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:04.515126 12542 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:04.493018 19674 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:06:04.494634 19479 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.491338 19679 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:04.552306 12588 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:04.515511 12510 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:04.523097 12539 raft_consensus.cc:2410] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:06:04.503705 19746 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:04.529049 19868 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:04.647401 19479 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:04.503793 19502 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:04.642855 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:04.643759 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:04.504221 19380 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:04.600684 19741 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:04.517061 19795 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:04.551105 19801 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Leader election won for term 27
W20260709 13:06:04.527937 19833 consensus_meta.cc:287] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.512s	user 0.005s	sys 0.005s
I20260709 13:06:04.503894 19822 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.149s
I20260709 13:06:04.653539 19482 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:04.657992 19820 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:04.663981 19820 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.664767 12547 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:06:04.576743 19760 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:04.515921 19632 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:04.520890 19423 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:04.662739 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:04.522805 19830 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:04.672379 12542 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
W20260709 13:06:04.687181 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 198343us
I20260709 13:06:04.688242 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:04.522974 19680 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.143s
I20260709 13:06:04.518685 19508 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.151s
W20260709 13:06:04.717355 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 165155us
I20260709 13:06:04.686296 19760 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:04.719717 12588 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:06:04.723184 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 66303us
I20260709 13:06:04.717098 19835 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:04.729503 19835 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:04.730057 19835 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:04.674154 19777 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.689821 19634 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.649546 19679 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.661813 19741 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:04.715747 19482 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:04.675024 19752 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:04.720934 19760 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:04.762836 19873 log.cc:927] Time spent T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:06:04.734068 19674 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:04.764281 19674 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:04.766579 19674 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:04.733263 19423 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:06:04.774811 12659 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:04.775650 19508 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:06:04.777997 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.736146 12588 leader_election.cc:400] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 17. Current term is 18.
I20260709 13:06:04.731168 19868 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:04.660986 19502 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:04.790261 19874 log.cc:927] Time spent T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:06:04.790387 19680 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:04.790977 19502 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:04.671962 19833 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.792471 19674 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:04.760304 19482 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:04.798034 19482 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:04.801823 19822 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:04.691818 19380 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:04.787948 19679 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:04.793427 19833 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:04.754379 19634 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.795814 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:04.803457 19868 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:04.822897 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.780633 19880 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:04.806301 19674 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:04.785627 19752 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.782114 19801 raft_consensus.cc:697] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 27 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:04.738155 19777 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:04.785853 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 50404.1us
I20260709 13:06:04.759174 19820 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:04.759464 19479 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:04.834643 19752 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:04.837283 12662 leader_election.cc:400] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17.
I20260709 13:06:04.837756 12662 leader_election.cc:403] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:04.836861 19482 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:04.840907 19820 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:04.844029 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:04.844599 19679 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:06:04.845031 19777 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:04.827193 19880 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:04.845678 19479 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.852596 19880 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:04.820358 19380 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.855953 19380 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:04.856179 19868 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:04.841755 19822 raft_consensus.cc:697] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:04.858204 12544 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:06:04.842935 19820 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:04.842985 19634 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:04.863406 19479 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:04.864812 19877 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 13:06:04.865492 19820 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:04.858343 19822 consensus_queue.cc:237] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:04.844638 12543 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 12.
I20260709 13:06:04.870347 13231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:06:04.871245 13231 raft_consensus.cc:606] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:04.871564 13231 raft_consensus.cc:614] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:04.873968 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:04.875020 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 1647) took 1088 ms. Trace:
I20260709 13:06:04.875468 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:04.876248 12543 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:06:04.877861 19741 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:04.878103 19801 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.879535 19760 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:04.880787 13231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:06:04.881356 13231 raft_consensus.cc:606] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:04.881709 13231 raft_consensus.cc:614] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:04.881816 19746 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:04.884928 12545 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:06:04.885280 12545 pending_rounds.cc:85] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 9
I20260709 13:06:04.878345 19880 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:04.884397 19679 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17.
I20260709 13:06:04.875423 12538 rpcz_store.cc:276] 0709 13:06:03.787083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.787216 (+   133us) service_pool.cc:224] Handling call
0709 13:06:04.874832 (+1087616us) spinlock_profiling.cc:243] Waited 705 ms on lock 0x7b54003a9154. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:04.874964 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1622053120}
I20260709 13:06:04.885496 12545 pending_rounds.cc:107] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260709 13:06:04.890311 12545 raft_consensus.cc:2889] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:04.891320 19777 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.889384 19760 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:04.919752 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:04.920879 12693 raft_consensus.cc:2410] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 24 because replica has last-logged OpId of term: 23 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 17.
I20260709 13:06:04.923628 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:04.924809 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:04.918447 19885 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.938896 19679 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:04.940912 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:04.923053 19171 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:04.942337 19502 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:04.911365 19777 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.942077 19879 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.947713 12691 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22.
W20260709 13:06:04.949986 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 174002us
W20260709 13:06:04.952255 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 120859us
I20260709 13:06:04.953274 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:04.959293 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:04.960098 12696 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:04.961463 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:04.962358 12622 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:06:04.939582 19632 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:04.946920 19482 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:04.982956 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:04.971779 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:04.984428 12619 raft_consensus.cc:2410] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 23 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:06:04.973246 12621 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:06:04.977988 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:04.978494 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:04.978969 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:04.979439 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:04.988652 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:04.989041 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:04.989912 12616 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:04.980791 12620 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:06:04.981788 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:04.983837 12691 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:06:04.993244 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:04.993342 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:04.956342 19171 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.950623 19885 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:04.994562 12588 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:04.996076 19171 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:04.996202 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:04.996965 19885 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:04.999200 19882 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:04.999819 19882 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.000260 19882 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:05.000763 12620 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 13:06:05.001464 19706 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:05.002210 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:05.002988 12620 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:05.004421 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:05.005196 19674 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:05.007437 12510 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:05.007802 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:05.008801 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:04.986822 19632 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:05.009783 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:05.039945 12613 raft_consensus.cc:2368] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13.
I20260709 13:06:05.040280 13231 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:05.011799 13232 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:05.013055 19777 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:04.963279 19884 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.002254 19880 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:05.014526 19889 log.cc:927] Time spent T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:06:04.958384 19502 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:05.019454 13197 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:05.019971 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:05.020529 12694 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:06:05.021333 19887 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:05.053397 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:04.951726 19679 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:05.025264 19432 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:05.026124 12588 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:05.057410 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:05.058087 12688 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 22.
I20260709 13:06:05.031054 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:05.021441 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:05.005148 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:05.032960 12512 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:05.034760 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:05.040010 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:05.042017 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:05.041939 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:05.063194 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:05.042889 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:05.043417 12538 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:05.044607 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:05.044303 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:05.064520 12512 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:04.963219 19879 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:05.029953 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:05.058182 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:05.072898 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:05.063398 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:05.075661 12620 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:05.065320 12543 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:06:05.055189 12542 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:06:05.067518 12615 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 22: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:05.067853 12696 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:06:05.069130 12547 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:06:05.069520 13227 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:06:05.076465 12619 raft_consensus.cc:2393] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 19: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:05.080204 12616 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:06:05.063987 12541 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:06:05.090267 12614 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:06:05.090970 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:05.096508 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:05.108335 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:05.111515 12691 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:06:05.112941 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:05.114267 12620 raft_consensus.cc:2393] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 19: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:05.052191 19482 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:05.091272 19554 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:05.120078 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:05.120824 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:05.116108 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:05.116194 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:05.107501 19777 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.128062 12617 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:05.069589 19802 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:05.128746 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:05.116299 13232 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 18 index: 17. Preceding OpId from leader: term: 19 index: 18. (index mismatch)
I20260709 13:06:05.120779 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:05.137658 13231 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:06:05.094767 19794 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:05.114040 19760 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:05.111018 19830 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:05.147650 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:05.142410 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:05.147035 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:05.165908 12691 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 22.
I20260709 13:06:05.112821 19706 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:05.145871 12693 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:06:05.121076 19482 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.120327 19554 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:05.171344 19554 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:05.120023 19801 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:05.154278 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:05.109903 19479 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 13:06:05.180887 13231 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:05.167289 12619 raft_consensus.cc:2393] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:05.167807 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:05.181871 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:05.167677 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:05.174955 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:05.074831 19887 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:05.184849 12617 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:06:05.186411 19887 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:05.147611 12513 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:05.177843 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:05.178308 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.114194 19880 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:06:05.143383 19802 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.117122 19787 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 13:06:05.197474 13232 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:06:05.064399 19884 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:05.194178 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:05.169306 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:05.208724 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:05.212253 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:05.213172 13235 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
I20260709 13:06:05.215986 19879 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:05.216902 12617 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:06:05.223641 19797 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:05.224016 19502 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:05.120383 19878 consensus_queue.cc:1059] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.086s
I20260709 13:06:05.231325 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:05.129634 19835 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:05.232023 12691 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:06:05.233419 12696 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:06:05.195051 19801 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:05.233898 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:05.235308 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:05.236032 19801 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:05.193677 19888 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:05.237965 19888 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:05.240550 19888 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:05.198475 19802 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:06:05.243279 19894 log.cc:927] Time spent T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:06:05.248201 12619 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16. Ops: []
W20260709 13:06:05.251746 19893 log.cc:927] Time spent T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:06:05.175529 19482 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:05.257529 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1646) took 1088 ms. Trace:
I20260709 13:06:05.259399 12613 raft_consensus.cc:2393] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 17: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:06:05.268229 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.128079 19777 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:05.224035 12617 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:05.296069 12614 raft_consensus.cc:1240] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:05.258070 13229 rpcz_store.cc:276] 0709 13:06:04.168986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.175414 (+  6428us) service_pool.cc:224] Handling call
0709 13:06:04.209024 (+ 33610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:04.243210 (+ 34186us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:06:04.385866 (+142656us) log.cc:844] Serialized 14 byte log entry
0709 13:06:04.486737 (+100871us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:04.486784 (+    47us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:04.486832 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.257211 (+770379us) spinlock_profiling.cc:243] Waited 34 ms on lock 0x7b54006801d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:05.257269 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:05.257439 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":188973,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":87,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"spinlock_wait_cycles":78094592,"thread_start_us":213745,"threads_started":2,"wal-append.queue_time_us":227017}
I20260709 13:06:05.284045 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3707) took 1030 ms. Trace:
I20260709 13:06:05.306128 13199 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:05.307926 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 233513us
I20260709 13:06:05.314230 12689 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:06:05.183737 19706 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:05.351727 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:05.351949 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:05.352214 12691 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:06:05.352342 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:05.353837 19634 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:05.354526 19554 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:05.357728 19380 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.362733 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:05.371536 12693 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:06:05.224498 19797 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:05.373013 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:05.305553 12539 rpcz_store.cc:276] 0709 13:06:04.254170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.254671 (+   501us) service_pool.cc:224] Handling call
0709 13:06:05.260988 (+1006317us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b54004100d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:05.283950 (+ 22962us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":547299712}
W20260709 13:06:05.375110 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 90648.5us
I20260709 13:06:05.390686 12659 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:05.401898 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:05.403275 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 66300.7us
I20260709 13:06:05.403823 12510 leader_election.cc:400] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 12 pre-election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13.
I20260709 13:06:05.243316 19884 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:05.374363 12689 raft_consensus.cc:606] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:05.408195 13197 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:05.411671 12659 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:05.406436 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:05.413895 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:05.414677 12694 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:06:05.416489 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:05.413903 13197 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:05.405102 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:05.429301 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:05.404610 12510 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:05.431239 12620 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:05.434827 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:05.435668 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:05.438467 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:05.440299 13227 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:05.443096 12692 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 18. (term mismatch)
I20260709 13:06:05.443425 19679 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:05.288419 19882 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:05.444698 19171 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:05.444882 12587 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:05.445153 19171 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.445511 19171 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:05.447642 19884 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:05.448350 19902 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:05.448909 19902 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.414134 19878 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:05.450024 19878 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:05.417898 19508 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:05.452704 19508 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.453202 19508 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:05.430081 19771 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:05.454221 19771 raft_consensus.cc:697] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:05.455370 19771 consensus_queue.cc:237] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:05.459187 12691 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:05.460425 19634 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:05.462285 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:05.470322 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:05.471371 12588 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:05.471750 19777 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:05.472398 19879 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:05.474015 19879 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:05.474674 19879 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:05.474937 19554 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:05.475155 19879 raft_consensus.cc:697] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 13 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:05.475234 19632 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:05.476141 19879 consensus_queue.cc:237] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:05.480687 12614 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:06:05.443485 12692 pending_rounds.cc:85] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 17
I20260709 13:06:05.481618 12692 pending_rounds.cc:107] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 23.18
I20260709 13:06:05.481913 12692 raft_consensus.cc:2889] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:05.372332 19801 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:05.484916 19797 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:05.449385 19902 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:05.495395 12689 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 18 index: 17. Preceding OpId from leader: term: 19 index: 18. (index mismatch)
W20260709 13:06:05.492995 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 428535us
I20260709 13:06:05.430614 19479 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:05.479570 19482 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:05.498174 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:05.505939 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:05.508395 12696 raft_consensus.cc:2393] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 22: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:05.493180 19801 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:05.519976 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:06:05.520663 13235 raft_consensus.cc:606] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:06:05.521029 13235 raft_consensus.cc:614] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:05.521157 19482 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:05.521873 19482 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:05.523034 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:05.522852 19887 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:06:05.523414 13200 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:05.488312 19284 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:06:05.526120 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:05.526655 19891 consensus_queue.cc:1059] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:05.523304 19502 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.527644 19502 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:05.475277 19749 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.053s
I20260709 13:06:05.528679 19741 raft_consensus.cc:3055] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:05.529048 19834 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:06:05.413478 19380 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:05.505718 19883 consensus_queue.cc:1059] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:06:05.527863 19901 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:05.540889 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:05.541163 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:05.535717 12622 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:06:05.538136 13200 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:05.486464 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 338930us
I20260709 13:06:05.492604 19830 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.543607 13200 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:05.506752 19479 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:05.540999 19888 raft_consensus.cc:3055] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:05.564062 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:05.551998 19634 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:05.552992 19706 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:05.554206 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:05.555294 19171 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:05.580051 12689 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 20: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:05.564327 19479 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:05.581022 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:05.582507 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:05.582248 19171 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:05.571128 19554 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:05.527637 19777 raft_consensus.cc:3055] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:05.583492 19777 raft_consensus.cc:740] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:05.584465 19777 consensus_queue.cc:260] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:05.585772 19777 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:05.558024 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:06:05.529094 19741 raft_consensus.cc:740] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:05.587769 19741 consensus_queue.cc:260] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:05.559654 13232 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:06:05.576691 19746 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:05.577955 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:05.578604 19380 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:05.579080 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:05.561733 19749 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.556267 19502 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:05.556095 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:05.602406 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:05.571233 19901 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.564463 19888 raft_consensus.cc:740] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:05.572628 19797 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:05.590771 19482 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:05.571436 19830 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:05.611094 19380 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:05.618465 19482 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:05.597452 19746 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:05.598745 19749 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:05.613714 12696 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:06:05.624792 19380 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:05.643631 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 285446us
I20260709 13:06:05.616447 19802 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:05.617482 19797 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:05.648487 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:05.615522 19901 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:05.636729 19482 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:05.658447 19760 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.659132 19760 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:05.662272 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:05.619732 19508 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:05.633143 19801 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:05.646778 19380 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:06:05.846027 12546 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.034s	sys 0.028s
W20260709 13:06:05.847702 12546 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.035s	sys 0.028s
W20260709 13:06:05.862618 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.630383 19479 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:05.898859 19746 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:05.899910 19794 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:05.900524 19794 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:05.902706 19901 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:05.904189 19749 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:05.904093 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:05.804780 19888 consensus_queue.cc:260] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:05.907052 19888 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:05.913831 19794 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:05.916749 19830 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:05.847011 19904 consensus_queue.cc:1059] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.278s
I20260709 13:06:05.918625 19904 raft_consensus.cc:3055] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:05.919085 19904 raft_consensus.cc:740] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:05.920215 19904 consensus_queue.cc:260] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:05.925159 19797 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:05.933636 19508 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:05.938629 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:05.929401 19902 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:05.951035 12613 raft_consensus.cc:2393] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:06:05.953833 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.959741 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:05.960685 12613 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:05.964434 19802 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:05.965374 12690 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:06:05.958755 19904 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:05.966850 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:05.899025 19479 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:05.970001 19479 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.970494 19479 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:05.976277 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:05.976377 19902 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:05.977034 12620 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:05.979748 12614 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:05.981081 12614 raft_consensus.cc:1275] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:06:05.982964 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:05.983713 12696 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:05.987428 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:05.988032 13229 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:06:05.992050 19554 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:05.992578 19554 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:05.995580 19882 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:05.996654 19741 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:05.998723 12687 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:06:06.003315 19479 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:06.003969 13197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.027s	sys 0.040s
W20260709 13:06:06.004359 13197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.027s	sys 0.040s
W20260709 13:06:06.004422 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 393843us
I20260709 13:06:06.005199 12512 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:06.006650 12512 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:06:06.005997 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 587849us
I20260709 13:06:06.007891 12512 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:06.007843 13197 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:06.008989 19918 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:06.009387 19918 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.009784 12659 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:06.009972 19918 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:06.016630 12616 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:06.013691 12613 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
W20260709 13:06:06.019258 13231 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.020s	sys 0.007s
W20260709 13:06:06.019708 13231 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.020s	sys 0.007s
I20260709 13:06:06.026712 12512 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:06:06.031340 12510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.025s	sys 0.033s
W20260709 13:06:06.031847 12510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.025s	sys 0.033s
W20260709 13:06:06.032641 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 628048us
W20260709 13:06:06.040635 12693 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.010s	sys 0.040s
W20260709 13:06:06.041280 12693 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.010s	sys 0.040s
I20260709 13:06:06.041764 12510 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:06.043272 12620 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
W20260709 13:06:06.042558 13199 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.008s	sys 0.015s
W20260709 13:06:06.047226 13199 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.008s	sys 0.015s
W20260709 13:06:06.048105 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 643044us
W20260709 13:06:06.021140 12619 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.005s	sys 0.023s
W20260709 13:06:06.056046 12619 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.005s	sys 0.023s
W20260709 13:06:06.056421 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 46915.6us
I20260709 13:06:06.063705 13235 raft_consensus.cc:606] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:06.057888 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 46895.3us
I20260709 13:06:06.067485 12510 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:06.069259 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:06.073531 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4115) took 1044 ms. Trace:
W20260709 13:06:06.074838 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.079488 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:06.074208 12619 rpcz_store.cc:276] 0709 13:06:05.029150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.273816 (+244666us) service_pool.cc:224] Handling call
0709 13:06:05.351310 (+ 77494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:05.372344 (+ 21034us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:06:05.372628 (+   284us) log.cc:844] Serialized 14 byte log entry
0709 13:06:06.073068 (+700440us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:06.073150 (+    82us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:06.073211 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.073306 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:06.073458 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6263,"prepare.queue_time_us":96,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"thread_start_us":683619,"threads_started":1,"wal-append.queue_time_us":625112}
I20260709 13:06:06.042999 19680 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:06.042932 19917 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:06.101423 12696 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:06:06.063098 19830 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:06.055554 19482 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:06.079576 19794 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:06.108700 19794 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:06.106750 12587 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:06.056569 19801 consensus_queue.cc:1059] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:06:06.077628 19904 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:06.063417 19797 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:06:06.112934 19882 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:06.123183 19904 raft_consensus.cc:697] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:06.123461 19882 raft_consensus.cc:697] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:06.124361 19904 consensus_queue.cc:237] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:06.124593 19882 consensus_queue.cc:237] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:06.118340 19797 consensus_queue.cc:1243] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:06:06.126955 19835 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:06.043512 19885 consensus_queue.cc:1059] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 13:06:06.092350 19901 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:06.122721 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:06.104698 19680 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:06.111778 19801 raft_consensus.cc:3055] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:06:06.136185 13200 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.019s	sys 0.011s
W20260709 13:06:06.143487 13200 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.019s	sys 0.011s
W20260709 13:06:06.143949 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 552325us
I20260709 13:06:06.145174 13200 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:06.077808 19760 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:06.149407 12692 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.004s	sys 0.028s
W20260709 13:06:06.149837 12692 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.004s	sys 0.028s
I20260709 13:06:06.149833 12510 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:06.129994 19830 raft_consensus.cc:697] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:06.110750 19891 consensus_queue.cc:1048] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:06:06.139497 19680 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:06.115198 19380 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:06.168828 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:06.173223 12588 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:06.131577 19794 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 13:06:06.147715 19801 raft_consensus.cc:740] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:06:06.183348 12617 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.005s	sys 0.031s
I20260709 13:06:06.156173 19901 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:06:06.190729 12617 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.006s	sys 0.031s
I20260709 13:06:06.171720 19797 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:06.170967 19482 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:06.174959 19917 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:06.194795 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:06.161762 19771 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 13:06:06.198951 12588 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:06.187546 19706 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:06.205492 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:06.206527 12588 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:06.216393 13231 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:06:06.195369 19878 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:06.184756 19741 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:06:06.223450 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:06.229713 13230 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 17. (term mismatch)
I20260709 13:06:06.230229 13230 pending_rounds.cc:85] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Aborting all ops after (but not including) 16
I20260709 13:06:06.230472 13230 pending_rounds.cc:107] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Aborting uncommitted NO_OP operation due to leader change: 26.17
I20260709 13:06:06.230746 13230 raft_consensus.cc:2889] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:06.232077 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:06.233690 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:06.219002 19482 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:06.238664 19482 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:06.210889 19835 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:06.239657 19835 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:06.240067 19835 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:06.245426 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:06.246531 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:06.247224 12622 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 20: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:06.261710 19760 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:06.262570 19921 log.cc:927] Time spent T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:06:06.223981 19795 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:06.202332 19802 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:06:06.202905 19834 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:06:06.208724 19917 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:06.268067 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 202949us
W20260709 13:06:06.276515 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 215144us
I20260709 13:06:06.281714 19794 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:06.286757 13199 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:06.285781 19920 log.cc:927] Time spent T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:06:06.295217 19554 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:06.296267 19777 raft_consensus.cc:3055] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:06.265993 19925 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:06.296816 19777 raft_consensus.cc:740] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:06.297188 19925 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:06.300279 19925 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:06.268165 19801 consensus_queue.cc:260] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:06.301545 19801 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:06.303694 19922 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:06.310185 13231 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
W20260709 13:06:06.365762 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.376577 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.381505 19380 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:06.242623 19830 consensus_queue.cc:237] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:06.297370 19554 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:06.448845 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 404038us
W20260709 13:06:06.450717 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 235773us
I20260709 13:06:06.451140 12659 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:06.452795 12662 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:06.467572 12662 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:06.455128 12659 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:06.305238 19794 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:06.470152 19885 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:06.469352 12662 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:06.456058 19883 consensus_queue.cc:1059] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.035s
I20260709 13:06:06.453686 19680 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:06.489114 19932 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:06.514671 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:06.454872 19777 consensus_queue.cc:260] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:06.499358 19797 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.497407 19925 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:06.516610 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 233488us
W20260709 13:06:06.501147 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 354496us
I20260709 13:06:06.524036 13200 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:06.525823 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:06.528301 12622 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 23: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:06.529282 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:06.529996 12545 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:06:06.530160 13200 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:06.531183 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:06.529284 19797 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:06.532593 13200 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:06.533521 19932 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:06.533631 19554 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:06.534116 19932 raft_consensus.cc:697] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:06.534348 19554 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:06.534673 19797 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:06.535084 19933 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:06.535048 19932 consensus_queue.cc:237] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:06.536033 19933 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.536820 19933 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:06.540393 19554 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:06.541114 13200 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:06.542639 13200 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:06.544246 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:06.541002 19554 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:06.547049 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:06.547641 13231 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:06:06.548596 19554 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:06.548859 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:06.549180 19554 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:06.549628 13231 raft_consensus.cc:2393] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 22: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:06.550737 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:06.551092 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:06.552279 19554 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:06.555015 13233 raft_consensus.cc:1240] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:06.555724 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:06.556773 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:06.557381 12539 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 27.
I20260709 13:06:06.557746 19554 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:06.558109 13230 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:06:06.558771 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:06.559854 13226 raft_consensus.cc:2410] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 20 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 15.
I20260709 13:06:06.562145 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:06.563107 13226 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:06.572887 13226 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 24.
I20260709 13:06:06.525697 19931 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:06.582350 19931 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:06.582928 19931 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:06.577891 19777 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:06.596370 19888 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:06.596987 19634 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:06.518046 19926 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:06.597465 19634 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:06.597916 19634 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:06.597697 19926 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:06.596959 19888 raft_consensus.cc:697] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:06.578606 19940 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:06.558152 19554 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:06.581684 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:06.602128 19917 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:06.602659 12540 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 20: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:06.542284 19925 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:06.602171 19940 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:06.603886 19940 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.604234 19940 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:06.605159 19794 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:06.605814 19888 consensus_queue.cc:237] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:06.601287 19926 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:06.501739 19835 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:06.616199 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2266) took 2589 ms. Trace:
W20260709 13:06:06.619639 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.643538 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 188479us
I20260709 13:06:06.646049 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:06.621523 12546 rpcz_store.cc:276] 0709 13:06:04.027137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.027252 (+   115us) service_pool.cc:224] Handling call
0709 13:06:04.053860 (+ 26608us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:04.054234 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:04.054263 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:04.070811 (+ 16548us) log.cc:844] Serialized 26 byte log entry
0709 13:06:05.256418 (+1185607us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b18003fb140. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:06:05.849149 (+592731us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:06.184274 (+335125us) log.cc:844] Serialized 14 byte log entry
0709 13:06:06.513345 (+329071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:06.513412 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:06.513450 (+    38us) raft_consensus.cc:1685] finished
0709 13:06:06.615909 (+102459us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:06.616123 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":436692,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":25515,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":17983,"spinlock_wait_cycles":5145984,"thread_start_us":1227037,"threads_started":3,"wal-append.queue_time_us":1935403}
I20260709 13:06:06.651583 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:06.652504 13228 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 23: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:06:06.654678 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 185408us
I20260709 13:06:06.658034 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:06.659444 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:06.660108 12538 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
I20260709 13:06:06.662616 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:06:06.662973 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.663579 12538 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 12. (term mismatch)
I20260709 13:06:06.663914 12538 pending_rounds.cc:85] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 11
I20260709 13:06:06.664188 12538 pending_rounds.cc:107] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 13:06:06.663277 12541 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:06:06.664438 12538 raft_consensus.cc:2889] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:06.666819 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.679157 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 393395us
W20260709 13:06:06.680536 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 63281.2us
I20260709 13:06:06.681938 13199 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:06.685809 19917 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:06.686509 19917 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:06.688987 19917 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:06.698866 19917 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:06.699621 19917 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:06.715407 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:06.716524 13233 raft_consensus.cc:2393] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 20: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:06.610934 19634 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:06.722383 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:06.723495 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:06.731189 12547 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:06.667906 19885 raft_consensus.cc:697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 20 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:06.743755 12541 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
W20260709 13:06:06.722918 19918 consensus_meta.cc:287] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.661s	user 0.009s	sys 0.003s
I20260709 13:06:06.758279 12542 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:06.759280 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:06.761857 13230 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 23: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:06.764647 12588 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:06.765425 13228 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:06:06.771399 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 116000us
I20260709 13:06:06.722204 19794 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.797293 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:06.722296 19801 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:06.798229 12547 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:06:06.739993 19830 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.762705 19936 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.761809 19917 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:06.821633 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:06.739389 19891 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.079s
I20260709 13:06:06.799461 19880 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.794797 19802 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:06.855850 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:06.858922 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:06.860162 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:06.807054 19795 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:06.868391 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:06.861395 12693 pending_rounds.cc:85] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 11
I20260709 13:06:06.874498 12693 pending_rounds.cc:107] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:06:06.874768 12693 raft_consensus.cc:2889] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:06.885824 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:06.886194 12538 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 20: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:06:06.887804 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.887384 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 78734.1us
I20260709 13:06:06.889101 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:06.889739 12695 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:06.886197 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:06.892431 12690 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 22.
I20260709 13:06:06.799041 19942 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260709 13:06:06.794111 19918 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:06.806954 19794 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:06.904299 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:06.909750 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:06.904075 19925 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:06.911486 19797 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.911863 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:06.912040 12512 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:06.911962 19797 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:06.913177 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:06.808873 19931 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:06.812702 19801 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:06.898852 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:06.905910 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:06.902720 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:06.925129 12692 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:06.873939 19680 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:06.906674 13200 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:06.823612 19830 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:06.914997 12512 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:06.922534 12510 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:06.927389 13231 raft_consensus.cc:2368] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 22. Current term is 23.
I20260709 13:06:06.882649 19880 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:06.978323 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:06.951102 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 44557.6us
I20260709 13:06:06.972134 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:06.987282 12688 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:06:06.882858 19802 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:06.905064 19955 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:06.993647 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:06:06.993791 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 71358.7us
W20260709 13:06:06.994560 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 81045.7us
W20260709 13:06:07.022769 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.024735 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:07.026139 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 344575us
I20260709 13:06:07.026911 13199 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:07.027674 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:07.025460 12695 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:06:07.023554 12512 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:07.029788 19970 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.932894 19835 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:06.950217 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:06.925405 19925 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:06.887262 19885 consensus_queue.cc:237] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:07.028481 12547 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:06:07.032766 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48978 (request call id 64) took 1469 ms. Trace:
W20260709 13:06:07.034879 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 230388us
I20260709 13:06:07.037182 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:07.034403 13199 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:07.035130 19949 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:07.040723 19634 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:07.041549 19802 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:07.041518 19634 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:07.037927 12547 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21.
I20260709 13:06:07.019862 19934 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:06:07.038882 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:07.069953 12588 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:06.979224 19479 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:06:07.027558 19923 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:06:07.046629 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:07.036712 13235 rpcz_store.cc:276] 0709 13:06:05.557774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.557894 (+   120us) service_pool.cc:224] Handling call
0709 13:06:07.026577 (+1468683us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b5400597254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9573853 00007fc3ae54160a 00007fc3a7ac77d4 00007fc3a7ac7762 00007fc3a7ac7691 00007fc3a7ac760c 00007fc3a7ac68c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:07.026664 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1096542592}
I20260709 13:06:07.018824 19955 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:07.019086 19797 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:07.042289 19952 log.cc:927] Time spent T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:07.026070 19906 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:07.074915 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:07.081192 19955 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:07.103358 12620 raft_consensus.cc:2393] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 19: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:06.950700 19958 consensus_queue.cc:1059] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.143s
I20260709 13:06:07.104300 19906 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:07.104565 19958 raft_consensus.cc:3055] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:07.105165 19958 raft_consensus.cc:740] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:07.036401 19925 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:07.107111 19925 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:06:07.041575 19945 log.cc:927] Time spent T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:06:07.075841 19882 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:07.110767 19882 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:07.111258 19882 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:07.069370 19904 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:07.076637 19634 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:07.069058 19934 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.100221 12588 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:07.114230 19934 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:07.115695 12588 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:07.081286 19479 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.028865 19960 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.104739 19906 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:07.025918 19938 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:06:07.102787 19953 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 13:06:07.046164 19883 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:07.122107 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:07.080570 19802 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:06:07.131924 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:07.166265 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 276609us
I20260709 13:06:07.045248 19944 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:06:07.163383 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 139899us
W20260709 13:06:07.102785 19961 log.cc:927] Time spent T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:06:07.169252 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:07.171411 19959 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:07.185515 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:07.186503 12547 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:06:07.118432 19835 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:07.030550 19970 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:07.195087 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 173849us
I20260709 13:06:07.173414 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:07.199508 12510 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:07.201395 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:07.071980 19949 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:06.919973 19936 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:07.192062 12543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.002s	sys 0.026s
W20260709 13:06:07.209940 12543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.002s	sys 0.026s
I20260709 13:06:07.179410 19801 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:07.176424 19882 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.161223 19965 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:07.182512 19944 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:07.189622 19904 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:07.212559 12620 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:06:07.106236 19958 consensus_queue.cc:260] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.201152 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:07.221360 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:07.223420 12510 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:07.198894 19931 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:07.225049 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 190756us
I20260709 13:06:07.229081 13199 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:07.229207 19972 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:07.208884 19680 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:07.221169 19944 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:07.229852 19966 raft_consensus.cc:2764] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:06:07.233161 19949 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:07.235318 19940 consensus_meta.cc:287] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.630s	user 0.011s	sys 0.000s
I20260709 13:06:07.219589 19904 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:07.238684 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 123054us
I20260709 13:06:07.216324 19835 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:07.242647 12510 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:07.242672 12662 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:07.183765 19883 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.247802 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:07.247685 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:07.246031 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:07.245374 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:07.237733 19882 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:07.244279 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:07.164227 19960 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:07.283248 13199 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:07.239902 19680 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:07.245177 19830 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:07.247040 19972 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:07.282958 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:07.281347 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:06:07.248296 19963 log.cc:927] Time spent T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:06:07.243970 19971 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:07.266924 19904 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:07.285957 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.281658 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:07.251469 19958 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:07.249820 19936 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:07.290043 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:07.218652 19968 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.064s
I20260709 13:06:07.253181 19794 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:07.284433 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:06:07.303083 19909 log.cc:927] Time spent T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 1.248s	user 0.000s	sys 0.018s
I20260709 13:06:07.307721 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:07.313046 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:06:07.319042 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.321025 12688 raft_consensus.cc:2410] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:06:07.222162 19965 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:07.279786 19797 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:07.297242 19882 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
W20260709 13:06:07.330101 19977 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:06:07.266229 19940 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.336598 19801 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:07.291755 19880 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:07.312637 19971 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:07.290752 19680 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:07.445461 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:07.348886 19479 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:07.349223 19933 consensus_meta.cc:287] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.812s	user 0.008s	sys 0.004s
I20260709 13:06:07.340979 19936 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.449986 19933 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.349852 19966 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:07.293066 19959 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:07.451361 19959 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:07.451787 19959 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:07.452507 19933 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:07.310896 19830 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.352263 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:07.453347 19830 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.453900 12544 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:06:07.454432 13227 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:06:07.455008 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:07.455638 19830 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:07.455839 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.375198 19938 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:06:07.390604 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 113613us
I20260709 13:06:07.455655 12544 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:06:07.457383 12662 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:07.458565 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:07.419718 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:07.459915 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:07.460457 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:07.461055 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:07.462070 13200 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:07.462325 19883 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:07.463135 19802 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:07.464036 19940 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:07.433954 19925 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.466220 19925 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:07.468161 12544 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:07.463285 19479 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:07.471125 19479 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.471335 19948 raft_consensus.cc:3055] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:07.471581 19479 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:07.471825 19948 raft_consensus.cc:740] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:07.472115 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:07.436321 19947 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:07.450105 19936 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.473829 19947 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:07.473368 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:07.476015 19936 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:07.476158 12544 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:07.461094 12545 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:07.478266 19970 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:07.481125 13230 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:07.452904 19934 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.484565 19934 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:07.487092 19965 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:07.510596 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 53307us
I20260709 13:06:07.511106 19965 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:07.511587 19965 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:07.511994 19965 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:07.511772 12662 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:07.512979 19918 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:07.448470 19971 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:07.487720 19955 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.513832 19801 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:07.514323 19801 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:07.514755 19801 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:07.515584 19955 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:07.491603 12544 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 23.
I20260709 13:06:07.493297 12689 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 22.
I20260709 13:06:07.518996 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:07.519824 12544 raft_consensus.cc:2410] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 13:06:07.496241 12545 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:06:07.520597 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:07.521364 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:07.522547 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:07.522689 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:07.523276 12545 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 23: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:07.510646 19906 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.523598 13200 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:07.524206 12696 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:06:07.524430 12545 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:06:07.497661 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:07.434446 19835 raft_consensus.cc:697] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 24 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:07.528501 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:07.528064 19835 consensus_queue.cc:237] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.529811 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:07.530840 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:07.531579 12662 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:07.531718 13200 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:07.531937 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:07.500732 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:07.501765 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4117) took 2472 ms. Trace:
I20260709 13:06:07.532721 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:07.472795 19948 consensus_queue.cc:260] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.504561 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:06:07.508323 19777 consensus_meta.cc:287] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.913s	user 0.008s	sys 0.001s
I20260709 13:06:07.508925 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:07.508978 19988 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.541383 12543 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:06:07.509058 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:07.525169 19906 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:07.525720 19932 raft_consensus.cc:2804] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:06:07.434129 19554 consensus_meta.cc:287] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.832s	user 0.018s	sys 0.000s
I20260709 13:06:07.526069 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:07.534196 12540 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:07.532951 12621 rpcz_store.cc:276] 0709 13:06:05.029697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.253763 (+224066us) service_pool.cc:224] Handling call
0709 13:06:05.254205 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:05.254647 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.254704 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:05.255312 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 13:06:05.628545 (+373233us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:06:05.628605 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.628701 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:07.302368 (+1673667us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:06:07.495302 (+192934us) raft_consensus.cc:1685] finished
0709 13:06:07.495325 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.501662 (+  6337us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1047,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":107244288,"thread_start_us":372741,"threads_started":1,"wal-append.queue_time_us":743488}
I20260709 13:06:07.537377 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:07.538112 12545 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:07.540481 12541 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
W20260709 13:06:07.392454 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 109281us
I20260709 13:06:07.558848 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:07.418916 12692 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 23.
I20260709 13:06:07.546841 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:07.549957 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:07.560798 12617 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:06:07.556411 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:07.561753 13226 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:06:07.562839 12692 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:07.541368 19888 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:07.545923 19901 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:07.548676 19956 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:06:07.592989 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.585258 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:06:07.590021 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 52731.8us
I20260709 13:06:07.567433 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:07.609277 19987 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:07.599665 19901 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.612298 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:07.607645 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:07.569104 19932 raft_consensus.cc:697] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:07.613246 19901 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:07.614002 19932 consensus_queue.cc:237] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.615080 12692 raft_consensus.cc:2393] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 23: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:07.623937 19479 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.625034 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:07.549355 19988 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.553510 19944 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.591984 19994 consensus_queue.cc:1059] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 13:06:07.587437 19888 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:07.594606 19904 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.625123 13235 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:07.628221 12512 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:07.628793 12692 raft_consensus.cc:2393] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 20: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:07.617147 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:07.640712 12662 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:07.641312 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 72170.5us
I20260709 13:06:07.658141 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:07.548439 19955 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:06:07.660480 12512 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:07.661325 12692 raft_consensus.cc:1275] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:06:07.657666 12695 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:06:07.656986 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:07.662482 13233 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:06:07.594030 13199 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:07.667235 20001 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:07.667725 19787 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:06:07.668864 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 74943.5us
I20260709 13:06:07.554338 19554 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.669675 13199 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:07.669575 19906 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:07.670538 19787 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:07.671262 19554 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:07.671413 12512 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:07.672544 13199 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:07.673667 19906 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:07.674113 19906 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:07.674482 19906 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:07.674746 19918 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:07.675284 19966 consensus_queue.cc:1059] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:07.676425 19966 raft_consensus.cc:3055] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:07.676859 19966 raft_consensus.cc:740] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:07.671157 19787 raft_consensus.cc:697] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:07.654469 12540 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 28.
I20260709 13:06:07.696906 12538 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 28 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 27. Current term is 28. Ops: []
I20260709 13:06:07.605114 19971 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.654031 19888 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:07.700141 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:07.699955 13200 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:07.696887 12544 raft_consensus.cc:2393] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 18: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:06:07.702519 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 61898.9us
I20260709 13:06:07.767491 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:07.768530 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 68705.4us
I20260709 13:06:07.692090 19901 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:07.664427 19482 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:07.786065 12689 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:07.778787 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:07.783291 12662 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:07.701972 19994 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.793920 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:06:07.770308 19867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.605s	user 0.009s	sys 0.013s
I20260709 13:06:07.702134 19925 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:07.809234 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:07.776686 19932 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:06:07.787102 12546 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:07.782764 19901 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:07.779845 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 363035us
I20260709 13:06:07.814397 13230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd40576623a84072be59a32d23cda14b"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:06:07.814790 13226 raft_consensus.cc:1240] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:07.816432 12513 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:07.816558 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3725) took 1175 ms. Trace:
I20260709 13:06:07.785454 19980 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:07.805593 19867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.716s	user 0.009s	sys 0.014s
I20260709 13:06:07.787673 19777 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:07.828641 13226 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:06:07.820858 19956 raft_consensus.cc:3055] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:07.833052 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:07.835923 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:07.836218 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:07.843954 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:07.844574 12546 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 13.
I20260709 13:06:07.847487 13226 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:07.826344 12542 rpcz_store.cc:276] 0709 13:06:06.640996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.641128 (+   132us) service_pool.cc:224] Handling call
0709 13:06:06.644138 (+  3010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:06.759878 (+115740us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.816222 (+1056344us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400228b54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:07.816450 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261947648}
I20260709 13:06:07.807441 19995 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:07.857975 12588 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:07.858871 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:07.859138 12588 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:07.828411 19901 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:07.812016 19479 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:07.859162 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:07.861007 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:07.821732 19993 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:07.863076 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:07.870657 12542 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
W20260709 13:06:07.845877 19990 log.cc:927] Time spent T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.173s	user 0.000s	sys 0.001s
W20260709 13:06:07.863211 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 46860.8us
I20260709 13:06:07.872398 13234 raft_consensus.cc:2393] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 23: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:07.776543 19966 consensus_queue.cc:260] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.926770 19991 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:07.958935 12513 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:07.971103 13197 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:07.971274 12513 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:07.837370 19940 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.091s
I20260709 13:06:07.923957 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 1290) took 1373 ms. Trace:
I20260709 13:06:07.810596 19994 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.924882 13200 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:07.842921 19980 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:07.991461 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 66664.2us
I20260709 13:06:07.992594 20003 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:07.993150 19980 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:07.822252 19925 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.853320 19956 raft_consensus.cc:740] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:07.996411 19989 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:07.997303 19956 consensus_queue.cc:260] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.998580 12546 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
W20260709 13:06:07.999284 19916 log.cc:927] Time spent T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 1.690s	user 0.009s	sys 0.011s
I20260709 13:06:08.000735 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:07.867858 19936 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:07.863955 19787 consensus_queue.cc:237] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:07.926225 19880 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:06:07.966719 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 107649us
I20260709 13:06:07.930191 12688 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:06:08.001415 12542 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:07.973928 13227 rpcz_store.cc:276] 0709 13:06:06.550716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.550828 (+   112us) service_pool.cc:224] Handling call
0709 13:06:06.551122 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:07.454851 (+903729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.911199 (+456348us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b54006cd4d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:07.923861 (+ 12662us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2076872576}
I20260709 13:06:07.989717 12513 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:07.969784 19991 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.990826 19926 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:07.843494 19932 raft_consensus.cc:697] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:06:08.008256 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.843750 19988 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:08.023649 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1852) took 2614 ms. Trace:
I20260709 13:06:08.005264 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:07.876067 19993 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:08.095206 12542 raft_consensus.cc:1275] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:06:08.051656 13197 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:08.095901 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3745) took 1197 ms. Trace:
I20260709 13:06:07.993146 20003 raft_consensus.cc:697] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:06:08.096253 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 44671.5us
I20260709 13:06:07.917891 19967 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.151s
I20260709 13:06:07.996474 19925 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:08.096262 12542 rpcz_store.cc:276] 0709 13:06:06.898482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.053931 (+1155449us) service_pool.cc:224] Handling call
0709 13:06:08.094863 (+ 40932us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.095648 (+   785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.095844 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:08.092216 12618 rpcz_store.cc:276] 0709 13:06:05.408801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.408919 (+   118us) service_pool.cc:224] Handling call
0709 13:06:05.409228 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:05.409553 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.409599 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:05.436897 (+ 27298us) log.cc:844] Serialized 26 byte log entry
0709 13:06:05.875094 (+438197us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:05.875153 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.875252 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:07.846078 (+1970826us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:06:08.004628 (+158550us) raft_consensus.cc:1685] finished
0709 13:06:08.004656 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.023575 (+ 18919us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":455,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":15874,"spinlock_wait_cycles":3200896,"thread_start_us":389070,"threads_started":1,"wal-append.queue_time_us":741184}
I20260709 13:06:08.051259 13232 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
I20260709 13:06:08.088490 19926 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.024186 19479 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:08.097122 13197 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:08.098354 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.100099 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2284) took 1191 ms. Trace:
I20260709 13:06:08.041872 19944 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:07.863898 19942 consensus_queue.cc:1059] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.184s
W20260709 13:06:08.055373 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 65845.8us
I20260709 13:06:08.114090 12546 rpcz_store.cc:276] 0709 13:06:06.908391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.099118 (+1190727us) service_pool.cc:224] Handling call
0709 13:06:08.099428 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.099647 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.099685 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:08.099743 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:08.099786 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.099862 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.100014 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:08.103852 13230 raft_consensus.cc:606] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:08.115438 13230 raft_consensus.cc:614] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:08.115883 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2289) took 1206 ms. Trace:
I20260709 13:06:08.116449 12546 rpcz_store.cc:276] 0709 13:06:06.909771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.115106 (+1205335us) service_pool.cc:224] Handling call
0709 13:06:08.115406 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.115578 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.115604 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:08.115643 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:08.115672 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.115724 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.115828 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:08.117763 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 71481.4us
I20260709 13:06:08.118877 12588 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:08.120535 12588 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:08.121598 19835 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:06:08.121968 19968 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:08.123788 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2285) took 1215 ms. Trace:
I20260709 13:06:08.124197 12542 rpcz_store.cc:276] 0709 13:06:06.908702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.103064 (+1194362us) service_pool.cc:224] Handling call
0709 13:06:08.123277 (+ 20213us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.123454 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.123481 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:08.123521 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:08.123557 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.123618 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.123734 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:08.127665 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:08.129267 12588 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:08.042423 19880 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:08.087198 19991 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:08.133914 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:08.133249 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:08.087348 19936 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:08.123584 19926 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:08.140154 19942 raft_consensus.cc:3055] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:08.140242 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2291) took 1229 ms. Trace:
I20260709 13:06:08.149506 12539 rpcz_store.cc:276] 0709 13:06:06.910472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.124134 (+1213662us) service_pool.cc:224] Handling call
0709 13:06:08.139741 (+ 15607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.139910 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.139933 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:08.139988 (+    55us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:08.140031 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.140093 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.140190 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:08.140568 19994 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:08.140841 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:08.101356 19959 consensus_meta.cc:287] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.649s	user 0.005s	sys 0.007s
I20260709 13:06:08.156670 19959 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:08.157204 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:06:08.157734 19801 consensus_meta.cc:287] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.643s	user 0.008s	sys 0.003s
I20260709 13:06:08.157925 19985 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:08.158169 19801 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:08.159000 19959 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:08.140762 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4140) took 1475 ms. Trace:
I20260709 13:06:08.160332 19801 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:08.159621 12614 rpcz_store.cc:276] 0709 13:06:06.664891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.665615 (+   724us) service_pool.cc:224] Handling call
0709 13:06:06.665904 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:06.666275 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.666320 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:07.305107 (+638787us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b2c0004c3c8. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:06:07.305636 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 13:06:07.319431 (+ 13795us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:07.319468 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.319535 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:08.135383 (+815848us) raft_consensus.cc:1685] finished
0709 13:06:08.135414 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.140702 (+  5288us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":10584,"spinlock_wait_cycles":3816192,"thread_start_us":13361,"threads_started":1,"wal-append.queue_time_us":264094}
W20260709 13:06:08.161369 20014 log.cc:927] Time spent T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:06:08.092253 19904 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:08.161530 12693 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:07.986954 19965 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:08.101418 19771 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:08.102000 19993 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:08.167569 19904 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:08.167836 12690 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:08.168148 19904 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:08.148590 19988 consensus_queue.cc:1059] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260709 13:06:08.171298 19965 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:08.172717 19988 raft_consensus.cc:3055] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:08.173152 19988 raft_consensus.cc:740] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:08.175175 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:08.175526 13200 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:08.149427 19942 raft_consensus.cc:740] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:08.176808 19771 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:08.176786 19942 consensus_queue.cc:260] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:08.177731 19771 raft_consensus.cc:697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:08.178200 19942 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:08.178979 19771 consensus_queue.cc:237] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:08.170899 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1682) took 1428 ms. Trace:
I20260709 13:06:08.173821 19904 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:08.148671 20003 consensus_queue.cc:237] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:08.182018 12543 rpcz_store.cc:276] 0709 13:06:06.742756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.542221 (+799465us) service_pool.cc:224] Handling call
0709 13:06:07.542492 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:07.546641 (+  4149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:07.546685 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:07.549859 (+  3174us) log.cc:844] Serialized 26 byte log entry
0709 13:06:07.702840 (+152981us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:06:07.798450 (+ 95610us) log.cc:844] Serialized 14 byte log entry
0709 13:06:07.806414 (+  7964us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.806489 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:08.170690 (+364201us) raft_consensus.cc:1685] finished
0709 13:06:08.170712 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.170841 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11423,"prepare.queue_time_us":95604,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":10149,"raft.queue_time_us":12230,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":17869,"thread_start_us":104566,"threads_started":1,"wal-append.queue_time_us":590005}
I20260709 13:06:08.184995 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:08.090996 19934 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260709 13:06:08.187258 12662 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:08.195706 12662 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:08.196134 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1685) took 1303 ms. Trace:
I20260709 13:06:08.188827 12543 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:06:08.130652 19955 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:08.154546 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:06:08.198139 12617 consensus_meta.cc:287] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.002s
I20260709 13:06:08.198199 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2301) took 1285 ms. Trace:
I20260709 13:06:08.198861 12617 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 23.
I20260709 13:06:08.199033 12543 rpcz_store.cc:276] 0709 13:06:06.913236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.188132 (+1274896us) service_pool.cc:224] Handling call
0709 13:06:08.188536 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:08.197866 (+  9330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.198131 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:08.138441 12588 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:08.191002 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:08.149020 19989 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:08.196581 12541 rpcz_store.cc:276] 0709 13:06:06.893080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.002919 (+1109839us) service_pool.cc:224] Handling call
0709 13:06:08.003242 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.003444 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:06:08.003768 (+   324us) log.cc:844] Serialized 14 byte log entry
0709 13:06:08.195829 (+192061us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:08.195878 (+    49us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:06:08.195918 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.195973 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.196082 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10373,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":873,"thread_start_us":191316,"threads_started":1}
W20260709 13:06:08.203109 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 64796.1us
W20260709 13:06:08.203254 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.144105 19936 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.141779 19835 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:08.196434 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2299) took 1283 ms. Trace:
W20260709 13:06:08.194387 20012 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:06:08.153546 19880 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:08.212625 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:08.155663 19971 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:08.219133 12539 rpcz_store.cc:276] 0709 13:06:06.912581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.150942 (+1238361us) service_pool.cc:224] Handling call
0709 13:06:08.195975 (+ 45033us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.196155 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.196189 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:08.196229 (+    40us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:06:08.196258 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.196304 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.196386 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:08.194384 19680 consensus_meta.cc:287] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.692s	user 0.009s	sys 0.000s
I20260709 13:06:08.218665 19936 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:08.256840 19935 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:08.211243 20006 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:08.214123 19777 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:06:08.264425 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 52154.6us
I20260709 13:06:08.141075 19932 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.16, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:08.214924 19482 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:08.214668 19980 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:08.276399 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:08.215701 19989 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:08.287814 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:08.213948 19965 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:08.219019 19801 consensus_queue.cc:1048] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:06:08.318817 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:06:08.280721 19906 consensus_meta.cc:287] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.606s	user 0.008s	sys 0.003s
I20260709 13:06:08.322686 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:08.275204 19834 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:08.350888 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:08.351660 12620 raft_consensus.cc:2393] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 23: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:08.351588 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:08.323443 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:08.352895 12622 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 23.
I20260709 13:06:08.323014 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:08.324571 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:08.325062 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:08.321208 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:08.286732 19777 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:08.324747 12541 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:08.262324 19680 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:08.349596 12616 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:08.274531 19935 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:08.325093 12619 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 24 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 13:06:08.326058 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:08.355759 12539 raft_consensus.cc:2393] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 23: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:08.283620 19960 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:08.370306 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:08.371351 12539 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:08.362099 12618 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:08.364101 19935 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:08.326576 19968 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:08.324126 19965 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:08.386809 12691 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:08.350996 19985 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:08.389734 12541 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
I20260709 13:06:08.391464 12662 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:08.266664 19988 consensus_queue.cc:260] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:08.359928 19777 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:08.392535 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:08.320215 19980 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:08.396384 12541 raft_consensus.cc:1240] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:06:08.397130 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2303) took 1480 ms. Trace:
I20260709 13:06:08.321596 19482 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:08.397939 12541 rpcz_store.cc:276] 0709 13:06:06.916930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.395840 (+1478910us) service_pool.cc:224] Handling call
0709 13:06:08.396165 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:08.396882 (+   717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.397078 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:08.369925 19834 raft_consensus.cc:697] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 23 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:08.349803 19906 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:08.403810 12541 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:08.404413 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2304) took 1487 ms. Trace:
I20260709 13:06:08.392611 19965 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:08.404731 12541 rpcz_store.cc:276] 0709 13:06:06.917248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.402167 (+1484919us) service_pool.cc:224] Handling call
0709 13:06:08.402434 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.404178 (+  1744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.404364 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:08.397832 19960 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:08.416805 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2290) took 1506 ms. Trace:
I20260709 13:06:08.418519 12546 rpcz_store.cc:276] 0709 13:06:06.910020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.117618 (+1207598us) service_pool.cc:224] Handling call
0709 13:06:08.117984 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:08.118745 (+   761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.118791 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:08.119406 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 13:06:08.220579 (+101173us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:08.220618 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.220696 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:08.416591 (+195895us) raft_consensus.cc:1685] finished
0709 13:06:08.416610 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.416748 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":110,"thread_start_us":100725,"threads_started":1,"wal-append.queue_time_us":172212}
I20260709 13:06:08.420357 12546 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:08.420892 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:08.421469 12613 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:08.421914 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:08.420892 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1688) took 1251 ms. Trace:
I20260709 13:06:08.422958 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:08.423095 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:08.386492 19891 consensus_queue.cc:1059] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 13:06:08.420821 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:08.426257 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:08.426466 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1686) took 1404 ms. Trace:
I20260709 13:06:08.422551 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:08.424188 12546 rpcz_store.cc:276] 0709 13:06:07.168990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.419921 (+1250931us) service_pool.cc:224] Handling call
0709 13:06:08.420207 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.420693 (+   486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.420844 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:08.422490 12615 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
I20260709 13:06:08.423988 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:08.427095 12613 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:08.387357 19992 consensus_queue.cc:1059] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:06:08.426851 12616 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:06:08.427469 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:08.413715 19999 consensus_queue.cc:1059] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:06:08.427971 19960 raft_consensus.cc:697] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:08.471392 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:08.425588 20011 consensus_queue.cc:1059] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
W20260709 13:06:08.473446 20025 log.cc:927] Time spent T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:06:08.426862 12541 rpcz_store.cc:276] 0709 13:06:07.022183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.424508 (+1402325us) service_pool.cc:224] Handling call
0709 13:06:08.424798 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.424955 (+   157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.424981 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:08.425019 (+    38us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:08.425047 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.426320 (+  1273us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.426417 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:08.442407 12615 raft_consensus.cc:1275] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:06:08.461961 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:08.494405 12540 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:08.468106 12662 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:08.455730 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:08.481324 12539 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
W20260709 13:06:08.445429 19901 consensus_meta.cc:287] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.517s	user 0.001s	sys 0.006s
I20260709 13:06:08.442632 19680 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:08.490059 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:08.437296 20018 log.cc:927] Time spent T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.079s	user 0.001s	sys 0.001s
I20260709 13:06:08.501112 12662 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:08.499840 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:08.504747 12539 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 19: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:08.438642 19891 raft_consensus.cc:3055] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:06:08.452458 19947 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:08.453037 19777 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:08.511438 19960 consensus_queue.cc:237] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:08.509332 19680 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:08.513211 19680 raft_consensus.cc:697] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:08.434158 19834 consensus_queue.cc:237] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:08.514288 19680 consensus_queue.cc:237] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:08.517772 19554 consensus_queue.cc:1059] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:08.519012 19554 raft_consensus.cc:3055] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:08.519408 19554 raft_consensus.cc:740] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:08.519426 19956 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:08.502509 20011 raft_consensus.cc:3055] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:08.503363 19986 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:08.521831 19986 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:08.522285 19986 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:08.523057 20011 raft_consensus.cc:740] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:08.524181 19948 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:08.524108 20011 consensus_queue.cc:260] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:08.526917 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.527878 13197 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:08.450565 19926 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:08.531459 19926 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:08.494529 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:08.536015 12539 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:08.536659 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1690) took 1282 ms. Trace:
I20260709 13:06:08.536970 12539 rpcz_store.cc:276] 0709 13:06:07.254657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.535545 (+1280888us) service_pool.cc:224] Handling call
0709 13:06:08.535836 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.536412 (+   576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.536605 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:08.490585 19883 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.537918 19883 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:08.538663 19980 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:08.540153 19883 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:08.540297 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2584) took 1019 ms. Trace:
I20260709 13:06:08.434856 19936 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:08.540786 12693 rpcz_store.cc:276] 0709 13:06:07.520491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.525663 (+  5172us) service_pool.cc:224] Handling call
0709 13:06:07.525938 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.162372 (+636434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.540066 (+377694us) spinlock_profiling.cc:243] Waited 635 ms on lock 0x7b54000c85d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:08.540236 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1461282688}
I20260709 13:06:08.548807 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:08.548966 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:08.435766 19482 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:08.439221 19906 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:08.549439 13226 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:08.507076 19901 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:08.541613 19993 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:08.542809 19936 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:08.505430 19992 raft_consensus.cc:3055] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:08.544873 12542 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:08.545003 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3736) took 1874 ms. Trace:
I20260709 13:06:08.561105 12544 rpcz_store.cc:276] 0709 13:06:06.670980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.521476 (+850496us) service_pool.cc:224] Handling call
0709 13:06:08.544720 (+1023244us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b5400228654. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:08.544924 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375695104}
I20260709 13:06:08.545593 19991 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:08.547128 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1800) took 1297 ms. Trace:
I20260709 13:06:08.562536 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:06:08.484223 19888 consensus_meta.cc:287] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.699s	user 0.011s	sys 0.000s
I20260709 13:06:08.563594 12544 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:06:08.564390 13226 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
I20260709 13:06:08.501528 12618 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:06:08.431351 19989 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:08.551826 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:08.552078 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1694) took 1069 ms. Trace:
I20260709 13:06:08.570483 12539 rpcz_store.cc:276] 0709 13:06:07.482648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.551317 (+1068669us) service_pool.cc:224] Handling call
0709 13:06:08.551594 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.551778 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.551803 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:08.551844 (+    41us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:08.551878 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.551930 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.552027 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:06:08.505861 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.513294 19777 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:08.557523 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:08.559285 12614 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:08.545914 12547 raft_consensus.cc:1240] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:08.562368 12691 rpcz_store.cc:276] 0709 13:06:07.249883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.328424 (+ 78541us) service_pool.cc:224] Handling call
0709 13:06:07.328736 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.390688 (+1061952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.546892 (+156204us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b5400404a54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:08.547067 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2432932096}
I20260709 13:06:08.548307 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:08.554522 20011 raft_consensus.cc:3060] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:08.508714 19891 raft_consensus.cc:740] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:08.569133 13228 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 27. Current term is 28. Ops: [27.17-27.17]
I20260709 13:06:08.588879 19891 consensus_queue.cc:260] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:08.590086 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2302) took 1676 ms. Trace:
I20260709 13:06:08.590628 12543 rpcz_store.cc:276] 0709 13:06:06.916612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.200474 (+1283862us) service_pool.cc:224] Handling call
0709 13:06:08.201182 (+   708us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:08.229908 (+ 28726us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:08.229939 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:08.267634 (+ 37695us) log.cc:844] Serialized 52 byte log entry
0709 13:06:08.415056 (+147422us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:08.415100 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.415165 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:08.589843 (+174678us) raft_consensus.cc:1685] finished
0709 13:06:08.589863 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.590024 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13360,"raft.queue_time_us":46898,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":1927,"thread_start_us":94190,"threads_started":1,"wal-append.queue_time_us":261786}
I20260709 13:06:08.592281 12617 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 21. Current term is 22. Ops: [21.12-21.12]
I20260709 13:06:08.574000 12546 raft_consensus.cc:1240] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:08.596311 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:08.599726 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.581019 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:08.565923 12513 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:08.601648 12695 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:08.556994 12540 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:06:08.603250 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:08.597620 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:08.603435 12543 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:06:08.603992 12622 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:08.569489 19999 raft_consensus.cc:3055] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:08.562134 19992 raft_consensus.cc:740] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:08.610244 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:08.611227 12622 raft_consensus.cc:2393] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 20: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:08.607496 12662 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:08.617120 12692 raft_consensus.cc:1240] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:08.607097 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:08.596707 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:08.619650 13200 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:06:08.623867 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:08.625694 12510 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.704s (SENT) [suppressed 12 similar messages]
I20260709 13:06:08.627557 12543 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:08.572167 19888 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:08.603842 19944 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:08.631197 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:08.608667 19994 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.818404 20026 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 19.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:06:08.818558 19994 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:08.612506 19967 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:08.604501 19958 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:08.836053 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:08.640147 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:08.837671 12618 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:08.623690 19942 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:08.628983 19913 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:08.841439 19882 raft_consensus.cc:3055] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:08.609499 19999 raft_consensus.cc:740] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:08.612912 19906 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.621440 19989 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:08.567334 19554 consensus_queue.cc:260] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:08.668311 20017 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.669130 19992 consensus_queue.cc:260] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:08.811547 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 191969us
W20260709 13:06:08.813055 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 237479us
I20260709 13:06:08.603715 19918 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:08.608479 19979 consensus_queue.cc:1059] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:06:08.667606 19983 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:06:08.814028 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:08.590155 19955 consensus_queue.cc:1059] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.042s
W20260709 13:06:08.821092 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 179046us
I20260709 13:06:08.819227 12622 raft_consensus.cc:2393] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 18: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:08.854283 19882 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:08.820348 19944 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:08.834296 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.851666 12692 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
W20260709 13:06:08.852008 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 226341us
I20260709 13:06:08.857491 19834 consensus_queue.cc:1059] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:06:08.808511 19949 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:08.901721 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3742) took 2140 ms. Trace:
I20260709 13:06:08.902024 12693 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:08.902110 12538 rpcz_store.cc:276] 0709 13:06:06.761607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.620771 (+859164us) service_pool.cc:224] Handling call
0709 13:06:07.696733 (+ 75962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:07.697419 (+   686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.901490 (+1204071us) spinlock_profiling.cc:243] Waited 75.7 ms on lock 0x7b54003ad250. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:08.901658 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":173998464}
I20260709 13:06:08.858220 12618 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
I20260709 13:06:08.849257 19942 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:08.864676 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 254920us
I20260709 13:06:08.863696 19989 raft_consensus.cc:697] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:08.874980 12620 raft_consensus.cc:2393] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 23: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:08.832446 19771 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:08.859431 19913 raft_consensus.cc:697] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:08.860597 19959 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:08.907976 12693 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:06:08.913102 19965 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:08.916831 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2297) took 2004 ms. Trace:
I20260709 13:06:08.917018 19999 consensus_queue.cc:260] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:08.858976 19906 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:08.918609 19949 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:08.905818 19992 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:08.921650 19968 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:08.922394 19973 consensus_queue.cc:1059] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:08.924738 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1684) took 2179 ms. Trace:
I20260709 13:06:09.006896 12545 rpcz_store.cc:276] 0709 13:06:06.745108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.555254 (+810146us) service_pool.cc:224] Handling call
0709 13:06:07.555592 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:07.626306 (+ 70714us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:07.626338 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:07.626790 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:06:07.968367 (+341577us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:07.968414 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.924369 (+955955us) spinlock_profiling.cc:243] Waited 70.3 ms on lock 0x7b54001121d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:08.924416 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:08.924458 (+    42us) raft_consensus.cc:1685] finished
0709 13:06:08.924472 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:08.924678 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1082,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":16035,"spinlock_wait_cycles":161745152,"thread_start_us":341221,"threads_started":1,"wal-append.queue_time_us":504179}
I20260709 13:06:08.926278 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1674) took 1088 ms. Trace:
I20260709 13:06:09.009761 12695 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:08.927189 12512 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:08.921684 12510 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:09.009961 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:06:08.930125 20031 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 13:06:08.863035 19479 consensus_queue.cc:1059] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:06:08.934648 20036 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.935218 19993 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:08.949856 12542 rpcz_store.cc:276] 0709 13:06:06.912085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.125173 (+1213088us) service_pool.cc:224] Handling call
0709 13:06:08.140899 (+ 15726us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.560808 (+419909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.916588 (+355780us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54000794d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:08.916766 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":928614784}
I20260709 13:06:08.950435 13231 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 23.
I20260709 13:06:09.015596 20036 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:08.956054 12615 raft_consensus.cc:1275] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:06:09.017293 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:08.963420 19771 raft_consensus.cc:697] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:09.018522 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:09.018626 20036 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:09.019158 12615 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:06:09.018643 19888 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:09.019395 19771 consensus_queue.cc:237] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:09.020494 12615 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:06:08.956779 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:09.022811 19906 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:08.958840 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:08.945161 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1681) took 2199 ms. Trace:
I20260709 13:06:09.023924 12547 rpcz_store.cc:276] 0709 13:06:06.742444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.541762 (+799318us) service_pool.cc:224] Handling call
0709 13:06:08.545618 (+1003856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.578099 (+ 32481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.941117 (+363018us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400228650. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:08.941418 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2307834752}
I20260709 13:06:08.957585 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:06:08.971372 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 348033us
I20260709 13:06:09.006803 19882 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 19.18, Last appended by leader: 18, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:08.975566 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:09.027619 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:08.938078 19942 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:09.029868 19965 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:09.032445 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2589) took 1354 ms. Trace:
I20260709 13:06:09.032950 12690 rpcz_store.cc:276] 0709 13:06:07.697057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.765377 (+ 68320us) service_pool.cc:224] Handling call
0709 13:06:07.789145 (+ 23768us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.168326 (+379181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.032161 (+863835us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b54001b5654. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:09.032371 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":870400896}
I20260709 13:06:09.035596 20001 consensus_queue.cc:1059] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:09.036463 20001 raft_consensus.cc:3055] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:06:09.036604 19948 consensus_meta.cc:287] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.000s
I20260709 13:06:09.036844 20001 raft_consensus.cc:740] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:09.037860 20001 consensus_queue.cc:260] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:08.994133 19940 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:09.039104 20001 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:09.038879 19940 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:08.995162 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:08.872207 19918 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:09.041064 19940 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:09.041685 19883 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.041874 19918 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:09.005015 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.042196 19883 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:08.997323 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:09.044200 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:09.046362 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:09.046952 12687 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 23.
I20260709 13:06:09.047762 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:09.048806 19891 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:09.050594 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3749) took 1216 ms. Trace:
I20260709 13:06:09.051041 12544 rpcz_store.cc:276] 0709 13:06:07.834385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.565451 (+731066us) service_pool.cc:224] Handling call
0709 13:06:08.565807 (+   356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:08.566419 (+   612us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:06:08.593900 (+ 27481us) log.cc:844] Serialized 14 byte log entry
0709 13:06:08.865239 (+271339us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:08.865711 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:06:08.865850 (+   139us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:08.865881 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.865949 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:09.050339 (+184390us) raft_consensus.cc:1685] finished
0709 13:06:09.050366 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.050530 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21784,"prepare.queue_time_us":44478,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":3297,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":14555,"thread_start_us":271011,"threads_started":1,"wal-append.queue_time_us":454596}
I20260709 13:06:09.008863 13228 rpcz_store.cc:276] 0709 13:06:07.837543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.837703 (+   160us) service_pool.cc:224] Handling call
0709 13:06:07.838025 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:08.589683 (+751658us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.926046 (+336363us) spinlock_profiling.cc:243] Waited 731 ms on lock 0x7b5400740254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:08.926226 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1680628480}
I20260709 13:06:08.954758 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:09.045379 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:09.051885 19913 consensus_queue.cc:237] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:08.865713 20017 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:09.034830 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:09.058799 12693 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 17. (term mismatch)
I20260709 13:06:09.059964 12693 pending_rounds.cc:85] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 16
I20260709 13:06:09.060248 12693 pending_rounds.cc:107] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 23.17
I20260709 13:06:09.060575 12693 raft_consensus.cc:2889] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:08.961247 19508 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.025195 12659 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:09.088451 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:09.071504 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 46378.1us
I20260709 13:06:09.005791 19968 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:09.097345 12659 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
W20260709 13:06:09.071015 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 149423us
I20260709 13:06:09.048871 12687 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:09.099365 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 235979us
I20260709 13:06:09.004463 19999 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:09.098371 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:09.103549 12693 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:08.964630 20011 consensus_queue.cc:1059] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.099s
W20260709 13:06:09.104087 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 176980us
I20260709 13:06:09.107430 12659 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:09.108353 12510 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:09.106014 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.006744 19901 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:09.057399 19991 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:09.125535 12510 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:09.130034 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.971925 19959 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:09.130381 12510 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:09.132616 13228 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:06:09.098795 19967 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:09.100754 19936 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:09.097787 19777 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:09.144929 12659 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:09.145275 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 276243us
I20260709 13:06:09.113370 19797 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:06:09.124758 19948 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:09.152086 19801 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:06:09.054313 19989 consensus_queue.cc:237] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:09.128818 19973 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:09.155534 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48978 (request call id 65) took 1341 ms. Trace:
I20260709 13:06:09.098650 19834 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.044s
I20260709 13:06:09.117695 19966 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:09.053505 19942 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:09.146178 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 222661us
I20260709 13:06:09.097354 19508 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:09.143591 19482 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:09.164567 12659 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:09.140117 19906 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:09.116572 20046 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:09.168206 13199 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:09.161605 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.167213 13230 rpcz_store.cc:276] 0709 13:06:07.814164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:07.814277 (+   113us) service_pool.cc:224] Handling call
0709 13:06:09.155281 (+1341004us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b540014afd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9573853 00007fc3ae54160a 00007fc3a7ac77d4 00007fc3a7ac7762 00007fc3a7ac7691 00007fc3a7ac760c 00007fc3a7ac68c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:09.155451 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":644623616}
W20260709 13:06:09.162534 19880 consensus_meta.cc:287] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.895s	user 0.013s	sys 0.013s
I20260709 13:06:09.172963 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:09.150905 20026 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:09.174170 12659 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:09.151328 19991 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:09.163519 19948 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:09.213198 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 186608us
I20260709 13:06:09.180106 19777 consensus_queue.cc:1048] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:06:09.227119 19948 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:09.212621 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:09.217295 20017 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:09.247756 12690 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
I20260709 13:06:09.220228 12687 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:09.215098 20026 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:09.175625 19801 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:09.163046 19936 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:06:09.172223 20045 consensus_queue.cc:1059] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:06:09.163190 19994 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:09.260188 19777 raft_consensus.cc:3055] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:09.260604 19777 raft_consensus.cc:740] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:09.260675 19987 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:06:09.261634 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 87572.4us
I20260709 13:06:09.261484 19777 consensus_queue.cc:260] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:09.262872 19777 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:09.263275 19959 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:09.263960 20049 consensus_queue.cc:1059] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:09.266748 19942 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:09.273799 19987 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:06:09.274662 19904 raft_consensus.cc:3055] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:09.258865 19801 raft_consensus.cc:697] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 20 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:09.275058 19904 raft_consensus.cc:740] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:09.275964 19904 consensus_queue.cc:260] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:09.276038 19801 consensus_queue.cc:237] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:09.274284 20051 raft_consensus.cc:3055] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:09.278101 20051 raft_consensus.cc:740] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:09.279183 20051 consensus_queue.cc:260] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:09.281673 20051 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:09.250520 19991 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:09.283831 19991 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:09.284372 19883 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:09.253243 19986 consensus_meta.cc:287] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.730s	user 0.006s	sys 0.006s
I20260709 13:06:09.288233 19986 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:09.288859 13232 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:09.290392 19986 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:09.290943 19986 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:09.294286 12659 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:09.295558 12689 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:09.238210 12694 raft_consensus.cc:2368] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19.
W20260709 13:06:09.299866 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 47310.7us
I20260709 13:06:09.319716 19949 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:09.321228 19508 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:09.180322 19880 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:09.321776 19904 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:09.296241 19986 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:09.323897 19882 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:09.324381 19968 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:09.331820 12659 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:09.339010 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 225175us
W20260709 13:06:09.348439 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.352488 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:09.354230 12687 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16. Ops: []
W20260709 13:06:09.355878 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.361492 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:09.363278 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:09.366554 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:09.392145 12618 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
W20260709 13:06:09.391692 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 59946.2us
I20260709 13:06:09.391942 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:09.398046 12620 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:06:09.399919 12621 raft_consensus.cc:1240] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:09.400705 12696 raft_consensus.cc:2410] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:06:09.393038 12688 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22.
I20260709 13:06:09.402909 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:09.403942 12512 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:09.406530 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:09.329530 19949 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:09.412441 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:09.415856 12615 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:06:09.420883 12619 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:09.426513 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:09.392557 12618 pending_rounds.cc:85] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 13
I20260709 13:06:09.440280 12618 pending_rounds.cc:107] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:06:09.440676 12618 raft_consensus.cc:2889] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:09.496531 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.498922 12512 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:06:09.501411 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 333263us
I20260709 13:06:09.399631 19926 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.331061 19777 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.090s
I20260709 13:06:09.403394 19891 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:09.500111 19906 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:09.507990 12512 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:09.502530 13199 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:09.512689 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:09.525149 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4143) took 1204 ms. Trace:
I20260709 13:06:09.526291 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1689) took 2297 ms. Trace:
I20260709 13:06:09.526669 12546 rpcz_store.cc:276] 0709 13:06:07.228998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.429710 (+1200712us) service_pool.cc:224] Handling call
0709 13:06:08.430351 (+   641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:08.593817 (+163466us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.526073 (+932256us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54000a5ad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:09.526238 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285444992}
I20260709 13:06:09.410764 19834 consensus_queue.cc:1059] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.104s
W20260709 13:06:09.505753 20042 log.cc:927] Time spent T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
I20260709 13:06:09.525591 12617 rpcz_store.cc:276] 0709 13:06:08.320387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.320498 (+   111us) service_pool.cc:224] Handling call
0709 13:06:08.356058 (+ 35560us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:08.592792 (+236734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.524871 (+932079us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b540007bcd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:09.525075 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":542659968}
I20260709 13:06:09.531489 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:09.410287 19991 consensus_queue.cc:1059] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
I20260709 13:06:09.542695 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1878) took 1012 ms. Trace:
W20260709 13:06:09.544504 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.533260 12512 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:09.429579 19482 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:09.536284 20048 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:09.533826 19777 consensus_queue.cc:1243] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 28.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:06:09.539475 20061 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:09.538651 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:09.538669 19992 consensus_meta.cc:287] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.533s	user 0.005s	sys 0.005s
I20260709 13:06:09.541663 20017 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.549252 12512 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:09.543341 12616 rpcz_store.cc:276] 0709 13:06:08.530368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.560247 (+ 29879us) service_pool.cc:224] Handling call
0709 13:06:08.560602 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:08.567171 (+  6569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:08.567203 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:08.583936 (+ 16733us) log.cc:844] Serialized 26 byte log entry
0709 13:06:08.835303 (+251367us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:08.835348 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:08.835424 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:09.542392 (+706968us) raft_consensus.cc:1685] finished
0709 13:06:09.542423 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:09.542621 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6084,"raft.queue_time_us":8839,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":3373,"thread_start_us":200711,"threads_started":1,"wal-append.queue_time_us":519295}
W20260709 13:06:09.535025 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 395937us
I20260709 13:06:09.560317 12617 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:06:09.566947 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:09.568668 12512 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:09.570248 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:09.571476 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:09.582892 12546 raft_consensus.cc:3055] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:09.583137 12539 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:09.583389 12546 raft_consensus.cc:740] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:09.585526 12544 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 13:06:09.585718 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.556720 19942 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.521379 19926 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:09.560662 19980 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:09.584304 12546 consensus_queue.cc:260] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:09.597543 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.560376 19983 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:09.623092 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:09.624293 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:09.640372 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:09.641341 12541 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:06:09.651525 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:09.653414 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:09.595919 12659 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:09.603067 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:09.603909 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.680068 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:09.622645 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:09.705343 12545 raft_consensus.cc:1275] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:06:09.654371 12538 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:09.580150 19906 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:09.705910 12539 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:09.707232 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 111409us
I20260709 13:06:09.607470 19771 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:09.728883 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:09.745366 12540 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:06:09.728936 19983 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:09.733057 20054 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:09.733978 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:09.765599 12617 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:09.735481 19956 raft_consensus.cc:3055] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:09.579996 19797 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:09.588310 19973 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:06:09.737041 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 54772.9us
I20260709 13:06:09.533615 20053 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.071s
I20260709 13:06:09.589211 19482 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:09.756639 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:09.594282 19835 raft_consensus.cc:3055] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:09.564570 19948 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:09.758074 13200 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.018s	sys 0.051s
I20260709 13:06:09.738608 19906 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:06:09.769357 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:09.774642 13231 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 1681) took 1599 ms (client timeout 1852 ms). Trace:
I20260709 13:06:09.576869 19777 consensus_queue.cc:1059] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.161s
I20260709 13:06:09.606305 20049 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:09.782042 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4153) took 1435 ms. Trace:
I20260709 13:06:09.602908 20061 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:09.590261 19992 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.174s
I20260709 13:06:09.850003 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2596) took 1242 ms. Trace:
I20260709 13:06:09.777696 19956 raft_consensus.cc:740] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:09.794854 12540 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:09.798422 13197 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:09.750567 19913 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.000s	sys 0.026s
W20260709 13:06:09.812086 13200 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.019s	sys 0.051s
I20260709 13:06:09.747313 19980 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:09.812719 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:09.761340 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2594) took 1161 ms. Trace:
I20260709 13:06:09.873226 12689 rpcz_store.cc:276] 0709 13:06:08.600695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.601065 (+   370us) service_pool.cc:224] Handling call
0709 13:06:08.601541 (+   476us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:09.296006 (+694465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.753838 (+457832us) spinlock_profiling.cc:243] Waited 694 ms on lock 0x7b5400405454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:09.761244 (+  7406us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1595550080}
W20260709 13:06:09.851980 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 686884us
I20260709 13:06:09.783203 12539 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:06:09.657935 19989 consensus_queue.cc:1059] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.182s
W20260709 13:06:09.817078 13231 rpcz_store.cc:269] 0709 13:06:08.153791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.154036 (+   245us) service_pool.cc:224] Handling call
0709 13:06:09.752458 (+1598422us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b54007c0e54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:09.752624 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1756712704}
I20260709 13:06:09.763818 20054 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.579537 20017 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:09.828806 12621 rpcz_store.cc:276] 0709 13:06:08.347647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.352533 (+  4886us) service_pool.cc:224] Handling call
0709 13:06:08.376152 (+ 23619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:09.409782 (+1033630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.781706 (+371924us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001eaad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:09.781942 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2335879040}
I20260709 13:06:09.850445 12695 rpcz_store.cc:276] 0709 13:06:08.607820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.607953 (+   133us) service_pool.cc:224] Handling call
0709 13:06:08.608206 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:09.018075 (+409869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.831317 (+813242us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b54003e94d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:09.849939 (+ 18622us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":923057920}
I20260709 13:06:09.608379 19942 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:09.875072 19913 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.001s	sys 0.026s
I20260709 13:06:09.803506 19835 raft_consensus.cc:740] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:09.829802 19968 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:09.870556 19634 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.827569 19906 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:09.891872 12617 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:09.764209 19771 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:09.871021 19986 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:09.911523 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 333580us
I20260709 13:06:09.781456 19880 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:09.830081 19973 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:06:09.908322 19999 consensus_meta.cc:287] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.802s	user 0.012s	sys 0.000s
I20260709 13:06:09.899163 20054 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:09.902945 20058 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.950364 12512 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:09.957482 12622 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:06:09.964577 12512 leader_election.cc:400] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19.
I20260709 13:06:09.965061 12512 leader_election.cc:403] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:09.889833 19980 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:09.945860 20006 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.010s	sys 0.014s
I20260709 13:06:09.989352 20058 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:09.993490 19882 consensus_meta.cc:287] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.000s
I20260709 13:06:09.997669 19941 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.246s
I20260709 13:06:09.997689 20066 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.997798 20060 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:09.879782 20061 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:10.058350 12546 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:10.071283 12587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.000s	sys 0.036s
W20260709 13:06:10.096477 12587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.000s	sys 0.036s
W20260709 13:06:10.072335 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 340269us
I20260709 13:06:09.994877 19554 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:06:10.039829 20041 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 1.067s	user 0.011s	sys 0.000s
I20260709 13:06:10.100848 12662 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:10.033874 20045 raft_consensus.cc:3055] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:10.045616 19482 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19.
W20260709 13:06:10.104374 12691 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.015s	sys 0.035s
I20260709 13:06:10.042488 19989 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:10.047899 20026 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:10.142069 12544 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:09.947433 19634 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:09.998167 20074 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:09.998299 20062 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:10.020278 19980 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:10.153954 12546 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:06:10.014600 19948 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:10.015851 19926 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:10.156741 12546 pending_rounds.cc:85] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 10
I20260709 13:06:10.157186 12546 pending_rounds.cc:107] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:06:10.157533 12546 raft_consensus.cc:2889] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:10.110937 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 309167us
I20260709 13:06:09.989794 19999 consensus_queue.cc:1059] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.113s
I20260709 13:06:10.005206 20071 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:06:10.115774 12691 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.015s	sys 0.036s
I20260709 13:06:10.120378 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:10.164971 13226 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 23.
I20260709 13:06:10.122376 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:10.102459 19960 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.008s	sys 0.041s
I20260709 13:06:09.955605 19956 consensus_queue.cc:260] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.152204 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:10.138077 19992 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:09.965919 19973 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:10.190312 12544 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15.
I20260709 13:06:10.115223 20045 raft_consensus.cc:740] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:06:10.155689 19966 consensus_meta.cc:287] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.983s	user 0.010s	sys 0.000s
I20260709 13:06:10.195467 13234 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:10.150949 20074 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:10.174840 19960 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.008s	sys 0.041s
I20260709 13:06:10.021935 19835 consensus_queue.cc:260] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:10.140389 19979 raft_consensus.cc:3055] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:10.198053 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:10.194555 19883 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:10.246492 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:10.168985 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 370661us
I20260709 13:06:10.163275 19989 raft_consensus.cc:697] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:10.205727 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:10.248186 13226 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
I20260709 13:06:10.173941 19980 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:10.248548 19989 consensus_queue.cc:237] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.249121 19980 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.251267 19980 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:10.150640 19777 consensus_queue.cc:1048] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 13:06:10.252802 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:10.244122 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:10.253604 13226 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 20: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:10.258538 13231 raft_consensus.cc:1217] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 LEADER]: Deduplicated request from leader. Original: 21.14->[23.15-27.17]   Dedup: 25.16->[27.17-27.17]
I20260709 13:06:10.259228 13231 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 27. Current term is 28. Ops: [23.15-27.17]
I20260709 13:06:10.260887 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:10.209959 20064 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.211438 19956 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:10.267583 12696 raft_consensus.cc:1240] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
W20260709 13:06:10.283000 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.273643 20059 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:10.274055 20087 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:10.113667 20060 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:10.105863 20066 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.194796 20062 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:10.279079 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:10.280908 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 323129us
I20260709 13:06:10.215896 20074 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:10.318436 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:10.284974 13230 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:06:10.242735 20068 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.290683 12692 raft_consensus.cc:3055] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:06:10.207326 20001 consensus_queue.cc:1059] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:06:10.296834 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:10.298611 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:10.327229 12692 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:06:10.285342 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 325126us
W20260709 13:06:10.306620 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 45859.7us
I20260709 13:06:10.241014 19979 raft_consensus.cc:740] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:10.306654 13231 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:06:10.214632 19983 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:10.212607 19882 consensus_queue.cc:1059] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:06:10.296828 20017 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:10.317342 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.319779 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:10.344338 12621 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:06:10.320935 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:10.314116 20063 log.cc:927] Time spent T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.162s	user 0.003s	sys 0.000s
I20260709 13:06:10.337806 12696 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
I20260709 13:06:10.315485 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:10.350252 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:10.350555 12696 pending_rounds.cc:85] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 13
I20260709 13:06:10.342413 13228 raft_consensus.cc:2393] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 20: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:10.350848 12621 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:10.350845 12696 pending_rounds.cc:107] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:06:10.353267 12696 raft_consensus.cc:2889] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:10.316546 19992 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:06:10.335209 20073 log.cc:927] Time spent T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.375s	user 0.001s	sys 0.000s
I20260709 13:06:10.387259 12662 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:10.390215 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:10.397691 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:10.397665 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:10.314599 19918 consensus_queue.cc:1059] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.068s
W20260709 13:06:10.405879 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.329421 12692 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 27.17, Last appended by leader: 17, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.358247 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:10.266752 19883 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.342741 19888 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:10.362682 19904 consensus_meta.cc:287] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 1.022s	user 0.011s	sys 0.002s
W20260709 13:06:10.415755 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.406857 13199 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:10.414657 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:10.425871 12620 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.017s	sys 0.014s
W20260709 13:06:10.427073 12620 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.017s	sys 0.014s
I20260709 13:06:10.405411 12588 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:10.352721 19771 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:10.406989 12662 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:10.353170 19882 consensus_queue.cc:1243] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer a70479a3b4114f3581095e9890f5d653 log is divergent from this leader: its last log entry 12.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:06:10.361975 19958 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.430111 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4165) took 1027 ms. Trace:
I20260709 13:06:10.432750 12621 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
I20260709 13:06:10.335031 20036 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.079s
I20260709 13:06:10.438933 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:10.441982 12621 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
I20260709 13:06:10.434309 12620 rpcz_store.cc:276] 0709 13:06:09.403184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.408019 (+  4835us) service_pool.cc:224] Handling call
0709 13:06:09.408359 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:09.408629 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:06:09.873439 (+464810us) log.cc:844] Serialized 14 byte log entry
0709 13:06:10.429509 (+556070us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.429833 (+   324us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:10.429883 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.429955 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.430061 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":178338,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"raft.queue_time_us":485,"thread_start_us":928554,"threads_started":2}
I20260709 13:06:10.296155 20045 consensus_queue.cc:260] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:10.443853 12688 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:06:10.318032 20059 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.324616 20087 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.450162 20087 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:10.450882 20087 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.451476 20087 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.455294 20087 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:10.460067 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:10.406714 20026 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:10.424468 19992 raft_consensus.cc:697] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 23 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:06:10.502535 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 71920.8us
W20260709 13:06:10.505151 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 98239.1us
I20260709 13:06:10.508633 12662 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:10.289911 20064 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.431495 20001 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:10.421463 20058 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:10.509254 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3765) took 1953 ms. Trace:
I20260709 13:06:10.341267 20068 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.517769 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:10.520900 12543 rpcz_store.cc:276] 0709 13:06:08.555648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.639429 (+ 83781us) service_pool.cc:224] Handling call
0709 13:06:08.639717 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:09.095605 (+455888us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.095640 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:09.114526 (+ 18886us) log.cc:844] Serialized 26 byte log entry
0709 13:06:09.521990 (+407464us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:09.522048 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.784608 (+262560us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54000a6ed4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:09.784656 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:09.996944 (+212288us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:06:10.509038 (+512094us) raft_consensus.cc:1685] finished
0709 13:06:10.509060 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.509197 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80450,"raft.queue_time_us":76427,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":8525,"spinlock_wait_cycles":889460352,"thread_start_us":368238,"threads_started":1,"wal-append.queue_time_us":665962}
I20260709 13:06:10.522831 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:10.443518 19980 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.428385 19979 consensus_queue.cc:260] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:10.546530 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:10.546892 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:10.499197 20061 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:10.508070 19926 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:10.511343 19947 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:10.432296 19888 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.554980 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:10.557802 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:10.557319 12540 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:06:10.558394 12546 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:10.443540 19958 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.556368 12539 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:10.561812 12510 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:10.561820 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:10.555800 12616 raft_consensus.cc:3055] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:10.567970 12616 raft_consensus.cc:740] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:10.495637 20071 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.056s
I20260709 13:06:10.544167 19777 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:10.569480 12510 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:10.578095 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:10.509483 20026 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:10.568780 12616 consensus_queue.cc:260] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:10.546893 19634 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:10.582353 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:10.586432 12540 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:10.534754 19787 consensus_queue.cc:1059] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:06:10.584833 12510 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:10.590705 12510 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:10.562919 19801 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:10.593135 12616 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:10.596561 12546 raft_consensus.cc:2410] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:06:10.564126 19973 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:10.602363 20076 log.cc:927] Time spent T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
I20260709 13:06:10.602810 19973 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:10.603684 20075 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.335s	user 0.001s	sys 0.000s
I20260709 13:06:10.601123 19883 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:10.608274 20093 log.cc:927] Time spent T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 13:06:10.603406 19973 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.610564 19973 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:10.611168 19973 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:10.601903 20091 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:10.602150 19988 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:10.603518 20044 raft_consensus.cc:3055] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:10.620291 20044 raft_consensus.cc:740] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:10.559052 19949 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:10.607069 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:10.632977 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 217951us
I20260709 13:06:10.601109 20100 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.580642 19777 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:10.549600 19980 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.598685 19634 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:10.611608 19973 raft_consensus.cc:697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 20 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:10.560169 19926 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:10.628288 20061 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:10.629937 20086 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.112s
I20260709 13:06:10.601191 20092 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.601455 20088 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:10.650858 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:10.651824 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:10.651824 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:10.612160 20091 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:10.670773 20080 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
W20260709 13:06:10.674093 20099 log.cc:927] Time spent T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:06:10.674767 19926 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:10.677399 20106 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:06:10.680567 20112 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.663390 19777 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:10.684137 20105 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.686841 20109 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:10.687394 20026 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:10.674993 20077 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.324s	user 0.000s	sys 0.001s
I20260709 13:06:10.675269 19797 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:10.690276 20091 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:10.597488 19992 consensus_queue.cc:237] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.698096 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:10.698045 19958 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:10.697575 20088 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:10.700835 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:10.701876 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4168) took 1274 ms. Trace:
I20260709 13:06:10.719103 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2609) took 1362 ms. Trace:
I20260709 13:06:10.718349 12614 rpcz_store.cc:276] 0709 13:06:09.427615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.515389 (+ 87774us) service_pool.cc:224] Handling call
0709 13:06:09.515901 (+   512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:09.516292 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.516333 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:09.530668 (+ 14335us) log.cc:844] Serialized 26 byte log entry
0709 13:06:09.912891 (+382223us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:09.912976 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.913140 (+   164us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:10.701664 (+788524us) raft_consensus.cc:1685] finished
0709 13:06:10.701688 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.701819 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":63413,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":2845,"thread_start_us":381693,"threads_started":1,"wal-append.queue_time_us":765681}
I20260709 13:06:10.720228 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:10.658743 19949 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.676137 20061 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:06:10.706254 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.672326 20100 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.721856 12614 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:06:10.719518 12687 rpcz_store.cc:276] 0709 13:06:09.356385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.356595 (+   210us) service_pool.cc:224] Handling call
0709 13:06:09.413213 (+ 56618us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:09.426708 (+ 13495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.426737 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:09.427203 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 13:06:09.830500 (+403297us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:06:09.830540 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:09.830616 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:10.718894 (+888278us) raft_consensus.cc:1685] finished
0709 13:06:10.718916 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.719045 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38546,"raft.queue_time_us":87514,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":6633,"thread_start_us":403000,"threads_started":1,"wal-append.queue_time_us":727316}
I20260709 13:06:10.736212 13197 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:10.729712 12540 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:06:10.732801 12616 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:06:10.740958 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 334155us
I20260709 13:06:10.751924 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:10.754681 12546 raft_consensus.cc:1275] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:06:10.740330 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 149714us
I20260709 13:06:10.741236 12587 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:10.711529 20105 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:10.757292 12510 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:10.760116 20105 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:10.760871 19797 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:10.763273 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:10.764046 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:10.733768 20054 consensus_meta.cc:287] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.744s	user 0.012s	sys 0.000s
I20260709 13:06:10.769006 20118 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:10.769506 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:10.772764 12512 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:10.774102 12687 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 25.
I20260709 13:06:10.722972 19980 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:10.777894 12542 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 28 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260709 13:06:10.734428 20061 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:10.784119 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:10.785461 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:10.785759 13200 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:10.790071 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:10.790805 13232 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:06:10.741669 19958 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.713850 20112 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:10.793510 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:10.795018 20112 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:10.765868 20064 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:10.771345 20049 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:10.768335 19888 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:10.770730 20026 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.807907 12689 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 17. Current term is 18. Ops: []
W20260709 13:06:10.808867 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.773495 20017 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:10.821492 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:10.788569 20118 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.704280 20044 consensus_queue.cc:260] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:10.784229 20114 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.715662 19973 consensus_queue.cc:237] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.788661 20109 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:10.822216 12687 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22.
I20260709 13:06:10.814455 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:10.809661 20112 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.813266 12588 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:10.774199 19934 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 13:06:10.826844 12693 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:10.823639 12689 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:06:10.833076 19906 consensus_meta.cc:287] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.878s	user 0.011s	sys 0.000s
I20260709 13:06:10.785084 20058 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.042s
I20260709 13:06:10.695185 20092 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:10.809689 20071 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.844167 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:10.770612 19634 consensus_queue.cc:1059] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:06:10.788558 20091 consensus_queue.cc:1059] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:06:10.834235 19980 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.846999 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:10.852587 12695 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:06:10.847141 20123 consensus_queue.cc:1048] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:06:10.778095 20054 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:10.841825 20111 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 13:06:10.851362 19888 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.805780 19958 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:10.821877 20017 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:10.861235 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:10.867550 12687 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22.
I20260709 13:06:10.836434 20118 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:10.842234 19802 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:10.863798 12541 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
W20260709 13:06:10.848861 19795 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:06:10.845652 20049 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:10.842136 20109 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:10.849677 20044 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:10.828356 20026 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.864732 20086 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:10.850490 19906 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:10.869249 20017 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:10.852402 20112 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.840672 20114 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:10.851132 19980 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.851678 20071 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:10.874825 19482 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:10.906267 20107 log.cc:927] Time spent T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260709 13:06:10.906683 20088 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:10.889183 20086 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.880218 20109 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:10.910928 12542 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:10.868340 19888 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.881737 19802 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.934187 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1817) took 2027 ms. Trace:
I20260709 13:06:10.918361 20054 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:10.938575 20100 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:10.938856 19944 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:10.921006 20086 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:10.921615 19949 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:10.948000 20112 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:10.934700 12691 rpcz_store.cc:276] 0709 13:06:08.906945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.907654 (+   709us) service_pool.cc:224] Handling call
0709 13:06:08.907921 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:09.160366 (+252445us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:06:09.545295 (+384929us) log.cc:844] Serialized 14 byte log entry
0709 13:06:10.179466 (+634171us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.179538 (+    72us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:10.179606 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.933837 (+754231us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54002c9f54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:10.933923 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.934095 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14512,"prepare.queue_time_us":603428,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":37094,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":7146,"spinlock_wait_cycles":579839232,"thread_start_us":993719,"threads_started":2,"wal-append.queue_time_us":1037907}
I20260709 13:06:10.919623 19482 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:10.958901 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:10.960165 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:10.936823 20026 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:10.963601 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:10.966995 12695 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:06:10.975692 12542 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
I20260709 13:06:10.986907 20026 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:11.023777 20059 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:11.040544 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:11.020809 19554 consensus_meta.cc:287] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.917s	user 0.011s	sys 0.002s
I20260709 13:06:11.046305 19994 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.058280 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:11.038646 19906 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:11.041544 19958 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:11.060034 12695 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21.
I20260709 13:06:11.063922 19888 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:11.063858 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:11.064982 12538 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:06:11.066362 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:11.066941 12538 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
I20260709 13:06:11.066968 20085 raft_consensus.cc:3055] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:11.068766 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:11.047499 19994 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.036304 20026 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.045156 20114 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:11.082577 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:11.084954 12538 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 23.
I20260709 13:06:11.081200 19958 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.101725 13230 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:06:11.082944 20085 raft_consensus.cc:740] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:11.105763 20125 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:11.096921 19956 consensus_meta.cc:287] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.794s	user 0.014s	sys 0.000s
I20260709 13:06:11.093654 19980 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:11.115996 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:11.107458 19958 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.119967 19958 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:11.116854 12538 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 24.
I20260709 13:06:11.108260 19802 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:11.135133 12538 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:11.098320 20061 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.154649 19955 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.171907 19955 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.106611 20125 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:11.178373 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.106282 20085 consensus_queue.cc:260] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.200043 12692 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:11.184664 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1889) took 1789 ms. Trace:
W20260709 13:06:11.207221 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.222790 12622 rpcz_store.cc:276] 0709 13:06:09.394860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.396738 (+  1878us) service_pool.cc:224] Handling call
0709 13:06:09.397091 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:09.960482 (+563391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.184356 (+1223874us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b540031c254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:11.184589 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1287896832}
I20260709 13:06:11.155911 20071 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:11.153292 19906 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:06:11.203387 20074 consensus_meta.cc:287] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.863s	user 0.005s	sys 0.008s
I20260709 13:06:11.233274 19906 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:11.199301 20085 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:11.208077 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:11.194316 20045 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:06:11.198734 20081 log.cc:927] Time spent T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.911s	user 0.003s	sys 0.002s
I20260709 13:06:11.251089 12692 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 27 index: 17. Preceding OpId from leader: term: 28 index: 17. (term mismatch)
I20260709 13:06:11.251627 12692 pending_rounds.cc:85] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 16
I20260709 13:06:11.251904 12692 pending_rounds.cc:107] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 27.17
I20260709 13:06:11.158563 20026 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:11.249676 19987 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:11.157370 20061 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:11.260491 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 52924us
I20260709 13:06:11.204671 19955 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:11.234079 20074 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:11.261189 19777 consensus_meta.cc:287] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.549s	user 0.012s	sys 0.000s
I20260709 13:06:11.179716 20109 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:11.258503 19995 consensus_queue.cc:1059] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:06:11.257670 19987 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:11.256672 20017 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.187887 20125 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:11.259507 20086 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.267961 20118 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.292276 20118 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:11.294297 20109 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:11.296345 20074 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:11.299119 20062 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:11.301268 20096 raft_consensus.cc:3055] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:11.301877 20096 raft_consensus.cc:740] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:11.302946 20096 consensus_queue.cc:260] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:11.304737 20096 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:11.308657 20092 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:11.313472 20068 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:11.315837 20060 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:11.318702 20066 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:11.321214 20086 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:11.361382 12546 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.004s	sys 0.018s
W20260709 13:06:11.361968 12585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.013s	sys 0.031s
W20260709 13:06:11.362530 12546 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.005s	sys 0.018s
W20260709 13:06:11.362646 12585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.013s	sys 0.031s
I20260709 13:06:11.155911 12547 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
W20260709 13:06:11.362646 12539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.008s	sys 0.008s
W20260709 13:06:11.364374 12539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.008s	sys 0.008s
W20260709 13:06:11.367867 12588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.021s	sys 0.019s
W20260709 13:06:11.368264 12614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.014s	sys 0.054s
W20260709 13:06:11.368901 12614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.014s	sys 0.054s
W20260709 13:06:11.368978 12616 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.017s	sys 0.038s
W20260709 13:06:11.369508 12616 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.017s	sys 0.038s
I20260709 13:06:11.370483 12621 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:11.371685 12619 raft_consensus.cc:2393] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 21: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:06:11.368407 12588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.021s	sys 0.020s
I20260709 13:06:11.375133 12622 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 19. Current term is 20. Ops: [18.16-19.17]
I20260709 13:06:11.159215 12538 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:06:11.245294 12659 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:11.252179 12692 raft_consensus.cc:2889] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:11.384474 12692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1819) took 1116 ms. Trace:
I20260709 13:06:11.384984 12692 rpcz_store.cc:276] 0709 13:06:10.268242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.290042 (+ 21800us) service_pool.cc:224] Handling call
0709 13:06:10.290534 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.199616 (+909082us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b58006a1cd0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a94d50aa 00007fc3a9557447 00007fc3a956ffe7 00007fc3a95717de 00007fc3a957bb49 00007fc3a957c416 00007fc3a9578d8f 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4
0709 13:06:11.383768 (+184152us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.384188 (+   420us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271601408}
I20260709 13:06:11.389235 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:11.389918 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:11.390815 13226 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.024s	sys 0.048s
W20260709 13:06:11.391328 13226 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.025s	sys 0.048s
W20260709 13:06:11.391711 13200 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.018s	sys 0.014s
W20260709 13:06:11.392263 13200 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.018s	sys 0.014s
I20260709 13:06:11.393997 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 1311) took 1097 ms. Trace:
W20260709 13:06:11.394639 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 608972us
I20260709 13:06:11.394721 13228 rpcz_store.cc:276] 0709 13:06:10.296438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.296581 (+   143us) service_pool.cc:224] Handling call
0709 13:06:11.393334 (+1096753us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b54006d01d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:11.393642 (+   308us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30802304}
W20260709 13:06:11.397274 19508 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 28 current term: 28 is higher.
I20260709 13:06:11.398504 19777 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.402220 19777 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:11.403174 19777 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.404197 19777 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:11.405975 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:11.407403 12689 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 24.
I20260709 13:06:11.408114 12539 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:06:11.412297 19906 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:11.412712 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:11.413134 19906 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.414081 19906 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:11.385033 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 139704us
I20260709 13:06:11.377305 12622 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:11.416551 12659 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:11.417738 12539 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 13.
I20260709 13:06:11.417985 19959 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:06:11.419840 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:11.422740 19777 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:11.423743 19988 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.425133 19980 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.430047 20001 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:11.431388 19999 raft_consensus.cc:3055] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:11.432081 20017 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:11.428305 19987 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:11.432919 12544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3769) took 1810 ms (client timeout 1601 ms). Trace:
I20260709 13:06:11.433799 19922 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:11.436339 13200 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:11.469183 20001 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.471478 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:11.472972 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:11.474694 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:11.475065 12541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3777) took 1826 ms (client timeout 2188 ms). Trace:
I20260709 13:06:11.475728 12695 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:06:11.474749 20062 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:06:11.477332 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.478727 20059 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:11.479018 20061 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:11.479913 20059 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:11.480136 20061 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:11.480795 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:11.482451 19988 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:11.484403 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:06:11.466077 12544 rpcz_store.cc:269] 0709 13:06:09.622639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.622796 (+   157us) service_pool.cc:224] Handling call
0709 13:06:11.432501 (+1809705us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b54003ab454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:11.432714 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1191540096}
I20260709 13:06:11.485936 20006 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:11.486745 20126 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:11.487793 20071 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.487295 20006 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.477133 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:11.485330 12542 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:06:11.476871 12545 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:11.487254 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:06:11.498286 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 82003.9us
I20260709 13:06:11.487959 20126 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.476826 20062 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:11.503875 19922 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.510967 20086 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:11.501911 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:06:11.481364 20044 consensus_meta.cc:287] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.593s	user 0.012s	sys 0.002s
W20260709 13:06:11.475528 12541 rpcz_store.cc:269] 0709 13:06:09.648754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.651159 (+  2405us) service_pool.cc:224] Handling call
0709 13:06:11.474620 (+1823461us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54002baf54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:11.474862 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2786019200}
I20260709 13:06:11.515148 12539 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:06:11.516305 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:11.516851 19942 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:11.517271 12541 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 23.
I20260709 13:06:11.517784 19980 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.518205 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 29 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:11.518502 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:11.519418 12541 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 24.
I20260709 13:06:11.520242 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:11.520398 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:11.521342 12689 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:11.457880 19999 raft_consensus.cc:740] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:11.510231 20062 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:11.514333 20049 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.521195 13232 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 23.
I20260709 13:06:11.513438 19922 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:11.527365 12659 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:11.520641 19980 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:11.496635 20109 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.532246 20109 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:11.532639 20062 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:06:11.532778 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 52281.2us
I20260709 13:06:11.533730 19988 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:11.534409 20062 consensus_queue.cc:1059] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:11.535408 12588 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:11.536446 20062 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:11.535408 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:11.537923 20097 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:11.538614 20097 raft_consensus.cc:697] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:11.539299 12588 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:11.546991 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 110651us
I20260709 13:06:11.549713 19988 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:11.552389 20062 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:06:11.585419 20109 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:11.586041 19479 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.586875 19479 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.588239 19554 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.589007 19554 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:11.589687 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.591519 19554 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:11.502322 20071 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.583474 20126 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:11.584178 19801 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:06:11.584442 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.584548 19988 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.592882 12545 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:11.540102 20097 consensus_queue.cc:237] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:11.584218 19906 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:11.589406 19479 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:11.627524 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:11.606904 19801 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:06:11.637846 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 98778.4us
I20260709 13:06:11.640615 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:11.573983 20049 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.641604 12659 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:11.635915 19801 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:11.620512 20126 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.646214 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:11.668351 12613 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.013s	sys 0.034s
I20260709 13:06:11.679131 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:11.679893 13232 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:06:11.681730 12615 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.016s	sys 0.019s
W20260709 13:06:11.682112 12615 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.016s	sys 0.019s
I20260709 13:06:11.682816 13235 raft_consensus.cc:3055] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:11.683225 13235 raft_consensus.cc:740] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:11.683387 19995 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:11.683949 19995 raft_consensus.cc:697] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 24 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:11.684212 13235 consensus_queue.cc:260] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:11.685396 19973 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.011s	sys 0.017s
W20260709 13:06:11.685889 19973 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.011s	sys 0.018s
I20260709 13:06:11.686712 19944 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:11.687304 19944 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:11.675637 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 76136.7us
I20260709 13:06:11.687793 19944 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:06:11.691525 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:11.692752 12613 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.014s	sys 0.035s
W20260709 13:06:11.671317 19992 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.017s	sys 0.030s
I20260709 13:06:11.630443 20092 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.160s
W20260709 13:06:11.702288 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:11.677275 19680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.642s	user 0.015s	sys 0.039s
W20260709 13:06:11.707347 12687 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.020s	sys 0.008s
I20260709 13:06:11.708580 20049 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:11.709152 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:11.709822 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:11.710753 20061 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:11.713714 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:11.671170 19479 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:06:11.674191 19999 consensus_queue.cc:260] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:11.685117 19995 consensus_queue.cc:237] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:11.760641 13232 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21.
I20260709 13:06:11.750561 19988 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:11.739770 12541 raft_consensus.cc:1240] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:06:11.740918 13231 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:06:11.722496 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1686) took 1599 ms. Trace:
I20260709 13:06:11.740624 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:11.750499 20006 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:11.740324 12540 raft_consensus.cc:1240] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 20 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:11.724920 12587 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:11.730705 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 1632) took 1079 ms. Trace:
I20260709 13:06:11.730268 13199 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:11.769234 12689 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21.
W20260709 13:06:11.703182 19992 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.018s	sys 0.031s
I20260709 13:06:11.765620 13230 rpcz_store.cc:276] 0709 13:06:10.650791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.651465 (+   674us) service_pool.cc:224] Handling call
0709 13:06:11.730352 (+1078887us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b5400578854. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:11.730537 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":971023616}
I20260709 13:06:11.733446 12513 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:11.764225 13234 rpcz_store.cc:276] 0709 13:06:10.123265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.124238 (+   973us) service_pool.cc:224] Handling call
0709 13:06:10.124567 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.212078 (+ 87511us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.721897 (+1509819us) spinlock_profiling.cc:243] Waited 70.7 ms on lock 0x7b54005794d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:11.722285 (+   388us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162567040}
W20260709 13:06:11.769145 12687 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.021s	sys 0.009s
I20260709 13:06:11.776818 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:11.778841 13228 raft_consensus.cc:2368] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21.
I20260709 13:06:11.780270 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:11.780652 19883 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:11.781216 13232 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:06:11.731051 20071 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:11.766520 19680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.829s	user 0.016s	sys 0.040s
I20260709 13:06:11.736202 19482 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:11.721475 20001 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:11.786859 12547 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:11.745069 19554 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:11.797698 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 67835us
I20260709 13:06:11.797698 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:11.795042 19941 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:11.733742 20126 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:11.802615 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 69422us
I20260709 13:06:11.798823 13233 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
W20260709 13:06:11.808779 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 57322.2us
I20260709 13:06:11.795176 20071 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:11.816460 20001 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:11.819722 20001 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:11.820254 20001 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:11.805969 19482 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:11.825897 19482 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.826300 19482 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:11.815256 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:11.836169 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:11.837322 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4175) took 1540 ms. Trace:
I20260709 13:06:11.827771 20049 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:11.866235 20059 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:11.833724 19554 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.875149 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:11.867682 12618 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:06:11.870844 19834 raft_consensus.cc:3055] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:06:11.874722 20096 consensus_meta.cc:287] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.569s	user 0.014s	sys 0.005s
I20260709 13:06:11.876842 19834 raft_consensus.cc:740] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:06:11.878015 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 153429us
I20260709 13:06:11.878264 19834 consensus_queue.cc:260] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:11.860484 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:11.880224 12587 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:06:11.882251 20129 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.151s	user 0.003s	sys 0.001s
I20260709 13:06:11.882795 12694 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:11.884092 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 1319) took 1174 ms. Trace:
I20260709 13:06:11.884569 13226 rpcz_store.cc:276] 0709 13:06:10.709403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.710602 (+  1199us) service_pool.cc:224] Handling call
0709 13:06:10.710998 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.712663 (+  1665us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.712693 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:10.713163 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:06:11.392153 (+678990us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:06:11.392247 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.392363 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:11.881306 (+488943us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:06:11.883730 (+  2424us) raft_consensus.cc:1685] finished
0709 13:06:11.883756 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.884017 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1205,"raft.queue_time_us":1958,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":10125,"spinlock_wait_cycles":58517376,"thread_start_us":628197,"threads_started":1,"wal-append.queue_time_us":917151}
I20260709 13:06:11.852799 19941 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.029s
W20260709 13:06:11.890443 20139 log.cc:927] Time spent T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.156s	user 0.000s	sys 0.002s
I20260709 13:06:11.838300 20071 raft_consensus.cc:697] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:11.892726 20071 consensus_queue.cc:237] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.860107 13233 raft_consensus.cc:3055] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:11.894222 13233 raft_consensus.cc:740] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:11.894660 12541 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:11.879834 19834 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:11.895298 13233 consensus_queue.cc:260] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.896617 20049 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.896831 13233 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:11.861635 13199 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:11.900017 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 67088.5us
I20260709 13:06:11.905354 13200 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:11.866510 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:11.865937 12688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 2611) took 1474 ms (client timeout 1811 ms). Trace:
I20260709 13:06:11.875483 19554 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:11.911594 12688 rpcz_store.cc:269] 0709 13:06:10.391240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.391385 (+   145us) service_pool.cc:224] Handling call
0709 13:06:11.844200 (+1452815us) spinlock_profiling.cc:243] Waited 45.4 ms on lock 0x7b540009f454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:11.865716 (+ 21516us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104455680}
W20260709 13:06:11.920008 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:11.923411 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 105816us
I20260709 13:06:11.922636 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:11.926313 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 46231.5us
I20260709 13:06:11.914213 20059 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.921394 20133 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:06:11.914512 20006 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:06:11.941664 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 246235us
I20260709 13:06:11.933681 19554 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:11.944204 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:11.840711 12613 rpcz_store.cc:276] 0709 13:06:10.278264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.278390 (+   126us) service_pool.cc:224] Handling call
0709 13:06:10.309473 (+ 31083us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.339222 (+ 29749us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.339264 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:10.382686 (+ 43422us) log.cc:844] Serialized 26 byte log entry
0709 13:06:10.773414 (+390728us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:06:11.697302 (+923888us) log.cc:844] Serialized 14 byte log entry
0709 13:06:11.793724 (+ 96422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.800040 (+  6316us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:11.810907 (+ 10867us) raft_consensus.cc:1685] finished
0709 13:06:11.810932 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.818278 (+  7346us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24062,"prepare.queue_time_us":928422,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":44912,"raft.run_cpu_time_us":496,"raft.run_wall_time_us":32653,"thread_start_us":1236645,"threads_started":2,"wal-append.queue_time_us":642389}
I20260709 13:06:11.958446 19795 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:11.959380 19795 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:11.949677 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:11.962523 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.962631 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3780) took 1181 ms. Trace:
I20260709 13:06:11.963094 12538 rpcz_store.cc:276] 0709 13:06:10.767614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.380115 (+612501us) service_pool.cc:224] Handling call
0709 13:06:11.380660 (+   545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.381368 (+   708us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:06:11.696461 (+315093us) log.cc:844] Serialized 14 byte log entry
0709 13:06:11.948011 (+251550us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.948062 (+    51us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:06:11.948117 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.948576 (+   459us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:11.948699 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67049,"prepare.queue_time_us":537250,"raft.queue_time_us":43457,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":138,"thread_start_us":463885,"threads_started":2}
I20260709 13:06:11.966370 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:11.967379 12620 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:06:11.970530 19966 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:06:11.951375 19554 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.974159 19554 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:11.974100 12619 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:11.944595 19479 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:06:11.973229 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 111901us
I20260709 13:06:11.973390 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:11.988698 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:11.991951 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:11.992555 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:11.993336 12617 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:06:11.994136 20006 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:11.994515 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:11.994441 19941 consensus_queue.cc:1059] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:11.994822 19479 consensus_queue.cc:1059] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:11.992022 12618 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:11.995707 19479 raft_consensus.cc:3055] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:11.995801 20006 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:11.996249 19479 raft_consensus.cc:740] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:11.996395 20006 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:12.001667 20148 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 13:06:12.003405 20144 log.cc:927] Time spent T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260709 13:06:12.004030 20127 log.cc:927] Time spent T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.274s	user 0.001s	sys 0.001s
I20260709 13:06:12.005146 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:11.995462 19941 consensus_queue.cc:1243] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Peer a70479a3b4114f3581095e9890f5d653 log is divergent from this leader: its last log entry 18.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:06:12.005894 12621 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:06:12.006397 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 1321) took 1234 ms. Trace:
I20260709 13:06:12.006816 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1897) took 1400 ms. Trace:
I20260709 13:06:11.995587 20126 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:12.006767 13229 rpcz_store.cc:276] 0709 13:06:10.772137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.772295 (+   158us) service_pool.cc:224] Handling call
0709 13:06:10.772666 (+   371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:10.781299 (+  8633us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.781357 (+    58us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:10.789376 (+  8019us) log.cc:844] Serialized 52 byte log entry
0709 13:06:11.486455 (+697079us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b1800035c20. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:06:11.779138 (+292683us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:11.779236 (+    98us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.779345 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:12.005974 (+226629us) raft_consensus.cc:1685] finished
0709 13:06:12.005993 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.006224 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23152,"raft.queue_time_us":11217,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":21164,"spinlock_wait_cycles":11446144,"thread_start_us":208047,"threads_started":1,"wal-append.queue_time_us":1076614}
I20260709 13:06:11.994328 13228 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:06:11.993336 12588 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:12.016450 12513 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:12.024477 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:12.032312 12587 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:12.033285 12618 raft_consensus.cc:2468] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
W20260709 13:06:12.046324 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 62180.7us
I20260709 13:06:12.048885 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:12.044186 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:12.007256 12614 rpcz_store.cc:276] 0709 13:06:10.606104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.737280 (+131176us) service_pool.cc:224] Handling call
0709 13:06:10.737850 (+   570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.738880 (+  1030us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:06:10.738915 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:10.739421 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 13:06:11.369954 (+630533us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:06:11.370135 (+   181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.370278 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:12.003092 (+632814us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:06:12.006520 (+  3428us) raft_consensus.cc:1685] finished
0709 13:06:12.006538 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.006758 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3061,"raft.queue_time_us":124,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":22496,"spinlock_wait_cycles":78026624,"thread_start_us":629503,"threads_started":1,"wal-append.queue_time_us":883059}
I20260709 13:06:12.054103 12588 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:12.005919 19979 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:12.050549 12538 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:06:12.053534 12547 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:06:12.029819 20126 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:12.064047 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 121189us
I20260709 13:06:11.997386 19479 consensus_queue.cc:260] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.077847 12513 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:12.021448 20059 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.076905 13199 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:12.085738 12621 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:06:12.089105 13200 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:12.065688 19834 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:12.061843 19941 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:12.089936 12588 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:06:12.098663 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 70287.4us
W20260709 13:06:12.099809 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.096863 13200 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:12.104702 19991 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:12.104925 19955 raft_consensus.cc:2764] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:06:12.105729 19955 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:12.106122 19955 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.106447 19955 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:12.106693 20037 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:12.107110 20037 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:12.107482 20037 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:12.087831 19988 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:12.109879 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2312) took 1547 ms. Trace:
I20260709 13:06:12.110294 19988 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:12.110739 20149 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:06:12.110978 20133 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:12.111565 20133 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:12.111595 19944 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.112318 20133 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:12.109710 20125 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.114257 20125 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:12.114697 19479 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:12.114949 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3785) took 1340 ms. Trace:
I20260709 13:06:12.115404 12542 rpcz_store.cc:276] 0709 13:06:10.774396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.540407 (+766011us) service_pool.cc:224] Handling call
0709 13:06:11.543481 (+  3074us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:11.575965 (+ 32484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.576023 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:11.585626 (+  9603us) log.cc:844] Serialized 26 byte log entry
0709 13:06:11.844778 (+259152us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:11.844830 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.844911 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:12.114718 (+269807us) raft_consensus.cc:1685] finished
0709 13:06:12.114744 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.114886 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4646,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":14246,"thread_start_us":250775,"threads_started":1,"wal-append.queue_time_us":386414}
I20260709 13:06:12.117645 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:12.118410 12542 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:06:12.119315 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:12.117720 19994 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:12.069538 20017 consensus_queue.cc:1059] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:06:12.122956 20125 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:12.123581 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:12.110795 19988 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:12.124167 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:12.124802 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:12.124923 12538 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:06:12.126688 19902 raft_consensus.cc:3055] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:06:12.127166 19902 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:12.128238 19902 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.102233 20109 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:12.130299 20109 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:12.132861 20109 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:12.095392 19834 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.137706 19992 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.137952 19834 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:12.138404 19992 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:12.138787 12513 leader_election.cc:400] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21.
I20260709 13:06:12.139279 12513 leader_election.cc:403] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 13:06:12.140817 19992 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:12.141049 20109 raft_consensus.cc:3060] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:12.120934 20006 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.145437 13230 raft_consensus.cc:2393] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 26: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:12.110507 12543 rpcz_store.cc:276] 0709 13:06:10.554238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.554383 (+   145us) service_pool.cc:224] Handling call
0709 13:06:10.554722 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.756215 (+201493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.756250 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.756293 (+    43us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:10.756325 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.053987 (+1297662us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54002baa54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:12.059723 (+  5736us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.101511 (+ 41788us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":462868224}
I20260709 13:06:12.142516 12513 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:06:12.153303 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 69324.8us
I20260709 13:06:12.154167 12622 raft_consensus.cc:2393] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 17: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:12.129477 19902 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:12.102651 19906 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:12.121141 20001 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.079006 20003 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:06:12.128252 20049 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:12.103477 20097 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.162907 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:12.121178 19944 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:12.160764 20092 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:12.109934 19941 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:12.173457 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.174507 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:12.175159 13229 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:06:12.163159 20125 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:12.158942 19906 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:12.182358 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:12.177165 13234 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:12.184852 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:12.160209 19992 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:12.171109 20092 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.154247 20126 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.191308 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:12.192000 13227 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:12.192402 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:12.192948 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:12.194280 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:12.195195 13233 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:12.180261 20125 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.186764 19906 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:12.208182 19958 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:12.210727 20126 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:12.227937 19958 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.210882 12539 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:06:12.211951 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:12.229682 12619 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:06:12.230715 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:12.231479 12619 raft_consensus.cc:2368] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19.
I20260709 13:06:12.232306 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:12.205150 19795 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:12.193682 19992 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:12.223425 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 45412.4us
W20260709 13:06:12.205436 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 251718us
I20260709 13:06:12.203114 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.217481 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:12.251497 12513 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:12.195696 20092 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:12.254407 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:12.255528 20011 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.239914 20154 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.222954 19994 consensus_queue.cc:1059] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.033s
I20260709 13:06:12.240271 20096 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.256793 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:12.256107 12690 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 23.
W20260709 13:06:12.227154 19801 consensus_meta.cc:287] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.539s	user 0.011s	sys 0.000s
W20260709 13:06:12.264308 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.223405 13197 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:12.267519 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.270538 19994 raft_consensus.cc:3055] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:12.270138 20096 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.271206 20154 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:12.206874 20125 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:12.244673 19992 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:12.278527 13234 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:12.279762 12541 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:12.236848 20006 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:12.257453 19973 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:12.247144 19941 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:12.286042 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:12.198835 20097 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:12.296265 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 72964us
I20260709 13:06:12.235793 20133 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:12.308611 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.239275 19482 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.304967 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:12.298760 20003 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:06:12.312902 13197 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:12.221035 19988 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.309449 13227 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
I20260709 13:06:12.324924 13227 pending_rounds.cc:85] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: Aborting all ops after (but not including) 16
I20260709 13:06:12.325459 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.326128 12689 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:06:12.326359 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:12.326970 12541 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:06:12.282051 19994 raft_consensus.cc:740] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:12.308748 12688 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 25.
I20260709 13:06:12.311988 12690 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:06:12.325206 13227 pending_rounds.cc:107] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: Aborting uncommitted NO_OP operation due to leader change: 19.17
I20260709 13:06:12.347456 13227 raft_consensus.cc:2889] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:12.307088 19973 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.284677 19801 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:12.377475 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.351016 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:12.348420 12513 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:12.273720 20011 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:12.352463 20037 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:12.385936 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 74612.6us
W20260709 13:06:12.356091 20155 log.cc:927] Time spent T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:06:12.357098 20045 consensus_meta.cc:287] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.121s	user 0.014s	sys 0.004s
I20260709 13:06:12.391069 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.328584 20126 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:12.374387 19973 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:12.362411 19554 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:12.369905 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 57095.3us
I20260709 13:06:12.371088 20154 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:12.372855 20133 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:12.322427 20085 consensus_meta.cc:287] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.926s	user 0.016s	sys 0.000s
I20260709 13:06:12.383366 12542 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 20: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:12.381829 12689 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:06:12.357841 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.402976 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:12.361694 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.419066 12693 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:12.419469 12691 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:06:12.420411 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.406250 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.381434 19958 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:12.380081 20049 raft_consensus.cc:2804] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:12.382767 20059 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:12.413993 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.415258 12688 raft_consensus.cc:1240] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:06:12.413707 19983 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:12.421880 12690 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:06:12.425060 12620 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:12.392179 20001 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:12.425319 13234 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 25.
I20260709 13:06:12.425977 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:12.422216 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 135842us
I20260709 13:06:12.410104 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:12.436507 12696 raft_consensus.cc:2393] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 17: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:12.414763 19680 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.438583 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:12.449864 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 63234.1us
I20260709 13:06:12.450687 12617 raft_consensus.cc:2410] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
W20260709 13:06:12.453629 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 356807us
I20260709 13:06:12.458120 12695 raft_consensus.cc:2393] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:12.456975 13197 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:12.436957 19983 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.436458 20049 raft_consensus.cc:697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:12.467674 12587 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:12.468839 12614 raft_consensus.cc:2393] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 15: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:12.472105 12696 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:12.472226 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:12.422210 20126 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.451824 19680 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:12.466859 19983 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:12.482852 12620 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
W20260709 13:06:12.486541 20151 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 13:06:12.486732 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:12.487805 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:12.488817 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1715) took 1068 ms. Trace:
I20260709 13:06:12.489480 12545 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 28 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 27. Current term is 28. Ops: [27.17-27.17]
I20260709 13:06:12.489992 19482 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:12.492270 20109 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21.
W20260709 13:06:12.492707 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.561167 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.559816 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:12.560273 12693 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 26.
I20260709 13:06:12.568769 19988 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:12.569247 20049 consensus_queue.cc:237] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.570263 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.570982 20011 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:12.573107 20143 log.cc:927] Time spent T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.705s	user 0.003s	sys 0.000s
I20260709 13:06:12.568714 19906 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.574723 12620 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 21.
I20260709 13:06:12.538972 13232 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:06:12.560531 13199 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:06:12.487772 20128 log.cc:927] Time spent T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.272s	user 0.000s	sys 0.001s
I20260709 13:06:12.578526 12688 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 21.
I20260709 13:06:12.572969 19955 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.516175 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1899) took 1899 ms. Trace:
I20260709 13:06:12.510931 20061 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:12.466102 19479 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.119s
I20260709 13:06:12.574306 12544 rpcz_store.cc:276] 0709 13:06:11.422445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.592533 (+170088us) service_pool.cc:224] Handling call
0709 13:06:11.637290 (+ 44757us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:11.686652 (+ 49362us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:06:11.686682 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:11.687338 (+   656us) log.cc:844] Serialized 26 byte log entry
0709 13:06:12.082964 (+395626us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:06:12.083009 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.083104 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:12.488533 (+405429us) raft_consensus.cc:1685] finished
0709 13:06:12.488557 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.488729 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":156,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":395106,"threads_started":1,"wal-append.queue_time_us":484218}
I20260709 13:06:12.510142 20096 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:12.502964 19801 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:12.498723 19913 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:12.488351 19989 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.602192 13199 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:12.455565 19994 consensus_queue.cc:260] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.613230 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:12.614753 12688 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:12.616426 13229 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 21: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:12.499701 20097 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:12.509969 19554 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:12.619609 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 169050us
I20260709 13:06:12.603819 20061 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.622877 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:12.619144 12614 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 22.
I20260709 13:06:12.602761 12615 rpcz_store.cc:276] 0709 13:06:10.616352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.880433 (+264081us) service_pool.cc:224] Handling call
0709 13:06:10.885264 (+  4831us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.944423 (+ 59159us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:06:11.682511 (+738088us) log.cc:844] Serialized 14 byte log entry
0709 13:06:12.084925 (+402414us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:12.095114 (+ 10189us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:06:12.121725 (+ 26611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.515362 (+393637us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b180032cc80. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a645a2a6 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419
0709 13:06:12.515879 (+   517us) spinlock_profiling.cc:243] Waited 58.9 ms on lock 0x7b54003d09d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:12.515937 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.516112 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":777441,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":76,"raft.queue_time_us":18046,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":10685,"spinlock_wait_cycles":189473152,"thread_start_us":1104350,"threads_started":2,"wal-append.queue_time_us":481249}
I20260709 13:06:12.627676 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:12.626726 12544 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:06:12.493503 19983 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.617807 20011 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:06:12.657102 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 169702us
I20260709 13:06:12.605818 19834 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:12.652241 12587 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:12.690807 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 351181us
I20260709 13:06:12.691167 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.691488 19973 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.692854 20096 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:12.692871 12541 raft_consensus.cc:2393] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 19: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:12.694252 19973 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:12.681793 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 79662.2us
I20260709 13:06:12.695734 19835 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:12.696632 13199 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:12.696918 19955 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:12.697678 19955 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:12.698040 19955 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.698395 19955 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:12.698621 13199 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:12.699777 19479 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:06:12.700279 19479 raft_consensus.cc:697] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:12.701859 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1898) took 2095 ms. Trace:
I20260709 13:06:12.661487 19994 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:12.702283 12616 rpcz_store.cc:276] 0709 13:06:10.606490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.749190 (+142700us) service_pool.cc:224] Handling call
0709 13:06:10.749605 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.752850 (+  3245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.752887 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:10.753600 (+   713us) log.cc:844] Serialized 26 byte log entry
0709 13:06:11.370485 (+616885us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:11.370588 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.370717 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:12.701649 (+1330932us) raft_consensus.cc:1685] finished
0709 13:06:12.701671 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.701801 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4754,"raft.queue_time_us":17412,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":8255,"thread_start_us":597297,"threads_started":1,"wal-append.queue_time_us":1261495}
I20260709 13:06:12.704284 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:12.663045 19906 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:12.663113 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:12.705605 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.663630 20064 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:12.665958 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 29 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:12.709663 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.709839 12688 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 28.
I20260709 13:06:12.643587 19913 raft_consensus.cc:697] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:12.668340 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:12.719440 12620 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:12.672947 20003 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:12.631065 20061 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:06:12.679903 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:12.682380 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 354024us
W20260709 13:06:12.667613 20114 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.004s	sys 0.007s
I20260709 13:06:12.693507 20096 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.701318 19479 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:12.708773 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 45714.2us
I20260709 13:06:12.660491 12546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1710) took 1901 ms. Trace:
W20260709 13:06:12.657771 19995 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.004s	sys 0.025s
I20260709 13:06:12.812656 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:12.706112 19554 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:12.838349 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:12.841866 12691 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 21
W20260709 13:06:12.830830 20114 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.089s	user 0.005s	sys 0.008s
I20260709 13:06:12.713132 20085 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:12.845722 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:12.844970 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:12.844516 12614 raft_consensus.cc:2368] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21.
I20260709 13:06:12.846709 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:12.847173 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:12.848018 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:12.857918 12620 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:06:12.850028 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:12.851660 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:12.852538 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1701) took 2103 ms. Trace:
I20260709 13:06:12.837674 19987 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.800108 20003 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:12.839210 19995 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.005s	sys 0.025s
I20260709 13:06:12.840960 19554 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.713692 20064 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:12.831328 12546 rpcz_store.cc:276] 0709 13:06:10.759237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.374324 (+615087us) service_pool.cc:224] Handling call
0709 13:06:11.374919 (+   595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.375490 (+   571us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:06:11.834393 (+458903us) log.cc:844] Serialized 14 byte log entry
0709 13:06:12.657458 (+823065us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:12.657522 (+    64us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:06:12.657584 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.657648 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.660383 (+  2735us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30504,"prepare.queue_time_us":540747,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":161768,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"thread_start_us":1069845,"threads_started":3,"wal-append.queue_time_us":590598}
I20260709 13:06:12.880518 20097 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:12.880972 20167 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:12.881647 20167 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.881945 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.880554 20064 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:12.883129 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.884298 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:12.885190 12690 raft_consensus.cc:2368] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21.
W20260709 13:06:12.885684 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.886180 12696 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260709 13:06:12.888796 20125 consensus_meta.cc:287] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.539s	user 0.003s	sys 0.006s
W20260709 13:06:12.894968 20165 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:06:12.896347 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:12.902570 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:12.889251 20125 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:12.838189 20092 consensus_meta.cc:287] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.540s	user 0.003s	sys 0.011s
I20260709 13:06:12.904526 20092 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:12.859386 12540 rpcz_store.cc:276] 0709 13:06:10.748984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.750200 (+  1216us) service_pool.cc:224] Handling call
0709 13:06:10.750792 (+   592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.795930 (+1045138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.852248 (+1056318us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b5400410d54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:12.852458 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2155862272}
W20260709 13:06:12.869753 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 232507us
I20260709 13:06:12.867089 20003 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:06:12.869935 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 217810us
I20260709 13:06:12.846036 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:12.870632 19554 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:12.862463 20006 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:12.644793 19989 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:12.876015 19983 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:12.876441 19987 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:12.878377 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:12.879554 19913 consensus_queue.cc:237] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.884363 20167 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:12.927083 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:12.928141 12622 raft_consensus.cc:2393] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 14: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:12.874305 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:12.872238 20096 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:12.873799 20175 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:12.919864 13231 raft_consensus.cc:2393] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 24: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:12.910310 12588 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:12.920814 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2613) took 2519 ms. Trace:
I20260709 13:06:12.921808 12619 raft_consensus.cc:2368] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 23. Current term is 25.
I20260709 13:06:12.935655 20175 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.933315 19906 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:12.937381 19906 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:12.938010 12510 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:12.939203 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 60886.3us
I20260709 13:06:12.939596 20092 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:12.940066 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:12.940944 19959 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:12.941365 19959 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:12.941519 20166 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:12.941802 19959 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:12.942183 20166 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.942495 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.934160 12694 rpcz_store.cc:276] 0709 13:06:10.392064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.392278 (+   214us) service_pool.cc:224] Handling call
0709 13:06:10.392547 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.883297 (+1490750us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.864393 (+981096us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54000c85d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:12.911707 (+ 47314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3338359168}
I20260709 13:06:12.943295 12692 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:06:12.943981 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.944190 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.946135 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.946889 12689 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 20: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:12.947614 12620 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 22.
I20260709 13:06:12.947660 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.945256 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.949607 12692 raft_consensus.cc:2393] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:12.925136 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:12.905673 20125 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:12.942492 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:12.945252 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.950837 12614 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:06:12.928738 12617 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 22.
I20260709 13:06:12.951754 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:12.957610 12662 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:06:12.976120 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 52738.9us
W20260709 13:06:12.977881 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 133484us
I20260709 13:06:12.979668 12619 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 21: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:12.979746 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.982424 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:12.905658 19955 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.984540 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:12.987455 12614 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:06:12.947875 20037 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:12.979944 20167 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:12.990613 20085 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:12.992218 20061 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:12.990348 19987 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:12.994653 12614 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 13:06:12.997714 12512 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:12.998230 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.998651 20167 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:12.998840 12512 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:12.990228 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:12.999356 20167 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.000190 20167 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:13.000406 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:13.001608 12619 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:06:12.989244 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:13.002895 12694 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
W20260709 13:06:13.004130 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 62597us
I20260709 13:06:13.008765 13230 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 23.
I20260709 13:06:13.009982 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.977252 19992 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:06:13.013298 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.982200 20059 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:06:13.015215 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:13.016256 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.017138 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:12.882091 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:13.021589 13234 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 20: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:13.022617 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:13.024158 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:13.032516 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:13.032750 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 45546.2us
I20260709 13:06:13.032147 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:13.033458 12587 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:13.034525 12619 raft_consensus.cc:2393] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 22: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:13.016043 19992 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.036142 12690 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 21.
I20260709 13:06:13.036386 19992 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:13.042557 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:13.014663 19987 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:13.043375 12692 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 22.
W20260709 13:06:13.046216 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 108429us
I20260709 13:06:13.025453 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:13.009414 19834 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:13.048799 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:13.046597 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:13.053840 13231 raft_consensus.cc:2393] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 21: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:13.041399 20059 raft_consensus.cc:697] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 21 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:13.073144 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:13.073335 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:13.075266 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:13.077071 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 43694.5us
I20260709 13:06:13.074064 12614 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:06:13.056654 20114 raft_consensus.cc:2764] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:06:13.056160 19987 raft_consensus.cc:697] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 25 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:13.080411 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:13.059281 20175 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:13.087397 13231 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:06:13.076287 20060 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:13.090763 13235 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:13.092432 19959 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:13.159204 12689 raft_consensus.cc:2393] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 19: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:13.096227 20126 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:13.096997 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
W20260709 13:06:13.160570 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 63672.6us
I20260709 13:06:13.098887 19988 consensus_queue.cc:1059] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:13.163003 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:13.163546 19988 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:06:13.163991 19988 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:13.164390 19988 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:06:13.165771 20109 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:13.167435 20109 raft_consensus.cc:3055] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:13.167768 20109 raft_consensus.cc:740] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:13.168629 20109 consensus_queue.cc:260] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:13.164404 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:13.170310 12621 raft_consensus.cc:2368] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 21. Current term is 22.
I20260709 13:06:13.171080 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:13.171677 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:13.172438 12545 raft_consensus.cc:2393] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 24: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:13.172302 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:13.172905 12621 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:06:13.171082 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:13.174221 12546 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:06:13.174427 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:13.174921 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:13.175341 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:13.176281 12545 raft_consensus.cc:2368] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 17. Current term is 18.
W20260709 13:06:13.177608 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.106786 13235 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:06:13.181748 13235 pending_rounds.cc:85] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: Aborting all ops after (but not including) 12
I20260709 13:06:13.182021 13235 pending_rounds.cc:107] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:06:13.182281 13235 raft_consensus.cc:2889] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:13.183205 20036 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:06:13.183252 19680 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:13.184906 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:13.110047 19989 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:13.113247 20152 log.cc:927] Time spent T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.825s	user 0.004s	sys 0.008s
I20260709 13:06:13.119910 19985 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.186815 19985 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:13.187939 12613 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:06:13.188851 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1639) took 1527 ms. Trace:
I20260709 13:06:13.189790 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:13.190119 20109 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:13.190990 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:13.191859 20150 log.cc:927] Time spent T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.981s	user 0.011s	sys 0.005s
I20260709 13:06:13.123193 13234 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:13.193050 19959 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:13.189221 13235 rpcz_store.cc:276] 0709 13:06:11.661178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.682167 (+ 20989us) service_pool.cc:224] Handling call
0709 13:06:11.682550 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:13.077143 (+1394593us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b58006be1d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a94d50aa 00007fc3a9557447 00007fc3a956ffe7 00007fc3a95717de 00007fc3a957bb49 00007fc3a957c416 00007fc3a9578d8f 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4
0709 13:06:13.182902 (+105759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.188792 (+  5890us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":976228736}
I20260709 13:06:13.196710 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:13.123257 20037 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:13.197945 20037 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:13.206422 19992 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:13.207382 13233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 1646) took 1022 ms. Trace:
I20260709 13:06:13.207932 13233 rpcz_store.cc:276] 0709 13:06:12.184540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.184658 (+   118us) service_pool.cc:224] Handling call
0709 13:06:13.207140 (+1022482us) spinlock_profiling.cc:243] Waited 9.63 ms on lock 0x7b54006fefd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:13.207300 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22142208}
I20260709 13:06:13.208665 19992 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:13.210613 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:13.214469 12691 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:06:13.215610 19988 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:13.216825 12546 raft_consensus.cc:1240] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 29 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 28. Current term is 29. Ops: []
I20260709 13:06:13.217718 20114 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.218218 20114 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:13.220366 13200 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:13.221441 20036 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:06:13.224007 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.126569 12619 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:13.137367 19554 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:13.138031 20059 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 19.18, Last appended by leader: 18, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:13.080042 20166 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:13.138593 20167 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:13.149957 20061 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:13.152033 20060 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:13.153069 20064 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:13.154412 19955 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:13.154817 19906 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:13.078999 19973 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:13.155515 12510 leader_election.cc:400] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19.
I20260709 13:06:13.156829 20045 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.156909 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:13.157254 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 67867.4us
W20260709 13:06:13.267604 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 110810us
I20260709 13:06:13.222572 13200 leader_election.cc:400] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 17. Current term is 18.
I20260709 13:06:13.269731 13200 leader_election.cc:403] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
W20260709 13:06:13.270275 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 47941.7us
I20260709 13:06:13.270629 20167 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:13.271847 20091 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:13.272603 20091 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.272976 20091 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:13.273044 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:13.273829 20036 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:13.274490 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:13.224828 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:13.124436 19987 consensus_queue.cc:237] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:13.226357 13197 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:06:13.276513 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 50291.6us
W20260709 13:06:13.226850 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.278338 20003 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:13.174963 12539 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:13.280808 20003 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:13.271867 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 116504us
I20260709 13:06:13.282768 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:13.282943 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:13.284082 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:13.284262 12510 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:13.284643 12695 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:13.285068 19906 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:13.238337 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:13.242853 20060 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:13.285772 19906 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:13.285989 12690 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 23.
I20260709 13:06:13.287070 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:13.287182 20064 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:13.287412 12510 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:13.288215 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:13.288690 12588 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:13.289243 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:13.251389 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:13.220419 20114 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:13.239775 20140 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:13.279050 19835 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.289520 12617 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:13.289888 13226 raft_consensus.cc:2393] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 19: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:13.289273 19554 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:13.295840 12587 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:13.235898 13199 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:06:13.237660 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.267729 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:13.302549 13197 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:13.235751 19988 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 29 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:13.242723 20037 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:13.290452 20085 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:13.338372 13197 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:13.266974 19973 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:13.311064 12692 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 20: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:13.306655 12539 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
W20260709 13:06:13.310549 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 74791.6us
I20260709 13:06:13.304015 19913 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:13.309365 19835 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:13.322575 20114 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:13.323933 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:13.340844 20167 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:06:13.343931 12547 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 24: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:13.343766 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:13.344856 19913 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:13.345280 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:13.346808 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:13.345331 19913 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:13.324788 12510 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:13.350742 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:13.324919 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:13.352065 12541 raft_consensus.cc:2393] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 19: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:13.325934 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:13.353145 12544 raft_consensus.cc:2393] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 21: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:13.307459 19992 raft_consensus.cc:2764] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
I20260709 13:06:13.330755 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60954 (request call id 1645) took 1146 ms. Trace:
I20260709 13:06:13.353832 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:13.354264 13229 rpcz_store.cc:276] 0709 13:06:12.184021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.184160 (+   139us) service_pool.cc:224] Handling call
0709 13:06:13.330503 (+1146343us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b54006c02d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:13.330684 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":969083264}
W20260709 13:06:13.331566 20142 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 1.469s	user 0.000s	sys 0.012s
I20260709 13:06:13.289774 19906 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:13.355970 12613 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:13.356278 19906 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:13.356734 19906 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:13.355990 12510 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:13.359509 12510 leader_election.cc:400] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21.
I20260709 13:06:13.360224 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:13.360414 12510 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:13.360850 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:13.361325 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1827) took 2455 ms. Trace:
I20260709 13:06:13.361847 12510 leader_election.cc:400] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 23. Current term is 25.
I20260709 13:06:13.362164 12510 leader_election.cc:403] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:06:13.362087 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:13.362439 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:13.362761 20181 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.363082 12510 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:13.363297 20181 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:13.363549 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:13.363612 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:13.364279 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:13.364547 13234 raft_consensus.cc:2393] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 21: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:13.364773 19989 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:13.365098 12510 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:13.365188 19989 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:06:13.365826 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.306170 19801 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:13.357926 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:13.340227 12695 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22.
I20260709 13:06:13.357265 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:13.373953 12619 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 25.
I20260709 13:06:13.290505 20006 consensus_queue.cc:1059] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.049s
I20260709 13:06:13.272023 20045 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:13.339546 19994 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:13.382535 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:13.365801 20126 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:13.342481 20175 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:13.383162 13197 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:13.413733 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:13.346825 19835 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:13.365553 20181 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:13.307626 20140 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:13.342185 20166 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.106s
I20260709 13:06:13.361763 12687 rpcz_store.cc:276] 0709 13:06:10.906259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.906415 (+   156us) service_pool.cc:224] Handling call
0709 13:06:10.906921 (+   506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.907351 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.907395 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:10.907991 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 13:06:11.862815 (+954824us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:11.862948 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.863070 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:13.307268 (+1444198us) spinlock_profiling.cc:243] Waited 41.6 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:06:13.360829 (+ 53561us) raft_consensus.cc:1685] finished
0709 13:06:13.360848 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.361270 (+   422us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1645,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":8485,"spinlock_wait_cycles":95670144,"thread_start_us":864592,"threads_started":1,"wal-append.queue_time_us":953704}
W20260709 13:06:13.523303 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 44997.7us
I20260709 13:06:13.367308 19973 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:13.490056 12694 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 25: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:06:13.504531 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.361757 20109 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:13.382424 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:13.483232 12693 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 25 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:13.475696 12510 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:13.590909 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 207794us
I20260709 13:06:13.577311 12688 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:06:13.375816 19801 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:13.371338 20085 raft_consensus.cc:697] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 23 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:13.376771 19989 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:13.379717 19966 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:13.597904 13197 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:13.600029 20126 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:13.381515 20167 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:13.519843 20061 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:13.605160 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:13.411011 19988 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:06:13.595531 20186 log.cc:927] Time spent T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:06:13.589869 19901 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:13.595558 20109 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:13.594023 20197 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:13.526675 20045 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:13.514892 20060 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:13.414568 20091 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:13.607013 19955 consensus_queue.cc:1059] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:06:13.412981 19479 consensus_queue.cc:1059] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.167s
I20260709 13:06:13.596402 19801 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:13.646332 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 1729) took 1557 ms. Trace:
I20260709 13:06:13.681921 12542 rpcz_store.cc:276] 0709 13:06:12.088565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.119067 (+ 30502us) service_pool.cc:224] Handling call
0709 13:06:13.646051 (+1526984us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b54002cc754. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:13.646249 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":585484160}
W20260709 13:06:13.658402 20185 log.cc:927] Time spent T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
W20260709 13:06:13.697422 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:13.663604 12512 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.195:34641 timed out after 1.910s (SENT) [suppressed 15 similar messages]
I20260709 13:06:13.611207 19994 raft_consensus.cc:697] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:13.702823 12540 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:13.649405 20200 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.703711 12622 raft_consensus.cc:2368] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 17. Current term is 18.
I20260709 13:06:13.665766 20001 raft_consensus.cc:3055] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:06:13.623930 20175 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:13.690025 19680 raft_consensus.cc:2764] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:06:13.613343 19988 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.610901 20167 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.685504 20109 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:13.640758 19966 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:13.694126 20159 raft_consensus.cc:3055] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:06:13.714998 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.717360 20159 raft_consensus.cc:740] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:13.717792 20059 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:13.718376 20159 consensus_queue.cc:260] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:13.729686 19985 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:13.728669 20036 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 17. Current term is 18.
I20260709 13:06:13.732403 19906 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:13.737911 20140 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:13.741518 20193 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
I20260709 13:06:13.741940 20049 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:13.742559 20049 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:13.744715 20061 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:13.744812 20049 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:13.745510 12659 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:13.751807 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.760080 13232 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:13.718698 20059 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:13.761870 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 163446us
I20260709 13:06:13.752153 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1706) took 1727 ms. Trace:
I20260709 13:06:13.765734 13228 rpcz_store.cc:276] 0709 13:06:12.025128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.170527 (+1145399us) service_pool.cc:224] Handling call
0709 13:06:13.224401 (+ 53874us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:13.242951 (+ 18550us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:13.242995 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:13.243063 (+    68us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:13.243108 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.243184 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.743190 (+500006us) spinlock_profiling.cc:243] Waited 53.5 ms on lock 0x7b54006fefd0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:13.752067 (+  8877us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123024640}
I20260709 13:06:13.762645 12540 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 26.
I20260709 13:06:13.708458 20001 raft_consensus.cc:740] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:13.709781 20175 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:06:13.779898 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 329327us
I20260709 13:06:13.773136 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 2582) took 1559 ms. Trace:
I20260709 13:06:13.711961 19988 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:13.720839 20167 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:13.777401 12587 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:06:13.783037 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.782877 13199 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:13.781054 12617 rpcz_store.cc:276] 0709 13:06:12.213645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.976934 (+763289us) service_pool.cc:224] Handling call
0709 13:06:12.986329 (+  9395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:13.307168 (+320839us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.772896 (+465728us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b54002a7bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:13.773080 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":696828288}
I20260709 13:06:13.785614 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:13.764098 19992 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:13.683131 20085 consensus_queue.cc:237] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:13.789062 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:13.792946 12587 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:13.795698 12587 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:13.769784 20159 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:13.797363 20011 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:13.794598 19985 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.802392 12538 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 24.
I20260709 13:06:13.784026 20175 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:13.805373 19906 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:13.807500 20060 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:13.800360 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:06:13.835604 20169 log.cc:927] Time spent T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 1.005s	user 0.003s	sys 0.003s
I20260709 13:06:13.748270 19959 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:06:13.828462 12587 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:13.823309 20177 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.884s	user 0.004s	sys 0.000s
I20260709 13:06:13.867395 20006 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:13.828884 12513 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:13.871135 13232 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:13.824029 20091 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:13.871699 13200 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:13.804837 20049 consensus_queue.cc:1059] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 28.17, Next index: 18, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:13.800283 19968 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.795271 20207 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:13.829540 12444 catalog_manager.cc:5697] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 16 to 19, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 19 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:13.877081 20059 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:13.823885 19994 consensus_queue.cc:237] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:13.878019 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:13.826928 20114 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:13.783371 20140 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.858160 12659 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:13.881687 12510 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:13.763890 19989 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:13.711813 20200 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:13.867161 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:13.801918 19882 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:06:13.804394 19999 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:13.761626 19966 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:13.867445 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1728) took 1826 ms. Trace:
I20260709 13:06:13.907809 13197 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:13.872443 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 79840.8us
W20260709 13:06:13.871141 19913 consensus_meta.cc:287] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.523s	user 0.011s	sys 0.001s
I20260709 13:06:13.901075 19906 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:13.904596 12510 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:13.880198 20125 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:13.910290 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:13.884961 12444 catalog_manager.cc:5697] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:13.871282 20206 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:06:13.914963 12613 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:06:13.914049 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 48265.6us
I20260709 13:06:13.907750 12543 rpcz_store.cc:276] 0709 13:06:12.041240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.165514 (+124274us) service_pool.cc:224] Handling call
0709 13:06:12.168352 (+  2838us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:12.610607 (+442255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:12.610656 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:12.622401 (+ 11745us) log.cc:844] Serialized 26 byte log entry
0709 13:06:12.713543 (+ 91142us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:12.713610 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.713686 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:13.822699 (+1109013us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:06:13.867154 (+ 44455us) raft_consensus.cc:1685] finished
0709 13:06:13.867175 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.867388 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":40394,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":25299328,"thread_start_us":499740,"threads_started":2,"wal-append.queue_time_us":310096}
I20260709 13:06:13.918316 13228 raft_consensus.cc:2393] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 18: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:13.919008 12587 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:13.881985 19985 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:13.915302 19906 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:13.898873 20140 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:13.949425 20125 raft_consensus.cc:697] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:13.914331 19913 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:13.958407 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 166379us
I20260709 13:06:13.960732 12444 catalog_manager.cc:5697] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 12 to 15, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 15 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:13.910140 20036 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:13.870574 20204 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.058s
I20260709 13:06:13.913992 19992 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:13.920053 20060 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:13.923682 13231 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:06:13.914712 20208 raft_consensus.cc:3055] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 LEADER]: Stepping down as leader of term 28
W20260709 13:06:13.921965 20201 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:06:13.915117 19955 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:14.014739 19901 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 23. Current term is 25.
I20260709 13:06:13.883765 19968 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:13.984280 12444 catalog_manager.cc:5697] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:13.990285 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1651) took 1737 ms. Trace:
I20260709 13:06:13.995563 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:13.974136 20206 consensus_queue.cc:1243] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer a11816c5d72e4d1295a242f3ced09e5f log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:06:13.974857 19906 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:14.049901 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:13.990221 19973 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:13.997009 20208 raft_consensus.cc:740] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:06:14.054404 20213 log.cc:927] Time spent T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:06:14.054695 19973 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:14.004103 20109 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:13.988126 19680 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:14.058795 19680 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.059175 19680 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:14.005390 19994 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:14.059859 20109 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:14.059815 19994 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:14.060289 19988 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:14.062065 19994 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:14.062486 19988 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:13.998884 19966 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:13.999240 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:14.007465 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:14.009310 19992 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:14.011057 12659 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:14.011946 20126 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:14.000896 20011 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:14.014083 12438 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36396 (request call id 357) took 33466 ms (client timeout 15000 ms). Trace:
I20260709 13:06:14.005295 12510 leader_election.cc:400] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 21. Current term is 22.
I20260709 13:06:14.080037 12510 leader_election.cc:403] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:13.999187 12689 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:06:14.035905 12693 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:06:14.000901 20140 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:14.002321 19913 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:14.041712 12444 catalog_manager.cc:5697] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 13 to 20, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 20 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:13.989806 20092 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:13.988399 20036 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:13.901152 20001 consensus_queue.cc:260] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:14.043658 19968 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:14.043884 20200 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:14.034572 13227 rpcz_store.cc:276] 0709 13:06:12.252432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.324419 (+ 71987us) service_pool.cc:224] Handling call
0709 13:06:12.324742 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:12.388425 (+ 63683us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:12.388463 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:12.394066 (+  5603us) log.cc:844] Serialized 26 byte log entry
0709 13:06:12.603227 (+209161us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:06:12.603266 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.603327 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:13.726250 (+1122923us) spinlock_profiling.cc:243] Waited 7.43 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:06:13.979965 (+253715us) raft_consensus.cc:1685] finished
0709 13:06:13.979986 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.990217 (+ 10231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17095424,"thread_start_us":155941,"threads_started":1,"wal-append.queue_time_us":208035}
I20260709 13:06:14.002784 20125 consensus_queue.cc:237] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:14.002477 19985 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:14.086464 20092 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.104115 20092 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:14.046288 20003 raft_consensus.cc:3055] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:14.053882 20208 consensus_queue.cc:260] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:14.106381 20208 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:06:14.108045 20221 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:06:14.108899 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.108700 20221 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:14.109421 20045 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:14.110002 20045 raft_consensus.cc:697] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 21 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:14.111093 20221 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:14.110885 20045 consensus_queue.cc:237] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:14.063896 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:14.064009 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:14.112545 12614 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:14.113873 20216 consensus_queue.cc:1059] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.021s
I20260709 13:06:14.093462 20036 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:14.064697 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:14.064819 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:14.003774 19989 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:14.068240 20192 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.548s	user 0.001s	sys 0.001s
I20260709 13:06:14.122859 12613 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:06:13.995471 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:13.997867 20006 raft_consensus.cc:697] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 22 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:14.124207 12694 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:06:14.124794 20006 consensus_queue.cc:237] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:14.125392 19992 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:14.075839 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 156933us
W20260709 13:06:14.130367 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.131515 12545 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:06:14.071821 20176 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:06:14.135391 19994 consensus_queue.cc:1175] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7ad68e814a7741488971822f2598183a" responder_term: 28 status { last_received { term: 28 index: 17 } last_committed_idx: 17 last_received_current_leader { term: 28 index: 17 } }
I20260709 13:06:14.136266 12616 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
W20260709 13:06:14.082170 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 71223.8us
W20260709 13:06:14.086421 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 109004us
W20260709 13:06:14.137881 12616 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 2598) took 1784 ms (client timeout 2009 ms). Trace:
I20260709 13:06:14.137969 12510 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:06:14.138511 12616 rpcz_store.cc:269] 0709 13:06:12.353786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.703970 (+350184us) service_pool.cc:224] Handling call
0709 13:06:14.137623 (+1433653us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54002a80d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:14.137779 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3291795328}
I20260709 13:06:14.140151 20071 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.090734 12444 catalog_manager.cc:5697] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 15 to 16, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 16 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:14.140765 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.140733 20071 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:14.127128 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 127958us
I20260709 13:06:14.141522 12543 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:06:14.142386 12444 catalog_manager.cc:5697] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:14.143177 12662 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:14.143783 12444 catalog_manager.cc:5697] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 11 to 23. New cstate: current_term: 23 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:14.145752 19989 raft_consensus.cc:2764] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:06:14.146507 19989 consensus_queue.cc:1059] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:14.147369 12662 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:14.147704 19973 raft_consensus.cc:3055] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:14.148168 19973 raft_consensus.cc:740] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:14.148274 12662 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:14.094314 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:14.105322 20003 raft_consensus.cc:740] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:13.998610 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:14.002203 19801 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:14.155292 12696 raft_consensus.cc:2393] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 19: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:14.093694 20219 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:14.092686 13197 leader_election.cc:400] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 17. Current term is 18.
W20260709 13:06:14.156738 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 67086.6us
I20260709 13:06:14.148890 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:14.079984 12438 rpcz_store.cc:269] 0709 13:05:40.507205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.509591 (+  2386us) service_pool.cc:224] Handling call
0709 13:06:13.917143 (+33407552us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:03.013834 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:03.017208 (+  3374us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:03.017266 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:06:03.017287 (+    21us) tablet.cc:662] Decoding operations
0709 13:06:03.055608 (+ 38321us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:03.055721 (+   113us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:03.055748 (+    27us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:06:03.083969 (+ 28221us) tablet.cc:701] Row locks acquired
0709 13:06:03.128456 (+ 44487us) write_op.cc:260] PREPARE: finished
0709 13:06:03.144700 (+ 16244us) write_op.cc:270] Start()
0709 13:06:03.154305 (+  9605us) write_op.cc:276] Timestamp: P: 1783602363135745 usec, L: 0
0709 13:06:03.154346 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:06:03.155092 (+   746us) log.cc:844] Serialized 8743 byte log entry
0709 13:06:04.226865 (+1071773us) op_driver.cc:464] REPLICATION: finished
0709 13:06:04.490791 (+263926us) write_op.cc:301] APPLY: starting
0709 13:06:04.490901 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:04.521508 (+ 30607us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:04.526758 (+  5250us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:04.849980 (+323222us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:04.850655 (+   675us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=44,key_file_lookups=44,delta_file_lookups=44,mrs_lookups=0
0709 13:06:04.861815 (+ 11160us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b5400235fd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957632a 00007fc3a94fbf14 00007fc3a94fbec3 00007fc3a94fbe38 00007fc3a94fbdf3 00007fc3a94fb0dc 00007fc3a9524e16 00007fc3a950ccbb 00007fc3a94f739d 00007fc3a94fad75
0709 13:06:04.884512 (+ 22697us) write_op.cc:312] APPLY: finished
0709 13:06:04.887681 (+  3169us) log.cc:844] Serialized 196 byte log entry
0709 13:06:04.887926 (+   245us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:04.888896 (+   970us) write_op.cc:454] Released schema lock
0709 13:06:04.888998 (+   102us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:04.909438 (+ 20440us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:04.911305 (+  1867us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":536696,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":255242,"apply.run_cpu_time_us":36294,"apply.run_wall_time_us":400554,"cfile_cache_hit":90,"cfile_cache_hit_bytes":96131,"num_ops":22,"prepare.queue_time_us":164672,"prepare.run_cpu_time_us":46228,"prepare.run_wall_time_us":421195,"raft.queue_time_us":249417,"raft.run_cpu_time_us":18147,"raft.run_wall_time_us":713884,"replication_time_us":1053444,"spinlock_wait_cycles":62537472,"thread_start_us":742252,"threads_started":4,"wal-append.queue_time_us":350630,"wal-append.run_cpu_time_us":18644,"wal-append.run_wall_time_us":2414121}]]}
W20260709 13:06:14.160068 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 249935us
I20260709 13:06:14.160431 13197 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:14.150394 12444 catalog_manager.cc:5697] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 12 to 13, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 13 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.151850 12614 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 23.
I20260709 13:06:14.152743 12693 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:06:14.154520 12689 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:06:14.146898 19987 raft_consensus.cc:2764] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:06:14.164469 19554 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:14.168128 19554 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:14.165967 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.168440 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:14.170390 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.168541 19554 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:14.166194 12444 catalog_manager.cc:5697] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 13 to 15, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 15 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:14.172581 12540 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 23. Current term is 24. Ops: [20.14-23.15]
I20260709 13:06:14.170440 12693 raft_consensus.cc:2393] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 17: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:14.157394 19988 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:06:14.178114 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.183809 12538 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:06:14.184945 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:14.178690 12687 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:14.180063 12545 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 22: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:14.180624 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:14.186844 12689 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:06:14.183331 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:14.188156 12693 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
W20260709 13:06:14.191679 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.193789 13229 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 19 index: 18. Preceding OpId from leader: term: 21 index: 19. (index mismatch)
I20260709 13:06:14.150004 19906 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:14.208082 20003 consensus_queue.cc:260] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:14.208643 20211 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:14.159754 19968 consensus_queue.cc:1059] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.034s
I20260709 13:06:14.093925 20207 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.093s
I20260709 13:06:14.171958 19992 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:14.190621 12444 catalog_manager.cc:5697] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 3 to 14. New cstate: current_term: 14 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:14.214768 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:14.219259 13197 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:14.220899 12695 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:14.210589 19801 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:14.222916 12542 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16. Ops: []
W20260709 13:06:14.228036 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.228503 12689 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 19 index: 18. Preceding OpId from leader: term: 21 index: 19. (index mismatch)
I20260709 13:06:14.226011 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:14.225466 19554 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:14.233618 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.155547 19973 consensus_queue.cc:260] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:14.245220 13228 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 20: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:14.246884 12538 raft_consensus.cc:1240] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:14.247354 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:06:14.247869 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.251180 19554 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:14.252239 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.252153 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.251526 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.258706 12546 raft_consensus.cc:2393] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 17: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:14.192237 19999 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.053s
I20260709 13:06:14.227305 20211 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:14.266026 12543 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:06:14.267686 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:14.267809 12444 catalog_manager.cc:5697] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:14.240444 19992 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.264060 20222 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:14.248752 19968 consensus_queue.cc:1243] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 25.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 13:06:14.276307 20222 raft_consensus.cc:697] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:14.276495 20071 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:14.252147 20003 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:14.277923 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:14.287264 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:14.294495 12620 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:14.268074 20211 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:14.295346 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.295962 12538 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:06:14.291882 12444 catalog_manager.cc:5697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 10 to 18, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 18 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.270474 20159 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.273710 19992 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:14.305367 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:14.308041 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:14.306052 12692 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
W20260709 13:06:14.301721 20197 consensus_meta.cc:287] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.617s	user 0.008s	sys 0.003s
I20260709 13:06:14.309392 12444 catalog_manager.cc:5697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 14 to 16, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 16 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:14.318987 12620 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:06:14.320879 13197 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:14.323310 12444 catalog_manager.cc:5697] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 15 to 18, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 18 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:14.324615 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:14.329981 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.331446 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.331722 20001 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:14.332056 12544 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:06:14.320772 20197 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:14.333045 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.333598 13231 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:14.324097 19554 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:14.353772 19554 raft_consensus.cc:697] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:14.353660 20222 consensus_queue.cc:237] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:14.354676 19554 consensus_queue.cc:237] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:14.325150 12444 catalog_manager.cc:5697] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 15 to 22. New cstate: current_term: 22 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:14.305222 20159 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:14.341976 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:14.342165 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:14.342923 20224 log.cc:927] Time spent T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:06:14.342833 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:14.370354 13234 raft_consensus.cc:2368] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 20. Current term is 21.
I20260709 13:06:14.371013 12547 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21.
I20260709 13:06:14.371225 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:14.343621 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 29 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:14.372345 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:14.345487 13230 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:06:14.373137 12547 raft_consensus.cc:2376] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16. Re-sending same reply.
I20260709 13:06:14.348157 12510 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:14.349825 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:14.352247 19906 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:14.362123 12587 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:14.377087 13234 raft_consensus.cc:2393] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 19: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:14.365834 12540 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 25.
I20260709 13:06:14.292639 20167 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:14.358925 13199 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:14.344373 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:14.347191 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:14.374317 12545 raft_consensus.cc:2376] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 15. Re-sending same reply.
I20260709 13:06:14.381021 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:14.381975 12444 catalog_manager.cc:5697] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 14 to 15, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 15 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:14.376579 12587 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:14.383612 12587 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:14.377705 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 174979us
W20260709 13:06:14.343657 20220 log.cc:927] Time spent T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:06:14.387338 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:14.388268 12662 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:14.387326 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.391162 12540 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:14.392797 13233 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 20: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:14.388629 13199 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:14.394774 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 244609us
I20260709 13:06:14.399348 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.399287 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 29 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.401041 12540 raft_consensus.cc:2368] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 20. Current term is 21.
I20260709 13:06:14.401154 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.403309 13199 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:14.402184 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.408367 12662 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:14.375473 20175 consensus_meta.cc:287] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.504s	user 0.003s	sys 0.007s
I20260709 13:06:14.409603 12544 raft_consensus.cc:2393] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 29: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:14.409762 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:14.411330 12659 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:14.374959 19973 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:14.399034 20091 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:14.440168 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:14.448096 13233 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:06:14.387436 19999 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:14.437552 13200 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:14.449738 20096 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:14.451577 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:14.434702 20200 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:14.403333 19994 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.050s
I20260709 13:06:14.409024 19959 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:14.409193 19966 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:14.448206 12444 catalog_manager.cc:5697] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 13 to 16, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 16 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:14.430835 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:14.465106 20091 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.412731 12547 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 14.
I20260709 13:06:14.456493 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.437330 12587 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:14.404656 19989 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:14.436905 20049 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:06:14.471453 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 63172.4us
I20260709 13:06:14.466701 19999 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.413422 20085 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:14.477648 19955 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:14.530643 19999 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:14.530447 20085 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.535198 20085 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:14.408458 20223 consensus_queue.cc:1059] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.111s
I20260709 13:06:14.501253 20216 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:14.538309 20216 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:14.539080 20036 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:14.471894 20096 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.540509 20216 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:14.540761 20096 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:14.541185 20036 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:14.482743 20167 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:14.484023 20159 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:14.468596 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.546511 12542 raft_consensus.cc:2393] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 23: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:14.547724 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.548846 20096 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:14.549959 13230 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:14.551013 20096 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:14.552237 19992 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:14.553351 19955 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:14.554634 20049 raft_consensus.cc:697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:14.555579 20049 consensus_queue.cc:237] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:14.521044 19989 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:14.558544 19989 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:14.507615 19966 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:14.562048 19966 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:14.489734 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.489887 12588 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:14.496577 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:14.448186 19801 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:06:14.566658 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 93715us
I20260709 13:06:14.567690 12588 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:14.413728 19968 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:14.488965 13200 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:14.460526 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.448666 20221 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.036s
I20260709 13:06:14.516090 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:14.574209 13228 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 23: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:06:14.574144 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 85260.4us
I20260709 13:06:14.492383 20071 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:14.518487 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 81224.5us
I20260709 13:06:14.439271 20175 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:14.520519 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 54533.2us
I20260709 13:06:14.583573 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:14.520462 12662 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:14.434715 20092 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:14.523629 12444 catalog_manager.cc:5697] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 13 to 15, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 15 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:14.531140 12540 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:06:14.531601 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.589063 12539 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:06:14.466511 20045 consensus_queue.cc:1059] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:06:14.466831 19680 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:14.564756 12545 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:06:14.517972 20091 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:14.569345 13226 raft_consensus.cc:2410] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 29 because replica has last-logged OpId of term: 28 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 16.
I20260709 13:06:14.570596 12588 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:14.572629 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.572860 13235 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:14.522794 19985 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:14.605399 12444 catalog_manager.cc:5697] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 14 to 16, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 16 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:14.590581 13228 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:14.537480 20223 raft_consensus.cc:3055] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:14.596540 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:14.597133 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:14.597802 12617 raft_consensus.cc:1240] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:14.598613 13234 raft_consensus.cc:1240] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:14.569111 20001 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:14.604919 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:14.609309 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:14.609495 12588 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:14.609799 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:14.612419 12613 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 25.
I20260709 13:06:14.607888 12540 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:06:14.615954 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:14.616778 12540 raft_consensus.cc:2393] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 19: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:14.578728 20216 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:14.609678 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:14.618604 12619 raft_consensus.cc:2393] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 18: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:14.578019 19801 raft_consensus.cc:697] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:14.622613 12621 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 13:06:14.593005 20208 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:14.623116 12616 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
I20260709 13:06:14.630607 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:14.625833 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.628887 12690 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:06:14.633239 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:14.636651 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:14.637468 12545 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 20: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:14.610376 19985 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.632030 12444 catalog_manager.cc:5697] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:14.609064 20223 raft_consensus.cc:740] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:14.609028 20059 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:14.654829 12540 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:06:14.605830 20217 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:14.619774 19968 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:14.670377 12541 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 23.
I20260709 13:06:14.672323 12444 catalog_manager.cc:5697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:14.633774 20071 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:06:14.676942 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 156555us
I20260709 13:06:14.677910 12662 leader_election.cc:400] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 20. Current term is 21.
I20260709 13:06:14.678246 12662 leader_election.cc:403] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:14.677018 12444 catalog_manager.cc:5697] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 11 to 17, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 17 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.649580 20001 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:14.653285 19985 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:14.650651 19959 raft_consensus.cc:697] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:14.682040 12444 catalog_manager.cc:5697] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.705451 12444 catalog_manager.cc:5697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 17 to 18, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 18 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.707032 12444 catalog_manager.cc:5697] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 17 to 18, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 18 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:14.713104 19959 consensus_queue.cc:237] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:14.738392 12544 raft_consensus.cc:1240] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:14.738052 19801 consensus_queue.cc:237] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:14.739880 12544 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:14.746524 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:14.748682 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:06:14.751827 12512 leader_election.cc:336] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Timed out: RequestConsensusVote RPC to 127.11.44.195:34641 timed out after 1.517s (SENT)
I20260709 13:06:14.703645 19992 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:14.677765 20059 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:14.763586 12695 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:06:14.771572 12539 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 23. Current term is 24. Ops: []
W20260709 13:06:14.775916 19988 consensus_meta.cc:287] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.589s	user 0.006s	sys 0.003s
I20260709 13:06:14.776513 19988 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 21. Current term is 22.
I20260709 13:06:14.773422 12539 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 13:06:14.778309 12539 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:06:14.779562 12539 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:14.779913 20211 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:14.787406 12541 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:06:14.790666 19680 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:14.791389 19680 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:14.791800 19680 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.792204 19680 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:14.793310 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:14.793965 12540 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:14.795892 19987 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307) with higher term. Message: Invalid argument: T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 20. Current term is 21.
I20260709 13:06:14.694634 19968 raft_consensus.cc:697] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 25 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:14.805485 12540 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 25.
I20260709 13:06:14.815840 12538 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22.
I20260709 13:06:14.824491 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:14.835049 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:14.835808 12618 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 25.
I20260709 13:06:14.800791 19999 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:14.696257 20217 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:14.842202 12614 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 25.
I20260709 13:06:14.823410 20175 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:14.840960 20011 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:14.861755 20237 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
W20260709 13:06:14.868865 20003 consensus_meta.cc:287] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.570s	user 0.004s	sys 0.005s
W20260709 13:06:14.909418 12512 leader_election.cc:336] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Timed out: RequestConsensusVote RPC to 127.11.44.195:34641 timed out after 1.583s (SENT)
I20260709 13:06:14.912782 12512 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:14.880020 13197 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:14.915513 13197 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:14.911685 20177 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 13:06:14.915087 20169 log.cc:927] Time spent T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:06:14.921988 12512 leader_election.cc:336] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Timed out: RequestConsensusVote RPC to 127.11.44.195:34641 timed out after 1.617s (SENT)
I20260709 13:06:14.868902 20217 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:14.914054 20216 raft_consensus.cc:697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 21 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:14.878428 20059 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:14.860260 19989 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:14.918503 19983 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:06:14.933758 12512 leader_election.cc:336] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Timed out: RequestConsensusVote RPC to 127.11.44.195:34641 timed out after 1.638s (SENT)
I20260709 13:06:14.950189 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:14.920617 20175 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:14.907544 20011 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:14.926383 19988 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:14.841241 20223 consensus_queue.cc:260] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:14.928545 20211 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:14.944545 12542 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:06:14.951368 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:14.950209 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:14.972540 12688 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 20: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:14.972577 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:14.974241 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:14.975849 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:14.977016 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:14.950203 12512 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:14.958020 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 327456us
I20260709 13:06:14.965653 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:14.969054 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:14.981390 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:14.981712 12695 raft_consensus.cc:2368] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 21. Current term is 22.
I20260709 13:06:14.987478 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:14.988075 12691 raft_consensus.cc:2393] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 19: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:14.916844 19968 consensus_queue.cc:237] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:14.990568 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 56840.8us
I20260709 13:06:14.988883 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:14.992859 12588 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:14.993125 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:15.007758 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:15.021639 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:15.013083 12512 leader_election.cc:336] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Timed out: RequestConsensusVote RPC to 127.11.44.195:34641 timed out after 1.663s (SENT)
I20260709 13:06:15.008214 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:14.964174 20175 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.963120 20246 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:14.972704 19983 raft_consensus.cc:697] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:15.027060 12688 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 21: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:15.028098 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:06:15.021363 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 343554us
I20260709 13:06:14.993155 20126 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:15.106987 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:15.107908 12693 raft_consensus.cc:2368] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:06:15.029824 12696 raft_consensus.cc:2368] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19.
W20260709 13:06:15.096951 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 83922.4us
I20260709 13:06:15.099327 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:15.100716 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:15.100121 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:15.027431 12689 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 15.
I20260709 13:06:15.115540 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:15.029330 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:15.123363 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:15.123776 12662 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:15.125277 12662 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:15.124090 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:15.007225 20243 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:06:15.134259 12512 leader_election.cc:336] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Timed out: RequestConsensusVote RPC to 127.11.44.195:34641 timed out after 1.893s (SENT)
I20260709 13:06:15.134846 12512 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:15.135905 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:15.136498 12588 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:15.130312 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:15.133155 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:15.140509 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:15.141894 12695 raft_consensus.cc:2393] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 21: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:15.143428 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:15.145696 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:15.146466 12696 raft_consensus.cc:2368] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19.
I20260709 13:06:15.147596 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:15.148155 12693 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:15.027554 20182 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.096729 20175 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:15.032286 20221 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:15.024703 20140 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.109s
I20260709 13:06:15.156054 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:15.180718 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 46483.3us
I20260709 13:06:15.157042 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:15.156713 19988 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:15.201577 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:15.202445 12615 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:15.204761 12539 raft_consensus.cc:1240] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:15.207571 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:15.166417 19959 consensus_queue.cc:1059] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:06:15.209619 20244 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:15.193353 19987 consensus_queue.cc:1059] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.018s
I20260709 13:06:15.199211 20096 consensus_queue.cc:1059] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.013s
W20260709 13:06:15.212365 19985 consensus_meta.cc:287] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.001s
I20260709 13:06:15.176332 20236 consensus_queue.cc:1059] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
W20260709 13:06:15.214164 20247 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 13:06:15.213789 19983 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:15.209640 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:15.174252 20182 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:15.225226 12617 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:15.166620 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:15.130515 19994 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.173192 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:15.137809 20242 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:15.176192 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:15.141676 20045 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:15.146155 20217 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.062s
I20260709 13:06:15.227804 12693 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 23.
I20260709 13:06:15.328564 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:15.228214 12512 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:15.167434 19999 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:15.212807 19985 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:15.355407 19988 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:15.356343 12659 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:15.355688 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:15.360018 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 131944us
I20260709 13:06:15.361476 12512 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:15.363426 12512 leader_election.cc:400] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:06:15.363816 12512 leader_election.cc:403] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:06:15.358403 20251 raft_consensus.cc:3055] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:15.365365 20251 raft_consensus.cc:740] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:15.366573 20251 consensus_queue.cc:260] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:15.368251 20251 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:15.371209 19988 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:15.372231 19988 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:15.380597 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:15.382081 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:15.404942 20011 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:15.231632 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:15.132083 20246 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:15.235567 12696 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:15.236305 12688 raft_consensus.cc:2393] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 19: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:06:15.199816 19966 consensus_meta.cc:287] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.003s
I20260709 13:06:15.233426 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:15.237711 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:15.238511 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:15.031038 20216 consensus_queue.cc:237] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:15.156451 12613 raft_consensus.cc:2393] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 18: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:15.284262 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:15.167850 20211 consensus_queue.cc:1059] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:06:15.167840 20238 consensus_queue.cc:1059] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.072s
I20260709 13:06:15.329986 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:15.405100 20256 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:06:15.282999 20242 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.493522 12691 raft_consensus.cc:2393] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 21: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:15.502156 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:15.512403 12539 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:15.492698 12617 raft_consensus.cc:2368] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:06:15.493299 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:15.533385 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:15.544148 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:15.544950 12617 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 23.
I20260709 13:06:15.545994 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:15.546685 12617 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:06:15.441529 20091 consensus_meta.cc:287] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.824s	user 0.007s	sys 0.002s
I20260709 13:06:15.553764 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:06:15.433542 20085 consensus_meta.cc:287] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.898s	user 0.010s	sys 0.000s
W20260709 13:06:15.459824 19680 consensus_meta.cc:287] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.667s	user 0.006s	sys 0.006s
I20260709 13:06:15.346941 20045 raft_consensus.cc:697] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:15.560096 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:15.348145 19989 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:15.427407 20182 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:15.498185 20037 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:15.560204 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.534207 20242 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:15.580014 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:15.582118 12618 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:06:15.585757 12544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.021s	sys 0.041s
W20260709 13:06:15.586097 12544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.021s	sys 0.041s
I20260709 13:06:15.588483 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3816) took 1241 ms. Trace:
I20260709 13:06:15.283386 19994 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:15.588886 12544 rpcz_store.cc:276] 0709 13:06:14.346777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.740996 (+394219us) service_pool.cc:224] Handling call
0709 13:06:14.741512 (+   516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:14.790133 (+ 48621us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:06:14.971001 (+180868us) log.cc:844] Serialized 14 byte log entry
0709 13:06:15.588094 (+617093us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:15.588154 (+    60us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:15.588205 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.588276 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:15.588425 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":644,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"thread_start_us":740202,"threads_started":2}
I20260709 13:06:15.576179 12688 raft_consensus.cc:2376] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 23. Re-sending same reply.
I20260709 13:06:15.596968 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:15.609043 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 472607us
I20260709 13:06:15.608995 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:15.641495 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:15.642179 12614 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:06:15.631690 12588 connection.cc:256] RPC call timeout handler was delayed by -1.1177945450000379s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1686s for a response
W20260709 13:06:15.652446 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 289166us
I20260709 13:06:15.653430 12512 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:15.585377 20059 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:06:15.657140 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 300585us
I20260709 13:06:15.670292 12512 leader_election.cc:400] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19.
I20260709 13:06:15.670735 12512 leader_election.cc:403] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 13:06:15.654372 12614 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
I20260709 13:06:15.536775 19966 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:15.671762 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:15.675952 12512 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:15.636353 20244 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.567067 20091 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:15.570043 19680 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:15.688601 12695 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:15.575069 20085 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:15.711683 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 1352) took 1522 ms. Trace:
I20260709 13:06:15.600826 12688 raft_consensus.cc:2393] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 19: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:15.675630 19989 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.712250 13231 rpcz_store.cc:276] 0709 13:06:14.189154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.189354 (+   200us) service_pool.cc:224] Handling call
0709 13:06:14.214262 (+ 24908us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:14.353292 (+139030us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.711384 (+1358092us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54007c38d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:15.711621 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":273889152}
I20260709 13:06:15.608019 20037 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:15.788859 12618 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 23.
I20260709 13:06:15.801177 12689 raft_consensus.cc:2368] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21.
I20260709 13:06:15.803530 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1866) took 1767 ms. Trace:
I20260709 13:06:15.804042 12687 rpcz_store.cc:276] 0709 13:06:14.035909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.036083 (+   174us) service_pool.cc:224] Handling call
0709 13:06:14.065186 (+ 29103us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:14.186121 (+120935us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.803233 (+1617112us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540009cc54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:15.803458 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245516672}
I20260709 13:06:15.810492 12620 raft_consensus.cc:2393] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:15.819028 12695 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
W20260709 13:06:15.829962 19554 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.011s	sys 0.038s
I20260709 13:06:15.833515 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2662) took 1089 ms. Trace:
I20260709 13:06:15.834182 12694 rpcz_store.cc:276] 0709 13:06:14.743769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.747756 (+  3987us) service_pool.cc:224] Handling call
0709 13:06:14.748091 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:14.793985 (+ 45894us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 13:06:14.794322 (+   337us) log.cc:844] Serialized 14 byte log entry
0709 13:06:14.968136 (+173814us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:15.006889 (+ 38753us) log.cc:844] Serialized 26 byte log entry
0709 13:06:15.008120 (+  1231us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:06:15.008186 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.008297 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:15.833255 (+824958us) raft_consensus.cc:1685] finished
0709 13:06:15.833278 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:15.833436 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45426,"prepare.queue_time_us":659,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":31,"raft.queue_time_us":59080,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":10601,"thread_start_us":173359,"threads_started":1,"wal-append.queue_time_us":361614}
W20260709 13:06:15.833617 19554 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.011s	sys 0.038s
W20260709 13:06:15.834280 20221 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.027s	sys 0.026s
I20260709 13:06:15.694993 20244 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:15.846078 19959 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.024s	sys 0.035s
I20260709 13:06:15.706385 12539 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:15.958913 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:15.959673 19554 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.959690 12613 raft_consensus.cc:2393] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 17: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:15.947393 20217 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:15.946317 20221 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.027s	sys 0.026s
I20260709 13:06:15.807121 19989 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:15.960271 19554 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:15.965700 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:06:15.961061 19959 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.024s	sys 0.036s
W20260709 13:06:15.994345 20253 log.cc:927] Time spent T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
W20260709 13:06:15.995371 20258 log.cc:927] Time spent T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 13:06:15.996380 20252 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.349s	user 0.000s	sys 0.001s
W20260709 13:06:16.006413 20259 log.cc:927] Time spent T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.323s	user 0.000s	sys 0.001s
W20260709 13:06:16.011121 20270 log.cc:927] Time spent T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:16.022759 19994 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:16.027359 20240 raft_consensus.cc:3055] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:16.041501 12613 raft_consensus.cc:2368] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21.
I20260709 13:06:15.962118 20274 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:15.963997 20266 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:15.832319 20045 consensus_queue.cc:237] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:16.078401 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:16.079295 12616 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:16.030836 20221 raft_consensus.cc:697] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 23 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:15.947487 20254 consensus_queue.cc:1059] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.158s
W20260709 13:06:16.050554 20251 consensus_meta.cc:287] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.682s	user 0.005s	sys 0.007s
I20260709 13:06:16.076928 20266 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.082719 20275 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:06:16.084175 19680 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:16.085379 20085 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:16.088409 12538 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 2344) took 1789 ms (client timeout 1686 ms). Trace:
W20260709 13:06:16.136754 12538 rpcz_store.cc:269] 0709 13:06:14.299314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.300406 (+  1092us) service_pool.cc:224] Handling call
0709 13:06:16.088169 (+1787763us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b5400079ed4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:16.088322 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1077422464}
I20260709 13:06:16.091522 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1721) took 1750 ms. Trace:
I20260709 13:06:16.138302 13230 rpcz_store.cc:276] 0709 13:06:14.341098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.381976 (+ 40878us) service_pool.cc:224] Handling call
0709 13:06:14.406464 (+ 24488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:14.550338 (+143874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.091257 (+1540919us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b5400570dd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:16.091455 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":329566080}
I20260709 13:06:16.098122 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1861) took 2111 ms. Trace:
W20260709 13:06:16.098659 20175 consensus_meta.cc:287] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.905s	user 0.010s	sys 0.000s
I20260709 13:06:16.100136 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:16.103444 19554 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:16.105131 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 435800us
I20260709 13:06:15.970520 12617 raft_consensus.cc:2410] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:06:16.141255 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 2609) took 1111 ms. Trace:
I20260709 13:06:16.140337 12695 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 22.
I20260709 13:06:16.141660 12617 rpcz_store.cc:276] 0709 13:06:15.029934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.545683 (+515749us) service_pool.cc:224] Handling call
0709 13:06:16.141197 (+595514us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:16.097384 12618 pending_rounds.cc:85] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 11
I20260709 13:06:16.142346 12618 pending_rounds.cc:107] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:06:16.142632 12618 raft_consensus.cc:2889] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:16.063079 20250 raft_consensus.cc:3055] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:06:16.139984 12690 rpcz_store.cc:276] 0709 13:06:13.986319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:13.986480 (+   161us) service_pool.cc:224] Handling call
0709 13:06:13.998426 (+ 11946us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:14.631439 (+633013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.097856 (+1466417us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b540009f454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:16.098059 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1431668608}
I20260709 13:06:16.117751 12693 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:06:16.077543 20246 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:16.121136 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:16.123437 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4204) took 1528 ms. Trace:
I20260709 13:06:16.123868 20059 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:16.125887 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:16.127429 20037 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:16.127795 19999 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.129191 20244 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:16.068593 20273 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:06:16.130329 20096 raft_consensus.cc:3055] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:16.130524 20091 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:16.132800 20236 raft_consensus.cc:3055] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:16.080207 20274 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:16.101317 20126 consensus_meta.cc:287] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.958s	user 0.010s	sys 0.000s
I20260709 13:06:16.141072 12659 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
W20260709 13:06:16.112943 12615 consensus_meta.cc:287] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.910s	user 0.006s	sys 0.003s
I20260709 13:06:16.250630 12615 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 22.
I20260709 13:06:16.251235 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 2613) took 1218 ms. Trace:
I20260709 13:06:16.251760 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 2569) took 1274 ms. Trace:
I20260709 13:06:16.251585 12615 rpcz_store.cc:276] 0709 13:06:15.033150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.156162 (+123012us) service_pool.cc:224] Handling call
0709 13:06:16.251174 (+1095012us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:16.253000 12615 raft_consensus.cc:1240] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 25 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:16.143386 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 2616) took 1109 ms. Trace:
I20260709 13:06:16.075276 19994 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.254676 19994 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.072235 20240 raft_consensus.cc:740] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:16.252213 12689 rpcz_store.cc:276] 0709 13:06:14.977323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.115179 (+137856us) service_pool.cc:224] Handling call
0709 13:06:16.236522 (+1121343us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b54003e94d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:16.251697 (+ 15175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1574450560}
I20260709 13:06:16.253800 12617 rpcz_store.cc:276] 0709 13:06:15.034024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.142436 (+1108412us) service_pool.cc:224] Handling call
0709 13:06:16.142736 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:16.142895 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:16.143106 (+   211us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:16.143157 (+    51us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:06:16.143191 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.143245 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:16.143332 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:16.261765 20221 consensus_queue.cc:237] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:16.218035 20059 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.184137 20175 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.267493 20274 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:16.267997 20175 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:15.978178 20217 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.191793 12545 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:15.990667 12696 raft_consensus.cc:2410] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 24 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:06:16.193737 12687 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 23.
W20260709 13:06:16.192364 12542 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 2358) took 1796 ms (client timeout 2219 ms). Trace:
I20260709 13:06:16.257256 20126 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:06:15.979916 20260 log.cc:927] Time spent T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.285s	user 0.000s	sys 0.001s
I20260709 13:06:16.210964 12619 raft_consensus.cc:1240] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:16.278100 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4208) took 1052 ms. Trace:
I20260709 13:06:16.190642 12622 rpcz_store.cc:276] 0709 13:06:14.595357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.604621 (+  9264us) service_pool.cc:224] Handling call
0709 13:06:14.634151 (+ 29530us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:14.878144 (+243993us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:14.878180 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:14.911296 (+ 33116us) log.cc:844] Serialized 26 byte log entry
0709 13:06:15.141860 (+230564us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:06:15.141901 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.141970 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:16.123223 (+981253us) raft_consensus.cc:1685] finished
0709 13:06:16.123243 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:16.123384 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":42552,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":15010,"thread_start_us":464621,"threads_started":2,"wal-append.queue_time_us":769165}
W20260709 13:06:16.211078 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 418640us
I20260709 13:06:16.118610 20266 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:16.148584 20250 raft_consensus.cc:740] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:16.194860 20208 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:16.267596 20059 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:16.120294 20071 consensus_meta.cc:287] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 1.431s	user 0.008s	sys 0.005s
W20260709 13:06:16.270187 12542 rpcz_store.cc:269] 0709 13:06:14.395643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.547405 (+151762us) service_pool.cc:224] Handling call
0709 13:06:16.191391 (+1643986us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b54003aaa54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:16.192286 (+   895us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":910801280}
I20260709 13:06:16.194458 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1768) took 1400 ms. Trace:
I20260709 13:06:16.285717 12541 rpcz_store.cc:276] 0709 13:06:14.793869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.799101 (+  5232us) service_pool.cc:224] Handling call
0709 13:06:14.799373 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:14.800238 (+   865us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:14.800270 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:14.800784 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:06:15.125449 (+324665us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:06:15.125507 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.125623 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:16.194195 (+1068572us) raft_consensus.cc:1685] finished
0709 13:06:16.194224 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:16.194385 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4281,"raft.queue_time_us":104,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":70,"thread_start_us":324232,"threads_started":1,"wal-append.queue_time_us":776432}
I20260709 13:06:16.223003 20096 raft_consensus.cc:740] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:06:16.278718 19988 consensus_meta.cc:287] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.903s	user 0.013s	sys 0.000s
I20260709 13:06:16.275477 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 2561) took 1319 ms. Trace:
W20260709 13:06:16.276005 12662 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.023s	sys 0.041s
W20260709 13:06:16.303567 12662 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.023s	sys 0.041s
I20260709 13:06:16.304368 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:16.305692 12662 leader_election.cc:400] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 20. Current term is 21.
I20260709 13:06:16.228142 20236 raft_consensus.cc:740] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:06:16.281777 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 140784us
W20260709 13:06:16.309914 12620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 4200) took 1727 ms (client timeout 1689 ms). Trace:
I20260709 13:06:16.303463 12696 rpcz_store.cc:276] 0709 13:06:14.956402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.167254 (+210852us) service_pool.cc:224] Handling call
0709 13:06:16.275391 (+1108137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:16.278430 12619 rpcz_store.cc:276] 0709 13:06:15.225864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.195721 (+969857us) service_pool.cc:224] Handling call
0709 13:06:16.196089 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:16.277801 (+ 81712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.278031 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:16.250272 20273 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:16.228319 20278 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19.
I20260709 13:06:16.217738 19999 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:16.185776 12691 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.029s	sys 0.038s
I20260709 13:06:16.297477 13229 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:06:16.296679 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:16.300761 12587 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:16.321990 20244 raft_consensus.cc:2764] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:06:16.298794 13197 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:16.311532 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:16.330163 20003 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:16.330612 20003 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.330984 20003 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:06:16.310339 12620 rpcz_store.cc:269] 0709 13:06:14.582037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.582204 (+   167us) service_pool.cc:224] Handling call
0709 13:06:16.309715 (+1727511us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54001eaad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:16.309847 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2751349760}
I20260709 13:06:16.333280 12620 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:06:16.334343 12620 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:16.314268 12662 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:16.338564 20003 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.339023 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:16.339619 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.340161 12662 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:16.343011 12687 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:06:16.344360 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:16.345376 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:16.346657 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:16.347781 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:16.315076 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:16.316119 12622 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:06:16.350029 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4214) took 1066 ms. Trace:
I20260709 13:06:16.350450 12622 rpcz_store.cc:276] 0709 13:06:15.283429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.279129 (+995700us) service_pool.cc:224] Handling call
0709 13:06:16.307459 (+ 28330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:16.349718 (+ 42259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.349958 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:16.351718 20003 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:16.349139 20240 consensus_queue.cc:260] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:16.352536 19987 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:16.352659 20240 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:16.353310 20268 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:16.354048 20268 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:16.330816 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:16.280129 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4210) took 1053 ms. Trace:
I20260709 13:06:16.356554 12615 rpcz_store.cc:276] 0709 13:06:15.226542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.252458 (+1025916us) service_pool.cc:224] Handling call
0709 13:06:16.252773 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:16.253494 (+   721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.280073 (+ 26579us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:16.358826 20249 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:16.360152 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:16.361210 19959 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:06:16.363732 12691 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.029s	sys 0.038s
I20260709 13:06:16.365218 19801 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:06:16.382354 12662 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:16.386463 20268 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:16.310838 20236 consensus_queue.cc:260] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:16.387392 19985 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:16.387678 20236 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:16.307331 20059 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.081s
I20260709 13:06:16.388834 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:16.389616 20092 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:16.390444 20238 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:16.284158 20246 raft_consensus.cc:2764] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:06:16.283447 20208 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:16.396629 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:16.397505 12696 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 21: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:16.400378 12620 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:06:16.400621 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:16.402047 20238 consensus_queue.cc:1059] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:06:16.404075 20238 consensus_queue.cc:1059] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:16.404939 20238 consensus_queue.cc:1243] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 20.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:06:16.406011 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:16.409821 20273 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.410375 20273 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:16.412479 20273 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:16.412964 20273 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:16.310067 19988 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:06:16.414497 19994 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:16.302651 20182 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.418969 20182 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.300032 20126 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.421981 20126 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.424074 20126 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:16.425468 20217 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:16.395841 20277 consensus_queue.cc:1059] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.112s
I20260709 13:06:16.430002 19989 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:16.431070 12617 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:16.435395 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2350) took 2108 ms. Trace:
I20260709 13:06:16.435778 12545 rpcz_store.cc:276] 0709 13:06:14.326949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.676252 (+349303us) service_pool.cc:224] Handling call
0709 13:06:16.191545 (+1515293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:16.274451 (+ 82906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.435205 (+160754us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54003aaa50. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:16.435338 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3430486784}
I20260709 13:06:16.302381 20071 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:16.438846 12688 raft_consensus.cc:2393] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:16.444487 12616 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:16.445753 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 4209) took 1219 ms. Trace:
I20260709 13:06:16.446287 12616 rpcz_store.cc:276] 0709 13:06:15.226222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.058803 (+832581us) service_pool.cc:224] Handling call
0709 13:06:16.445677 (+386874us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:16.450574 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:16.452503 12620 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 13:06:16.453738 12689 raft_consensus.cc:1240] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:16.454965 20096 consensus_queue.cc:260] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:16.455323 20250 consensus_queue.cc:260] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.13, Last appended by leader: 13, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:16.456396 19999 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:16.457098 20211 raft_consensus.cc:3055] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:16.391996 19966 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:16.465363 13200 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.032s	sys 0.036s
I20260709 13:06:16.467804 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:16.454552 20238 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:06:16.471179 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:06:16.473757 12585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.015s	sys 0.064s
I20260709 13:06:16.477982 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:16.516953 12619 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:16.517304 12622 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:16.461922 19994 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.469638 20182 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:16.484910 12588 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.016s	sys 0.033s
I20260709 13:06:16.485749 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:16.523612 12588 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.017s	sys 0.034s
I20260709 13:06:16.413514 20273 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.470323 20280 consensus_queue.cc:1059] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.006s
I20260709 13:06:16.490178 12662 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:16.490679 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1945) took 1651 ms. Trace:
I20260709 13:06:16.501803 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4212) took 1259 ms. Trace:
I20260709 13:06:16.528172 12617 rpcz_store.cc:276] 0709 13:06:15.232842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.258942 (+1026100us) service_pool.cc:224] Handling call
0709 13:06:16.259380 (+   438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:16.431596 (+172216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.491775 (+ 60179us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54001e9bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:16.492003 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394244480}
I20260709 13:06:16.484311 19989 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.487684 20250 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:06:16.550513 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 60427.5us
I20260709 13:06:16.460901 12540 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
W20260709 13:06:16.516072 13200 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.032s	sys 0.036s
W20260709 13:06:16.518325 12585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.015s	sys 0.064s
I20260709 13:06:16.483212 12510 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:16.521210 12512 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.022s	sys 0.032s
W20260709 13:06:16.553756 12512 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.022s	sys 0.032s
W20260709 13:06:16.554495 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 878580us
W20260709 13:06:16.555565 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:16.523989 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 728027us
I20260709 13:06:16.493392 20282 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.533237 19983 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:16.533593 20175 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:06:16.526799 12621 rpcz_store.cc:276] 0709 13:06:14.839163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.839320 (+   157us) service_pool.cc:224] Handling call
0709 13:06:14.853536 (+ 14216us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:14.853832 (+   296us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:14.853883 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:14.870987 (+ 17104us) log.cc:844] Serialized 26 byte log entry
0709 13:06:15.138494 (+267507us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:06:15.577235 (+438741us) log.cc:844] Serialized 14 byte log entry
0709 13:06:15.577526 (+   291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.577620 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:16.490449 (+912829us) raft_consensus.cc:1685] finished
0709 13:06:16.490467 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:16.490600 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5484,"prepare.queue_time_us":755150,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":92,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":40994,"thread_start_us":607003,"threads_started":2,"wal-append.queue_time_us":670368}
I20260709 13:06:16.523425 20096 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:16.538039 20276 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:16.540916 20208 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.543015 20273 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:16.524858 19994 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.555402 12512 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:16.560967 12617 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16. Ops: []
W20260709 13:06:16.521577 12661 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.047s	user 0.021s	sys 0.034s
W20260709 13:06:16.569959 12661 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.114s	user 0.021s	sys 0.034s
W20260709 13:06:16.570617 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.571363 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:16.561546 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:16.572381 12616 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 21: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:06:16.562476 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 79390.2us
I20260709 13:06:16.574532 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:16.516588 20211 raft_consensus.cc:740] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:16.564692 12622 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 24.
I20260709 13:06:16.523767 20283 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.566000 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:16.549697 20280 consensus_queue.cc:1243] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 23.19 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 18
I20260709 13:06:16.563831 12620 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:16.575101 12615 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:06:16.580926 12510 leader_election.cc:400] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:06:16.585618 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:16.586290 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:16.589641 12588 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:16.529770 19988 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:16.595281 12617 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 21 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:16.597486 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:16.598129 13235 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21.
I20260709 13:06:16.607219 13231 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:16.608315 19554 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:06:16.591104 20283 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.584374 20275 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.584635 19680 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:16.559165 19989 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:16.637367 19989 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:16.638005 19989 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:16.639092 19989 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:16.608414 13197 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:16.595273 20049 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:16.574865 20240 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:16.588107 20273 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:16.610637 20091 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:16.630949 12662 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:16.610808 19985 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.021s
I20260709 13:06:16.631760 20045 consensus_queue.cc:1059] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:16.632157 20275 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.614737 20278 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:06:16.771893 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 180065us
W20260709 13:06:16.772056 12613 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.012s	sys 0.031s
W20260709 13:06:16.772684 12613 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.013s	sys 0.031s
I20260709 13:06:16.634749 19994 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:16.635327 20208 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:16.635524 20242 consensus_meta.cc:287] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.997s	user 0.012s	sys 0.000s
I20260709 13:06:16.556902 20282 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.641582 20266 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:16.653895 13199 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.002s	sys 0.027s
W20260709 13:06:16.793094 13199 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.003s	sys 0.028s
I20260709 13:06:16.595547 20037 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.577157 20246 consensus_queue.cc:1059] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.046s
W20260709 13:06:16.763316 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 132499us
I20260709 13:06:16.613593 20280 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:16.770895 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 119735us
I20260709 13:06:16.609350 19988 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.804785 20254 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:06:16.779183 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 291786us
I20260709 13:06:16.644620 20279 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.810497 19988 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:16.810325 20279 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.810866 20275 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:16.777456 12618 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.008s	sys 0.026s
I20260709 13:06:16.567852 20276 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.811854 19554 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.812453 20279 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:16.812326 19554 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.813601 20276 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:16.759372 20059 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.813992 20274 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.802528 12662 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:16.814503 20274 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.814308 20059 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.816499 20274 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:16.816944 20059 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:16.817600 12618 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.008s	sys 0.026s
I20260709 13:06:16.774055 19999 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.818172 19999 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.808391 20003 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:16.820324 20251 raft_consensus.cc:3055] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:16.820948 20251 raft_consensus.cc:740] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:16.820657 20003 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.822053 20251 consensus_queue.cc:260] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.823063 20003 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:16.823823 20251 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:16.808104 20280 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.827221 20280 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:16.828429 12622 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:16.664985 19680 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:16.783900 20221 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.007s	sys 0.027s
I20260709 13:06:16.774121 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:06:16.834538 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 60509.3us
I20260709 13:06:16.835299 19680 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:16.796100 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:16.835495 12588 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:16.835894 20140 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:16.836800 20140 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:06:16.838272 20221 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.008s	sys 0.027s
I20260709 13:06:16.759176 20049 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.784228 20240 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:16.789943 20175 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:16.784652 20290 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:06:16.848264 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.848609 19554 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:16.837301 20140 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.850173 12694 raft_consensus.cc:2368] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 25. Current term is 26.
W20260709 13:06:16.857959 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 290120us
I20260709 13:06:16.765158 20273 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:16.863682 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.805907 20222 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:16.805145 20289 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.861797 12619 raft_consensus.cc:2468] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 26.
W20260709 13:06:16.870339 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 315023us
I20260709 13:06:16.865630 20175 raft_consensus.cc:697] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:16.875012 12512 leader_election.cc:400] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19.
W20260709 13:06:16.911172 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 108717us
I20260709 13:06:16.912215 12512 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:16.913944 12512 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:16.898962 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.820359 19999 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:16.759758 20211 consensus_queue.cc:260] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.796986 20242 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:16.924453 12512 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:16.860895 20140 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:06:16.921751 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 336237us
I20260709 13:06:16.805486 20037 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:16.935864 20175 consensus_queue.cc:237] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:16.971422 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:17.023725 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.935286 20211 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:06:16.977850 12540 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3823) took 1802 ms (client timeout 1512 ms). Trace:
W20260709 13:06:17.025974 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 216910us
I20260709 13:06:16.921859 19988 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:16.987777 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:16.988409 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.989141 12693 raft_consensus.cc:2393] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 16: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:16.990195 19987 raft_consensus.cc:3055] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:16.990885 20242 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:16.993692 20275 raft_consensus.cc:3055] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:06:16.865125 20290 raft_consensus.cc:697] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 20 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:16.994974 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:16.923861 20268 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:17.040831 20268 raft_consensus.cc:697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:17.036441 19994 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
I20260709 13:06:17.041843 20268 consensus_queue.cc:237] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:17.042402 20290 consensus_queue.cc:237] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:17.046940 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.046993 20228 raft_consensus.cc:3055] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 20 LEADER]: Stepping down as leader of term 20
W20260709 13:06:17.047509 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.047511 20228 raft_consensus.cc:740] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:17.049098 20228 consensus_queue.cc:260] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:17.050347 20228 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:16.918118 20289 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:16.997131 13197 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:17.062391 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 65348.4us
I20260709 13:06:16.970799 20287 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:16.972955 20266 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:17.007035 12510 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:16.970829 12512 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:06:17.026295 12540 rpcz_store.cc:269] 0709 13:06:15.175269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.208290 (+ 33021us) service_pool.cc:224] Handling call
0709 13:06:16.948977 (+1740687us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b54000a55d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:16.977751 (+ 28774us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2146979584}
W20260709 13:06:17.035406 20292 log.cc:927] Time spent T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.171s	user 0.000s	sys 0.002s
W20260709 13:06:17.030319 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:17.083884 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 113148us
I20260709 13:06:17.063066 12688 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 13. (term mismatch)
I20260709 13:06:17.086350 12688 pending_rounds.cc:85] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 12
I20260709 13:06:17.086663 12688 pending_rounds.cc:107] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 24.13
I20260709 13:06:17.086930 12688 raft_consensus.cc:2889] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:17.004458 20278 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260709 13:06:17.087868 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.064694 13230 raft_consensus.cc:2410] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 13:06:17.033232 20238 consensus_meta.cc:287] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.000s
W20260709 13:06:17.056922 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 251935us
I20260709 13:06:17.095307 13200 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:16.985468 20140 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:17.069500 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:17.074054 12695 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:06:17.065199 20296 log.cc:927] Time spent T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
W20260709 13:06:17.075762 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 68798.3us
I20260709 13:06:17.115854 12510 leader_election.cc:400] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21.
I20260709 13:06:17.116250 12510 leader_election.cc:403] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
W20260709 13:06:17.039203 20291 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.126s	user 0.001s	sys 0.001s
I20260709 13:06:17.062619 13199 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:17.089340 12512 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:17.095307 12689 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:16.919627 20222 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:17.099257 20293 raft_consensus.cc:2804] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:06:17.101583 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:17.074486 13227 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:06:17.106032 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:17.136152 12692 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 26: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:17.032029 19987 raft_consensus.cc:740] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:17.109691 13231 raft_consensus.cc:2393] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 19: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:17.110986 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:17.111814 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:17.113071 13232 raft_consensus.cc:1240] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:17.139479 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:17.141079 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:17.139500 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:17.073854 20236 consensus_meta.cc:287] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.678s	user 0.013s	sys 0.000s
I20260709 13:06:17.118726 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:17.122440 12694 raft_consensus.cc:1275] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:06:17.038373 20275 raft_consensus.cc:740] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:06:17.143715 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 81147.9us
I20260709 13:06:17.138213 20217 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:06:17.145009 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:17.145782 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:17.146101 20049 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:17.116080 19988 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:17.149304 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 2557) took 2193 ms. Trace:
W20260709 13:06:17.149644 20297 log.cc:927] Time spent T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:06:17.150049 20244 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:17.150981 20282 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:17.124253 20283 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:17.152302 20273 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:17.158017 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:17.160322 20140 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:17.237241 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 142018us
I20260709 13:06:17.113749 20285 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.092s
I20260709 13:06:17.122422 20306 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:17.074704 20159 consensus_queue.cc:1059] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.075s
I20260709 13:06:17.168875 20287 raft_consensus.cc:697] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 23 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:06:17.169497 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 53835.3us
I20260709 13:06:17.170861 20305 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:17.201745 20293 raft_consensus.cc:697] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:17.171520 20003 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:17.172477 20126 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:17.172988 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:17.173477 20307 consensus_queue.cc:1059] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:17.173208 12695 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:06:17.176350 19983 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:17.178891 20037 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:17.117120 20238 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:06:17.147115 20223 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:17.310662 20306 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.310935 20307 raft_consensus.cc:3055] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:17.311306 20307 raft_consensus.cc:740] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:17.204838 20254 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.052s
I20260709 13:06:17.199491 13199 leader_election.cc:400] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 25. Current term is 26.
W20260709 13:06:17.318064 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 129200us
I20260709 13:06:17.319824 20222 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:17.198742 12691 rpcz_store.cc:276] 0709 13:06:14.955479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.564553 (+609074us) service_pool.cc:224] Handling call
0709 13:06:15.607579 (+ 43026us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:16.364289 (+756710us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:16.364334 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:16.364923 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 13:06:16.801684 (+436761us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:16.801751 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.801841 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:17.148982 (+347141us) raft_consensus.cc:1685] finished
0709 13:06:17.149015 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.149226 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":443171,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":17762,"thread_start_us":1161631,"threads_started":2,"wal-append.queue_time_us":688932}
W20260709 13:06:17.322988 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 58638.6us
W20260709 13:06:17.182679 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 115185us
I20260709 13:06:17.212030 20211 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:17.217953 20266 consensus_queue.cc:1059] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:17.219416 20045 consensus_queue.cc:1059] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:17.225713 19989 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.166316 20289 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:17.312180 20307 consensus_queue.cc:260] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:17.335166 19989 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:17.335815 20307 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:17.336567 20277 raft_consensus.cc:3055] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:17.336961 20277 raft_consensus.cc:740] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:17.313345 20293 consensus_queue.cc:237] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:17.338002 19989 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:17.337867 20277 consensus_queue.cc:260] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:17.338919 20277 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:17.321036 20287 consensus_queue.cc:237] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:17.342394 20294 log.cc:927] Time spent T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.371s	user 0.003s	sys 0.000s
I20260709 13:06:17.343998 20266 raft_consensus.cc:3055] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:17.344439 20266 raft_consensus.cc:740] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:17.345623 12614 raft_consensus.cc:2410] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 24 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:06:17.345316 20266 consensus_queue.cc:260] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:17.346608 20266 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:17.348281 12614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 2608) took 2318 ms (client timeout 2367 ms). Trace:
I20260709 13:06:17.186172 20278 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:17.248728 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:17.350775 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:17.351825 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 1360) took 1053 ms. Trace:
I20260709 13:06:17.352413 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:17.249706 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:17.354117 12619 raft_consensus.cc:2393] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:17.238478 13235 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
I20260709 13:06:17.355036 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:17.356575 20278 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:17.239938 20244 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:17.263340 20282 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:17.360795 12614 rpcz_store.cc:269] 0709 13:06:15.029702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.671517 (+641815us) service_pool.cc:224] Handling call
0709 13:06:17.348030 (+1676513us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b54000997d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:17.348208 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3847151872}
I20260709 13:06:17.263701 20279 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:17.363364 20279 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:17.364701 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:17.367086 20308 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.060s	user 0.002s	sys 0.000s
I20260709 13:06:17.365535 12614 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:06:17.369144 13197 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:17.373231 20313 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:06:17.264456 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:17.271394 20324 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.275138 19802 consensus_queue.cc:1048] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 13:06:17.260437 12696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83"
dest_uuid: "7ad68e814a7741488971822f2598183a"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:33998
I20260709 13:06:17.273944 19983 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:17.385389 19994 raft_consensus.cc:3055] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:17.403669 19983 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:17.404146 19994 raft_consensus.cc:740] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:17.371541 20222 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:17.404723 20222 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:17.390746 20322 log.cc:927] Time spent T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 13:06:17.405092 20222 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:17.405272 12696 raft_consensus.cc:606] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:06:17.371572 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:17.276574 20003 raft_consensus.cc:697] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:17.369457 13231 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:17.407212 12617 raft_consensus.cc:2393] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:17.276432 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:17.407658 20003 consensus_queue.cc:237] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:17.405707 12696 raft_consensus.cc:614] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:17.394695 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:17.409354 12692 raft_consensus.cc:2410] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 25 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 16.
I20260709 13:06:17.276664 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:06:17.397964 20295 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.424s	user 0.000s	sys 0.012s
I20260709 13:06:17.309012 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 2611) took 2276 ms. Trace:
I20260709 13:06:17.370779 12614 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 25. Current term is 26. Ops: [25.18-25.18]
I20260709 13:06:17.410598 12613 rpcz_store.cc:276] 0709 13:06:15.032584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.104382 (+1071798us) service_pool.cc:224] Handling call
0709 13:06:16.137962 (+ 33580us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:16.138455 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:16.138495 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:16.219450 (+ 80955us) log.cc:844] Serialized 52 byte log entry
0709 13:06:16.773154 (+553704us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:06:16.847814 (+ 74660us) log.cc:844] Serialized 14 byte log entry
0709 13:06:16.848828 (+  1014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.848997 (+   169us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:17.308681 (+459684us) raft_consensus.cc:1685] finished
0709 13:06:17.308712 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.308926 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21572,"prepare.queue_time_us":74193,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":5288,"raft.queue_time_us":11300,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":12992,"thread_start_us":512472,"threads_started":1,"wal-append.queue_time_us":726968}
W20260709 13:06:17.391832 20319 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.114s	user 0.001s	sys 0.001s
W20260709 13:06:17.229168 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 139851us
I20260709 13:06:17.348423 20045 raft_consensus.cc:3055] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:17.415027 20045 raft_consensus.cc:740] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:17.370656 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:17.416184 20045 consensus_queue.cc:260] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:17.417025 12694 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 25. Current term is 26. Ops: []
I20260709 13:06:17.348876 20092 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.417976 20092 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:17.418794 12659 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:17.420300 20254 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:17.256309 12510 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:17.390349 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:17.374985 13227 raft_consensus.cc:1240] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:17.311201 20306 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:17.406103 20324 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:17.398440 20282 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:17.397070 20275 consensus_queue.cc:260] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:17.429792 20275 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:17.438421 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2679) took 1043 ms. Trace:
I20260709 13:06:17.443156 12687 rpcz_store.cc:276] 0709 13:06:16.395110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.395680 (+   570us) service_pool.cc:224] Handling call
0709 13:06:16.456152 (+ 60472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:16.921939 (+465787us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:16.921972 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:17.052280 (+130308us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b2c00103488. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:06:17.052785 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 13:06:17.201268 (+148483us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:06:17.201328 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.391116 (+189788us) spinlock_profiling.cc:243] Waited 50 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:06:17.438098 (+ 46982us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b54000c7bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:17.438148 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:17.438192 (+    44us) raft_consensus.cc:1685] finished
0709 13:06:17.438204 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.438332 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105655,"raft.queue_time_us":102960,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":12411,"spinlock_wait_cycles":953246464,"thread_start_us":148005,"threads_started":1,"wal-append.queue_time_us":224479}
I20260709 13:06:17.278445 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:17.247929 20271 consensus_queue.cc:1059] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.182s
I20260709 13:06:17.533308 20271 raft_consensus.cc:3055] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:17.533759 20271 raft_consensus.cc:740] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:17.255467 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:17.253320 20273 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:17.255491 19987 consensus_queue.cc:260] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:17.422163 20126 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:06:17.393432 20326 log.cc:927] Time spent T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:06:17.422783 12619 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
I20260709 13:06:17.423478 20045 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:17.407943 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:17.300233 20302 log.cc:927] Time spent T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 13:06:17.384137 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:17.542675 12690 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:06:17.405164 19994 consensus_queue.cc:260] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:17.452340 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:17.453924 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 2615) took 2420 ms. Trace:
I20260709 13:06:17.577877 12689 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:06:17.455693 12620 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:06:17.457321 12693 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:06:17.581146 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:17.581960 12693 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:06:17.464250 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:17.583242 12692 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 24.
I20260709 13:06:17.465734 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:17.483635 20324 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:17.410311 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:17.586310 13229 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:17.577858 12618 rpcz_store.cc:276] 0709 13:06:15.033721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.096646 (+1062925us) service_pool.cc:224] Handling call
0709 13:06:16.097108 (+   462us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:16.209117 (+112009us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:16.209149 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:16.209765 (+   616us) log.cc:844] Serialized 52 byte log entry
0709 13:06:16.827994 (+618229us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:16.828039 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:16.828112 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:17.342079 (+513967us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b24000fa2c8. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63129c4 00007fc3a6310acb 00007fc3a64cbdc9 00007fc3a64cba55 00007fc3a64cb09d 00007fc3a90fd10e 00007fc3a911488c 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221
0709 13:06:17.453509 (+111430us) raft_consensus.cc:1685] finished
0709 13:06:17.453539 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.453856 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12625,"raft.queue_time_us":24848,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":8863,"spinlock_wait_cycles":4494208,"thread_start_us":565879,"threads_started":1,"wal-append.queue_time_us":696509}
I20260709 13:06:17.352289 13228 rpcz_store.cc:276] 0709 13:06:16.298412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:16.298581 (+   169us) service_pool.cc:224] Handling call
0709 13:06:16.298986 (+   405us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:16.304566 (+  5580us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 13:06:16.497012 (+192446us) spinlock_profiling.cc:243] Waited 7.59 ms on lock 0x7b18003621a0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a6489455 00007fc3acf713c7 00007fc3a95839a7 00007fc3a95930bf 00007fc3a9593038
0709 13:06:16.850976 (+353964us) log.cc:844] Serialized 14 byte log entry
0709 13:06:17.185267 (+334291us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:17.201360 (+ 16093us) log.cc:844] Serialized 26 byte log entry
0709 13:06:17.201512 (+   152us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:06:17.201549 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:17.201636 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:17.351483 (+149847us) raft_consensus.cc:1685] finished
0709 13:06:17.351596 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:17.351753 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7571,"prepare.queue_time_us":630899,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":59919,"raft.queue_time_us":23262,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":106812,"spinlock_wait_cycles":17453312,"thread_start_us":617076,"threads_started":2,"wal-append.queue_time_us":485115}
I20260709 13:06:17.487246 20305 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21.
I20260709 13:06:17.489689 19802 consensus_queue.cc:1059] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:17.491284 20282 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:17.492365 20306 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:17.596803 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:17.597697 12689 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 29.
I20260709 13:06:17.537120 20236 consensus_queue.cc:1059] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.040s
I20260709 13:06:17.496219 12688 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:06:17.496618 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 240383us
I20260709 13:06:17.604413 12510 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:06:17.496776 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 78098.7us
I20260709 13:06:17.607471 12659 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:17.499056 20244 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:17.499971 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 65568.6us
I20260709 13:06:17.501791 20278 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:17.504355 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.516371 12615 raft_consensus.cc:1275] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:06:17.519263 20092 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:17.520201 19983 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:17.488853 20279 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:17.558899 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:17.560468 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.562028 13199 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:17.566536 12588 leader_election.cc:336] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.675s (SENT)
W20260709 13:06:17.494917 20251 consensus_meta.cc:287] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.670s	user 0.013s	sys 0.002s
I20260709 13:06:17.599839 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:17.691075 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 75336.2us
I20260709 13:06:17.698153 12512 leader_election.cc:400] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21.
I20260709 13:06:17.598209 20310 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.104s
I20260709 13:06:17.704173 12696 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 13:06:17.643115 20326 log.cc:927] Time spent T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:06:17.711359 13230 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 23. Current term is 24. Ops: []
W20260709 13:06:17.713822 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 151930us
I20260709 13:06:17.617797 19994 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:17.600859 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:17.726462 12693 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:06:17.601806 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:17.727119 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:17.620942 12659 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:17.654366 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 87887.7us
W20260709 13:06:17.687974 20328 log.cc:927] Time spent T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:06:17.723668 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:17.689787 20325 log.cc:927] Time spent T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:06:17.729265 12588 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:06:17.730221 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 109379us
I20260709 13:06:17.736302 12659 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:17.727568 13234 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
W20260709 13:06:17.742707 12588 leader_election.cc:336] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.724s (SENT)
I20260709 13:06:17.743482 12588 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:17.693017 20306 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:06:17.746833 12588 leader_election.cc:336] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.750s (SENT)
I20260709 13:06:17.748267 12588 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:17.680490 12587 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:17.647557 20238 consensus_queue.cc:1059] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.093s
I20260709 13:06:17.757045 13235 raft_consensus.cc:1240] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 25. Current term is 26. Ops: [25.18-25.18]
I20260709 13:06:17.656546 12510 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:17.763948 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 83602.3us
I20260709 13:06:17.651820 13231 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 24.
I20260709 13:06:17.745630 20140 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:17.799861 13232 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:17.755339 20249 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:06:17.775031 12588 leader_election.cc:336] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.989s (SENT)
I20260709 13:06:17.700655 20091 consensus_queue.cc:1059] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:06:17.603701 20271 consensus_queue.cc:260] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:17.810540 20313 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:06:17.596254 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.742138 20320 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:17.751585 20222 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:17.823459 12588 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:17.824450 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 168028us
I20260709 13:06:17.780787 20274 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.050s
I20260709 13:06:17.787256 20217 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:17.825644 20273 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:06:17.787793 20228 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:17.643217 20282 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:17.782451 20092 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:17.787036 19802 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.767968 20306 raft_consensus.cc:697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 22 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:17.742388 20309 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 13:06:17.832708 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:17.838238 12695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.017s	sys 0.028s
W20260709 13:06:17.918011 12695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.017s	sys 0.028s
W20260709 13:06:17.918108 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:17.918540 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:17.918880 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:17.919284 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.762123 12688 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22.
W20260709 13:06:17.847923 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 72929.5us
I20260709 13:06:17.855484 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:17.925973 12540 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:06:17.927488 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:17.856722 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:17.859635 20091 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:17.858968 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:17.859267 12696 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:17.882483 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:17.881953 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:17.941365 12539 raft_consensus.cc:2393] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:17.933678 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:17.857681 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:17.942560 12541 raft_consensus.cc:2468] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:06:17.865124 20096 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.937285 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:17.949651 12547 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:17.941184 12542 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:06:17.955241 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:17.956252 12542 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:17.942351 12545 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:06:17.958107 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:17.958858 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:17.959329 12545 raft_consensus.cc:2410] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 22 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 13:06:17.869845 20228 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.945240 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:17.961989 12546 raft_consensus.cc:2393] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 20: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:17.956537 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:17.964094 12539 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:06:17.936255 13229 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22.
I20260709 13:06:17.967350 12539 raft_consensus.cc:1275] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:06:17.968513 12539 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:06:17.912912 20251 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:06:17.943399 20308 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:06:18.045748 20251 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:18.048563 20251 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:18.056690 20275 consensus_meta.cc:287] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.626s	user 0.011s	sys 0.000s
I20260709 13:06:17.974674 12546 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:06:18.068603 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:17.974856 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:17.979353 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 275572us
I20260709 13:06:17.930972 19802 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:17.987772 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:17.988814 12513 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:17.932420 20217 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:17.991361 13260 heartbeater.cc:646] Failed to heartbeat to 127.11.44.254:44047 (5 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.11.44.254:44047 timed out after 15.000s (SENT)
I20260709 13:06:17.994832 20223 raft_consensus.cc:3055] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:18.002326 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:18.008443 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:18.010138 19987 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:18.010502 20182 raft_consensus.cc:3055] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:06:17.961256 20309 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:18.018198 20306 consensus_queue.cc:237] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:18.019487 20315 raft_consensus.cc:3055] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 25 LEADER]: Stepping down as leader of term 25
W20260709 13:06:18.024885 20266 consensus_meta.cc:287] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.678s	user 0.005s	sys 0.004s
I20260709 13:06:18.029824 19983 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:18.040472 20222 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:17.962333 20096 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:18.057500 12690 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 24.
I20260709 13:06:17.971846 20228 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:17.974424 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:18.064977 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:18.065418 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:18.070546 12615 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:06:18.152232 12545 raft_consensus.cc:2376] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22. Re-sending same reply.
I20260709 13:06:18.152493 12538 raft_consensus.cc:2410] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:06:18.153244 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:18.076681 12540 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21.
I20260709 13:06:18.086338 12547 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:06:18.086689 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1736) took 1010 ms. Trace:
W20260709 13:06:18.133247 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 144558us
I20260709 13:06:18.103137 13199 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:18.101538 12544 raft_consensus.cc:2393] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 19: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:06:18.137135 13198 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.11.44.254:44047, user_credentials={real_user=slave}} blocked reactor thread for 74901.8us
I20260709 13:06:18.139638 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:18.141449 20324 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:18.063299 20236 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:06:18.150635 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 67640.3us
I20260709 13:06:18.138304 20305 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:18.081453 20251 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.191424 12545 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 23: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:18.191597 12542 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16.
I20260709 13:06:18.193048 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 29 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:18.193670 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:18.099763 20211 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.100584 20223 raft_consensus.cc:740] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:18.223750 13226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "588a15c12a6c46ab9373c48890191400"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:06:18.224357 13226 raft_consensus.cc:606] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:06:18.224752 13226 raft_consensus.cc:614] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:18.100699 20268 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.196703 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:18.242513 12540 raft_consensus.cc:2393] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 20: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:18.196596 13235 rpcz_store.cc:276] 0709 13:06:17.075796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.357069 (+281273us) service_pool.cc:224] Handling call
0709 13:06:17.357420 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:17.785591 (+428171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.086321 (+300730us) spinlock_profiling.cc:243] Waited 395 ms on lock 0x7b540063a954. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:18.086606 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":908287744}
W20260709 13:06:18.204725 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.212467 20222 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:18.189021 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:18.207509 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:06:18.208701 12692 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.041s	sys 0.090s
W20260709 13:06:18.252784 12692 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.042s	sys 0.090s
W20260709 13:06:18.156507 19988 consensus_meta.cc:287] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.951s	user 0.006s	sys 0.009s
I20260709 13:06:18.135723 20182 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:18.137768 20315 raft_consensus.cc:740] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:18.218354 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:18.217279 12546 raft_consensus.cc:2376] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21. Re-sending same reply.
W20260709 13:06:18.222088 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.145797 20309 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:18.255129 12538 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 24.
I20260709 13:06:18.263579 13228 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:18.222793 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:18.235932 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:18.078563 20254 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.128s
I20260709 13:06:18.213011 20305 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.266265 12544 raft_consensus.cc:2376] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 16. Re-sending same reply.
W20260709 13:06:18.205204 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 102198us
I20260709 13:06:18.200908 12539 raft_consensus.cc:2393] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:18.135488 20217 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:18.253736 12690 raft_consensus.cc:2410] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:06:18.266855 12542 raft_consensus.cc:2393] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 19: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:18.211609 20236 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:18.271951 13199 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:18.292174 13199 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:18.293005 13199 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:18.209924 20324 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:18.215595 20266 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.223372 20251 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:18.251780 20222 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.299588 13199 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:18.261823 19988 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:18.234699 20211 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:18.350804 12614 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:06:18.283087 20305 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:06:18.283694 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 486194us
I20260709 13:06:18.346184 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:18.290517 20277 consensus_meta.cc:287] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.951s	user 0.009s	sys 0.004s
I20260709 13:06:18.347726 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:06:18.317512 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:18.360296 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:18.360670 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.272735 20273 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:18.252242 20268 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:18.349813 20045 consensus_meta.cc:287] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.774s	user 0.012s	sys 0.000s
I20260709 13:06:18.378409 12694 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:06:18.310101 20274 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:06:18.307017 19966 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:18.307868 20208 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:18.384186 12696 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 23.
I20260709 13:06:18.351871 20222 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:18.387969 12618 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:06:18.390014 12619 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:06:18.400441 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:18.417210 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:18.289345 20293 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.073s
I20260709 13:06:18.407271 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:18.423605 12620 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:18.420678 12541 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:06:18.271392 20223 consensus_queue.cc:260] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:18.384567 20274 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.400970 20277 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:18.425511 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 125985us
W20260709 13:06:18.421989 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 159644us
I20260709 13:06:18.445533 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:18.349308 20266 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:18.438009 13228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:06:18.435515 12588 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:18.400221 20011 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.437862 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:18.466274 12539 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 24.
I20260709 13:06:18.404644 20208 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:18.451323 12542 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:06:18.453495 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:18.450641 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:18.464003 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:18.470929 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:18.458923 12544 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 24.
I20260709 13:06:18.476274 12540 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:06:18.472497 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:06:18.484073 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.486116 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:18.449051 20310 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:06:18.496459 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.455206 20274 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Advancing to term 30
W20260709 13:06:18.499343 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 63966us
W20260709 13:06:18.515010 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 248157us
I20260709 13:06:18.518064 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:18.368711 20315 consensus_queue.cc:260] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:18.493110 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:06:18.498224 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 136348us
I20260709 13:06:18.377449 20273 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:18.520936 12539 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:06:18.452315 19802 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:18.401309 20182 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.19, Last appended by leader: 19, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:18.533541 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:18.535446 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.473454 20223 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:18.540730 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:18.480597 20208 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:06:18.543295 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 87032.5us
I20260709 13:06:18.554479 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:18.545610 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:18.551249 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:18.552667 12620 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
W20260709 13:06:18.511965 20338 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.298s	user 0.001s	sys 0.001s
I20260709 13:06:18.481206 20096 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:18.567916 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:18.563359 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:18.574052 12541 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:06:18.513303 20310 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.555105 12544 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 29.
I20260709 13:06:18.571518 19554 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:06:18.577431 12617 raft_consensus.cc:2393] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:18.475111 20277 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:18.580942 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:18.479496 20011 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:18.567207 19994 consensus_meta.cc:287] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.826s	user 0.013s	sys 0.000s
I20260709 13:06:18.646344 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:18.655625 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:18.658123 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:18.659006 12544 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:06:18.561900 20357 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:18.675325 20309 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:18.675166 20357 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:18.676107 20309 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:18.676621 20309 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:18.577550 20182 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:18.584550 20310 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:18.511610 20345 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.147s
I20260709 13:06:18.578284 20315 raft_consensus.cc:3060] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:18.669317 20011 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:18.669983 20324 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:18.699554 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:18.679677 20336 log.cc:927] Time spent T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
W20260709 13:06:18.673292 20342 log.cc:927] Time spent T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
W20260709 13:06:18.674012 20341 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.251s	user 0.000s	sys 0.000s
W20260709 13:06:18.674693 20343 log.cc:927] Time spent T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.231s	user 0.000s	sys 0.000s
I20260709 13:06:18.680598 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:18.679149 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:18.558066 20311 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.103s
I20260709 13:06:18.642262 20285 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 13:06:18.701188 12687 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 29.
I20260709 13:06:18.671254 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:18.759624 13235 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 21.
I20260709 13:06:18.645241 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:18.653273 20354 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:18.708768 12542 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:06:18.660943 20356 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election won for term 22
W20260709 13:06:18.562676 20279 consensus_queue.cc:1175] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "66750b8bbd4c4b3a9695951d0ede3372" responder_term: 26 status { last_received { term: 26 index: 18 } last_committed_idx: 16 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 25. Current term is 26. Ops: [25.18-25.18]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:18.583456 20045 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.104s
I20260709 13:06:18.777662 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:18.735539 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:18.778350 12687 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
I20260709 13:06:18.697592 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:18.756206 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 77157.1us
I20260709 13:06:18.683249 20358 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:18.675179 20277 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:18.805320 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:18.806623 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:18.671288 20273 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:18.700116 20251 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:18.684485 20091 consensus_queue.cc:1059] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.075s
I20260709 13:06:18.773505 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:18.773604 20140 raft_consensus.cc:3055] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:18.828156 13200 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:18.775450 12513 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:06:18.776387 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.799672 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:18.765134 20360 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.831651 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:18.820429 12538 raft_consensus.cc:3060] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:18.826066 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.772390 20249 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:06:18.767609 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 245135us
W20260709 13:06:18.829468 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 58142.3us
I20260709 13:06:18.829886 12620 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:06:18.817188 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:18.839591 12687 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:06:18.833542 12662 leader_election.cc:336] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.512s (SENT)
I20260709 13:06:18.841533 12662 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:18.843726 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:18.777769 20356 raft_consensus.cc:697] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 22 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:18.840185 13200 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:18.833482 13234 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:18.809333 20367 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.845526 19554 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:06:18.847877 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.870793 19554 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.871316 19554 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:18.867592 13200 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:18.871379 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.866654 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1685) took 1292 ms. Trace:
I20260709 13:06:18.872058 13227 rpcz_store.cc:276] 0709 13:06:17.573879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.575998 (+  2119us) service_pool.cc:224] Handling call
0709 13:06:17.576385 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:17.576825 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.576864 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:17.577419 (+   555us) log.cc:844] Serialized 26 byte log entry
0709 13:06:18.131338 (+553919us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:06:18.131385 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.131452 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:18.866453 (+735001us) raft_consensus.cc:1685] finished
0709 13:06:18.866473 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:18.866596 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10426,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":3075,"thread_start_us":488716,"threads_started":1,"wal-append.queue_time_us":752176}
I20260709 13:06:18.869765 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1899) took 1346 ms. Trace:
I20260709 13:06:18.875773 12689 rpcz_store.cc:276] 0709 13:06:17.523115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.598548 (+ 75433us) service_pool.cc:224] Handling call
0709 13:06:17.643998 (+ 45450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:17.644440 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.644483 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:17.698141 (+ 53658us) log.cc:844] Serialized 26 byte log entry
0709 13:06:18.233991 (+535850us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:06:18.234032 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.234099 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:18.869470 (+635371us) raft_consensus.cc:1685] finished
0709 13:06:18.869500 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:18.869688 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":416,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":50049,"thread_start_us":480100,"threads_started":1,"wal-append.queue_time_us":630106}
W20260709 13:06:18.878063 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 44575.9us
W20260709 13:06:18.878757 12662 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.712s (SENT) [suppressed 27 similar messages]
I20260709 13:06:18.878926 12617 raft_consensus.cc:1275] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:06:18.878921 12588 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:18.828518 20251 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.821910 20277 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:18.837520 20217 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:18.887836 12687 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 24.
I20260709 13:06:18.890424 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 1895) took 1438 ms. Trace:
I20260709 13:06:18.890893 12694 rpcz_store.cc:276] 0709 13:06:17.451881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.465496 (+ 13615us) service_pool.cc:224] Handling call
0709 13:06:18.890221 (+1424725us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b54000c71d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:18.890364 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1825827712}
I20260709 13:06:18.894063 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:18.771999 20354 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:18.828395 20140 raft_consensus.cc:740] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:18.910604 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:18.914701 12687 raft_consensus.cc:2393] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 19: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:18.915362 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:18.836171 20249 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:18.918978 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:18.913539 12620 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:06:18.835568 20266 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:18.892028 20367 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:18.943157 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:06:18.944360 20348 log.cc:927] Time spent T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:06:18.809139 20358 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:18.845727 20360 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:18.887815 20277 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:18.948184 20356 consensus_queue.cc:237] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:18.959156 12538 raft_consensus.cc:2468] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:06:18.959816 12689 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:18.921437 12694 raft_consensus.cc:2368] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21.
I20260709 13:06:18.969056 19554 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:18.906724 20357 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:18.949810 20249 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:18.949486 20049 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:06:19.017444 20353 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.367s	user 0.004s	sys 0.008s
I20260709 13:06:19.026839 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:19.027351 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:18.953950 20311 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:18.888615 20251 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.031824 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:18.958287 20324 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:19.050817 12689 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
W20260709 13:06:19.051762 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 481445us
I20260709 13:06:19.024299 20266 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.056388 13197 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:19.059619 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 192122us
I20260709 13:06:19.063222 13200 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:19.022480 20371 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:06:19.064337 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 185281us
I20260709 13:06:19.031013 20309 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:19.025965 19994 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:19.110291 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2695) took 1189 ms. Trace:
I20260709 13:06:19.073355 13200 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:19.110894 12689 rpcz_store.cc:276] 0709 13:06:17.920836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.058342 (+1137506us) service_pool.cc:224] Handling call
0709 13:06:19.109681 (+ 51339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.109923 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:19.109959 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:19.110000 (+    41us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:06:19.110030 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.110085 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.110219 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:19.111791 13200 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:19.064033 19554 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:19.096117 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:06:19.087502 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 248822us
I20260709 13:06:19.105682 12662 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:19.107221 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2697) took 1185 ms. Trace:
I20260709 13:06:19.114121 12545 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 21: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:19.114383 12694 rpcz_store.cc:276] 0709 13:06:17.921472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.058589 (+1137117us) service_pool.cc:224] Handling call
0709 13:06:19.106540 (+ 47951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.106780 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:19.106818 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:19.106880 (+    62us) raft_consensus.cc:1645] Marking committed up to 19
0709 13:06:19.106926 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.106996 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.107145 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:19.115166 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:06:19.115931 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.109500 12687 raft_consensus.cc:2410] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 24 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 16.
W20260709 13:06:19.071977 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.025301 20374 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:19.116386 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:19.115993 12694 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:06:19.121253 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:19.058554 20357 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.131016 12545 raft_consensus.cc:2376] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18. Re-sending same reply.
I20260709 13:06:19.123179 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:19.124191 13200 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:19.127503 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:19.069077 20091 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.104s
I20260709 13:06:19.162369 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2699) took 1226 ms. Trace:
I20260709 13:06:19.209811 12689 rpcz_store.cc:276] 0709 13:06:17.936223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.112604 (+1176381us) service_pool.cc:224] Handling call
0709 13:06:19.161816 (+ 49212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.162003 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:19.162032 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:19.162082 (+    50us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:19.162113 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.162170 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.162310 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:19.062386 20311 raft_consensus.cc:697] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:19.211853 20311 consensus_queue.cc:237] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.148125 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:19.120479 20374 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:19.126490 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1904) took 1025 ms. Trace:
I20260709 13:06:19.109632 20344 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:19.225131 20344 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.225730 20344 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:19.238735 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:19.072721 20266 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.142405 12543 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:06:19.130936 20049 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:19.129156 20355 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:19.120266 20375 raft_consensus.cc:2804] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:19.145892 20371 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:06:19.189628 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 66573.2us
I20260709 13:06:19.129228 20370 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
W20260709 13:06:19.198926 20228 consensus_meta.cc:287] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.995s	user 0.009s	sys 0.002s
I20260709 13:06:19.105551 20372 consensus_queue.cc:1048] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.142s
W20260709 13:06:19.218637 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 94567us
I20260709 13:06:19.062848 20278 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:19.209276 20315 consensus_meta.cc:287] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.503s	user 0.000s	sys 0.007s
W20260709 13:06:19.177366 20348 log.cc:927] Time spent T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:06:19.063552 20324 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:19.221210 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 327211us
I20260709 13:06:19.240032 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:19.171250 19554 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:19.310045 19554 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.310148 12545 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:06:19.310454 19554 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:19.130580 19994 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.240345 20374 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:19.220206 20045 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:06:19.323498 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.062670 20140 consensus_queue.cc:260] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:19.300210 12689 raft_consensus.cc:1275] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 18. (term mismatch)
I20260709 13:06:19.167846 20357 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:19.311226 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:19.238245 19966 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:19.267315 20092 consensus_meta.cc:287] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 1.347s	user 0.013s	sys 0.000s
I20260709 13:06:19.310469 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:06:19.299973 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 273535us
I20260709 13:06:19.230099 12694 rpcz_store.cc:276] 0709 13:06:18.101486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.115410 (+1013924us) service_pool.cc:224] Handling call
0709 13:06:19.115701 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.125367 (+  9666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.126406 (+  1039us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:19.296952 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:06:19.312704 20182 consensus_meta.cc:287] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.625s	user 0.011s	sys 0.000s
I20260709 13:06:19.299275 20375 raft_consensus.cc:697] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:19.347512 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:19.336607 12545 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
W20260709 13:06:19.325722 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.298293 20011 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:19.342458 12543 raft_consensus.cc:2393] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:19.336278 12689 pending_rounds.cc:85] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 17
I20260709 13:06:19.350172 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 2596) took 1096 ms. Trace:
I20260709 13:06:19.323835 20045 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.352608 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1902) took 1828 ms. Trace:
I20260709 13:06:19.353663 12689 pending_rounds.cc:107] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 25.18
I20260709 13:06:19.357818 12689 raft_consensus.cc:2889] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:19.353861 12540 raft_consensus.cc:2393] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 23: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:19.353040 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:19.359335 12588 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:19.357195 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:19.361738 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:19.362610 12543 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
I20260709 13:06:19.312096 20278 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.356343 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:19.364455 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:19.344269 20092 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:06:19.360225 20373 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.336s	user 0.000s	sys 0.001s
I20260709 13:06:19.298858 20228 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.326038 20383 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.373489 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:19.375953 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:19.369465 20306 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.377705 20140 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:19.360499 20355 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.362196 20045 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:19.326375 20049 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.036s
I20260709 13:06:19.357499 12693 rpcz_store.cc:276] 0709 13:06:17.524089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.741815 (+217726us) service_pool.cc:224] Handling call
0709 13:06:17.766292 (+ 24477us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:17.795958 (+ 29666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:17.796009 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:17.796671 (+   662us) log.cc:844] Serialized 26 byte log entry
0709 13:06:18.286114 (+489443us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:18.558326 (+272212us) log.cc:844] Serialized 14 byte log entry
0709 13:06:18.828800 (+270474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.828880 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:19.043704 (+214824us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b180030e5c0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c522 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
0709 13:06:19.346895 (+303191us) raft_consensus.cc:1685] finished
0709 13:06:19.352409 (+  5514us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.352552 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29098,"prepare.queue_time_us":475195,"prepare.run_cpu_time_us":163,"prepare.run_wall_time_us":3158,"raft.queue_time_us":255428,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":41924,"spinlock_wait_cycles":9435008,"thread_start_us":989438,"threads_started":3,"wal-append.queue_time_us":873846}
I20260709 13:06:19.377179 12588 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:19.356690 20315 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.392457 12538 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:19.390328 12622 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 25. Current term is 26. Ops: [25.19-25.19]
I20260709 13:06:19.371487 20354 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:19.388340 12688 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 25: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:19.404333 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:19.414340 12543 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:06:19.377133 20305 consensus_meta.cc:287] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 1.001s	user 0.012s	sys 0.003s
W20260709 13:06:19.416575 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 153108us
I20260709 13:06:19.377926 20396 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.419448 13199 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:19.421809 12693 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
W20260709 13:06:19.351764 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.380916 20369 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:19.422986 19987 consensus_meta.cc:287] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.284s	user 0.011s	sys 0.006s
I20260709 13:06:19.404454 20356 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:19.387163 19994 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:19.418488 20358 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:19.443683 12691 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
W20260709 13:06:19.447623 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 70536.8us
I20260709 13:06:19.448086 12693 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 25. Current term is 26. Ops: [25.19-25.19]
I20260709 13:06:19.425042 20372 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:19.448419 12588 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:19.448318 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:19.457790 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.423347 20277 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:19.452644 20382 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:19.453295 19802 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:19.454034 20370 raft_consensus.cc:3055] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:06:19.454823 20390 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:06:19.388267 20306 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:19.466610 20370 raft_consensus.cc:740] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:19.474514 20370 consensus_queue.cc:260] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.475142 20306 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:19.436702 20208 consensus_meta.cc:287] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.858s	user 0.015s	sys 0.004s
I20260709 13:06:19.476205 20208 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:19.477104 20389 log.cc:927] Time spent T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:06:19.439851 20369 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:19.479777 19987 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:19.438185 20309 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:06:19.449724 20274 consensus_meta.cc:287] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.906s	user 0.013s	sys 0.014s
I20260709 13:06:19.475659 20370 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:19.437956 20371 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:19.416457 20315 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:19.469120 12588 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:06:19.484840 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 58524.9us
I20260709 13:06:19.422653 20305 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.465732 20271 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:19.436380 20400 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:19.408995 20355 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.426199 20396 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:19.389819 20383 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.451792 20356 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.602610 12543 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 25.
W20260709 13:06:19.604980 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 135974us
W20260709 13:06:19.575273 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 51323.9us
I20260709 13:06:19.608562 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2694) took 1688 ms. Trace:
I20260709 13:06:19.605152 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:19.611608 12546 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 21: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:19.481644 20208 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:19.608984 12695 rpcz_store.cc:276] 0709 13:06:17.920524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.044168 (+123644us) service_pool.cc:224] Handling call
0709 13:06:18.044494 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:18.212837 (+168343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:18.212871 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:18.233973 (+ 21102us) log.cc:844] Serialized 26 byte log entry
0709 13:06:19.023805 (+789832us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b18003b0380. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:06:19.130006 (+106201us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:19.130055 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.373469 (+243414us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54000c6cd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:19.373545 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:19.608357 (+234812us) raft_consensus.cc:1685] finished
0709 13:06:19.608378 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.608506 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":532,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":8940,"spinlock_wait_cycles":396015232,"thread_start_us":106013,"threads_started":1,"wal-append.queue_time_us":1122835}
I20260709 13:06:19.614872 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:19.617888 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:19.502270 20346 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:06:19.574388 20378 log.cc:927] Time spent T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
W20260709 13:06:19.604326 20223 consensus_meta.cc:287] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 1.040s	user 0.001s	sys 0.022s
I20260709 13:06:19.493901 20394 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:19.425143 20375 consensus_queue.cc:237] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.556818 20372 raft_consensus.cc:697] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:06:19.610742 20249 consensus_meta.cc:287] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.560s	user 0.015s	sys 0.006s
W20260709 13:06:19.656503 20377 log.cc:927] Time spent T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:06:19.480624 19987 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.525795 20382 raft_consensus.cc:697] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:06:19.627159 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.606462 20311 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.016s
I20260709 13:06:19.667845 12510 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:19.575516 20279 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:19.670037 12543 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 13:06:19.670673 12619 raft_consensus.cc:2410] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 19 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260709 13:06:19.606879 20363 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:19.603667 20358 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:19.603283 20049 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:19.656385 20393 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:19.718920 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:19.677711 12614 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 4236) took 1612 ms (client timeout 1752 ms). Trace:
I20260709 13:06:19.720534 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:19.679894 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:19.506110 20274 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.724871 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:19.688217 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:19.697765 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.707864 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:19.660825 20394 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.730142 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4241) took 1269 ms. Trace:
I20260709 13:06:19.504874 20309 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.710421 12543 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:19.663007 20346 raft_consensus.cc:697] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:06:19.707050 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 88522.8us
W20260709 13:06:19.721405 12614 rpcz_store.cc:269] 0709 13:06:18.065079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.065203 (+   124us) service_pool.cc:224] Handling call
0709 13:06:19.677425 (+1612222us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54002954d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:19.677628 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456477440}
I20260709 13:06:19.736932 12543 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 22 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:19.622373 19966 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.072s
I20260709 13:06:19.728407 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:19.573917 20344 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.690850 20278 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:19.733770 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:19.733879 19554 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.740161 12543 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:19.602581 20371 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.742388 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1778) took 1292 ms. Trace:
I20260709 13:06:19.730746 12621 rpcz_store.cc:276] 0709 13:06:18.461159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.461345 (+   186us) service_pool.cc:224] Handling call
0709 13:06:18.461785 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:18.761663 (+299878us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:18.761718 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:18.762687 (+   969us) log.cc:844] Serialized 26 byte log entry
0709 13:06:18.908409 (+145722us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:18.908473 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.908570 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:19.729858 (+821288us) raft_consensus.cc:1685] finished
0709 13:06:19.729902 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.730070 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42426,"raft.queue_time_us":206707,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"thread_start_us":402192,"threads_started":2,"wal-append.queue_time_us":419028}
I20260709 13:06:19.750427 12543 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:19.747423 12547 rpcz_store.cc:276] 0709 13:06:18.450703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.452894 (+  2191us) service_pool.cc:224] Handling call
0709 13:06:18.483241 (+ 30347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:18.702569 (+219328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:18.702615 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:18.741024 (+ 38409us) log.cc:844] Serialized 26 byte log entry
0709 13:06:18.958111 (+217087us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:06:18.958162 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.958867 (+   705us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:19.742130 (+783263us) raft_consensus.cc:1685] finished
0709 13:06:19.742160 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.742305 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":221240,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":7124,"thread_start_us":355905,"threads_started":2,"wal-append.queue_time_us":368602}
I20260709 13:06:19.759918 12543 raft_consensus.cc:1240] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:19.760932 20416 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.760808 20407 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.761459 20416 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.762100 20315 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:19.762619 20397 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:19.763031 20045 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.763921 20416 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:19.764910 20352 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.765152 20045 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:19.744561 20408 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:19.765405 20352 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:19.767227 20290 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:19.770440 12540 raft_consensus.cc:1275] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:06:19.685925 20249 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.775508 19554 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:19.736124 20394 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:19.714493 20279 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.751907 20367 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:19.726095 20358 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:19.728766 20049 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.759055 20278 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:19.790617 12695 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:06:19.728237 20363 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:19.781526 20140 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:19.783438 20417 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:19.798321 20402 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:06:19.798802 20398 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:19.781062 20372 consensus_queue.cc:237] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:19.801132 20140 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.791950 20396 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:19.804250 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1788) took 1136 ms. Trace:
I20260709 13:06:19.784638 20382 consensus_queue.cc:237] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:19.822458 20417 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:19.827020 12544 rpcz_store.cc:276] 0709 13:06:18.667906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.686083 (+ 18177us) service_pool.cc:224] Handling call
0709 13:06:18.707384 (+ 21301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.052648 (+345264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:19.052694 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:19.052752 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:19.052795 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.804000 (+751205us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b54002b9b54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:19.804053 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.804189 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":793441664}
I20260709 13:06:19.824472 20356 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:19.799880 19987 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:19.829305 20417 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:19.792040 20355 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:19.777925 20290 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:19.823535 20344 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:19.811069 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1979) took 2038 ms. Trace:
I20260709 13:06:19.832067 20290 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:19.729786 20393 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.832266 20398 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.833133 20211 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:19.834738 20398 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:19.834880 20393 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:19.761479 20407 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:19.805718 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:19.836122 12692 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:06:19.836196 20358 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:19.837298 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:19.816715 20360 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:19.810009 20266 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:19.821480 20411 log.cc:927] Time spent T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 13:06:19.837967 12692 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:19.840157 20279 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:19.840397 20140 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:19.820324 20309 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:19.797684 20346 consensus_queue.cc:237] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:19.838884 20222 consensus_meta.cc:287] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 1.402s	user 0.005s	sys 0.009s
I20260709 13:06:19.845389 20222 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.818661 20357 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:19.846511 13228 raft_consensus.cc:606] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:06:19.847050 13228 raft_consensus.cc:614] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:19.832083 12622 rpcz_store.cc:276] 0709 13:06:17.772385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.779664 (+  7279us) service_pool.cc:224] Handling call
0709 13:06:17.798590 (+ 18926us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:19.409288 (+1610698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.810798 (+401510us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b5400375354. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:19.811005 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3659997568}
I20260709 13:06:19.826181 20371 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:19.834645 20352 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:19.837208 20407 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:19.353962 12694 rpcz_store.cc:276] 0709 13:06:18.254265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.341787 (+1087522us) service_pool.cc:224] Handling call
0709 13:06:19.349165 (+  7378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.349686 (+   521us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:06:19.349736 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:19.349799 (+    63us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:19.349847 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.349936 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.350095 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3467}
I20260709 13:06:19.859236 12587 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:19.811249 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 1983) took 1531 ms. Trace:
W20260709 13:06:19.862517 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.860684 12615 rpcz_store.cc:276] 0709 13:06:18.279827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.280471 (+   644us) service_pool.cc:224] Handling call
0709 13:06:19.677666 (+1397195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.677919 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:19.677957 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:19.678017 (+    60us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:19.678060 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.678136 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.811079 (+132943us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54002954d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:19.811195 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3212266368}
I20260709 13:06:19.864113 12543 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:06:19.869270 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:19.790948 20383 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:19.871112 12694 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
W20260709 13:06:19.824205 20310 consensus_meta.cc:287] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 1.120s	user 0.013s	sys 0.000s
I20260709 13:06:19.888728 12692 raft_consensus.cc:2468] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:06:19.838065 20049 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:19.902701 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:19.903651 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:19.904464 12694 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:06:19.909106 12614 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:06:19.915831 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:19.916666 12614 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 13.
I20260709 13:06:19.919633 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:19.920401 12614 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:19.922240 13234 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:19.922431 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:19.922852 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:19.807840 20363 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:19.810983 20274 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 30 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:19.809811 20249 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:19.868674 20309 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.866688 20371 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:19.875526 20352 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:06:19.926258 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 258553us
I20260709 13:06:19.883415 20279 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.929594 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:19.882282 20391 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.882066 20266 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.930864 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:19.931653 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:19.978534 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.935396 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:19.978252 12622 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 21.
I20260709 13:06:19.975009 12510 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:19.980754 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:19.982837 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:19.988443 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:19.988852 12510 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:19.927577 20222 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:19.991297 12694 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 30.
I20260709 13:06:19.992396 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:19.974040 20352 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.994683 12510 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:19.923360 20310 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.993090 12694 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:19.978058 20371 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:20.008890 13199 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:19.983271 20249 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:19.983296 20278 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:19.983475 20175 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:20.012159 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.013615 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:20.014605 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:20.015044 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:19.987660 20397 raft_consensus.cc:697] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:19.992163 20380 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:20.018366 13199 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:19.999401 20358 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:20.017274 20249 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:20.020045 20360 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.020594 20360 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:20.021624 20249 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:19.974458 20309 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.999682 20352 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:20.016583 12587 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:20.016583 12510 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:19.984447 20279 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:20.028467 12510 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:20.027253 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:19.986805 20266 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:20.017378 20290 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:20.030697 12694 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:20.022265 20396 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:20.022565 20175 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:19.985846 20391 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:20.024011 20349 raft_consensus.cc:2804] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:20.023886 20344 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 30 FOLLOWER]: Leader election won for term 30
W20260709 13:06:20.040246 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.030247 20249 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:06:20.038491 20374 consensus_meta.cc:287] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.703s	user 0.010s	sys 0.000s
I20260709 13:06:20.047235 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.031193 20278 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:20.049981 12694 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 26.
W20260709 13:06:20.052114 12696 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 2696) took 2131 ms (client timeout 1530 ms). Trace:
W20260709 13:06:20.052672 12696 rpcz_store.cc:269] 0709 13:06:17.921169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.001883 (+ 80714us) service_pool.cc:224] Handling call
0709 13:06:20.051880 (+2049997us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54001b5654. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:20.052028 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":569679232}
I20260709 13:06:20.050179 20290 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:06:20.058352 20349 raft_consensus.cc:697] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:20.063112 20349 consensus_queue.cc:237] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:20.054867 20211 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.066800 20211 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:20.069186 20211 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:20.059338 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
W20260709 13:06:20.077790 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.088119 20391 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:20.040284 20425 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:20.089887 13199 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:20.091847 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:20.094882 12510 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:20.089982 20271 consensus_meta.cc:287] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.001s
I20260709 13:06:20.097988 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.057308 20344 raft_consensus.cc:697] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 30 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:20.110352 20310 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:20.110280 20344 consensus_queue.cc:237] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 28.17, Last appended by leader: 17, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:20.101606 20358 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:20.100001 20293 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:20.035746 20397 consensus_queue.cc:237] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:20.093631 20391 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:20.105789 20279 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:20.106863 20371 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:20.108322 20266 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:20.110656 20352 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:20.047662 20380 consensus_queue.cc:1048] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:06:20.091039 20360 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:20.113941 20293 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.123888 20293 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:20.123905 20352 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:20.098968 20287 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:20.126297 20287 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.126722 20287 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:20.127763 20309 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:20.115463 20391 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:20.128613 20391 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:20.121937 20271 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.130081 20271 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:20.130719 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1794) took 1356 ms. Trace:
I20260709 13:06:20.132077 20271 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:20.131090 12542 rpcz_store.cc:276] 0709 13:06:18.773929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.776583 (+  2654us) service_pool.cc:224] Handling call
0709 13:06:18.776858 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:18.978106 (+201248us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:06:19.418836 (+440730us) log.cc:844] Serialized 14 byte log entry
0709 13:06:19.442982 (+ 24146us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:19.443065 (+    83us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:06:19.443136 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:19.820797 (+377661us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:06:20.130498 (+309701us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54003bddd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:20.130557 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:20.130668 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3850,"prepare.queue_time_us":735546,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":6311,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7619,"spinlock_wait_cycles":465737344,"thread_start_us":415996,"threads_started":2,"wal-append.queue_time_us":238159}
I20260709 13:06:20.135249 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.135926 12547 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:06:20.136375 20394 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:20.136874 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:06:20.138015 12687 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 2588) took 2001 ms (client timeout 2107 ms). Trace:
W20260709 13:06:20.138394 12687 rpcz_store.cc:269] 0709 13:06:18.136785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.915360 (+778575us) service_pool.cc:224] Handling call
0709 13:06:20.137845 (+1222485us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b540041fad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:20.137963 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":295932288}
I20260709 13:06:20.139093 20394 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:20.139415 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.140501 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.141068 12687 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:06:20.142215 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3826) took 1048 ms. Trace:
I20260709 13:06:20.142580 12538 rpcz_store.cc:276] 0709 13:06:19.094343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.094604 (+   261us) service_pool.cc:224] Handling call
0709 13:06:19.141402 (+ 46798us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.408988 (+267586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.141989 (+733001us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b5400228154. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:20.142158 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":576880896}
I20260709 13:06:20.143643 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.144181 12538 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:06:20.144954 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:20.146282 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.147372 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.148283 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.056936 20374 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:20.069933 20329 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:06:20.113818 20359 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.164146 20359 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:20.165778 20391 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:20.123065 20175 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:20.145430 12538 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:20.172773 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:20.173552 12622 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 25: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:20.174520 12622 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:20.152360 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.175880 12687 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 25.
I20260709 13:06:20.176802 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.178205 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.178258 20369 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:20.178830 12687 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22.
I20260709 13:06:20.179013 20374 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:20.179719 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.149199 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.179945 20310 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:20.180045 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:20.180615 20310 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:20.181026 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.182178 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.150112 20249 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:20.157553 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.176681 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:20.133245 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:06:20.188433 12512 leader_election.cc:336] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Timed out: RequestConsensusVote RPC to 127.11.44.195:34641 timed out after 1.709s (SENT)
I20260709 13:06:20.188802 12542 raft_consensus.cc:2376] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21. Re-sending same reply.
I20260709 13:06:20.188997 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:06:20.185189 12546 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 1776) took 1762 ms (client timeout 1964 ms). Trace:
W20260709 13:06:20.190171 12546 rpcz_store.cc:269] 0709 13:06:18.422495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.422653 (+   158us) service_pool.cc:224] Handling call
0709 13:06:20.185013 (+1762360us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54002cc754. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:20.185137 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2610869504}
I20260709 13:06:20.185693 12545 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:20.191636 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:20.192256 12616 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 26.
I20260709 13:06:20.193850 12538 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:06:20.194517 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.195122 12694 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 21.
I20260709 13:06:20.196056 20126 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 13:06:20.199910 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.202939 13233 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 21.
W20260709 13:06:20.246639 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.248345 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.249492 12690 raft_consensus.cc:2368] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 21. Current term is 22.
I20260709 13:06:20.250672 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.252147 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.252904 12690 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 23.
I20260709 13:06:20.254597 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.257848 13226 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:20.259605 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.260699 12694 raft_consensus.cc:2410] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 24 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
W20260709 13:06:20.265805 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 75602.3us
I20260709 13:06:20.267877 20374 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.268597 20374 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:20.270366 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.271210 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:20.272516 20329 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:20.273763 12512 leader_election.cc:400] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21.
I20260709 13:06:20.274473 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:20.289052 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.291563 12538 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:06:20.292877 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.293751 12690 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 24.
I20260709 13:06:20.242305 20400 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.149224 20293 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:20.245707 20310 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:20.297274 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.302062 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:20.211663 20358 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:20.303731 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:20.306191 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:20.309948 12687 raft_consensus.cc:2393] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 17: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:20.308472 13233 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:20.309440 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:20.295038 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:20.315655 12690 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:20.287002 20374 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:20.323673 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:20.331571 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:20.337882 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 30 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:20.338104 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:20.338622 12547 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:06:20.338871 13232 raft_consensus.cc:2393] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 20: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:20.340220 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:20.340323 13233 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
I20260709 13:06:20.340839 12694 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:20.341513 12662 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:06:20.342336 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 68791us
I20260709 13:06:20.295890 20287 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:20.345120 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:20.346095 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:20.346810 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:20.347157 20360 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:20.350636 20271 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.352046 12587 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:20.369838 20271 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:20.371013 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:20.371934 12587 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:20.372232 12688 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 2698) took 2437 ms (client timeout 2121 ms). Trace:
I20260709 13:06:20.372668 20249 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:20.373180 20249 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:20.373813 20249 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:20.375427 20305 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:20.376484 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1787) took 1723 ms. Trace:
I20260709 13:06:20.376902 12541 rpcz_store.cc:276] 0709 13:06:18.652728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.655943 (+  3215us) service_pool.cc:224] Handling call
0709 13:06:18.656318 (+   375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:18.676463 (+ 20145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:18.676493 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:18.676530 (+    37us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:18.676560 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.376234 (+1699674us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b54002bb454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:20.376280 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:20.376420 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45816704}
I20260709 13:06:20.382825 20249 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:20.357425 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:20.358732 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3848) took 1182 ms. Trace:
I20260709 13:06:20.358880 20309 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:20.360570 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:48978 (request call id 67) took 1923 ms. Trace:
I20260709 13:06:20.364308 13232 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 27: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:20.364656 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:20.364923 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.366848 12512 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:20.367242 12662 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:20.372767 12688 rpcz_store.cc:269] 0709 13:06:17.935528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.008065 (+ 72537us) service_pool.cc:224] Handling call
0709 13:06:20.372016 (+2363951us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54001a0c54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:20.372133 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2877610752}
I20260709 13:06:20.385025 12543 rpcz_store.cc:276] 0709 13:06:19.176628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.786814 (+610186us) service_pool.cc:224] Handling call
0709 13:06:19.787120 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.864553 (+ 77433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.358479 (+493926us) spinlock_profiling.cc:243] Waited 76.6 ms on lock 0x7b5400229554. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:20.358671 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176207232}
I20260709 13:06:20.394560 12662 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:20.386155 13233 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
I20260709 13:06:20.356768 12690 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:06:20.391265 13228 rpcz_store.cc:276] 0709 13:06:18.437669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.437862 (+   193us) service_pool.cc:224] Handling call
0709 13:06:20.360342 (+1922480us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400578854. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9573853 00007fc3ae54160a 00007fc3a7ac77d4 00007fc3a7ac7762 00007fc3a7ac7691 00007fc3a7ac760c 00007fc3a7ac68c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:20.360478 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3188914560}
I20260709 13:06:20.394971 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:20.397730 12622 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:06:20.395288 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:20.400130 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:20.400769 12622 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
I20260709 13:06:20.400635 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.378350 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.404922 12541 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:20.406316 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.407372 12541 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 23.
I20260709 13:06:20.410772 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:20.411876 13232 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 21: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:20.408468 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.412457 12541 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 16.
I20260709 13:06:20.413532 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.414873 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.416146 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.419375 12512 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:20.302994 20400 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:20.443452 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.417254 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:20.445001 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.446581 12512 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:20.366097 20394 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:20.454456 20394 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:20.456650 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:20.456951 20394 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:20.461899 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:20.462111 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:20.463055 12688 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 25: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:20.463233 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:20.463995 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:20.464874 12688 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 25: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:20.464671 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:20.363216 20287 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:20.466045 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:20.467172 12620 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:06:20.468276 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:20.469698 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:20.469991 20366 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:06:20.470474 12620 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 23.
I20260709 13:06:20.471349 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:20.472397 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:20.465539 12615 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 23.
I20260709 13:06:20.472764 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:20.478564 12617 raft_consensus.cc:2410] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:06:20.366762 20391 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:20.393407 20309 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.491568 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.492455 12541 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
I20260709 13:06:20.493536 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.494277 12541 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:20.495381 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.496280 12541 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 21: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:20.328088 20358 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:20.483525 12512 leader_election.cc:400] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 21. Current term is 22.
I20260709 13:06:20.500244 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.442610 20211 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:20.525321 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:20.526000 12687 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:20.526081 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1905) took 2424 ms. Trace:
I20260709 13:06:20.526556 12689 rpcz_store.cc:276] 0709 13:06:18.101855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.210736 (+1108881us) service_pool.cc:224] Handling call
0709 13:06:19.211065 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.358323 (+147258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.525724 (+1167401us) spinlock_profiling.cc:243] Waited 88.8 ms on lock 0x7b54001effd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:20.525985 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204127488}
I20260709 13:06:20.484722 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:20.498008 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:20.521289 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.511952 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:20.529103 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:20.530421 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:20.531136 12618 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 26.
I20260709 13:06:20.442478 20354 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:20.500458 12512 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:20.519418 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:20.441704 20254 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:20.531157 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:20.546429 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 46060.6us
I20260709 13:06:20.549925 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:20.551935 12539 raft_consensus.cc:2393] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 19: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:20.553061 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:20.554023 12539 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 21: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:20.554711 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:20.555562 12689 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:20.535696 12694 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:06:20.557250 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.453320 12547 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 30.
I20260709 13:06:20.558467 20394 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:20.501401 20309 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:20.512820 20251 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:20.506335 20268 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:20.524863 20211 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:20.542865 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.679759 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:20.515740 20249 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:20.508669 20293 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:20.517973 20358 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:20.633067 12540 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3847) took 1460 ms. Trace:
I20260709 13:06:20.561266 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:20.690778 12547 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:20.690456 12540 rpcz_store.cc:276] 0709 13:06:19.172456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.786534 (+614078us) service_pool.cc:224] Handling call
0709 13:06:19.786861 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.858448 (+ 71587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:19.858482 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:19.858528 (+    46us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:19.859848 (+  1320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.632793 (+772945us) spinlock_profiling.cc:243] Waited 71.4 ms on lock 0x7b54000a6ed4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:20.632842 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:20.633002 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164150016}
I20260709 13:06:20.507635 20400 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:20.514540 20271 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:20.536851 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:20.505738 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.692746 12688 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 26.
I20260709 13:06:20.560112 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:20.558995 20287 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:20.683780 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.699081 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.683636 20211 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:20.697857 12541 raft_consensus.cc:2393] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 21: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:20.704804 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:20.705657 12618 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:20.562089 20394 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:20.696617 12539 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:20.703099 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:20.703912 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.710846 12543 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 25: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:20.711021 12688 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 21.
I20260709 13:06:20.707438 12541 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:20.702467 12547 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:06:20.715689 12687 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:06:20.685465 20251 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:06:20.749310 12615 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:06:20.700559 20287 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:20.735898 12689 raft_consensus.cc:2410] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 25 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 16.
I20260709 13:06:20.739392 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:06:20.755921 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.752225 13200 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:20.759615 12694 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 21: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:20.761094 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1883) took 3438 ms. Trace:
I20260709 13:06:20.761531 12691 rpcz_store.cc:276] 0709 13:06:17.322975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.407400 (+ 84425us) service_pool.cc:224] Handling call
0709 13:06:17.443522 (+ 36122us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.445503 (+2001981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.760852 (+1315349us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b5400070154. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:20.761040 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4589122944}
I20260709 13:06:20.765319 12539 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:06:20.768214 12618 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 27.
I20260709 13:06:20.770733 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:20.771646 12688 raft_consensus.cc:2410] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 24 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 13:06:20.772625 12689 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:20.773319 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2702) took 1314 ms. Trace:
I20260709 13:06:20.773662 12689 rpcz_store.cc:276] 0709 13:06:19.459392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.772125 (+1312733us) service_pool.cc:224] Handling call
0709 13:06:20.772444 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.773073 (+   629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.773266 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:20.774947 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 2708) took 1037 ms. Trace:
I20260709 13:06:20.775393 12688 rpcz_store.cc:276] 0709 13:06:19.737803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.735804 (+998001us) service_pool.cc:224] Handling call
0709 13:06:20.774885 (+ 39081us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:20.763051 20287 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:20.787694 12691 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:20.791266 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2700) took 1332 ms. Trace:
I20260709 13:06:20.791751 12691 rpcz_store.cc:276] 0709 13:06:19.458707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.770542 (+1311835us) service_pool.cc:224] Handling call
0709 13:06:20.787463 (+ 16921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.790943 (+  3480us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.791197 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:20.779101 20311 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:20.811998 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1909) took 2147 ms. Trace:
I20260709 13:06:20.812654 12693 rpcz_store.cc:276] 0709 13:06:18.664141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.458491 (+794350us) service_pool.cc:224] Handling call
0709 13:06:19.458874 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:19.779706 (+320832us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:19.779755 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:19.779813 (+    58us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:06:19.779858 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.811677 (+1031819us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b540009c254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:20.811744 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:20.811921 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":737233664}
I20260709 13:06:20.815150 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1912) took 1328 ms. Trace:
I20260709 13:06:20.815655 12693 rpcz_store.cc:276] 0709 13:06:19.486799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.814106 (+1327307us) service_pool.cc:224] Handling call
0709 13:06:20.814497 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.814724 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.814762 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:20.814820 (+    58us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:20.814866 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.814937 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:20.815078 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:20.777343 20236 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:20.823966 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1913) took 1322 ms. Trace:
I20260709 13:06:20.829351 12693 rpcz_store.cc:276] 0709 13:06:19.507133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.816826 (+1309693us) service_pool.cc:224] Handling call
0709 13:06:20.817185 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.817402 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.817452 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:20.817509 (+    57us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:06:20.817553 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.823720 (+  6167us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:20.823891 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:20.833302 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1914) took 1308 ms. Trace:
I20260709 13:06:20.833971 12693 rpcz_store.cc:276] 0709 13:06:19.525178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.832183 (+1307005us) service_pool.cc:224] Handling call
0709 13:06:20.832619 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.832851 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.832891 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:20.832951 (+    60us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:20.832997 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.833067 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:20.833229 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:20.839787 12547 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:06:20.824478 20311 raft_consensus.cc:697] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:20.797490 20310 consensus_queue.cc:1059] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 13:06:20.855943 12547 raft_consensus.cc:1240] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:20.849527 20311 consensus_queue.cc:237] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:20.872115 20394 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:20.879791 20440 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 13:06:20.891785 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3852) took 1700 ms. Trace:
I20260709 13:06:20.892290 12545 rpcz_store.cc:276] 0709 13:06:19.191707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.375667 (+183960us) service_pool.cc:224] Handling call
0709 13:06:20.891586 (+1515919us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b54003be7d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:20.891718 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1849601408}
I20260709 13:06:20.894542 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:06:20.896709 12619 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 2622) took 2380 ms (client timeout 2962 ms). Trace:
W20260709 13:06:20.897302 12619 rpcz_store.cc:269] 0709 13:06:18.515889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.806357 (+290468us) service_pool.cc:224] Handling call
0709 13:06:20.896461 (+2090104us) spinlock_profiling.cc:243] Waited 863 ms on lock 0x7b540031d654. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:20.896635 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1984704384}
I20260709 13:06:20.903211 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:20.903911 12540 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:20.905427 12545 raft_consensus.cc:2393] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 16: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:20.906155 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:06:20.924654 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.925220 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.924822 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.926108 12545 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 25: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:20.926194 12547 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 26.
W20260709 13:06:20.927708 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 452869us
I20260709 13:06:20.935245 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:20.937412 20359 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:20.943616 12512 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:20.967808 12512 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:20.973119 20406 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:20.973346 19994 raft_consensus.cc:3055] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:20.973724 20406 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:20.973915 19994 raft_consensus.cc:740] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:20.974327 20406 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:20.974979 19994 consensus_queue.cc:260] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:20.976385 19994 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:20.980531 20228 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:20.982326 20444 log.cc:927] Time spent T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:06:20.985653 20438 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.533s	user 0.003s	sys 0.011s
W20260709 13:06:20.990260 20443 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:06:20.993628 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:20.996833 12659 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:20.971065 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a70479a3b4114f3581095e9890f5d653"
 from {username='slave'} at 127.0.0.1:48978
W20260709 13:06:20.999826 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.000289 13235 raft_consensus.cc:606] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Received request to transfer leadership to TS a70479a3b4114f3581095e9890f5d653
I20260709 13:06:21.000840 13235 raft_consensus.cc:614] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:20.945405 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:20.959651 12695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 1916) took 1400 ms (client timeout 1622 ms). Trace:
W20260709 13:06:21.004468 12695 rpcz_store.cc:269] 0709 13:06:19.559453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.614616 (+ 55163us) service_pool.cc:224] Handling call
0709 13:06:20.959476 (+1344860us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54003ea8d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:20.959589 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":401963904}
I20260709 13:06:21.005844 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:21.007187 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:21.007880 12695 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
I20260709 13:06:21.008869 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:20.967886 19988 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:21.009990 19988 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:21.010536 19988 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:20.998142 20449 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:21.011423 20449 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:21.014961 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:21.015681 12541 raft_consensus.cc:3060] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:06:21.016973 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.018244 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:20.955432 12513 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:21.020390 12695 raft_consensus.cc:2368] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 21. Current term is 22.
W20260709 13:06:21.020388 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 65046.5us
I20260709 13:06:21.021649 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:20.942303 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:21.023012 12618 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 25: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:21.023988 20345 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:21.024166 20091 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:21.025007 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:21.025431 20306 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:21.027599 20306 raft_consensus.cc:697] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 21 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:20.961604 20324 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:21.024720 20091 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:21.025938 12542 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 25: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:21.024721 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997"
dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
mode: GRACEFUL
new_leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:48978
I20260709 13:06:21.034430 13235 raft_consensus.cc:606] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 LEADER]: Received request to transfer leadership to TS a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:21.032467 12659 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:21.037065 12659 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:21.028743 20306 consensus_queue.cc:237] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:21.049639 12588 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:21.043905 12659 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:21.051791 12588 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:21.052285 12659 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:21.052680 12540 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 25.
I20260709 13:06:21.044813 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:21.053632 12545 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:06:21.053889 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:21.055219 12545 raft_consensus.cc:1275] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:06:21.046265 12510 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:21.043457 12547 raft_consensus.cc:1275] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:06:21.057746 12659 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:21.061360 12541 raft_consensus.cc:2468] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21.
I20260709 13:06:21.050902 12513 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:06:21.061729 12622 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.031s	sys 0.046s
W20260709 13:06:21.063809 12622 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.031s	sys 0.046s
I20260709 13:06:21.064085 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:21.068905 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:21.071643 12588 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:21.073691 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:21.075253 20249 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:21.075394 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:21.078126 20091 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:21.032902 20449 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:21.081722 20403 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:21.081934 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:21.082764 12695 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:21.085156 20287 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:21.086308 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:21.061187 20279 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:21.087558 20287 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:21.087927 20279 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.088466 20279 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:21.060488 20345 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:21.090533 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:21.049840 20228 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:21.094451 20228 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:21.095029 20228 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:21.042373 20359 raft_consensus.cc:2764] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 13:06:21.072247 20395 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:21.074049 20268 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:21.096794 20268 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.097173 20268 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:06:21.086601 20439 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.635s	user 0.002s	sys 0.000s
I20260709 13:06:21.074275 20266 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:21.102187 20266 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.102597 20266 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:21.103112 19988 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:21.105885 12620 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 23.
W20260709 13:06:21.106072 12662 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.006s	sys 0.015s
W20260709 13:06:21.106568 12662 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.006s	sys 0.015s
W20260709 13:06:21.106874 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 607919us
I20260709 13:06:21.108161 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:21.113260 12512 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:21.089001 20406 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:21.117676 12662 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:21.115899 13199 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:21.073657 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:21.122547 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:21.121438 13199 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:21.116737 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:21.127161 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:21.128692 12662 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:21.129254 12695 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 23.
W20260709 13:06:21.129794 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 388961us
I20260709 13:06:21.131520 12512 leader_election.cc:400] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 21. Current term is 22.
I20260709 13:06:21.095276 20357 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:21.073879 20446 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:21.133329 12662 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:21.128434 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 335111us
I20260709 13:06:21.133383 12659 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:21.134930 12587 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:21.154947 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:21.132514 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 58970.3us
I20260709 13:06:21.156483 12542 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 26. Current term is 27. Ops: []
I20260709 13:06:21.123833 20359 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:21.125461 19983 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:21.165730 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:21.172017 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2707) took 1434 ms. Trace:
I20260709 13:06:21.172551 12693 rpcz_store.cc:276] 0709 13:06:19.737469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.835328 (+1097859us) service_pool.cc:224] Handling call
0709 13:06:20.962415 (+127087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.962655 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.962691 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:20.962748 (+    57us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:20.962793 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.962864 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.171805 (+208941us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b54003ea8d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:21.171939 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":291235712}
I20260709 13:06:21.175405 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:21.175971 12693 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:06:21.176718 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:21.177207 12693 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:21.179311 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:21.137773 20403 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:21.184314 19988 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:21.185173 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:21.137514 20273 consensus_queue.cc:1059] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.050s
I20260709 13:06:21.186486 12513 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:21.187574 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:21.188251 20287 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.184324 20403 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:21.188827 20287 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:21.189400 20403 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:21.157442 20049 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.055s
I20260709 13:06:21.191898 20273 consensus_queue.cc:1243] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 20.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:06:21.192541 20273 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:21.159031 20271 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:21.131043 20182 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:21.193732 20354 raft_consensus.cc:3055] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:21.193868 20182 raft_consensus.cc:697] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:21.194278 20354 raft_consensus.cc:740] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:21.195044 20182 consensus_queue.cc:237] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:21.195277 20354 consensus_queue.cc:260] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:21.196558 20354 raft_consensus.cc:3060] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:21.169329 20359 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:21.197996 20287 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:21.198094 20359 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:21.193042 20273 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:21.106950 20309 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:21.200484 20403 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:21.201246 20309 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:21.159513 20395 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:21.201929 20273 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:21.203683 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 48819.8us
I20260709 13:06:21.204810 12692 raft_consensus.cc:2393] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 21: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:21.204885 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:21.203747 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 45125.2us
I20260709 13:06:21.131980 20360 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:21.129817 20426 consensus_queue.cc:1048] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.072s
I20260709 13:06:21.133754 20407 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:21.206822 12659 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:21.210901 12512 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:21.212121 12512 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:21.206796 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:21.214015 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:21.214717 12693 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 16.
I20260709 13:06:21.215816 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:21.216768 12693 raft_consensus.cc:2410] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:06:21.220391 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:21.221371 12620 raft_consensus.cc:2393] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 21: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:21.202224 20395 raft_consensus.cc:697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 23 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:21.239019 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:21.237473 12512 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:21.246106 12662 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:21.158614 20357 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:21.132066 20449 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:06:21.212402 20360 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.219760 20273 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:21.255967 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:21.157259 20211 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:21.260800 12693 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:21.219924 19983 raft_consensus.cc:697] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:21.234136 19988 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:21.238093 20446 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:21.239182 20287 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:06:21.255803 20391 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:21.271167 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2706) took 1809 ms. Trace:
W20260709 13:06:21.270941 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.257200 20357 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:21.282182 12689 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:21.255746 20450 raft_consensus.cc:2764] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260709 13:06:21.265295 19988 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.260242 20360 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:21.266832 20446 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.272096 20251 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:21.280438 20236 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:21.296716 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2705) took 1836 ms. Trace:
I20260709 13:06:21.283850 20391 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.282316 12688 rpcz_store.cc:276] 0709 13:06:19.462051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.780211 (+1318160us) service_pool.cc:224] Handling call
0709 13:06:20.780662 (+   451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.780884 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:06:20.795268 (+ 14384us) log.cc:844] Serialized 14 byte log entry
0709 13:06:21.270831 (+475563us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:21.270889 (+    58us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:21.270934 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.270998 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.271113 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19494,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"thread_start_us":475298,"threads_started":1}
I20260709 13:06:21.280145 20400 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:21.317476 12689 rpcz_store.cc:276] 0709 13:06:19.460454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.779366 (+1318912us) service_pool.cc:224] Handling call
0709 13:06:20.779650 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:21.282689 (+503039us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.291220 (+  8531us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b5400236ed4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:21.296652 (+  5432us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1155070720}
I20260709 13:06:21.306411 12693 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:06:21.334564 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2714) took 1439 ms. Trace:
I20260709 13:06:21.294556 20126 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:21.357717 12688 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:21.346066 12512 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:21.358400 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 2604) took 1477 ms. Trace:
I20260709 13:06:21.358726 12688 rpcz_store.cc:276] 0709 13:06:19.881133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.357194 (+1476061us) service_pool.cc:224] Handling call
0709 13:06:21.357535 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:21.358135 (+   600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.358347 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:21.360786 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2715) took 1433 ms. Trace:
I20260709 13:06:21.361218 12688 rpcz_store.cc:276] 0709 13:06:19.927053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.360026 (+1432973us) service_pool.cc:224] Handling call
0709 13:06:21.360284 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:21.360453 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:21.360494 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:21.360537 (+    43us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:06:21.360572 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.360625 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.360735 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:21.307623 19988 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:21.342391 12693 rpcz_store.cc:276] 0709 13:06:19.895520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.333595 (+1438075us) service_pool.cc:224] Handling call
0709 13:06:21.333969 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:21.334160 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:21.334198 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:21.334255 (+    57us) raft_consensus.cc:1645] Marking committed up to 19
0709 13:06:21.334300 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.334369 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.334500 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:21.310334 20446 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:21.332547 20391 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:21.324249 20238 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:21.373965 20287 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:21.373512 20092 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:21.364084 20345 consensus_queue.cc:1059] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:06:21.357115 20400 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:21.411947 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1918) took 1596 ms. Trace:
I20260709 13:06:21.382789 20126 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:21.412578 12696 rpcz_store.cc:276] 0709 13:06:19.815874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.896138 (+1080264us) service_pool.cc:224] Handling call
0709 13:06:20.929593 (+ 33455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.929803 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:06:21.034042 (+104239us) log.cc:844] Serialized 14 byte log entry
0709 13:06:21.411512 (+377470us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:21.411564 (+    52us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:06:21.411637 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.411759 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.411887 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17346,"prepare.queue_time_us":104355,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":3027,"thread_start_us":371958,"threads_started":1}
I20260709 13:06:21.419742 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:21.420370 12693 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:21.401895 20406 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:21.328768 20395 consensus_queue.cc:237] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:21.421253 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 251844us
I20260709 13:06:21.399325 20324 consensus_queue.cc:1059] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 13:06:21.415050 20271 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:06:21.427728 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 356173us
I20260709 13:06:21.437245 12588 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:21.438933 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:21.435472 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:21.439996 20345 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:21.422376 20091 raft_consensus.cc:3055] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:21.444058 12696 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:21.419335 20403 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:21.395391 19983 consensus_queue.cc:237] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:21.446892 20366 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:21.447041 20283 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:06:21.461796 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 204607us
I20260709 13:06:21.475749 12662 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:21.447542 20091 raft_consensus.cc:740] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:21.481762 12662 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:21.486667 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:21.486310 12693 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 22.
I20260709 13:06:21.487143 12662 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:21.487540 13226 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 25: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:21.488515 13199 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:21.493629 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 2003) took 1238 ms. Trace:
I20260709 13:06:21.496140 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:21.496263 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:21.496755 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 55909.1us
I20260709 13:06:21.499922 12662 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:21.497298 13226 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:06:21.500591 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:21.488163 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:21.503201 13232 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:06:21.496305 12616 rpcz_store.cc:276] 0709 13:06:20.255247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.256146 (+   899us) service_pool.cc:224] Handling call
0709 13:06:20.256479 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:20.256884 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:06:20.439703 (+182819us) log.cc:844] Serialized 14 byte log entry
0709 13:06:21.350438 (+910735us) log.cc:844] Serialized 14 byte log entry
0709 13:06:21.364334 (+ 13896us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:21.364766 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:06:21.364917 (+   151us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:06:21.364950 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.365084 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:21.493347 (+128263us) raft_consensus.cc:1685] finished
0709 13:06:21.493375 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.493531 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13575,"prepare.queue_time_us":539171,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":2903,"raft.queue_time_us":26941,"raft.run_cpu_time_us":463,"raft.run_wall_time_us":76978,"spinlock_wait_cycles":847104,"thread_start_us":1023999,"threads_started":3,"wal-append.queue_time_us":717555}
I20260709 13:06:21.504161 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:21.506960 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.477141 20211 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:21.488117 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 48014.3us
I20260709 13:06:21.475868 20375 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:21.526078 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:21.525980 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:21.535320 12696 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:06:21.537171 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1927) took 1504 ms. Trace:
I20260709 13:06:21.539000 12696 rpcz_store.cc:276] 0709 13:06:20.032414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.418108 (+1385694us) service_pool.cc:224] Handling call
0709 13:06:21.443857 (+ 25749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:21.536834 (+ 92977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.537100 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:21.542550 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1928) took 1455 ms. Trace:
I20260709 13:06:21.545531 12696 rpcz_store.cc:276] 0709 13:06:20.087129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.541375 (+1454246us) service_pool.cc:224] Handling call
0709 13:06:21.541830 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:21.542079 (+   249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:21.542121 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:21.542184 (+    63us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:21.542236 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.542321 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.542465 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:21.489522 20450 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:21.534082 13197 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:21.552564 13200 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:21.556339 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:21.491852 20345 raft_consensus.cc:697] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:21.569674 20287 raft_consensus.cc:697] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 19 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:21.616322 12512 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:21.519621 20311 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:21.618029 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:21.531226 20375 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:21.548319 20211 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:06:21.555042 20254 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:06:21.691097 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 138609us
W20260709 13:06:21.696336 20279 consensus_meta.cc:287] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.607s	user 0.012s	sys 0.001s
W20260709 13:06:21.641039 20268 consensus_meta.cc:287] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.000s
I20260709 13:06:21.639385 20468 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:06:21.651803 20452 log.cc:927] Time spent T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
W20260709 13:06:21.721544 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 187510us
W20260709 13:06:21.697487 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 66520.9us
I20260709 13:06:21.707224 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2716) took 1727 ms. Trace:
I20260709 13:06:21.724680 12688 rpcz_store.cc:276] 0709 13:06:19.979561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.363570 (+1384009us) service_pool.cc:224] Handling call
0709 13:06:21.363854 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:21.364054 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:06:21.391970 (+ 27916us) log.cc:844] Serialized 14 byte log entry
0709 13:06:21.706877 (+314907us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:21.706929 (+    52us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:21.706983 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.707049 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.707170 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27335,"prepare.queue_time_us":27497,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":184526,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":6505,"thread_start_us":314549,"threads_started":2}
I20260709 13:06:21.625464 20311 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:21.686902 20375 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:21.727355 12688 raft_consensus.cc:1240] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:21.728765 12688 raft_consensus.cc:1275] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:06:21.715492 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 214222us
W20260709 13:06:21.700479 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 142201us
I20260709 13:06:21.730991 12588 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:21.627650 20324 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:21.726354 20311 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:21.692162 20474 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:21.703433 20406 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:21.712183 20249 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:21.741073 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:21.737823 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:21.713630 20236 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:21.743538 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:21.709170 20283 raft_consensus.cc:697] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 21 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:21.749614 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:21.699414 20182 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:06:21.743837 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:21.752739 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:21.735152 20324 raft_consensus.cc:697] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 22 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:06:21.744454 20457 log.cc:927] Time spent T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 13:06:21.747781 20249 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:21.783959 20249 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:21.738407 20474 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:21.789863 20474 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:21.791491 20324 consensus_queue.cc:237] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:21.792919 20458 log.cc:927] Time spent T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.339s	user 0.000s	sys 0.004s
I20260709 13:06:21.768550 20126 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:21.754148 20345 consensus_queue.cc:237] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:21.749233 20400 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:21.734229 19994 consensus_queue.cc:1059] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
W20260709 13:06:21.825028 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 86283.9us
W20260709 13:06:21.771723 20354 consensus_meta.cc:287] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.000s
I20260709 13:06:21.742067 20487 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:06:21.772882 20455 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.318s	user 0.001s	sys 0.000s
I20260709 13:06:21.752035 20049 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:21.750243 20406 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:21.756649 20489 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:06:21.775231 20092 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:21.827801 13232 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 25: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:21.828519 20092 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:06:21.776051 20463 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:06:21.776805 20464 log.cc:927] Time spent T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 13:06:21.777432 20460 log.cc:927] Time spent T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.227s	user 0.000s	sys 0.000s
I20260709 13:06:21.832664 20049 raft_consensus.cc:697] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:06:21.833693 20360 consensus_meta.cc:287] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.509s	user 0.007s	sys 0.004s
I20260709 13:06:21.834146 20360 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:21.835088 20406 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:21.779042 20182 consensus_queue.cc:1059] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 26.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:06:21.714839 20279 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:21.716528 20268 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:21.745645 20287 consensus_queue.cc:237] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:21.781914 20456 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.302s	user 0.000s	sys 0.001s
I20260709 13:06:21.819625 20481 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:21.778060 20283 consensus_queue.cc:237] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:21.840059 20467 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.051s	user 0.003s	sys 0.000s
W20260709 13:06:21.836855 20359 consensus_meta.cc:287] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.638s	user 0.014s	sys 0.000s
W20260709 13:06:21.845058 20465 log.cc:927] Time spent T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
W20260709 13:06:21.839265 20407 consensus_meta.cc:287] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.605s	user 0.012s	sys 0.000s
I20260709 13:06:21.869727 20446 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:21.902580 20498 raft_consensus.cc:2804] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:21.839892 20474 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:21.908836 20498 raft_consensus.cc:697] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 21 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:21.899596 20481 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:21.874394 20489 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
W20260709 13:06:21.963469 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 294380us
I20260709 13:06:21.973016 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:21.973975 12538 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:06:21.974686 12541 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:06:21.975438 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:21.977737 12542 raft_consensus.cc:2393] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 21: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:21.978295 12547 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:06:21.975558 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:21.981477 12546 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 30 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 30 index: 18. (index mismatch)
W20260709 13:06:21.986179 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 255146us
W20260709 13:06:21.988025 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 235217us
I20260709 13:06:21.989595 12662 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:21.774912 19988 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.011751 20279 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:21.833860 20049 consensus_queue.cc:237] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:21.836417 20266 consensus_meta.cc:287] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.728s	user 0.003s	sys 0.011s
I20260709 13:06:21.846815 20360 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:21.872367 20391 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:22.026543 20266 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:22.029093 20391 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:21.998939 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1910) took 3264 ms. Trace:
I20260709 13:06:22.030915 13197 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:21.840342 20375 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.001394 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1911) took 2536 ms. Trace:
I20260709 13:06:21.912674 20498 consensus_queue.cc:237] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:22.037273 20375 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:22.002036 20469 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:22.002985 20494 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:06:22.003077 19983 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:22.003979 20211 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:22.004980 20236 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:22.006139 20492 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:21.835539 20249 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.020275 20474 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:22.025293 12541 raft_consensus.cc:1240] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:06:22.029728 12687 rpcz_store.cc:276] 0709 13:06:18.734351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.731793 (+1997442us) service_pool.cc:224] Handling call
0709 13:06:20.732321 (+   528us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:20.732865 (+   544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.732907 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:20.733455 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:06:21.271863 (+538408us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:06:21.271934 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.272016 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:21.998217 (+726201us) raft_consensus.cc:1685] finished
0709 13:06:21.998267 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.998641 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":157,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":20928,"thread_start_us":473536,"threads_started":1,"wal-append.queue_time_us":641228}
I20260709 13:06:21.999457 20359 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:22.001921 20470 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:22.037501 20394 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:21.840637 20400 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:22.035868 12691 rpcz_store.cc:276] 0709 13:06:19.484262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.792840 (+1308578us) service_pool.cc:224] Handling call
0709 13:06:20.810178 (+ 17338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:20.810626 (+   448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.810666 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:20.831186 (+ 20520us) log.cc:844] Serialized 26 byte log entry
0709 13:06:21.283907 (+452721us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:06:21.308613 (+ 24706us) log.cc:844] Serialized 14 byte log entry
0709 13:06:21.318569 (+  9956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.318693 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:21.842174 (+523481us) spinlock_profiling.cc:243] Waited 8.47 ms on lock 0x7b1800339220. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c522 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
0709 13:06:22.000678 (+158504us) raft_consensus.cc:1685] finished
0709 13:06:22.000859 (+   181us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.001175 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":165230,"prepare.queue_time_us":25188,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":33264,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":17558,"spinlock_wait_cycles":19481984,"thread_start_us":438699,"threads_started":1,"wal-append.queue_time_us":587289}
I20260709 13:06:22.063324 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:22.064139 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2704) took 2604 ms. Trace:
I20260709 13:06:22.064942 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:22.039529 20266 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:21.793497 20357 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.037338 20407 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:22.055545 20469 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.054603 20249 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:22.048537 12538 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:06:21.820624 20228 consensus_meta.cc:287] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.725s	user 0.012s	sys 0.003s
I20260709 13:06:22.066268 20268 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:22.066670 20470 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.067408 12695 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 27: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:22.068105 20400 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.069017 20493 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:22.115862 12543 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:22.116160 20400 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:22.069671 20446 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:22.070591 12689 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:22.073715 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:22.075006 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:22.064631 12694 rpcz_store.cc:276] 0709 13:06:19.460060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.776847 (+1316787us) service_pool.cc:224] Handling call
0709 13:06:20.789053 (+ 12206us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:20.789478 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.789513 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:20.790375 (+   862us) log.cc:844] Serialized 26 byte log entry
0709 13:06:21.291976 (+501601us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:21.292018 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.292082 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:22.063628 (+771546us) raft_consensus.cc:1685] finished
0709 13:06:22.063663 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.063948 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":3677,"thread_start_us":458799,"threads_started":1,"wal-append.queue_time_us":621956}
I20260709 13:06:22.075620 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:22.078491 12693 raft_consensus.cc:2393] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 21: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:22.078763 20394 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.079867 20359 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:22.080494 20395 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.085132 13197 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:22.046519 20492 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.085726 19988 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:22.101055 20470 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:22.102846 12687 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:06:22.127759 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2728) took 1108 ms. Trace:
I20260709 13:06:22.128340 12687 rpcz_store.cc:276] 0709 13:06:21.019441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.101701 (+1082260us) service_pool.cc:224] Handling call
0709 13:06:22.102252 (+   551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.127430 (+ 25178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.127674 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:22.105942 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1920) took 2289 ms. Trace:
W20260709 13:06:22.130949 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 46166.2us
I20260709 13:06:22.129834 12690 rpcz_store.cc:276] 0709 13:06:19.816486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.970703 (+1154217us) service_pool.cc:224] Handling call
0709 13:06:20.971175 (+   472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:20.999458 (+ 28283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.999505 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:21.024191 (+ 24686us) log.cc:844] Serialized 26 byte log entry
0709 13:06:21.407996 (+383805us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:06:21.408042 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.408135 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:21.844291 (+436156us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:06:22.044196 (+199905us) raft_consensus.cc:1685] finished
0709 13:06:22.044252 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.105749 (+ 61497us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35761,"raft.queue_time_us":43866,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"spinlock_wait_cycles":13251968,"thread_start_us":383503,"threads_started":1,"wal-append.queue_time_us":508800}
W20260709 13:06:22.127764 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 138497us
I20260709 13:06:22.134752 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:22.135385 20394 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:22.136739 20359 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:22.137863 20395 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.138785 20375 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:22.106428 20344 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.139880 20375 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:06:22.139935 20344 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.107147 20469 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:22.140872 20395 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:22.108148 12692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1922) took 2291 ms. Trace:
I20260709 13:06:22.108824 20228 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:22.149947 20493 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:22.151865 12687 raft_consensus.cc:1275] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:06:22.152437 12687 pending_rounds.cc:85] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 10
I20260709 13:06:22.152866 12687 pending_rounds.cc:107] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:06:22.153424 12687 raft_consensus.cc:2889] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:22.149747 12692 rpcz_store.cc:276] 0709 13:06:19.817014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.255543 (+1438529us) service_pool.cc:224] Handling call
0709 13:06:21.255928 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:21.427989 (+172061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:21.428030 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:21.429858 (+  1828us) log.cc:844] Serialized 26 byte log entry
0709 13:06:21.688170 (+258312us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:06:21.688434 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.689002 (+   568us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:22.050310 (+361308us) raft_consensus.cc:1685] finished
0709 13:06:22.060994 (+ 10684us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.107955 (+ 46961us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2524,"raft.queue_time_us":14367,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":5668,"thread_start_us":390329,"threads_started":2,"wal-append.queue_time_us":332378}
I20260709 13:06:22.154613 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2729) took 1045 ms. Trace:
I20260709 13:06:22.155170 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:22.155391 12696 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:06:22.155879 12692 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:22.156543 12690 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:22.157241 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2730) took 1047 ms. Trace:
I20260709 13:06:22.159983 20486 raft_consensus.cc:3055] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:22.129163 20492 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:22.160526 20486 raft_consensus.cc:740] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:22.162046 20486 consensus_queue.cc:260] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.163144 20228 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:22.164413 20486 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:22.155014 12687 rpcz_store.cc:276] 0709 13:06:21.109245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.129421 (+1020176us) service_pool.cc:224] Handling call
0709 13:06:22.151139 (+ 21718us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.154349 (+  3210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.154559 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:22.170154 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:22.107304 20481 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:22.170858 12687 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:22.172618 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:22.176604 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:22.178176 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:22.180275 20426 raft_consensus.cc:3055] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:06:22.180856 20426 raft_consensus.cc:740] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:22.180276 13230 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:22.182171 20426 consensus_queue.cc:260] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.138055 12662 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:22.146826 12621 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:22.183144 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:22.184322 12691 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 21. Current term is 22. Ops: []
W20260709 13:06:22.180706 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 46868.9us
I20260709 13:06:22.185429 20344 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:22.185429 13197 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:22.145542 12615 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:06:22.184422 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 46552us
I20260709 13:06:22.107714 19983 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:22.123773 12694 raft_consensus.cc:1275] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 30 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 30 index: 18. (index mismatch)
I20260709 13:06:22.157593 12690 rpcz_store.cc:276] 0709 13:06:21.109535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.132429 (+1022894us) service_pool.cc:224] Handling call
0709 13:06:22.133132 (+   703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.156977 (+ 23845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.157183 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:22.197799 12692 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
W20260709 13:06:22.209263 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 218812us
I20260709 13:06:22.211117 12687 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
I20260709 13:06:22.213846 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:22.214732 12616 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:06:22.215217 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.210389 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:22.218080 20251 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:22.218626 20498 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:22.219650 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:22.220409 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:22.221312 20498 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:22.221940 20426 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:22.224658 12588 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:22.225508 20498 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:22.229835 12588 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:06:22.231304 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.232474 20498 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:22.199295 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1933) took 1086 ms. Trace:
I20260709 13:06:22.234516 12694 rpcz_store.cc:276] 0709 13:06:21.108934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.122664 (+1013730us) service_pool.cc:224] Handling call
0709 13:06:22.123232 (+   568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.192970 (+ 69738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.194792 (+  1822us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:22.237715 20375 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:06:22.237884 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:22.238512 20375 raft_consensus.cc:697] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:22.238780 12613 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:22.239810 20375 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.19, Last appended by leader: 19, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.234067 20283 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.221227 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:22.248056 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:22.251307 12622 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 27: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:22.257987 20471 raft_consensus.cc:993] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372: : Instructing follower a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:06:22.257789 20283 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.258677 20471 raft_consensus.cc:1081] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 LEADER]: Signalling peer a11816c5d72e4d1295a242f3ced09e5f to start an election
I20260709 13:06:22.260345 20283 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:22.261370 20364 raft_consensus.cc:3055] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:22.261919 20364 raft_consensus.cc:740] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:22.262236 12618 raft_consensus.cc:1275] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:06:22.263170 20364 consensus_queue.cc:260] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:22.264464 20364 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:22.266247 20366 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:22.266780 20366 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:22.268196 20092 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.270618 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:22.271247 12513 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:22.272460 20273 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:22.248485 19988 consensus_queue.cc:1059] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:06:22.274497 19988 raft_consensus.cc:3055] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:22.274917 19988 raft_consensus.cc:740] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:22.276264 19988 consensus_queue.cc:260] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.262099 20091 consensus_queue.cc:260] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:22.277853 20228 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.278535 20228 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.279919 20091 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:22.280516 12691 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:06:22.277539 20126 consensus_queue.cc:1059] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:22.281819 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:22.249254 12621 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:06:22.288734 12538 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 23.
I20260709 13:06:22.290984 20306 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.291342 20271 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:22.291493 20306 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:22.292089 20271 raft_consensus.cc:697] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:22.297449 12512 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:22.297796 20481 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:06:22.298326 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 56144.4us
I20260709 13:06:22.298635 20126 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:22.299202 12512 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:22.293474 20271 consensus_queue.cc:237] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.302083 19988 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:06:22.307950 20311 consensus_meta.cc:287] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.010s
I20260709 13:06:22.308528 20311 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.308771 20488 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:06:22.310432 13228 raft_consensus.cc:2393] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 17: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:22.311458 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:22.314090 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:22.314358 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 2597) took 2435 ms. Trace:
I20260709 13:06:22.314791 12689 rpcz_store.cc:276] 0709 13:06:19.878654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.359224 (+1480570us) service_pool.cc:224] Handling call
0709 13:06:21.359578 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.122633 (+763055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.314084 (+191451us) spinlock_profiling.cc:243] Waited 710 ms on lock 0x7b540016f3d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:22.314300 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1633936256}
I20260709 13:06:22.315755 12662 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:22.316614 20268 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:22.317312 20268 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:22.318931 12662 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:22.319854 20268 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:22.321870 20126 raft_consensus.cc:697] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 17 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:22.324198 20403 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:22.324795 20403 raft_consensus.cc:697] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 20 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:22.325384 20357 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:22.325686 20407 consensus_queue.cc:1059] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:22.325965 20403 consensus_queue.cc:237] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.320004 20311 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:22.329834 12616 raft_consensus.cc:2468] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
I20260709 13:06:22.334019 12613 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:22.321513 12662 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:22.348237 20484 consensus_queue.cc:1059] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:22.349881 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:22.351090 20228 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:22.350006 20406 raft_consensus.cc:3055] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:22.352317 12615 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
I20260709 13:06:22.326222 20357 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:22.361795 20228 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:22.355132 20406 raft_consensus.cc:740] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:22.363200 12662 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:22.364145 20406 consensus_queue.cc:260] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:22.365737 20251 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:22.366205 20251 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:22.366586 20251 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:22.369897 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:22.323207 20126 consensus_queue.cc:237] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:22.365377 12662 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:22.377710 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 148055us
I20260709 13:06:22.406004 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:22.376461 20406 raft_consensus.cc:3060] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:22.435662 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:22.437764 20510 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 13:06:22.457471 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:22.493162 20508 log.cc:927] Time spent T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.154s	user 0.000s	sys 0.002s
I20260709 13:06:22.401690 20357 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:22.436241 12659 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:22.338603 20471 consensus_queue.cc:1059] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:06:22.645373 12688 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 20. Current term is 21. Ops: []
W20260709 13:06:22.647821 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 247154us
I20260709 13:06:22.649260 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:22.650694 12693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 2624) took 1227 ms (client timeout 1553 ms). Trace:
W20260709 13:06:22.653744 12693 rpcz_store.cc:269] 0709 13:06:21.419581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.487881 (+ 68300us) service_pool.cc:224] Handling call
0709 13:06:22.458595 (+970714us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b5400311ad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:22.646465 (+187870us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1313257344}
I20260709 13:06:22.655288 12692 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 23.
I20260709 13:06:22.655709 12693 raft_consensus.cc:1240] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:06:22.656390 12617 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:06:22.656865 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:22.657406 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.671068 20091 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:22.673803 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1798) took 3054 ms. Trace:
I20260709 13:06:22.675830 20366 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.674503 12544 rpcz_store.cc:276] 0709 13:06:19.618973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.060725 (+441752us) service_pool.cc:224] Handling call
0709 13:06:20.150985 (+ 90260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:20.151414 (+   429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:20.151459 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:20.156889 (+  5430us) log.cc:844] Serialized 26 byte log entry
0709 13:06:20.964353 (+807464us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b1800234e80. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:06:21.441240 (+476887us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:06:21.441279 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.446012 (+  4733us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:21.976616 (+530604us) raft_consensus.cc:1685] finished
0709 13:06:21.976656 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:22.673367 (+696711us) spinlock_profiling.cc:243] Waited 58.5 ms on lock 0x7b5400228150. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:22.673570 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1669,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":2843,"spinlock_wait_cycles":141737600,"thread_start_us":476688,"threads_started":1,"wal-append.queue_time_us":1530287}
I20260709 13:06:22.679097 20357 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:22.681615 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 329732us
I20260709 13:06:22.683718 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:22.661827 12588 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:22.664502 20268 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:06:22.685509 20466 log.cc:927] Time spent T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.986s	user 0.003s	sys 0.002s
I20260709 13:06:22.686188 20450 raft_consensus.cc:2804] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:22.652383 20311 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.687274 12659 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:22.688428 20228 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.696764 20344 consensus_queue.cc:1048] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:22.697615 20450 raft_consensus.cc:697] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 24 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:22.702004 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 2616) took 1706 ms. Trace:
I20260709 13:06:22.703253 12694 raft_consensus.cc:1275] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:06:22.691679 12689 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 24.
W20260709 13:06:22.710340 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 345073us
I20260709 13:06:22.711499 12615 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:06:22.713989 12696 rpcz_store.cc:276] 0709 13:06:20.995999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.549912 (+553913us) service_pool.cc:224] Handling call
0709 13:06:21.625943 (+ 76031us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:22.155945 (+530002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.701703 (+545758us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b540012d754. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:22.701945 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1216389504}
I20260709 13:06:22.687069 20092 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:22.731631 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 48257.5us
I20260709 13:06:22.740667 12659 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:22.755039 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:22.726428 20283 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:22.769409 12659 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:22.778584 12689 raft_consensus.cc:1240] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:06:22.780535 12689 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:06:22.783490 12696 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:06:22.751107 20268 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:22.780645 20251 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:22.788532 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 127529us
I20260709 13:06:22.799067 12662 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:22.822088 12693 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:06:22.789398 20211 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:22.828184 20238 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:22.831278 20251 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:22.835448 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 97599us
W20260709 13:06:22.848110 20512 log.cc:927] Time spent T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:06:22.851547 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:22.762245 20311 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.857817 12694 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 26. Current term is 27. Ops: []
W20260709 13:06:22.858732 20515 log.cc:927] Time spent T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
W20260709 13:06:22.862365 12695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 1932) took 1753 ms (client timeout 1500 ms). Trace:
W20260709 13:06:22.862524 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:22.862039 20450 consensus_queue.cc:237] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:22.862800 12695 rpcz_store.cc:269] 0709 13:06:21.108666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.157692 (+ 49026us) service_pool.cc:224] Handling call
0709 13:06:22.862093 (+1704401us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b5400405454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:22.862285 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2026138880}
I20260709 13:06:22.864959 20293 raft_consensus.cc:3055] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:22.865391 20293 raft_consensus.cc:740] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:22.867178 12621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997"
dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
 from {username='slave'} at 127.0.0.1:60170
I20260709 13:06:22.867268 12617 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:22.868497 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:22.867977 12621 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:22.870308 12621 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:22.829242 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:22.881199 13228 raft_consensus.cc:3055] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:22.881669 13228 raft_consensus.cc:740] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:22.820248 20268 raft_consensus.cc:697] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 21 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:22.783748 20228 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.889870 12695 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260709 13:06:22.891664 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 62527.5us
W20260709 13:06:22.894394 20511 log.cc:927] Time spent T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:06:22.895411 20507 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:22.896662 20507 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:22.885746 20379 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.906312 20379 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:22.906750 13228 consensus_queue.cc:260] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.908058 13228 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:22.908929 20379 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:22.896826 12662 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:22.893492 12588 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:22.847450 20366 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:22.884799 20364 consensus_meta.cc:287] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.620s	user 0.011s	sys 0.007s
W20260709 13:06:22.888717 20486 consensus_meta.cc:287] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.724s	user 0.016s	sys 0.003s
I20260709 13:06:22.931401 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:22.932475 12547 raft_consensus.cc:2393] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 27: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:22.933255 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2727) took 1914 ms. Trace:
I20260709 13:06:22.933626 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:22.933706 12688 rpcz_store.cc:276] 0709 13:06:21.019155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.729390 (+710235us) service_pool.cc:224] Handling call
0709 13:06:22.642798 (+913408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:22.657253 (+ 14455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.933044 (+275791us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b5400311ad0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:22.933197 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2098312960}
I20260709 13:06:22.934518 12543 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:06:22.866617 20293 consensus_queue.cc:260] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:22.931624 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:22.910097 20251 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:06:22.959103 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 65845.8us
I20260709 13:06:22.959021 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:22.947472 20091 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:22.979195 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:22.983613 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:22.984081 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:22.984377 20228 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:22.985292 20182 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260709 13:06:22.984462 12540 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:22.999372 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:23.022750 13230 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:23.022773 12588 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:23.057664 12688 raft_consensus.cc:1275] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:06:23.001302 20251 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.995272 20228 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:23.063506 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:23.069310 12620 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 23.
I20260709 13:06:23.070187 12662 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:23.072782 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 302893us
I20260709 13:06:23.078645 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:23.079972 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 31 candidate_status { last_received { term: 28 index: 17 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:23.084424 12540 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
W20260709 13:06:23.085403 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 109010us
I20260709 13:06:23.087246 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:23.068822 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:23.095299 12544 raft_consensus.cc:2393] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 21: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:23.096174 13197 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:23.097548 13197 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:23.101655 20450 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:23.104599 20450 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.105173 20450 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:23.107204 12547 raft_consensus.cc:2410] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 24 because replica has last-logged OpId of term: 23 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 12.
I20260709 13:06:23.108476 13230 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 23.
W20260709 13:06:23.113497 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 52811.1us
W20260709 13:06:23.113873 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 114315us
I20260709 13:06:23.114499 12662 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:23.115461 20306 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:23.116137 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:23.116967 13235 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 27.
I20260709 13:06:23.094465 20092 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:23.061265 20271 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:23.119379 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:23.119311 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:23.128075 12615 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 24: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:06:23.121968 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.117519 12662 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:23.125797 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:23.131570 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:23.200047 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 70260.4us
I20260709 13:06:23.211122 12622 raft_consensus.cc:2368] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:06:23.118448 20375 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:23.109699 20251 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:23.250229 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:23.121205 20311 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:23.194480 20494 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:23.256735 12619 raft_consensus.cc:1240] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 23. Current term is 24. Ops: [21.12-23.13]
I20260709 13:06:23.195847 20238 raft_consensus.cc:697] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:23.252535 12543 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:06:23.196030 20211 raft_consensus.cc:697] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 24 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:23.237963 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:23.255564 12621 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:23.258963 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:23.244933 20126 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.009s	sys 0.031s
I20260709 13:06:23.106300 20268 consensus_queue.cc:237] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:23.272002 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:23.264885 20306 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.281911 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:23.281859 20306 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:23.282395 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:23.283581 12692 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:06:23.284734 12614 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:06:23.286393 20525 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:23.287249 20525 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:23.254575 20091 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:06:23.291868 20533 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.292469 20533 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:23.293502 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:23.294126 12617 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 23 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:06:23.294301 12622 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:23.294889 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:23.295152 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:23.295467 12619 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:23.295799 12617 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:23.247716 20375 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:23.310135 12621 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:23.300454 12687 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:23.208922 20486 consensus_queue.cc:1059] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.061s
I20260709 13:06:23.257061 20494 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:06:23.312366 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 94331.9us
I20260709 13:06:23.313069 20426 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:06:23.313803 20519 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:06:23.203567 20271 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:23.315793 20251 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:23.319161 20533 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:23.302474 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:23.303506 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 83705.4us
I20260709 13:06:23.327162 20375 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:23.342006 12622 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:06:23.361153 13199 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:23.362640 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:23.341066 20494 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:23.385022 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:23.326076 20487 consensus_queue.cc:1048] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.153s
I20260709 13:06:23.353252 12687 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 26.
I20260709 13:06:23.353921 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:23.343189 12696 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:06:23.290234 20211 consensus_queue.cc:237] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:23.389259 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:23.347134 12619 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14.
W20260709 13:06:23.394366 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.398474 12693 raft_consensus.cc:2393] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 19: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:23.399506 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:23.400624 12687 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 27: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:23.390574 20524 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:23.369733 20426 consensus_queue.cc:1048] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
W20260709 13:06:23.449098 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 330495us
I20260709 13:06:23.339744 20238 consensus_queue.cc:237] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:23.459527 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 56819.4us
W20260709 13:06:23.452458 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 191204us
W20260709 13:06:23.449780 20519 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:23.459964 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: true dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:23.394433 20486 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.057s
I20260709 13:06:23.463212 12696 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:23.451802 20507 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.468717 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:23.445345 20451 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.021s
I20260709 13:06:23.522629 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:23.569904 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1831) took 1377 ms. Trace:
I20260709 13:06:23.570384 12539 rpcz_store.cc:276] 0709 13:06:22.192661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.271709 (+ 79048us) service_pool.cc:224] Handling call
0709 13:06:22.272123 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:22.327121 (+ 54998us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:06:22.378438 (+ 51317us) log.cc:844] Serialized 14 byte log entry
0709 13:06:22.946960 (+568522us) log.cc:844] Serialized 14 byte log entry
0709 13:06:23.081435 (+134475us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b180039ec20. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c3f3 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
0709 13:06:23.083948 (+  2513us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b180039ec20. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a6406c0a 00007fc3afb46219 00007fc3a648ea40 00007fc3a64894e4 00007fc3a6489455 00007fc3a9571060 00007fc3a9583716 00007fc3a9594287 00007fc3a9594208
0709 13:06:23.084158 (+   210us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:23.084756 (+   598us) log.cc:844] Serialized 26 byte log entry
0709 13:06:23.084894 (+   138us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:06:23.084927 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.085001 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:23.569640 (+484639us) raft_consensus.cc:1685] finished
0709 13:06:23.569662 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.569816 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2085,"prepare.queue_time_us":37727,"prepare.run_cpu_time_us":8903,"prepare.run_wall_time_us":250271,"raft.queue_time_us":139498,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":209,"spinlock_wait_cycles":60936192,"thread_start_us":281619,"threads_started":1,"wal-append.queue_time_us":649903}
I20260709 13:06:23.523432 12689 raft_consensus.cc:1275] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:06:23.525669 20528 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:23.525498 20507 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:23.526857 20534 log.cc:927] Time spent T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:06:23.520260 20357 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:23.530120 12693 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 17. (term mismatch)
W20260709 13:06:23.533453 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:23.524807 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 63491us
I20260709 13:06:23.594739 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:23.452211 20092 consensus_queue.cc:1059] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.090s
I20260709 13:06:23.545877 20542 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:23.559995 20271 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:23.590395 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:23.594480 12693 pending_rounds.cc:85] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 16
I20260709 13:06:23.600201 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1936) took 1227 ms. Trace:
I20260709 13:06:23.602710 12693 pending_rounds.cc:107] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 23.17
I20260709 13:06:23.603089 12693 raft_consensus.cc:2889] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:23.603955 12616 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:23.600153 12587 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:23.602838 12690 rpcz_store.cc:276] 0709 13:06:22.372835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.742335 (+369500us) service_pool.cc:224] Handling call
0709 13:06:22.786603 (+ 44268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:22.837961 (+ 51358us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:06:22.838003 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:22.838657 (+   654us) log.cc:844] Serialized 26 byte log entry
0709 13:06:23.211771 (+373114us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:06:23.211813 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.212113 (+   300us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:23.599925 (+387812us) raft_consensus.cc:1685] finished
0709 13:06:23.599955 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.600124 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5676,"raft.queue_time_us":140287,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":5516,"thread_start_us":372600,"threads_started":1,"wal-append.queue_time_us":545113}
I20260709 13:06:23.608536 12689 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 25. Current term is 26. Ops: []
I20260709 13:06:23.615242 20092 consensus_queue.cc:1243] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:06:23.606824 20542 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:23.615960 20092 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:23.616442 20092 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:23.617676 20542 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:23.619464 20366 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:23.620043 20366 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:23.620733 20507 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:23.624711 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:23.621336 20507 raft_consensus.cc:3055] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:23.631085 13199 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:23.626798 20547 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:23.627722 20366 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:23.611654 20541 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:23.605706 12696 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 24.
I20260709 13:06:23.605924 20528 raft_consensus.cc:697] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 23 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:23.611977 20271 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:23.648247 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 48170us
W20260709 13:06:23.649822 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 144650us
I20260709 13:06:23.644809 20451 consensus_queue.cc:1048] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:06:23.678565 20426 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:23.679138 20426 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:23.679651 20468 consensus_queue.cc:1059] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:23.680877 20528 consensus_queue.cc:237] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:23.681463 20426 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:23.689692 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 48796.8us
I20260709 13:06:23.629716 20507 raft_consensus.cc:740] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:23.614305 20357 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:23.639626 20547 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:23.689170 20228 consensus_meta.cc:287] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.618s	user 0.006s	sys 0.006s
I20260709 13:06:23.695436 12587 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:23.699481 20507 consensus_queue.cc:260] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:23.673271 20541 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:23.638931 20470 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.062s
I20260709 13:06:23.706947 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:23.708045 12622 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:23.649000 20486 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:23.712679 20092 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:23.713431 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:23.713581 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:23.717070 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:23.714815 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:23.715844 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:23.719127 12615 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 24: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:23.719395 12619 raft_consensus.cc:3055] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:23.719775 12619 raft_consensus.cc:740] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:23.720456 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:23.720588 12619 consensus_queue.cc:260] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:23.721258 12616 raft_consensus.cc:2368] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:06:23.721837 12619 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:23.723342 20541 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:23.716178 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:23.739068 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:23.744753 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 49458.4us
I20260709 13:06:23.702482 20547 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:23.748631 12622 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:23.707794 20228 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:23.754413 12662 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:23.709368 20524 consensus_queue.cc:1059] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.032s
I20260709 13:06:23.755340 20507 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:23.766434 20533 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 13:06:23.780129 12619 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 14. (term mismatch)
I20260709 13:06:23.780745 12619 pending_rounds.cc:85] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 13
I20260709 13:06:23.781111 12619 pending_rounds.cc:107] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 21.14
I20260709 13:06:23.781432 12619 raft_consensus.cc:2889] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:23.782032 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:23.783473 12616 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:23.786247 20126 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:23.786875 20126 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:23.791594 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:23.791730 20481 raft_consensus.cc:3055] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:23.793121 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:23.748365 20092 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:23.794862 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:23.797993 12616 raft_consensus.cc:2376] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 14. Re-sending same reply.
I20260709 13:06:23.728068 20487 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.048s
I20260709 13:06:23.796515 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:23.800280 20092 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:23.800451 20268 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:23.800796 20092 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:23.801123 20268 raft_consensus.cc:697] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:23.802141 20268 consensus_queue.cc:237] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:23.804641 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:23.806126 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:23.807754 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:23.808756 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:23.809942 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:06:23.810144 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 55826.8us
I20260709 13:06:23.810544 13230 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:23.810815 20379 consensus_queue.cc:1059] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.015s
I20260709 13:06:23.811661 20379 raft_consensus.cc:3055] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:23.811990 20379 raft_consensus.cc:740] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:23.813045 20375 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:23.813702 20548 consensus_queue.cc:1059] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:23.814693 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:23.815004 20091 raft_consensus.cc:3055] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:23.815237 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:23.815460 20091 raft_consensus.cc:740] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:23.813995 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:23.815866 12621 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 17.
I20260709 13:06:23.816335 20091 consensus_queue.cc:260] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:23.818308 20375 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:23.789306 20126 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:23.811990 12662 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:23.820181 20554 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:23.823033 20357 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:23.781504 20366 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.826726 13232 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 16. Current term is 17. Ops: []
W20260709 13:06:23.841328 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.845276 12622 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 22.
I20260709 13:06:23.827306 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:23.850869 13230 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:06:23.850716 13233 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 14.
I20260709 13:06:23.862566 12547 raft_consensus.cc:1275] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:06:23.812922 20379 consensus_queue.cc:260] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:23.825335 20091 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:23.867084 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:23.867666 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:23.748344 20271 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:23.797194 20481 raft_consensus.cc:740] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:23.851783 20357 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.889186 12662 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:23.844002 19988 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.895887 20468 consensus_queue.cc:1048] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:23.896257 19988 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:23.895879 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:23.902340 20481 consensus_queue.cc:260] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:23.904335 20481 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:23.908437 20271 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:23.932247 20306 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:23.886474 12544 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260709 13:06:23.882965 12543 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:06:23.893544 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:23.828691 20366 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:23.912717 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:23.890909 12587 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:23.954411 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 63588.7us
I20260709 13:06:23.956949 20550 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:23.957854 20555 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:23.958276 20366 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:23.958457 20555 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:23.959812 20523 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.857s	user 0.001s	sys 0.002s
I20260709 13:06:23.960899 20555 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:23.962272 13234 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 19. Current term is 20. Ops: []
W20260709 13:06:23.954420 12620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 4281) took 2338 ms (client timeout 1624 ms). Trace:
W20260709 13:06:23.962980 12620 rpcz_store.cc:269] 0709 13:06:21.616185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.616328 (+   143us) service_pool.cc:224] Handling call
0709 13:06:23.954209 (+2337881us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b54001cbe54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:23.954345 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1798204672}
I20260709 13:06:23.965991 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:23.966750 12694 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 25.
W20260709 13:06:23.967427 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.957530 20550 raft_consensus.cc:697] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 24 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:06:23.976253 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:23.975991 20550 consensus_queue.cc:237] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:23.978981 20530 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.875s	user 0.004s	sys 0.000s
I20260709 13:06:23.981542 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1935) took 1609 ms. Trace:
I20260709 13:06:23.982735 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:23.982093 12691 rpcz_store.cc:276] 0709 13:06:22.372580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.707205 (+334625us) service_pool.cc:224] Handling call
0709 13:06:22.723792 (+ 16587us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:22.752888 (+ 29096us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:22.752972 (+    84us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:22.790268 (+ 37296us) log.cc:844] Serialized 26 byte log entry
0709 13:06:23.103845 (+313577us) raft_consensus.cc:1645] Marking committed up to 19
0709 13:06:23.104143 (+   298us) log.cc:844] Serialized 14 byte log entry
0709 13:06:23.104314 (+   171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.104394 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:23.978047 (+873653us) spinlock_profiling.cc:243] Waited 8.14 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:06:23.981150 (+  3103us) raft_consensus.cc:1685] finished
0709 13:06:23.981288 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:23.981463 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1154,"prepare.queue_time_us":19319,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":187998,"raft.run_cpu_time_us":365,"raft.run_wall_time_us":34965,"spinlock_wait_cycles":18721664,"thread_start_us":214317,"threads_started":1,"wal-append.queue_time_us":225763}
W20260709 13:06:23.921399 20517 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.850s	user 0.004s	sys 0.001s
I20260709 13:06:23.887051 20211 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.925832 13235 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 22. Current term is 23. Ops: [20.15-22.16]
I20260709 13:06:23.925963 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: true dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:23.929872 20357 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:24.008910 13229 raft_consensus.cc:3055] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:23.931991 12662 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:06:23.932233 20450 consensus_meta.cc:287] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.824s	user 0.009s	sys 0.001s
I20260709 13:06:23.934054 13227 pending_rounds.cc:85] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: Aborting all ops after (but not including) 13
I20260709 13:06:24.014539 13227 pending_rounds.cc:107] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260709 13:06:23.935729 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:23.940068 20527 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
W20260709 13:06:23.944303 12659 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.624s (SENT) [suppressed 30 similar messages]
I20260709 13:06:23.848757 20548 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 13:06:23.950742 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:23.952270 20494 consensus_meta.cc:287] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.000s
I20260709 13:06:23.990633 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:24.024120 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:23.527182 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:24.028153 12692 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:24.029906 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:24.030650 13232 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 25.
W20260709 13:06:24.031136 20553 log.cc:927] Time spent T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
W20260709 13:06:24.050572 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.051904 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:24.020787 20556 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:24.022429 20366 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.107715 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:24.020898 20450 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:24.099898 20556 raft_consensus.cc:697] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 23 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:24.119719 20556 consensus_queue.cc:237] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:24.120656 20526 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.121407 20526 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:24.123394 20529 log.cc:927] Time spent T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 1.022s	user 0.005s	sys 0.002s
I20260709 13:06:24.124178 20526 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:24.124902 19988 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:24.120728 20293 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:24.130110 12690 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:06:24.130223 12622 raft_consensus.cc:1240] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 21. Current term is 22. Ops: []
W20260709 13:06:23.997942 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 102594us
I20260709 13:06:23.930367 13228 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:06:24.131230 20450 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:24.009753 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 77845.2us
I20260709 13:06:24.009362 13229 raft_consensus.cc:740] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:24.012773 13235 raft_consensus.cc:1240] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:24.018220 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 2019) took 1574 ms. Trace:
I20260709 13:06:24.022526 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:24.014822 13227 raft_consensus.cc:2889] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:24.132689 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:24.135695 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:24.136322 13232 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 27.
I20260709 13:06:24.137789 12615 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 27 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
W20260709 13:06:24.142864 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.045750 20494 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:24.133045 13229 consensus_queue.cc:260] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:24.156224 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:24.170114 13229 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:24.132301 12512 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:24.133503 12613 rpcz_store.cc:276] 0709 13:06:22.438892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.647235 (+208343us) service_pool.cc:224] Handling call
0709 13:06:22.653850 (+  6615us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:22.654299 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:22.654333 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:22.654907 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 13:06:22.815071 (+160164us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:06:22.815132 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:22.815230 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:23.920514 (+1105284us) spinlock_profiling.cc:243] Waited 48.3 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:06:23.990070 (+ 69556us) raft_consensus.cc:1685] finished
0709 13:06:23.990118 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.009612 (+ 19494us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":110982016,"thread_start_us":159646,"threads_started":1,"wal-append.queue_time_us":322433}
I20260709 13:06:24.159098 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:24.170614 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:24.159760 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:24.161679 12513 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:24.162334 19988 consensus_queue.cc:1059] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:06:24.166061 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:24.166445 20344 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:06:24.166579 20548 consensus_queue.cc:1059] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:24.168601 20357 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:24.172246 13232 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 25.
I20260709 13:06:24.029165 20211 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:24.178349 12588 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:06:24.179931 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 47800.2us
W20260709 13:06:24.182879 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 50302.9us
I20260709 13:06:24.180734 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:24.189664 13234 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:24.174258 20555 raft_consensus.cc:2764] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:06:24.103796 20366 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:24.197108 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 420544us
I20260709 13:06:24.193327 12545 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:24.195477 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:24.198544 13230 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 22.
I20260709 13:06:24.205328 12512 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:24.133960 20306 consensus_queue.cc:1059] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:06:24.220273 20357 raft_consensus.cc:3055] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:24.217700 20126 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.008s
W20260709 13:06:24.226981 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.227349 13226 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:06:24.225890 20357 raft_consensus.cc:740] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:06:24.194633 20528 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.066s	sys 0.093s
I20260709 13:06:24.190287 20228 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:24.191933 20364 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:06:24.195704 20541 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:06:24.194769 20283 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:06:24.238343 20496 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.148s	user 0.015s	sys 0.025s
W20260709 13:06:24.243068 20528 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.067s	sys 0.093s
I20260709 13:06:24.217844 20468 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:06:24.272040 12689 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.028s	sys 0.041s
W20260709 13:06:24.282161 12689 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.029s	sys 0.041s
I20260709 13:06:24.266196 20541 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.265911 19988 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader election won for term 26
W20260709 13:06:24.281773 20496 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.189s	user 0.015s	sys 0.026s
I20260709 13:06:24.270376 20306 consensus_queue.cc:1243] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:06:24.270682 20126 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:24.300117 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:06:24.285532 20403 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.935s	user 0.031s	sys 0.057s
I20260709 13:06:24.303319 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:24.266992 20228 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:24.297324 20468 raft_consensus.cc:697] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:24.301578 20541 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:24.338191 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:06:24.316416 20268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.014s	sys 0.058s
I20260709 13:06:24.339087 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:24.349089 12544 raft_consensus.cc:2410] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 24 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
W20260709 13:06:24.330101 20403 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.980s	user 0.031s	sys 0.057s
I20260709 13:06:24.353113 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:24.315671 20306 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:24.317420 19988 raft_consensus.cc:697] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 26 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:06:24.348599 20268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.014s	sys 0.062s
W20260709 13:06:24.349344 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 405042us
I20260709 13:06:24.359056 12543 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 13. (term mismatch)
I20260709 13:06:24.355494 12547 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:24.336809 20549 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:06:24.368225 12543 pending_rounds.cc:85] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 12
I20260709 13:06:24.375842 12543 pending_rounds.cc:107] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 23.13
I20260709 13:06:24.373556 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:24.376569 12543 raft_consensus.cc:2889] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:24.376754 12544 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 25.
I20260709 13:06:24.379333 20357 consensus_queue.cc:260] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:24.380357 20549 raft_consensus.cc:697] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 27 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:24.380838 20357 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:24.388420 13229 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 24.
I20260709 13:06:24.378017 12659 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:24.389817 20268 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:24.395815 20268 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:24.381733 20092 consensus_meta.cc:287] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.000s
I20260709 13:06:24.397774 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:24.419276 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 227722us
W20260709 13:06:24.420094 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.421342 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:24.422055 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:24.433380 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:24.434526 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:24.435143 12544 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:24.422607 20364 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:24.436964 20364 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:24.439973 20364 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:24.440666 20364 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.441167 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:24.441838 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.456004 12547 raft_consensus.cc:1275] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 13:06:24.373646 20547 consensus_meta.cc:287] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.598s	user 0.006s	sys 0.004s
I20260709 13:06:24.471777 12547 raft_consensus.cc:1275] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:06:24.459470 12544 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
W20260709 13:06:24.474386 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 195381us
I20260709 13:06:24.483603 12618 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 24 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:24.358613 20126 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:24.424113 20526 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:24.425640 20494 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:24.498443 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:24.499706 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:24.395888 20211 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:24.490463 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:24.500519 12547 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 25.
I20260709 13:06:24.389873 20306 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:24.505086 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:24.486398 13200 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:24.512905 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:24.472941 20533 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.516065 12540 raft_consensus.cc:2410] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:06:24.441247 20364 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:24.424660 20092 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:24.491325 20526 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:24.492547 20550 consensus_queue.cc:1059] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
W20260709 13:06:24.539434 12510 leader_election.cc:336] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.549s (SENT)
I20260709 13:06:24.539912 12510 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:24.540838 20287 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:24.461728 20453 consensus_queue.cc:1048] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.240s
I20260709 13:06:24.532604 20540 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:24.381516 20549 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:24.482663 20547 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:24.544886 20481 consensus_meta.cc:287] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.640s	user 0.008s	sys 0.005s
I20260709 13:06:24.546092 20526 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:24.578117 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:24.583274 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.608763 12614 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:24.568099 20366 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:24.528452 20533 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:24.579274 20451 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:24.505858 20468 consensus_queue.cc:237] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:24.623256 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 136952us
I20260709 13:06:24.532929 19988 consensus_queue.cc:237] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:24.609383 20481 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.636947 13200 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:24.667148 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:24.656764 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 158415us
W20260709 13:06:24.655663 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 234458us
I20260709 13:06:24.675209 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:06:24.684720 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 47904.3us
W20260709 13:06:24.686198 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.624054 20579 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:24.623508 20451 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:24.692116 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.628122 20228 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:24.631953 20525 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:24.660595 20403 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.668064 20287 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.666975 20494 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 13:06:24.694785 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:24.696084 12662 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:24.670816 20481 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:24.667131 20182 consensus_queue.cc:1048] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:06:24.693849 20579 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:24.776060 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:24.854696 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 179598us
W20260709 13:06:24.859515 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.699705 20584 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:24.786080 20570 log.cc:927] Time spent T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
W20260709 13:06:24.781672 20580 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:06:24.860882 20579 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:06:24.873975 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 178920us
W20260709 13:06:24.787065 20565 log.cc:927] Time spent T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.295s	user 0.001s	sys 0.001s
W20260709 13:06:24.787189 20561 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
I20260709 13:06:24.791643 20581 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:24.790261 20563 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
W20260709 13:06:24.781082 20557 log.cc:927] Time spent T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
W20260709 13:06:24.789999 20569 log.cc:927] Time spent T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 13:06:24.711584 20451 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:24.849251 20092 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:24.889096 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:24.780367 20582 raft_consensus.cc:3055] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:24.792264 20268 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:24.893368 12545 consensus_meta.cc:287] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.003s
I20260709 13:06:24.894474 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:24.891140 12662 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:06:24.876050 20091 consensus_meta.cc:287] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.989s	user 0.009s	sys 0.004s
I20260709 13:06:24.726235 20403 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:24.903955 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:24.869958 20591 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:24.888770 20306 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:24.790824 20547 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:24.914974 12545 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
I20260709 13:06:24.725962 20525 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:24.919699 20574 log.cc:927] Time spent T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
I20260709 13:06:24.920172 20481 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:24.920857 20228 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:24.871693 20287 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:24.916664 12662 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:24.935917 12615 raft_consensus.cc:1275] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 13:06:24.906737 20550 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:24.940593 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:24.968501 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:24.969465 12616 raft_consensus.cc:2376] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 23. Re-sending same reply.
I20260709 13:06:24.938480 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:24.963831 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 47258.6us
I20260709 13:06:24.931377 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
W20260709 13:06:24.964515 12545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3887) took 2025 ms (client timeout 1847 ms). Trace:
I20260709 13:06:24.927663 20539 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:06:24.927977 20602 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:06:24.971736 20528 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:24.983017 20528 raft_consensus.cc:697] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:24.983670 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:24.984293 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:24.983981 20528 consensus_queue.cc:237] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:24.984828 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:24.986114 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1959) took 1275 ms. Trace:
I20260709 13:06:24.987486 13229 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:06:24.986615 12693 rpcz_store.cc:276] 0709 13:06:23.711087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.711356 (+   269us) service_pool.cc:224] Handling call
0709 13:06:23.747362 (+ 36006us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:23.766373 (+ 19011us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:06:23.766407 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:23.766876 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:06:23.947974 (+181098us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:06:23.948014 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:23.948084 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:24.985911 (+1037827us) raft_consensus.cc:1685] finished
0709 13:06:24.985930 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.986059 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":952,"raft.queue_time_us":21585,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"thread_start_us":179825,"threads_started":1,"wal-append.queue_time_us":504370}
I20260709 13:06:24.974982 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:24.933792 20599 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:24.990262 20599 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:24.911468 20582 raft_consensus.cc:740] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:24.956152 20268 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:24.991901 20268 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:06:24.929891 20575 log.cc:927] Time spent T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.353s	user 0.000s	sys 0.001s
I20260709 13:06:24.993781 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1720) took 1061 ms. Trace:
I20260709 13:06:24.994275 13227 rpcz_store.cc:276] 0709 13:06:23.932864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.933119 (+   255us) service_pool.cc:224] Handling call
0709 13:06:23.933676 (+   557us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:24.167277 (+233601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:24.167310 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:24.167736 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:06:24.352789 (+185053us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:24.353727 (+   938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.353812 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:24.993464 (+639652us) raft_consensus.cc:1685] finished
0709 13:06:24.993493 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:24.993674 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":183966,"threads_started":1,"wal-append.queue_time_us":292925}
I20260709 13:06:24.995208 12620 raft_consensus.cc:1275] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:06:24.995625 12620 pending_rounds.cc:85] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 10
I20260709 13:06:24.978098 20588 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:24.995838 12620 pending_rounds.cc:107] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:06:24.996134 12620 raft_consensus.cc:2889] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:24.996204 20588 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:24.978678 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:06:24.999205 20564 log.cc:927] Time spent T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.619s	user 0.002s	sys 0.000s
I20260709 13:06:24.980868 20596 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:25.001223 20550 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.001941 20596 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.001466 12513 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:25.004372 20306 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:25.004928 20591 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.005071 20306 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:24.989657 12545 rpcz_store.cc:269] 0709 13:06:22.928855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.929071 (+   216us) service_pool.cc:224] Handling call
0709 13:06:24.156667 (+1227596us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b5800000c98. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454eee 0000000000375939 00007fc3ae4c81e0 00007fc3ae5910c4 00007fc3ae591131 00007fc3ae53f0a0 00007fc3ae53e984 00007fc3a7ab96d4 00007fc3a7ab9662
0709 13:06:24.954340 (+797673us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11315328}
I20260709 13:06:24.985070 13235 raft_consensus.cc:2393] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 20: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:24.985968 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:25.008795 13226 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
I20260709 13:06:25.009191 20406 raft_consensus.cc:3055] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:24.972362 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:25.009718 20406 raft_consensus.cc:740] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:25.010301 12613 raft_consensus.cc:2410] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:06:24.981602 20487 raft_consensus.cc:3055] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:06:25.010996 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:25.010852 20406 consensus_queue.cc:260] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:24.974272 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:25.012161 20406 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:25.011229 20487 raft_consensus.cc:740] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:25.013459 20487 consensus_queue.cc:260] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.014420 20403 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:25.014916 20487 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:25.015780 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:24.985495 12691 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 21.
I20260709 13:06:25.017815 12695 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 13:06:25.019460 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1958) took 1308 ms. Trace:
I20260709 13:06:25.019927 12696 rpcz_store.cc:276] 0709 13:06:23.710786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.711063 (+   277us) service_pool.cc:224] Handling call
0709 13:06:23.711590 (+   527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:23.742666 (+ 31076us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:23.742743 (+    77us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:23.844769 (+102026us) log.cc:844] Serialized 26 byte log entry
0709 13:06:24.350508 (+505739us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:06:24.350556 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.350619 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:25.019230 (+668611us) raft_consensus.cc:1685] finished
0709 13:06:25.019256 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:25.019396 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7759,"raft.queue_time_us":1745,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":6398,"thread_start_us":322488,"threads_started":1,"wal-append.queue_time_us":511045}
I20260709 13:06:25.021867 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2751) took 1039 ms. Trace:
W20260709 13:06:24.933727 20560 log.cc:927] Time spent T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.554s	user 0.004s	sys 0.000s
I20260709 13:06:25.006703 20306 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:25.022321 12687 rpcz_store.cc:276] 0709 13:06:23.984166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.988091 (+  3925us) service_pool.cc:224] Handling call
0709 13:06:23.988526 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:23.988997 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:23.989057 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:23.989653 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 13:06:24.297685 (+308032us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:24.297733 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.297809 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:25.021622 (+723813us) raft_consensus.cc:1685] finished
0709 13:06:25.021648 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:25.021798 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":127,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"thread_start_us":307538,"threads_started":1,"wal-append.queue_time_us":400126}
W20260709 13:06:24.937510 20592 log.cc:927] Time spent T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:06:24.992300 20268 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:24.971029 12617 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
I20260709 13:06:25.021435 20364 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:25.028098 20126 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:25.006011 20287 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:25.035830 20357 consensus_meta.cc:287] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.654s	user 0.012s	sys 0.000s
I20260709 13:06:25.038393 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2746) took 1651 ms. Trace:
I20260709 13:06:25.095045 12690 rpcz_store.cc:276] 0709 13:06:23.387362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.609989 (+222627us) service_pool.cc:224] Handling call
0709 13:06:23.627585 (+ 17596us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:24.130674 (+503089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.038072 (+907398us) spinlock_profiling.cc:243] Waited 502 ms on lock 0x7b54002fdad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:25.038316 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1155045632}
I20260709 13:06:25.096439 20527 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:25.098229 20582 consensus_queue.cc:260] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.099709 20582 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:25.099879 20540 consensus_queue.cc:1048] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:06:25.056316 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.056740 20379 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:24.961838 20533 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:24.921538 20593 consensus_queue.cc:1048] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.144s
W20260709 13:06:25.067425 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.070318 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.071096 12662 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:25.079195 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:25.069208 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:25.108072 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:24.903600 20576 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.189s
I20260709 13:06:25.115864 12617 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 22: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:25.097100 20527 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:25.121340 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 50362.2us
I20260709 13:06:25.117359 13200 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:25.115058 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 45966.9us
W20260709 13:06:25.087280 20541 consensus_meta.cc:287] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.728s	user 0.011s	sys 0.000s
I20260709 13:06:25.126856 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:25.126945 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:25.127802 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:25.134799 12615 raft_consensus.cc:2410] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:06:25.134613 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:25.135629 12620 raft_consensus.cc:2393] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 25: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:25.136718 12512 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:24.915132 20581 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.148988 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 2036) took 1086 ms. Trace:
I20260709 13:06:25.139056 12687 raft_consensus.cc:1240] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 21 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:06:25.086483 20579 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.126230 20238 consensus_queue.cc:1048] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:06:25.141497 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:25.151047 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:25.152264 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:25.157294 12690 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 23.
I20260709 13:06:25.110311 20496 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.149501 12614 rpcz_store.cc:276] 0709 13:06:24.063011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.063168 (+   157us) service_pool.cc:224] Handling call
0709 13:06:24.087570 (+ 24402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.613809 (+526239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.148726 (+534917us) spinlock_profiling.cc:243] Waited 518 ms on lock 0x7b54002a71d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:25.148919 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1191750016}
I20260709 13:06:25.113255 20525 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:25.159163 12512 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
W20260709 13:06:25.161285 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.087618 20591 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:25.139627 20539 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:25.094506 20526 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:25.174685 12621 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 26: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:25.150570 20426 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:25.176087 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:25.177587 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1960) took 1466 ms. Trace:
I20260709 13:06:25.179332 12688 raft_consensus.cc:1240] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:25.178143 12544 raft_consensus.cc:2468] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:06:25.183003 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:25.191411 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 404072us
I20260709 13:06:25.179605 12689 rpcz_store.cc:276] 0709 13:06:23.711388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.711565 (+   177us) service_pool.cc:224] Handling call
0709 13:06:23.747273 (+ 35708us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:23.765095 (+ 17822us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:23.765139 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:23.765747 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 13:06:24.294869 (+529122us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:24.294934 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:24.295051 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:24.932858 (+637807us) spinlock_profiling.cc:243] Waited 39.2 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:06:25.170902 (+238044us) raft_consensus.cc:1685] finished
0709 13:06:25.170933 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:25.177478 (+  6545us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59343,"raft.queue_time_us":20440,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":567,"spinlock_wait_cycles":90047744,"thread_start_us":516524,"threads_started":1,"wal-append.queue_time_us":593425}
I20260709 13:06:25.173679 20496 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.173902 20539 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.139056 20541 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.174078 20525 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:25.166270 20364 consensus_queue.cc:1059] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
W20260709 13:06:25.219393 20484 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.019s	sys 0.055s
I20260709 13:06:25.182431 20126 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 13:06:25.244271 20364 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:25.244763 20364 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.245086 20364 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:25.248783 20451 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.234444 20539 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:06:25.240451 20484 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.019s	sys 0.056s
I20260709 13:06:25.242547 20594 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.227803 20251 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
W20260709 13:06:25.285022 12546 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.000s	sys 0.021s
I20260709 13:06:25.272256 20584 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:25.301698 12546 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.000s	sys 0.021s
I20260709 13:06:25.273056 20596 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:25.242859 20525 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.304646 12541 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 26 LEADER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 25. Current term is 26. Ops: []
W20260709 13:06:25.324705 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 165660us
W20260709 13:06:25.329700 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.286335 20594 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:25.363495 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 169761us
I20260709 13:06:25.308115 20584 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.324432 20484 raft_consensus.cc:3055] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 LEADER]: Stepping down as leader of term 24
W20260709 13:06:25.370545 20613 log.cc:927] Time spent T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:06:25.368148 20484 raft_consensus.cc:740] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:25.372306 20484 consensus_queue.cc:260] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.374656 20581 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:25.377689 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.378285 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.378446 20579 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:25.364931 20496 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:25.365259 20527 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:25.381929 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:25.382778 13231 raft_consensus.cc:2393] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 20: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:25.384919 20541 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 28 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:25.385653 20306 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.387213 20526 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:25.387770 20306 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:25.359175 20596 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.388440 20596 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:25.389482 20584 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:25.396306 12659 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:25.373392 20484 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:25.420756 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:25.421347 13231 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:06:25.414530 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 45318.1us
I20260709 13:06:25.420053 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:25.365141 20287 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:25.437528 12513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.411113 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 280489us
I20260709 13:06:25.422324 13226 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:25.425099 12619 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 16. (term mismatch)
I20260709 13:06:25.438506 12619 pending_rounds.cc:85] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 15
I20260709 13:06:25.438755 12619 pending_rounds.cc:107] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260709 13:06:25.438993 12619 raft_consensus.cc:2889] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:25.425249 12512 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:25.430069 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:25.430583 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:25.442459 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:25.443120 12545 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:25.369164 20451 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:25.433842 12617 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:06:25.435245 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:25.445266 12662 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:25.452664 12614 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:25.431301 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 28 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:25.398540 20608 raft_consensus.cc:3055] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:06:25.468087 20611 log.cc:927] Time spent T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:06:25.468199 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:25.469075 12691 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
W20260709 13:06:25.478300 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 53122.9us
I20260709 13:06:25.444085 20526 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:25.479439 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:25.480688 12512 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:25.482697 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:25.444741 20621 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:25.457461 20596 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:25.419512 20364 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.503859 12545 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:06:25.457762 20608 raft_consensus.cc:740] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:25.475579 20591 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:25.494095 20283 raft_consensus.cc:3055] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:25.518146 20238 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:06:25.519969 20487 consensus_meta.cc:287] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.000s
I20260709 13:06:25.529872 20379 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.505508 20621 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.487356 19988 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:25.482664 20526 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:25.534660 20525 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:25.540556 13231 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 28.
W20260709 13:06:25.541846 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 62644.5us
I20260709 13:06:25.534140 20532 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.544559 12543 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:06:25.504814 20426 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.545717 13227 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:06:25.552990 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:25.555689 13226 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 23.
I20260709 13:06:25.549029 12614 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:06:25.559213 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35624 (request call id 1848) took 1064 ms. Trace:
I20260709 13:06:25.559679 12544 rpcz_store.cc:276] 0709 13:06:24.495078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.512494 (+ 17416us) service_pool.cc:224] Handling call
0709 13:06:25.559031 (+1046537us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b54001ab8d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:25.559151 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1391928064}
I20260709 13:06:25.539644 20283 raft_consensus.cc:740] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:25.550928 12513 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:25.547245 19988 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.577807 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1965) took 1592 ms. Trace:
I20260709 13:06:25.578397 12695 rpcz_store.cc:276] 0709 13:06:23.985026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.986952 (+  1926us) service_pool.cc:224] Handling call
0709 13:06:23.987376 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:25.018234 (+1030858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:25.568566 (+550332us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400405454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:25.577710 (+  9144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2368898816}
I20260709 13:06:25.569525 12513 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:06:25.564605 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 104088us
I20260709 13:06:25.550537 20526 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:25.538089 20629 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 13:06:25.585639 13226 raft_consensus.cc:1240] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:25.590271 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:25.547201 20379 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:25.650440 13231 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 27. Current term is 28. Ops: []
I20260709 13:06:25.576797 20582 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:25.580600 20403 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:06:25.580703 19988 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:06:25.653447 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 148076us
I20260709 13:06:25.632740 20468 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.562342 20532 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.583055 20579 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:25.633491 20287 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:25.673696 20287 raft_consensus.cc:697] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 23 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:25.674127 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:25.674664 20287 consensus_queue.cc:237] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.675341 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:25.675944 12689 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:25.677711 20619 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:25.677836 20540 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:25.678375 20619 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:25.678571 20540 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.678767 20283 consensus_queue.cc:260] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.679903 20283 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:25.680608 20619 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:25.680737 20540 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:25.682209 20364 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:25.682569 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:25.683183 13231 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:25.683272 20579 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.684389 12662 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:25.684921 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:25.685214 20540 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:25.685730 20540 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:25.688336 20540 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:25.663646 20582 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.692482 20582 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:25.670645 20468 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:25.695123 20468 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:25.695834 13200 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:25.700274 20594 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:25.656796 20268 consensus_meta.cc:287] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.545s	user 0.011s	sys 0.000s
I20260709 13:06:25.632522 20525 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.651381 20585 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:25.667606 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 85841.2us
I20260709 13:06:25.705518 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:25.710633 12510 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:25.711618 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:25.712931 12510 leader_election.cc:400] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:06:25.577279 20596 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:25.562754 20426 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:25.662336 20609 log.cc:927] Time spent T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.442s	user 0.004s	sys 0.005s
I20260709 13:06:25.671142 20593 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:25.653692 20608 consensus_queue.cc:260] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.701658 20550 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:25.702561 12689 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 24.
I20260709 13:06:25.702688 20311 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:25.685465 20579 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:25.588047 20628 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:25.708526 20599 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:25.713269 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:25.668665 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:06:25.722038 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.753273 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:25.713343 12510 leader_election.cc:403] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:25.762203 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:25.773016 13231 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
I20260709 13:06:25.773190 13200 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:25.719098 20379 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:25.720710 20403 raft_consensus.cc:697] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 28 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:06:25.776767 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 108172us
I20260709 13:06:25.713971 20364 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:25.710098 20585 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.714401 20468 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:25.786936 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:25.751328 20635 consensus_queue.cc:1059] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.111s
I20260709 13:06:25.709483 20268 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:25.707221 20540 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.775092 20311 raft_consensus.cc:697] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:25.756716 20596 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.709771 20525 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:25.780215 20344 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:25.782680 20584 raft_consensus.cc:2804] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 13:06:25.834852 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 188269us
I20260709 13:06:25.771574 20631 consensus_queue.cc:1059] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 13:06:25.782166 20623 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18.
I20260709 13:06:25.848910 12690 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:25.774910 20593 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.809396 20637 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.840886 20344 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.805271 20496 consensus_queue.cc:1059] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.078s
W20260709 13:06:25.886835 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:25.889767 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 52706.1us
W20260709 13:06:25.891419 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 179049us
I20260709 13:06:25.894961 12587 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:25.905699 12510 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:25.878432 20621 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:25.836807 20468 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:25.893038 20539 consensus_meta.cc:287] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.001s
I20260709 13:06:25.886927 20344 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:25.916225 12690 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:25.921619 12510 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:25.922943 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:25.924151 20532 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:25.926397 20633 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:06:25.843760 20639 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 17, Time since last communication: 0.074s
I20260709 13:06:25.939170 13235 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 25.
I20260709 13:06:25.881047 20379 consensus_queue.cc:1059] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:06:25.947804 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:25.949878 12545 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:06:25.918845 20584 raft_consensus.cc:697] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:25.885264 20637 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.938741 20579 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:25.886669 20403 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 26.17, Last appended by leader: 17, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:25.939222 20623 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:25.986709 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:25.939466 20541 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:25.994108 20238 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:06:25.994619 20642 log.cc:927] Time spent T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:06:25.994810 20627 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:25.970283 20357 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:06:25.999435 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 76601.4us
I20260709 13:06:25.962061 20311 consensus_queue.cc:237] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.004498 12510 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:26.005029 12695 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:26.006459 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:25.939601 20539 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.050063 12689 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 26: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:26.008785 20625 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
I20260709 13:06:26.051059 20344 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:26.052898 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.053884 20525 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:26.055198 20646 log.cc:927] Time spent T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:06:25.996053 20579 raft_consensus.cc:697] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 24 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:26.057051 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:26.017799 20585 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:26.021286 20540 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:26.022118 20468 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:26.022631 12510 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:26.058632 20268 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:26.058951 12694 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:06:26.059165 12510 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:26.059607 20623 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:26.060459 20623 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:26.060518 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:26.061647 20624 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:26.062067 20624 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:26.065079 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.065424 12547 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:26.065788 12542 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21.
I20260709 13:06:26.066200 12540 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:06:26.066437 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.066656 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:26.067142 12542 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:26.067217 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.068420 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.052754 20584 consensus_queue.cc:237] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.062429 20624 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:26.026398 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:26.027433 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:26.030071 20364 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:26.074746 12691 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21.
I20260709 13:06:26.078161 20539 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:26.034936 20283 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:26.039345 19988 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:26.079090 20283 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.080477 19988 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:26.042593 20596 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:26.081125 20283 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:26.045849 20357 raft_consensus.cc:697] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:26.053273 20344 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:26.024756 20608 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:26.069406 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.087584 12540 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 25.
I20260709 13:06:25.997622 20541 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:26.074707 12696 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21.
I20260709 13:06:26.078342 12538 raft_consensus.cc:1240] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:26.077979 12542 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:06:26.033963 20287 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.045137 20637 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:26.097551 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.098227 12542 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:06:26.100983 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.102885 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:26.104277 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.104882 12542 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 24.
I20260709 13:06:26.105055 12540 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:06:26.106535 13232 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:06:26.107506 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.108718 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.102427 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:26.099238 20645 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.105778 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.095338 20541 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:26.112711 12542 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 22: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:26.088955 20651 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:26.116885 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.127381 12542 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 25.
I20260709 13:06:26.127121 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.137388 12542 raft_consensus.cc:1240] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 17 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 13:06:26.142071 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:26.082711 20357 consensus_queue.cc:237] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.162889 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:26.163830 12542 raft_consensus.cc:2376] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24. Re-sending same reply.
I20260709 13:06:26.099396 20526 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:26.103785 20287 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:26.057400 20579 consensus_queue.cc:237] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.207873 20556 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:26.205446 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.214222 12542 raft_consensus.cc:2393] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 24: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:06:26.216526 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.218279 12544 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:26.127214 20651 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.121831 20645 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.223513 20629 raft_consensus.cc:3055] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:06:26.231106 20283 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.242496 13226 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:26.219208 20556 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.245126 12542 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:26.238138 20629 raft_consensus.cc:740] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:26.260401 12546 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:26.263528 20651 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:26.247016 20283 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.272971 20526 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:26.280229 20453 raft_consensus.cc:3055] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:26.289819 12542 raft_consensus.cc:1275] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 13:06:26.291635 20649 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 13:06:26.294684 12510 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:26.295061 12544 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:06:26.295477 20366 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:26.295077 20541 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.297124 12544 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:06:26.298076 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 2635) took 1836 ms. Trace:
I20260709 13:06:26.298436 12688 rpcz_store.cc:276] 0709 13:06:24.462245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.483005 (+ 20760us) service_pool.cc:224] Handling call
0709 13:06:24.504012 (+ 21007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:25.182207 (+678195us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:26.297875 (+1115668us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b54004349d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:26.298021 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1552664320}
I20260709 13:06:26.300379 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:26.300455 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:26.301937 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:26.303032 13229 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:26.301527 12510 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:26.304334 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:26.304481 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:26.304765 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:26.305541 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:26.305891 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:26.306048 13234 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:06:26.306515 12617 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:06:26.307204 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:26.307574 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:26.308261 12614 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 26: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:26.309280 12616 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:06:26.285367 20453 raft_consensus.cc:740] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:26.309831 12620 raft_consensus.cc:1275] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 13:06:26.310339 12544 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:06:26.313619 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:26.313912 12621 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:06:26.309186 20366 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:26.314982 20526 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.315747 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:26.316339 12621 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:26.316592 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:26.317070 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:26.317682 12622 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:26.315541 20526 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.323042 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:26.323324 20526 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:26.323725 12619 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:06:26.324733 20541 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:26.325673 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1850) took 1790 ms. Trace:
I20260709 13:06:26.326172 12621 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 23.
I20260709 13:06:26.330504 13229 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 26.
I20260709 13:06:26.327732 12539 rpcz_store.cc:276] 0709 13:06:24.535446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.535699 (+   253us) service_pool.cc:224] Handling call
0709 13:06:24.988329 (+452630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:24.988528 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:06:24.988803 (+   275us) log.cc:844] Serialized 14 byte log entry
0709 13:06:26.324248 (+1335445us) spinlock_profiling.cc:243] Waited 1.7 ms on lock 0x7b18004303c0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a91214bc 00007fc3a646f48b 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a6489455 00007fc3a9571060 00007fc3a9583716 00007fc3a9594287
0709 13:06:26.324334 (+    86us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:26.324373 (+    39us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:06:26.324419 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:26.324496 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:26.325510 (+  1014us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b54000a64d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:26.325625 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7346,"prepare.queue_time_us":580,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":137950,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":1705,"spinlock_wait_cycles":973030016,"thread_start_us":368504,"threads_started":2,"wal-append.queue_time_us":332189}
I20260709 13:06:26.340550 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:26.342247 13229 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 23.
I20260709 13:06:26.342406 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:26.315217 20588 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:26.345403 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:06:26.330060 12588 connection.cc:256] RPC call timeout handler was delayed by -1.1415335609999602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
I20260709 13:06:26.346740 12540 raft_consensus.cc:2393] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 19: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:06:26.346907 12588 connection.cc:256] RPC call timeout handler was delayed by -1.1217335610000418s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
I20260709 13:06:26.347199 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:26.347457 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.344403 12659 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:26.350355 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.331985 20626 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:26.352284 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:26.356004 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.356142 12540 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:06:26.355157 12659 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:26.357272 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:26.360244 20556 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:26.341660 20637 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:06:26.311131 20629 consensus_queue.cc:260] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 27.18, Last appended by leader: 18, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.365957 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.366979 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.370913 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.371865 12588 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:26.372020 12545 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
I20260709 13:06:26.368621 12540 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:06:26.376108 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.369277 12659 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:26.366410 20630 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:26.351158 20539 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:26.384825 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.347726 20526 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:06:26.391335 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.392263 12539 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 23.
I20260709 13:06:26.406586 20624 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:26.374006 20453 consensus_queue.cc:260] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.369800 20599 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:26.413545 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.367120 20579 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.385830 20549 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:26.415856 12621 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:26.415839 12659 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:26.386921 20550 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.409992 20283 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:26.416599 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.390105 20379 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:06:26.421541 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.423095 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:26.424634 20238 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:26.424823 20596 consensus_queue.cc:1059] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:26.386714 20588 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.033s
I20260709 13:06:26.423609 12693 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:06:26.424770 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:26.426546 12545 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:26.434674 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:26.434845 12619 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:06:26.431540 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:26.429049 12542 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:26.430086 12540 raft_consensus.cc:2410] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 22 because replica has last-logged OpId of term: 20 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:06:26.425053 20636 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:26.411538 20539 raft_consensus.cc:697] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 20 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:26.435380 12613 raft_consensus.cc:1240] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:26.436602 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:26.439486 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:26.388485 20651 consensus_queue.cc:1059] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 23.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.034s
I20260709 13:06:26.456740 12621 raft_consensus.cc:2410] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 24 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:06:26.417912 20549 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:26.425755 20211 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 13:06:26.446398 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:26.470957 12616 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 17.
I20260709 13:06:26.426066 20599 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.423812 12539 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:06:26.426543 20550 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.477090 12540 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 23 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:26.478214 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:26.430219 20453 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:26.477394 12688 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:26.451357 20636 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.470999 20549 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:26.485579 12539 raft_consensus.cc:1240] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 28 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 27. Current term is 28. Ops: []
W20260709 13:06:26.489843 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 80149.7us
I20260709 13:06:26.490628 12588 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:26.495843 12545 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 26.
I20260709 13:06:26.496450 12512 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:26.497727 20366 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:06:26.498535 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:26.499161 12622 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
I20260709 13:06:26.499773 20366 consensus_queue.cc:1059] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:26.500789 20623 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:06:26.505517 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:26.421206 20579 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.485119 20636 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:26.532375 12614 raft_consensus.cc:3055] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:26.532903 12614 raft_consensus.cc:740] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:26.535130 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:26.511767 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.515677 20624 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:26.515780 20426 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:26.516721 20468 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:26.522243 20541 consensus_queue.cc:1059] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:26.522918 20623 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:26.564005 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:26.566525 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:26.568459 12694 raft_consensus.cc:3055] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:26.568980 12694 raft_consensus.cc:740] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:06:26.540520 20666 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:06:26.574710 12687 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:26.573223 12694 consensus_queue.cc:260] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.584643 12694 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:26.565157 20379 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:26.563036 20468 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:26.557869 20669 consensus_queue.cc:1059] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:06:26.537662 20539 consensus_queue.cc:237] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:26.602968 20677 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:06:26.603178 20668 log.cc:927] Time spent T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:06:26.605377 12588 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:26.588871 20468 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:26.571416 20623 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.611925 12588 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:26.589334 20541 consensus_queue.cc:1059] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 10, Time since last communication: 0.018s
W20260709 13:06:26.627975 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:26.628553 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.629318 12694 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:06:26.635556 12659 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:26.639662 20211 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:26.639828 20541 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:26.640170 20593 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:26.640590 20541 consensus_queue.cc:1243] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:06:26.653944 20211 raft_consensus.cc:2804] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:26.654320 12659 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:26.654628 20617 raft_consensus.cc:3055] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:26.655150 20617 raft_consensus.cc:740] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:26.655246 20450 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:26.655719 20450 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.656050 20617 consensus_queue.cc:260] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:26.658131 20283 raft_consensus.cc:3055] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:26.658520 20283 raft_consensus.cc:740] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:26.656075 20450 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:26.657311 20617 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:26.667418 12694 raft_consensus.cc:1217] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Deduplicated request from leader. Original: 17.13->[20.14-23.16]   Dedup: 20.14->[21.15-23.16]
I20260709 13:06:26.668246 12694 pending_rounds.cc:85] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 14
I20260709 13:06:26.668617 12694 pending_rounds.cc:107] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 13:06:26.668982 12694 raft_consensus.cc:2889] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:26.620383 20599 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:26.685891 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 2762) took 1008 ms. Trace:
I20260709 13:06:26.686476 12689 rpcz_store.cc:276] 0709 13:06:25.675250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.761944 (+ 86694us) service_pool.cc:224] Handling call
0709 13:06:26.682980 (+921036us) spinlock_profiling.cc:243] Waited 276 ms on lock 0x7b54001a0c54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:26.683191 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":635916032}
I20260709 13:06:26.654553 20211 raft_consensus.cc:697] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 23 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:26.679744 20550 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:26.699136 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.702911 20680 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:26.659406 20283 consensus_queue.cc:260] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:26.706692 20579 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:26.718587 20450 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.726805 20450 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:26.728098 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:26.728741 12621 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:26.721722 20126 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.735857 20623 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:26.739598 12621 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:06:26.733067 20126 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.743183 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 1782) took 1285 ms. Trace:
I20260709 13:06:26.743806 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:26.744467 12689 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:26.744225 13235 rpcz_store.cc:276] 0709 13:06:25.458142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.458269 (+   127us) service_pool.cc:224] Handling call
0709 13:06:26.743007 (+1284738us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b54005965d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:26.743107 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1048185088}
I20260709 13:06:26.747833 20126 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:26.751314 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:26.751597 20451 raft_consensus.cc:3055] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:26.753222 20581 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.755198 20581 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:26.756789 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.754776 20451 raft_consensus.cc:740] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:26.759168 13235 raft_consensus.cc:1240] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 22. Current term is 23. Ops: [22.15-22.15]
W20260709 13:06:26.760324 20671 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:06:26.761591 20581 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:26.754316 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:26.763278 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.763345 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:26.764513 20406 raft_consensus.cc:3055] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:26.764691 13229 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:06:26.764945 20406 raft_consensus.cc:740] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:26.765007 13200 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:26.765956 20406 consensus_queue.cc:260] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:26.767156 20406 raft_consensus.cc:3060] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:26.767411 20293 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.767925 20293 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.768597 20451 consensus_queue.cc:260] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.769889 20451 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:26.776240 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:26.754107 13230 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 28 index: 18. (index mismatch)
I20260709 13:06:26.753479 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:26.770373 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.777818 12542 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:26.778792 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:26.772791 12659 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:26.786289 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:26.786631 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:26.787001 12687 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 21.
I20260709 13:06:26.787163 13229 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 22.
I20260709 13:06:26.787570 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:26.787838 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:26.788575 13228 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:26.790704 13232 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 26: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:26.790581 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:26.791204 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.791850 12538 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
I20260709 13:06:26.791977 12543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1864) took 1060 ms. Trace:
I20260709 13:06:26.794216 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:26.794983 13230 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 17.
W20260709 13:06:26.776971 20673 log.cc:927] Time spent T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:06:26.797591 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:26.798585 12542 raft_consensus.cc:2393] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 26: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:26.800611 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:26.805680 12513 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:26.779583 20612 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:26.807399 12541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1849) took 2289 ms. Trace:
I20260709 13:06:26.807826 12541 rpcz_store.cc:276] 0709 13:06:24.518106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.518224 (+   118us) service_pool.cc:224] Handling call
0709 13:06:24.535466 (+ 17242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:25.317687 (+782221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:26.807154 (+1489467us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b5400228154. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:26.807337 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1764013952}
I20260709 13:06:26.812286 20293 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:26.822301 20287 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:26.824996 20612 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.906018 20612 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:26.860077 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:26.910629 20581 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:26.911091 20581 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:26.911590 20581 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:06:26.912838 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 301320us
I20260709 13:06:26.913594 12588 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:26.917476 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:26.884981 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.786156 20626 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 13:06:26.730659 20450 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:26.803544 13197 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:26.887094 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:26.789276 20238 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:26.892868 20283 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:06:26.893800 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.895017 12692 raft_consensus.cc:1240] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 25. Current term is 26. Ops: []
W20260709 13:06:26.901669 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.901813 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1741) took 1374 ms. Trace:
I20260709 13:06:26.955389 13227 rpcz_store.cc:276] 0709 13:06:25.527339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.527511 (+   172us) service_pool.cc:224] Handling call
0709 13:06:25.527843 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:25.554476 (+ 26633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:26.817981 (+1263505us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b5400570dd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:26.901753 (+ 83772us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40309504}
I20260709 13:06:26.794529 20628 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.024s
I20260709 13:06:26.904215 20645 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:26.732493 20211 consensus_queue.cc:237] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:26.790491 20623 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:26.974462 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:26.981076 13229 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:26.925752 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.792490 12543 rpcz_store.cc:276] 0709 13:06:25.731257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.731418 (+   161us) service_pool.cc:224] Handling call
0709 13:06:25.731798 (+   380us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:25.758980 (+ 27182us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:06:25.780568 (+ 21588us) log.cc:844] Serialized 14 byte log entry
0709 13:06:26.638140 (+857572us) spinlock_profiling.cc:243] Waited 5.74 ms on lock 0x7b18004b9700. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a911923a 00007fc3a9583a2a
0709 13:06:26.688823 (+ 50683us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:26.702801 (+ 13978us) log.cc:844] Serialized 26 byte log entry
0709 13:06:26.702960 (+   159us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:06:26.702990 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:26.703052 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:26.780842 (+ 77790us) raft_consensus.cc:1685] finished
0709 13:06:26.791713 (+ 10871us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:26.791895 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1633,"prepare.queue_time_us":11093,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":5046,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":19088,"spinlock_wait_cycles":13202816,"thread_start_us":50327,"threads_started":1,"wal-append.queue_time_us":904039}
W20260709 13:06:26.951479 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 148010us
W20260709 13:06:26.961266 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 47008us
I20260709 13:06:26.988194 12587 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:26.965492 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:26.992746 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:26.993518 12618 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:06:26.994668 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:26.995615 12615 raft_consensus.cc:2393] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 18: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:26.997856 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:26.998585 12690 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:27.013478 12693 raft_consensus.cc:1240] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 23. Current term is 24. Ops: []
W20260709 13:06:27.015058 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 232246us
I20260709 13:06:27.020398 13229 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
W20260709 13:06:27.021070 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.018373 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:27.026763 13228 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
I20260709 13:06:27.026767 12622 raft_consensus.cc:3060] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:26.964324 20470 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:27.028740 12662 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:26.964942 20550 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:27.032449 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:26.973925 20126 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:27.033003 12662 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:27.030398 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:27.047376 12662 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:27.016549 13197 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:27.034009 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 45918.7us
I20260709 13:06:26.970850 20238 raft_consensus.cc:697] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:27.057509 12587 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:26.915325 20549 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:26.966729 20450 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:27.318090 20690 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:06:27.319450 20450 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:26.971472 20588 consensus_queue.cc:1059] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
W20260709 13:06:27.207788 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 186992us
I20260709 13:06:27.019930 20627 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:27.320670 20588 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:27.320514 20627 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:27.321117 20588 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.321507 20588 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:27.322609 20627 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:27.322743 20678 raft_consensus.cc:3055] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:27.032905 20593 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:27.323202 20678 raft_consensus.cc:740] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:27.323400 20593 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:27.324054 20678 consensus_queue.cc:260] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:27.332158 20680 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:27.332777 20680 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:27.035331 20550 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:27.338166 20550 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:27.025091 20293 consensus_queue.cc:1059] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 24.19, Next index: 20, Last known committed idx: 17, Time since last communication: 0.181s
I20260709 13:06:27.045821 20556 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:27.341946 20556 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.342583 20556 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:27.325460 20593 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:27.017896 20623 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:27.347610 20623 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:27.029299 20379 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.197s
I20260709 13:06:27.027081 20468 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:27.250174 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 202843us
I20260709 13:06:27.204442 20584 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:27.349900 20584 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:27.350041 12621 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:27.350356 20584 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:27.062124 20539 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:27.350526 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:27.351052 20539 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:27.351470 20539 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:27.352142 12662 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:27.353266 12662 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:27.050915 20126 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:27.284219 20451 consensus_meta.cc:287] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.001s
W20260709 13:06:27.354805 20687 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:06:27.355243 20635 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:27.355696 20635 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:27.011737 20287 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:27.310755 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 253323us
I20260709 13:06:27.357017 20528 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:27.311513 20679 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:27.357793 20679 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:27.358201 20679 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:27.220881 20527 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:06:27.359702 20527 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:06:27.314244 20685 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:06:27.301735 20636 consensus_meta.cc:287] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.772s	user 0.011s	sys 0.000s
I20260709 13:06:27.364406 20636 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:27.366920 20636 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:27.368533 20126 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:27.369129 20629 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:27.375335 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:27.379350 20700 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:27.380044 20700 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:27.381834 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:27.382253 20593 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:27.383554 13199 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:27.385444 20556 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:27.387566 20556 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:27.031994 20470 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:27.342057 20293 raft_consensus.cc:3055] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:06:27.355468 20238 consensus_queue.cc:237] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:27.356096 20635 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:27.388167 20700 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:27.388532 12541 raft_consensus.cc:1240] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:06:27.389734 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:27.382733 20593 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:27.392571 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:27.021092 20677 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:27.394687 12690 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:06:27.436995 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:27.396931 12540 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 13:06:27.400028 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 46839us
I20260709 13:06:27.439278 12662 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:27.439327 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:27.312536 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.426003 20470 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:27.450079 12662 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:27.429318 12694 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.000s	sys 0.019s
W20260709 13:06:27.451640 12694 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.000s	sys 0.020s
I20260709 13:06:27.491086 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:27.493978 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.496145 12687 raft_consensus.cc:1240] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:27.396477 20678 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:27.377079 20679 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:27.504758 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:27.401820 20403 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:27.515053 12538 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:27.434618 20579 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:27.426254 20293 raft_consensus.cc:740] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:06:27.505046 20406 consensus_meta.cc:287] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.737s	user 0.011s	sys 0.000s
I20260709 13:06:27.389446 20612 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:27.497871 20450 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:06:27.529083 12547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 2424) took 1463 ms (client timeout 1532 ms). Trace:
I20260709 13:06:27.529218 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:27.495535 20126 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:27.506217 20494 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:27.501271 20556 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:27.504839 20426 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:27.536682 12547 rpcz_store.cc:269] 0709 13:06:26.066034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.066216 (+   182us) service_pool.cc:224] Handling call
0709 13:06:27.528895 (+1462679us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002b9b54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:27.529024 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2676764032}
W20260709 13:06:27.573432 12588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.009s	sys 0.006s
W20260709 13:06:27.574057 12588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.010s	sys 0.006s
I20260709 13:06:27.572057 12614 consensus_queue.cc:260] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:27.575824 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:27.522992 20453 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:27.569722 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:27.569335 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 364131us
I20260709 13:06:27.561841 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:27.568994 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.500612 20366 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.067s
I20260709 13:06:27.575896 20526 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
W20260709 13:06:27.595677 12691 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.064s	sys 0.149s
I20260709 13:06:27.596124 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:27.592511 12510 leader_election.cc:336] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.514s (SENT)
I20260709 13:06:27.511587 20287 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:27.587318 20617 consensus_meta.cc:287] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.912s	user 0.010s	sys 0.000s
W20260709 13:06:27.602658 12691 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.064s	sys 0.152s
W20260709 13:06:27.574802 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 661249us
I20260709 13:06:27.573122 20556 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:27.605715 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:27.607034 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:06:27.615211 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.613868 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:27.526065 20403 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:27.620651 20403 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:27.622738 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:27.612953 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 226766us
I20260709 13:06:27.591337 20550 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:27.587000 20494 raft_consensus.cc:697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:27.627331 12618 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 25: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:27.629793 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:27.574260 20126 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:27.567911 20579 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:27.586086 20426 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:27.623988 20556 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:06:27.644552 13226 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.002s	sys 0.018s
I20260709 13:06:27.590488 20453 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:27.574747 20539 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:27.649303 12544 raft_consensus.cc:2468] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 23.
I20260709 13:06:27.628592 20669 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:06:27.656409 13226 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.002s	sys 0.018s
I20260709 13:06:27.662546 20679 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:27.665750 20426 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:27.673161 20549 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:27.685693 12620 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.010s	sys 0.011s
W20260709 13:06:27.686215 12620 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.010s	sys 0.011s
W20260709 13:06:27.686930 12586 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.013s	sys 0.008s
I20260709 13:06:27.687728 12688 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 25.
W20260709 13:06:27.690636 12586 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.013s	sys 0.008s
W20260709 13:06:27.698742 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.700875 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:27.615113 20293 consensus_queue.cc:260] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:27.689121 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 44982us
I20260709 13:06:27.704034 12540 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
I20260709 13:06:27.707762 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:27.645876 20379 consensus_queue.cc:1059] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 13:06:27.680981 20451 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:27.645695 20585 consensus_queue.cc:1059] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 13:06:27.764880 12512 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:06:27.766706 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 53269.3us
W20260709 13:06:27.768489 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:27.723239 20581 consensus_meta.cc:287] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.811s	user 0.006s	sys 0.006s
I20260709 13:06:27.777622 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:06:27.778653 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 49006.5us
I20260709 13:06:27.781737 12588 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:06:27.783052 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 84497.7us
W20260709 13:06:27.786775 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 291082us
W20260709 13:06:27.826371 12586 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:27.826565 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 44933.1us
I20260709 13:06:27.827427 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:27.725893 20593 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:27.689638 20549 consensus_queue.cc:1059] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.082s
I20260709 13:06:27.766964 20617 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:27.840440 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:27.845448 12588 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:27.837582 12618 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:27.702509 20679 consensus_queue.cc:1048] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.087s
I20260709 13:06:27.785802 20585 consensus_queue.cc:1243] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer a70479a3b4114f3581095e9890f5d653 log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:06:27.784320 20403 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:06:27.858768 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 94120.4us
I20260709 13:06:27.718856 20584 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:27.852007 20677 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:27.786970 20211 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:27.860163 12619 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 14.
I20260709 13:06:27.888839 12588 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:27.866478 20612 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:27.789554 20588 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:27.854713 20599 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:06:27.878566 20680 consensus_meta.cc:287] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.003s
I20260709 13:06:27.852202 20702 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:27.925868 12588 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:27.919524 13228 raft_consensus.cc:1240] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:27.763947 20494 consensus_queue.cc:237] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:27.831172 20581 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:27.935746 12621 raft_consensus.cc:2393] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 22: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:27.912191 20379 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:27.938982 12588 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:27.940634 12588 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:27.867664 20617 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:27.883803 20593 consensus_queue.cc:1048] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.045s
W20260709 13:06:27.920409 20629 consensus_meta.cc:287] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.001s
W20260709 13:06:27.945900 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:27.918412 20549 raft_consensus.cc:3055] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:27.921808 20599 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:28.013787 12692 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 28 index: 18. (term mismatch)
I20260709 13:06:27.946126 20550 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:28.018050 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:28.018841 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:28.019143 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:27.970534 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:27.936980 20287 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:27.938118 20677 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:28.014302 12692 pending_rounds.cc:85] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 17
I20260709 13:06:28.028362 12692 pending_rounds.cc:107] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 27.18
I20260709 13:06:28.028672 12692 raft_consensus.cc:2889] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:27.928387 20680 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:27.885839 20528 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 13:06:27.970808 20585 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:27.924964 20211 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:28.016412 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 47682.6us
I20260709 13:06:28.024494 12617 raft_consensus.cc:2410] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:06:28.026129 12615 raft_consensus.cc:2393] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 22: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:28.027209 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:27.947674 20710 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:27.986626 20593 consensus_queue.cc:1243] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer a70479a3b4114f3581095e9890f5d653 log is divergent from this leader: its last log entry 20.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:06:27.950788 20720 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:28.038278 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:28.013870 20549 raft_consensus.cc:740] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:28.039883 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:28.017690 20599 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:28.075738 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:27.944396 20702 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:28.072971 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:28.071647 12618 raft_consensus.cc:1275] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:06:28.192924 12618 pending_rounds.cc:85] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 10
I20260709 13:06:28.193313 12618 pending_rounds.cc:107] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 13:06:28.193666 12618 raft_consensus.cc:2889] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:28.082751 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:28.099018 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 214124us
W20260709 13:06:28.099618 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.034956 20677 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:28.027384 20126 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:28.023921 20539 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:28.039472 20585 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:06:28.123268 20721 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 13:06:28.123842 20712 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
I20260709 13:06:28.123979 20211 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:28.124336 20699 log.cc:927] Time spent T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
W20260709 13:06:28.129143 20715 log.cc:927] Time spent T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:06:28.232393 20706 consensus_queue.cc:1059] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
W20260709 13:06:28.130050 20716 log.cc:927] Time spent T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:06:28.232393 20585 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:28.251222 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1986) took 1332 ms. Trace:
W20260709 13:06:28.132890 12544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42458 (request call id 3929) took 1342 ms (client timeout 1714 ms). Trace:
I20260709 13:06:28.253664 20581 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:28.253750 12544 rpcz_store.cc:269] 0709 13:06:26.790200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.790329 (+   129us) service_pool.cc:224] Handling call
0709 13:06:28.132662 (+1342333us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b54003aaa54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:28.132787 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1716162432}
I20260709 13:06:28.134702 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:28.255761 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:28.256138 20468 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:28.256731 20468 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:28.256963 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:28.046543 20710 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:06:28.257133 20678 consensus_meta.cc:287] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.753s	user 0.006s	sys 0.003s
I20260709 13:06:28.218991 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:28.222796 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 383011us
I20260709 13:06:28.157799 20711 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.225399 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:28.223116 13197 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:28.226190 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 396041us
I20260709 13:06:28.238427 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:28.196182 20697 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.234324 20720 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.249491 20706 raft_consensus.cc:3055] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:28.218151 20579 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:28.257637 20710 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:28.257215 20468 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:28.251778 12689 rpcz_store.cc:276] 0709 13:06:26.918420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.918566 (+   146us) service_pool.cc:224] Handling call
0709 13:06:26.919041 (+   475us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:26.919538 (+   497us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 13:06:27.011489 (+ 91951us) log.cc:844] Serialized 14 byte log entry
0709 13:06:27.708998 (+697509us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:27.709476 (+   478us) log.cc:844] Serialized 52 byte log entry
0709 13:06:27.709663 (+   187us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:06:27.709714 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:27.709810 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:28.250881 (+541071us) raft_consensus.cc:1685] finished
0709 13:06:28.250911 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:28.251146 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47935,"prepare.queue_time_us":121969,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":148382,"raft.queue_time_us":136548,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":19826,"thread_start_us":485887,"threads_started":1,"wal-append.queue_time_us":875629}
W20260709 13:06:28.258276 20714 log.cc:927] Time spent T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 13:06:28.258510 12688 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 21.
I20260709 13:06:28.076503 12622 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 24. Current term is 25. Ops: []
W20260709 13:06:28.259135 20719 log.cc:927] Time spent T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:06:28.218770 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:28.222352 20677 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:28.243933 20584 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:28.280525 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 57477.8us
I20260709 13:06:28.328665 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:28.311394 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:28.275897 12588 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:28.314093 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1977) took 1424 ms. Trace:
W20260709 13:06:28.307672 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 428373us
I20260709 13:06:28.266503 20539 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:28.267258 20588 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:28.327262 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:28.316593 20527 consensus_meta.cc:287] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.956s	user 0.007s	sys 0.007s
I20260709 13:06:28.310674 20706 raft_consensus.cc:740] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:28.277287 20678 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:28.370793 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:28.372635 12587 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:28.359231 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:06:28.319926 20721 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:06:28.377931 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:28.359918 12689 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:06:28.330613 12687 rpcz_store.cc:276] 0709 13:06:26.889937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.890214 (+   277us) service_pool.cc:224] Handling call
0709 13:06:26.890518 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:27.496536 (+606018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.313737 (+817201us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b54001b5b54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:28.314032 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1392432384}
I20260709 13:06:28.362982 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:28.364132 12662 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:28.319345 20737 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:28.382515 20737 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.382947 20737 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:28.380555 20729 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:06:28.383416 20706 consensus_queue.cc:260] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:28.387689 12687 raft_consensus.cc:1240] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 24. Current term is 25. Ops: [24.19-24.19]
I20260709 13:06:28.388433 20740 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.389114 12687 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:28.390780 20612 consensus_queue.cc:1059] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:28.376513 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:28.378062 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:06:28.360764 12510 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.315830 20697 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:28.381623 20702 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:28.380548 20556 consensus_meta.cc:287] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.699s	user 0.012s	sys 0.000s
I20260709 13:06:28.424153 20556 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:28.427176 20556 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:28.380945 20678 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:28.427264 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 2667) took 1768 ms. Trace:
I20260709 13:06:28.428193 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:28.428718 12689 raft_consensus.cc:1240] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 25. Current term is 26. Ops: []
W20260709 13:06:28.428974 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 56440.3us
I20260709 13:06:28.429944 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:28.430493 12540 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:28.429016 12547 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 23: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:28.370215 20527 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:06:28.373291 20283 consensus_meta.cc:287] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 1.414s	user 0.005s	sys 0.009s
W20260709 13:06:28.370555 20686 log.cc:927] Time spent T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 1.011s	user 0.003s	sys 0.007s
I20260709 13:06:28.434078 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:28.434279 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:28.428470 12694 rpcz_store.cc:276] 0709 13:06:26.658910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.661153 (+  2243us) service_pool.cc:224] Handling call
0709 13:06:26.667175 (+  6022us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:06:26.678317 (+ 11142us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:06:27.452188 (+773871us) log.cc:844] Serialized 14 byte log entry
0709 13:06:27.706292 (+254104us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:27.712381 (+  6089us) log.cc:844] Serialized 52 byte log entry
0709 13:06:27.712544 (+   163us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:06:27.712580 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:27.712648 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:28.427050 (+714402us) raft_consensus.cc:1685] finished
0709 13:06:28.427072 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:28.427203 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43305,"prepare.queue_time_us":11263,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":2283,"raft.queue_time_us":83321,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":24227,"thread_start_us":999752,"threads_started":2,"wal-append.queue_time_us":484224}
I20260709 13:06:28.434649 12538 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:28.287078 20711 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:28.436019 12615 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:28.437268 20711 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:28.437985 20711 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:28.438161 12690 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22.
I20260709 13:06:28.438372 20711 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.389046 20740 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:28.440683 20740 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:28.392573 20470 consensus_meta.cc:287] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.872s	user 0.010s	sys 0.002s
I20260709 13:06:28.441645 12694 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 24 index: 20. (index mismatch)
I20260709 13:06:28.441921 20470 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:28.443806 20702 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:28.444420 20470 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:28.444382 20702 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:28.359534 20680 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:28.390515 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:28.446271 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:28.447050 12613 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:28.448521 20702 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:28.389312 20585 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:28.450011 20680 consensus_queue.cc:1059] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 23.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:06:28.450913 20680 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 21.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:06:28.451251 20740 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 13:06:28.451920 13231 raft_consensus.cc:1240] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:28.452075 20680 raft_consensus.cc:3055] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:06:28.452554 20680 raft_consensus.cc:740] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:28.452358 20599 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:28.452822 20740 raft_consensus.cc:3055] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:06:28.381371 20735 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:06:28.453785 20711 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:28.404523 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:28.455139 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 50709us
W20260709 13:06:28.405202 20450 consensus_meta.cc:287] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.834s	user 0.006s	sys 0.002s
I20260709 13:06:28.456442 12662 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:28.456885 20450 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:28.457604 20450 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:28.406780 20468 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:28.408146 20737 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:28.458601 12688 raft_consensus.cc:1240] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:28.458091 20527 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:28.459213 20527 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:28.459627 20527 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:28.459797 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2776) took 1063 ms. Trace:
I20260709 13:06:28.316394 20720 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:28.376770 20588 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:28.415912 12620 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4349) took 1757 ms. Trace:
I20260709 13:06:28.461189 12620 rpcz_store.cc:276] 0709 13:06:26.658217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.662345 (+  4128us) service_pool.cc:224] Handling call
0709 13:06:26.665919 (+  3574us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:27.011982 (+346063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:27.012029 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:27.020482 (+  8453us) log.cc:844] Serialized 52 byte log entry
0709 13:06:27.686654 (+666172us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:27.686721 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:27.686822 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:28.415659 (+728837us) raft_consensus.cc:1685] finished
0709 13:06:28.415682 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:28.415847 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":345581,"raft.queue_time_us":640296,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":643313,"threads_started":1,"wal-append.queue_time_us":985020}
I20260709 13:06:28.462422 20720 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:28.451190 20585 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:28.394264 20723 log.cc:927] Time spent T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:06:28.463689 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:28.465619 12688 rpcz_store.cc:276] 0709 13:06:27.395945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.327696 (+931751us) service_pool.cc:224] Handling call
0709 13:06:28.327978 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:28.458988 (+131010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.459570 (+   582us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b540009c754. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:28.459733 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":299746560}
I20260709 13:06:28.466517 12619 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 24.
I20260709 13:06:28.430073 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:28.469456 12541 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:06:28.432677 12692 raft_consensus.cc:2393] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 22: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:28.363588 20539 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:28.394057 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:28.437203 20678 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:28.453390 20680 consensus_queue.cc:260] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.19, Last appended by leader: 19, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:28.454218 12616 raft_consensus.cc:2368] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 22. Current term is 23.
W20260709 13:06:28.349396 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 74072us
I20260709 13:06:28.359254 20615 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:06:28.331961 20549 consensus_queue.cc:260] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:28.433544 20541 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:28.432204 12544 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:06:28.481966 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:28.467116 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:28.482942 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:28.459854 20737 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:28.468730 20635 consensus_meta.cc:287] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.979s	user 0.008s	sys 0.004s
I20260709 13:06:28.403328 20729 consensus_queue.cc:1059] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:28.470871 12613 raft_consensus.cc:2468] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 15.
W20260709 13:06:28.472741 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.458609 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:28.474885 12617 raft_consensus.cc:2393] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 18: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:06:28.487147 12510 leader_election.cc:336] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 2.096s (SENT)
I20260709 13:06:28.490666 12510 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:28.475432 12540 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:06:28.459800 12615 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:28.476887 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:28.479312 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:28.481370 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:28.494043 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:28.463399 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:28.494024 12619 raft_consensus.cc:2368] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 19. Current term is 20.
I20260709 13:06:28.498878 12619 raft_consensus.cc:1240] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 13:06:28.499001 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:28.499788 12692 raft_consensus.cc:2393] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 21: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:28.478307 12538 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22.
I20260709 13:06:28.453372 20740 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:28.474669 20550 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.458068 20677 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:28.502254 12618 raft_consensus.cc:2368] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 22. Current term is 23.
I20260709 13:06:28.502080 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:28.503114 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:28.503311 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 44758.4us
I20260709 13:06:28.501263 12619 raft_consensus.cc:1240] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:28.507787 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:28.509291 12588 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:28.512038 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:28.533977 13229 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22.
I20260709 13:06:28.535192 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:28.530735 12616 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 22.
I20260709 13:06:28.515234 13197 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:28.541519 12588 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:28.530735 13232 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 25.
I20260709 13:06:28.543260 12588 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:28.550724 13231 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:28.550911 13227 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 24 index: 20. (index mismatch)
I20260709 13:06:28.551964 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:28.552407 13230 raft_consensus.cc:1240] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:28.553422 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:28.539924 20556 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:28.540604 20588 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:28.557821 20588 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:28.560088 20588 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:28.565904 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:28.567406 20379 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:28.571132 20379 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:28.571342 20708 raft_consensus.cc:3055] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:28.571748 20708 raft_consensus.cc:740] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:28.568533 12542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1876) took 1179 ms. Trace:
I20260709 13:06:28.573832 12542 rpcz_store.cc:276] 0709 13:06:27.389383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.390237 (+   854us) service_pool.cc:224] Handling call
0709 13:06:27.390506 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:27.633506 (+243000us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:27.633552 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:27.633625 (+    73us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:06:27.633671 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.568292 (+934621us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b5400068bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:28.568349 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:28.568474 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":558351232}
W20260709 13:06:28.569417 12693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 1993) took 1545 ms (client timeout 1916 ms). Trace:
W20260709 13:06:28.575518 12693 rpcz_store.cc:269] 0709 13:06:27.024250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.032211 (+  7961us) service_pool.cc:224] Handling call
0709 13:06:28.569222 (+1537011us) spinlock_profiling.cc:243] Waited 976 ms on lock 0x7b54002c9054. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:28.569362 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2244500736}
I20260709 13:06:28.570586 12613 raft_consensus.cc:1240] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:06:28.487622 20680 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:28.501716 20678 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:28.583914 20740 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 21.19, Last appended by leader: 19, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:28.585263 20740 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:28.587309 20379 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:28.527218 20585 consensus_queue.cc:1059] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 13:06:28.592221 20379 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:28.595525 20677 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:28.596916 20746 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:06:28.597198 20379 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:28.598248 20596 raft_consensus.cc:3055] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:28.597810 20585 consensus_queue.cc:1243] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer 66750b8bbd4c4b3a9695951d0ede3372 log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 13:06:28.597940 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 54778.2us
I20260709 13:06:28.633128 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:28.598799 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 58130us
W20260709 13:06:28.612993 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.592623 20527 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:28.450815 20710 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:28.597671 20468 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:28.615253 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:06:28.617331 12585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.052s	sys 0.086s
I20260709 13:06:28.635157 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41084 (request call id 4359) took 1022 ms. Trace:
W20260709 13:06:28.635586 12585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.052s	sys 0.086s
I20260709 13:06:28.621207 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:28.598124 20549 raft_consensus.cc:3060] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:28.541054 20720 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:28.538503 20612 raft_consensus.cc:2804] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:28.500955 20635 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:28.643642 12662 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:28.488363 20541 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:28.599920 20599 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:28.618297 20746 raft_consensus.cc:697] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 26 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:28.609790 20702 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:06:28.671633 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 340061us
I20260709 13:06:28.635619 12621 rpcz_store.cc:276] 0709 13:06:27.606550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.606705 (+   155us) service_pool.cc:224] Handling call
0709 13:06:28.628914 (+1022209us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b54001ea5d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:28.629053 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":735494528}
W20260709 13:06:28.648795 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:28.650290 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 163180us
W20260709 13:06:28.676275 12510 leader_election.cc:336] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 2.150s (SENT)
I20260709 13:06:28.626739 20596 raft_consensus.cc:740] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:28.677541 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:28.630698 13233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1754) took 1125 ms. Trace:
I20260709 13:06:28.540144 20550 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:28.603367 20539 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:28.680331 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:28.683212 12695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1981) took 1792 ms. Trace:
I20260709 13:06:28.696581 12691 raft_consensus.cc:2393] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 26: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:28.628060 20379 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:28.678646 13233 rpcz_store.cc:276] 0709 13:06:27.505238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.505704 (+   466us) service_pool.cc:224] Handling call
0709 13:06:27.528607 (+ 22903us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:27.686346 (+157739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:27.686390 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:27.712897 (+ 26507us) log.cc:844] Serialized 52 byte log entry
0709 13:06:28.261668 (+548771us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:06:28.261708 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.622858 (+361150us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b54004d8354. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:28.622936 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:28.623017 (+    81us) raft_consensus.cc:1685] finished
0709 13:06:28.623037 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:28.630607 (+  7570us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41931,"raft.queue_time_us":766,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":17286,"spinlock_wait_cycles":361639296,"thread_start_us":405589,"threads_started":1,"wal-append.queue_time_us":470551}
I20260709 13:06:28.704718 20702 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.704728 20379 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:06:28.705411 12510 leader_election.cc:336] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 2.209s (SENT)
I20260709 13:06:28.705916 12510 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:28.706619 20596 consensus_queue.cc:260] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:28.709817 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:28.710487 12541 raft_consensus.cc:3060] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:28.710928 20612 raft_consensus.cc:697] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:28.711871 20612 consensus_queue.cc:237] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:28.714303 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:28.714936 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:28.717352 12622 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:28.719256 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:28.660897 20585 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:28.721213 12547 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 22: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
W20260709 13:06:28.724135 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 44331.4us
I20260709 13:06:28.725214 12588 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:28.677030 20450 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:28.670832 20636 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.727175 12541 raft_consensus.cc:2468] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
I20260709 13:06:28.725368 12547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:28.730867 20740 consensus_queue.cc:1059] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:28.731647 20710 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:28.731802 20740 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:28.732266 20710 raft_consensus.cc:3055] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:28.732641 20710 raft_consensus.cc:740] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:28.733654 20182 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.734462 20182 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:28.734925 20527 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:28.736518 20182 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:28.738005 12541 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:06:28.738170 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 63928.3us
I20260709 13:06:28.743443 12538 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:28.683661 12695 rpcz_store.cc:276] 0709 13:06:26.891125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.893635 (+  2510us) service_pool.cc:224] Handling call
0709 13:06:26.894059 (+   424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:27.317828 (+423769us) raft_consensus.cc:1534] Early marking committed up to index 19
0709 13:06:27.318106 (+   278us) log.cc:844] Serialized 14 byte log entry
0709 13:06:27.999571 (+681465us) log.cc:844] Serialized 14 byte log entry
0709 13:06:28.009974 (+ 10403us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:28.010053 (+    79us) raft_consensus.cc:1645] Marking committed up to 19
0709 13:06:28.010120 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.682991 (+672871us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54000c7bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:28.683038 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:28.683158 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28514,"prepare.queue_time_us":38791,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":2430,"raft.queue_time_us":87646,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":20552,"spinlock_wait_cycles":973957888,"thread_start_us":678582,"threads_started":2,"wal-append.queue_time_us":513783}
I20260709 13:06:28.739899 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:28.746284 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:28.701539 20581 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:28.750370 20635 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:28.751291 12541 pending_rounds.cc:85] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 10
I20260709 13:06:28.751672 12541 pending_rounds.cc:107] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 13:06:28.751917 12541 raft_consensus.cc:2889] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:28.749241 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:28.752347 20636 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:28.750396 20379 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:28.754441 20450 raft_consensus.cc:697] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:28.754953 20636 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:28.705338 20702 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:28.756176 20379 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:28.695775 20468 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.061s
I20260709 13:06:28.743795 20494 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:28.757328 20494 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:28.758000 20746 consensus_queue.cc:237] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 26, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:28.758782 20541 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:28.759382 20541 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:28.759727 13235 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:06:28.761140 20494 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:28.755755 20450 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 21.19, Last appended by leader: 19, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:28.764513 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:28.765331 13230 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
W20260709 13:06:28.765908 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.766534 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:28.767809 12539 raft_consensus.cc:1240] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:28.764585 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:28.769718 12662 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:28.770571 13200 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:28.771086 12662 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:28.772132 12540 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 11. (term mismatch)
I20260709 13:06:28.772487 12540 pending_rounds.cc:85] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 10
I20260709 13:06:28.772689 12540 pending_rounds.cc:107] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 13:06:28.772897 12540 raft_consensus.cc:2889] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:28.775434 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:28.776208 13234 raft_consensus.cc:2393] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 18: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:28.780831 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:28.783592 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:28.750120 20581 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:28.793469 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:28.787799 13230 raft_consensus.cc:2368] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16.
I20260709 13:06:28.789086 12662 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:28.794348 13233 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
I20260709 13:06:28.796443 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:28.797199 12539 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:28.793375 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:28.800554 12588 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:28.802517 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:28.823505 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:28.825862 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:28.827442 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:28.828141 12588 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:28.825932 20556 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 13:06:28.791684 20653 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:28.792584 20729 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:28.865758 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:28.787173 20468 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:28.828240 13233 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:28.784621 20593 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:06:28.835843 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:28.863745 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:28.794153 20636 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:28.769254 20639 consensus_queue.cc:1059] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.057s
I20260709 13:06:28.799925 20211 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:28.874223 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:28.874922 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:28.804704 20635 raft_consensus.cc:2804] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:28.877373 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:28.887176 12588 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:28.862457 20744 raft_consensus.cc:2804] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:28.900252 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:28.901473 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:28.903241 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:28.872553 20585 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:28.905540 12510 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:28.905795 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:28.907713 12622 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:28.909240 12588 leader_election.cc:400] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16.
I20260709 13:06:28.909745 12588 leader_election.cc:403] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:06:28.914004 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:28.914631 12618 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
I20260709 13:06:28.915426 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:28.828744 20379 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.070s
I20260709 13:06:28.918565 20738 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:28.919612 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:28.920683 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:28.921998 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:28.882443 20526 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:28.881042 20541 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:28.925459 12542 raft_consensus.cc:2393] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 18: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:28.879608 20702 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:28.932832 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:28.870965 20556 consensus_queue.cc:1059] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:06:28.913311 20468 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:28.942899 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:28.947481 12616 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:28.878612 20636 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:28.916720 20744 raft_consensus.cc:697] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 22 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:28.954596 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:28.925921 20526 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:28.925513 20585 raft_consensus.cc:697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:06:28.963706 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 62202.6us
I20260709 13:06:28.969187 12510 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:28.970295 13199 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.195:34641 timed out after 1.916s (SENT) [suppressed 15 similar messages]
I20260709 13:06:28.970804 12510 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:28.945536 20468 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:28.973016 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:28.977823 13234 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:28.946588 20702 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:28.981352 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 29 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:28.980458 12510 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:28.999404 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:28.968215 20526 raft_consensus.cc:3060] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:28.942412 20541 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:29.013980 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 43692.8us
W20260709 13:06:29.014853 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:28.982972 20468 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:29.025988 12622 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 23.
I20260709 13:06:29.036794 20758 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:29.037722 20758 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:29.042443 13232 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 25.
I20260709 13:06:29.041311 20702 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:29.049646 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:29.041955 20751 log.cc:927] Time spent T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.203s	user 0.002s	sys 0.000s
I20260709 13:06:29.061129 20759 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:29.061787 20759 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.073423 20584 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:29.074111 20584 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.076243 20584 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:29.026901 20757 consensus_queue.cc:1059] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 13:06:29.048202 20541 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:29.085685 20581 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:29.086087 20541 raft_consensus.cc:3055] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:29.086643 20541 raft_consensus.cc:740] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:29.087555 20541 consensus_queue.cc:260] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.088903 20541 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:29.046042 20744 consensus_queue.cc:237] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:29.096185 12539 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 26.
I20260709 13:06:29.109549 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:29.110195 12539 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:29.119333 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:29.122026 12542 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 15.
W20260709 13:06:29.125080 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.130218 20617 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:29.131691 20636 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:29.132071 12690 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 2778) took 1734 ms (client timeout 2057 ms). Trace:
I20260709 13:06:29.132918 13234 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 24.
I20260709 13:06:29.134791 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:29.135147 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:29.135803 12538 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:29.135948 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:29.136742 12543 raft_consensus.cc:2393] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 22: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:29.137470 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:06:29.121809 20750 log.cc:927] Time spent T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
I20260709 13:06:29.138123 20743 raft_consensus.cc:3055] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:29.138465 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:29.093480 20585 consensus_queue.cc:237] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:29.138551 20743 raft_consensus.cc:740] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:29.143656 12543 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:29.132553 12690 rpcz_store.cc:269] 0709 13:06:27.397319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.577802 (+180483us) service_pool.cc:224] Handling call
0709 13:06:29.131887 (+1554085us) spinlock_profiling.cc:243] Waited 835 ms on lock 0x7b54002ca454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:29.132012 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1921252096}
I20260709 13:06:29.104894 20759 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:29.152181 13233 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 23.
I20260709 13:06:29.154372 12696 raft_consensus.cc:2468] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22.
I20260709 13:06:29.156831 12539 raft_consensus.cc:2468] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:06:29.150712 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:29.160635 20769 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.140880 20710 consensus_queue.cc:260] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.162360 20773 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.177222 20773 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.184824 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:29.186554 20743 consensus_queue.cc:260] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:29.188323 20743 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:29.194144 12622 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:29.195494 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:29.196142 12622 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:06:29.200526 20706 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:29.202256 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 2699) took 1180 ms. Trace:
I20260709 13:06:29.202675 12613 rpcz_store.cc:276] 0709 13:06:28.022431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.498108 (+475677us) service_pool.cc:224] Handling call
0709 13:06:28.570323 (+ 72215us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:28.577499 (+  7176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.202038 (+624539us) spinlock_profiling.cc:243] Waited 67.5 ms on lock 0x7b54002a80d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:29.202190 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155254656}
I20260709 13:06:29.203884 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:29.203660 20769 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.163178 13233 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:06:29.158298 20746 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:29.165298 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:29.233799 12539 raft_consensus.cc:2410] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for term 24 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:06:29.164448 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:29.196969 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:29.197440 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:29.235432 12622 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 22.
I20260709 13:06:29.238716 12538 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:29.168440 12543 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:06:29.240525 12544 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:29.240561 12538 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:06:29.242149 12543 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:06:29.243607 12543 raft_consensus.cc:1240] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:06:29.244781 12543 raft_consensus.cc:1240] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 25. Current term is 26. Ops: []
I20260709 13:06:29.235442 12542 raft_consensus.cc:2393] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 19: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:29.255637 13197 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:29.207487 20711 consensus_meta.cc:287] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.751s	user 0.011s	sys 0.000s
I20260709 13:06:29.252900 20526 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.251164 20773 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:29.267335 20756 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:29.210999 20470 raft_consensus.cc:3055] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:29.170238 20710 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:29.210321 20182 raft_consensus.cc:3055] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:29.273303 12539 raft_consensus.cc:1275] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:06:29.163472 20591 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.278095 12541 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:06:29.206445 20769 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:29.165912 20617 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:29.279067 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 298696us
I20260709 13:06:29.278237 20749 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:29.284000 20470 raft_consensus.cc:740] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:29.287235 20182 raft_consensus.cc:740] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:29.285370 20756 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:29.296994 20680 consensus_meta.cc:287] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.717s	user 0.009s	sys 0.003s
I20260709 13:06:29.261768 20746 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:29.301198 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.303254 12510 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:29.307686 12510 leader_election.cc:400] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 19. Current term is 20.
I20260709 13:06:29.281417 20711 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.300868 20749 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.305192 20702 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 13:06:29.297901 20617 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.315589 20746 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:29.307715 20541 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:29.317694 20182 consensus_queue.cc:260] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.318817 20182 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:29.318671 20126 consensus_queue.cc:1059] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:29.319648 20541 raft_consensus.cc:3055] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:29.320011 20541 raft_consensus.cc:740] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:29.320741 12587 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:29.322293 12587 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:29.322501 12616 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:29.326738 12510 leader_election.cc:400] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 22. Current term is 23.
I20260709 13:06:29.338737 12621 raft_consensus.cc:2368] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 25. Current term is 26.
I20260709 13:06:29.298452 20591 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.321583 20749 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:29.350250 12510 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:29.337656 20612 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.033s	sys 0.040s
I20260709 13:06:29.351974 12510 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:29.336233 20746 raft_consensus.cc:2764] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 13:06:29.317687 20617 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:29.357401 12510 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:29.353641 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:29.360671 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:29.353600 20612 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.033s	sys 0.040s
I20260709 13:06:29.355428 20702 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:29.320775 20541 consensus_queue.cc:260] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.369190 20541 raft_consensus.cc:3060] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:29.375314 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 2787) took 1014 ms. Trace:
I20260709 13:06:29.404945 12696 rpcz_store.cc:276] 0709 13:06:28.360517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.376240 (+ 15723us) service_pool.cc:224] Handling call
0709 13:06:29.375106 (+998866us) spinlock_profiling.cc:243] Waited 712 ms on lock 0x7b540012e154. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:29.375242 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1637343104}
I20260709 13:06:29.371690 20708 consensus_queue.cc:260] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.342137 20470 consensus_queue.cc:260] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.417778 20708 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:29.402179 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:29.403532 12616 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:06:29.384913 12588 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:29.405682 20591 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:29.406486 20526 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:29.407567 20711 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:29.408494 20468 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.423008 20680 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:29.424597 20468 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:29.409358 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.410085 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 2703) took 1386 ms. Trace:
I20260709 13:06:29.425357 12615 rpcz_store.cc:276] 0709 13:06:28.023494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.358946 (+335452us) service_pool.cc:224] Handling call
0709 13:06:29.409896 (+1050950us) spinlock_profiling.cc:243] Waited 62.4 ms on lock 0x7b54003af7d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:29.410005 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143542528}
I20260709 13:06:29.392426 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:29.411186 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1756) took 1899 ms. Trace:
I20260709 13:06:29.411669 20738 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 15. Current term is 16.
I20260709 13:06:29.430270 13228 rpcz_store.cc:276] 0709 13:06:27.511649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:27.511912 (+   263us) service_pool.cc:224] Handling call
0709 13:06:27.512341 (+   429us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:27.926774 (+414433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.410955 (+1484181us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b5400690354. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:29.411126 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":935751040}
W20260709 13:06:29.411702 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:29.413682 13197 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.438386 20596 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:29.441932 20635 raft_consensus.cc:697] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:29.442787 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:29.442934 20635 consensus_queue.cc:237] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:29.414268 12614 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:29.414765 20550 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:29.447677 20556 raft_consensus.cc:3055] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:29.448098 20556 raft_consensus.cc:740] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:29.448225 12662 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:29.449761 20450 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.449433 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:29.450598 20733 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:29.451169 20733 raft_consensus.cc:697] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 25 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:29.452046 20733 consensus_queue.cc:237] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:29.454408 20754 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.536s	user 0.003s	sys 0.000s
I20260709 13:06:29.454547 12618 raft_consensus.cc:1275] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:06:29.454411 20766 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 13:06:29.416488 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2780) took 2014 ms. Trace:
I20260709 13:06:29.457787 12617 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60170 (request call id 2077) took 1093 ms. Trace:
I20260709 13:06:29.457712 12689 rpcz_store.cc:276] 0709 13:06:27.402207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.379408 (+977201us) service_pool.cc:224] Handling call
0709 13:06:28.379682 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:28.429282 (+ 49600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.416227 (+986945us) spinlock_profiling.cc:243] Waited 48.8 ms on lock 0x7b54002373d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:29.416430 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":112199424}
I20260709 13:06:29.448916 20556 consensus_queue.cc:260] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:29.467144 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:29.467947 12614 raft_consensus.cc:1275] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:06:29.468536 12614 pending_rounds.cc:85] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 10
I20260709 13:06:29.468832 12614 pending_rounds.cc:107] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:06:29.469126 12614 raft_consensus.cc:2889] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:29.469372 12659 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:29.419510 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 62206.7us
I20260709 13:06:29.360025 20774 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:06:29.459478 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.459671 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:29.460901 12692 raft_consensus.cc:1240] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:29.417877 20470 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:29.485833 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:29.476017 20643 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 13:06:29.471338 13230 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:29.471346 13232 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 13:06:29.491281 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.470670 12613 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:06:29.476379 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4340) took 2976 ms. Trace:
I20260709 13:06:29.476603 20766 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:29.478046 12691 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 2677) took 1754 ms (client timeout 2187 ms). Trace:
I20260709 13:06:29.491176 20468 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:29.480315 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:29.563392 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:29.481546 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 96729.5us
I20260709 13:06:29.483537 12512 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:29.483935 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:29.470671 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:29.566355 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
W20260709 13:06:29.567196 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 96627.8us
I20260709 13:06:29.476150 20528 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:29.525615 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:29.488138 20306 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:29.525142 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.546900 13231 raft_consensus.cc:2468] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
W20260709 13:06:29.505597 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.492803 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:29.516489 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:29.575838 12694 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:29.458200 12617 rpcz_store.cc:276] 0709 13:06:28.363971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.501747 (+137776us) service_pool.cc:224] Handling call
0709 13:06:28.502040 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:28.583632 (+ 81592us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:28.583661 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:28.584090 (+   429us) log.cc:844] Serialized 26 byte log entry
0709 13:06:28.878327 (+294237us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:06:28.878380 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.177895 (+299515us) spinlock_profiling.cc:243] Waited 81.3 ms on lock 0x7b54002a67d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:29.177964 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:29.453794 (+275830us) spinlock_profiling.cc:243] Waited 8.13 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:06:29.457596 (+  3802us) raft_consensus.cc:1685] finished
0709 13:06:29.457617 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.457738 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205793408,"thread_start_us":293937,"threads_started":1,"wal-append.queue_time_us":334376}
I20260709 13:06:29.556187 12614 rpcz_store.cc:276] 0709 13:06:26.493267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:26.495084 (+  1817us) service_pool.cc:224] Handling call
0709 13:06:26.524857 (+ 29773us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:27.528541 (+1003684us) spinlock_profiling.cc:243] Waited 72.1 ms on lock 0x7b5400098e20. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a94f706f 00007fc3a956ff60 00007fc3a95717de 00007fc3a957bb49 00007fc3a957c416 00007fc3a9578d8f 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62
0709 13:06:29.413905 (+1885364us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b58008393d0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a94d50aa 00007fc3a9557447 00007fc3a956ffe7 00007fc3a95717de 00007fc3a957bb49 00007fc3a957c416 00007fc3a9578d8f 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4
0709 13:06:29.469769 (+ 55864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.470029 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1712866560}
I20260709 13:06:29.557521 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:29.576541 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:29.577214 12690 raft_consensus.cc:2393] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 26: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:06:29.560063 12691 rpcz_store.cc:269] 0709 13:06:27.723887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.218683 (+494796us) service_pool.cc:224] Handling call
0709 13:06:29.477790 (+1259107us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b540041fad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:29.477985 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":949256448}
I20260709 13:06:29.538098 20772 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.489360 20696 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:29.533535 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.488556 20702 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:29.524125 20526 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:29.569888 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:29.595129 20702 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.597148 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:29.597731 20756 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:29.598380 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:29.471313 20737 consensus_queue.cc:1048] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 13:06:29.601075 20540 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:29.602591 20724 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:06:29.604691 12662 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:29.450246 20450 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.478690 12687 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 25. Current term is 26. Ops: []
I20260709 13:06:29.606680 20528 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.607755 12693 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:06:29.486536 20426 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.077s
I20260709 13:06:29.581753 20306 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.611663 20306 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:29.583781 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:29.574213 20468 raft_consensus.cc:697] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 24 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:29.613300 12688 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 22: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:29.614203 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:29.584863 20581 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:29.574698 20403 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:06:29.572211 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 88755.9us
I20260709 13:06:29.622866 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:29.554412 20617 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:29.595173 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:29.615124 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:29.624626 13230 raft_consensus.cc:2410] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:06:29.625062 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:29.523674 20238 consensus_queue.cc:1059] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.057s
I20260709 13:06:29.631014 12512 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:29.631076 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:29.632874 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:29.633267 12588 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:29.634188 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:29.554863 20228 consensus_queue.cc:1059] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.068s
I20260709 13:06:29.618760 20696 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:29.622000 20403 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:29.636153 20550 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:29.636387 20403 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:29.569518 20766 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.637228 20228 raft_consensus.cc:3055] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:29.637663 20228 raft_consensus.cc:740] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:29.638810 20766 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:29.638489 20228 consensus_queue.cc:260] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.619864 20772 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:29.643067 12588 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:29.643740 13234 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:29.575166 20591 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:29.647969 12588 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:29.654178 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:29.555431 20539 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.076s
I20260709 13:06:29.640617 20228 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:06:29.680948 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.680994 13234 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:06:29.701238 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:29.618453 20540 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:06:29.614007 20468 consensus_queue.cc:237] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.706104 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:29.718245 13233 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:29.663950 12588 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:29.719308 12694 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 23.
W20260709 13:06:29.725253 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 61425.1us
I20260709 13:06:29.641284 20722 raft_consensus.cc:2804] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:06:29.726033 12588 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:29.726583 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 147213us
I20260709 13:06:29.730749 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:29.653971 20680 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:06:29.658942 20306 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:29.761169 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:29.762727 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:29.678001 20453 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:29.701982 20738 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:06:29.676998 20591 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:29.766618 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:29.645345 20756 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 13:06:29.706651 20743 raft_consensus.cc:3055] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:06:29.768710 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:29.771458 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 45486.1us
I20260709 13:06:29.782269 12588 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:29.775002 13233 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 26.
I20260709 13:06:29.671564 20526 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:29.701696 20773 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.091s
I20260709 13:06:29.628068 20581 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.724532 20744 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:29.759931 20306 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:29.756605 20579 raft_consensus.cc:2804] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:29.784732 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:29.799291 12694 raft_consensus.cc:2393] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 21: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:29.785501 12659 leader_election.cc:400] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 25. Current term is 26.
I20260709 13:06:29.724268 20211 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:06:29.781323 20760 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:29.730927 20238 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:06:29.768466 20591 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:29.756287 20251 consensus_queue.cc:1059] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:06:29.779976 20550 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:06:29.796998 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 150508us
I20260709 13:06:29.789529 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:29.778210 20743 raft_consensus.cc:740] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:29.776086 20722 raft_consensus.cc:697] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 26 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:29.803644 12616 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:29.793201 20738 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:29.797966 20306 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:29.816562 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:29.818439 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:29.819334 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:29.819929 12540 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:29.820974 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:29.821583 12542 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 24.
I20260709 13:06:29.822355 13233 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:06:29.803205 20710 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:06:29.789530 20706 consensus_meta.cc:287] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.588s	user 0.011s	sys 0.003s
I20260709 13:06:29.806370 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:29.817353 12694 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 24.
I20260709 13:06:29.800635 20526 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:06:29.806327 20702 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:29.812253 20579 raft_consensus.cc:697] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:29.840569 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:29.815304 20697 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:29.827230 12541 raft_consensus.cc:2393] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 24: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:29.803890 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:29.845399 13199 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:29.848098 12544 raft_consensus.cc:2393] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 22: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:29.851976 13229 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22.
I20260709 13:06:29.798137 20744 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:29.857720 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:29.818203 20379 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:29.855451 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 51644.1us
I20260709 13:06:29.828634 20749 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.882910 20379 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:29.884722 20749 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:29.885054 20379 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:29.886699 12688 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 24.
I20260709 13:06:29.855610 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:29.822454 20541 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:29.858927 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:29.861024 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:06:29.861475 20784 log.cc:927] Time spent T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 13:06:29.862018 20779 log.cc:927] Time spent T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:06:29.890465 20541 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.809603 20680 consensus_queue.cc:1059] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 25.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:06:29.893536 20541 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:29.893648 20680 raft_consensus.cc:3055] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:06:29.894238 20680 raft_consensus.cc:740] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:29.858407 20679 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:29.895282 20680 consensus_queue.cc:260] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:29.870031 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.871093 20581 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:29.872012 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:29.873697 20743 consensus_queue.cc:260] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:29.875725 20403 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:29.857323 20426 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:29.829864 20738 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:29.878849 13232 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21.
I20260709 13:06:29.879766 20744 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:29.880477 20344 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:06:29.852665 20775 log.cc:927] Time spent T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
I20260709 13:06:29.918218 20426 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.918210 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:29.867236 20579 consensus_queue.cc:237] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:29.921741 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:29.922420 20403 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:29.862428 20722 consensus_queue.cc:237] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:29.842051 20710 raft_consensus.cc:697] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:06:29.889966 20782 log.cc:927] Time spent T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:06:29.890856 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:29.933684 12694 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 24.
I20260709 13:06:29.895256 12510 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:29.935913 12510 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:29.847611 20702 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:29.905140 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:29.892060 12443 catalog_manager.cc:5697] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 17 to 18, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 18 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:29.909230 20785 log.cc:927] Time spent T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 13:06:29.917008 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1761) took 1149 ms. Trace:
I20260709 13:06:29.922554 20744 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:29.923249 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3942) took 1197 ms. Trace:
I20260709 13:06:29.881867 13199 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:29.923813 20306 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.859234 20772 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:29.926561 20708 consensus_meta.cc:287] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.508s	user 0.005s	sys 0.005s
I20260709 13:06:29.942540 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:29.943802 12620 raft_consensus.cc:2410] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 24 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 13:06:29.945868 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:29.946595 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:29.948988 12545 rpcz_store.cc:276] 0709 13:06:28.726082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.726244 (+   162us) service_pool.cc:224] Handling call
0709 13:06:28.727392 (+  1148us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:28.973768 (+246376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:28.973836 (+    68us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:28.993486 (+ 19650us) log.cc:844] Serialized 52 byte log entry
0709 13:06:29.123554 (+130068us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:06:29.217994 (+ 94440us) log.cc:844] Serialized 14 byte log entry
0709 13:06:29.218446 (+   452us) log.cc:844] Serialized 14 byte log entry
0709 13:06:29.218638 (+   192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.218768 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:29.923004 (+704236us) raft_consensus.cc:1685] finished
0709 13:06:29.923030 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.923186 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26133,"prepare.queue_time_us":95508,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":91,"raft.queue_time_us":34944,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":243,"thread_start_us":320112,"threads_started":2,"wal-append.queue_time_us":383869}
I20260709 13:06:29.967128 12539 raft_consensus.cc:1240] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:06:29.948138 13226 rpcz_store.cc:276] 0709 13:06:28.763535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.142366 (+378831us) service_pool.cc:224] Handling call
0709 13:06:29.142809 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:29.373100 (+230291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.373132 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:29.381716 (+  8584us) log.cc:844] Serialized 26 byte log entry
0709 13:06:29.483017 (+101301us) raft_consensus.cc:1645] Marking committed up to 19
0709 13:06:29.483546 (+   529us) log.cc:844] Serialized 14 byte log entry
0709 13:06:29.483812 (+   266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.883536 (+399724us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b18001c43e0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c3f3 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
0709 13:06:29.911218 (+ 27682us) spinlock_profiling.cc:243] Waited 6 ms on lock 0x7b18001c43e0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a645a2a6 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419
0709 13:06:29.912474 (+  1256us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b5400570dd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:29.912536 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:29.912598 (+    62us) raft_consensus.cc:1685] finished
0709 13:06:29.912618 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:29.912786 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":100,"prepare.run_cpu_time_us":1595,"prepare.run_wall_time_us":26816,"raft.queue_time_us":7285,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":181,"spinlock_wait_cycles":547823104,"thread_start_us":100971,"threads_started":1,"wal-append.queue_time_us":179532}
I20260709 13:06:29.990785 12542 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21.
I20260709 13:06:29.965462 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 1995) took 2384 ms. Trace:
I20260709 13:06:29.947679 20403 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:29.984004 12546 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20. Ops: []
W20260709 13:06:29.952931 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 93538.1us
W20260709 13:06:29.988009 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.973937 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:29.990823 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 48400.3us
I20260709 13:06:29.956344 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:29.951870 20744 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:29.993366 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:29.967114 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:29.994123 12614 raft_consensus.cc:2393] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 22: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:29.995239 12614 raft_consensus.cc:1240] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:29.997197 12621 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:06:29.997653 12621 pending_rounds.cc:85] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 14
I20260709 13:06:29.997885 12621 pending_rounds.cc:107] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:06:29.998147 12621 raft_consensus.cc:2889] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:29.998128 12614 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 18. Current term is 19. Ops: []
W20260709 13:06:29.997195 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.000063 12614 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 13:06:30.011785 13226 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:29.969374 20738 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:29.967361 20182 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:29.995998 20379 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.012115 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:30.011773 20733 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:29.965891 20710 consensus_queue.cc:237] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:29.953624 20581 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:30.002085 20526 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:29.938407 20743 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:30.003046 20403 raft_consensus.cc:697] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 23 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:29.965478 20591 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:30.001734 20293 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:29.953514 20702 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:29.948417 20680 raft_consensus.cc:3060] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:30.003414 20306 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:29.991750 12687 rpcz_store.cc:276] 0709 13:06:27.581269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.400529 (+819260us) service_pool.cc:224] Handling call
0709 13:06:29.478453 (+1077924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:29.607282 (+128829us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.965267 (+357985us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540041fad0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:29.965400 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2478102784}
W20260709 13:06:30.012670 20781 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.453s	user 0.002s	sys 0.000s
W20260709 13:06:30.046563 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 235433us
I20260709 13:06:30.074389 12512 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:30.056434 12694 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:06:29.994218 20744 raft_consensus.cc:3060] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:30.074690 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:30.075536 12512 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:30.081264 12694 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:30.064479 20526 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:30.081946 12614 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:30.083052 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 1444) took 1196 ms. Trace:
I20260709 13:06:30.085503 13235 rpcz_store.cc:276] 0709 13:06:28.886399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.175892 (+289493us) service_pool.cc:224] Handling call
0709 13:06:29.176454 (+   562us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:29.260753 (+ 84299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.260796 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:29.261343 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:06:29.420356 (+159013us) raft_consensus.cc:1645] Marking committed up to 19
0709 13:06:29.420411 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:29.968392 (+547981us) spinlock_profiling.cc:243] Waited 57 ms on lock 0x7b54006315d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:29.968471 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:30.012039 (+ 43568us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:06:30.082838 (+ 70799us) raft_consensus.cc:1685] finished
0709 13:06:30.082859 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.083000 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26851,"raft.queue_time_us":29455,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":118,"spinlock_wait_cycles":140661760,"thread_start_us":131640,"threads_started":1,"wal-append.queue_time_us":185307}
I20260709 13:06:30.087800 12616 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 24 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:30.069643 20774 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:06:30.083487 20635 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.012s	sys 0.008s
I20260709 13:06:30.094190 12512 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:30.102056 20403 consensus_queue.cc:237] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:30.109859 20306 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:30.110839 20182 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:30.111384 20182 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:30.063159 20379 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:30.067593 20733 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:30.122159 20182 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:30.120802 20797 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:30.089951 20526 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:30.084529 20772 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:30.130661 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:30.131469 12687 raft_consensus.cc:2393] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 25: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:30.136401 12512 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:30.094621 20635 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.012s	sys 0.008s
I20260709 13:06:30.142027 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:30.148234 20760 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:30.155565 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:30.157155 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:30.158529 20450 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:30.159235 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:30.163379 20426 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:30.144068 20126 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:30.166081 12538 raft_consensus.cc:2410] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:06:30.180454 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:30.181048 12542 raft_consensus.cc:3060] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:30.172314 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:30.173017 12617 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:30.184151 12617 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:30.189850 12618 raft_consensus.cc:1240] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 17. Current term is 18. Ops: []
W20260709 13:06:30.197120 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.198419 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:30.196888 12542 raft_consensus.cc:2468] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 16.
I20260709 13:06:30.199571 12689 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:06:30.200917 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:30.202677 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:30.171023 20702 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:30.172041 20679 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:30.173214 20591 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:30.170254 20733 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:30.205889 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 281089us
I20260709 13:06:30.176954 20696 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:30.210736 12588 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:30.215308 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 86217.1us
I20260709 13:06:30.222280 12544 raft_consensus.cc:2468] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:06:30.223210 12588 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:30.230301 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:30.231362 12539 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:06:30.231280 12545 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:06:30.235222 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:30.230269 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:30.211114 20710 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:30.239434 12588 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:30.225455 20696 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:30.243645 12539 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:30.243351 12544 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:06:30.238969 20679 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:06:30.246680 13227 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 25.
I20260709 13:06:30.250674 12545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:30.251433 12588 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:30.252764 20612 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.257025 20612 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:30.250093 20591 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:30.262373 12588 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:30.262586 12545 raft_consensus.cc:1240] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 18. Current term is 19. Ops: []
W20260709 13:06:30.265659 20802 log.cc:927] Time spent T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:06:30.273155 20468 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:06:30.274662 20803 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:06:30.279776 12545 raft_consensus.cc:1240] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:30.283205 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:30.283972 12617 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:30.254712 20696 raft_consensus.cc:697] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:30.286645 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:30.287688 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60170 (request call id 2082) took 1097 ms. Trace:
I20260709 13:06:30.300252 12613 rpcz_store.cc:276] 0709 13:06:29.190049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.203613 (+ 13564us) service_pool.cc:224] Handling call
0709 13:06:30.287520 (+1083907us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54001ca054. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:30.287631 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520056064}
I20260709 13:06:30.301328 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:30.289932 12622 raft_consensus.cc:1275] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:06:30.291165 13229 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 1435) took 1777 ms (client timeout 1561 ms). Trace:
I20260709 13:06:30.284170 20579 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:30.294836 20635 consensus_queue.cc:1059] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:30.264693 20591 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.264324 20744 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:30.311368 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:30.258417 20679 raft_consensus.cc:697] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 26 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:30.296459 12617 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 21.
I20260709 13:06:30.296893 20556 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:30.297713 20733 consensus_queue.cc:1059] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:30.297889 20526 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:30.263758 20738 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:30.244488 20710 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:30.298341 20450 consensus_queue.cc:1059] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:06:30.302259 13229 rpcz_store.cc:269] 0709 13:06:28.513779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.534855 (+ 21076us) service_pool.cc:224] Handling call
0709 13:06:30.290950 (+1756095us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54006d01d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:30.291069 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2989025536}
I20260709 13:06:30.295135 20593 consensus_queue.cc:1059] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:30.316790 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:30.297354 20726 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:06:30.304200 20579 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.327067 20579 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:30.325774 20696 consensus_queue.cc:237] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:30.313752 20591 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:30.317541 20764 raft_consensus.cc:3055] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:30.333052 12539 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:30.320547 20550 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.340368 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:30.321338 20708 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:30.323413 20738 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.345824 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:30.341234 12617 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 25: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:30.344338 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:30.346798 12689 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 25.
I20260709 13:06:30.344820 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:30.334874 20733 consensus_queue.cc:1243] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer a11816c5d72e4d1295a242f3ced09e5f log is divergent from this leader: its last log entry 20.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:06:30.347915 12688 raft_consensus.cc:2410] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 23 because replica has last-logged OpId of term: 21 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:06:30.346494 13200 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:30.346668 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:30.348215 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.335127 20764 raft_consensus.cc:740] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:30.338853 20720 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.360458 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:30.360471 13200 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:30.363175 12510 leader_election.cc:336] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Timed out: RequestConsensusVote RPC to 127.11.44.194:41653 timed out after 1.894s (SENT)
I20260709 13:06:30.364063 12510 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:30.364881 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:30.366555 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:30.366714 13200 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:30.347779 20738 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:30.368916 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:30.350497 20450 raft_consensus.cc:3055] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:30.370798 13200 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:30.352401 20797 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:30.342559 20550 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:30.378324 13200 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:30.387792 13200 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:30.346676 20708 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:30.372138 20403 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:06:30.416277 20550 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:30.418483 20453 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:30.374634 20759 raft_consensus.cc:2804] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:30.419734 20759 raft_consensus.cc:697] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:30.420867 20759 consensus_queue.cc:237] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:30.372490 20450 raft_consensus.cc:740] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:30.423290 20450 consensus_queue.cc:260] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:30.424813 20450 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:30.425820 12544 raft_consensus.cc:1240] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 25. Current term is 26. Ops: []
I20260709 13:06:30.362906 20426 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:30.397038 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:30.397477 12538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:30.370518 20615 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:30.388813 12512 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:30.431679 12512 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:30.433331 12512 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:30.396590 12613 raft_consensus.cc:2468] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 26.
I20260709 13:06:30.400501 12662 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:30.406046 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:30.407017 20809 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:06:30.366598 20720 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:30.381130 20736 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:30.410737 20710 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:30.411655 20744 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:30.413527 20708 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:30.427472 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:30.444450 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:30.447233 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:30.449049 12617 raft_consensus.cc:2376] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18. Re-sending same reply.
I20260709 13:06:30.448307 12659 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:30.450031 12512 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:30.451215 12659 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:30.453042 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 52649.7us
I20260709 13:06:30.453945 12662 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:30.398440 20344 raft_consensus.cc:2804] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:30.456240 12512 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:30.457137 20238 raft_consensus.cc:2804] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:30.464677 20251 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:30.465982 20287 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:30.370081 20679 consensus_queue.cc:237] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:30.430109 20617 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:30.471895 20617 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:30.474336 20617 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:30.475757 20726 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:30.478051 20720 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:30.432090 20541 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:30.491560 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:30.492554 12617 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
W20260709 13:06:30.491637 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 103921us
I20260709 13:06:30.455613 20527 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.493878 13200 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:30.494544 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.452010 20403 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:30.455266 20540 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:30.456538 20126 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:30.456331 20760 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:06:30.503773 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:30.393736 20764 consensus_queue.cc:260] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:30.508654 12617 raft_consensus.cc:2393] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 24: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:30.488637 20541 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:30.488373 20344 raft_consensus.cc:697] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:30.515264 20720 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:30.518473 12619 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 21 index: 19. Preceding OpId from leader: term: 22 index: 20. (index mismatch)
W20260709 13:06:30.518709 20787 log.cc:927] Time spent T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.882s	user 0.003s	sys 0.000s
I20260709 13:06:30.521363 20737 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:30.522248 20344 consensus_queue.cc:237] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:30.523371 20526 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:30.502730 20527 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:30.536674 20527 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:30.517371 20541 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:30.560366 12692 raft_consensus.cc:1240] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:30.556401 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:30.562162 12617 raft_consensus.cc:2393] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 19: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:06:30.563081 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.559252 20238 raft_consensus.cc:697] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:06:30.567286 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 113438us
I20260709 13:06:30.542315 20527 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.021s
I20260709 13:06:30.569211 12662 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:30.565397 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 55822.4us
I20260709 13:06:30.572276 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:30.582614 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:30.588953 12692 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 24.
I20260709 13:06:30.590835 20700 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:30.583793 20738 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:30.594907 20738 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:30.595695 12621 raft_consensus.cc:2368] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 22. Current term is 23.
I20260709 13:06:30.575359 20539 raft_consensus.cc:3055] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:30.603210 20539 raft_consensus.cc:740] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:30.603519 20797 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.604121 20539 consensus_queue.cc:260] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:30.604262 20797 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:30.588616 20612 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:30.582885 20591 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:30.608654 20591 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:30.576785 20251 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:30.609719 20815 consensus_queue.cc:1059] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:30.610826 20815 raft_consensus.cc:3055] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:30.611157 20815 raft_consensus.cc:740] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:30.611936 20815 consensus_queue.cc:260] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:30.614342 20579 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:30.615759 12619 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:06:30.618537 20579 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:30.620239 20541 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:30.613376 20815 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:30.605413 20539 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:30.643843 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 187673us
W20260709 13:06:30.641722 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 50297.1us
W20260709 13:06:30.645437 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.646047 12512 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:30.652158 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:30.652817 12692 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:06:30.650555 20426 consensus_queue.cc:1059] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.005s
W20260709 13:06:30.658618 20812 log.cc:927] Time spent T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.299s	user 0.000s	sys 0.002s
I20260709 13:06:30.572891 20238 consensus_queue.cc:237] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:30.669309 20635 raft_consensus.cc:3055] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:30.669799 20635 raft_consensus.cc:740] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:30.672497 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:30.673339 12621 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 25: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:30.676112 12622 raft_consensus.cc:1240] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 20. Current term is 21. Ops: [20.11-20.11]
I20260709 13:06:30.665252 20819 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:30.692005 20541 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:30.693359 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:30.695216 12694 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:06:30.695619 12692 raft_consensus.cc:1275] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:06:30.697965 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:30.677477 12622 raft_consensus.cc:1275] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
W20260709 13:06:30.703416 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.704311 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:30.704921 12694 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22.
I20260709 13:06:30.705775 12622 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:06:30.709689 12587 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:30.711004 12587 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:30.713500 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:30.681378 20700 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:30.720304 12587 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:30.723744 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:30.724763 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:30.726954 12615 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:06:30.733829 20819 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.734464 20528 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:30.734408 20819 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:30.736660 20819 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:30.737751 20550 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:30.738184 20550 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:30.738512 20550 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:30.741963 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:30.717908 20643 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:30.743321 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:30.746783 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.778286 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:30.778927 12687 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:30.781795 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:30.783792 12691 raft_consensus.cc:1275] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:06:30.785665 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:30.786105 12694 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:06:30.786271 12690 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:30.787397 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:30.787993 12689 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 25.
I20260709 13:06:30.724061 20738 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:06:30.803722 20643 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:30.804453 20643 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:30.806576 20643 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:30.807617 20797 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:30.808728 12690 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 25.
W20260709 13:06:30.815248 12620 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41086 (request call id 2717) took 1933 ms (client timeout 1894 ms). Trace:
W20260709 13:06:30.815703 12620 rpcz_store.cc:269] 0709 13:06:28.882253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.903876 (+ 21623us) service_pool.cc:224] Handling call
0709 13:06:30.815061 (+1911185us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54002a8ad4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:30.815183 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2350224128}
I20260709 13:06:30.818892 20591 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:30.820588 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42458 (request call id 3954) took 1004 ms. Trace:
I20260709 13:06:30.821004 12547 rpcz_store.cc:276] 0709 13:06:29.817114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.817239 (+   125us) service_pool.cc:224] Handling call
0709 13:06:29.817530 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:29.824551 (+  7021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:29.824582 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:29.825041 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:06:30.819990 (+994949us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b1800452c20. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a91214bc 00007fc3a646f48b 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1
0709 13:06:30.820140 (+   150us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:30.820176 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.820245 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:30.820287 (+    42us) raft_consensus.cc:1685] finished
0709 13:06:30.820302 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:30.820500 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6666,"raft.queue_time_us":36367,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":20115,"spinlock_wait_cycles":5924736,"thread_start_us":30041,"threads_started":1,"wal-append.queue_time_us":122706}
I20260709 13:06:30.824596 12617 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 26 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 25. Current term is 26. Ops: []
I20260709 13:06:30.829690 12510 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:30.831350 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:30.831431 13227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60962 (request call id 1799) took 2298 ms (client timeout 1866 ms). Trace:
W20260709 13:06:30.832057 13227 rpcz_store.cc:269] 0709 13:06:28.533281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.551663 (+ 18382us) service_pool.cc:224] Handling call
0709 13:06:30.831232 (+2279569us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54001dfe54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:30.831332 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3896103552}
I20260709 13:06:30.834748 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:30.835094 20635 consensus_queue.cc:260] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:30.836259 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:30.837087 12690 raft_consensus.cc:2410] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 27 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:06:30.843604 12688 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 25.
I20260709 13:06:30.845224 20828 consensus_queue.cc:1059] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:06:30.843909 20453 raft_consensus.cc:3055] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:30.844930 12619 raft_consensus.cc:1240] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:30.845268 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:30.850440 12696 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
I20260709 13:06:30.849256 12687 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 23.
I20260709 13:06:30.853717 20818 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.854303 20818 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:30.856930 20818 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:30.857769 20528 consensus_queue.cc:1048] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:30.858444 20450 consensus_queue.cc:1059] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:30.859419 20450 consensus_queue.cc:1048] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:30.860179 20528 consensus_queue.cc:1059] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:30.860651 20450 raft_consensus.cc:3055] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:30.861064 20450 raft_consensus.cc:740] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:30.866858 12587 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:30.861878 20743 raft_consensus.cc:3055] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:30.873831 20743 raft_consensus.cc:740] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:30.875617 20720 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:30.862704 20182 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.876797 20182 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:30.877609 20764 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:30.880678 20182 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:30.863909 20738 consensus_queue.cc:1048] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:30.869927 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:30.849984 20453 raft_consensus.cc:740] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:30.883481 20453 consensus_queue.cc:260] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:30.884804 20453 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:30.865178 20468 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:30.886238 12618 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4378) took 1074 ms. Trace:
W20260709 13:06:30.868515 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 218551us
I20260709 13:06:30.886801 12618 rpcz_store.cc:276] 0709 13:06:29.811849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.175042 (+363193us) service_pool.cc:224] Handling call
0709 13:06:30.175360 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:30.191958 (+ 16598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.885949 (+693991us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b54003aedd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:30.886166 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32910720}
I20260709 13:06:30.888227 20817 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 13:06:30.889631 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4368) took 1102 ms. Trace:
I20260709 13:06:30.868854 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:30.890076 20726 raft_consensus.cc:3055] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:30.890616 20726 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:30.891078 13229 raft_consensus.cc:2410] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 27 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 13.
I20260709 13:06:30.862216 12614 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4376) took 1058 ms. Trace:
I20260709 13:06:30.891678 20726 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 22.20, Last appended by leader: 20, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:30.892130 12614 rpcz_store.cc:276] 0709 13:06:29.803639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.056954 (+253315us) service_pool.cc:224] Handling call
0709 13:06:30.057326 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:30.084924 (+ 27598us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.861982 (+777058us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b540024bb54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:30.862155 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56205568}
I20260709 13:06:30.894023 12662 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:30.872694 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:30.896420 12620 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 22.
I20260709 13:06:30.873238 20379 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:30.898157 20766 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:30.898645 20766 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:30.899121 20766 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:30.874588 12443 catalog_manager.cc:5697] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 10 to 19, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 19 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:30.890139 12616 rpcz_store.cc:276] 0709 13:06:29.787430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.889797 (+102367us) service_pool.cc:224] Handling call
0709 13:06:29.890142 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:30.088252 (+198110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:30.889287 (+801035us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54001e9bd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:30.889536 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454100864}
I20260709 13:06:30.869442 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:30.904554 12613 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 25.
I20260709 13:06:30.906821 20726 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:30.836302 20635 raft_consensus.cc:3060] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:30.910573 13227 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:06:30.915426 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:30.916029 13232 raft_consensus.cc:2376] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22. Re-sending same reply.
W20260709 13:06:30.918032 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 88428.6us
I20260709 13:06:30.919013 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:30.920441 12510 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:30.922737 12510 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:30.918208 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:30.917713 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:30.861392 20528 consensus_queue.cc:1243] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer a11816c5d72e4d1295a242f3ced09e5f log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:06:30.936059 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:06:30.935256 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 68480.2us
I20260709 13:06:30.940603 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:30.939090 20526 consensus_queue.cc:1059] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260709 13:06:30.942922 20772 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:30.945631 20757 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:30.948176 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:30.950522 13227 raft_consensus.cc:1275] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260709 13:06:30.951503 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:30.952241 13231 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 24.
I20260709 13:06:30.955312 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:30.957798 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 54798.3us
I20260709 13:06:30.939110 20581 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:30.960896 20450 consensus_queue.cc:260] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:30.962358 20450 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:30.939285 20608 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:30.968196 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:30.938298 12587 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:30.917294 20818 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:30.988531 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:30.935899 20643 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:30.992596 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 144237us
W20260709 13:06:30.993198 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 70457.4us
I20260709 13:06:30.994187 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:30.996132 12510 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:30.979099 12512 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:30.982672 13235 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:06:30.982931 20581 raft_consensus.cc:697] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 21 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:06:30.996759 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 58574.5us
I20260709 13:06:30.999185 20541 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:30.999607 20541 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:30.999969 20541 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:31.001698 20379 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:31.001879 20550 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:31.002699 20772 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:31.003355 20772 raft_consensus.cc:697] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:31.004818 20550 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:31.006667 20581 consensus_queue.cc:237] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:31.006989 20743 consensus_queue.cc:260] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:31.008639 20743 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:31.009521 12613 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 26: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:31.013978 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:31.021538 12587 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:31.023042 12587 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:30.916638 20826 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.079s
I20260709 13:06:30.959707 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:31.043151 12547 pending_rounds.cc:85] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653: Aborting all ops after (but not including) 10
I20260709 13:06:31.043741 12547 pending_rounds.cc:107] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:06:31.044111 12547 raft_consensus.cc:2889] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:31.050551 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:31.051329 12541 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:31.055544 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:31.056428 12541 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 26.
I20260709 13:06:31.051573 12614 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 18.
W20260709 13:06:31.075555 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 79490.8us
I20260709 13:06:31.076962 12510 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:31.077296 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 117676us
I20260709 13:06:31.079448 12510 leader_election.cc:400] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 22. Current term is 23.
I20260709 13:06:31.079871 12510 leader_election.cc:403] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:31.080655 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 51278.3us
I20260709 13:06:31.080610 12659 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:31.090796 13197 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:31.092166 12688 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:06:31.095009 12620 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:06:31.099062 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:31.099100 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:31.101285 13227 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:31.016497 20798 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:31.025421 20468 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:31.038602 20738 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:06:31.120069 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 272963us
I20260709 13:06:31.058921 12512 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:06:31.144178 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.016712 20526 consensus_queue.cc:1059] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 13:06:31.087802 20539 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:31.005064 20772 consensus_queue.cc:237] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:31.206810 12588 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:31.022331 20643 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:31.094880 20306 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:31.104710 12662 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:30.997502 20818 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:31.242179 20818 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:31.139358 20797 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.242899 20797 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:31.245235 20797 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:31.016186 20700 consensus_queue.cc:1059] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.097s
I20260709 13:06:31.118393 20758 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:06:31.224085 20737 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:06:31.225608 12588 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:31.104535 20817 consensus_queue.cc:1059] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:06:31.118870 20711 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:31.258193 20711 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:31.239580 20744 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:31.261852 20744 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:31.262466 20744 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:06:31.263592 12444 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36394 (request call id 343) took 38638 ms (client timeout 15000 ms). Trace:
I20260709 13:06:31.206420 20556 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:31.087890 20251 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:31.276101 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 50607.9us
I20260709 13:06:31.280966 12588 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:31.206509 20733 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:31.145527 20819 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:06:31.294147 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 189508us
I20260709 13:06:31.113801 20591 consensus_queue.cc:1048] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.161s
I20260709 13:06:31.288570 20711 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:31.266121 20760 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:31.275525 20738 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:31.140226 20579 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.163s
I20260709 13:06:31.302585 20379 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:31.289176 20556 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:31.314976 20238 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.055s	sys 0.063s
I20260709 13:06:31.300529 20733 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.289462 20293 consensus_queue.cc:1059] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.048s
I20260709 13:06:31.306847 20700 consensus_queue.cc:1243] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Peer a11816c5d72e4d1295a242f3ced09e5f log is divergent from this leader: its last log entry 26.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 13:06:31.281553 20737 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 13:06:31.293864 20251 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:31.412192 20556 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:31.444443 12693 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.022s	sys 0.042s
I20260709 13:06:31.326294 20468 consensus_queue.cc:1048] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.112s
I20260709 13:06:31.352770 20528 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:06:31.388190 20759 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.016s	sys 0.044s
I20260709 13:06:31.371703 20738 raft_consensus.cc:697] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 22 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:31.352574 20793 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:06:31.264127 12444 rpcz_store.cc:269] 0709 13:05:52.625156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.896459 (+9271303us) service_pool.cc:224] Handling call
0709 13:06:31.263289 (+29366830us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:16.088358 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:16.089063 (+   705us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:16.089127 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:06:16.089150 (+    23us) tablet.cc:662] Decoding operations
0709 13:06:16.091272 (+  2122us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:16.091369 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:16.091397 (+    28us) tablet.cc:685] Acquiring locks for 26 operations
0709 13:06:16.209602 (+118205us) tablet.cc:701] Row locks acquired
0709 13:06:16.228001 (+ 18399us) write_op.cc:260] PREPARE: finished
0709 13:06:16.278196 (+ 50195us) write_op.cc:270] Start()
0709 13:06:16.307739 (+ 29543us) write_op.cc:276] Timestamp: P: 1783602376260899 usec, L: 0
0709 13:06:16.391819 (+ 84080us) op_driver.cc:348] REPLICATION: starting
0709 13:06:16.437404 (+ 45585us) log.cc:844] Serialized 10284 byte log entry
0709 13:06:18.491879 (+2054475us) op_driver.cc:464] REPLICATION: finished
0709 13:06:19.321014 (+829135us) write_op.cc:301] APPLY: starting
0709 13:06:19.339120 (+ 18106us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:20.170447 (+831327us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:20.170563 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:21.197599 (+1027036us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:21.198104 (+   505us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=52,key_file_lookups=52,delta_file_lookups=52,mrs_lookups=0
0709 13:06:21.198172 (+    68us) write_op.cc:312] APPLY: finished
0709 13:06:21.198708 (+   536us) log.cc:844] Serialized 228 byte log entry
0709 13:06:21.525810 (+327102us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:21.617889 (+ 92079us) write_op.cc:454] Released schema lock
0709 13:06:21.693237 (+ 75348us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:21.749526 (+ 56289us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:21.751285 (+  1759us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31012,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":707895,"apply.run_cpu_time_us":83062,"apply.run_wall_time_us":2460256,"cfile_cache_hit":106,"cfile_cache_hit_bytes":112859,"num_ops":26,"prepare.queue_time_us":706667,"prepare.run_cpu_time_us":38225,"prepare.run_wall_time_us":823667,"raft.queue_time_us":588067,"raft.run_cpu_time_us":40034,"raft.run_wall_time_us":639384,"replication_time_us":2056172,"thread_start_us":1928725,"threads_started":5,"wal-append.queue_time_us":1451794,"wal-append.run_cpu_time_us":97236,"wal-append.run_wall_time_us":3116796}]]}
I20260709 13:06:31.402141 20379 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:31.484579 12693 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.023s	sys 0.043s
W20260709 13:06:31.404249 20238 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.057s	sys 0.065s
I20260709 13:06:31.513785 12693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37308 (request call id 2692) took 1169 ms. Trace:
I20260709 13:06:31.412974 20733 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:31.491725 20528 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.479578 20700 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.514251 12693 rpcz_store.cc:276] 0709 13:06:30.344627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.344804 (+   177us) service_pool.cc:224] Handling call
0709 13:06:30.345061 (+   257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:30.349480 (+  4419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:30.349514 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:30.356185 (+  6671us) log.cc:844] Serialized 26 byte log entry
0709 13:06:30.584326 (+228141us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b1800294520. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:06:30.649314 (+ 64988us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:06:30.855256 (+205942us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b1800294520. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a648c522 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd 000000000038f354 000000000038f199 00007fc3a646f83a
0709 13:06:31.513178 (+657922us) log.cc:844] Serialized 14 byte log entry
0709 13:06:31.513423 (+   245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.513508 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:31.513575 (+    67us) raft_consensus.cc:1685] finished
0709 13:06:31.513587 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.513723 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":556,"prepare.queue_time_us":52584,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":5751,"raft.queue_time_us":9509,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":8676,"spinlock_wait_cycles":61245952,"thread_start_us":878513,"threads_started":2,"wal-append.queue_time_us":371786}
W20260709 13:06:31.505424 20759 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.016s	sys 0.048s
I20260709 13:06:31.516688 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:31.513717 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 210810us
W20260709 13:06:31.505061 20764 consensus_meta.cc:287] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.627s	user 0.011s	sys 0.000s
W20260709 13:06:31.492419 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 433569us
I20260709 13:06:31.413637 20711 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.098s
I20260709 13:06:31.524096 12620 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 23.
W20260709 13:06:31.527499 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 386596us
I20260709 13:06:31.524632 12512 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:06:31.525199 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 418093us
W20260709 13:06:31.530764 20450 consensus_meta.cc:287] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.564s	user 0.006s	sys 0.005s
I20260709 13:06:31.522289 20758 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 22. Current term is 23.
I20260709 13:06:31.541327 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:31.540324 12659 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:31.533962 12512 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:31.515985 20379 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:31.514051 20793 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:31.621619 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 87755.4us
W20260709 13:06:31.631937 12587 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.000s	sys 0.017s
I20260709 13:06:31.537541 20797 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:31.526006 20835 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:06:31.608860 20823 log.cc:927] Time spent T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:06:31.626420 12615 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.020s	sys 0.049s
W20260709 13:06:31.622032 13197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.018s	sys 0.069s
W20260709 13:06:31.635036 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 94796.2us
W20260709 13:06:31.631681 13200 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.013s	sys 0.005s
W20260709 13:06:31.655874 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:31.656302 13200 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.013s	sys 0.005s
W20260709 13:06:31.656665 13197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.018s	sys 0.069s
W20260709 13:06:31.657883 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 567185us
W20260709 13:06:31.655290 12615 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.020s	sys 0.049s
I20260709 13:06:31.524469 20528 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:06:31.616766 12617 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.000s	sys 0.010s
W20260709 13:06:31.713989 12617 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.000s	sys 0.011s
I20260709 13:06:31.640416 13199 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:06:31.715005 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 75247.7us
W20260709 13:06:31.639925 12587 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.000s	sys 0.017s
W20260709 13:06:31.666415 12444 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36396 (request call id 358) took 26647 ms (client timeout 15000 ms). Trace:
W20260709 13:06:31.717269 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 611048us
I20260709 13:06:31.659834 20182 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.644299 20581 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:31.525617 20700 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:31.638836 20738 consensus_queue.cc:237] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:31.690061 20833 log.cc:927] Time spent T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:06:31.691445 20251 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:31.838815 12621 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4394) took 1252 ms. Trace:
I20260709 13:06:31.692860 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:31.839296 12621 rpcz_store.cc:276] 0709 13:06:30.586019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.705834 (+119815us) service_pool.cc:224] Handling call
0709 13:06:30.714636 (+  8802us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:30.714970 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:30.714998 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:30.726331 (+ 11333us) log.cc:844] Serialized 26 byte log entry
0709 13:06:31.036194 (+309863us) raft_consensus.cc:1645] Marking committed up to 19
0709 13:06:31.036240 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.036309 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:31.838536 (+802227us) raft_consensus.cc:1685] finished
0709 13:06:31.838560 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:31.838741 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15692,"raft.queue_time_us":2969,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":2455,"thread_start_us":309494,"threads_started":1,"wal-append.queue_time_us":604055}
W20260709 13:06:31.843175 20832 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.429s	user 0.002s	sys 0.000s
W20260709 13:06:31.846199 20830 log.cc:927] Time spent T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
W20260709 13:06:31.846593 20306 consensus_meta.cc:287] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.569s	user 0.010s	sys 0.001s
I20260709 13:06:31.847064 20306 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:31.847831 20306 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:31.848351 20306 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:31.854568 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 195994us
I20260709 13:06:31.800071 20845 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:06:31.696918 20766 consensus_meta.cc:287] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.797s	user 0.007s	sys 0.002s
I20260709 13:06:31.698164 20848 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:31.701826 20793 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:31.702665 20726 consensus_meta.cc:287] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.795s	user 0.006s	sys 0.005s
I20260709 13:06:31.824268 20581 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:31.709009 20743 consensus_meta.cc:287] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.700s	user 0.010s	sys 0.000s
W20260709 13:06:31.709430 20453 consensus_meta.cc:287] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.824s	user 0.013s	sys 0.001s
W20260709 13:06:31.799528 12588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.025s	sys 0.031s
W20260709 13:06:31.882840 12588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.027s	sys 0.033s
W20260709 13:06:31.883226 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 588870us
I20260709 13:06:31.786311 12587 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:31.791426 20541 consensus_meta.cc:287] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.786s	user 0.008s	sys 0.003s
I20260709 13:06:31.811383 13199 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:06:31.800079 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 153575us
W20260709 13:06:31.889595 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 103365us
W20260709 13:06:31.720768 12547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.004s	sys 0.007s
W20260709 13:06:31.890378 12547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.015s	sys 0.031s
I20260709 13:06:31.890276 12587 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:31.643756 20722 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:31.809090 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:31.717684 12444 rpcz_store.cc:269] 0709 13:06:05.018869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.666129 (+26647260us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:31.666317 (+   188us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:06:31.891441 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:06:31.807416 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 169440us
I20260709 13:06:31.892604 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:31.815536 20828 consensus_queue.cc:1059] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.004s
I20260709 13:06:31.825263 12620 raft_consensus.cc:1275] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:06:31.896598 12541 raft_consensus.cc:1275] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:06:31.896962 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:31.897585 12543 raft_consensus.cc:3060] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:31.897432 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:31.903496 20772 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.015s	sys 0.000s
I20260709 13:06:31.903663 12689 raft_consensus.cc:3055] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 25 LEADER]: Stepping down as leader of term 25
W20260709 13:06:31.903937 20772 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.015s	sys 0.000s
I20260709 13:06:31.904075 12689 raft_consensus.cc:740] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:31.898351 12693 raft_consensus.cc:2468] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:31.701377 20744 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:31.818845 20182 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:31.832523 20841 log.cc:927] Time spent T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
I20260709 13:06:31.802240 20526 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:31.855450 13197 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:31.620427 20643 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:31.661298 20835 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:31.704100 20635 consensus_meta.cc:287] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.794s	user 0.007s	sys 0.003s
I20260709 13:06:31.863970 20845 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:31.887950 12696 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:06:31.967070 12696 pending_rounds.cc:85] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 14
I20260709 13:06:31.869374 20211 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:31.877691 20581 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:31.910025 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
W20260709 13:06:31.916603 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 105322us
I20260709 13:06:31.920193 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:31.920316 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:31.904911 12689 consensus_queue.cc:260] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:31.930382 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:31.870894 20760 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:06:31.929473 12546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:31.920850 12541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:31.881851 20860 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:31.940245 12543 raft_consensus.cc:2468] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 25.
I20260709 13:06:31.867225 20766 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:31.894984 12540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653"
I20260709 13:06:32.046437 20867 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.047003 20867 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:32.048450 20766 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:32.051002 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:32.051780 20828 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:32.051949 20835 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:32.053030 20828 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:32.053510 20828 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:31.918120 20720 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:31.968545 20758 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.058058 20758 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:31.930821 20759 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:32.059319 20211 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:32.065114 20840 log.cc:927] Time spent T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.451s	user 0.000s	sys 0.002s
I20260709 13:06:32.065651 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:31.967345 12696 pending_rounds.cc:107] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 18.15
W20260709 13:06:32.029145 12444 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36398 (request call id 359) took 19729 ms (client timeout 15000 ms). Trace:
I20260709 13:06:31.899394 20541 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:32.076516 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:31.917351 20722 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.026223 12541 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:32.030427 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:32.080456 12542 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:06:32.081506 12542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:32.082276 12542 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 24.
I20260709 13:06:31.920518 20844 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.046096 12546 raft_consensus.cc:2393] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 18: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:32.057634 20720 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.026963 20859 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:32.038175 20635 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.028697 12694 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 19: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:32.029479 12692 raft_consensus.cc:1275] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:06:32.067519 12444 rpcz_store.cc:269] 0709 13:06:12.240180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.943606 (+19703426us) service_pool.cc:211] Skipping call since client already timed out
0709 13:06:31.969167 (+ 25561us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:06:31.983887 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 128528us
I20260709 13:06:32.076675 12543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:32.077529 12695 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:32.077518 12540 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 23.
I20260709 13:06:32.083405 20867 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:31.966486 20526 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.085000 12542 raft_consensus.cc:1275] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:06:31.936002 20764 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:32.066869 13227 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 25.
I20260709 13:06:31.908737 20864 raft_consensus.cc:2804] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:32.132952 20864 raft_consensus.cc:697] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 25 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:31.937645 20238 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:31.983055 20858 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.920428 20846 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:32.070777 12696 raft_consensus.cc:2889] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:32.036034 20815 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.011158 20643 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.116336 12543 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 19: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:32.077251 20211 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:32.123051 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:32.097540 12512 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:32.079387 20722 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:31.970958 20845 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:06:32.124766 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 213868us
I20260709 13:06:32.076081 20835 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:32.158295 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 60913us
I20260709 13:06:31.970502 20450 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:32.137583 12541 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:06:32.149768 12546 raft_consensus.cc:1275] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:06:32.112071 20798 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:32.154979 12693 raft_consensus.cc:2468] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 30.
W20260709 13:06:32.150660 20379 consensus_meta.cc:287] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.504s	user 0.000s	sys 0.010s
I20260709 13:06:32.137588 20759 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.164301 12693 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 21 index: 11. (term mismatch)
I20260709 13:06:32.151466 20858 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:32.166148 20869 log.cc:927] Time spent T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:06:32.182964 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:32.158601 20815 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.146065 20306 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:32.168078 20700 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:32.173152 13231 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:06:32.181206 12693 pending_rounds.cc:85] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 10
I20260709 13:06:32.186348 12693 pending_rounds.cc:107] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 20.11
I20260709 13:06:32.165405 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:32.088512 20860 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.166641 20798 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:32.159714 20857 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.186656 12693 raft_consensus.cc:2889] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:32.126919 20635 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.187461 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:32.189397 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:32.142964 20764 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.114315 20844 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:32.178421 20736 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.199270 13230 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21.
I20260709 13:06:32.124262 20859 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.164979 20846 raft_consensus.cc:697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 23 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:32.183979 20759 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:32.184894 20867 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:32.149941 20864 consensus_queue.cc:237] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:32.149821 20238 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:32.217002 20870 log.cc:927] Time spent T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:06:32.217124 20867 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.219004 20238 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:32.219394 20867 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:32.221026 20859 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:32.222098 20846 consensus_queue.cc:237] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:32.222927 20825 raft_consensus.cc:3055] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:06:32.223322 20825 raft_consensus.cc:740] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:32.224228 20825 consensus_queue.cc:260] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.193917 20843 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
W20260709 13:06:32.213711 20873 log.cc:927] Time spent T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:06:32.158331 20643 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:32.196101 20874 raft_consensus.cc:2804] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:32.202368 20877 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:32.171048 20835 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.200239 20744 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:32.187211 20450 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 5
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:06:32.450692 20550 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.452121 20550 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.356328 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:32.454304 20238 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.455261 20238 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.359189 12619 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4397) took 1309 ms. Trace:
I20260709 13:06:32.456279 12619 rpcz_store.cc:276] 0709 13:06:31.049551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.052084 (+  2533us) service_pool.cc:224] Handling call
0709 13:06:31.052537 (+   453us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:31.053050 (+   513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.053102 (+    52us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:31.860358 (+807256us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b2c0004c3c8. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:06:31.860925 (+   567us) log.cc:844] Serialized 52 byte log entry
0709 13:06:32.087496 (+226571us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:32.087533 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.087609 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.358388 (+270779us) raft_consensus.cc:1685] finished
0709 13:06:32.358439 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.358952 (+   513us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20920,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":8102,"spinlock_wait_cycles":47566208,"thread_start_us":226236,"threads_started":1,"wal-append.queue_time_us":265099}
I20260709 13:06:32.458824 20238 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:32.362774 12621 raft_consensus.cc:1275] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:06:32.459661 20238 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.364144 12622 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4398) took 1314 ms. Trace:
I20260709 13:06:32.460418 20238 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:32.368248 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:32.373057 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:32.462394 12693 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 27.
I20260709 13:06:32.184407 12695 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 26.
W20260709 13:06:32.378240 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 218612us
I20260709 13:06:32.466826 20450 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:32.384049 13231 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:06:32.203609 13228 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:06:32.386387 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:32.389005 12692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2823) took 1607 ms. Trace:
I20260709 13:06:32.388923 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:32.472430 20238 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:32.391206 12696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2825) took 1437 ms. Trace:
I20260709 13:06:32.477319 20635 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:32.477741 12696 rpcz_store.cc:276] 0709 13:06:30.953932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.954085 (+   153us) service_pool.cc:224] Handling call
0709 13:06:30.954405 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.150633 (+1196228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.390635 (+240002us) spinlock_profiling.cc:243] Waited 933 ms on lock 0x7b54002c9054. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:32.391011 (+   376us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2145962880}
I20260709 13:06:32.478617 20635 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.479547 20635 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:32.404702 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:32.482262 12691 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 25.
I20260709 13:06:32.472424 12692 rpcz_store.cc:276] 0709 13:06:30.781623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.782743 (+  1120us) service_pool.cc:224] Handling call
0709 13:06:30.783066 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.114588 (+1331522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.388519 (+273931us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54000c80d4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:32.388814 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2761580288}
I20260709 13:06:32.406409 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:32.409301 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:32.486917 20635 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:32.489285 20720 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:32.490550 20643 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:32.491338 20643 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.411857 12544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a70479a3b4114f3581095e9890f5d653" is_pre_election: true
I20260709 13:06:32.493263 20711 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 13:06:32.419263 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:32.426512 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:32.428053 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:32.434758 20182 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:32.436012 20251 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.185984 20379 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.438695 20526 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:32.460457 12622 rpcz_store.cc:276] 0709 13:06:31.050011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.053440 (+  3429us) service_pool.cc:224] Handling call
0709 13:06:31.053859 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:31.054293 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.054321 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:31.862123 (+807802us) spinlock_profiling.cc:243] Waited 20.2 ms on lock 0x7b2c0004c3c8. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a7e72a11 00007fc3a7e82372 00007fc3a95b4a01 00007fc3a957943a 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2
0709 13:06:31.862503 (+   380us) log.cc:844] Serialized 26 byte log entry
0709 13:06:31.919848 (+ 57345us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:31.919893 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.925322 (+  5429us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.363506 (+438184us) raft_consensus.cc:1685] finished
0709 13:06:32.363550 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.363957 (+   407us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20420,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":18726,"spinlock_wait_cycles":46510976,"thread_start_us":37923,"threads_started":1,"wal-append.queue_time_us":159263}
I20260709 13:06:32.405967 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:32.416407 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:32.211236 20736 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.277788 20815 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:32.289747 20817 raft_consensus.cc:3055] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:32.601282 20764 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:32.598131 12617 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 18.
I20260709 13:06:32.602598 20228 raft_consensus.cc:3055] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:32.603075 20228 raft_consensus.cc:740] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:32.604162 20379 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:32.274379 20819 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:32.608402 20819 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:32.610569 20182 consensus_queue.cc:1048] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:32.225518 20825 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:32.613749 20759 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.616825 20722 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:32.273201 20828 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.620797 20722 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:32.622074 20722 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.622413 20828 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:32.623685 20856 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.624552 20856 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.273207 20835 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:32.626720 20539 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.627579 20539 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:32.279387 20839 log.cc:927] Time spent T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.599s	user 0.000s	sys 0.002s
W20260709 13:06:32.278100 20842 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.598s	user 0.000s	sys 0.003s
I20260709 13:06:32.268298 20844 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:32.279711 20845 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:32.273753 20847 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:06:32.291697 20850 raft_consensus.cc:3055] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:06:32.283344 20852 log.cc:927] Time spent T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.483s	user 0.003s	sys 0.000s
W20260709 13:06:32.280625 20854 log.cc:927] Time spent T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.576s	user 0.000s	sys 0.002s
I20260709 13:06:32.203143 20857 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.275386 20858 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:32.273190 20860 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:32.286274 20862 log.cc:927] Time spent T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.431s	user 0.000s	sys 0.002s
W20260709 13:06:32.289188 20863 log.cc:927] Time spent T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.359s	user 0.002s	sys 0.000s
W20260709 13:06:32.292606 20868 log.cc:927] Time spent T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.394s	user 0.002s	sys 0.000s
I20260709 13:06:32.777603 12547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35624 (request call id 1917) took 1735 ms. Trace:
I20260709 13:06:32.778061 12547 rpcz_store.cc:276] 0709 13:06:31.041650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.042355 (+   705us) service_pool.cc:224] Handling call
0709 13:06:31.042804 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:31.044858 (+  2054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.044909 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:31.075935 (+ 31026us) log.cc:844] Serialized 26 byte log entry
0709 13:06:31.890909 (+814974us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:31.890951 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.891030 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.285035 (+394005us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:06:32.777053 (+492018us) raft_consensus.cc:1685] finished
0709 13:06:32.777098 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.777357 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519820160,"thread_start_us":814641,"threads_started":1,"wal-append.queue_time_us":778214}
W20260709 13:06:32.289211 20871 log.cc:927] Time spent T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.385s	user 0.000s	sys 0.002s
I20260709 13:06:32.258683 20874 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.258524 20877 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.783064 20541 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:32.783802 20877 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:32.382364 11443 tablet_server.cc:179] TabletServer@127.11.44.193:0 shutting down...
I20260709 13:06:32.784588 20737 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.572589 13226 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 21.
I20260709 13:06:32.492050 20643 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.785269 20737 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.787567 20643 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:32.598758 20882 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:32.598259 20251 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.788528 20882 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:32.789180 12689 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:06:32.651607 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 235535us
I20260709 13:06:32.622794 20722 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:32.604554 20228 consensus_queue.cc:260] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:32.698655 20759 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:32.731114 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1788) took 1614 ms. Trace:
I20260709 13:06:32.742336 20848 raft_consensus.cc:2804] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 13:06:32.742364 20743 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:32.742266 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 338673us
W20260709 13:06:32.747632 13199 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.046s	sys 0.073s
W20260709 13:06:32.752050 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 309909us
W20260709 13:06:32.754411 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 309423us
I20260709 13:06:32.731127 20306 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.759336 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2824) took 1885 ms. Trace:
I20260709 13:06:32.751765 20856 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:32.752277 20550 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:32.769850 12662 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:32.747630 20876 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:32.751187 20845 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:32.843344 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 116321us
I20260709 13:06:32.843868 20877 raft_consensus.cc:2764] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election decision vote started in defunct term 25: won
I20260709 13:06:32.844513 20306 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:32.823431 13229 rpcz_store.cc:276] 0709 13:06:31.103668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.103810 (+   142us) service_pool.cc:224] Handling call
0709 13:06:31.104119 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:31.107828 (+  3709us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.107892 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:31.118285 (+ 10393us) log.cc:844] Serialized 26 byte log entry
0709 13:06:31.631334 (+513049us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:31.631457 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.631566 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.707417 (+1075851us) raft_consensus.cc:1685] finished
0709 13:06:32.711143 (+  3726us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.718132 (+  6989us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4572,"raft.queue_time_us":161428,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":13646,"thread_start_us":473132,"threads_started":1,"wal-append.queue_time_us":826064}
I20260709 13:06:32.846031 20228 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:32.774166 20857 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:32.789932 20874 raft_consensus.cc:3060] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:32.790789 20251 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:32.600775 20817 raft_consensus.cc:740] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:32.791245 20882 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:32.791582 20737 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:32.792725 20736 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:32.747507 20850 raft_consensus.cc:740] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:32.808175 20539 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:32.834818 13199 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.047s	sys 0.074s
I20260709 13:06:32.841895 20876 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.839232 13227 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 26.
I20260709 13:06:32.825510 20848 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 30 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:32.853911 12539 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.000s	sys 0.019s
W20260709 13:06:32.853875 12510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.005s	sys 0.021s
I20260709 13:06:32.919327 12689 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 18. (term mismatch)
I20260709 13:06:32.869654 20541 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:06:32.926870 12510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.006s	sys 0.021s
W20260709 13:06:32.932411 12539 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.001s	sys 0.019s
I20260709 13:06:32.934428 20798 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:32.934505 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:32.936625 20722 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:32.939333 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.924855 20848 raft_consensus.cc:3060] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:06:32.928393 12689 pending_rounds.cc:85] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 17
I20260709 13:06:32.932976 20743 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.961392 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:32.961494 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:32.954308 12689 pending_rounds.cc:107] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 25.18
I20260709 13:06:32.963071 12689 raft_consensus.cc:2889] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:32.831753 12687 rpcz_store.cc:276] 0709 13:06:30.934142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.934596 (+   454us) service_pool.cc:224] Handling call
0709 13:06:30.942588 (+  7992us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:30.969399 (+ 26811us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:06:30.980349 (+ 10950us) log.cc:844] Serialized 14 byte log entry
0709 13:06:30.986194 (+  5845us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b1800506e00. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a911923a 00007fc3a9583a2a
0709 13:06:31.518665 (+532471us) log.cc:844] Serialized 14 byte log entry
0709 13:06:31.519108 (+   443us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:31.538844 (+ 19736us) log.cc:844] Serialized 26 byte log entry
0709 13:06:31.539450 (+   606us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:06:31.539484 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.539554 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:32.277421 (+737867us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
0709 13:06:32.727951 (+450530us) raft_consensus.cc:1685] finished
0709 13:06:32.731586 (+  3635us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:32.739248 (+  7662us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68070,"prepare.queue_time_us":14493,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":2856,"raft.queue_time_us":273631,"raft.run_cpu_time_us":869,"raft.run_wall_time_us":20511,"spinlock_wait_cycles":927946752,"thread_start_us":498485,"threads_started":2,"wal-append.queue_time_us":698994}
I20260709 13:06:32.947594 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:32.962826 12622 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:06:32.964085 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:32.972306 20864 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.972486 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:32.945197 20539 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.974713 12691 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:32.974861 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:32.944970 20857 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.976866 20866 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.987517 20866 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.988265 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:32.988713 13230 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 25. Current term is 26. Ops: []
I20260709 13:06:32.989789 20760 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.990118 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:32.990429 20892 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:06:32.990550 20760 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.991430 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:32.992194 13229 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
I20260709 13:06:32.992496 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:32.993211 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:32.994262 12687 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:06:32.995327 20891 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.996260 20891 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:32.996665 20853 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:32.997357 20853 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.997856 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:32.998553 12692 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 23.
W20260709 13:06:32.999712 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.999864 20853 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:32.991439 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.000993 12659 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:33.005841 20864 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:32.972508 20757 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.171s
I20260709 13:06:33.008483 20864 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:33.009053 20857 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:33.011452 20857 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:33.012025 20857 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:06:33.014019 20528 consensus_meta.cc:287] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.213s	user 0.013s	sys 0.015s
I20260709 13:06:33.014792 20306 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:33.014515 20528 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:32.997908 12617 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 26: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:32.976941 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:33.037667 12620 raft_consensus.cc:2368] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 25. Current term is 26.
I20260709 13:06:33.040697 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2830) took 1139 ms. Trace:
W20260709 13:06:33.041483 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 79500.2us
I20260709 13:06:33.041272 12689 rpcz_store.cc:276] 0709 13:06:31.901324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.903275 (+  1951us) service_pool.cc:224] Handling call
0709 13:06:31.903550 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:32.788582 (+885032us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b58003dfad0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a94d50aa 00007fc3a9557447 00007fc3a956ffe7 00007fc3a95717de 00007fc3a957bb49 00007fc3a957c416 00007fc3a9578d8f 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4
0709 13:06:33.028991 (+240409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.040613 (+ 11622us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1090251648}
I20260709 13:06:32.977783 20882 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:32.952293 20722 consensus_queue.cc:1048] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
I20260709 13:06:33.005323 20743 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.050401 12688 raft_consensus.cc:2368] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 21. Current term is 22.
I20260709 13:06:33.039726 20720 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:33.067113 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 20 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.093401 12691 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 26.
I20260709 13:06:33.100373 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:33.059890 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 99033.2us
I20260709 13:06:33.102205 13229 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:33.050068 20757 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.115507 20774 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:32.979249 20817 consensus_queue.cc:260] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.117357 20817 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:06:33.094883 20892 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:06:33.111747 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 70005.1us
I20260709 13:06:33.113855 12539 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2487) took 1219 ms. Trace:
I20260709 13:06:33.114341 20882 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.129146 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.129207 20882 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.130532 20891 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:33.131783 12620 raft_consensus.cc:1217] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 26 LEADER]: Deduplicated request from leader. Original: 22.16->[24.17-25.18]   Dedup: 24.17->[25.18-25.18]
I20260709 13:06:33.047571 20539 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:33.100744 20798 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.125074 20720 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.086345 20760 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.114823 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.000761 20541 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.132670 12620 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 26 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 25. Current term is 26. Ops: [24.17-25.18]
I20260709 13:06:33.049417 20864 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:33.064983 20797 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.152s	user 0.010s	sys 0.012s
W20260709 13:06:33.142935 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 172216us
I20260709 13:06:33.067216 20306 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.113967 20711 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:06:33.113879 20527 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 26 current term: 26 is higher.
W20260709 13:06:33.167918 20581 consensus_meta.cc:287] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.975s	user 0.008s	sys 0.018s
I20260709 13:06:33.115924 20757 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.171741 12587 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:33.167030 20797 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.449s	user 0.012s	sys 0.019s
I20260709 13:06:33.172001 13228 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 23.
W20260709 13:06:33.175791 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 51889.3us
I20260709 13:06:33.116381 20774 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:33.165696 20853 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.167595 20711 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:33.183805 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.185484 20864 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.186002 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:33.186507 20608 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:33.188421 20899 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:33.167963 20894 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:33.189620 20733 consensus_meta.cc:287] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.660s	user 0.013s	sys 0.007s
I20260709 13:06:33.133553 20798 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.192668 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.222232 12621 raft_consensus.cc:1240] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 18. Current term is 19. Ops: [18.11-18.11]
W20260709 13:06:33.193420 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 59104.6us
I20260709 13:06:33.195570 12620 raft_consensus.cc:2368] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 25. Current term is 26.
I20260709 13:06:33.174679 20875 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:33.192049 20711 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:33.177842 20797 raft_consensus.cc:697] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 25 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:33.210958 12617 raft_consensus.cc:1240] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:33.231465 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:33.173166 20581 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:33.241014 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:33.243731 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:33.212661 20895 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:06:33.244508 13229 raft_consensus.cc:2393] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 23: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:33.227293 20450 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.249023 20903 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 13:06:33.249948 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:33.244900 20819 consensus_meta.cc:287] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.636s	user 0.014s	sys 0.000s
I20260709 13:06:33.251114 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:33.258038 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:33.254881 12587 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:33.261394 20875 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:33.261443 12538 raft_consensus.cc:1240] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:33.263845 20875 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:33.264869 20774 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:33.264595 20819 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.265617 20539 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:33.265756 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 47939.5us
I20260709 13:06:33.268793 20539 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:33.269423 12545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2481) took 1379 ms. Trace:
I20260709 13:06:33.269482 20539 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:33.270170 20539 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:33.270004 12545 rpcz_store.cc:276] 0709 13:06:31.890174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.892277 (+  2103us) service_pool.cc:224] Handling call
0709 13:06:31.899297 (+  7020us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:32.401614 (+502317us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b18004e6d00. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a91214bc 00007fc3a646f48b 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a6489455 00007fc3a9571060 00007fc3a9571bfb 00007fc3a957c64b
0709 13:06:32.402274 (+   660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.402310 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:32.403159 (+   849us) log.cc:844] Serialized 26 byte log entry
0709 13:06:32.707048 (+303889us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:32.707098 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.716039 (+  8941us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:33.268981 (+552942us) raft_consensus.cc:1685] finished
0709 13:06:33.269001 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.269256 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17831,"raft.queue_time_us":83411,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":40914,"spinlock_wait_cycles":52687616,"thread_start_us":431711,"threads_started":2,"wal-append.queue_time_us":763867}
W20260709 13:06:33.272500 20910 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:06:33.274636 12544 raft_consensus.cc:2393] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 20: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:33.272114 12588 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:33.275635 20541 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.275794 12544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42446 (request call id 2485) took 1384 ms. Trace:
I20260709 13:06:33.275511 20798 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.276304 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2828) took 1375 ms. Trace:
I20260709 13:06:33.268846 12688 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37292 (request call id 2835) took 1093 ms. Trace:
I20260709 13:06:33.276418 12544 rpcz_store.cc:276] 0709 13:06:31.891320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.892336 (+  1016us) service_pool.cc:224] Handling call
0709 13:06:32.411357 (+519021us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b5800000c98. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae53f0a0 00007fc3ae53e984 00007fc3a7ab96d4 00007fc3a7ab9662
0709 13:06:33.275578 (+864221us) spinlock_profiling.cc:243] Waited 777 ms on lock 0x7b54003a9154. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:33.275704 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1793026688}
I20260709 13:06:33.272691 12662 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:33.228344 20853 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.280835 12688 rpcz_store.cc:276] 0709 13:06:32.175883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.367301 (+191418us) service_pool.cc:224] Handling call
0709 13:06:33.268632 (+901331us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b54001b5b54. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:33.268785 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1336589184}
I20260709 13:06:33.228475 20733 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:33.233080 20306 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.252365 20895 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 27 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:33.254482 20528 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.277125 20875 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:06:33.291231 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.327896 20875 raft_consensus.cc:697] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 21 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:06:33.291342 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 52497us
I20260709 13:06:33.292732 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:33.267099 20819 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.294076 20643 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:33.276758 12690 rpcz_store.cc:276] 0709 13:06:31.900761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.903110 (+  2349us) service_pool.cc:224] Handling call
0709 13:06:31.907144 (+  4034us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:32.140448 (+233304us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b48001b0258. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3ae4a2aa1 00007fc3ae499b37 00007fc3ae4999ca 00007fc3ae59126f 00007fc3ae590f37 00007fc3ae5a555c 00007fc3ae5a5508 00007fc3ae5a5488 00007fc3ae5a5443 00007fc3ae5a46ec 00007fc3ad4cea96
0709 13:06:32.369617 (+229169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:32.369685 (+    68us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:32.370818 (+  1133us) log.cc:844] Serialized 26 byte log entry
0709 13:06:32.702169 (+331351us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:06:32.702221 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:32.710518 (+  8297us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:33.275788 (+565270us) raft_consensus.cc:1685] finished
0709 13:06:33.275808 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.276126 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25741,"raft.queue_time_us":59071,"raft.run_cpu_time_us":2255,"raft.run_wall_time_us":172571,"spinlock_wait_cycles":33983360,"thread_start_us":766759,"threads_started":2,"wal-append.queue_time_us":855658}
I20260709 13:06:33.263860 20876 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.246460 20894 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:33.298138 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:33.298710 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:33.327052 13199 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:33.299012 20874 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:33.257694 20608 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.298724 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:33.298170 20306 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.235633 20899 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.301810 20895 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:06:33.303259 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.308590 13197 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:33.309947 20615 consensus_queue.cc:1048] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:33.309974 20866 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.311584 13233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57404 (request call id 1464) took 1122 ms. Trace:
I20260709 13:06:33.313491 20758 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:33.315307 20848 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 31 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.123087 12539 rpcz_store.cc:276] 0709 13:06:31.891919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.892430 (+   511us) service_pool.cc:224] Handling call
0709 13:06:31.892759 (+   329us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:06:31.906397 (+ 13638us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:31.906455 (+    58us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:06:31.916152 (+  9697us) log.cc:844] Serialized 78 byte log entry
0709 13:06:32.933364 (+1017212us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:06:33.028384 (+ 95020us) log.cc:844] Serialized 14 byte log entry
0709 13:06:33.094720 (+ 66336us) log.cc:844] Serialized 14 byte log entry
0709 13:06:33.101520 (+  6800us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.110659 (+  9139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:33.110724 (+    65us) raft_consensus.cc:1685] finished
0709 13:06:33.110736 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.110929 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52950,"raft.queue_time_us":60795,"raft.run_cpu_time_us":619,"raft.run_wall_time_us":78713,"thread_start_us":950981,"threads_started":2,"wal-append.queue_time_us":995628}
I20260709 13:06:33.346206 12622 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
W20260709 13:06:33.318964 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 66804.6us
I20260709 13:06:33.319620 20581 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:33.322067 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.322497 20451 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.325532 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:33.293224 20450 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:33.330544 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.329057 20875 consensus_queue.cc:237] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.332046 12694 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:06:33.334168 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:33.334168 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.300289 20846 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:06:33.334338 12692 raft_consensus.cc:2468] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
I20260709 13:06:33.337316 12696 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19. Ops: []
I20260709 13:06:33.290071 20757 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.340288 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.338238 20743 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:33.329077 20864 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.345908 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.331259 20643 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.347038 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:33.349479 12587 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372
W20260709 13:06:33.355206 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 46720.5us
I20260709 13:06:33.353076 12687 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 26.
I20260709 13:06:33.355609 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.358316 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:33.363088 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:33.366251 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:33.363641 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.350762 20903 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:33.366449 12690 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 19.
I20260709 13:06:33.370509 12617 raft_consensus.cc:2410] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 22 because replica has last-logged OpId of term: 21 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:06:33.341442 20579 consensus_queue.cc:1048] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:06:33.372349 20838 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:33.372133 20451 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.373394 20864 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:06:33.374029 20864 raft_consensus.cc:697] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 26 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:33.374583 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.364462 20743 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.374779 20451 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:33.375190 20743 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:33.375229 13235 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 26.
I20260709 13:06:33.375797 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:33.342454 13233 rpcz_store.cc:276] 0709 13:06:32.188690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.188863 (+   173us) service_pool.cc:224] Handling call
0709 13:06:32.202212 (+ 13349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:32.202624 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:06:32.714471 (+511847us) log.cc:844] Serialized 14 byte log entry
0709 13:06:33.038473 (+324002us) log.cc:844] Serialized 14 byte log entry
0709 13:06:33.304492 (+266019us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b180046b700. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a6406c0a 00007fc3afb46219 00007fc3ad44d58f 00007fc3a648c571 00007fc3a648e7c1 00007fc3a648e779 00007fc3a648e709 00007fc3a648e6d1 00007fc3a648d9cd
0709 13:06:33.305583 (+  1091us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:33.306226 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 13:06:33.306401 (+   175us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:06:33.306447 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.306624 (+   177us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:33.311186 (+  4562us) raft_consensus.cc:1685] finished
0709 13:06:33.311205 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:33.311363 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":304578,"prepare.queue_time_us":406102,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":113,"raft.queue_time_us":307667,"raft.run_cpu_time_us":385,"raft.run_wall_time_us":7589,"spinlock_wait_cycles":7930752,"thread_start_us":526529,"threads_started":2,"wal-append.queue_time_us":363880}
I20260709 13:06:33.377135 13231 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:06:33.359766 20896 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:33.376710 13234 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
I20260709 13:06:33.385685 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:33.386562 12694 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:33.392553 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:33.367635 20643 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:33.358090 20306 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:33.372819 20838 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.397723 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:33.398797 12690 raft_consensus.cc:2368] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 25. Current term is 26.
I20260709 13:06:33.381639 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:33.335465 20797 consensus_queue.cc:237] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:33.404172 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 105572us
I20260709 13:06:33.405186 13197 leader_election.cc:400] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 25. Current term is 26.
I20260709 13:06:33.406240 13197 leader_election.cc:403] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 13:06:33.409160 12689 raft_consensus.cc:2393] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 26: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:33.403106 20903 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 13:06:33.414307 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:33.416357 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:33.416878 12587 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:33.401036 20838 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:06:33.423720 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 46608.3us
I20260709 13:06:33.396796 20581 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:33.421891 13199 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:33.431311 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:33.432801 20468 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:06:33.433358 20893 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.010s
I20260709 13:06:33.433779 20468 raft_consensus.cc:697] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 26 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:33.434994 20468 consensus_queue.cc:237] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.435635 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:33.437716 20843 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:33.438159 20846 consensus_queue.cc:1048] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:33.437770 20844 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:33.446504 20850 consensus_queue.cc:260] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.450985 12688 raft_consensus.cc:1240] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:33.431363 20798 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.454623 20850 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:33.465030 20733 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:33.454331 20798 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.467723 20798 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.468696 20848 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 31 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.471504 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:33.471568 12620 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 13:06:33.375154 20864 consensus_queue.cc:237] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.458493 13199 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:33.459167 20896 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:33.460772 12587 leader_election.cc:400] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 21. Current term is 22.
I20260709 13:06:33.463709 20581 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.457497 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:33.474063 12691 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:06:33.476840 12694 raft_consensus.cc:2468] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 23.
I20260709 13:06:33.478368 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:33.493093 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:33.494527 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:33.498914 13199 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:33.461166 20711 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.496904 20894 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:33.484428 20527 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:33.522616 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:33.502697 20853 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:33.513629 12588 connection.cc:256] RPC call timeout handler was delayed by -1.114459021000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1705s for a response
I20260709 13:06:33.523061 12615 raft_consensus.cc:2468] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 21.
I20260709 13:06:33.493963 20306 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:33.525223 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 64605.5us
I20260709 13:06:33.517972 20615 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:33.544449 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:33.545439 13199 leader_election.cc:400] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 25. Current term is 26.
I20260709 13:06:33.550300 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 20 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:33.550356 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.554833 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:33.555225 13199 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:33.555662 12691 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:06:33.523427 20874 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:33.548631 20615 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.576050 20615 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:33.577276 20450 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:33.577637 20849 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:33.578166 20849 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.578547 20849 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:33.581820 20608 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.550976 20527 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.588205 20527 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.591847 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:33.595108 20306 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.573969 20451 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:06:33.592083 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:33.571787 12616 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
I20260709 13:06:33.601727 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:33.556821 20894 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.603813 13199 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:33.565201 20899 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.616779 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:33.622114 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.622359 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.622922 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.625835 13199 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:33.632445 12587 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:33.632962 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.633203 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:33.634197 12616 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 23.
W20260709 13:06:33.634969 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.639338 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:33.640010 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:33.640223 12691 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 24.
I20260709 13:06:33.642405 12696 raft_consensus.cc:1240] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 22. Current term is 23. Ops: [22.14-22.14]
W20260709 13:06:33.651229 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.661314 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.652331 12587 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:33.636366 20901 raft_consensus.cc:2804] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:33.702477 20901 raft_consensus.cc:697] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:33.703507 20901 consensus_queue.cc:237] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.654160 20875 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:33.632717 20539 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.673664 20838 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:33.676396 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.676440 20798 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:33.676384 20913 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.387s	user 0.003s	sys 0.000s
I20260709 13:06:33.655128 20874 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:33.682410 20881 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:33.686364 20468 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:33.687335 20720 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.627737 20894 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:33.692973 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.790741 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.694139 12538 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42446 (request call id 2489) took 1798 ms. Trace:
I20260709 13:06:33.695185 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:33.699892 20711 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.704882 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:33.740546 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:33.724241 20608 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:33.793550 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:33.794798 20591 consensus_queue.cc:1059] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.076s
W20260709 13:06:33.795708 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 56140.8us
I20260709 13:06:33.714160 20875 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.797188 12689 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:06:33.743001 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:33.802857 13233 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 22.
W20260709 13:06:33.805953 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 64479.3us
I20260709 13:06:33.796819 12538 rpcz_store.cc:276] 0709 13:06:31.895672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.896312 (+   640us) service_pool.cc:224] Handling call
0709 13:06:31.896575 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:33.263679 (+1367104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.693859 (+430180us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400229554. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:33.694086 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3129086848}
I20260709 13:06:33.812942 13228 raft_consensus.cc:2393] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 20: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:33.817427 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.809959 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:33.730146 20843 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 25. Current term is 26.
I20260709 13:06:33.797873 20468 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:33.832942 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.808317 20451 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:33.812935 20893 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.838060 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.837996 12616 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
I20260709 13:06:33.840147 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.738202 20895 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.841419 12512 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:33.838361 20468 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:33.792785 20849 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.730906 20643 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:33.820379 20875 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:33.856298 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.829577 20579 raft_consensus.cc:3055] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:33.877619 20579 raft_consensus.cc:740] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:33.879087 13231 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 20: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:33.878971 20579 consensus_queue.cc:260] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.882037 12659 leader_election.cc:400] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for earlier term 25. Current term is 26.
I20260709 13:06:33.857923 20608 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:33.884276 12659 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:33.884541 20608 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:33.885739 20581 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.886515 12513 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:33.888320 20894 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:33.890370 20849 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:33.892998 20527 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:33.894917 12659 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:33.886744 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:33.922739 12616 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:33.923720 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:33.923905 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:33.924436 12616 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:06:33.895087 20539 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.925357 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:33.814193 20874 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.927819 20874 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.928777 20539 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:33.930321 12659 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:33.932746 20539 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:33.880699 20579 raft_consensus.cc:3060] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:33.934710 12659 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:33.935957 12618 raft_consensus.cc:2393] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 26: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:33.936961 20643 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:33.897363 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 338560us
I20260709 13:06:33.839552 20848 raft_consensus.cc:2804] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:33.938058 20848 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:33.938472 20848 raft_consensus.cc:3060] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:33.938797 20591 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.939342 20591 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:33.901674 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 60331.8us
I20260709 13:06:33.942194 20550 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:33.902441 20758 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:33.904708 12513 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:33.905364 20581 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:33.942770 20550 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:33.791711 20881 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.906577 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:33.944486 12622 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:33.906724 12620 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 28 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 27. Current term is 28. Ops: []
I20260709 13:06:33.873386 20893 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:33.908695 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:33.909317 13234 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 26.
I20260709 13:06:33.916958 12662 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:33.920042 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:33.791947 20798 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.930811 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:33.923745 20615 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:33.897406 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:33.957415 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 52798.8us
I20260709 13:06:33.907909 20895 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 28 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:33.956211 13233 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:33.897361 20838 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:33.997233 12588 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.44.193:43307 timed out after 1.705s (SENT) [suppressed 12 similar messages]
I20260709 13:06:34.010881 12621 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:34.009805 20722 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:34.030957 20722 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.031395 20722 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:34.004911 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:33.997097 20797 consensus_queue.cc:1059] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:06:33.943436 20581 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.943928 20758 raft_consensus.cc:697] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 19 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:34.008759 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:33.999455 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 82585.6us
I20260709 13:06:34.017086 20539 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:34.018867 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:34.006843 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 52329.2us
I20260709 13:06:34.024147 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:34.015172 20615 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:34.015508 13226 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 26. Current term is 27. Ops: [26.18-26.18]
W20260709 13:06:34.007071 20932 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:06:34.008405 12513 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:34.034693 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:34.034929 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:34.040390 12696 raft_consensus.cc:1240] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:34.066507 12616 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
W20260709 13:06:34.071210 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 354341us
I20260709 13:06:34.041081 12622 raft_consensus.cc:2468] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:06:34.047552 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:34.095599 12688 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:34.096474 13197 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:34.098922 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:34.011976 20893 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:34.106778 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:34.051290 20743 consensus_meta.cc:287] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.647s	user 0.009s	sys 0.000s
I20260709 13:06:34.107844 13228 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:34.108601 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:34.047273 20881 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:34.042027 20758 consensus_queue.cc:237] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:34.111266 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 54807us
W20260709 13:06:34.115027 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 155813us
I20260709 13:06:34.124836 12616 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 19: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:34.117097 20615 raft_consensus.cc:2804] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:34.034246 20797 raft_consensus.cc:3055] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:06:34.119655 20876 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:34.120298 20895 consensus_queue.cc:1059] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:34.106954 12662 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:34.010449 20798 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:34.125944 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:34.125463 12659 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:34.106339 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:34.128119 12659 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:34.051779 20608 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:34.068195 20757 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.035358 20581 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:34.067979 20539 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.140822 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:34.150888 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:34.152695 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 45842.4us
I20260709 13:06:34.042237 20722 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:34.156298 20615 raft_consensus.cc:697] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:34.157173 20875 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:34.157296 20615 consensus_queue.cc:237] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:34.158505 20539 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:34.158789 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:34.159561 12696 raft_consensus.cc:2393] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 19: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:34.160442 20895 consensus_queue.cc:1048] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:34.152298 20856 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:34.152566 12693 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 26.
I20260709 13:06:34.163698 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:34.160701 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:34.161744 20856 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:34.035125 20591 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:34.208822 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:34.156299 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:34.126853 20797 raft_consensus.cc:740] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:06:34.212827 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.213290 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:34.214092 12619 raft_consensus.cc:2393] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 20: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:06:34.163164 20932 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:06:34.234938 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:34.127090 20876 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.153554 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:34.140782 20733 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:34.208148 20527 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:34.235793 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:34.057420 20468 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:34.148028 20608 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.279469 20608 raft_consensus.cc:3060] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:34.280720 20468 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:34.240793 12692 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 19.
I20260709 13:06:34.285794 20853 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:34.286407 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 31 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:34.286513 20853 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:34.287724 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:34.234125 20856 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:34.297463 12688 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:06:34.264669 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:34.158526 20550 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:34.299508 12695 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.005s	sys 0.013s
W20260709 13:06:34.303236 12695 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.005s	sys 0.013s
I20260709 13:06:34.159569 20875 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:34.238930 20899 raft_consensus.cc:3055] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:34.262558 20876 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:34.276561 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:34.276654 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:34.310452 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:34.212796 20845 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 27.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.065s
W20260709 13:06:34.277649 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 121462us
I20260709 13:06:34.267118 20591 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:34.242136 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:34.312379 12618 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:34.290694 12621 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:34.292402 13233 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
I20260709 13:06:34.033541 20848 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:34.299497 12689 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 17.
I20260709 13:06:34.210644 12693 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 22.
I20260709 13:06:34.305783 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:34.134479 20743 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:34.275715 20733 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.235049 20757 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:34.317196 12688 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 26.
W20260709 13:06:34.299654 20901 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.004s	sys 0.015s
I20260709 13:06:34.322670 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:34.327329 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:34.328173 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:34.329164 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:34.308682 20722 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:34.330420 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:34.330560 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 20 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:34.331060 12616 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:06:34.331633 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:34.331818 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:34.332361 12693 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:34.335709 20853 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:34.335780 20608 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:34.308137 20899 raft_consensus.cc:740] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:34.337764 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:34.338033 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:34.338764 12614 raft_consensus.cc:2393] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 20: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:34.338352 20899 consensus_queue.cc:260] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:34.339655 20899 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:34.342660 20527 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:34.343123 20527 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.343461 20527 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:34.331163 12587 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:34.347637 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:34.353348 12690 raft_consensus.cc:2393] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 20: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:34.354257 20882 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:34.354717 20882 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:34.355095 20882 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:34.357009 12618 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
I20260709 13:06:34.321091 20733 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:34.363703 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:34.359225 12615 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 20: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:34.360659 13227 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
W20260709 13:06:34.326233 20901 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.004s	sys 0.016s
I20260709 13:06:34.362298 12692 raft_consensus.cc:1240] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 21. Current term is 22. Ops: []
W20260709 13:06:34.368324 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 48685.9us
I20260709 13:06:34.362612 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:34.370579 12696 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:34.332865 20843 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.373908 12692 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 13:06:34.396090 12588 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:34.410912 12616 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
I20260709 13:06:34.379284 20895 consensus_queue.cc:1059] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 13:06:34.400434 20711 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.013s
I20260709 13:06:34.425100 12588 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:34.426925 12617 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:34.428944 12588 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:06:34.420760 12687 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.013s	sys 0.007s
I20260709 13:06:34.378799 20843 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:34.434278 12687 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.014s	sys 0.008s
I20260709 13:06:34.365885 20797 consensus_queue.cc:260] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:34.418951 20579 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:34.446916 20876 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:34.448004 20579 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:34.452092 20882 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:34.452497 20539 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:34.454144 20608 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:34.454394 20856 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:34.461875 20902 raft_consensus.cc:3055] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:06:34.464341 20468 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:06:34.427557 20893 raft_consensus.cc:3055] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:34.471046 13197 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:34.475942 13228 raft_consensus.cc:2468] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22.
I20260709 13:06:34.520258 12693 raft_consensus.cc:2468] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 26.
I20260709 13:06:34.495244 12694 raft_consensus.cc:1240] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:06:34.484573 12622 raft_consensus.cc:1240] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18. Ops: []
I20260709 13:06:34.504383 13199 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:34.494180 12688 raft_consensus.cc:2393] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 25: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:34.493552 12690 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:46988 (request call id 2038) took 1147 ms. Trace:
I20260709 13:06:34.443164 20853 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:34.526360 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 55407.5us
I20260709 13:06:34.521283 12659 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:34.481112 20923 log.cc:927] Time spent T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:06:34.522022 12690 rpcz_store.cc:276] 0709 13:06:33.346132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.423937 (+ 77805us) service_pool.cc:224] Handling call
0709 13:06:34.493239 (+1069302us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b54002c9054. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:34.493441 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2118114688}
W20260709 13:06:34.602015 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 80826.7us
W20260709 13:06:34.584843 20930 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.349s	user 0.000s	sys 0.001s
I20260709 13:06:34.480918 20902 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:34.483693 20876 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:34.488395 20882 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:34.519994 20893 raft_consensus.cc:740] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:34.494055 20757 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:34.498003 20743 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:34.519737 20722 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.573872 20849 raft_consensus.cc:2804] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:34.495375 20539 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:34.605834 20737 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:06:34.623495 12695 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 25. Current term is 26. Ops: []
I20260709 13:06:34.604070 20608 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:06:34.656565 20527 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:34.658066 12695 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:06:34.659490 12691 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2854) took 1117 ms. Trace:
W20260709 13:06:34.659953 13235 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.001s	sys 0.048s
W20260709 13:06:34.666728 13235 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.001s	sys 0.048s
I20260709 13:06:34.665668 12691 rpcz_store.cc:276] 0709 13:06:33.544452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.641069 (+ 96617us) service_pool.cc:224] Handling call
0709 13:06:33.641473 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:33.644347 (+  2874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.644388 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:33.662785 (+ 18397us) log.cc:844] Serialized 26 byte log entry
0709 13:06:34.090938 (+428153us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b1800507ee0. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3af354de1 00007fc3af3615b1 00007fc3a646ee07 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a648bc02 00007fc3a911320b 00007fc3a9118d23 00007fc3a91190d1 00007fc3a9534a0f
0709 13:06:34.305978 (+215040us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:34.306031 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.306119 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:34.659179 (+353060us) raft_consensus.cc:1685] finished
0709 13:06:34.659201 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.659425 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2430,"raft.queue_time_us":2534,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":15380,"spinlock_wait_cycles":73660032,"thread_start_us":214801,"threads_started":1,"wal-append.queue_time_us":935643}
I20260709 13:06:34.612901 20581 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:34.648016 20849 raft_consensus.cc:697] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
W20260709 13:06:34.676406 12613 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.004s	sys 0.016s
W20260709 13:06:34.676908 12613 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.004s	sys 0.016s
I20260709 13:06:34.674005 20539 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:34.623596 20722 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:34.627353 20853 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:34.622993 20902 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 27.20, Last appended by leader: 20, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:34.703497 20937 log.cc:927] Time spent T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 13:06:34.668962 20893 consensus_queue.cc:260] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:34.726414 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 310952us
W20260709 13:06:34.725098 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 322257us
W20260709 13:06:34.675354 12513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.011s	sys 0.032s
W20260709 13:06:34.743331 12513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.011s	sys 0.033s
W20260709 13:06:34.743932 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 735545us
I20260709 13:06:34.739529 20539 raft_consensus.cc:697] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:06:34.758248 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 604717us
I20260709 13:06:34.759320 12662 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:34.713819 20843 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:34.762737 12513 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 31 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:34.779243 12513 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:34.790395 12587 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:34.786372 12512 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:34.763453 20856 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:34.773397 20882 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
W20260709 13:06:34.803619 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 201359us
W20260709 13:06:34.817215 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 57960.8us
I20260709 13:06:34.789331 20893 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:34.818879 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:34.819132 12662 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:34.822284 12662 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:34.822445 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 219504us
I20260709 13:06:34.721771 20849 consensus_queue.cc:237] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:34.829741 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 434996us
I20260709 13:06:34.846328 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:34.822584 20856 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:34.837817 12659 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:34.862092 20737 consensus_queue.cc:1059] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:06:34.893276 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 464388us
I20260709 13:06:34.810277 20882 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:34.866160 20939 log.cc:927] Time spent T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:06:34.866685 20874 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:06:34.867319 20938 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
W20260709 13:06:34.870966 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.872049 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2852) took 1330 ms. Trace:
I20260709 13:06:34.812846 20539 consensus_queue.cc:237] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:34.885975 20581 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:34.895071 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.854908 20579 raft_consensus.cc:2804] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:06:34.835322 20946 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:34.905202 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:34.864626 12696 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:06:34.884199 20848 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:34.909866 12694 rpcz_store.cc:276] 0709 13:06:33.541372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.605995 (+ 64623us) service_pool.cc:224] Handling call
0709 13:06:34.495023 (+889028us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:34.520850 (+ 25827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.871846 (+350996us) spinlock_profiling.cc:243] Waited 870 ms on lock 0x7b54002c9050. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a95788ad 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:34.871994 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2000940288}
I20260709 13:06:34.824976 20733 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:34.858736 20527 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:34.897149 20856 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:34.919790 20901 raft_consensus.cc:3055] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:34.928519 12587 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:34.907692 20940 log.cc:927] Time spent T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.191s	user 0.002s	sys 0.000s
I20260709 13:06:34.933945 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:34.923887 20948 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:34.919953 20550 consensus_queue.cc:1059] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.025s
I20260709 13:06:34.935388 20579 raft_consensus.cc:697] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 26 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:34.939721 20856 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:34.960598 20874 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:06:34.977521 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 119590us
W20260709 13:06:34.978127 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 131887us
I20260709 13:06:34.940359 20853 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:34.940128 20901 raft_consensus.cc:740] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:34.977242 20948 raft_consensus.cc:697] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:06:34.983553 12443 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50014 (request call id 227) took 53158 ms (client timeout 15000 ms). Trace:
I20260709 13:06:34.972911 20722 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:34.984650 12687 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2862) took 1277 ms. Trace:
I20260709 13:06:35.021153 12687 rpcz_store.cc:276] 0709 13:06:33.707640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.904098 (+196458us) service_pool.cc:224] Handling call
0709 13:06:33.904405 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:33.904610 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.904638 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:33.905090 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 13:06:34.435957 (+530867us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:06:34.435998 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.436070 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:34.984352 (+548282us) raft_consensus.cc:1685] finished
0709 13:06:34.984383 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.984579 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":530459,"threads_started":1,"wal-append.queue_time_us":780191}
I20260709 13:06:34.996011 20961 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:34.999820 20848 raft_consensus.cc:2804] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:35.001657 20733 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:34.975293 20527 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:35.018945 12613 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4427) took 1332 ms. Trace:
W20260709 13:06:35.024360 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 128745us
W20260709 13:06:35.030220 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 244073us
I20260709 13:06:35.041477 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 20 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:35.042567 13228 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:06:35.043869 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 261304us
I20260709 13:06:35.046967 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:35.047995 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:35.048864 13227 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 26.
I20260709 13:06:35.050168 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:35.050221 12662 connection.cc:256] RPC call timeout handler was delayed by -1.0950464140000804s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20120000000000002s for a response
I20260709 13:06:35.054304 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:35.056687 12662 connection.cc:256] RPC call timeout handler was delayed by -1.0773759380000456s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
W20260709 13:06:35.057054 12662 connection.cc:256] RPC call timeout handler was delayed by -1.0308366010000327s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27440000000000003s for a response
W20260709 13:06:35.057488 12662 connection.cc:256] RPC call timeout handler was delayed by -1.0262370410000585s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
I20260709 13:06:35.062358 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:35.068676 20798 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.069485 20798 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:35.071440 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:35.072458 13232 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:35.072854 20798 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:35.080935 12513 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:35.113490 12513 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:35.123106 13228 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
W20260709 13:06:35.125077 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 287328us
I20260709 13:06:35.026820 12613 rpcz_store.cc:276] 0709 13:06:33.686936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.688059 (+  1123us) service_pool.cc:224] Handling call
0709 13:06:33.917395 (+229336us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b58001f4198. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454eee 0000000000375939 00007fc3ae4c81e0 00007fc3ae5910c4 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:06:33.917643 (+   248us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:33.918131 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.918162 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:33.918749 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 13:06:34.677389 (+758640us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:34.677446 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.677544 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:35.009805 (+332261us) raft_consensus.cc:1685] finished
0709 13:06:35.009837 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:35.018870 (+  9033us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6218,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"spinlock_wait_cycles":34887552,"thread_start_us":758203,"threads_started":1,"wal-append.queue_time_us":759212}
W20260709 13:06:35.036834 20943 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.003s	sys 0.029s
I20260709 13:06:35.129287 20843 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:35.131253 13232 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 27.
W20260709 13:06:35.131497 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.139951 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:35.010828 20955 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 31 FOLLOWER]: Leader election lost for term 31. Reason: could not achieve majority
I20260709 13:06:35.025646 20848 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:35.148113 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:35.143775 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:35.144440 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:06:35.135891 20943 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.003s	sys 0.030s
I20260709 13:06:35.150323 12618 raft_consensus.cc:2393] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 25: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:35.155884 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:35.034907 20961 raft_consensus.cc:697] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 24 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:35.156033 13228 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 13:06:35.118552 20838 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:35.156832 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:35.157054 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:35.117203 20957 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:35.156524 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:35.141490 20527 raft_consensus.cc:697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:35.154645 20848 raft_consensus.cc:3060] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:35.191494 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:35.185824 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:35.154990 20843 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:35.192821 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:35.187469 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 235941us
I20260709 13:06:35.193274 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:35.193244 13228 raft_consensus.cc:1240] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:35.196447 12622 raft_consensus.cc:2410] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 25 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 13:06:35.192550 13232 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 18.
I20260709 13:06:35.192230 12615 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:35.200348 12619 raft_consensus.cc:2393] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 25: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:06:35.187593 20947 log.cc:927] Time spent T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
W20260709 13:06:35.204668 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 146428us
I20260709 13:06:35.205084 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:35.205389 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.187016 20955 raft_consensus.cc:2804] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:35.210222 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:35.211298 12614 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 20: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
W20260709 13:06:35.214268 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 80544.4us
I20260709 13:06:35.216675 12513 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:35.187858 20964 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:35.184736 20838 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:35.156695 20579 consensus_queue.cc:237] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:35.203750 20972 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.209594 20955 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:06:35.018769 12443 rpcz_store.cc:269] 0709 13:05:41.774033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.777765 (+  3732us) service_pool.cc:224] Handling call
0709 13:06:34.927160 (+53149395us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:31.899266 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:32.205879 (+306613us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:32.213689 (+  7810us) write_op.cc:435] Acquired schema lock
0709 13:06:32.213717 (+    28us) tablet.cc:662] Decoding operations
0709 13:06:32.214279 (+   562us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:32.216555 (+  2276us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:32.216621 (+    66us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:06:32.217117 (+   496us) tablet.cc:701] Row locks acquired
0709 13:06:32.217161 (+    44us) write_op.cc:260] PREPARE: finished
0709 13:06:32.217334 (+   173us) write_op.cc:270] Start()
0709 13:06:32.217487 (+   153us) write_op.cc:276] Timestamp: P: 1783602392217269 usec, L: 0
0709 13:06:32.217527 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:06:32.218247 (+   720us) log.cc:844] Serialized 982 byte log entry
0709 13:06:33.284135 (+1065888us) op_driver.cc:464] REPLICATION: finished
0709 13:06:33.527836 (+243701us) write_op.cc:301] APPLY: starting
0709 13:06:33.536743 (+  8907us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:33.594167 (+ 57424us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:33.594282 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:33.595593 (+  1311us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:33.595933 (+   340us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:06:33.595994 (+    61us) write_op.cc:312] APPLY: finished
0709 13:06:33.596327 (+   333us) log.cc:844] Serialized 33 byte log entry
0709 13:06:33.596537 (+   210us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:33.596678 (+   141us) write_op.cc:454] Released schema lock
0709 13:06:33.596734 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:33.597339 (+   605us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:33.597381 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3088447,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":219482,"apply.run_cpu_time_us":5950,"apply.run_wall_time_us":72212,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12491,"num_ops":2,"prepare.queue_time_us":448914,"prepare.run_cpu_time_us":19640,"prepare.run_wall_time_us":396039,"raft.queue_time_us":920839,"raft.run_cpu_time_us":35453,"raft.run_wall_time_us":253591,"replication_time_us":1003702,"thread_start_us":873552,"threads_started":4,"wal-append.queue_time_us":24146,"wal-append.run_cpu_time_us":23761,"wal-append.run_wall_time_us":2355385}]]}
I20260709 13:06:35.159533 20901 consensus_queue.cc:260] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:35.258656 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:35.259557 13230 raft_consensus.cc:2393] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 27: Already voted for candidate a70479a3b4114f3581095e9890f5d653 in this term.
I20260709 13:06:35.272501 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:35.272902 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:35.273303 12620 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:35.273850 12614 raft_consensus.cc:3060] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:35.274917 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:35.279739 12444 catalog_manager.cc:5697] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:35.281899 12659 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:35.284919 12688 raft_consensus.cc:1275] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:06:35.285980 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:35.286883 12687 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 22.
I20260709 13:06:35.284921 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:35.237967 20882 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:35.290052 20969 log.cc:927] Time spent T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:06:35.290555 20975 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:35.291086 20975 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:35.294407 13229 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:35.288156 20967 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:06:35.294936 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 54624us
W20260709 13:06:35.308257 12662 leader_election.cc:336] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:35.288235 12444 catalog_manager.cc:5697] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 15 to 18, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 18 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:35.256949 20957 raft_consensus.cc:697] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:35.238387 20964 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:35.318997 20527 consensus_queue.cc:237] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:35.321193 20964 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:35.318922 12662 leader_election.cc:336] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:35.328051 20960 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:06:35.328689 20971 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Leader election won for term 27
W20260709 13:06:35.330221 20970 log.cc:927] Time spent T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:06:35.324172 20893 consensus_meta.cc:287] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.008s
I20260709 13:06:35.333297 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60962 (request call id 1848) took 1476 ms. Trace:
I20260709 13:06:35.204507 20948 consensus_queue.cc:237] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:35.341115 12444 catalog_manager.cc:5697] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 20 to 25. New cstate: current_term: 25 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:35.238415 20955 raft_consensus.cc:3060] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:35.240846 20959 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
W20260709 13:06:35.334576 12588 leader_election.cc:336] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:35.228988 20853 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:35.342132 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 58712.4us
I20260709 13:06:35.346115 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:35.254217 20758 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:35.355378 12588 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:35.349488 12444 catalog_manager.cc:5697] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.333772 13235 rpcz_store.cc:276] 0709 13:06:33.856418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.119867 (+263449us) service_pool.cc:224] Handling call
0709 13:06:34.120210 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:34.120532 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:06:34.120557 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:34.121033 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 13:06:34.669308 (+548275us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:06:34.669373 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.669598 (+   225us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:35.333076 (+663478us) raft_consensus.cc:1685] finished
0709 13:06:35.333100 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:35.333236 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":547785,"threads_started":1,"wal-append.queue_time_us":673431}
I20260709 13:06:35.353444 13199 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:35.295718 20975 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:35.298378 20967 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.359911 20967 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:35.367043 20838 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:35.372642 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 52322.5us
I20260709 13:06:35.362042 12444 catalog_manager.cc:5697] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 11 to 14, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 14 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.377456 12614 raft_consensus.cc:2468] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 25.
I20260709 13:06:35.381155 12621 pending_rounds.cc:85] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 13
I20260709 13:06:35.381491 12621 pending_rounds.cc:107] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 22.14
I20260709 13:06:35.381837 12621 raft_consensus.cc:2889] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:35.377969 12444 catalog_manager.cc:5697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 16 to 20, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 20 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.237461 20972 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:35.353910 20901 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:35.400617 13199 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:35.406625 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:35.354758 20971 raft_consensus.cc:697] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 27 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:35.379688 12659 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:35.413504 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 94782.4us
I20260709 13:06:35.316672 20957 consensus_queue.cc:237] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:35.364125 20964 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:35.429054 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 197851us
I20260709 13:06:35.364893 20986 consensus_queue.cc:1059] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.069s
I20260709 13:06:35.364507 20959 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:35.405644 20973 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:06:35.379678 20853 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:35.420347 20968 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:35.417800 20946 raft_consensus.cc:2804] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:35.435931 12444 catalog_manager.cc:5697] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 17 to 23, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 23 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.375947 20758 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:35.447378 12510 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:35.437455 20451 consensus_queue.cc:1048] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
W20260709 13:06:35.460474 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.334736 20961 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 22.20, Last appended by leader: 20, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:35.433553 20843 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:35.430917 20980 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:35.445984 20849 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:06:35.506263 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 171700us
I20260709 13:06:35.499919 12444 catalog_manager.cc:5697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 18 to 21, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 21 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:35.515713 12510 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:35.461503 20968 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.517081 12510 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:35.523154 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.523383 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:35.524952 12588 leader_election.cc:336] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:35.526283 20983 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:35.527129 20990 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:35.527765 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:35.527662 20990 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:35.528033 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:35.529191 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:35.529265 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:35.530016 12694 raft_consensus.cc:2393] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 22: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:35.530108 12695 raft_consensus.cc:2393] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 27: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:35.530210 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:35.530839 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:35.531005 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:35.531582 12696 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:35.531796 12695 raft_consensus.cc:2393] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 25: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:06:35.530390 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.532846 12695 raft_consensus.cc:1240] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:35.533015 20954 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.533581 20954 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:35.534053 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:35.534770 12689 raft_consensus.cc:2393] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 20: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:35.535231 20468 raft_consensus.cc:3055] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:35.535655 20468 raft_consensus.cc:740] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:35.535817 20954 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:35.536666 20468 consensus_queue.cc:260] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:35.537395 12691 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 13:06:35.538868 12510 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:35.539801 20983 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:35.540271 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:35.540580 20983 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:35.540767 20468 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:35.541433 20983 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:35.541458 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:35.543927 12510 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:35.545704 20983 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:35.545742 20943 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:35.545137 12510 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:35.547463 12510 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:35.547664 20976 log.cc:927] Time spent T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 13:06:35.548219 20983 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:35.549027 20982 raft_consensus.cc:3060] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:35.549454 12510 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:35.550323 20983 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:35.551626 12510 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:35.557438 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:35.557647 12510 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:35.560973 13229 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 23.
I20260709 13:06:35.561758 12444 catalog_manager.cc:5697] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 15 to 18, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 18 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:35.564608 12615 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
I20260709 13:06:35.506428 20964 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:35.498777 20946 raft_consensus.cc:697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 25 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:35.567164 12659 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:35.524740 20968 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:06:35.629662 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 71781.3us
I20260709 13:06:35.568369 20983 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:35.630004 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:35.636059 12696 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 24.
I20260709 13:06:35.630862 12510 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:35.631891 20853 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:35.501927 20984 consensus_queue.cc:1059] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.248s
W20260709 13:06:35.642948 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 118020us
W20260709 13:06:35.644734 12588 leader_election.cc:336] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:35.639413 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 63739.4us
I20260709 13:06:35.649756 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:35.630811 12444 catalog_manager.cc:5697] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:35.623551 20973 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:35.652549 12444 catalog_manager.cc:5697] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 16 to 20, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 20 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.568389 20943 consensus_queue.cc:1059] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.085s
I20260709 13:06:35.696275 12444 catalog_manager.cc:5697] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 18 to 21, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 21 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:35.674947 20983 raft_consensus.cc:697] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 20 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:35.705721 12444 catalog_manager.cc:5697] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 18 to 19, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 19 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:35.704474 20899 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.021s	sys 0.038s
I20260709 13:06:35.699600 20984 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:06:35.716668 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 71995.4us
W20260709 13:06:35.724952 12588 leader_election.cc:336] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:35.725771 12588 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:35.523694 20971 consensus_queue.cc:237] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:35.718740 12444 catalog_manager.cc:5697] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 22 to 26. New cstate: current_term: 26 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:35.665706 20990 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:35.713948 20848 consensus_meta.cc:287] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.000s
I20260709 13:06:35.704984 20973 raft_consensus.cc:697] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:35.738721 12444 catalog_manager.cc:5697] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:06:35.727500 20899 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.021s	sys 0.039s
W20260709 13:06:35.736845 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 163410us
I20260709 13:06:35.744356 12444 catalog_manager.cc:5697] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 5 to 19. New cstate: current_term: 19 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:35.714895 20527 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:35.723238 21003 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:35.748413 12444 catalog_manager.cc:5697] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 16 to 17, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 17 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:35.753697 12588 leader_election.cc:336] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:35.754329 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:35.713578 20643 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.030s
W20260709 13:06:35.759019 12588 leader_election.cc:336] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:35.742951 20990 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:35.759557 12588 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:35.763098 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 132316us
I20260709 13:06:35.764263 12510 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:35.758455 20993 log.cc:927] Time spent T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:06:35.770226 20983 consensus_queue.cc:237] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:35.753213 20980 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:35.773063 12510 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:35.741331 20848 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:35.784803 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 380543us
I20260709 13:06:35.784194 12444 catalog_manager.cc:5697] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 12 to 16, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 16 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:35.765537 20984 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:06:35.755080 20527 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:35.798843 12444 catalog_manager.cc:5697] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:35.800443 12510 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:35.729678 20946 consensus_queue.cc:237] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:35.803337 12510 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:35.760128 20853 consensus_queue.cc:1059] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.036s
W20260709 13:06:35.813917 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 54937.4us
W20260709 13:06:35.817678 12588 leader_election.cc:336] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:35.795111 20899 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:35.814476 12444 catalog_manager.cc:5697] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:06:35.809165 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 113196us
I20260709 13:06:35.799189 21003 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:35.798496 20758 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:35.819334 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:35.816907 12587 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:35.802435 21004 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:35.823804 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:35.824743 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:35.825322 12688 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
W20260709 13:06:35.826798 20995 log.cc:927] Time spent T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:06:35.815366 20990 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:35.830137 20853 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:35.830832 21008 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.820683 12444 catalog_manager.cc:5697] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 17 to 20, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 20 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:35.846702 12588 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:35.831398 21008 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:35.828661 20899 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:35.857641 20853 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:06:35.860292 20990 consensus_queue.cc:1059] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:06:35.871129 20990 raft_consensus.cc:3055] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:06:35.871522 20990 raft_consensus.cc:740] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:35.872464 20990 consensus_queue.cc:260] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:35.873665 20997 log.cc:927] Time spent T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:06:35.798925 20973 consensus_queue.cc:237] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:35.862262 20943 consensus_queue.cc:1059] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:06:35.869645 21004 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.870168 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
W20260709 13:06:35.861867 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:35.924506 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.948688 12588 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:35.964706 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:35.863293 20959 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:35.865965 20899 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.864986 20996 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:35.993741 12620 raft_consensus.cc:1275] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:06:35.874986 20972 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:35.969486 20938 log.cc:927] Time spent T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:06:35.965116 20975 raft_consensus.cc:2804] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:35.965410 20990 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:35.991497 20984 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:35.947561 20722 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:36.005002 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:36.007402 21022 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.972864 20882 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.035s
I20260709 13:06:36.008046 20736 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:06:36.008067 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.994982 20899 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:35.990473 20971 raft_consensus.cc:3055] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:35.994592 20980 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:36.013595 20975 raft_consensus.cc:697] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 22 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:36.013358 20984 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.055374 21008 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:36.056406 12689 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:06:36.058523 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 84055.3us
I20260709 13:06:36.053915 13199 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:36.064762 13199 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:36.047988 20971 raft_consensus.cc:740] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:36.042246 21022 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.066597 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:35.984290 21004 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:36.068408 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:36.070891 12510 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:36.001215 20996 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.046950 20736 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.053522 20980 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:36.054042 20968 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.058174 20984 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:36.061718 20527 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:36.040315 20722 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:36.073247 21025 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:06:36.139842 20967 consensus_meta.cc:287] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 0.779s	user 0.007s	sys 0.005s
I20260709 13:06:36.140297 20967 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:36.141023 20971 consensus_queue.cc:260] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:36.142725 20971 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:36.084540 12510 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:36.147085 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 62638us
I20260709 13:06:36.148149 12510 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:36.058941 20711 raft_consensus.cc:3055] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:06:36.103235 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:36.104387 13227 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260709 13:06:36.121599 12621 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:06:36.125978 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:36.078619 13232 raft_consensus.cc:1240] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 26. Current term is 27. Ops: [26.18-26.18]
I20260709 13:06:36.162750 20798 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:36.081717 21008 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:36.122287 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:36.164806 12616 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 26 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 25. Current term is 26. Ops: []
I20260709 13:06:36.158571 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:36.128031 12619 raft_consensus.cc:1275] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:06:36.121985 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:36.150907 12588 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:36.077414 20856 consensus_meta.cc:287] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a: Time spent flushing consensus metadata: real 1.058s	user 0.010s	sys 0.013s
I20260709 13:06:36.090442 20968 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:36.084852 21017 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:36.081162 21022 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:36.195389 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:36.127655 12511 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.11.44.254:44047, user_credentials={real_user=slave}} blocked reactor thread for 61341.8us
I20260709 13:06:36.184909 12621 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 19. Current term is 20. Ops: []
I20260709 13:06:36.086634 20996 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:36.108101 20581 raft_consensus.cc:3055] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:06:36.158049 20711 raft_consensus.cc:740] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 26 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:36.090421 20980 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:36.093080 20964 consensus_meta.cc:287] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.002s
I20260709 13:06:36.191201 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:36.191828 12614 raft_consensus.cc:1240] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 21. Current term is 22. Ops: [21.11-21.11]
I20260709 13:06:36.216276 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:36.088608 20736 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:36.082468 21004 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:36.200142 12588 leader_election.cc:336] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.200778 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:36.165602 20893 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.154189 21009 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:06:36.204785 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.207998 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:36.210752 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:36.220381 12696 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:36.214437 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:36.185456 21008 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:36.217710 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:36.196960 20856 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:36.223724 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 44328.2us
I20260709 13:06:36.159035 21025 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
W20260709 13:06:36.228679 12588 leader_election.cc:336] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.229068 12588 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:36.230070 12588 leader_election.cc:336] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.230423 12588 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:36.227020 13200 leader_election.cc:336] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.207665 20581 raft_consensus.cc:740] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
W20260709 13:06:36.234542 12588 leader_election.cc:336] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.094314 20975 consensus_queue.cc:237] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.223026 20964 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:06:36.228188 20901 consensus_meta.cc:287] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.818s	user 0.010s	sys 0.002s
W20260709 13:06:36.253913 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.114480 20984 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.252337 12692 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:36.235724 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:36.225800 21008 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:36.232496 13200 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:36.235376 20643 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:06:36.265390 12588 leader_election.cc:336] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.271490 12588 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:36.278116 12696 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 23.
W20260709 13:06:36.238003 20849 consensus_meta.cc:287] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372: Time spent flushing consensus metadata: real 0.724s	user 0.012s	sys 0.000s
W20260709 13:06:36.280601 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 53612.9us
W20260709 13:06:36.281670 13200 leader_election.cc:336] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.249960 20967 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:36.282280 20996 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:36.225024 20893 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:36.283412 12588 consensus_peers.cc:597] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:36.224941 20736 consensus_queue.cc:1048] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
W20260709 13:06:36.293071 12588 leader_election.cc:336] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:36.294337 12588 leader_election.cc:336] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.294837 12588 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:36.288412 13200 consensus_peers.cc:597] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:36.287585 20849 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:06:36.303840 21021 log.cc:927] Time spent T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.346s	user 0.003s	sys 0.001s
I20260709 13:06:36.307453 20984 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:36.311244 20722 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:36.280167 20711 consensus_queue.cc:260] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.315829 20711 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:36.268422 20901 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:36.326282 20581 consensus_queue.cc:260] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:36.327585 20581 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:36.328847 20797 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:06:36.290868 20955 consensus_meta.cc:287] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.921s	user 0.013s	sys 0.001s
I20260709 13:06:36.281431 20980 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:06:36.335465 12588 leader_election.cc:336] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.340557 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:36.284477 20986 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:06:36.296815 13200 consensus_peers.cc:597] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:36.350132 12588 consensus_peers.cc:597] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:36.351478 12588 leader_election.cc:336] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:36.352886 12588 leader_election.cc:336] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.353408 12588 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:36.344800 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 48024.6us
W20260709 13:06:36.357914 12588 leader_election.cc:336] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:36.368927 12588 leader_election.cc:336] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.335108 20875 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:36.289806 21010 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.090s
W20260709 13:06:36.356149 20982 consensus_meta.cc:287] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.807s	user 0.014s	sys 0.000s
I20260709 13:06:36.369417 12588 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:36.345786 20856 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:36.375378 13200 leader_election.cc:336] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:36.384886 13200 consensus_peers.cc:597] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:36.385531 12588 leader_election.cc:336] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.370779 20984 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:36.355458 20958 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:06:36.386161 13200 consensus_peers.cc:597] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:36.390053 12588 leader_election.cc:336] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:36.391358 13200 consensus_peers.cc:597] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:36.391780 12588 leader_election.cc:336] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:36.392099 13200 consensus_peers.cc:597] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:36.392380 12588 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:36.343575 20955 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.384334 20982 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:36.386144 20643 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:06:36.395568 12588 leader_election.cc:336] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:36.396656 13200 consensus_peers.cc:597] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:36.398563 12588 leader_election.cc:336] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:36.399520 12588 leader_election.cc:336] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.399917 12588 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:36.401085 13200 consensus_peers.cc:597] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:36.402366 12588 consensus_peers.cc:597] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:36.403326 12588 consensus_peers.cc:597] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:36.403985 12588 consensus_peers.cc:597] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:36.404467 12588 leader_election.cc:336] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.404812 12588 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:36.402370 13200 consensus_peers.cc:597] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:36.397126 20875 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:06:36.412160 12588 consensus_peers.cc:597] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:36.402704 20984 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:06:36.410694 13200 consensus_peers.cc:597] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:36.411458 21017 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:06:36.420563 21027 log.cc:927] Time spent T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:06:36.415112 20975 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:06:36.425876 13200 consensus_peers.cc:597] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:36.433950 12510 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:36.436859 12621 raft_consensus.cc:1240] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 18. Current term is 19. Ops: []
W20260709 13:06:36.438930 13200 leader_election.cc:336] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:36.440048 13200 leader_election.cc:336] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:36.436925 12588 leader_election.cc:336] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:36.440924 13200 leader_election.cc:336] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.442420 13200 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:36.441817 12588 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:36.418491 20899 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:36.447083 12588 leader_election.cc:336] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.447788 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:36.449757 20736 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:06:36.448603 20875 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:36.455616 12617 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:06:36.438023 20982 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:06:36.463246 21034 log.cc:927] Time spent T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 13:06:36.463431 20955 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:36.468036 20899 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:36.469252 12620 raft_consensus.cc:2368] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 24. Current term is 25.
I20260709 13:06:36.472323 21008 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.474020 20899 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:36.474987 12588 leader_election.cc:336] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.476472 12613 raft_consensus.cc:1240] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 17. Current term is 18. Ops: []
W20260709 13:06:36.480409 12588 consensus_peers.cc:597] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:36.482769 13200 leader_election.cc:336] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:36.483861 13200 consensus_peers.cc:597] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:36.484364 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:06:36.487526 12588 consensus_peers.cc:597] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:36.484385 13200 leader_election.cc:336] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:36.508334 13200 leader_election.cc:336] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.508740 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:36.508896 13200 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:36.509349 13227 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Advancing to term 20
W20260709 13:06:36.510386 12588 leader_election.cc:336] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.482575 20955 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.030s
W20260709 13:06:36.511658 12588 leader_election.cc:336] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.519330 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:36.511305 21008 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:36.525404 20615 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:06:36.522802 13200 consensus_peers.cc:597] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:36.526544 13200 leader_election.cc:336] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.526490 13227 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:06:36.536929 20988 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.537601 20988 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:36.528848 20643 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.010s
I20260709 13:06:36.523826 20895 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:06:36.544263 12588 leader_election.cc:336] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:36.552666 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:36.558717 12588 leader_election.cc:336] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:36.547035 13200 leader_election.cc:336] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.561760 12616 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41086 (request call id 2761) took 1419 ms. Trace:
I20260709 13:06:36.562388 12616 rpcz_store.cc:276] 0709 13:06:35.144564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.154888 (+ 10324us) service_pool.cc:224] Handling call
0709 13:06:35.172371 (+ 17483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:36.182255 (+1009884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.561418 (+379163us) spinlock_profiling.cc:243] Waited 992 ms on lock 0x7b5400099cd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:36.561686 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2281831168}
I20260709 13:06:36.565019 13226 raft_consensus.cc:1240] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:36.565883 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60954 (request call id 1827) took 1489 ms. Trace:
I20260709 13:06:36.566255 13226 rpcz_store.cc:276] 0709 13:06:35.076726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.076859 (+   133us) service_pool.cc:224] Handling call
0709 13:06:36.564607 (+1487748us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b58000f6398. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5910ab 00007fc3ae591131 00007fc3ae552fc0 00007fc3ae53d929 00007fc3ae53d3d2 00007fc3a7ab4bd4
0709 13:06:36.564828 (+   221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:36.565546 (+   718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.565820 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6729472}
W20260709 13:06:36.569370 12511 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.571090 12694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37308 (request call id 2753) took 1051 ms. Trace:
I20260709 13:06:36.571573 12694 rpcz_store.cc:276] 0709 13:06:35.519962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.530605 (+ 10643us) service_pool.cc:224] Handling call
0709 13:06:36.570861 (+1040256us) spinlock_profiling.cc:243] Waited 644 ms on lock 0x7b54003e9ed4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:36.571019 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1481754880}
I20260709 13:06:36.573052 21010 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:36.574048 21010 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.565069 20757 consensus_queue.cc:1059] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:06:36.576121 20757 consensus_queue.cc:1243] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer a11816c5d72e4d1295a242f3ced09e5f log is divergent from this leader: its last log entry 26.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 13:06:36.583856 20994 raft_consensus.cc:3055] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:36.584178 21010 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:36.584592 20994 raft_consensus.cc:740] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:36.584932 21010 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:36.585551 21010 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.587754 21010 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:36.595779 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.595816 20957 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.596556 20957 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.597972 21025 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.598714 20957 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:36.600407 13199 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:36.600932 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.598501 21025 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.601029 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:36.601622 13199 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:36.601936 13227 raft_consensus.cc:2368] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 21. Current term is 22.
I20260709 13:06:36.602842 20758 raft_consensus.cc:3055] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:06:36.602859 21025 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:36.603430 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:36.604139 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:36.604398 13230 raft_consensus.cc:2368] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 22. Current term is 23.
I20260709 13:06:36.604803 13231 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:06:36.603015 13199 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:36.605952 12513 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:36.606909 21013 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:36.607797 21011 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:36.603502 20758 raft_consensus.cc:740] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:36.609028 13199 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:36.609211 12513 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:36.610160 21011 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:36.609977 20758 consensus_queue.cc:260] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:36.610788 21011 raft_consensus.cc:697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 23 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:36.611459 20758 raft_consensus.cc:3060] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:36.611783 21011 consensus_queue.cc:237] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.620955 12510 leader_election.cc:400] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 24. Current term is 25.
I20260709 13:06:36.621387 12510 leader_election.cc:403] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:36.601836 21031 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:36.614277 20849 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:36.633334 12513 leader_election.cc:400] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 21. Current term is 22.
I20260709 13:06:36.634043 12513 leader_election.cc:403] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:36.592141 20893 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:36.626094 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:36.632252 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:36.637454 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:36.639281 12618 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 28 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 27. Current term is 28. Ops: []
I20260709 13:06:36.640427 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:36.639228 12695 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:36.642992 12622 raft_consensus.cc:2410] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 13:06:36.639861 13231 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 22.
I20260709 13:06:36.643625 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:36.647116 12513 leader_election.cc:400] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 22. Current term is 23.
I20260709 13:06:36.647471 12513 leader_election.cc:403] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:36.647672 12588 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:36.648425 12513 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:36.651072 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:36.622298 20965 consensus_queue.cc:1059] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 13:06:36.652140 20876 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:06:36.654980 20849 raft_consensus.cc:697] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:36.656057 20849 consensus_queue.cc:237] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.623593 20896 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.657860 20896 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.654865 20971 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:06:36.660076 20896 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:36.623853 20966 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Advancing to term 25
W20260709 13:06:36.664575 12588 leader_election.cc:336] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.665115 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:36.665943 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:36.638485 20962 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:36.666877 21017 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:06:36.652032 20982 raft_consensus.cc:3060] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:06:36.650161 20994 consensus_queue.cc:260] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:36.671655 20994 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:36.672880 20876 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 22. Current term is 23.
I20260709 13:06:36.682400 20988 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:36.683627 12692 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37292 (request call id 2883) took 1774 ms. Trace:
I20260709 13:06:36.684023 12692 rpcz_store.cc:276] 0709 13:06:34.909162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.923033 (+ 13871us) service_pool.cc:224] Handling call
0709 13:06:34.932477 (+  9444us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:36.260165 (+1327688us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.683281 (+423116us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54002c9554. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:36.683563 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3034491776}
I20260709 13:06:36.684937 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:36.685916 12696 raft_consensus.cc:2393] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 24: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:06:36.687332 21019 log.cc:927] Time spent T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.679s	user 0.000s	sys 0.003s
I20260709 13:06:36.687786 12687 raft_consensus.cc:1240] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:36.688802 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:06:36.691241 21029 log.cc:927] Time spent T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.335s	user 0.003s	sys 0.000s
I20260709 13:06:36.691295 12687 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260709 13:06:36.681414 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:36.692715 12687 raft_consensus.cc:1240] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 25. Current term is 26. Ops: [25.17-25.17]
I20260709 13:06:36.692961 12620 raft_consensus.cc:3060] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:36.696241 20848 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:36.697393 20539 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:36.697649 12662 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:36.697986 20539 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:36.700150 20539 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:36.701140 20743 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:36.701988 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:36.674010 20965 raft_consensus.cc:3055] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:36.703593 12512 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:36.674546 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:36.705977 12618 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 28: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:36.675263 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:36.675765 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:36.711236 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:36.711236 12695 raft_consensus.cc:2468] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:06:36.717406 12687 raft_consensus.cc:1240] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:36.724010 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:36.724813 12618 raft_consensus.cc:2468] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:06:36.726301 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:36.731560 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:36.732654 12618 raft_consensus.cc:2393] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 18: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:36.735857 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:36.728737 21004 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:36.736539 12696 raft_consensus.cc:3060] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:36.702847 20893 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:36.754406 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:36.715946 20848 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:36.738375 13200 leader_election.cc:336] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:36.762949 13200 leader_election.cc:336] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.764364 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:36.704668 20965 raft_consensus.cc:740] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:36.768965 12587 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:36.769371 12662 connection.cc:256] RPC call timeout handler was delayed by -1.2846369959999038s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
I20260709 13:06:36.736469 20895 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:36.767269 13199 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:36.770416 12662 connection.cc:256] RPC call timeout handler was delayed by -1.2828369959999009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
I20260709 13:06:36.763411 13200 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:36.740450 20893 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:36.774103 12662 connection.cc:256] RPC call timeout handler was delayed by -1.0074369959999103s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1975s for a response
W20260709 13:06:36.781833 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.725832 20881 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 27.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.043s
I20260709 13:06:36.723359 20948 consensus_queue.cc:1048] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:06:36.783319 20893 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:36.770359 20848 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.766475 20958 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.793237 20848 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:36.795651 12620 raft_consensus.cc:2468] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:06:36.795923 13199 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:36.797345 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:36.790416 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:36.803774 12659 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:36.812099 13199 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:36.761658 21004 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.033s
I20260709 13:06:36.788017 20986 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:36.789461 20856 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:06:36.809172 21048 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.171s	user 0.002s	sys 0.000s
I20260709 13:06:36.832046 20722 raft_consensus.cc:2804] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:36.816517 20845 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:36.845189 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.809823 20958 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.851258 20722 raft_consensus.cc:697] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 20 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:36.862370 20826 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:36.862952 20722 consensus_queue.cc:237] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:36.864173 21044 log.cc:927] Time spent T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:06:36.802429 20996 consensus_queue.cc:1059] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.042s
I20260709 13:06:36.851864 20901 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:36.852487 21008 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.811094 20758 raft_consensus.cc:2804] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:36.825888 21010 raft_consensus.cc:2804] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:36.873705 12696 raft_consensus.cc:2468] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 25.
I20260709 13:06:36.878134 12587 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:36.883194 20966 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 24. Current term is 25.
W20260709 13:06:36.879900 13200 leader_election.cc:336] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:36.867293 20902 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:36.890286 20958 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:36.890739 20579 raft_consensus.cc:2804] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:36.892216 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:36.833685 20856 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:36.902529 12588 consensus_peers.cc:597] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:36.874191 20758 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.877398 21008 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.874503 21031 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:36.894840 20982 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for earlier term 21. Current term is 22.
I20260709 13:06:36.916179 20856 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:36.918828 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:36.920113 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:36.920642 12688 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:36.921705 20758 raft_consensus.cc:3060] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:36.868286 20965 consensus_queue.cc:260] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.897743 21010 raft_consensus.cc:697] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:36.926481 20876 consensus_queue.cc:1059] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:36.927477 21010 consensus_queue.cc:237] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.908133 20579 raft_consensus.cc:697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 25 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:36.930588 20579 consensus_queue.cc:237] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:36.934533 20996 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.935063 20996 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.935778 13230 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:06:36.937160 20996 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:36.908806 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:36.908257 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:36.938812 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:36.940483 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:36.941295 12616 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:36.942965 12512 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:36.944304 20848 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:06:36.946957 12512 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:36.948045 21009 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:36.950455 20893 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.950944 12659 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:36.907392 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:36.952795 20980 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:36.953811 20980 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.956593 20980 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:36.953845 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 22 index: 20 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:36.957864 13232 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 24.
I20260709 13:06:36.956363 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:36.964118 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 22 index: 20 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:36.965400 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:36.965765 20948 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:36.966187 20948 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:36.927987 21008 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:36.966550 20948 raft_consensus.cc:3060] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:36.966475 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:36.966897 21031 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:36.979817 20992 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.980459 20992 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:37.000970 13227 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 28.
I20260709 13:06:36.987416 13232 raft_consensus.cc:1275] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:06:36.993523 13197 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:36.983568 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:37.019517 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 200868us
I20260709 13:06:37.029816 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:37.030797 12620 raft_consensus.cc:2410] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 28 because replica has last-logged OpId of term: 26 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
W20260709 13:06:37.030202 12662 leader_election.cc:336] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:37.033186 12662 leader_election.cc:336] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.033936 12662 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:36.987725 21052 log.cc:927] Time spent T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:06:36.983630 12588 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:37.058884 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 75336.2us
I20260709 13:06:37.059006 20958 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:37.059572 20958 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.059968 20958 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:37.059741 12588 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:37.060956 20895 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:06:37.063241 12696 raft_consensus.cc:1275] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
W20260709 13:06:37.067684 12660 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.068802 20958 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:37.071130 20958 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:37.075407 12690 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
W20260709 13:06:37.086789 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 53647.7us
W20260709 13:06:37.087607 12662 leader_election.cc:336] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.089133 12688 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:06:37.032562 20968 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:37.091982 13197 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:37.092346 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:37.094241 21031 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:37.088553 20973 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260709 13:06:37.087615 20893 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:37.116407 21035 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:37.097306 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:37.102546 20948 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:37.110670 20743 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:37.091395 20895 consensus_queue.cc:1048] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.022s
W20260709 13:06:37.112601 12662 leader_election.cc:336] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.153218 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:37.135973 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:37.121426 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 108613us
I20260709 13:06:37.145143 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 22 index: 20 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:37.156388 13227 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:37.151472 13228 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:06:37.156090 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:37.157784 13231 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:06:37.169238 12588 leader_election.cc:336] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.169766 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:37.170403 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 22 index: 20 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:06:37.169271 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 56701.1us
W20260709 13:06:37.171293 12662 consensus_peers.cc:597] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:37.176311 12662 consensus_peers.cc:597] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:37.181747 12662 consensus_peers.cc:597] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:37.182382 12662 leader_election.cc:336] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.183306 13227 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 25.
I20260709 13:06:37.187134 13197 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:37.170583 20539 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:06:37.179360 20983 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.179086 20965 raft_consensus.cc:3060] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:37.184998 21004 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:37.222977 12689 raft_consensus.cc:3055] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:37.223415 12689 raft_consensus.cc:740] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:06:37.223909 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 60163.5us
I20260709 13:06:37.210569 20797 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:37.226379 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 44026.2us
W20260709 13:06:37.228140 12662 consensus_peers.cc:597] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:37.228722 12662 consensus_peers.cc:597] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:37.229974 12662 leader_election.cc:336] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.182585 20758 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:37.230376 12662 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:37.230945 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 43944.7us
I20260709 13:06:37.229717 12689 consensus_queue.cc:260] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:37.240388 12689 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:37.225426 21006 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.246955 20992 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:37.257870 20966 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:06:37.261065 20966 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:06:37.225728 21004 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:37.268930 21004 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:37.238214 20527 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:37.272207 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:37.273808 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:37.242117 12662 leader_election.cc:336] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.277500 12662 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:37.277882 21006 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:37.278708 20527 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:37.279755 12662 leader_election.cc:336] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.280117 21006 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:37.280208 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:37.282243 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 32 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:37.285761 13231 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 23.
W20260709 13:06:37.298480 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 129247us
W20260709 13:06:37.302042 12662 leader_election.cc:336] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.236469 21035 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:37.302570 12662 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:37.303691 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 32 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:37.305398 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:37.224291 20983 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:37.235401 20797 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:37.301514 20527 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:06:37.315940 12662 leader_election.cc:336] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.316023 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:37.318452 20581 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 13:06:37.318852 20948 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:37.324783 12689 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 18. (term mismatch)
I20260709 13:06:37.325423 12689 pending_rounds.cc:85] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 17
I20260709 13:06:37.325855 12689 pending_rounds.cc:107] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 22.18
I20260709 13:06:37.326299 12689 raft_consensus.cc:2889] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:37.326378 12662 leader_election.cc:336] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:37.329793 12662 leader_election.cc:336] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.332594 12662 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:37.339445 12662 leader_election.cc:336] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.313855 20973 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:37.340018 12662 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:37.329304 20990 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.006s
I20260709 13:06:37.341053 20527 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:37.349803 12662 consensus_peers.cc:597] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:37.349181 20539 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:06:37.359505 12662 leader_election.cc:336] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.370115 12662 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:37.376303 20758 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:37.378887 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:37.381711 20966 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:37.382405 20966 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:37.383868 20983 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:37.384719 20966 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:37.384927 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:37.385604 12692 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 20.
I20260709 13:06:37.393740 20733 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260709 13:06:37.394192 12662 leader_election.cc:336] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.394806 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:37.396092 12662 leader_election.cc:336] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.396552 12662 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:37.397341 20948 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:37.398027 20948 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:37.400569 12512 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:37.403281 21006 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:06:37.403615 12662 leader_election.cc:336] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.403754 21006 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:37.404224 21006 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:06:37.405400 12662 leader_election.cc:336] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.406693 20986 raft_consensus.cc:3055] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:06:37.407639 20986 raft_consensus.cc:740] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:06:37.408265 12662 leader_election.cc:336] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.408803 12662 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:37.408605 20986 consensus_queue.cc:260] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:37.409934 20986 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:06:37.414388 12662 leader_election.cc:336] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.414515 20758 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.415133 20758 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:37.415556 12662 leader_election.cc:336] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.416383 20966 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.416921 20966 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:37.417651 20856 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:37.419595 20797 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:37.420101 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:37.421723 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:37.423038 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:37.403275 21061 log.cc:927] Time spent T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.225s	user 0.002s	sys 0.000s
W20260709 13:06:37.419610 12662 leader_election.cc:336] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.424968 12662 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:37.425061 12512 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:06:37.430347 12662 leader_election.cc:336] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.436646 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:37.428922 20965 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:37.445924 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:37.449195 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:37.425827 20758 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:37.445251 20856 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:37.437958 20722 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:37.455156 13231 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:37.458946 13231 raft_consensus.cc:1240] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:37.463362 12662 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:37.464603 12662 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:37.465348 20539 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:37.465720 20527 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:06:37.466745 12662 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:37.467511 20948 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:06:37.467898 20948 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:37.468267 20948 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:37.472715 21006 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:37.462154 20758 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:37.489972 12662 leader_election.cc:336] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:37.491474 12662 leader_election.cc:336] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.491919 12662 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:37.492755 20856 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:06:37.494911 12662 leader_election.cc:336] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:37.495914 12662 leader_election.cc:336] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.496366 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:37.499655 12662 leader_election.cc:336] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.478183 20527 consensus_queue.cc:1059] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.013s
W20260709 13:06:37.500564 12662 leader_election.cc:336] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.478340 20733 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.014s
W20260709 13:06:37.505982 12662 consensus_peers.cc:597] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:37.501119 20856 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:06:37.490175 20758 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:37.494992 20948 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:37.512406 20722 raft_consensus.cc:3055] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:06:37.551179 12662 leader_election.cc:336] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:37.559039 12662 leader_election.cc:336] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.559640 12662 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:37.529661 20876 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:37.565503 12662 leader_election.cc:336] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.566272 12662 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:37.557991 20722 raft_consensus.cc:740] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:06:37.843488 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 278004us
I20260709 13:06:37.550616 20797 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:37.862052 12662 leader_election.cc:336] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:37.866072 20539 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:37.859460 20856 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:06:37.914604 20986 consensus_meta.cc:287] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.504s	user 0.014s	sys 0.003s
I20260709 13:06:37.864130 20876 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:37.887880 20797 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:37.924100 21006 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:37.917871 20982 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:37.935289 21083 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.943158 20983 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:37.946390 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 843718us
I20260709 13:06:37.939735 20982 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:37.944516 20758 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:37.955825 20983 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:37.983165 21085 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:37.983619 21078 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 13:06:37.989429 21079 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:06:37.990998 20982 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:37.991166 13232 raft_consensus.cc:1240] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:37.992657 20983 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:37.997236 20881 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.997767 20881 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:37.999857 20881 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:37.956313 20948 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 28 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:37.936841 20722 consensus_queue.cc:260] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.010560 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:38.012434 12690 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 20: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:38.012938 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:38.013979 12693 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:37.984038 21085 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:37.981065 21084 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.947186 21083 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.029767 20948 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.025400 20722 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:38.042322 20948 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:38.052390 21082 log.cc:927] Time spent T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:06:38.053445 20948 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:38.054575 20797 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:38.053295 21081 log.cc:927] Time spent T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.139s	user 0.003s	sys 0.001s
W20260709 13:06:38.057716 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 832725us
I20260709 13:06:38.059410 12587 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
W20260709 13:06:38.062037 21077 log.cc:927] Time spent T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 13:06:38.062932 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 757581us
I20260709 13:06:38.030579 21084 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.063668 20895 consensus_queue.cc:1048] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:06:38.064273 12588 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:38.065485 12588 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:38.067222 21070 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:38.050047 20591 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:38.074661 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:38.065790 20579 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:38.078406 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:38.065177 20895 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:38.087062 12696 raft_consensus.cc:1240] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 24. Current term is 25. Ops: []
I20260709 13:06:38.065595 21084 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:38.077606 21083 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:38.066445 20876 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:38.077216 21080 log.cc:927] Time spent T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:06:38.095893 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:38.099406 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.103473 21086 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.104199 20579 raft_consensus.cc:697] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:06:38.109104 12585 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.110838 20711 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.116125 13228 raft_consensus.cc:1240] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:06:38.139606 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:38.141650 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:38.146250 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:38.147455 13235 raft_consensus.cc:2393] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 20: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:38.148736 20966 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:38.152804 21004 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.129475 21086 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:38.153442 21004 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.156333 21086 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:38.157395 20711 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.158005 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:38.159798 13228 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 24. Current term is 25. Ops: [22.20-24.21]
I20260709 13:06:38.162432 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:38.165553 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 169275us
I20260709 13:06:38.167667 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:38.173960 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:38.175354 12614 raft_consensus.cc:1275] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:06:38.176501 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:38.180169 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:38.118710 12693 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 21.
I20260709 13:06:38.121420 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:38.088725 21070 raft_consensus.cc:697] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 25 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:38.128460 12691 raft_consensus.cc:1275] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 13:06:38.085697 21071 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:38.190119 12689 raft_consensus.cc:1240] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Rejecting Update request from peer a11816c5d72e4d1295a242f3ced09e5f for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 13:06:38.189921 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:38.201263 12616 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 28.
I20260709 13:06:38.181506 12694 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:06:38.200397 20758 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.210232 20758 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.212083 20711 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:38.212656 20758 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:38.212888 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:38.213554 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:38.213320 20579 consensus_queue.cc:237] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.214449 12613 raft_consensus.cc:2393] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a in current term 28: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:38.194500 20984 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.218024 20984 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.218818 21071 raft_consensus.cc:697] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 23 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:38.219908 12510 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:38.219838 21071 consensus_queue.cc:237] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.178253 21004 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:38.222609 21004 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:38.222846 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:38.167275 21087 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:38.196424 21086 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.243723 12692 raft_consensus.cc:1275] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:06:38.261062 12614 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 13:06:38.197378 20893 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.266203 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:38.224303 21087 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.220330 20984 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:38.273919 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 187168us
I20260709 13:06:38.274472 13199 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:06:38.274781 13200 leader_election.cc:336] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:38.277138 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 149610us
I20260709 13:06:38.281183 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:38.272266 12513 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:38.212832 20743 consensus_queue.cc:1048] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:06:38.224601 21086 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:38.290334 12622 raft_consensus.cc:2468] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:38.285794 20539 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:38.286976 20758 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:06:38.305362 12662 leader_election.cc:336] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:38.288290 21008 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:38.312378 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:38.297308 13227 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 28.
I20260709 13:06:38.311825 12692 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:38.313076 12691 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 26.
I20260709 13:06:38.313599 12692 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 20.
I20260709 13:06:38.314476 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:38.314904 12662 consensus_peers.cc:597] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:38.315541 12662 consensus_peers.cc:597] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:38.309578 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 211906us
I20260709 13:06:38.315079 12617 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:06:38.272611 20893 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:38.321645 12662 consensus_peers.cc:597] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:38.323664 12513 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:38.328084 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:38.329638 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:38.334810 20983 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.335505 20983 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:38.339118 12513 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:38.288794 20962 consensus_queue.cc:1048] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 13:06:38.317111 21008 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.340284 12587 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:38.346978 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:38.360510 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:38.365135 12662 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:38.365984 20948 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:06:38.366472 20948 raft_consensus.cc:697] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 28 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:38.368363 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:38.369009 12617 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 22.
I20260709 13:06:38.307642 20539 consensus_queue.cc:1059] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.051s
I20260709 13:06:38.340004 21084 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:38.374028 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:38.373584 20948 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 27.20, Last appended by leader: 20, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.356408 21004 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:38.344426 20797 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:38.322640 20984 consensus_queue.cc:1048] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 13:06:38.383421 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:38.385222 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 45025.8us
I20260709 13:06:38.368789 21008 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:38.375514 20876 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.391348 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:38.390657 12587 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:38.394398 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:38.386313 12662 leader_election.cc:336] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:38.398887 12662 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:38.322244 21070 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 22.20, Last appended by leader: 20, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.405109 13197 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:38.387768 20875 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:06:38.469671 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:38.467113 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:38.473225 12616 raft_consensus.cc:2410] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:06:38.400677 20733 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:38.387074 21084 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:38.399247 20983 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:38.398948 21089 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:38.470060 20975 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:38.461596 20875 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.470192 20797 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.534571 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:38.476905 20982 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.517838 20965 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.533186 20975 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.531912 21086 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:38.400218 20876 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:38.549871 13200 consensus_peers.cc:597] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:38.577121 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:38.581393 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 242203us
I20260709 13:06:38.476295 20711 consensus_queue.cc:1059] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 13:06:38.536293 20875 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:38.608385 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:38.540192 20737 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Leader pre-election won for term 29
W20260709 13:06:38.593532 13200 consensus_peers.cc:597] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:38.582971 20975 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:38.615370 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:38.579705 21092 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.556195 20982 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:38.598507 21087 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:38.627218 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:38.612362 20737 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.543190 20797 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:38.633121 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.640403 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:38.642912 12618 raft_consensus.cc:1240] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 23 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 22. Current term is 23. Ops: []
I20260709 13:06:38.536041 21089 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.580605 20965 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.650373 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:38.653149 12622 raft_consensus.cc:2410] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:06:38.650046 20893 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:38.654583 20876 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:38.654601 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:38.656997 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:38.657698 12616 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:38.659296 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:38.707118 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 44420.5us
I20260709 13:06:38.707898 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:38.647461 20737 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:06:38.715662 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 48360.9us
I20260709 13:06:38.632251 20983 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:38.719960 21101 log.cc:927] Time spent T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.330s	user 0.001s	sys 0.000s
I20260709 13:06:38.749193 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:38.630652 21092 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.820343 21092 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:38.821328 20984 raft_consensus.cc:3055] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:38.821810 20984 raft_consensus.cc:740] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:38.822623 20984 consensus_queue.cc:260] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:38.823891 20984 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:38.825445 21092 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:38.825716 20643 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:38.826046 21092 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.826278 20643 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.828202 21092 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:38.828317 20643 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:38.828790 21092 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:38.774744 20876 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:06:38.784225 20982 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:38.785449 20797 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:38.786981 20962 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:38.778977 21089 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:38.788872 21113 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:38.834898 21113 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.791368 21114 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:38.738147 20983 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.805810 21116 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.806389 21084 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:38.810094 21105 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
W20260709 13:06:38.817930 21104 log.cc:927] Time spent T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
W20260709 13:06:38.823101 21103 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.293s	user 0.000s	sys 0.003s
I20260709 13:06:38.788611 20965 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:38.841804 12620 raft_consensus.cc:1275] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:06:38.837316 21113 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:38.843111 21057 raft_consensus.cc:3055] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:06:38.858394 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:38.873093 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 129570us
I20260709 13:06:38.869362 21057 raft_consensus.cc:740] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:38.880128 21057 consensus_queue.cc:260] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.21, Last appended by leader: 21, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.848625 20962 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.887012 20983 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:38.862349 21116 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.888584 20737 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.890893 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:38.892035 21116 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:38.892406 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:38.850925 21114 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.894255 12694 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:06:38.895274 21114 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:38.895610 21085 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:38.903861 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.902452 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:38.881335 21057 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:38.905167 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:38.829247 21092 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.911296 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:38.910686 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:38.861611 21008 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:38.917388 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:38.922515 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:38.924300 13230 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 24. Current term is 25. Ops: [22.20-24.21]
I20260709 13:06:38.925446 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:38.909614 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 201803us
I20260709 13:06:38.927081 13227 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:06:38.927616 12510 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:38.928647 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:38.906832 21098 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:38.983160 12511 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.000s	sys 0.009s
W20260709 13:06:38.984445 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 62405.1us
W20260709 13:06:38.983644 12511 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.000s	sys 0.009s
W20260709 13:06:38.986075 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 53494.9us
W20260709 13:06:38.999766 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 72292.1us
I20260709 13:06:39.000669 12510 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:38.921999 21116 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:38.985657 20758 consensus_meta.cc:287] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.668s	user 0.010s	sys 0.002s
I20260709 13:06:38.981338 20948 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:39.019045 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:39.019681 12695 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:06:39.018522 20990 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:39.021032 20579 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:39.022526 21088 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.023065 21088 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:39.024983 20581 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.025524 20581 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:39.027586 20581 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:39.028031 20581 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.028414 20581 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:39.029270 21136 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.029873 21136 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:39.023224 12512 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:39.032171 21136 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:39.032591 21084 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:39.033157 21084 raft_consensus.cc:697] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 21 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:39.033957 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:39.034111 21084 consensus_queue.cc:237] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:39.035238 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:39.036032 12691 raft_consensus.cc:2393] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 25: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:39.037254 12687 raft_consensus.cc:1275] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:06:38.930879 21109 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:39.039166 20581 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:39.039449 21109 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:39.040827 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:38.987542 21098 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:39.044214 21098 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:39.044454 21135 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:39.045095 21135 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.045653 21135 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:39.046223 20962 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:39.039916 20581 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:39.025238 21088 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:39.005520 13197 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.007s	sys 0.005s
W20260709 13:06:39.052186 11443 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 12572)
W20260709 13:06:39.065423 13197 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.008s	sys 0.005s
W20260709 13:06:39.066251 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 661196us
I20260709 13:06:39.091416 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:39.092240 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:39.092823 12616 raft_consensus.cc:2376] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21. Re-sending same reply.
W20260709 13:06:39.096961 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 46306.8us
I20260709 13:06:39.098368 12510 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:39.100446 20737 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 29 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:39.104523 12616 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 28 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 27 index: 20. Preceding OpId from leader: term: 28 index: 21. (index mismatch)
I20260709 13:06:39.107118 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:39.050315 20875 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:39.111593 20875 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 28 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:39.113129 21008 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:39.113950 21109 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:39.120442 21091 log.cc:927] Time spent T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1: Append to log took a long time: real 0.797s	user 0.010s	sys 0.011s
I20260709 13:06:39.061898 20948 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:39.121697 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.123107 20948 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:39.123487 21008 consensus_queue.cc:1048] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:06:39.048790 20758 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:39.125712 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:39.126309 12694 raft_consensus.cc:3060] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:39.128283 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:39.128949 12687 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
W20260709 13:06:39.135010 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 130111us
I20260709 13:06:39.136243 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:39.137199 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:39.137233 12695 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 25.
I20260709 13:06:39.136246 20451 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.138582 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:39.020303 21116 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:39.139114 12510 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:39.136477 13200 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 169 similar messages]
I20260709 13:06:39.147498 12687 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:06:39.150753 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 83877.5us
I20260709 13:06:39.151139 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:39.152011 12687 raft_consensus.cc:2468] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 23.
I20260709 13:06:39.155874 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:39.156536 12696 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Advancing to term 28
I20260709 13:06:39.134588 21132 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:39.162005 12694 raft_consensus.cc:2468] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:06:39.163240 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:39.164242 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:39.165184 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:39.166253 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:39.166836 12620 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:06:39.167892 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:39.170729 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:39.168532 12618 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 25.
I20260709 13:06:39.179268 12615 raft_consensus.cc:1240] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 25 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 24. Current term is 25. Ops: []
W20260709 13:06:39.174042 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 47900.6us
I20260709 13:06:39.180200 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:39.180711 13199 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:39.181291 12510 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:39.182572 12510 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:39.183532 20899 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.184130 20899 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:39.186160 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:39.188653 21116 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:39.186589 20899 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:39.190776 21071 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:06:39.191607 21071 consensus_queue.cc:1243] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Peer 7ad68e814a7741488971822f2598183a log is divergent from this leader: its last log entry 22.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:06:39.193008 21084 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:39.141664 21004 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:39.194617 21004 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:39.195262 21132 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:39.201959 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 66566.9us
I20260709 13:06:39.202834 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:39.205133 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:39.206004 12688 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 25.
I20260709 13:06:39.212631 12510 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:39.216120 12696 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 28.
I20260709 13:06:39.217350 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:39.217954 12696 pending_rounds.cc:85] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 15
I20260709 13:06:39.218293 12696 pending_rounds.cc:107] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260709 13:06:39.218581 12696 raft_consensus.cc:2889] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:39.221201 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:39.222437 12510 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:39.172685 21130 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:39.139706 20451 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:39.230419 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:39.230356 12587 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:39.232169 12587 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:39.232944 21098 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:39.233332 21098 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.233709 21098 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:39.234040 21126 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:39.234813 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:39.235435 12694 raft_consensus.cc:2468] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 18.
I20260709 13:06:39.237097 21141 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:06:39.237721 21141 raft_consensus.cc:697] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 28 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:39.238642 21141 consensus_queue.cc:237] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:39.239352 21004 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:39.216356 20581 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:39.224020 21135 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:39.242626 12512 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:39.243777 12512 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:39.244242 21135 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:39.244894 21135 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:39.245277 21135 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.245536 21085 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:39.246025 21085 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.219689 21129 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:39.246408 21085 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:39.247587 21132 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:39.219890 20758 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.251078 21092 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:39.252835 20975 consensus_meta.cc:287] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.632s	user 0.002s	sys 0.011s
I20260709 13:06:39.248914 20758 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:39.253295 20975 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:39.255465 20758 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:39.211376 20962 raft_consensus.cc:2804] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:39.256443 20962 raft_consensus.cc:697] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:39.257035 12621 raft_consensus.cc:2393] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 21: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:39.257503 12512 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:39.259744 12512 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372
I20260709 13:06:39.228896 12510 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:39.261102 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.263689 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:39.267347 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:39.270048 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 44811.5us
I20260709 13:06:39.272022 12620 raft_consensus.cc:2468] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 29.
I20260709 13:06:39.227761 21088 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:39.276225 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:39.276487 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:39.277490 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 48675.4us
I20260709 13:06:39.278421 12510 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:39.230466 21084 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:39.279657 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
W20260709 13:06:39.288080 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.290356 12510 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:39.299110 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:39.299983 13232 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 27.
I20260709 13:06:39.340174 12687 raft_consensus.cc:2393] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 21: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:39.296795 12512 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
W20260709 13:06:39.345192 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 70084.2us
I20260709 13:06:39.262633 21135 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:39.275825 21004 raft_consensus.cc:2804] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:39.272763 21126 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:06:39.357920 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 67572.4us
W20260709 13:06:39.357735 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 60927.2us
I20260709 13:06:39.360455 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:39.432723 20451 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:39.380278 20966 raft_consensus.cc:2804] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:06:39.273972 20975 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:39.381505 21004 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.301596 21115 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.425949 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:39.505919 13234 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:39.292228 20581 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:39.507719 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:39.508615 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:39.257364 20962 consensus_queue.cc:237] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:39.295672 21130 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:39.409862 13229 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:06:39.478786 13197 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:39.484880 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:39.362046 21124 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.487808 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:39.491948 12690 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 24 index: 21. Preceding OpId from leader: term: 25 index: 21. (term mismatch)
I20260709 13:06:39.526814 12690 pending_rounds.cc:85] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 20
I20260709 13:06:39.527096 12690 pending_rounds.cc:107] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 24.21
I20260709 13:06:39.527318 12690 raft_consensus.cc:2889] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:39.479707 21112 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:39.493443 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:39.494175 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:39.532317 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:39.494483 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:39.507596 21004 raft_consensus.cc:3060] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:39.535509 13234 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 28.
I20260709 13:06:39.503702 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:39.383095 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:39.492666 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:39.528470 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 49890.4us
I20260709 13:06:39.498129 20966 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:39.531603 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:39.495375 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:39.540283 12619 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:06:39.534617 12662 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.538097 13197 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:39.515393 21088 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.508481 20758 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.516080 21129 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:39.543351 13197 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:39.530119 21124 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:39.550001 21092 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:39.549880 13197 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:39.549110 21119 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.533689 20451 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:39.554335 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:39.549110 21088 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:39.543041 20966 raft_consensus.cc:3060] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:39.561358 12588 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:39.521942 21115 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:39.567113 12588 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:39.535151 20975 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.024s
I20260709 13:06:39.532364 21085 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:39.773458 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 206540us
I20260709 13:06:39.555475 21122 raft_consensus.cc:2804] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:06:39.781112 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:39.556229 20451 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:39.557490 21140 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:39.812682 12690 raft_consensus.cc:2393] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 28: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:39.761358 20986 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:06:39.784269 21128 log.cc:927] Time spent T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
W20260709 13:06:39.827823 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.555377 20758 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:39.555856 21129 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:39.764403 21087 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:39.765543 21124 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:39.837405 12619 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 23.
I20260709 13:06:39.774952 21112 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.785279 21070 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:06:39.853446 12694 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.021s	sys 0.059s
I20260709 13:06:39.558272 21119 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:39.877517 12694 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.021s	sys 0.059s
I20260709 13:06:39.879242 21119 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:39.830231 20451 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:39.564935 20980 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.268s
I20260709 13:06:39.859587 21141 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:39.894608 21141 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:39.888991 20451 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:39.831966 21116 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:39.874449 21140 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:39.892757 21092 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.873250 21122 raft_consensus.cc:697] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:39.921150 21031 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:39.869318 21087 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:39.876298 21112 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:39.965009 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:39.965750 12619 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 25.
I20260709 13:06:39.929392 21116 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:39.938406 21140 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:39.940510 21092 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:39.977221 21092 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:39.984665 21151 log.cc:927] Time spent T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:06:39.988255 21071 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:39.988879 21071 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:39.991298 21071 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:40.003062 21154 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:40.004063 21154 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:40.007043 21087 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:40.007766 21087 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:40.008034 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:40.008325 21087 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:40.017128 21156 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:40.017819 21156 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:40.021088 21156 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:40.021894 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:40.022212 21129 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:40.022593 12619 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:40.022923 21115 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:40.029740 21112 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:39.974197 21122 consensus_queue.cc:237] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 27.20, Last appended by leader: 20, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:40.036779 21135 consensus_meta.cc:287] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.639s	user 0.008s	sys 0.002s
I20260709 13:06:40.037319 21135 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:40.039659 21135 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:40.040583 21085 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:39.973819 21141 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:40.050817 13232 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.006s	sys 0.020s
W20260709 13:06:40.051689 13232 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.007s	sys 0.021s
W20260709 13:06:40.064949 11443 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 12572)
I20260709 13:06:40.056097 21115 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:06:40.096462 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:40.091790 21098 consensus_meta.cc:287] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f: Time spent flushing consensus metadata: real 0.858s	user 0.007s	sys 0.005s
I20260709 13:06:40.106113 21140 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:40.109324 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 26 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:40.110435 12694 raft_consensus.cc:2410] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for term 26 because replica has last-logged OpId of term: 22 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 19.
I20260709 13:06:40.093884 21088 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:40.120831 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:40.127774 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 75119.2us
I20260709 13:06:40.108662 21154 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:40.133749 21070 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:40.146981 21070 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:40.149185 21070 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:40.151788 21116 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:40.128427 21140 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:40.145068 21160 consensus_queue.cc:1048] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:06:40.104111 21098 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:40.139789 12659 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:40.180373 12659 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:40.179826 21116 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:40.183151 12613 raft_consensus.cc:2393] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 26: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:40.184289 21098 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:40.194000 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 55460.5us
I20260709 13:06:40.196260 12659 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:40.197240 21165 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:40.197682 21165 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.198029 21165 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:40.199160 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:40.200209 12687 raft_consensus.cc:3060] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:40.206532 21165 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:40.209553 12659 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:40.185935 21004 consensus_meta.cc:287] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653: Time spent flushing consensus metadata: real 0.639s	user 0.006s	sys 0.006s
I20260709 13:06:40.211604 12687 raft_consensus.cc:2468] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 26.
I20260709 13:06:40.170598 20966 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:40.214926 12615 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41084 (request call id 4461) took 2040 ms. Trace:
I20260709 13:06:40.215096 20966 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:40.215593 12615 rpcz_store.cc:276] 0709 13:06:38.174659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:38.175041 (+   382us) service_pool.cc:224] Handling call
0709 13:06:38.175401 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.179751 (+1004350us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.214630 (+1034879us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54001ca554. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:40.214854 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2308188544}
I20260709 13:06:40.227658 21085 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:40.228302 21085 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:40.229285 21088 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:40.229862 21088 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:40.230587 12689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:46988 (request call id 2098) took 1219 ms. Trace:
I20260709 13:06:40.231187 12689 rpcz_store.cc:276] 0709 13:06:39.011093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.011638 (+   545us) service_pool.cc:224] Handling call
0709 13:06:39.028889 (+ 17251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:39.176004 (+147115us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.176036 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:39.176075 (+    39us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:06:39.176113 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.230346 (+1054233us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b540009f454. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9579e01 00007fc3a957883e 00007fc3ae53d419 00007fc3a7ab4bd4 00007fc3a7ab4b62 00007fc3a7ab4a91 00007fc3a7ab4a0c 00007fc3a7ab3cc2 00007fc3a78b448c 00007fc3a78b38c6
0709 13:06:40.230393 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:40.230527 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":337851776}
I20260709 13:06:40.231950 21088 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:40.232715 20451 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:40.211750 21154 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.043s
I20260709 13:06:40.238389 21004 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:40.242974 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:40.244014 12689 raft_consensus.cc:2368] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 25. Current term is 26.
I20260709 13:06:40.180119 21140 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:40.246502 13199 leader_election.cc:400] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 election: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 25. Current term is 26.
I20260709 13:06:40.248420 13199 leader_election.cc:403] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 13:06:40.222848 21115 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:40.211521 21160 raft_consensus.cc:2804] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:40.251461 13230 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 LEADER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 28. Current term is 29. Ops: []
I20260709 13:06:40.252385 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:40.253053 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:40.255143 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:40.254015 20881 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:40.257419 21085 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:40.259557 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:40.259686 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:40.261693 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:40.240957 21004 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 election: Requested vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:40.240595 20451 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:40.266352 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:40.265381 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:40.266544 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:40.267580 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:40.268128 12618 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 23.
I20260709 13:06:40.270771 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:06:40.271318 12659 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.273260 12615 raft_consensus.cc:1240] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 22. Current term is 23. Ops: [21.11-22.12]
I20260709 13:06:40.249470 21115 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:40.271335 12619 raft_consensus.cc:3060] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:40.250402 21119 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:40.252151 21161 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:40.276320 12618 raft_consensus.cc:1240] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 29 FOLLOWER]: Rejecting Update request from peer 7ad68e814a7741488971822f2598183a for earlier term 28. Current term is 29. Ops: [28.21-28.21]
W20260709 13:06:40.276731 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 77964us
I20260709 13:06:40.278115 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:40.279881 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:40.286420 21169 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.288471 21169 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:40.289805 12513 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:40.291301 21169 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:40.274021 20451 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:40.292562 21083 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:40.289654 21161 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:40.326849 20881 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) with higher term. Message: Invalid argument: T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 25. Current term is 26.
I20260709 13:06:40.327562 20451 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:40.327818 21161 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:40.294195 12587 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:40.329272 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:40.268537 21165 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:40.276348 21115 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:40.296092 20743 consensus_queue.cc:1059] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:40.287103 21119 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:40.300715 21140 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:40.303038 12619 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 26.
W20260709 13:06:40.309684 21142 log.cc:927] Time spent T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 1.170s	user 0.014s	sys 0.016s
I20260709 13:06:40.331214 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:40.359241 12659 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:40.351023 20899 raft_consensus.cc:2804] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:06:40.359833 21160 raft_consensus.cc:697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 21 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:06:40.360590 20992 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.236s	user 0.014s	sys 0.009s
W20260709 13:06:40.370668 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 62023.1us
I20260709 13:06:40.350397 20539 consensus_queue.cc:1059] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: INVALID_TERM, Last received: 27.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.017s
I20260709 13:06:40.362949 21165 raft_consensus.cc:3055] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:06:40.364326 20948 raft_consensus.cc:2804] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election won for term 26
W20260709 13:06:40.371383 20992 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.247s	user 0.015s	sys 0.009s
I20260709 13:06:40.380291 21119 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:40.375285 20899 raft_consensus.cc:697] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 26 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
W20260709 13:06:40.387219 21162 log.cc:927] Time spent T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.251s	user 0.000s	sys 0.003s
I20260709 13:06:40.386791 20899 consensus_queue.cc:237] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:40.393683 21160 consensus_queue.cc:237] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:40.403043 20893 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:40.403795 20893 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:40.373745 21165 raft_consensus.cc:740] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:40.408530 21165 consensus_queue.cc:260] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:40.409754 21165 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:40.413456 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:40.414865 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:40.416800 21119 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:40.417336 21119 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:40.418731 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:40.419371 20758 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:40.419838 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:40.419421 21119 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:40.421878 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:40.422972 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:40.423046 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:40.426019 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:40.426963 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:40.427770 13228 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 13:06:40.429847 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:40.430596 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:40.433805 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:40.437409 21131 log.cc:927] Time spent T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 1.312s	user 0.008s	sys 0.011s
I20260709 13:06:40.439721 20996 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:06:40.441962 20901 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:40.442543 20901 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:40.452044 20980 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:40.452733 20980 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:40.455538 20980 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:40.464371 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:40.468014 13229 raft_consensus.cc:2468] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 26.
W20260709 13:06:40.486958 13235 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57404 (request call id 1510) took 1248 ms (client timeout 1651 ms). Trace:
W20260709 13:06:40.487421 13235 rpcz_store.cc:269] 0709 13:06:39.230059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.230175 (+   116us) service_pool.cc:224] Handling call
0709 13:06:40.478670 (+1248495us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b54005d3254. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957d2fa 00007fc3ae53eb17 00007fc3a7ab96d4 00007fc3a7ab9662 00007fc3a7ab9591 00007fc3a7ab950c 00007fc3a7ab87c2 00007fc3a78b448c 00007fc3a78b38c6 00007fc3a78b326f
0709 13:06:40.478815 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1958877952}
I20260709 13:06:40.495608 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:40.499073 21087 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:40.472587 21123 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:40.522188 20901 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:40.526741 20539 raft_consensus.cc:3055] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 28 LEADER]: Stepping down as leader of term 28
I20260709 13:06:40.528829 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcafb50fd3c47afbf475b1da51b147a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:40.554844 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:40.558043 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 65317.5us
I20260709 13:06:40.564684 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:40.557381 20948 raft_consensus.cc:697] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 26 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:40.566588 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:40.566368 20948 consensus_queue.cc:237] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:40.560716 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 28 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:40.573298 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:40.574878 12444 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36394 (request call id 344) took 19498 ms (client timeout 15000 ms). Trace:
I20260709 13:06:40.574322 12615 raft_consensus.cc:2468] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:06:40.586338 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d83186354414170b4775351916c56c2" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:40.591490 12615 raft_consensus.cc:2368] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 25. Current term is 26.
I20260709 13:06:40.547308 20539 raft_consensus.cc:740] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:40.569657 20986 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:40.590656 13200 leader_election.cc:336] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:40.587504 21004 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.587157 20966 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.586968 21173 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:40.589816 21136 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.618827 20539 consensus_queue.cc:260] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 28.21, Last appended by leader: 21, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:40.620378 20966 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:40.596567 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 26 candidate_status { last_received { term: 21 index: 19 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:40.528424 21123 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:40.604579 13200 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:40.577226 21172 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:40.617771 21004 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:40.630724 21173 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:40.620428 20539 raft_consensus.cc:3060] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:06:40.635831 12661 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.613644 12662 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:40.634799 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 44175.7us
I20260709 13:06:40.631733 21136 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:40.648324 21123 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:40.645218 21115 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:40.637111 21172 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:40.650779 21115 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:40.649721 12693 raft_consensus.cc:1240] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Rejecting Update request from peer 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 21. Current term is 22. Ops: []
I20260709 13:06:40.651187 21136 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:40.663116 20966 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:40.666966 21004 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:40.605499 20893 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:40.668381 21115 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:40.669147 21115 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:40.671741 20838 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:40.605917 20986 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:40.676976 21156 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:06:40.677175 13200 leader_election.cc:336] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:40.675972 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 62421.8us
I20260709 13:06:40.685002 12662 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:40.690642 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 32 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:40.693862 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:40.695108 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:40.696231 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:40.704386 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:40.705607 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:40.671345 21115 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:40.746867 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:40.575459 12444 rpcz_store.cc:269] 0709 13:06:21.060580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.144213 (+11083633us) service_pool.cc:224] Handling call
0709 13:06:32.428553 (+284340us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b5400002490. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a64550b2 00007fc3af3cea89 00007fc3af366da6 00007fc3af338088 00007fc3af43637e 00007fc3ad8f72a4 00007fc3ad8f7232 00007fc3ad8f7161 00007fc3ad8f70dc
0709 13:06:40.558789 (+8130236us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:36.448398 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:36.450383 (+  1985us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:36.450439 (+    56us) write_op.cc:435] Acquired schema lock
0709 13:06:36.450467 (+    28us) tablet.cc:662] Decoding operations
0709 13:06:36.452578 (+  2111us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:36.452704 (+   126us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:36.452736 (+    32us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:06:36.472044 (+ 19308us) tablet.cc:701] Row locks acquired
0709 13:06:36.472113 (+    69us) write_op.cc:260] PREPARE: finished
0709 13:06:36.472343 (+   230us) write_op.cc:270] Start()
0709 13:06:36.472558 (+   215us) write_op.cc:276] Timestamp: P: 1783602396472254 usec, L: 0
0709 13:06:36.472586 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:06:36.492011 (+ 19425us) log.cc:844] Serialized 8345 byte log entry
0709 13:06:36.809626 (+317615us) op_driver.cc:464] REPLICATION: finished
0709 13:06:37.147892 (+338266us) write_op.cc:301] APPLY: starting
0709 13:06:37.148001 (+   109us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:37.464944 (+316943us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:37.465050 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:37.994856 (+529806us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:37.995290 (+   434us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:06:37.995348 (+    58us) write_op.cc:312] APPLY: finished
0709 13:06:37.995843 (+   495us) log.cc:844] Serialized 188 byte log entry
0709 13:06:38.216563 (+220720us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:38.216804 (+   241us) write_op.cc:454] Released schema lock
0709 13:06:38.216881 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:38.217430 (+   549us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:38.217471 (+    41us) write_op.cc:454] Released schema lock
0709 13:06:39.119647 (+902176us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a911486e 00007fc3a9113bb6 00007fc3a91137d8 00007fc3a911d221 00007fc3a911d1d9 00007fc3a911d169
Metrics: {"reported_tablets":47,"spinlock_wait_cycles":37681920,"child_traces":[["op",{"apply.queue_time_us":333284,"apply.run_cpu_time_us":73984,"apply.run_wall_time_us":1069460,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91949,"num_ops":21,"prepare.queue_time_us":109755,"prepare.run_cpu_time_us":15429,"prepare.run_wall_time_us":127527,"raft.queue_time_us":196702,"raft.run_cpu_time_us":99948,"raft.run_wall_time_us":307801,"replication_time_us":313163,"spinlock_wait_cycles":33466240,"thread_start_us":730680,"threads_started":5,"wal-append.queue_time_us":389642,"wal-append.run_cpu_time_us":57710,"wal-append.run_wall_time_us":3111120}]]}
I20260709 13:06:40.748277 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:40.749246 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:40.750149 12689 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:40.750504 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:40.751271 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:40.750094 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:40.753223 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:40.761029 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:40.763098 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:40.764986 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:40.748387 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:40.767563 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:40.768566 12619 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
I20260709 13:06:40.773154 12691 raft_consensus.cc:2393] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 in current term 26: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
W20260709 13:06:40.790078 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 100821us
I20260709 13:06:40.790880 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:40.791745 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:40.744724 21156 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:40.798586 12696 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 13:06:40.800202 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:40.803022 12689 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:06:40.807745 12618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:40.807875 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:40.809892 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:40.813906 20992 consensus_queue.cc:1059] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:40.815174 21008 raft_consensus.cc:3055] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:06:40.815563 21008 raft_consensus.cc:740] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:40.816407 21008 consensus_queue.cc:260] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:40.820345 20893 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:06:40.826021 12613 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:06:40.826285 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 222249us
I20260709 13:06:40.828208 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:40.828305 21008 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:40.841338 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:40.843070 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:40.845484 12615 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:06:40.843641 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:40.848752 13197 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:40.843799 12689 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:06:40.845212 12512 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:40.863572 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:40.866587 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:40.851414 12588 consensus_peers.cc:597] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:40.874985 21193 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:40.875640 21193 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:40.878146 20758 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:06:40.881520 12588 consensus_peers.cc:597] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:40.884590 12615 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 19.
I20260709 13:06:40.886829 21004 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:40.888406 12510 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:40.887507 12512 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:40.890899 12512 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:40.892379 12512 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:40.893651 12510 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:40.898589 20451 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:40.900880 20966 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:40.902947 12510 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:40.908627 12510 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:40.909040 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 32 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:40.921725 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:40.927402 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 131073us
I20260709 13:06:40.919775 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:40.925293 12615 raft_consensus.cc:1275] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:06:40.905026 21004 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:06:40.906607 21083 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:40.889797 20758 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:40.909081 12512 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:40.931321 20986 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:41.001685 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 93170.2us
W20260709 13:06:41.003831 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 155166us
I20260709 13:06:40.931365 21193 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:40.917773 20966 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:06:40.918064 21135 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:40.940703 21172 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:40.963073 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 114318us
W20260709 13:06:41.002705 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 93716.8us
W20260709 13:06:41.012890 13200 leader_election.cc:336] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:41.014359 13200 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:41.015161 12662 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:41.004842 13197 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:41.017907 12694 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 29 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 28 index: 21. Preceding OpId from leader: term: 29 index: 21. (term mismatch)
I20260709 13:06:41.018324 12694 pending_rounds.cc:85] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 20
I20260709 13:06:41.018564 12694 pending_rounds.cc:107] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 28.21
W20260709 13:06:41.005183 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 62461.9us
I20260709 13:06:41.019217 21123 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:06:41.001996 20965 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:41.021200 21115 consensus_queue.cc:1048] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:06:41.004302 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:41.006227 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:41.007898 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:41.018803 12694 raft_consensus.cc:2889] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:41.003422 21083 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:06:41.027365 12696 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:06:41.030628 13197 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:41.036787 12512 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:06:41.040704 13200 leader_election.cc:336] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:41.046696 20896 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:41.040493 12512 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:41.043234 21083 raft_consensus.cc:697] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 19 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:41.052031 21083 consensus_queue.cc:237] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:41.054368 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 50159.4us
I20260709 13:06:41.055357 21193 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:41.055496 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:41.056336 20758 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:41.056741 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a
I20260709 13:06:41.057463 20758 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:41.057999 20758 raft_consensus.cc:697] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 23 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:41.058820 20758 consensus_queue.cc:237] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:41.017993 21165 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:06:41.065491 11443 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 12572)
I20260709 13:06:41.044489 20965 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 13:06:41.073122 20966 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:41.073941 20966 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:06:41.075994 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 46238.1us
W20260709 13:06:41.076310 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 45815.2us
I20260709 13:06:41.076793 20901 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:41.077310 13197 leader_election.cc:400] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 election: Vote denied by peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653) with higher term. Message: Invalid argument: T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 for earlier term 25. Current term is 26.
I20260709 13:06:41.077699 20901 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 13:06:41.079098 13197 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:41.080570 21123 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:41.032337 21115 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.081743 21115 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:41.082492 13197 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:41.083927 21115 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:41.084249 20992 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:41.084702 20992 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:41.085078 20992 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:41.088357 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:41.089272 12615 raft_consensus.cc:2410] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ad68e814a7741488971822f2598183a for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
W20260709 13:06:41.090444 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 46198.8us
I20260709 13:06:41.091171 13197 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:41.094184 12687 raft_consensus.cc:1275] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 26 index: 15. (index mismatch)
I20260709 13:06:41.094635 12510 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:41.096527 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 50146.1us
W20260709 13:06:41.098896 13200 leader_election.cc:336] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:41.100205 21195 log.cc:927] Time spent T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:06:41.100394 21165 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:41.119326 21165 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:41.123401 13235 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:06:41.104100 21173 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:41.106454 20996 consensus_queue.cc:1048] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:06:41.113940 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:41.115785 13200 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:41.133865 13200 leader_election.cc:336] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:41.134757 13200 leader_election.cc:336] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:41.135123 13200 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:41.116832 12510 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:41.117455 21198 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:41.118687 20965 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:41.121364 21165 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:41.152588 12510 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:41.096253 21196 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:41.154505 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:41.154827 13200 leader_election.cc:336] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:41.158941 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 43571.6us
I20260709 13:06:41.159122 13200 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:41.176307 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:41.142659 21008 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:06:41.185199 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 56475.3us
I20260709 13:06:41.178854 12510 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:41.183174 12615 raft_consensus.cc:1275] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:06:41.183264 12613 raft_consensus.cc:1275] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 29 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 27 index: 20. Preceding OpId from leader: term: 29 index: 21. (index mismatch)
I20260709 13:06:41.190160 21085 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:41.177680 21198 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:41.195623 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:41.198699 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:41.202042 12510 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:41.204419 13233 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 21 index: 19. Preceding OpId from leader: term: 25 index: 21. (index mismatch)
I20260709 13:06:41.159806 20758 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:06:41.172590 20838 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:06:41.141158 20539 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.045s
I20260709 13:06:41.213649 13235 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 13:06:41.225715 13200 leader_election.cc:336] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:41.226348 13200 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:41.193094 21004 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:41.232748 20901 consensus_queue.cc:1048] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260709 13:06:41.208142 21085 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:41.210213 20591 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.196769 20965 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:06:41.237416 21123 consensus_queue.cc:1048] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.024s
I20260709 13:06:41.239770 21008 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:06:41.278386 21201 log.cc:927] Time spent T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:06:41.281278 21070 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:41.282073 21070 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:41.285336 21070 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:41.292548 12587 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:41.295289 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 70762.4us
I20260709 13:06:41.305786 12588 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:06:41.313246 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 74535.7us
W20260709 13:06:41.251946 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 50019.9us
I20260709 13:06:41.319849 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:41.312777 21193 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.327559 21193 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:41.300585 20965 consensus_queue.cc:1243] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer a11816c5d72e4d1295a242f3ced09e5f log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:06:41.334014 21193 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:41.247189 20591 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:41.336656 20591 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:41.307272 21085 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:41.339599 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:41.312170 20893 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:41.350091 12613 raft_consensus.cc:1275] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
W20260709 13:06:41.372546 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 52828.8us
I20260709 13:06:41.392932 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:41.333415 20992 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:41.389822 21083 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:41.365584 20948 consensus_queue.cc:1048] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.042s
I20260709 13:06:41.405725 20758 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.235081 12437 catalog_manager.cc:5697] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 9 to 15. New cstate: current_term: 15 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:41.421877 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 203734us
I20260709 13:06:41.476786 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:41.482436 13234 raft_consensus.cc:1240] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 20. Current term is 21. Ops: []
I20260709 13:06:41.494679 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:41.490046 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 55285.3us
I20260709 13:06:41.520553 20893 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:06:41.540820 20966 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:41.548243 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:41.549415 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:41.431043 20758 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:41.564160 12615 pending_rounds.cc:85] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Aborting all ops after (but not including) 12
I20260709 13:06:41.564517 12615 pending_rounds.cc:107] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260709 13:06:41.564759 12615 raft_consensus.cc:2889] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:41.568742 13200 consensus_peers.cc:597] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:41.528389 21203 log.cc:927] Time spent T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:06:41.473441 20986 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.055s
I20260709 13:06:41.579303 12510 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:41.534832 21135 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:41.583910 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 68554.8us
I20260709 13:06:41.601145 12613 raft_consensus.cc:1275] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:06:41.602443 12588 leader_election.cc:336] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:41.541417 20966 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:41.583118 21115 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.594470 21135 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:41.601004 12662 leader_election.cc:336] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:41.603029 12588 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:41.627223 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:41.631956 12662 leader_election.cc:336] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:41.632479 12662 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:41.634099 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 75485.9us
W20260709 13:06:41.670636 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 68417.2us
W20260709 13:06:41.672542 12662 leader_election.cc:336] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:41.672693 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 70272.8us
I20260709 13:06:41.673213 12662 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:41.674837 12662 leader_election.cc:336] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:41.675544 12662 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:41.670375 20591 raft_consensus.cc:493] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:41.666669 21165 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:41.635934 20539 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:06:41.688097 20996 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:41.712126 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:41.629824 21115 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:41.711983 12512 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 47935us
I20260709 13:06:41.698977 21156 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:41.688442 21212 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:06:41.742870 12588 consensus_peers.cc:597] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:41.743572 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 69993.6us
W20260709 13:06:41.744410 12588 leader_election.cc:336] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:41.746233 12588 leader_election.cc:336] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:41.699550 20992 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:41.683986 21208 consensus_queue.cc:1059] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.029s
I20260709 13:06:41.697801 21215 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:41.697296 20591 raft_consensus.cc:515] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:41.755828 12513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 57338.3us
W20260709 13:06:41.768576 21204 log.cc:927] Time spent T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 13:06:41.775416 12588 leader_election.cc:336] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:41.776393 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:41.777823 12688 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 23 index: 12. (term mismatch)
I20260709 13:06:41.778426 12688 pending_rounds.cc:85] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a: Aborting all ops after (but not including) 11
I20260709 13:06:41.778728 12688 pending_rounds.cc:107] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a: Aborting uncommitted NO_OP operation due to leader change: 22.12
I20260709 13:06:41.779032 12688 raft_consensus.cc:2889] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:41.759755 21205 log.cc:927] Time spent T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.280s	user 0.001s	sys 0.000s
W20260709 13:06:41.792160 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 212998us
I20260709 13:06:41.793190 12510 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:41.756199 20966 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:41.779433 12588 leader_election.cc:336] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:41.802472 12588 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:41.803787 21135 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:41.808382 12588 leader_election.cc:336] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:41.808621 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:41.809136 12588 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:41.809526 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 48600.4us
I20260709 13:06:41.811058 12694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:41.785964 20875 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:41.812212 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:41.813365 12588 leader_election.cc:336] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:41.793349 21215 raft_consensus.cc:3055] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:06:41.821763 12588 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:41.815269 20893 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:41.816570 21141 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:41.826663 20966 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:06:41.835687 12588 leader_election.cc:336] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:41.821452 21215 raft_consensus.cc:740] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:41.839367 20875 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:41.863130 21115 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:41.885937 12615 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:41.886667 12615 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 23.
I20260709 13:06:41.899188 21224 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.906199 21224 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:41.912053 21224 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:41.842876 20758 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:41.912935 21215 consensus_queue.cc:260] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:41.909014 21211 log.cc:927] Time spent T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a: Append to log took a long time: real 0.199s	user 0.005s	sys 0.000s
I20260709 13:06:41.899477 20966 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.916864 20966 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:41.917557 21215 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:41.918977 20966 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:41.934089 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 98518.4us
W20260709 13:06:41.935642 12588 leader_election.cc:336] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:41.936321 12588 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:41.937674 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 262863us
W20260709 13:06:41.947504 12588 leader_election.cc:336] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:41.948501 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:41.951668 12588 leader_election.cc:336] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:41.952122 12588 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:41.955649 12588 leader_election.cc:336] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:41.956066 12588 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:41.987560 12662 leader_election.cc:336] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:41.948395 21168 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:41.995280 12662 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:41.999342 12662 leader_election.cc:336] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:41.999778 12662 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:41.988782 21217 log.cc:927] Time spent T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.170s	user 0.002s	sys 0.000s
W20260709 13:06:42.002163 12662 leader_election.cc:336] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:41.971318 21095 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:42.013875 21227 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:42.001214 21165 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:41.996313 20893 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:42.020011 12662 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:41.986433 20875 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:42.022120 21165 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:42.024160 12662 leader_election.cc:336] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:42.026269 12662 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:42.027877 12662 consensus_peers.cc:597] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:42.035140 12662 leader_election.cc:336] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:42.035642 12662 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:42.033864 20966 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:06:42.028368 21165 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:42.050596 21123 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.051299 21123 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:42.055850 20966 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.056474 20966 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:42.065973 11443 thread.cc:527] Waited for 4000ms trying to join with heartbeat (tid 12572)
I20260709 13:06:42.067804 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:42.068344 12688 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 22.
I20260709 13:06:42.071907 21215 raft_consensus.cc:493] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.072479 21215 raft_consensus.cc:515] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:42.074321 21123 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:42.075166 12687 raft_consensus.cc:1275] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:06:42.081045 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:42.081715 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:42.083403 12617 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:42.120340 21165 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:42.139362 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:42.137346 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 102221us
W20260709 13:06:42.152684 12662 leader_election.cc:336] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:42.155229 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:42.167738 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:42.172520 12588 leader_election.cc:336] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:42.172952 12588 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:42.167716 12615 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 13:06:42.175508 12510 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:42.177471 12588 leader_election.cc:336] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:42.177960 12588 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:42.179268 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f46dfbe6726b4cdd862263f711c7d5d9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:42.181419 12662 leader_election.cc:336] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:42.181951 21083 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:42.184301 12512 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:42.186072 12512 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:42.165625 20899 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:42.199066 13200 leader_election.cc:336] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:42.177894 21004 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:42.178906 21140 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:06:42.201292 13200 consensus_peers.cc:597] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:42.178813 21165 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:42.204241 20899 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:42.187763 21208 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:42.197959 20965 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:42.217203 20966 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:42.219298 20975 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:42.219657 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:42.177189 21223 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:06:42.223681 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:42.224565 12687 raft_consensus.cc:2393] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 22: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:42.225308 21215 leader_election.cc:290] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:42.222230 20899 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:42.233992 13200 consensus_peers.cc:597] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:42.247943 13200 consensus_peers.cc:597] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:42.251619 13200 consensus_peers.cc:597] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:42.258690 20591 leader_election.cc:290] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:42.263761 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 30 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:42.283560 13200 consensus_peers.cc:597] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:42.284714 13200 consensus_peers.cc:597] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:42.285269 13200 consensus_peers.cc:597] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:42.299700 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 122252us
W20260709 13:06:42.300405 12588 consensus_peers.cc:597] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:42.305608 12588 leader_election.cc:336] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:42.292217 13200 consensus_peers.cc:597] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:42.307085 13200 consensus_peers.cc:597] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:42.307763 13200 consensus_peers.cc:597] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:42.308627 13200 consensus_peers.cc:597] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:42.306149 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:42.313072 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:42.316874 20986 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:42.320144 21210 log.cc:927] Time spent T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.605s	user 0.009s	sys 0.001s
I20260709 13:06:42.320748 20992 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:42.320989 20962 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:42.321905 20962 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:42.321213 20992 raft_consensus.cc:493] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.324363 20992 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:42.325732 20962 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:42.314635 21236 log.cc:927] Time spent T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.076s	user 0.000s	sys 0.002s
I20260709 13:06:42.333740 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:42.334551 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:42.335304 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:42.339012 12659 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:42.313756 20758 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
W20260709 13:06:42.349771 13200 consensus_peers.cc:597] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:42.352257 12588 leader_election.cc:336] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:42.354064 13197 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:42.352833 12588 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:42.361690 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:42.360492 12513 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:42.364171 12513 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:42.370012 21208 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:42.342017 21193 raft_consensus.cc:493] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:42.342237 21071 raft_consensus.cc:493] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:42.345862 21173 raft_consensus.cc:493] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:42.394680 12619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:42.395481 12619 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:06:42.367098 21115 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:42.371765 21221 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:42.442920 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 50488.9us
I20260709 13:06:42.387939 21226 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:06:42.450802 21239 log.cc:927] Time spent T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:06:42.452155 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:42.453323 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 88832.6us
I20260709 13:06:42.452247 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a059fe8e339d4b8f8fd0c9f18705f015" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:42.415162 21173 raft_consensus.cc:515] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:42.470323 12510 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:42.438275 21236 log.cc:927] Time spent T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:06:42.358834 20758 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:42.410681 20591 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:42.481205 12510 leader_election.cc:304] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:42.484061 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 73000.6us
I20260709 13:06:42.489195 12620 raft_consensus.cc:2410] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a70479a3b4114f3581095e9890f5d653 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:06:42.410322 21071 raft_consensus.cc:515] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:42.476523 21135 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:42.397888 21193 raft_consensus.cc:515] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:42.476691 21224 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:06:42.494243 20966 raft_consensus.cc:2749] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:06:42.520654 21193 leader_election.cc:290] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:42.552876 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 179332us
I20260709 13:06:42.554484 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:42.554652 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:42.555495 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:42.535063 21244 log.cc:927] Time spent T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:06:42.557113 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:42.557873 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd40576623a84072be59a32d23cda14b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 30 candidate_status { last_received { term: 29 index: 21 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:42.537298 20758 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:42.566471 21071 leader_election.cc:290] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:42.584581 20992 raft_consensus.cc:515] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:42.586265 13232 raft_consensus.cc:2368] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 22. Current term is 23.
I20260709 13:06:42.586926 20992 leader_election.cc:290] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:42.589792 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:42.590674 12693 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:42.614740 12693 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 23.
I20260709 13:06:42.616333 13199 leader_election.cc:304] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:42.618355 20896 raft_consensus.cc:2804] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:42.619130 20896 raft_consensus.cc:697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:42.620116 20896 consensus_queue.cc:237] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:42.618414 21115 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:42.622916 21115 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:42.627823 13197 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
W20260709 13:06:42.631695 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 126983us
I20260709 13:06:42.667070 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:42.670249 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f6ccc9457e2e4aeaac5163b9bb9f13cb" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:42.677518 12510 leader_election.cc:304] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:42.681422 20983 raft_consensus.cc:2749] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:42.679785 12510 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:42.656637 20992 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:42.696667 21115 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:42.702101 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 144845us
I20260709 13:06:42.682606 21085 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.708086 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:42.714684 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cba1eecd7bd4c2b913bcfdaa3c7c88c" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:42.715391 12620 raft_consensus.cc:3060] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:06:42.718602 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:42.686774 20983 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:42.724709 12696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d21e2686d5e84f6495f1b6f8a9b68dca" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:42.707445 21085 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:42.762094 21085 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:42.769884 21173 leader_election.cc:290] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:42.773964 21115 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:42.870074 12616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
W20260709 13:06:42.885236 12662 consensus_peers.cc:597] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:42.930051 21208 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.931577 21208 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:42.934273 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:42.963550 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 49540us
W20260709 13:06:42.941111 13200 leader_election.cc:336] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:43.003381 21208 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:43.014914 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 74143.1us
I20260709 13:06:43.020771 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:43.022425 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 46858.9us
I20260709 13:06:43.032016 12588 leader_election.cc:304] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:43.033365 21095 raft_consensus.cc:2749] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:06:43.038784 21085 raft_consensus.cc:493] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.039767 21085 raft_consensus.cc:515] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:43.041149 12693 raft_consensus.cc:1240] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Rejecting Update request from peer a70479a3b4114f3581095e9890f5d653 for earlier term 23. Current term is 24. Ops: []
I20260709 13:06:43.041303 12695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:43.042526 21085 leader_election.cc:290] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:43.071846 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 54277.5us
I20260709 13:06:43.081974 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:43.086655 11443 thread.cc:527] Waited for 5000ms trying to join with heartbeat (tid 12572)
I20260709 13:06:43.076208 12436 catalog_manager.cc:5697] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 15 to 20, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 20 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:06:43.101518 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 69879.9us
I20260709 13:06:43.102809 12512 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:43.100867 20881 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:06:43.093737 12662 leader_election.cc:336] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:43.110664 12662 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:43.112480 20881 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:43.116623 21085 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:43.133646 20965 consensus_queue.cc:1059] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: INVALID_TERM, Last received: 23.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:06:43.135037 21004 raft_consensus.cc:3055] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:06:43.135499 21004 raft_consensus.cc:740] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:43.123237 21087 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:06:43.136873 21004 consensus_queue.cc:260] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:43.151134 21004 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:43.151445 21225 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:43.152304 21225 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:43.158406 12662 consensus_peers.cc:597] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:43.164963 12688 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:06:43.167404 21225 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:43.168133 12620 raft_consensus.cc:2468] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 23.
I20260709 13:06:43.178479 20881 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:43.195171 12588 leader_election.cc:400] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 22. Current term is 23.
I20260709 13:06:43.195618 12588 leader_election.cc:403] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:43.196451 21260 raft_consensus.cc:2749] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) with higher term. Message: Invalid argument: T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f for earlier term 22. Current term is 23.
I20260709 13:06:43.200286 12436 catalog_manager.cc:5697] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 15 to 16, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 16 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:43.203898 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:43.206069 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:43.197351 12588 leader_election.cc:304] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
W20260709 13:06:43.221623 12662 consensus_peers.cc:597] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:43.220093 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:43.216725 21095 raft_consensus.cc:2749] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:06:43.232666 12512 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:43.238947 12662 consensus_peers.cc:597] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:43.241858 12662 consensus_peers.cc:597] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:43.249709 13199 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:43.239804 21250 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:06:43.263865 21226 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:06:43.268280 12662 consensus_peers.cc:597] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:43.280817 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddff67072e694e36addbc3b673b008d0" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:43.295241 12436 catalog_manager.cc:5697] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 7 to 18, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 18 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:43.300238 12436 catalog_manager.cc:5697] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 12 to 20, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 20 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:43.338702 12620 raft_consensus.cc:1275] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 13:06:43.344085 20881 consensus_queue.cc:1048] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:06:43.348044 12588 leader_election.cc:336] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:43.353740 21004 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.354421 21004 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:43.356310 12588 leader_election.cc:304] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:43.366060 21260 raft_consensus.cc:2749] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:43.356961 21004 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:43.358135 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:43.358939 12437 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50014 (request call id 226) took 81717 ms (client timeout 15000 ms). Trace:
I20260709 13:06:43.395987 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:43.399263 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0767462f04d344b5a4fce9de7e885245" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:43.410588 12662 consensus_peers.cc:597] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:43.419371 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb8ee8ee1a2c43cc9dc422f32773a55b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:43.423328 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67b0620b67b94f25ad79a8b18732686a" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:43.390424 12437 rpcz_store.cc:269] 0709 13:05:21.641397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.641887 (+   490us) service_pool.cc:224] Handling call
0709 13:06:43.358537 (+81716650us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:42.046176 (+     0us) spinlock_profiling.cc:243] Waited 9.47 ms on lock 0x7b4400022b4c. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a63b2c85 00007fc3a63b36a2 00007fc3a91251db 00007fc3a9120aaf 00007fc3a646f0ac 00007fc3af2c9ab9 00007fc3a648b69b 00007fc3a648993f 00007fc3a6489455 00007fc3acfae16c
0709 13:06:42.218509 (+172333us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:42.219068 (+   559us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:42.219103 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:06:42.219120 (+    17us) tablet.cc:662] Decoding operations
0709 13:06:42.219444 (+   324us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:42.219519 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:42.219552 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:42.219729 (+   177us) tablet.cc:701] Row locks acquired
0709 13:06:42.219746 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:06:42.219890 (+   144us) write_op.cc:270] Start()
0709 13:06:42.220088 (+   198us) write_op.cc:276] Timestamp: P: 1783602402219829 usec, L: 0
0709 13:06:42.220107 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:06:42.220762 (+   655us) log.cc:844] Serialized 536 byte log entry
0709 13:06:42.562144 (+341382us) op_driver.cc:464] REPLICATION: finished
0709 13:06:42.658209 (+ 96065us) write_op.cc:301] APPLY: starting
0709 13:06:42.658325 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:42.659590 (+  1265us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:42.659616 (+    26us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:42.770301 (+110685us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b5400235fd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a957632a 00007fc3a94fbf14 00007fc3a94fbec3 00007fc3a94fbe38 00007fc3a94fbdf3 00007fc3a94fb0dc 00007fc3a9524e16 00007fc3a950ccbb 00007fc3a94f739d 00007fc3a94fad75
0709 13:06:42.774510 (+  4209us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:42.774760 (+   250us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:06:42.774819 (+    59us) write_op.cc:312] APPLY: finished
0709 13:06:42.775061 (+   242us) log.cc:844] Serialized 25 byte log entry
0709 13:06:42.775254 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:42.775344 (+    90us) write_op.cc:454] Released schema lock
0709 13:06:42.775385 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:42.775831 (+   446us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:42.775871 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":225187,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":95624,"apply.run_cpu_time_us":5076,"apply.run_wall_time_us":117624,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":354829,"prepare.run_cpu_time_us":56045,"prepare.run_wall_time_us":104450,"raft.queue_time_us":99830,"raft.run_cpu_time_us":30161,"raft.run_wall_time_us":281792,"replication_time_us":281551,"spinlock_wait_cycles":29781760,"thread_start_us":575179,"threads_started":4,"wal-append.queue_time_us":162741}]]}
I20260709 13:06:43.444351 12510 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:43.445436 21004 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:06:43.451134 13200 consensus_peers.cc:597] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:43.462320 12510 leader_election.cc:304] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:43.467207 21225 raft_consensus.cc:2749] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:43.463508 21208 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.478159 21208 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:43.480396 12510 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:43.482751 12510 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:43.484308 21085 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:43.488489 21083 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:43.538708 21004 raft_consensus.cc:493] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:43.547385 21004 raft_consensus.cc:515] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:43.559559 21208 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:43.564356 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:43.564172 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:43.569487 12588 consensus_peers.cc:597] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:43.571192 12588 consensus_peers.cc:597] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:43.575459 12588 consensus_peers.cc:597] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:43.577702 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:43.578785 13232 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 21.
I20260709 13:06:43.581728 12513 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:43.580440 21172 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:43.583003 21225 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:43.583441 21225 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.583794 21225 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:43.583456 21172 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:43.591773 21172 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:43.589748 21004 leader_election.cc:290] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:43.594524 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60708e41894c42b697291e905bff5dc6" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:43.597215 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:43.598114 13228 raft_consensus.cc:2393] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 21: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:43.612685 21225 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:43.617018 12510 leader_election.cc:304] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:43.698333 20965 raft_consensus.cc:2749] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:06:43.699551 12510 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 82605.9us
W20260709 13:06:43.701961 12588 consensus_peers.cc:597] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:43.649876 21208 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:43.618873 12662 consensus_peers.cc:597] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:43.702787 21208 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:43.702629 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 83811.1us
I20260709 13:06:43.705238 21208 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:43.710244 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:43.711584 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9209cf88e9b140a58be2e0d349b1263b" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:43.717407 12588 consensus_peers.cc:597] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:43.721953 12588 leader_election.cc:336] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:43.722460 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:43.723531 21070 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:43.724092 21225 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:43.726737 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:43.727418 13228 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:43.738437 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:43.751909 12510 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:43.760057 13228 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 22.
I20260709 13:06:43.760972 21070 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:43.762547 21225 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:06:43.764746 12588 consensus_peers.cc:597] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:43.770572 12513 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:43.771135 12620 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:43.775265 21225 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:43.775835 21225 raft_consensus.cc:697] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 22 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:43.776779 21225 consensus_queue.cc:237] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:43.767587 12662 consensus_peers.cc:597] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:43.779386 12620 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 22.
I20260709 13:06:43.815604 20965 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.816589 20983 raft_consensus.cc:493] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.817361 20983 raft_consensus.cc:515] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:43.816641 20965 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:43.825677 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:43.820200 20983 leader_election.cc:290] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:43.828675 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e64b5865b31f48158abb124846961f72" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:43.830798 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:43.830821 20965 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:43.831845 12510 leader_election.cc:304] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:43.834237 20965 raft_consensus.cc:2749] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:43.839150 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d31111d98c04e47baff178e562510a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:43.841269 12510 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:43.842258 20965 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:43.881105 21225 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:43.881819 21225 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:43.884337 21225 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:43.885057 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:43.894908 12588 consensus_peers.cc:597] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:43.903637 12437 catalog_manager.cc:5697] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 20 to 27, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 27 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:43.905764 12437 catalog_manager.cc:5697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 16 to 20, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 20 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:43.918622 21225 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.936597 21225 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:43.924886 12436 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36398 (request call id 358) took 55186 ms (client timeout 15000 ms). Trace:
I20260709 13:06:43.930243 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:43.941535 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:43.938789 21225 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:43.940940 12436 rpcz_store.cc:269] 0709 13:05:48.754754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.734488 (+6979734us) service_pool.cc:224] Handling call
0709 13:06:43.924815 (+48190327us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:43.537128 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:43.537849 (+   721us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:43.537902 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:06:43.537921 (+    19us) tablet.cc:662] Decoding operations
0709 13:06:43.553026 (+ 15105us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:43.553120 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:43.553147 (+    27us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:06:43.553705 (+   558us) tablet.cc:701] Row locks acquired
0709 13:06:43.553753 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:06:43.553916 (+   163us) write_op.cc:270] Start()
0709 13:06:43.554062 (+   146us) write_op.cc:276] Timestamp: P: 1783602403553859 usec, L: 0
0709 13:06:43.554106 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 13:06:43.568717 (+ 14611us) log.cc:844] Serialized 1686 byte log entry
0709 13:06:43.658870 (+ 90153us) op_driver.cc:464] REPLICATION: finished
0709 13:06:43.712838 (+ 53968us) write_op.cc:301] APPLY: starting
0709 13:06:43.712964 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:43.732900 (+ 19936us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:43.733012 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:43.760410 (+ 27398us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:43.760816 (+   406us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:06:43.760900 (+    84us) write_op.cc:312] APPLY: finished
0709 13:06:43.761188 (+   288us) log.cc:844] Serialized 49 byte log entry
0709 13:06:43.761401 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:43.761502 (+   101us) write_op.cc:454] Released schema lock
0709 13:06:43.761582 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:43.762038 (+   456us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:43.762068 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":171134,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":53692,"apply.run_cpu_time_us":9426,"apply.run_wall_time_us":49196,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20855,"num_ops":4,"prepare.queue_time_us":115776,"prepare.run_cpu_time_us":4025,"prepare.run_wall_time_us":43089,"replication_time_us":104603,"thread_start_us":99344,"threads_started":2}]]}
I20260709 13:06:43.965549 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a269dd3f9bbd4e53a58b736c0a5bf8b9" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 26 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:43.970712 12512 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:43.972784 21225 raft_consensus.cc:2749] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:43.975291 12512 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:43.977018 21225 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:43.946020 12437 catalog_manager.cc:5697] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 19 to 20, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 20 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:43.991789 12437 catalog_manager.cc:5697] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 13 to 24, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 24 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:43.999818 12437 catalog_manager.cc:5697] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 15 to 21, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 21 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:44.002429 12437 catalog_manager.cc:5697] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 21 to 23, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 23 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:44.005369 12437 catalog_manager.cc:5697] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 13 to 18, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 18 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:44.007002 12437 catalog_manager.cc:5697] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 20 to 22, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 22 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.008817 12437 catalog_manager.cc:5697] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 15 to 20, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 20 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:44.010658 12437 catalog_manager.cc:5697] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 14 to 17, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 17 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:44.012351 12437 catalog_manager.cc:5697] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 20 to 23, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 23 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:44.014209 12437 catalog_manager.cc:5697] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 26 to 28, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 28 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:44.015990 12437 catalog_manager.cc:5697] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 13 to 21, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 21 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:44.024035 12437 catalog_manager.cc:5697] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 8 to 24, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 24 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:06:44.087211 11443 thread.cc:527] Waited for 6000ms trying to join with heartbeat (tid 12572)
W20260709 13:06:44.114395 13200 consensus_peers.cc:597] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:44.102504 12437 catalog_manager.cc:5697] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 19 to 26, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 26 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:44.128051 12437 catalog_manager.cc:5697] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 23 to 26. New cstate: current_term: 26 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:44.120481 20965 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:44.174295 12437 catalog_manager.cc:5697] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 23 to 24, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 24 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.193605 12437 catalog_manager.cc:5697] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 20 to 26, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 26 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:44.169899 21225 raft_consensus.cc:493] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.174789 20983 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.196244 12437 catalog_manager.cc:5697] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 10 to 30. New cstate: current_term: 30 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:44.196154 21070 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:44.201594 21070 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:44.201411 12437 catalog_manager.cc:5697] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 14 to 18, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 18 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:44.203970 21070 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:44.203676 12437 catalog_manager.cc:5697] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 20 to 21, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 21 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.205724 12437 catalog_manager.cc:5697] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:44.207103 12437 catalog_manager.cc:5697] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 25 to 26, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 26 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.208666 12437 catalog_manager.cc:5697] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 7 to 23. New cstate: current_term: 23 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:44.195174 21208 raft_consensus.cc:493] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.230387 21208 raft_consensus.cc:515] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:44.226065 21225 raft_consensus.cc:515] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:44.199991 20965 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:44.227991 20983 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:44.233350 21208 leader_election.cc:290] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:44.263628 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:44.267267 12588 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 212 similar messages]
I20260709 13:06:44.272488 21284 raft_consensus.cc:493] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.273160 21284 raft_consensus.cc:515] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:44.252168 12437 catalog_manager.cc:5697] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 16 to 22, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 22 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:44.283636 12690 raft_consensus.cc:2393] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 24: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
W20260709 13:06:44.284416 12431 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f2abdbdc67164b32bd58bfe3763a4183 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7ad68e814a7741488971822f2598183a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:44.289057 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:44.321679 20965 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:44.323870 21284 leader_election.cc:290] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:44.279455 12437 catalog_manager.cc:5697] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 16 to 22, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 22 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:44.332345 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 46393.9us
I20260709 13:06:44.334790 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:44.336126 20983 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:44.338754 21225 leader_election.cc:290] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:44.340744 21225 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.344743 21225 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:44.333058 21287 raft_consensus.cc:493] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.356953 12622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:44.357542 21287 raft_consensus.cc:515] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:44.359910 21287 leader_election.cc:290] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:44.363320 12613 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:06:44.363718 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:44.377610 21225 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:44.381413 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:44.398202 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:44.406796 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22a877009d42412fb470ba88a418be05" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:44.430445 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 32 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:44.431841 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:44.452384 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24f57e3f5524b1c8e167aff853a0218" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:44.452692 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:44.461937 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:44.465227 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee851126f3964a84a26d5d9a400ec3a8" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:44.466578 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c94183b9e8b46989e1da72e911d7aee" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 32 candidate_status { last_received { term: 30 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:44.468189 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:44.469890 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 110663us
W20260709 13:06:44.470552 12588 leader_election.cc:336] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:44.492611 12587 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:44.496085 21294 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:44.512828 21294 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:44.517266 21291 raft_consensus.cc:493] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:44.518075 21291 raft_consensus.cc:515] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:44.520413 21291 leader_election.cc:290] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:44.522688 12513 leader_election.cc:304] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:44.523521 21284 raft_consensus.cc:2749] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:44.523955 12513 leader_election.cc:304] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:44.525439 21284 raft_consensus.cc:2749] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:44.525506 12513 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:44.534519 21208 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:44.526702 12510 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:44.540221 12510 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:44.540467 21225 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:44.541039 12513 leader_election.cc:304] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:44.544615 12513 leader_election.cc:304] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:44.545269 21286 raft_consensus.cc:2749] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:44.529631 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:44.545854 21291 raft_consensus.cc:2749] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 13:06:44.541934 21287 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:06:44.542655 21292 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:44.557268 13228 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 13:06:44.563917 21225 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:06:44.564396 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4432abbae9994c048d249abe3143fa09" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:44.628520 13200 consensus_peers.cc:597] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:44.632953 12588 consensus_peers.cc:597] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:44.635044 12512 leader_election.cc:304] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:44.639611 21296 raft_consensus.cc:2749] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:44.695163 21208 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.695889 21208 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:44.702090 12662 consensus_peers.cc:597] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:44.702392 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:44.704023 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:44.702073 21208 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:44.724601 12510 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:44.726239 21208 raft_consensus.cc:493] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.727711 21225 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:44.727789 21208 raft_consensus.cc:515] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:44.731738 21208 leader_election.cc:290] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:44.733142 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:44.733162 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d00b21d8b1e5471b8bf4e449c8b98cd7" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:44.736068 12512 leader_election.cc:304] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:44.738276 21208 raft_consensus.cc:2749] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:44.750803 21225 raft_consensus.cc:493] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.751336 21225 raft_consensus.cc:515] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:44.753335 21225 leader_election.cc:290] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:44.754081 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:44.754956 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "789704b18a5945318724c3ba1ca5b6e5" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:44.756409 12513 leader_election.cc:304] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:44.757511 21225 raft_consensus.cc:2749] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:06:44.834087 12588 consensus_peers.cc:597] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:44.861330 20965 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.861923 20965 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:44.864171 20965 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:44.865598 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:44.866262 12613 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 24.
I20260709 13:06:44.867499 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:44.868211 20965 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:44.868633 20965 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.868947 20965 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:44.879117 20965 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:44.881121 20965 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:44.892288 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:44.893116 12613 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:44.931774 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:44.932428 12691 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:44.938764 21225 raft_consensus.cc:493] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:44.939495 21225 raft_consensus.cc:515] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:44.945947 21225 leader_election.cc:290] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:44.951717 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 25 candidate_status { last_received { term: 23 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:44.955715 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:44.970265 12691 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 25.
I20260709 13:06:44.975131 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0f42b279a3452b8aebddcb497afc9d" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:44.991648 21208 raft_consensus.cc:493] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.992616 21208 raft_consensus.cc:515] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:44.995184 21208 leader_election.cc:290] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:44.991663 12613 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a70479a3b4114f3581095e9890f5d653 in term 25.
I20260709 13:06:44.999899 12510 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653; no voters: 
I20260709 13:06:45.003185 12512 leader_election.cc:304] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:45.003980 21225 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:45.004561 21225 raft_consensus.cc:697] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 25 LEADER]: Becoming Leader. State: Replica: a70479a3b4114f3581095e9890f5d653, State: Running, Role: LEADER
I20260709 13:06:45.005808 21225 consensus_queue.cc:237] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:45.008020 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:45.024323 21208 raft_consensus.cc:2749] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:45.032066 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d57d5dfad8e146a193ef43ffcbaac5ad" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:45.037266 12437 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36398 (request call id 360) took 9407 ms. Trace:
W20260709 13:06:45.046161 13200 consensus_peers.cc:597] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:45.037842 12437 rpcz_store.cc:276] 0709 13:06:35.631914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.425783 (+7793869us) service_pool.cc:224] Handling call
0709 13:06:45.037170 (+1611387us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:44.494473 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:44.495094 (+   621us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:44.495132 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:06:44.495152 (+    20us) tablet.cc:662] Decoding operations
0709 13:06:44.509092 (+ 13940us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:44.509170 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:44.509189 (+    19us) tablet.cc:685] Acquiring locks for 26 operations
0709 13:06:44.511377 (+  2188us) tablet.cc:701] Row locks acquired
0709 13:06:44.511393 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:06:44.511519 (+   126us) write_op.cc:270] Start()
0709 13:06:44.511623 (+   104us) write_op.cc:276] Timestamp: P: 1783602404511481 usec, L: 0
0709 13:06:44.511638 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:06:44.512289 (+   651us) log.cc:844] Serialized 10285 byte log entry
0709 13:06:44.626762 (+114473us) op_driver.cc:464] REPLICATION: finished
0709 13:06:44.673683 (+ 46921us) write_op.cc:301] APPLY: starting
0709 13:06:44.673797 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:44.716228 (+ 42431us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:44.716343 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:44.814818 (+ 98475us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:44.815162 (+   344us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=52,key_file_lookups=52,delta_file_lookups=52,mrs_lookups=0
0709 13:06:44.815208 (+    46us) write_op.cc:312] APPLY: finished
0709 13:06:44.815691 (+   483us) log.cc:844] Serialized 228 byte log entry
0709 13:06:44.816493 (+   802us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:44.816699 (+   206us) write_op.cc:454] Released schema lock
0709 13:06:44.816761 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:44.817160 (+   399us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:44.817195 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":103780,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":46618,"apply.run_cpu_time_us":36663,"apply.run_wall_time_us":143471,"cfile_cache_hit":106,"cfile_cache_hit_bytes":112859,"num_ops":26,"prepare.queue_time_us":120917,"prepare.run_cpu_time_us":6195,"prepare.run_wall_time_us":18164,"replication_time_us":114965,"thread_start_us":166824,"threads_started":2}]]}
W20260709 13:06:45.047521 13200 consensus_peers.cc:597] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:45.048172 13200 consensus_peers.cc:597] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:45.049007 13200 consensus_peers.cc:597] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:45.053297 13200 consensus_peers.cc:597] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:45.050997 12436 catalog_manager.cc:5697] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 20 to 27. New cstate: current_term: 27 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:45.066474 12436 catalog_manager.cc:5697] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 18 to 19, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 19 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:45.070218 12436 catalog_manager.cc:5697] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:45.072821 12512 leader_election.cc:304] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:45.075454 21225 raft_consensus.cc:2749] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:45.073935 12436 catalog_manager.cc:5697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 21 to 23, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 23 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:45.082219 12436 catalog_manager.cc:5697] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:06:45.104679 11443 thread.cc:527] Waited for 7000ms trying to join with heartbeat (tid 12572)
I20260709 13:06:45.096452 12436 catalog_manager.cc:5697] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 reported cstate change: term changed from 17 to 20, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 20 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:45.131119 21208 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.131891 21208 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:45.136760 20965 raft_consensus.cc:493] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.137399 20965 raft_consensus.cc:515] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:45.139708 20965 leader_election.cc:290] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:45.140774 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:45.146440 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c94bcdd6f18485cabc0ed14df679880" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:45.154453 12510 leader_election.cc:304] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:45.164829 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:45.165112 12691 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:45.158793 20965 raft_consensus.cc:2749] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:45.166927 12512 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:45.167953 21208 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:45.168108 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:45.168486 21208 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:45.249286 13200 consensus_peers.cc:597] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:45.255990 12440 catalog_manager.cc:5697] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 8 to 13, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 13 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:45.266319 12436 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36394 (request call id 345) took 4886 ms. Trace:
W20260709 13:06:45.277788 13200 consensus_peers.cc:597] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:45.278945 13200 consensus_peers.cc:597] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:45.281392 13200 consensus_peers.cc:597] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:45.277634 12436 rpcz_store.cc:276] 0709 13:06:40.379920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.962689 (+3582769us) service_pool.cc:224] Handling call
0709 13:06:45.266228 (+1303539us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:45.129732 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:45.130263 (+   531us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:45.130305 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:06:45.130322 (+    17us) tablet.cc:662] Decoding operations
0709 13:06:45.131303 (+   981us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:45.131378 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:45.131408 (+    30us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:06:45.133746 (+  2338us) tablet.cc:701] Row locks acquired
0709 13:06:45.133764 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:06:45.133920 (+   156us) write_op.cc:270] Start()
0709 13:06:45.134034 (+   114us) write_op.cc:276] Timestamp: P: 1783602405133872 usec, L: 0
0709 13:06:45.134058 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:06:45.134749 (+   691us) log.cc:844] Serialized 2452 byte log entry
0709 13:06:45.143518 (+  8769us) op_driver.cc:464] REPLICATION: finished
0709 13:06:45.147267 (+  3749us) write_op.cc:301] APPLY: starting
0709 13:06:45.147365 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:45.163771 (+ 16406us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:45.163861 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:45.176865 (+ 13004us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:45.177092 (+   227us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:06:45.177134 (+    42us) write_op.cc:312] APPLY: finished
0709 13:06:45.177373 (+   239us) log.cc:844] Serialized 65 byte log entry
0709 13:06:45.178153 (+   780us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:45.178266 (+   113us) write_op.cc:454] Released schema lock
0709 13:06:45.178313 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:45.178745 (+   432us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:45.178777 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15742,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":770,"apply.run_cpu_time_us":8902,"apply.run_wall_time_us":31440,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25092,"num_ops":6,"prepare.queue_time_us":14690,"prepare.run_cpu_time_us":3518,"prepare.run_wall_time_us":13311,"replication_time_us":9301,"spinlock_wait_cycles":975616,"thread_start_us":14798,"threads_started":1}]]}
I20260709 13:06:45.302614 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:06:45.304399 12588 consensus_peers.cc:597] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:45.305862 11443 tablet_replica.cc:333] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:45.307906 11443 raft_consensus.cc:2243] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.308681 11443 raft_consensus.cc:2272] T a059fe8e339d4b8f8fd0c9f18705f015 P a70479a3b4114f3581095e9890f5d653 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:45.341933 12662 consensus_peers.cc:597] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:45.343254 11443 tablet_replica.cc:333] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:45.346560 11443 raft_consensus.cc:2243] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.347481 11443 raft_consensus.cc:2272] T f2abdbdc67164b32bd58bfe3763a4183 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.380352 11443 tablet_replica.cc:333] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:45.386755 12691 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:06:45.396561 11443 raft_consensus.cc:2243] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.398988 21208 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:45.415367 11443 raft_consensus.cc:2272] T d57d5dfad8e146a193ef43ffcbaac5ad P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:45.417768 13200 consensus_peers.cc:597] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:45.439838 11443 tablet_replica.cc:333] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:45.441257 11443 raft_consensus.cc:2243] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.442286 11443 raft_consensus.cc:2272] T 7de7740d60cf417e8f6867a7d23f010f P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:45.474895 12432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 63874.3us
I20260709 13:06:45.487334 11443 tablet_replica.cc:333] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:45.489032 11443 raft_consensus.cc:2243] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 13:06:45.499290 12588 consensus_peers.cc:597] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:45.501152 12614 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Refusing update from remote peer a70479a3b4114f3581095e9890f5d653: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 13:06:45.505219 20965 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:45.509795 11443 pending_rounds.cc:70] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653: Trying to abort 1 pending ops.
I20260709 13:06:45.510179 11443 pending_rounds.cc:77] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653: Aborting op as it isn't in flight: id { term: 22 index: 13 } timestamp: 7305635386548424704 op_type: NO_OP noop_request { }
W20260709 13:06:45.510519 12432 catalog_manager.cc:4755] TS a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): ChangeConfig:REMOVE_PEER RPC failed for tablet 7724ca15b4534948997fc02e3fe5445a: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:45.510706 11443 raft_consensus.cc:2889] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:06:45.514175 11443 raft_consensus.cc:2272] T fb8ee8ee1a2c43cc9dc422f32773a55b P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.514626 21286 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.516453 21286 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:45.519632 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:45.531896 11443 tablet_replica.cc:333] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:45.532598 21286 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:45.535156 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6542f7c6287d4310b225c3c8479d4eca" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:45.536021 11443 raft_consensus.cc:2243] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.539781 11443 pending_rounds.cc:70] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653: Trying to abort 1 pending ops.
I20260709 13:06:45.540066 11443 pending_rounds.cc:77] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653: Aborting op as it isn't in flight: id { term: 18 index: 13 } timestamp: 7305635394525757440 op_type: NO_OP noop_request { }
I20260709 13:06:45.540448 11443 raft_consensus.cc:2889] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:06:45.540783 11443 raft_consensus.cc:2272] T e64b5865b31f48158abb124846961f72 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:45.547250 12440 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36396 (request call id 356) took 84274 ms (client timeout 15000 ms). Trace:
W20260709 13:06:45.551347 12431 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f2abdbdc67164b32bd58bfe3763a4183 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7ad68e814a7741488971822f2598183a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:45.552495 11443 tablet_replica.cc:333] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
W20260709 13:06:45.547695 12440 rpcz_store.cc:269] 0709 13:05:21.272708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.272959 (+   251us) service_pool.cc:224] Handling call
0709 13:06:45.547160 (+84274201us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:45.333007 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:45.333788 (+   781us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:45.333838 (+    50us) write_op.cc:435] Acquired schema lock
0709 13:06:45.333858 (+    20us) tablet.cc:662] Decoding operations
0709 13:06:45.334259 (+   401us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:45.334328 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:45.334360 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:45.334559 (+   199us) tablet.cc:701] Row locks acquired
0709 13:06:45.334580 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:06:45.334740 (+   160us) write_op.cc:270] Start()
0709 13:06:45.334908 (+   168us) write_op.cc:276] Timestamp: P: 1783602405334690 usec, L: 0
0709 13:06:45.334929 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:06:45.335678 (+   749us) log.cc:844] Serialized 541 byte log entry
0709 13:06:45.337790 (+  2112us) op_driver.cc:464] REPLICATION: finished
0709 13:06:45.338850 (+  1060us) write_op.cc:301] APPLY: starting
0709 13:06:45.338933 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:45.339708 (+   775us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:45.339822 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:45.340525 (+   703us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:45.340715 (+   190us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:06:45.340766 (+    51us) write_op.cc:312] APPLY: finished
0709 13:06:45.340979 (+   213us) log.cc:844] Serialized 25 byte log entry
0709 13:06:45.341137 (+   158us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:45.341222 (+    85us) write_op.cc:454] Released schema lock
0709 13:06:45.341264 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:45.342508 (+  1244us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:45.342538 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5088,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":844,"apply.run_cpu_time_us":2774,"apply.run_wall_time_us":2757,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4182,"num_ops":1,"prepare.queue_time_us":101,"prepare.run_cpu_time_us":2977,"prepare.run_wall_time_us":2977,"replication_time_us":2728}]]}
I20260709 13:06:45.560837 12512 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:45.561614 20965 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.563733 11443 raft_consensus.cc:2243] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.562183 21311 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:45.562126 20965 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:45.571979 20965 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:45.580698 12662 consensus_peers.cc:597] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:45.583756 11443 raft_consensus.cc:2272] T d24f57e3f5524b1c8e167aff853a0218 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.584061 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:45.592355 11443 tablet_replica.cc:333] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
W20260709 13:06:45.592965 13200 consensus_peers.cc:597] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:45.593628 12689 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9d67599bec471cb17398de70b43841" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:45.595104 11443 raft_consensus.cc:2243] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.595830 11443 raft_consensus.cc:2272] T 588a15c12a6c46ab9373c48890191400 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.623805 12512 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:45.625290 21286 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:06:45.629137 13200 consensus_peers.cc:597] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:45.651342 11443 tablet_replica.cc:333] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:45.652683 11443 raft_consensus.cc:2243] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:06:45.662958 12662 consensus_peers.cc:597] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:45.668004 11443 raft_consensus.cc:2272] T 7724ca15b4534948997fc02e3fe5445a P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:45.668179 12662 consensus_peers.cc:597] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:45.732088 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 58347.9us
W20260709 13:06:45.759485 12439 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36398 (request call id 356) took 107628 ms (client timeout 15000 ms). Trace:
W20260709 13:06:45.760324 12439 rpcz_store.cc:269] 0709 13:04:58.131657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.133762 (+  2105us) service_pool.cc:224] Handling call
0709 13:06:45.759368 (+107625606us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75200,"reported_tablets":48}
I20260709 13:06:45.776767 11443 tablet_replica.cc:333] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
W20260709 13:06:45.802345 12662 consensus_peers.cc:597] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:45.803138 12662 consensus_peers.cc:597] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:45.813840 12588 consensus_peers.cc:597] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:45.815048 11443 raft_consensus.cc:2243] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.815872 11443 pending_rounds.cc:70] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653: Trying to abort 1 pending ops.
I20260709 13:06:45.816157 11443 pending_rounds.cc:77] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653: Aborting op as it isn't in flight: id { term: 25 index: 17 } timestamp: 7305635404148649984 op_type: NO_OP noop_request { }
I20260709 13:06:45.816519 11443 raft_consensus.cc:2889] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:06:45.816860 11443 raft_consensus.cc:2272] T eb9d67599bec471cb17398de70b43841 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:45.825156 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 89258us
I20260709 13:06:45.850999 21311 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.851680 21311 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:45.854667 21311 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:45.855984 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:45.860877 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab3ccbaad6d445c580a75e6a739a1422" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 27 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:45.863351 12512 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:45.865844 21286 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:06:45.871598 12441 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36398 (request call id 357) took 82918 ms (client timeout 15000 ms). Trace:
I20260709 13:06:45.872202 11443 tablet_replica.cc:333] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
W20260709 13:06:45.872064 12441 rpcz_store.cc:269] 0709 13:05:22.952645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.953081 (+   436us) service_pool.cc:224] Handling call
0709 13:06:45.871397 (+82918316us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":145756,"reported_tablets":48}
I20260709 13:06:45.873443 11443 raft_consensus.cc:2243] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.874163 11443 raft_consensus.cc:2272] T 789704b18a5945318724c3ba1ca5b6e5 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.890586 11443 tablet_replica.cc:333] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:45.891623 11443 raft_consensus.cc:2243] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.892403 11443 raft_consensus.cc:2272] T 7c94183b9e8b46989e1da72e911d7aee P a70479a3b4114f3581095e9890f5d653 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:45.948987 11443 tablet_replica.cc:333] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:45.950100 11443 raft_consensus.cc:2243] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:45.951150 11443 pending_rounds.cc:70] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653: Trying to abort 1 pending ops.
I20260709 13:06:45.953179 21286 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:45.953882 21286 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:45.956187 21286 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:45.962795 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:45.964205 12588 consensus_peers.cc:597] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:45.967281 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a70479a3b4114f3581095e9890f5d653" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:45.991515 12510 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a70479a3b4114f3581095e9890f5d653; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:45.993317 20965 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:06:46.006608 12588 consensus_peers.cc:597] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:45.951582 11443 pending_rounds.cc:77] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653: Aborting op as it isn't in flight: id { term: 22 index: 15 } timestamp: 7305635344546332672 op_type: NO_OP noop_request { }
I20260709 13:06:46.018033 11443 raft_consensus.cc:2889] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:06:46.018564 11443 raft_consensus.cc:2272] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:46.024104 12588 consensus_peers.cc:597] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:46.033746 12662 consensus_peers.cc:597] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:46.034621 11443 tablet_replica.cc:333] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.035643 11443 raft_consensus.cc:2243] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:06:46.058867 11443 raft_consensus.cc:2272] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:46.081786 12588 consensus_peers.cc:597] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:46.092710 11443 tablet_replica.cc:333] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.095932 11443 raft_consensus.cc:2243] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 13:06:46.099749 13200 consensus_peers.cc:597] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:46.102442 12442 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50014 (request call id 225) took 109306 ms (client timeout 15000 ms). Trace:
W20260709 13:06:46.114678 12442 rpcz_store.cc:269] 0709 13:04:56.797148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:56.797949 (+   801us) service_pool.cc:224] Handling call
0709 13:06:46.102249 (+109304300us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47566,"reported_tablets":39,"spinlock_wait_cycles":2304}
W20260709 13:06:46.108258 12662 consensus_peers.cc:597] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:46.120307 11443 raft_consensus.cc:2272] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.149783 11443 tablet_replica.cc:333] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
W20260709 13:06:46.150519 12588 consensus_peers.cc:597] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:46.150712 11443 raft_consensus.cc:2243] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.161322 11443 raft_consensus.cc:2272] T ddff67072e694e36addbc3b673b008d0 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.175222 11443 tablet_replica.cc:333] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.176306 11443 raft_consensus.cc:2243] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:06:46.177490 11443 raft_consensus.cc:2272] T 69bd963c45b34a92981b6663666fc7eb P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.191219 12443 catalog_manager.cc:5697] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:46.207047 11443 tablet_replica.cc:333] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.208214 11443 raft_consensus.cc:2243] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:06:46.210516 11443 raft_consensus.cc:2272] T bf1f0526c7954a23b36c79f2c2b19122 P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.217998 12443 catalog_manager.cc:5697] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:46.219568 12443 catalog_manager.cc:5697] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 16 to 20, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 20 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:46.227773 12443 catalog_manager.cc:5697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 18 to 21, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 21 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:46.242336 12662 consensus_peers.cc:597] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:46.252892 12445 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36396 (request call id 355) took 113251 ms (client timeout 15000 ms). Trace:
W20260709 13:06:46.253386 12445 rpcz_store.cc:269] 0709 13:04:53.001268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:53.001443 (+   175us) service_pool.cc:224] Handling call
0709 13:06:46.248421 (+113246978us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131840,"reported_tablets":47}
I20260709 13:06:46.246815 12443 catalog_manager.cc:5697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 18 to 23, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 23 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:46.255972 11443 tablet_replica.cc:333] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.261904 11443 raft_consensus.cc:2243] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.262831 11443 pending_rounds.cc:70] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653: Trying to abort 1 pending ops.
I20260709 13:06:46.265600 11443 pending_rounds.cc:77] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653: Aborting op as it isn't in flight: id { term: 15 index: 11 } timestamp: 7305635384387239936 op_type: NO_OP noop_request { }
I20260709 13:06:46.266036 11443 raft_consensus.cc:2889] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:06:46.266418 11443 raft_consensus.cc:2272] T 60708e41894c42b697291e905bff5dc6 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.277580 11443 tablet_replica.cc:333] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.278823 11443 raft_consensus.cc:2243] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.279817 11443 pending_rounds.cc:70] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653: Trying to abort 1 pending ops.
I20260709 13:06:46.280128 11443 pending_rounds.cc:77] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653: Aborting op as it isn't in flight: id { term: 23 index: 15 } timestamp: 7305635378684928000 op_type: NO_OP noop_request { }
I20260709 13:06:46.280681 11443 raft_consensus.cc:2889] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:06:46.281119 11443 raft_consensus.cc:2272] T 5f0f42b279a3452b8aebddcb497afc9d P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.284197 11443 tablet_replica.cc:333] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.285351 11443 raft_consensus.cc:2243] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.286199 11443 raft_consensus.cc:2272] T 0767462f04d344b5a4fce9de7e885245 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.289740 11443 tablet_replica.cc:333] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.290694 11443 raft_consensus.cc:2243] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.291599 11443 raft_consensus.cc:2272] T ee851126f3964a84a26d5d9a400ec3a8 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.296916 11443 tablet_replica.cc:333] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.302452 11443 raft_consensus.cc:2243] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.303263 11443 pending_rounds.cc:70] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653: Trying to abort 1 pending ops.
I20260709 13:06:46.303578 11443 pending_rounds.cc:77] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653: Aborting op as it isn't in flight: id { term: 20 index: 17 } timestamp: 7305635369442201600 op_type: NO_OP noop_request { }
I20260709 13:06:46.304055 11443 raft_consensus.cc:2889] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:06:46.304579 11443 raft_consensus.cc:2272] T 67b0620b67b94f25ad79a8b18732686a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.313972 11443 tablet_replica.cc:333] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.315886 11443 raft_consensus.cc:2243] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.316527 11443 pending_rounds.cc:70] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653: Trying to abort 1 pending ops.
I20260709 13:06:46.316879 11443 pending_rounds.cc:77] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653: Aborting op as it isn't in flight: id { term: 23 index: 14 } timestamp: 7305635333177999360 op_type: NO_OP noop_request { }
I20260709 13:06:46.317304 11443 raft_consensus.cc:2889] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:06:46.322515 11443 raft_consensus.cc:2272] T 9209cf88e9b140a58be2e0d349b1263b P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.334208 11443 tablet_replica.cc:333] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.335067 11443 raft_consensus.cc:2243] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.336206 11443 pending_rounds.cc:70] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653: Trying to abort 1 pending ops.
I20260709 13:06:46.336449 11443 pending_rounds.cc:77] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653: Aborting op as it isn't in flight: id { term: 26 index: 16 } timestamp: 7305635384366018560 op_type: NO_OP noop_request { }
I20260709 13:06:46.336792 11443 raft_consensus.cc:2889] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:06:46.337155 11443 raft_consensus.cc:2272] T fb1007aec88948499b3c20c4e58bba2f P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.341675 11443 tablet_replica.cc:333] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.342599 11443 raft_consensus.cc:2243] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.343401 11443 raft_consensus.cc:2272] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.346480 11443 tablet_replica.cc:333] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.347323 11443 raft_consensus.cc:2243] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.348222 11443 raft_consensus.cc:2272] T ec9f14432c254d7a84f0c763fabd3d34 P a70479a3b4114f3581095e9890f5d653 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.351166 11443 tablet_replica.cc:333] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.351933 11443 raft_consensus.cc:2243] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:06:46.353121 11443 raft_consensus.cc:2272] T 5589ff6a0b984c84a050ecad03db5a87 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.356937 11443 tablet_replica.cc:333] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.357817 11443 raft_consensus.cc:2243] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:06:46.358831 11443 raft_consensus.cc:2272] T 0bcff91ac60a48ff97278bdb5c4d21dc P a70479a3b4114f3581095e9890f5d653 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.362489 11443 tablet_replica.cc:333] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.363875 11443 raft_consensus.cc:2243] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:06:46.364996 11443 raft_consensus.cc:2272] T 2f072313cdba43b09e842af6e98f0385 P a70479a3b4114f3581095e9890f5d653 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.368211 11443 tablet_replica.cc:333] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.369071 11443 raft_consensus.cc:2243] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:06:46.370203 11443 raft_consensus.cc:2272] T 4b253d5a6b42486ba3b3a6e07c59f7ff P a70479a3b4114f3581095e9890f5d653 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.373430 11443 tablet_replica.cc:333] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.374523 11443 raft_consensus.cc:2243] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.375209 11443 raft_consensus.cc:2272] T ab3ccbaad6d445c580a75e6a739a1422 P a70479a3b4114f3581095e9890f5d653 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.378567 11443 tablet_replica.cc:333] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.379400 11443 raft_consensus.cc:2243] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.380398 11443 raft_consensus.cc:2272] T 5161235af1b440278d598161e1de2453 P a70479a3b4114f3581095e9890f5d653 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.387495 11443 tablet_replica.cc:333] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.388474 11443 raft_consensus.cc:2243] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.389179 11443 raft_consensus.cc:2272] T 4432abbae9994c048d249abe3143fa09 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.395282 11443 tablet_replica.cc:333] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.396165 11443 raft_consensus.cc:2243] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.396814 11443 pending_rounds.cc:70] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653: Trying to abort 2 pending ops.
I20260709 13:06:46.397071 11443 pending_rounds.cc:77] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653: Aborting op as it isn't in flight: id { term: 17 index: 12 } timestamp: 7305635364063399936 op_type: NO_OP noop_request { }
I20260709 13:06:46.397475 11443 raft_consensus.cc:2889] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:06:46.397845 11443 pending_rounds.cc:77] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653: Aborting op as it isn't in flight: id { term: 15 index: 11 } timestamp: 7305635326941024256 op_type: NO_OP noop_request { }
I20260709 13:06:46.398214 11443 raft_consensus.cc:2889] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:06:46.398593 11443 raft_consensus.cc:2272] T 6542f7c6287d4310b225c3c8479d4eca P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.401827 11443 tablet_replica.cc:333] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.407196 11443 raft_consensus.cc:2243] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.407938 11443 raft_consensus.cc:2272] T 8c94bcdd6f18485cabc0ed14df679880 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.411149 11443 tablet_replica.cc:333] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.412107 11443 raft_consensus.cc:2243] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.412649 11443 raft_consensus.cc:2272] T 22a877009d42412fb470ba88a418be05 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.416188 11443 tablet_replica.cc:333] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.416996 11443 raft_consensus.cc:2243] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:06:46.418407 11443 raft_consensus.cc:2272] T 5d48be0c79154aa3938113fc3c045740 P a70479a3b4114f3581095e9890f5d653 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.421433 11443 tablet_replica.cc:333] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.422289 11443 raft_consensus.cc:2243] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:06:46.423647 11443 raft_consensus.cc:2272] T d88c15b898154821b2931e6b0f47833e P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:46.404834 12443 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36396 (request call id 359) took 15563 ms (client timeout 15000 ms). Trace:
I20260709 13:06:46.426842 11443 tablet_replica.cc:333] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.427754 11443 raft_consensus.cc:2243] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.428745 11443 raft_consensus.cc:2272] T 7d31111d98c04e47baff178e562510a8 P a70479a3b4114f3581095e9890f5d653 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.432314 11443 tablet_replica.cc:333] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.433229 11443 raft_consensus.cc:2243] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.434052 11443 raft_consensus.cc:2272] T 8b8383d4233b4ad5871ffc0dc8d82321 P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.437619 11443 tablet_replica.cc:333] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
W20260709 13:06:46.427127 12443 rpcz_store.cc:269] 0709 13:06:30.841618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.293108 (+4451490us) service_pool.cc:224] Handling call
0709 13:06:46.404732 (+11111624us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:46.261384 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:46.262029 (+   645us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:46.262067 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:06:46.262088 (+    21us) tablet.cc:662] Decoding operations
0709 13:06:46.263036 (+   948us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:46.263194 (+   158us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:46.263223 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:06:46.263786 (+   563us) tablet.cc:701] Row locks acquired
0709 13:06:46.263807 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:06:46.263947 (+   140us) write_op.cc:270] Start()
0709 13:06:46.264086 (+   139us) write_op.cc:276] Timestamp: P: 1783602406263897 usec, L: 0
0709 13:06:46.264108 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:06:46.264815 (+   707us) log.cc:844] Serialized 2079 byte log entry
0709 13:06:46.328725 (+ 63910us) op_driver.cc:464] REPLICATION: finished
0709 13:06:46.329951 (+  1226us) write_op.cc:301] APPLY: starting
0709 13:06:46.330035 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:46.333171 (+  3136us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:46.333266 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:46.338752 (+  5486us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:46.338988 (+   236us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:06:46.339040 (+    52us) write_op.cc:312] APPLY: finished
0709 13:06:46.339293 (+   253us) log.cc:844] Serialized 57 byte log entry
0709 13:06:46.339462 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:46.339568 (+   106us) write_op.cc:454] Released schema lock
0709 13:06:46.339607 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:46.359751 (+ 20144us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:46.359782 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6803,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":974,"apply.run_cpu_time_us":7484,"apply.run_wall_time_us":29766,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25037,"num_ops":5,"prepare.queue_time_us":2086,"prepare.run_cpu_time_us":3491,"prepare.run_wall_time_us":11325,"replication_time_us":64458,"thread_start_us":20638,"threads_started":2}]]}
I20260709 13:06:46.441087 11443 raft_consensus.cc:2243] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.441860 11443 raft_consensus.cc:2272] T f46dfbe6726b4cdd862263f711c7d5d9 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.456329 11443 tablet_replica.cc:333] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.457206 11443 raft_consensus.cc:2243] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.457890 11443 raft_consensus.cc:2272] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:46.458171 12588 consensus_peers.cc:597] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:46.454686 12437 catalog_manager.cc:5697] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } attrs { replace: true } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:46.459619 12437 catalog_manager.cc:5697] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 13 to 26. New cstate: current_term: 26 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:46.460980 11443 tablet_replica.cc:333] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.460927 12437 catalog_manager.cc:5697] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 20 to 21, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 21 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:46.461896 11443 raft_consensus.cc:2243] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.462685 11443 raft_consensus.cc:2272] T 39a7784c61d94bd5a03c390c81d48e35 P a70479a3b4114f3581095e9890f5d653 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.465083 12437 catalog_manager.cc:5697] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 15 to 26. New cstate: current_term: 26 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:46.466037 11443 tablet_replica.cc:333] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.466821 11443 raft_consensus.cc:2243] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.467653 11443 raft_consensus.cc:2272] T 8dcafb50fd3c47afbf475b1da51b147a P a70479a3b4114f3581095e9890f5d653 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.468451 12437 catalog_manager.cc:5697] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 27 to 29. New cstate: current_term: 29 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:46.470449 11443 tablet_replica.cc:333] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
W20260709 13:06:46.471163 12438 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50014 (request call id 228) took 43485 ms (client timeout 15000 ms). Trace:
I20260709 13:06:46.469924 12437 catalog_manager.cc:5697] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 21 to 25. New cstate: current_term: 25 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:46.474599 12437 catalog_manager.cc:5697] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 20 to 23, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 23 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:06:46.471621 12438 rpcz_store.cc:269] 0709 13:06:02.985430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.276966 (+11291536us) service_pool.cc:224] Handling call
0709 13:06:46.470942 (+32193976us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10946,"reported_tablets":39,"spinlock_wait_cycles":1408}
I20260709 13:06:46.478130 11443 raft_consensus.cc:2243] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:46.478775 11443 raft_consensus.cc:2272] T b8a1e8bdbd894ee4abb7a463446fe471 P a70479a3b4114f3581095e9890f5d653 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.479486 12437 catalog_manager.cc:5697] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:46.481945 11443 tablet_replica.cc:333] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653: stopping tablet replica
I20260709 13:06:46.481257 12437 catalog_manager.cc:5697] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 20 to 21, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 21 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:46.482753 11443 raft_consensus.cc:2243] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:06:46.482914 12437 catalog_manager.cc:5697] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 11 to 20, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 20 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:46.483985 11443 raft_consensus.cc:2272] T 2ec4af0b6e774d2986c11b75c9460d83 P a70479a3b4114f3581095e9890f5d653 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:46.485056 12437 catalog_manager.cc:5697] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:46.486714 12437 catalog_manager.cc:5697] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 21 to 26, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 26 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:46.488152 12437 catalog_manager.cc:5697] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 18 to 25, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 25 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:46.489552 12437 catalog_manager.cc:5697] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 19 to 20, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 20 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:46.491088 12437 catalog_manager.cc:5697] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 20 to 28. New cstate: current_term: 28 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:46.492506 12437 catalog_manager.cc:5697] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 16 to 21, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to a70479a3b4114f3581095e9890f5d653 (127.11.44.193). New cstate: current_term: 21 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:46.497731 12437 catalog_manager.cc:5697] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 18 to 26, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 26 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:46.499102 12437 catalog_manager.cc:5697] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 19 to 21, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 21 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:46.500680 12437 catalog_manager.cc:5697] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 19 to 23, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 23 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:46.502226 12437 catalog_manager.cc:5697] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 24 to 26, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 26 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:46.504175 12437 catalog_manager.cc:5697] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:46.505765 12437 catalog_manager.cc:5697] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 17 to 23, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 23 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:46.507910 12437 catalog_manager.cc:5697] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 18 to 25, leader changed from 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 25 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:46.509413 12437 catalog_manager.cc:5697] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 18 to 20, leader changed from 7ad68e814a7741488971822f2598183a (127.11.44.195) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 20 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:46.514055 12437 catalog_manager.cc:5697] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 23 to 25, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 25 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:46.715667 13200 consensus_peers.cc:597] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:46.779793 21325 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:46.780602 21325 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:46.781828 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 70635.8us
I20260709 13:06:46.784788 21325 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:46.799569 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:46.810446 12432 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 99038.4us
W20260709 13:06:46.823323 12432 catalog_manager.cc:4755] TS a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): ChangeConfig:REMOVE_PEER RPC failed for tablet 7724ca15b4534948997fc02e3fe5445a: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:46.827095 12662 leader_election.cc:336] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:46.827600 12662 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:46.830077 21325 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:46.843909 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
W20260709 13:06:46.845892 12431 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet f2abdbdc67164b32bd58bfe3763a4183 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 7ad68e814a7741488971822f2598183a (127.11.44.195:34641) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 7ad68e814a7741488971822f2598183a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } attrs { replace: true } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:46.857440 21294 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:46.862524 21294 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:46.866423 21294 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:46.868721 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:46.871807 12690 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 23.
W20260709 13:06:46.878969 12588 leader_election.cc:336] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:06:46.890317 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 52214.9us
I20260709 13:06:46.888881 21329 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:46.905630 21329 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:46.907500 13200 consensus_peers.cc:597] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:46.914628 21329 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:46.916556 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:46.917227 12693 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 23.
I20260709 13:06:46.935141 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:46.935913 13235 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 23.
I20260709 13:06:46.937400 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:46.938097 12620 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 23.
W20260709 13:06:46.937748 13200 leader_election.cc:336] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:46.943567 13197 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:46.944473 21331 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:46.944917 21331 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:46.945315 21331 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:46.959211 12441 catalog_manager.cc:5697] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:46.961265 12588 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:46.962239 21320 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:46.962644 21320 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:46.963040 21320 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:46.956652 21331 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:46.970058 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:46.970381 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:46.970938 12690 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:46.971843 21331 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:46.979523 12690 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 24.
I20260709 13:06:46.980404 12441 catalog_manager.cc:5697] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 21 to 25. New cstate: current_term: 25 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } }
I20260709 13:06:46.982896 12441 catalog_manager.cc:5697] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 17 to 18, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 18 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:46.990680 12441 catalog_manager.cc:5697] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 14 to 16, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 16 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:06:46.987356 13200 leader_election.cc:336] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:46.985234 21320 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:46.998445 12620 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 24: Already voted for candidate a11816c5d72e4d1295a242f3ced09e5f in this term.
I20260709 13:06:46.969801 12437 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36398 (request call id 361) took 1741 ms. Trace:
I20260709 13:06:47.002163 13197 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:47.003091 12588 leader_election.cc:336] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:47.005085 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:47.005259 21331 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:06:47.005955 12690 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 24: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:47.006976 12587 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:47.008013 21259 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:06:47.014247 12441 catalog_manager.cc:5697] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "a70479a3b4114f3581095e9890f5d653" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:47.015753 21320 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:47.001108 12437 rpcz_store.cc:276] 0709 13:06:45.228492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.228636 (+   144us) service_pool.cc:224] Handling call
0709 13:06:46.969740 (+1741104us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:46.525846 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:46.526339 (+   493us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:46.526371 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:06:46.526395 (+    24us) tablet.cc:662] Decoding operations
0709 13:06:46.528334 (+  1939us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:46.528405 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:46.528438 (+    33us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:06:46.530465 (+  2027us) tablet.cc:701] Row locks acquired
0709 13:06:46.530480 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:06:46.530640 (+   160us) write_op.cc:270] Start()
0709 13:06:46.530759 (+   119us) write_op.cc:276] Timestamp: P: 1783602406530589 usec, L: 0
0709 13:06:46.530774 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:06:46.539692 (+  8918us) log.cc:844] Serialized 9910 byte log entry
0709 13:06:46.541855 (+  2163us) spinlock_profiling.cc:243] Waited 8.12 ms on lock 0x7b5400235fd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e2571 00007fc3a9574e28 00007fc3acfaf581 00007fc3acfaed58 00007fc3acfb39f1 00007fc3acfb39a9 00007fc3acfb3939 00007fc3acfb3901 00007fc3acfb2b2d 000000000038f354 000000000038f199
0709 13:06:46.542713 (+   858us) op_driver.cc:464] REPLICATION: finished
0709 13:06:46.543457 (+   744us) write_op.cc:301] APPLY: starting
0709 13:06:46.543543 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:46.631217 (+ 87674us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:46.631244 (+    27us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:46.780029 (+148785us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:46.780353 (+   324us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 13:06:46.780400 (+    47us) write_op.cc:312] APPLY: finished
0709 13:06:46.780876 (+   476us) log.cc:844] Serialized 220 byte log entry
0709 13:06:46.807004 (+ 26128us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:46.814176 (+  7172us) write_op.cc:454] Released schema lock
0709 13:06:46.824473 (+ 10297us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:46.826139 (+  1666us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:46.826172 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":16028,"reported_tablets":38,"spinlock_wait_cycles":8320,"child_traces":[["op",{"apply.queue_time_us":497,"apply.run_cpu_time_us":32702,"apply.run_wall_time_us":282627,"cfile_cache_hit":100,"cfile_cache_hit_bytes":104550,"num_ops":25,"prepare.queue_time_us":172,"prepare.run_cpu_time_us":8021,"prepare.run_wall_time_us":16164,"replication_time_us":11834,"spinlock_wait_cycles":18664832}]]}
I20260709 13:06:47.024097 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:47.024911 13235 raft_consensus.cc:2393] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 24: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:47.032426 12441 catalog_manager.cc:5697] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
W20260709 13:06:47.058612 12588 connection.cc:573] client connection to 127.11.44.193:43307 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 13:06:47.152405 12588 consensus_peers.cc:597] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:47.179126 12441 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36396 (request call id 360) took 1199 ms. Trace:
I20260709 13:06:47.182893 12441 rpcz_store.cc:276] 0709 13:06:45.979726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:45.979883 (+   157us) service_pool.cc:224] Handling call
0709 13:06:47.179054 (+1199171us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:47.041124 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:47.041661 (+   537us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:47.041695 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:06:47.041712 (+    17us) tablet.cc:662] Decoding operations
0709 13:06:47.042469 (+   757us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:47.042535 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:47.042563 (+    28us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:06:47.043087 (+   524us) tablet.cc:701] Row locks acquired
0709 13:06:47.043105 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:06:47.043245 (+   140us) write_op.cc:270] Start()
0709 13:06:47.043391 (+   146us) write_op.cc:276] Timestamp: P: 1783602407043197 usec, L: 0
0709 13:06:47.043674 (+   283us) op_driver.cc:348] REPLICATION: starting
0709 13:06:47.044783 (+  1109us) log.cc:844] Serialized 2457 byte log entry
0709 13:06:47.052270 (+  7487us) op_driver.cc:464] REPLICATION: finished
0709 13:06:47.052759 (+   489us) write_op.cc:301] APPLY: starting
0709 13:06:47.052934 (+   175us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:47.056250 (+  3316us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:47.056363 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:47.064245 (+  7882us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:47.064511 (+   266us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 13:06:47.064586 (+    75us) write_op.cc:312] APPLY: finished
0709 13:06:47.064936 (+   350us) log.cc:844] Serialized 65 byte log entry
0709 13:06:47.065128 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:47.065236 (+   108us) write_op.cc:454] Released schema lock
0709 13:06:47.069364 (+  4128us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:47.091930 (+ 22566us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:47.091968 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":45730,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":147,"apply.run_cpu_time_us":9240,"apply.run_wall_time_us":39149,"cfile_cache_hit":24,"cfile_cache_hit_bytes":25092,"num_ops":6,"prepare.queue_time_us":133,"prepare.run_cpu_time_us":3348,"prepare.run_wall_time_us":3978,"replication_time_us":8454}]]}
I20260709 13:06:47.215472 21326 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.216097 21326 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:47.218364 21326 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:47.224738 12588 leader_election.cc:336] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:47.227201 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:47.229653 12587 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:47.231225 21320 raft_consensus.cc:2749] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:06:47.240468 12662 consensus_peers.cc:597] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:47.252166 12588 consensus_peers.cc:597] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:47.268169 21331 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.268846 21331 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:47.272209 21331 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:47.272323 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:47.277086 21332 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.277690 21332 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:47.281158 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:47.281858 12620 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 19.
I20260709 13:06:47.283526 12659 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:47.284404 21325 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:06:47.284809 21325 raft_consensus.cc:493] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.285193 21325 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:47.289673 21332 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:47.304060 21325 raft_consensus.cc:515] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:47.307618 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69bd963c45b34a92981b6663666fc7eb" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:47.318289 12439 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50014 (request call id 230) took 1214 ms. Trace:
I20260709 13:06:47.308292 12620 raft_consensus.cc:3060] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:06:47.341660 12439 rpcz_store.cc:276] 0709 13:06:46.103684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.103845 (+   161us) service_pool.cc:224] Handling call
0709 13:06:47.318219 (+1214374us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54290,"reported_tablets":39,"spinlock_wait_cycles":2304}
I20260709 13:06:47.343564 12620 raft_consensus.cc:2468] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:06:47.348129 12659 leader_election.cc:304] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:47.349076 21285 raft_consensus.cc:2804] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:06:47.349738 21285 raft_consensus.cc:697] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 20 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:47.350646 21285 consensus_queue.cc:237] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:47.380573 21326 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.381356 21326 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:47.384322 21326 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:47.389083 12588 leader_election.cc:336] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:47.403390 12439 catalog_manager.cc:5697] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 19 to 20, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 20 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.404044 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:47.407239 12588 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:47.409972 21321 raft_consensus.cc:2749] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:47.419927 12444 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50014 (request call id 229) took 16547 ms (client timeout 15000 ms). Trace:
W20260709 13:06:47.423589 12444 rpcz_store.cc:269] 0709 13:06:30.872377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.805185 (+9932808us) service_pool.cc:224] Handling call
0709 13:06:47.419710 (+6614525us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":195,"mutex_wait_us":28018,"reported_tablets":39,"spinlock_wait_cycles":75136}
I20260709 13:06:47.427666 21325 leader_election.cc:290] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:47.430474 12662 leader_election.cc:336] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:47.435526 12662 leader_election.cc:336] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:47.440451 13235 consensus_queue.cc:237] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:47.441802 13200 leader_election.cc:336] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:47.449421 13200 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:47.450552 21335 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:06:47.452286 13200 consensus_peers.cc:597] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:47.482182 21325 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.482831 21325 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:47.489261 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:47.485380 21325 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:47.496881 12688 raft_consensus.cc:1275] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:06:47.499099 21335 consensus_queue.cc:1048] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:06:47.502084 12662 leader_election.cc:336] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:47.502640 12662 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:47.503875 21325 raft_consensus.cc:2749] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:06:47.493737 13200 consensus_peers.cc:597] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:47.524261 21325 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.524979 21325 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:47.534499 21325 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:47.537885 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:47.539366 21335 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.543450 21335 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:47.546442 21335 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:47.540582 13200 consensus_peers.cc:597] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:47.547590 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:47.548321 12620 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 20.
W20260709 13:06:47.547816 13200 consensus_peers.cc:597] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:47.550067 13197 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:47.551774 13200 consensus_peers.cc:597] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:47.552404 21335 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:47.552838 21335 raft_consensus.cc:493] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.553442 21335 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:47.553939 21331 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.554617 21331 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:47.550576 21326 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.557735 21329 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.558104 21326 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:47.558857 21329 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:47.560556 21326 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:47.556988 21331 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:47.563417 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:47.564049 21329 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:47.564075 12620 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 22.
I20260709 13:06:47.565542 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:47.566190 12688 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 23.
I20260709 13:06:47.566562 21317 raft_consensus.cc:2955] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 6 to 15, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:47.570492 21329 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.571139 21329 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:47.574033 13197 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:47.574956 21331 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:06:47.575433 21331 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.575804 21331 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:47.576141 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:47.576248 12688 raft_consensus.cc:2955] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 6 to 15, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:47.578061 13199 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:47.579854 21280 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:47.580231 21280 raft_consensus.cc:493] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.580559 21280 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:47.574133 21329 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:47.600657 12444 catalog_manager.cc:5697] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a reported cstate change: config changed from index 6 to 15, VOTER a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) evicted. New cstate: current_term: 20 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:47.607455 21331 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:47.551121 12662 leader_election.cc:336] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:47.609642 12588 leader_election.cc:336] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:47.613901 21325 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.614535 21325 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:47.615878 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 64776.7us
I20260709 13:06:47.616787 21325 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:47.616824 12662 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:47.618943 21325 raft_consensus.cc:2749] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:47.621021 21335 raft_consensus.cc:515] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:47.625430 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:47.628377 21335 leader_election.cc:290] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:47.633692 12662 leader_election.cc:336] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:47.634234 12662 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:47.622613 21280 raft_consensus.cc:515] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:47.639834 21285 raft_consensus.cc:2749] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:47.641870 21280 leader_election.cc:290] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:47.645516 13200 leader_election.cc:336] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:47.657200 13200 leader_election.cc:336] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:47.649784 13197 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 56671.1us
W20260709 13:06:47.684566 13200 leader_election.cc:336] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:47.688473 12613 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dbe6a90f99a44fe85d2c7a8bcb7c9ad" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:47.689126 12613 raft_consensus.cc:3060] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:47.659832 21331 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:47.664644 21285 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.689860 21285 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:47.692070 21285 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:47.653642 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 75655us
I20260709 13:06:47.695099 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:47.695696 12432 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ddff67072e694e36addbc3b673b008d0 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:47.686169 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:47.687248 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:47.696743 12621 raft_consensus.cc:3060] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:06:47.696810 13235 raft_consensus.cc:2393] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a11816c5d72e4d1295a242f3ced09e5f in current term 23: Already voted for candidate 66750b8bbd4c4b3a9695951d0ede3372 in this term.
I20260709 13:06:47.697532 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf1f0526c7954a23b36c79f2c2b19122" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:47.698124 12690 raft_consensus.cc:3060] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:06:47.695393 12588 consensus_peers.cc:597] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:47.703646 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:47.703783 12621 raft_consensus.cc:2468] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 23.
W20260709 13:06:47.707399 13200 leader_election.cc:336] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:47.707928 13200 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:47.708382 21320 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:06:47.711705 12662 leader_election.cc:336] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:47.712208 12662 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:47.713340 21285 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:47.714164 21285 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.714740 21285 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:47.717038 21285 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:47.721764 21331 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:06:47.715312 12690 raft_consensus.cc:2468] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 24.
W20260709 13:06:47.722021 13200 leader_election.cc:336] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:47.720239 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:47.732057 13226 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 26.
I20260709 13:06:47.723346 13199 leader_election.cc:304] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:47.733327 21331 raft_consensus.cc:2804] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:47.733371 12604 tablet_service.cc:1558] Processing DeleteTablet for tablet ddff67072e694e36addbc3b673b008d0 with delete_type TABLET_DATA_TOMBSTONED (TS a11816c5d72e4d1295a242f3ced09e5f not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:47018
I20260709 13:06:47.740588 21331 raft_consensus.cc:697] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:47.717629 13197 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:47.724315 12613 raft_consensus.cc:2468] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 21.
I20260709 13:06:47.743172 21348 raft_consensus.cc:2804] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:06:47.743728 21348 raft_consensus.cc:697] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:47.744693 21348 consensus_queue.cc:237] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:47.741847 21331 consensus_queue.cc:237] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:47.749027 21350 tablet_replica.cc:333] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:47.752632 12613 raft_consensus.cc:1275] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:06:47.754767 21325 consensus_queue.cc:1048] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:06:47.758642 13200 leader_election.cc:336] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:47.731248 12662 leader_election.cc:336] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:47.771201 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:47.768205 13197 leader_election.cc:304] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:47.772192 21285 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:47.773062 21285 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.773175 21317 raft_consensus.cc:2804] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:47.763378 21350 raft_consensus.cc:2243] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:47.773893 21317 raft_consensus.cc:697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:47.775216 21350 raft_consensus.cc:2272] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:47.775750 21320 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.776476 21320 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:47.779217 21320 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:47.779740 13200 leader_election.cc:336] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:47.780555 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:47.781229 12690 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 25.
I20260709 13:06:47.773694 21285 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:06:47.787313 12588 leader_election.cc:336] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:47.791766 21350 ts_tablet_manager.cc:1916] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:47.801447 21326 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.802232 21326 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:47.804639 21326 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:47.809423 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:47.810298 12587 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
W20260709 13:06:47.810861 12588 leader_election.cc:336] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:47.808610 12444 catalog_manager.cc:5697] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 23 to 24, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 24 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.811589 21320 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:47.812569 21320 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.813004 21320 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:47.817236 21329 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.817905 21329 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:47.818745 12587 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:47.819980 21326 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:47.820574 21329 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:47.821275 21325 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.821848 21325 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:47.823429 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:47.824156 12688 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 23.
I20260709 13:06:47.824576 21325 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:47.825706 13200 consensus_peers.cc:597] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:47.826229 13200 consensus_peers.cc:597] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:47.775332 21317 consensus_queue.cc:237] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:47.826978 13199 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:47.828727 21347 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:47.829191 21347 raft_consensus.cc:493] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.829821 21347 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:47.839011 21347 raft_consensus.cc:515] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:47.841029 21325 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.841634 21325 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:47.844486 21347 leader_election.cc:290] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:47.844745 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:47.845453 13226 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 28.
I20260709 13:06:47.845664 12621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:47.846336 12621 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:47.846977 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b253d5a6b42486ba3b3a6e07c59f7ff" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:47.847607 12659 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:47.848779 21332 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:06:47.849205 21332 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.849812 21332 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:06:47.850601 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:47.847609 12688 raft_consensus.cc:3060] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:47.847709 21325 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:47.857288 12662 leader_election.cc:336] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:47.866429 21328 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:06:47.868270 21328 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.868670 21328 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:06:47.874042 12688 raft_consensus.cc:2468] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 24.
I20260709 13:06:47.884413 21331 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.885046 21331 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:47.883775 13200 consensus_peers.cc:597] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:47.886439 13200 consensus_peers.cc:597] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:47.886819 13200 leader_election.cc:336] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:47.893263 12662 leader_election.cc:336] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:47.877375 21328 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:47.907011 21328 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 29 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:47.911407 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f072313cdba43b09e842af6e98f0385" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 29 candidate_status { last_received { term: 28 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:47.912046 13226 raft_consensus.cc:3060] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:06:47.912964 12662 consensus_peers.cc:597] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:47.914593 13199 leader_election.cc:304] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
W20260709 13:06:47.913033 12432 catalog_manager.cc:4755] TS a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): ChangeConfig:REMOVE_PEER RPC failed for tablet 7724ca15b4534948997fc02e3fe5445a: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:47.896035 21285 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:47.916782 21317 raft_consensus.cc:2804] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:06:47.928254 13200 leader_election.cc:336] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:47.932389 12662 leader_election.cc:336] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:47.936894 13200 consensus_peers.cc:597] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:47.949266 13226 raft_consensus.cc:2468] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 29.
I20260709 13:06:47.950416 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5589ff6a0b984c84a050ecad03db5a87" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:47.951025 13235 raft_consensus.cc:3060] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:47.952258 12662 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:47.954367 12439 catalog_manager.cc:5697] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 22 to 23, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 23 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.957122 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:47.957902 12690 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 27.
I20260709 13:06:47.957430 12439 catalog_manager.cc:5697] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 20 to 21, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 21 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:47.948930 21331 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:47.965740 21350 ts_tablet_manager.cc:1929] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.14
I20260709 13:06:47.966307 21350 log.cc:1199] T ddff67072e694e36addbc3b673b008d0 P a11816c5d72e4d1295a242f3ced09e5f: Deleting WAL directory at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0/minicluster-data/ts-1-root/wals/ddff67072e694e36addbc3b673b008d0
I20260709 13:06:47.968547 12429 catalog_manager.cc:5028] TS a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): tablet ddff67072e694e36addbc3b673b008d0 (table test-workload [id=906a11f4c2da4470829fcd1d6100e6f4]) successfully deleted
I20260709 13:06:47.972312 13199 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:47.973925 21331 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:06:47.974340 21331 raft_consensus.cc:493] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting leader election (detected failure of leader a70479a3b4114f3581095e9890f5d653)
I20260709 13:06:47.974701 21331 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:06:47.955899 21285 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:47.956092 21317 raft_consensus.cc:697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:47.984423 21328 raft_consensus.cc:2804] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 29 FOLLOWER]: Leader election won for term 29
W20260709 13:06:47.990460 13200 leader_election.cc:336] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:48.001399 13200 consensus_peers.cc:597] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:48.001986 21317 consensus_queue.cc:237] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:48.010963 21328 raft_consensus.cc:697] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 29 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:48.029946 21328 consensus_queue.cc:237] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.18, Last appended by leader: 18, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:48.031060 21320 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:48.035348 13235 raft_consensus.cc:2468] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 27.
I20260709 13:06:48.028949 21332 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:48.038762 21332 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:48.051158 21331 raft_consensus.cc:515] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:48.054266 21320 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:48.053355 21331 leader_election.cc:290] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:48.055478 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d48be0c79154aa3938113fc3c045740" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:48.056123 12688 raft_consensus.cc:3060] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:06:48.072263 11443 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 12568)
W20260709 13:06:48.076514 13200 leader_election.cc:336] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:48.078153 12588 consensus_peers.cc:597] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:48.085865 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 171659us
W20260709 13:06:48.089227 12588 leader_election.cc:336] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:48.086735 12688 raft_consensus.cc:2468] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 28.
I20260709 13:06:48.091051 13199 leader_election.cc:304] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:48.092639 21347 raft_consensus.cc:2804] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:06:48.093190 21347 raft_consensus.cc:697] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:48.098286 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bcff91ac60a48ff97278bdb5c4d21dc" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 25 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:48.099772 12690 raft_consensus.cc:3060] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:48.121654 12620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:48.122325 12620 raft_consensus.cc:3060] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:06:48.129177 12662 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 176985us
W20260709 13:06:48.129931 12662 leader_election.cc:336] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:48.094156 21347 consensus_queue.cc:237] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:48.131388 12439 catalog_manager.cc:5697] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 23 to 24, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 24 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:48.136682 12662 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:48.140205 21355 raft_consensus.cc:2804] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:06:48.140758 21355 raft_consensus.cc:697] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 27 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:48.143535 12620 raft_consensus.cc:2468] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 22.
I20260709 13:06:48.148123 21355 consensus_queue.cc:237] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:48.192051 12690 raft_consensus.cc:2468] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 26.
W20260709 13:06:48.193931 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 59023.5us
I20260709 13:06:48.203186 12587 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
W20260709 13:06:48.224916 12662 consensus_peers.cc:597] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:48.225040 13200 consensus_peers.cc:597] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:48.211886 12659 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
W20260709 13:06:48.225658 13200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 62782.1us
W20260709 13:06:48.226851 12662 consensus_peers.cc:597] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:48.227335 12662 consensus_peers.cc:597] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:48.227690 12662 leader_election.cc:336] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:48.228772 12662 consensus_peers.cc:597] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:48.236303 12690 raft_consensus.cc:1275] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:06:48.236545 12620 raft_consensus.cc:1275] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:06:48.238075 21329 consensus_queue.cc:1048] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:06:48.238569 21280 consensus_queue.cc:1048] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:06:48.209214 21320 raft_consensus.cc:2804] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:06:48.247280 21320 raft_consensus.cc:697] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 26 LEADER]: Becoming Leader. State: Replica: a11816c5d72e4d1295a242f3ced09e5f, State: Running, Role: LEADER
I20260709 13:06:48.248299 21320 consensus_queue.cc:237] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:48.229840 21332 raft_consensus.cc:2804] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:06:48.258534 21332 raft_consensus.cc:697] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
W20260709 13:06:48.248294 21365 log.cc:927] Time spent T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:06:48.259582 21332 consensus_queue.cc:237] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:48.277773 12587 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 65388.7us
W20260709 13:06:48.277773 12588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:33997, user_credentials={real_user=slave}} blocked reactor thread for 63841.3us
W20260709 13:06:48.287355 12662 consensus_peers.cc:597] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:48.303138 12444 catalog_manager.cc:5697] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 28 to 29, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 29 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:48.350955 12437 catalog_manager.cc:5697] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 27 to 28, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 28 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:48.395361 13200 consensus_peers.cc:597] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:48.405676 13200 consensus_peers.cc:597] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:48.417809 12444 catalog_manager.cc:5697] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 26 to 27, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 27 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:48.427731 13226 raft_consensus.cc:1275] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 28 index: 18. Preceding OpId from leader: term: 29 index: 19. (index mismatch)
W20260709 13:06:48.428817 12588 consensus_peers.cc:597] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:48.432534 12620 raft_consensus.cc:1275] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
W20260709 13:06:48.432909 12662 consensus_peers.cc:597] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:48.431365 12444 catalog_manager.cc:5697] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 21 to 22, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 22 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:48.434425 21376 consensus_queue.cc:1048] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:06:48.441017 21332 consensus_queue.cc:1048] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
W20260709 13:06:48.481791 13200 consensus_peers.cc:597] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:48.520335 21346 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:48.521027 12588 consensus_peers.cc:597] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:48.520985 21346 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:48.526695 12688 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:48.527348 12688 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 24.
I20260709 13:06:48.528108 21346 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:48.537417 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f" is_pre_election: true
I20260709 13:06:48.538249 12614 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 24.
I20260709 13:06:48.539459 13197 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 
I20260709 13:06:48.541767 21346 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:48.542198 21346 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.542562 21346 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:48.544874 12688 raft_consensus.cc:1275] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
W20260709 13:06:48.547850 12662 consensus_peers.cc:597] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:48.551043 13200 consensus_peers.cc:597] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:48.555397 12437 catalog_manager.cc:5697] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f reported cstate change: term changed from 25 to 26, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194). New cstate: current_term: 26 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:48.568061 13200 leader_election.cc:336] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:48.564371 21331 consensus_queue.cc:1048] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.009s
W20260709 13:06:48.590699 12588 consensus_peers.cc:597] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:48.591218 21346 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:48.597999 12614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "a11816c5d72e4d1295a242f3ced09e5f"
I20260709 13:06:48.598588 12614 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:06:48.608574 12588 consensus_peers.cc:597] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:48.614310 13200 consensus_peers.cc:597] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:48.614940 13200 leader_election.cc:336] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:48.616704 12690 raft_consensus.cc:1275] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 27 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 13:06:48.621165 21331 consensus_queue.cc:1048] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:06:48.693580 12614 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 25.
W20260709 13:06:48.712407 12588 consensus_peers.cc:597] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:48.714987 12687 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:48.715680 12687 raft_consensus.cc:3060] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:06:48.721499 12662 consensus_peers.cc:597] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:48.724747 12687 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 25.
W20260709 13:06:48.735502 12588 consensus_peers.cc:597] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:48.738646 13199 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: a70479a3b4114f3581095e9890f5d653
I20260709 13:06:48.739650 21331 raft_consensus.cc:2804] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:48.740150 21331 raft_consensus.cc:697] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:48.741039 21331 consensus_queue.cc:237] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.13, Last appended by leader: 13, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:48.756527 13235 raft_consensus.cc:1275] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
W20260709 13:06:48.737960 12588 consensus_peers.cc:597] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:48.735937 21346 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 election: Requested vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:48.765597 21325 consensus_queue.cc:1048] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.012s
I20260709 13:06:48.790568 12444 catalog_manager.cc:5697] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 23 to 25, leader changed from a70479a3b4114f3581095e9890f5d653 (127.11.44.193) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 25 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:48.818812 12614 raft_consensus.cc:1275] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:06:48.828253 21332 consensus_queue.cc:1048] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:06:48.836746 12662 consensus_peers.cc:597] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:48.848481 12662 consensus_peers.cc:597] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:48.886111 12662 consensus_peers.cc:597] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:48.902228 12662 consensus_peers.cc:597] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:48.906198 12693 raft_consensus.cc:1275] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 13:06:48.924623 21320 consensus_queue.cc:1048] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:06:48.907071 12613 consensus_queue.cc:237] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:48.969487 13235 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:06:48.971043 21374 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:06:48.982574 12588 consensus_peers.cc:597] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:48.996138 12687 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Refusing update from remote peer a11816c5d72e4d1295a242f3ced09e5f: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:06:49.010304 21374 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
W20260709 13:06:49.040356 13200 consensus_peers.cc:597] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:49.041740 21320 raft_consensus.cc:2955] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 5 to 15, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:49.044257 13235 raft_consensus.cc:2955] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 5 to 15, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:49.082443 12687 raft_consensus.cc:2955] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 5 to 15, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:49.091905 12429 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f2abdbdc67164b32bd58bfe3763a4183 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260709 13:06:49.096604 12441 catalog_manager.cc:5697] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: config changed from index 5 to 15, VOTER a70479a3b4114f3581095e9890f5d653 (127.11.44.193) evicted. New cstate: current_term: 20 leader_uuid: "a11816c5d72e4d1295a242f3ced09e5f" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } }
I20260709 13:06:49.170513 11443 tablet_server.cc:196] TabletServer@127.11.44.193:0 shutdown complete.
I20260709 13:06:49.181512 12614 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:06:49.184532 21347 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:06:49.215381 12432 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 70663.3us
W20260709 13:06:49.220336 13200 consensus_peers.cc:597] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:49.239338 12432 catalog_manager.cc:4755] TS a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet f2abdbdc67164b32bd58bfe3763a4183: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:49.284721 13200 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111) [suppressed 435 similar messages]
W20260709 13:06:49.298141 13200 consensus_peers.cc:597] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:49.332990 12662 consensus_peers.cc:597] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:49.338788 12687 raft_consensus.cc:1275] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 13:06:49.350603 21347 consensus_queue.cc:1048] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:06:49.555509 13200 consensus_peers.cc:597] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:49.603183 12588 consensus_peers.cc:597] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:49.658347 11443 tablet_server.cc:179] TabletServer@127.11.44.194:0 shutting down...
W20260709 13:06:49.670573 13197 consensus_peers.cc:597] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:49.671238 13197 consensus_peers.cc:597] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:49.729715 13197 consensus_peers.cc:597] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:49.769927 13197 consensus_peers.cc:597] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:49.770924 12659 consensus_peers.cc:597] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:49.773236 13200 consensus_peers.cc:597] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:49.800814 12659 consensus_peers.cc:597] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:49.804430 13200 consensus_peers.cc:597] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:49.818814 13197 consensus_peers.cc:597] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:49.818435 12659 consensus_peers.cc:597] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:49.838634 12659 consensus_peers.cc:597] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:49.870323 13197 consensus_peers.cc:597] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:49.888289 13197 consensus_peers.cc:597] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:49.889921 12659 consensus_peers.cc:597] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:49.897065 12659 consensus_peers.cc:597] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:49.921020 12659 consensus_peers.cc:597] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:49.914891 13197 consensus_peers.cc:597] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:49.950222 13197 consensus_peers.cc:597] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:49.996960 13200 consensus_peers.cc:597] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:50.012298 13235 consensus_queue.cc:237] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:50.019702 13197 consensus_peers.cc:597] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:50.034670 13200 consensus_peers.cc:597] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:50.037959 13197 consensus_peers.cc:597] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:50.038710 13197 consensus_peers.cc:597] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:50.053716 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:06:50.058602 13200 consensus_peers.cc:597] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:50.061281 13197 consensus_peers.cc:597] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:50.058352 11443 tablet_replica.cc:333] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.099975 11443 raft_consensus.cc:2243] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:50.100953 11443 raft_consensus.cc:2272] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:50.146464 13200 consensus_peers.cc:597] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:50.162786 11443 tablet_replica.cc:333] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.163785 11443 raft_consensus.cc:2243] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:50.164469 11443 raft_consensus.cc:2272] T a059fe8e339d4b8f8fd0c9f18705f015 P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:50.180316 13200 consensus_peers.cc:597] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:50.189695 11443 tablet_replica.cc:333] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.190743 11443 raft_consensus.cc:2243] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:06:50.191785 11443 raft_consensus.cc:2272] T f2abdbdc67164b32bd58bfe3763a4183 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:50.193550 13200 consensus_peers.cc:597] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:50.209765 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 64440.8us
W20260709 13:06:50.210573 12659 consensus_peers.cc:597] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:50.229812 12659 consensus_peers.cc:597] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:50.230486 13197 consensus_peers.cc:597] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:50.231089 13197 consensus_peers.cc:597] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:50.231583 13197 consensus_peers.cc:597] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:50.230489 12659 consensus_peers.cc:597] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:50.234695 12659 consensus_peers.cc:597] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:50.235344 12659 consensus_peers.cc:597] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:50.251385 11443 tablet_replica.cc:333] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.254554 11443 raft_consensus.cc:2243] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:06:50.255729 11443 raft_consensus.cc:2272] T fb8ee8ee1a2c43cc9dc422f32773a55b P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:50.259128 11443 tablet_replica.cc:333] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.260015 11443 raft_consensus.cc:2243] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:50.260646 11443 raft_consensus.cc:2272] T d57d5dfad8e146a193ef43ffcbaac5ad P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:50.290346 11443 tablet_replica.cc:333] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.291257 11443 raft_consensus.cc:2243] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:50.291893 11443 raft_consensus.cc:2272] T dd40576623a84072be59a32d23cda14b P a11816c5d72e4d1295a242f3ced09e5f [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:50.306421 11443 tablet_replica.cc:333] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.307278 11443 raft_consensus.cc:2243] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:50.310232 11443 raft_consensus.cc:2272] T e64b5865b31f48158abb124846961f72 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:50.330255 11443 tablet_replica.cc:333] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.331193 11443 raft_consensus.cc:2243] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:06:50.332227 11443 raft_consensus.cc:2272] T f7bf456f0b724194a6e042403ee0b730 P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:50.335017 11443 tablet_replica.cc:333] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.335786 11443 raft_consensus.cc:2243] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:06:50.338507 11443 raft_consensus.cc:2272] T eb9d67599bec471cb17398de70b43841 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:50.342191 11443 tablet_replica.cc:333] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.343010 11443 raft_consensus.cc:2243] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:50.343608 11443 raft_consensus.cc:2272] T f6ccc9457e2e4aeaac5163b9bb9f13cb P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:50.350042 13200 consensus_peers.cc:597] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:50.362188 11443 tablet_replica.cc:333] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.364584 11443 raft_consensus.cc:2243] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Raft consensus shutting down.
W20260709 13:06:50.386714 12662 consensus_peers.cc:597] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:50.394079 11443 raft_consensus.cc:2272] T d21e2686d5e84f6495f1b6f8a9b68dca P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:50.397481 11443 tablet_replica.cc:333] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.398371 11443 raft_consensus.cc:2243] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:50.399197 11443 raft_consensus.cc:2272] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:50.401965 11443 tablet_replica.cc:333] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.402699 11443 raft_consensus.cc:2243] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:50.403302 11443 raft_consensus.cc:2272] T d00b21d8b1e5471b8bf4e449c8b98cd7 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:50.413087 11443 tablet_replica.cc:333] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.445632 11443 raft_consensus.cc:2243] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:50.449944 11443 raft_consensus.cc:2272] T 69bd963c45b34a92981b6663666fc7eb P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:50.472329 11443 tablet_replica.cc:333] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.473186 11443 raft_consensus.cc:2243] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:06:50.474622 11443 raft_consensus.cc:2272] T 67b0620b67b94f25ad79a8b18732686a P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:50.491923 11443 tablet_replica.cc:333] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.494442 11443 raft_consensus.cc:2243] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:50.495898 11443 raft_consensus.cc:2272] T 0767462f04d344b5a4fce9de7e885245 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:50.500782 11443 tablet_replica.cc:333] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
W20260709 13:06:50.497448 13200 consensus_peers.cc:597] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:50.502722 11443 raft_consensus.cc:2243] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:50.517423 11443 raft_consensus.cc:2272] T 60708e41894c42b697291e905bff5dc6 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:50.519810 13200 consensus_peers.cc:597] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:50.522948 11443 tablet_replica.cc:333] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
W20260709 13:06:50.586372 12662 consensus_peers.cc:597] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:50.594146 13200 consensus_peers.cc:597] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:50.596589 12662 consensus_peers.cc:597] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:50.603461 11443 raft_consensus.cc:2243] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:50.605429 11443 raft_consensus.cc:2272] T 5f0f42b279a3452b8aebddcb497afc9d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:50.607335 12662 consensus_peers.cc:597] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:50.623446 11443 tablet_replica.cc:333] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.624401 11443 raft_consensus.cc:2243] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 25 LEADER]: Raft consensus shutting down.
W20260709 13:06:50.625950 13200 consensus_peers.cc:597] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:50.633868 12432 catalog_manager.cc:4755] TS a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet f2abdbdc67164b32bd58bfe3763a4183: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:50.634073 11443 raft_consensus.cc:2272] T 0f7c3aec6a56450cb76aab45d874eff7 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:50.648505 21372 raft_consensus.cc:493] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:50.649091 21372 raft_consensus.cc:515] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:50.651245 21372 leader_election.cc:290] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:50.653596 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "588a15c12a6c46ab9373c48890191400" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:50.657305 12588 leader_election.cc:336] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:50.657769 12588 leader_election.cc:304] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:50.658849 21372 raft_consensus.cc:2749] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:06:50.681939 12662 consensus_peers.cc:597] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:50.688481 11443 tablet_replica.cc:333] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.689441 11443 raft_consensus.cc:2243] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 25 LEADER]: Raft consensus shutting down.
W20260709 13:06:50.699697 13200 consensus_peers.cc:597] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:50.700572 12662 consensus_peers.cc:597] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:50.691363 11443 raft_consensus.cc:2272] T 9209cf88e9b140a58be2e0d349b1263b P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:50.729264 11443 tablet_replica.cc:333] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.729931 21372 raft_consensus.cc:493] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:50.730538 21372 raft_consensus.cc:515] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:50.734309 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b8383d4233b4ad5871ffc0dc8d82321" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:50.738807 21372 leader_election.cc:290] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:50.741675 12588 leader_election.cc:336] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:50.742182 12588 leader_election.cc:304] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:50.743177 21402 raft_consensus.cc:2749] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:50.745739 11443 raft_consensus.cc:2243] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:50.746687 11443 raft_consensus.cc:2272] T 8b8383d4233b4ad5871ffc0dc8d82321 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:50.753448 21372 raft_consensus.cc:493] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:50.754065 21372 raft_consensus.cc:515] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:50.756682 21372 leader_election.cc:290] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:50.760433 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8a1e8bdbd894ee4abb7a463446fe471" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:50.765398 12588 leader_election.cc:336] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:50.765941 12588 leader_election.cc:304] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:50.767266 21372 raft_consensus.cc:2749] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:50.774912 21372 raft_consensus.cc:493] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:50.775534 21372 raft_consensus.cc:515] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:50.796751 21372 leader_election.cc:290] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:50.798238 11443 tablet_replica.cc:333] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
W20260709 13:06:50.805176 12588 leader_election.cc:336] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:50.806538 12588 consensus_peers.cc:597] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:50.814095 13200 consensus_peers.cc:597] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:50.815555 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d88c15b898154821b2931e6b0f47833e" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:50.818749 11443 raft_consensus.cc:2243] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:06:50.818325 12588 leader_election.cc:304] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:50.824594 21372 raft_consensus.cc:2749] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:50.824689 11443 raft_consensus.cc:2272] T 7d31111d98c04e47baff178e562510a8 P a11816c5d72e4d1295a242f3ced09e5f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:50.833743 11443 tablet_replica.cc:333] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.858976 11443 raft_consensus.cc:2243] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 26 LEADER]: Raft consensus shutting down.
W20260709 13:06:50.847311 13200 consensus_peers.cc:597] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:50.860728 11443 raft_consensus.cc:2272] T fb1007aec88948499b3c20c4e58bba2f P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:50.863903 11443 tablet_replica.cc:333] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.868834 21372 raft_consensus.cc:493] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:50.872717 21372 raft_consensus.cc:515] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:50.873296 11443 raft_consensus.cc:2243] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:06:50.875052 11443 raft_consensus.cc:2272] T df093254fdff40f38b8370a4e884cc5d P a11816c5d72e4d1295a242f3ced09e5f [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:50.878176 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:50.884833 21402 raft_consensus.cc:493] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:50.885085 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e396b3164bf5409c9d6b0dd8dc22cd2d" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:50.885527 21402 raft_consensus.cc:515] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:50.886946 12588 leader_election.cc:304] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:50.888190 21402 leader_election.cc:290] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:50.888597 11443 tablet_replica.cc:333] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.889004 21402 raft_consensus.cc:2749] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:06:50.889632 11443 raft_consensus.cc:2243] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:50.890394 11443 raft_consensus.cc:2272] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:50.891314 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec9f14432c254d7a84f0c763fabd3d34" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:50.878173 21372 leader_election.cc:290] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:50.908067 11443 tablet_replica.cc:333] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
W20260709 13:06:50.917482 12588 leader_election.cc:336] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:50.916991 13200 consensus_peers.cc:597] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:50.918115 12588 leader_election.cc:304] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:50.920660 12588 raft_consensus.cc:2686] T ec9f14432c254d7a84f0c763fabd3d34 P a11816c5d72e4d1295a242f3ced09e5f: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:06:50.925971 11443 raft_consensus.cc:2243] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:06:50.927518 11443 raft_consensus.cc:2272] T dda7dbc055d64c86aedec4299e15f997 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:50.931417 11443 tablet_replica.cc:333] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.933732 21404 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:50.934347 21404 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:50.940476 11443 raft_consensus.cc:2243] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:06:50.944906 21372 raft_consensus.cc:493] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:50.945521 21372 raft_consensus.cc:515] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:50.947692 21372 leader_election.cc:290] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:50.948431 12659 leader_election.cc:336] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:06:50.951236 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba3a2645bcdf4ca5b8e0a2133dd93114" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:50.952358 12662 leader_election.cc:336] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:50.952844 12662 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:50.953636 21325 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:50.954223 21404 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:50.955653 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:50.956537 21409 raft_consensus.cc:493] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:50.957090 21409 raft_consensus.cc:515] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:50.959209 21409 leader_election.cc:290] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:50.961258 11443 raft_consensus.cc:2272] T 44ad8138d0594c32b4590c837a41891e P a11816c5d72e4d1295a242f3ced09e5f [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:50.961700 12588 leader_election.cc:336] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:50.964470 11443 tablet_replica.cc:333] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:50.964671 12588 leader_election.cc:304] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:50.965340 11443 raft_consensus.cc:2243] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:06:50.967227 21372 raft_consensus.cc:2749] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:50.967515 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5161235af1b440278d598161e1de2453" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:50.970297 12588 consensus_peers.cc:597] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:50.975423 12588 leader_election.cc:336] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:50.975893 12588 leader_election.cc:304] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:50.976423 13200 consensus_peers.cc:597] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:50.980734 21409 raft_consensus.cc:2749] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:50.983338 21409 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:50.984678 21372 raft_consensus.cc:493] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:50.985214 21372 raft_consensus.cc:515] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:50.987532 21372 leader_election.cc:290] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:50.983901 21409 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:50.993208 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:50.994168 12690 raft_consensus.cc:2468] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a11816c5d72e4d1295a242f3ced09e5f in term 25.
I20260709 13:06:50.995067 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39a7784c61d94bd5a03c390c81d48e35" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:50.992870 12662 consensus_peers.cc:597] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:50.975442 11443 raft_consensus.cc:2272] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:50.996932 21409 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:51.003250 11443 tablet_replica.cc:333] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:51.004722 11443 raft_consensus.cc:2243] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:06:51.005630 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:51.013824 12588 leader_election.cc:336] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:51.009444 11443 raft_consensus.cc:2272] T 6542f7c6287d4310b225c3c8479d4eca P a11816c5d72e4d1295a242f3ced09e5f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.014457 12588 leader_election.cc:304] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:51.018111 11443 tablet_replica.cc:333] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:51.019199 11443 raft_consensus.cc:2243] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 13:06:51.029312 21372 raft_consensus.cc:670] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:06:51.030479 11443 raft_consensus.cc:2272] T 8c94bcdd6f18485cabc0ed14df679880 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.034001 11443 tablet_replica.cc:333] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:51.034904 11443 raft_consensus.cc:2243] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:06:51.022195 21409 raft_consensus.cc:2749] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:06:51.039938 11443 raft_consensus.cc:2272] T 0bcff91ac60a48ff97278bdb5c4d21dc P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:51.037744 12588 leader_election.cc:336] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:51.041354 12588 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:51.042238 21409 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:51.047392 11443 tablet_replica.cc:333] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:51.052625 11443 raft_consensus.cc:2243] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:06:51.056914 11443 raft_consensus.cc:2272] T ac31a22d7aa245e385188a5ff4068842 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.060001 11443 tablet_replica.cc:333] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:51.061255 21409 raft_consensus.cc:493] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:51.067158 11443 raft_consensus.cc:2243] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.066939 21409 raft_consensus.cc:515] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:51.067900 11443 raft_consensus.cc:2272] T 1d83186354414170b4775351916c56c2 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.070624 21409 leader_election.cc:290] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:51.073393 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec4af0b6e774d2986c11b75c9460d83" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:51.077152 12588 leader_election.cc:336] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:51.077680 12588 leader_election.cc:304] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:51.079177 21409 raft_consensus.cc:2749] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:51.080754 21409 raft_consensus.cc:493] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:51.081347 21409 raft_consensus.cc:515] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:51.085096 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7de7740d60cf417e8f6867a7d23f010f" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 27 candidate_status { last_received { term: 26 index: 14 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:51.085594 21409 leader_election.cc:290] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:51.077811 11443 tablet_replica.cc:333] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
W20260709 13:06:51.092080 12588 leader_election.cc:336] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:51.092583 12588 leader_election.cc:304] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:51.093847 21409 raft_consensus.cc:2749] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:51.091615 11443 raft_consensus.cc:2243] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:06:51.095857 11443 raft_consensus.cc:2272] T ab3ccbaad6d445c580a75e6a739a1422 P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.098618 11443 tablet_replica.cc:333] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:51.099376 11443 raft_consensus.cc:2243] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.100215 11443 raft_consensus.cc:2272] T 5161235af1b440278d598161e1de2453 P a11816c5d72e4d1295a242f3ced09e5f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.102919 11443 tablet_replica.cc:333] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:51.103673 11443 raft_consensus.cc:2243] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.104378 11443 raft_consensus.cc:2272] T e396b3164bf5409c9d6b0dd8dc22cd2d P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.107483 11443 tablet_replica.cc:333] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:51.108209 11443 raft_consensus.cc:2243] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.109073 11443 raft_consensus.cc:2272] T 7724ca15b4534948997fc02e3fe5445a P a11816c5d72e4d1295a242f3ced09e5f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.111723 11443 tablet_replica.cc:333] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:51.112600 11443 raft_consensus.cc:2243] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.113206 11443 raft_consensus.cc:2272] T 588a15c12a6c46ab9373c48890191400 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.116300 11443 tablet_replica.cc:333] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:51.117084 11443 raft_consensus.cc:2243] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.117890 11443 raft_consensus.cc:2272] T d88c15b898154821b2931e6b0f47833e P a11816c5d72e4d1295a242f3ced09e5f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.120612 11443 tablet_replica.cc:333] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:51.121362 11443 raft_consensus.cc:2243] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.122129 11443 raft_consensus.cc:2272] T 2ec4af0b6e774d2986c11b75c9460d83 P a11816c5d72e4d1295a242f3ced09e5f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.125171 21409 raft_consensus.cc:493] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:51.125761 21409 raft_consensus.cc:515] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:51.128116 21409 leader_election.cc:290] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 7ad68e814a7741488971822f2598183a (127.11.44.195:34641), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:51.130290 12662 consensus_peers.cc:597] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:51.130134 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:51.124774 11443 tablet_replica.cc:333] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:51.131574 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ea9ad298ab4fa08087d24740b5a13b" candidate_uuid: "a11816c5d72e4d1295a242f3ced09e5f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:51.133131 12588 leader_election.cc:304] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a11816c5d72e4d1295a242f3ced09e5f; no voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a
I20260709 13:06:51.134542 21409 raft_consensus.cc:2749] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:51.135848 11443 raft_consensus.cc:2243] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.136761 11443 raft_consensus.cc:2272] T 7de7740d60cf417e8f6867a7d23f010f P a11816c5d72e4d1295a242f3ced09e5f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.140170 11443 tablet_replica.cc:333] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:51.141039 11443 raft_consensus.cc:2243] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:06:51.142284 11443 raft_consensus.cc:2272] T f46dfbe6726b4cdd862263f711c7d5d9 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.145700 11443 tablet_replica.cc:333] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:51.146521 11443 raft_consensus.cc:2243] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.147255 11443 raft_consensus.cc:2272] T 02ea9ad298ab4fa08087d24740b5a13b P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.150364 11443 tablet_replica.cc:333] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:51.152480 11443 raft_consensus.cc:2243] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.153146 11443 raft_consensus.cc:2272] T ba3a2645bcdf4ca5b8e0a2133dd93114 P a11816c5d72e4d1295a242f3ced09e5f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.159770 11443 tablet_replica.cc:333] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:51.160547 11443 raft_consensus.cc:2243] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.161739 11443 raft_consensus.cc:2272] T 39a7784c61d94bd5a03c390c81d48e35 P a11816c5d72e4d1295a242f3ced09e5f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:51.165319 11443 tablet_replica.cc:333] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f: stopping tablet replica
I20260709 13:06:51.166023 11443 raft_consensus.cc:2243] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:51.166934 11443 raft_consensus.cc:2272] T b8a1e8bdbd894ee4abb7a463446fe471 P a11816c5d72e4d1295a242f3ced09e5f [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:51.223097 12662 consensus_peers.cc:597] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:51.271809 12662 consensus_peers.cc:597] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:51.351013 21325 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:51.351649 21325 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:51.365947 12659 leader_election.cc:336] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:51.368147 21325 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:51.378069 12662 leader_election.cc:336] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:51.378695 12662 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:51.379606 21325 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:06:51.398806 12662 consensus_peers.cc:597] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:51.445809 21325 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:51.446516 21325 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:51.450071 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:51.457404 21404 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:51.458065 21404 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:51.460522 21404 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:51.467685 21325 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:51.475739 12659 leader_election.cc:336] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:51.476320 12659 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:51.478503 21404 raft_consensus.cc:2749] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:06:51.479455 12662 leader_election.cc:336] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:51.483455 12659 leader_election.cc:336] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:51.483978 12659 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:51.500967 12434 maintenance_manager.cc:419] P 78966838052c4dd980a04a5b750887f1: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033389
I20260709 13:06:51.504199 21404 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:51.567587 12433 maintenance_manager.cc:643] P 78966838052c4dd980a04a5b750887f1: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.065s	user 0.035s	sys 0.010s Metrics: {"bytes_written":6532,"delete_count":0,"lbm_write_time_us":1007,"lbm_writes_lt_1ms":6,"reinsert_count":0,"thread_start_us":7158,"threads_started":1,"update_count":250,"wal-append.queue_time_us":6912}
I20260709 13:06:51.570060 12434 maintenance_manager.cc:419] P 78966838052c4dd980a04a5b750887f1: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.336880
I20260709 13:06:51.570930 21347 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:51.571600 21347 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:51.574105 21347 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:51.581791 13197 leader_election.cc:336] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:51.582110 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:51.584195 13199 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:51.585551 21347 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:51.618296 13200 consensus_peers.cc:597] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:51.621194 21325 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:51.621999 21325 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:51.624181 21325 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:51.633334 12659 leader_election.cc:336] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:51.636477 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:51.637179 13235 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 20.
I20260709 13:06:51.648010 12662 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:51.657855 21325 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:06:51.658409 21325 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:51.658819 21325 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:51.666471 21325 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:51.685528 12659 leader_election.cc:336] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
W20260709 13:06:51.687726 12662 consensus_peers.cc:597] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:51.691283 21325 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:51.699848 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2abdbdc67164b32bd58bfe3763a4183" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:51.700551 13235 raft_consensus.cc:3060] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:06:51.716388 13235 raft_consensus.cc:2468] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 21.
I20260709 13:06:51.719520 21331 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:51.720021 21325 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:51.720468 21331 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:51.735857 13200 leader_election.cc:336] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:51.722981 21331 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:51.720619 21325 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:51.738790 21325 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:51.743932 12659 leader_election.cc:336] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
W20260709 13:06:51.744699 13197 leader_election.cc:336] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:51.745174 13197 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:51.746151 21405 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:06:51.771095 12662 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:51.774121 21325 raft_consensus.cc:2804] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:06:51.774649 21325 raft_consensus.cc:697] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 21 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:51.775533 21325 consensus_queue.cc:237] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:51.780923 12432 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.11.44.193:43307, user_credentials={real_user=slave}} blocked reactor thread for 49034.7us
I20260709 13:06:51.803610 12437 catalog_manager.cc:5697] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 20 to 21, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 21 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:51.808306 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 25 index: 21 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:51.809729 12432 catalog_manager.cc:4755] TS a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet f2abdbdc67164b32bd58bfe3763a4183: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:51.828531 21331 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:51.829181 21331 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:51.833529 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:51.834362 12693 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 23.
I20260709 13:06:51.835875 13199 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:51.836971 21415 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:06:51.837525 21415 raft_consensus.cc:493] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:51.837922 21415 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:06:51.844352 21331 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:51.850885 13197 leader_election.cc:336] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:51.861042 21325 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:51.861665 21325 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:51.863982 21325 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:51.871358 21415 raft_consensus.cc:515] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:51.875198 13200 consensus_peers.cc:597] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:51.877090 21347 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:51.877732 21347 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:51.880337 21347 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:51.882651 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 26 candidate_status { last_received { term: 25 index: 21 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:51.883312 12693 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 25.
I20260709 13:06:51.884873 13199 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:51.885975 21414 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:06:51.886451 21414 raft_consensus.cc:493] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:51.886837 21414 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:51.895808 21414 raft_consensus.cc:515] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:51.898145 13197 leader_election.cc:336] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
W20260709 13:06:51.906081 12659 leader_election.cc:336] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:51.907205 12662 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:51.908066 21325 raft_consensus.cc:2749] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:51.910728 21331 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:51.911223 21331 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:51.913079 21331 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:51.913877 21415 leader_election.cc:290] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:51.914980 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:51.915197 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7bf456f0b724194a6e042403ee0b730" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:51.915802 12690 raft_consensus.cc:3060] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:06:51.920231 12662 consensus_peers.cc:597] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:51.921407 21414 leader_election.cc:290] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:51.922452 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f7c3aec6a56450cb76aab45d874eff7" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 26 candidate_status { last_received { term: 25 index: 21 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:51.923221 12693 raft_consensus.cc:3060] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:06:51.922647 12690 raft_consensus.cc:2468] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 24.
I20260709 13:06:51.926608 13199 leader_election.cc:304] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:51.927417 21414 raft_consensus.cc:2804] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:06:51.927915 21414 raft_consensus.cc:697] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:51.928789 21414 consensus_queue.cc:237] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:51.929949 21325 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:06:51.931116 13197 leader_election.cc:336] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:51.930575 21325 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:51.931612 13197 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:51.933326 21331 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:06:51.933591 13197 leader_election.cc:336] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:51.934592 21325 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:51.937790 13197 leader_election.cc:336] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:51.941812 12693 raft_consensus.cc:2468] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 26.
I20260709 13:06:51.943900 13199 leader_election.cc:304] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:51.943950 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:51.945030 21331 raft_consensus.cc:2804] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:06:51.944962 13235 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 26.
I20260709 13:06:51.945739 21331 raft_consensus.cc:697] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:51.946851 21331 consensus_queue.cc:237] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 25.21, Last appended by leader: 21, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:51.953673 12659 leader_election.cc:336] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
W20260709 13:06:51.955336 12662 consensus_peers.cc:597] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:51.956048 12662 leader_election.cc:336] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:51.956581 12662 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:51.957804 21325 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:51.960508 21325 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:51.961117 21325 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:51.963725 21415 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:51.963953 21325 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:51.964282 21415 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:51.966413 12662 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:51.968499 21325 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:51.968995 21325 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:51.969309 21325 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:51.971993 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:51.973249 12659 leader_election.cc:336] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:51.978243 13235 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 28.
I20260709 13:06:51.984215 12662 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:51.985369 21404 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:06:51.985798 21404 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:51.986210 21404 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:06:51.995229 13197 leader_election.cc:336] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:51.995172 21404 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:51.996959 21331 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:51.997545 21331 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:51.999646 21331 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:52.000615 21415 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:52.001452 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:52.003839 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
W20260709 13:06:52.007764 13197 leader_election.cc:336] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:52.008252 13197 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:52.010931 21404 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 29 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:52.011227 21347 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:06:52.012514 12693 raft_consensus.cc:2393] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66750b8bbd4c4b3a9695951d0ede3372 in current term 29: Already voted for candidate 7ad68e814a7741488971822f2598183a in this term.
I20260709 13:06:52.012378 12433 maintenance_manager.cc:643] P 78966838052c4dd980a04a5b750887f1: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.429s	user 0.104s	sys 0.025s Metrics: {"cfile_cache_miss":9,"cfile_cache_miss_bytes":28128,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":50532,"dirs.run_cpu_time_us":485,"dirs.run_wall_time_us":2122,"lbm_read_time_us":2070,"lbm_reads_lt_1ms":25,"lbm_write_time_us":1724,"lbm_writes_lt_1ms":11,"peak_mem_usage":298939,"reinsert_count":0,"thread_start_us":78977,"threads_started":2,"update_count":276}
I20260709 13:06:52.016067 12434 maintenance_manager.cc:419] P 78966838052c4dd980a04a5b750887f1: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 13:06:52.018527 21325 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:52.020387 21325 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:52.021134 12433 maintenance_manager.cc:643] P 78966838052c4dd980a04a5b750887f1: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
I20260709 13:06:52.022861 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df093254fdff40f38b8370a4e884cc5d" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:52.023510 13235 raft_consensus.cc:3060] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:06:52.025143 12659 leader_election.cc:336] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:52.028523 13199 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:52.031052 12441 catalog_manager.cc:5697] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 23 to 24, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 24 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:52.031920 13235 raft_consensus.cc:2468] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 29.
I20260709 13:06:52.033447 21347 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 13:06:52.041404 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dda7dbc055d64c86aedec4299e15f997" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:52.043095 13235 raft_consensus.cc:3060] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:06:52.042397 12662 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:52.047255 21404 raft_consensus.cc:2804] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 29 FOLLOWER]: Leader election won for term 29
W20260709 13:06:52.047688 12659 leader_election.cc:336] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:52.049439 21404 raft_consensus.cc:697] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 29 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:52.050465 21404 consensus_queue.cc:237] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:52.055627 12441 catalog_manager.cc:5697] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 25 to 26, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 26 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:52.071918 21325 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:52.072599 21325 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:52.077894 13235 raft_consensus.cc:2468] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 27.
I20260709 13:06:52.079247 12662 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:52.082191 21403 raft_consensus.cc:2804] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:06:52.082705 21403 raft_consensus.cc:697] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 27 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:52.083653 21403 consensus_queue.cc:237] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 26.20, Last appended by leader: 20, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:52.086265 13200 consensus_peers.cc:597] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:52.089777 21325 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:52.098626 21325 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:52.095232 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:52.102128 13200 consensus_peers.cc:597] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:06:52.103262 21325 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:52.101522 12662 leader_election.cc:336] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:52.108547 12662 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:52.112697 21403 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:52.113910 21325 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:52.127182 13197 consensus_peers.cc:597] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:52.133519 12662 leader_election.cc:336] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:52.135624 12659 leader_election.cc:336] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:52.136420 21425 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:52.136950 21425 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:52.139096 21425 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
I20260709 13:06:52.142009 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:52.140972 12659 leader_election.cc:336] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:52.148207 12659 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:52.155422 12441 catalog_manager.cc:5697] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 28 to 29, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 29 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:52.158401 13197 consensus_peers.cc:597] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:52.163599 21404 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:52.167996 13235 raft_consensus.cc:1275] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:06:52.185020 12441 catalog_manager.cc:5697] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 26 to 27, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 27 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:52.186146 13197 consensus_peers.cc:597] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:52.186968 12659 leader_election.cc:336] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:52.187500 12659 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:52.188367 21425 raft_consensus.cc:2749] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:06:52.203120 13197 consensus_peers.cc:597] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:52.204313 21404 consensus_queue.cc:1048] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:06:52.228366 21414 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:52.229120 21414 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:52.242096 13200 leader_election.cc:336] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:52.249724 13197 leader_election.cc:336] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:52.250239 13197 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:52.251482 21347 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:52.252614 21414 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:52.254257 12693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:52.254913 12693 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 26.
W20260709 13:06:52.263149 13197 consensus_peers.cc:597] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:52.281980 12659 consensus_peers.cc:597] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:52.289549 13197 consensus_peers.cc:597] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:52.316267 13197 consensus_peers.cc:597] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:52.319202 21325 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
W20260709 13:06:52.319442 12659 consensus_peers.cc:597] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:52.319859 21325 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:52.321986 21325 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:52.319381 11443 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 12643)
I20260709 13:06:52.348325 21426 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:52.348929 21426 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:52.352403 12662 leader_election.cc:336] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:52.355934 21426 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:52.359670 13200 consensus_peers.cc:597] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:52.365746 12662 leader_election.cc:336] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:52.376190 13200 consensus_peers.cc:597] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:52.377292 12659 leader_election.cc:336] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:52.377884 12659 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:52.382692 21426 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:06:52.390471 13197 consensus_peers.cc:597] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:52.399734 12659 leader_election.cc:336] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:52.400445 12659 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:52.401295 21426 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:06:52.409521 13197 consensus_peers.cc:597] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:52.401531 12659 consensus_peers.cc:597] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:52.414213 12693 raft_consensus.cc:1275] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 25 index: 21. Preceding OpId from leader: term: 26 index: 22. (index mismatch)
I20260709 13:06:52.415820 21347 consensus_queue.cc:1048] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
W20260709 13:06:52.417068 12659 consensus_peers.cc:597] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:52.426715 21426 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:52.427235 21426 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:52.430100 21426 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:52.439960 21426 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:52.440511 21426 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:52.440155 12662 leader_election.cc:336] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:52.442854 21426 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:52.443720 13197 consensus_peers.cc:597] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:52.447530 12662 leader_election.cc:336] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:52.450938 12659 consensus_peers.cc:597] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:52.454972 21426 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:52.455616 21426 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:52.457922 21426 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:52.458882 12659 leader_election.cc:336] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:52.459394 12659 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:52.460222 21325 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:52.462694 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
I20260709 13:06:52.463368 13235 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 24.
W20260709 13:06:52.465992 12659 leader_election.cc:336] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:52.471832 12659 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:52.473129 21325 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:06:52.475615 13200 consensus_peers.cc:597] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:06:52.476943 12662 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:52.478466 21325 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:06:52.478857 21325 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:52.479200 21325 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:06:52.487638 21325 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:52.491007 21325 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:52.489153 12659 consensus_peers.cc:597] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:52.499047 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44ad8138d0594c32b4590c837a41891e" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372"
I20260709 13:06:52.502532 13235 raft_consensus.cc:3060] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:06:52.509815 12659 leader_election.cc:336] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
W20260709 13:06:52.513888 12659 consensus_peers.cc:597] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:52.511005 13235 raft_consensus.cc:2468] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ad68e814a7741488971822f2598183a in term 25.
I20260709 13:06:52.516794 12662 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: 
I20260709 13:06:52.517773 21325 raft_consensus.cc:2804] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:06:52.518333 21325 raft_consensus.cc:697] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 25 LEADER]: Becoming Leader. State: Replica: 7ad68e814a7741488971822f2598183a, State: Running, Role: LEADER
I20260709 13:06:52.519997 21325 consensus_queue.cc:237] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 24.20, Last appended by leader: 20, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:52.529155 12659 leader_election.cc:336] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
W20260709 13:06:52.530114 12659 consensus_peers.cc:597] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:52.533236 13197 consensus_peers.cc:597] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:52.545933 21414 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:52.546473 21414 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:52.552975 12693 raft_consensus.cc:1275] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:06:52.553591 21414 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:52.557040 21426 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:52.557608 21426 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:52.559636 21426 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:52.562798 13197 leader_election.cc:336] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
W20260709 13:06:52.566380 12662 leader_election.cc:336] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:52.569398 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:52.570237 12690 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 26.
I20260709 13:06:52.569465 21414 consensus_queue.cc:1048] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.002s
I20260709 13:06:52.572178 13199 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:52.574178 21331 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:06:52.574661 21331 raft_consensus.cc:493] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting leader election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:52.575120 21331 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:06:52.572211 13197 consensus_peers.cc:597] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:52.584460 13197 consensus_peers.cc:597] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:52.585021 13197 consensus_peers.cc:597] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:52.587242 12441 catalog_manager.cc:5697] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a reported cstate change: term changed from 24 to 25, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 7ad68e814a7741488971822f2598183a (127.11.44.195). New cstate: current_term: 25 leader_uuid: "7ad68e814a7741488971822f2598183a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:52.591974 12659 leader_election.cc:336] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:52.592541 12659 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:52.593717 21325 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:06:52.608987 12659 consensus_peers.cc:597] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:52.625313 12659 consensus_peers.cc:597] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:52.629527 21331 raft_consensus.cc:515] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:52.643950 12659 consensus_peers.cc:597] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:52.652115 13235 raft_consensus.cc:1275] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 26 index: 20. Preceding OpId from leader: term: 27 index: 21. (index mismatch)
I20260709 13:06:52.656270 21325 consensus_queue.cc:1048] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
W20260709 13:06:52.671123 13197 leader_election.cc:336] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:52.676221 13228 raft_consensus.cc:1275] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 29 index: 20. (index mismatch)
I20260709 13:06:52.676221 21331 leader_election.cc:290] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 election: Requested vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:52.677325 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac31a22d7aa245e385188a5ff4068842" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a"
I20260709 13:06:52.677910 12690 raft_consensus.cc:3060] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Advancing to term 27
W20260709 13:06:52.685326 12659 consensus_peers.cc:597] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:52.689096 12690 raft_consensus.cc:2468] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 27.
I20260709 13:06:52.690560 13199 leader_election.cc:304] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:52.692114 21415 raft_consensus.cc:2804] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:06:52.692620 21415 raft_consensus.cc:697] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 LEADER]: Becoming Leader. State: Replica: 66750b8bbd4c4b3a9695951d0ede3372, State: Running, Role: LEADER
I20260709 13:06:52.693732 21415 consensus_queue.cc:237] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 26.20, Last appended by leader: 20, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:52.698316 12659 consensus_peers.cc:597] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:52.708946 13200 consensus_peers.cc:597] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:06:52.724778 12441 catalog_manager.cc:5697] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 reported cstate change: term changed from 26 to 27, leader changed from a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194) to 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196). New cstate: current_term: 27 leader_uuid: "66750b8bbd4c4b3a9695951d0ede3372" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:52.726166 21325 consensus_queue.cc:1048] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
W20260709 13:06:52.729965 13197 consensus_peers.cc:597] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:52.739619 13200 consensus_peers.cc:597] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:52.740173 13200 consensus_peers.cc:597] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:52.777135 12659 consensus_peers.cc:597] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:52.820266 13200 consensus_peers.cc:597] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:52.824671 13200 consensus_peers.cc:597] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:52.826560 12659 consensus_peers.cc:597] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:52.830528 13197 consensus_peers.cc:597] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:52.834983 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:34641, user_credentials={real_user=slave}} blocked reactor thread for 71273.7us
W20260709 13:06:52.847137 13197 consensus_peers.cc:597] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:52.957548 13197 consensus_peers.cc:597] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:53.028326 13228 raft_consensus.cc:1275] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Refusing update from remote peer 7ad68e814a7741488971822f2598183a: Log matching property violated. Preceding OpId in replica: term: 24 index: 20. Preceding OpId from leader: term: 25 index: 21. (index mismatch)
W20260709 13:06:53.049516 12662 consensus_peers.cc:597] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:06:53.054925 21425 consensus_queue.cc:1048] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [LEADER]: Connected to new peer: Peer: permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
W20260709 13:06:53.074241 12662 consensus_peers.cc:597] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:53.090499 13200 consensus_peers.cc:597] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:53.091095 13200 consensus_peers.cc:597] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:06:53.104239 12687 raft_consensus.cc:1275] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Refusing update from remote peer 66750b8bbd4c4b3a9695951d0ede3372: Log matching property violated. Preceding OpId in replica: term: 26 index: 20. Preceding OpId from leader: term: 27 index: 21. (index mismatch)
I20260709 13:06:53.107204 21438 consensus_queue.cc:1048] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 13:06:53.109122 21325 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:53.112630 21325 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:53.107448 12662 consensus_peers.cc:597] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:53.115063 12662 consensus_peers.cc:597] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:06:53.117040 21325 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:53.133688 13200 consensus_peers.cc:597] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:53.139237 13200 consensus_peers.cc:597] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:53.156129 12659 leader_election.cc:336] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
W20260709 13:06:53.161532 13200 consensus_peers.cc:597] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:53.203063 12662 leader_election.cc:336] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:53.207322 12662 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:53.208334 21325 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:06:53.209179 12662 consensus_peers.cc:597] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:53.257499 12659 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:41653, user_credentials={real_user=slave}} blocked reactor thread for 62796.4us
W20260709 13:06:53.267298 13197 consensus_peers.cc:597] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:53.275323 12659 consensus_peers.cc:597] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:53.293115 13200 consensus_peers.cc:597] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:53.293648 13200 consensus_peers.cc:597] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:53.309374 12662 consensus_peers.cc:597] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:53.322937 11443 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 12643)
W20260709 13:06:53.344199 13200 consensus_peers.cc:597] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:53.623729 12662 consensus_peers.cc:597] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:53.661497 21325 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:53.662217 21325 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:53.664237 21325 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:53.668440 12659 leader_election.cc:336] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:53.673774 21325 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:53.674564 21325 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:53.679556 12662 leader_election.cc:336] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:53.680007 12662 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:53.680939 21425 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:53.687366 21325 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:53.687808 12662 leader_election.cc:336] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:53.689850 12659 leader_election.cc:336] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:53.694691 12659 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:53.696906 21325 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:06:53.711866 12662 consensus_peers.cc:597] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:53.712805 12662 consensus_peers.cc:597] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:53.714849 13200 consensus_peers.cc:597] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:53.800748 21347 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:53.801396 21347 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:53.803639 21347 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:53.812273 13200 leader_election.cc:336] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:53.818188 13197 leader_election.cc:336] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:53.822043 13197 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:53.825784 21331 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:06:53.829702 12662 consensus_peers.cc:597] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:53.933533 12432 catalog_manager.cc:4755] TS a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet f2abdbdc67164b32bd58bfe3763a4183: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:53.949100 21331 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:53.950026 21331 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:53.954200 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:53.955096 12690 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 26.
W20260709 13:06:53.959884 13200 leader_election.cc:336] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:53.962484 13197 leader_election.cc:336] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:53.962942 13197 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:53.963676 21347 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:53.963882 21331 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:54.030486 12662 consensus_peers.cc:597] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:54.119765 13200 consensus_peers.cc:597] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:06:54.167251 21425 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:54.168038 21425 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:54.170565 21425 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:54.177999 12659 leader_election.cc:336] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
W20260709 13:06:54.180578 12662 leader_election.cc:336] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:54.181098 12662 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:54.182008 21443 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:06:54.218510 21425 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:54.219312 21425 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:54.221771 21425 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:54.257460 12662 leader_election.cc:336] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:54.258173 12662 consensus_peers.cc:597] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:54.287089 13197 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111) [suppressed 733 similar messages]
W20260709 13:06:54.291471 12659 leader_election.cc:336] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:54.299734 12659 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:54.292121 21425 raft_consensus.cc:493] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:54.306258 21425 raft_consensus.cc:515] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:54.308723 21425 leader_election.cc:290] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:54.313892 21443 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:06:54.323480 11443 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 12643)
I20260709 13:06:54.337743 21443 raft_consensus.cc:493] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 66750b8bbd4c4b3a9695951d0ede3372)
I20260709 13:06:54.338689 21443 raft_consensus.cc:515] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:54.341835 21443 leader_election.cc:290] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997)
W20260709 13:06:54.346563 12662 consensus_peers.cc:597] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:54.361276 12659 leader_election.cc:336] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:54.368449 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7724ca15b4534948997fc02e3fe5445a" candidate_uuid: "7ad68e814a7741488971822f2598183a" candidate_term: 26 candidate_status { last_received { term: 25 index: 14 } } ignore_live_leader: false dest_uuid: "66750b8bbd4c4b3a9695951d0ede3372" is_pre_election: true
W20260709 13:06:54.376336 12659 leader_election.cc:336] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
W20260709 13:06:54.374075 13200 consensus_peers.cc:597] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:54.378245 12662 leader_election.cc:336] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:54.387351 12662 leader_election.cc:304] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:54.391682 21443 raft_consensus.cc:2749] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:54.431236 12662 leader_election.cc:304] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: 66750b8bbd4c4b3a9695951d0ede3372, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:54.446276 21425 raft_consensus.cc:2749] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:06:54.450135 12662 consensus_peers.cc:597] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:54.463059 12662 leader_election.cc:336] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:54.494737 13200 consensus_peers.cc:597] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:06:54.495155 21425 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:54.495893 21425 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:54.498178 21425 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:54.512219 12659 leader_election.cc:336] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
W20260709 13:06:54.514320 12662 leader_election.cc:336] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:54.515729 12662 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:54.517788 21425 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:54.549863 21425 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:54.550526 21425 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:54.552712 21425 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:54.564069 12662 leader_election.cc:336] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:54.564906 12659 leader_election.cc:336] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:54.565306 12659 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:54.567781 21425 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:06:54.589532 13197 consensus_peers.cc:597] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:54.614552 21425 raft_consensus.cc:493] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:54.615264 21425 raft_consensus.cc:515] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:54.619072 13200 consensus_peers.cc:597] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:54.622555 12662 leader_election.cc:336] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:54.633332 21425 leader_election.cc:290] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:54.634503 12659 leader_election.cc:336] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:54.637940 12659 leader_election.cc:304] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:54.639755 21425 raft_consensus.cc:2749] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:06:54.688660 13197 consensus_peers.cc:597] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:54.730976 13197 consensus_peers.cc:597] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:54.749611 13197 consensus_peers.cc:597] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:54.780236 12659 consensus_peers.cc:597] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:54.793838 13197 consensus_peers.cc:597] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:54.806255 13200 consensus_peers.cc:597] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:54.807343 13197 consensus_peers.cc:597] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:54.809389 12659 consensus_peers.cc:597] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:54.823408 13197 consensus_peers.cc:597] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:54.826692 13200 consensus_peers.cc:597] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:54.842308 12659 consensus_peers.cc:597] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:54.866214 13197 consensus_peers.cc:597] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:54.876351 12659 consensus_peers.cc:597] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:54.878592 13200 consensus_peers.cc:597] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:54.908250 12659 consensus_peers.cc:597] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:54.911121 12659 consensus_peers.cc:597] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:54.934757 13197 consensus_peers.cc:597] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:54.945119 12659 consensus_peers.cc:597] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:54.947329 12659 consensus_peers.cc:597] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:54.973244 13200 consensus_peers.cc:597] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:54.996424 13197 consensus_peers.cc:597] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:54.996646 13200 consensus_peers.cc:597] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:55.075696 12659 consensus_peers.cc:597] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:55.091986 13197 consensus_peers.cc:597] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:55.097645 12659 consensus_peers.cc:597] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:55.116607 12659 consensus_peers.cc:597] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:55.162822 13197 consensus_peers.cc:597] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:55.202944 13197 consensus_peers.cc:597] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:55.203635 13200 consensus_peers.cc:597] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:55.215230 12659 consensus_peers.cc:597] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:06:55.220422 21443 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:55.221012 21443 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:55.223249 21443 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:55.228971 13197 consensus_peers.cc:597] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:55.234112 12662 leader_election.cc:336] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:55.237977 12659 leader_election.cc:336] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:55.241128 12659 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:06:55.241715 13200 consensus_peers.cc:597] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:06:55.246173 21425 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:06:55.246583 13197 consensus_peers.cc:597] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:55.255067 13197 consensus_peers.cc:597] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:55.264786 12659 consensus_peers.cc:597] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:55.273144 13197 consensus_peers.cc:597] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:55.349689 12659 consensus_peers.cc:597] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:55.389526 13197 consensus_peers.cc:597] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:55.426203 12659 consensus_peers.cc:597] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:55.431677 12659 consensus_peers.cc:597] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:55.436584 13200 consensus_peers.cc:597] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:55.496119 12662 consensus_peers.cc:597] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:55.532395 12662 consensus_peers.cc:597] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:55.562719 13200 consensus_peers.cc:597] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:55.565369 12662 consensus_peers.cc:597] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:55.579025 12662 consensus_peers.cc:597] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:55.672308 13200 consensus_peers.cc:597] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:55.700176 13197 consensus_peers.cc:597] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:55.708547 13200 consensus_peers.cc:597] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:55.717922 13200 consensus_peers.cc:597] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:55.731951 13200 consensus_peers.cc:597] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:55.815307 13200 consensus_peers.cc:597] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:55.838990 12662 consensus_peers.cc:597] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:06:55.847338 21443 raft_consensus.cc:493] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:55.847920 21443 raft_consensus.cc:515] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:55.850068 21443 leader_election.cc:290] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:55.857219 12662 leader_election.cc:336] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:55.863353 12659 leader_election.cc:336] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:55.863950 12659 leader_election.cc:304] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:55.865034 21425 raft_consensus.cc:2749] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:55.901599 21331 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:55.902191 21331 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:55.904861 21331 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:55.906088 12690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb1007aec88948499b3c20c4e58bba2f" candidate_uuid: "66750b8bbd4c4b3a9695951d0ede3372" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "7ad68e814a7741488971822f2598183a" is_pre_election: true
I20260709 13:06:55.906955 12690 raft_consensus.cc:2468] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66750b8bbd4c4b3a9695951d0ede3372 in term 26.
W20260709 13:06:55.910688 13200 leader_election.cc:336] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:55.916399 13197 leader_election.cc:336] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:55.916891 13197 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372, 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:55.917747 21331 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:06:55.927697 21443 raft_consensus.cc:493] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:55.928331 21443 raft_consensus.cc:515] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:55.930238 13200 consensus_peers.cc:597] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:55.930835 21443 leader_election.cc:290] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:55.938094 13200 consensus_peers.cc:597] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:55.948446 12659 leader_election.cc:336] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:55.950968 21443 raft_consensus.cc:493] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:55.951501 21443 raft_consensus.cc:515] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:55.953917 21443 leader_election.cc:290] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:55.967374 12659 leader_election.cc:336] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
W20260709 13:06:55.975467 12662 leader_election.cc:336] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:55.976131 12662 leader_election.cc:304] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:55.976998 21443 raft_consensus.cc:2749] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:06:55.978179 12662 consensus_peers.cc:597] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:55.990659 12662 leader_election.cc:336] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:55.991252 12662 leader_election.cc:304] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:55.996423 21443 raft_consensus.cc:2749] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:06:55.997700 12662 consensus_peers.cc:597] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:56.263768 21425 raft_consensus.cc:493] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:56.264307 21425 raft_consensus.cc:515] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:56.271337 12662 leader_election.cc:336] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:56.272665 21425 leader_election.cc:290] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:56.277222 12659 leader_election.cc:336] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:56.277745 12659 leader_election.cc:304] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:56.279207 21425 raft_consensus.cc:2749] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:06:56.388428 13200 consensus_peers.cc:597] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:56.405479 21331 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:56.406057 21331 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:56.411084 21331 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:56.414822 13197 leader_election.cc:336] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
W20260709 13:06:56.420610 13200 leader_election.cc:336] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:56.423158 13200 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:56.429867 21331 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:06:56.421531 12662 consensus_peers.cc:597] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:56.585417 12662 consensus_peers.cc:597] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:56.610232 12662 consensus_peers.cc:597] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:56.637372 13200 consensus_peers.cc:597] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:56.667263 12662 consensus_peers.cc:597] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:56.692322 12662 consensus_peers.cc:597] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:56.727435 12662 consensus_peers.cc:597] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:06:56.780408 11443 tablet_server.cc:196] TabletServer@127.11.44.194:0 shutdown complete.
W20260709 13:06:56.798029 13200 consensus_peers.cc:597] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:56.922298 12662 consensus_peers.cc:597] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:56.995302 13200 consensus_peers.cc:597] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:06:57.029151 13200 consensus_peers.cc:597] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:57.097366 12659 consensus_peers.cc:597] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:57.146239 12659 consensus_peers.cc:597] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:57.160974 13197 consensus_peers.cc:597] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:57.162426 11443 tablet_server.cc:179] TabletServer@127.11.44.195:0 shutting down...
W20260709 13:06:57.181493 12659 consensus_peers.cc:597] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:57.186900 13199 consensus_peers.cc:597] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:57.201814 12659 consensus_peers.cc:597] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:57.227245 12659 consensus_peers.cc:597] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:57.229776 13197 consensus_peers.cc:597] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:57.245185 13200 consensus_peers.cc:597] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:57.259886 13197 consensus_peers.cc:597] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:57.260643 13199 consensus_peers.cc:597] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:57.263850 13199 consensus_peers.cc:597] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:57.279408 21443 raft_consensus.cc:493] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:57.280104 21443 raft_consensus.cc:515] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
I20260709 13:06:57.282585 21443 leader_election.cc:290] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:57.289093 12662 leader_election.cc:336] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:57.293676 12659 leader_election.cc:336] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:57.294292 12659 leader_election.cc:304] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:57.295653 21443 raft_consensus.cc:2749] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:06:57.301297 13197 consensus_peers.cc:597] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:57.319357 13199 consensus_peers.cc:597] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:57.322542 13197 consensus_peers.cc:597] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:57.328060 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:06:57.331626 21443 raft_consensus.cc:493] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:57.335479 21443 raft_consensus.cc:515] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:57.355732 12659 leader_election.cc:336] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
W20260709 13:06:57.356452 12659 consensus_peers.cc:597] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:57.346186 21443 leader_election.cc:290] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:06:57.357525 12662 leader_election.cc:336] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:57.358498 12662 leader_election.cc:304] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:57.359999 21443 raft_consensus.cc:2749] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:06:57.361763 11443 tablet_replica.cc:333] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.362912 11443 raft_consensus.cc:2243] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:06:57.364539 11443 raft_consensus.cc:2272] T d57d5dfad8e146a193ef43ffcbaac5ad P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.367830 11443 tablet_replica.cc:333] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.368777 11443 raft_consensus.cc:2243] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.369439 11443 raft_consensus.cc:2272] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:57.372001 13199 consensus_peers.cc:597] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:57.372442 11443 tablet_replica.cc:333] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.373401 11443 raft_consensus.cc:2243] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 21 LEADER]: Raft consensus shutting down.
W20260709 13:06:57.374667 13200 consensus_peers.cc:597] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:57.374678 13199 consensus_peers.cc:597] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:57.379714 13199 consensus_peers.cc:597] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:57.381254 11443 raft_consensus.cc:2272] T f2abdbdc67164b32bd58bfe3763a4183 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.384608 11443 tablet_replica.cc:333] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.385584 11443 raft_consensus.cc:2243] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.386291 11443 raft_consensus.cc:2272] T fb8ee8ee1a2c43cc9dc422f32773a55b P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:57.395709 12659 consensus_peers.cc:597] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:57.398509 11443 tablet_replica.cc:333] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.399557 11443 raft_consensus.cc:2243] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.400538 11443 raft_consensus.cc:2272] T d24f57e3f5524b1c8e167aff853a0218 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.403795 11443 tablet_replica.cc:333] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.404722 11443 raft_consensus.cc:2243] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:06:57.406504 11443 raft_consensus.cc:2272] T 7de7740d60cf417e8f6867a7d23f010f P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.409329 11443 tablet_replica.cc:333] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
W20260709 13:06:57.409449 13199 consensus_peers.cc:597] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:57.410548 11443 raft_consensus.cc:2243] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:06:57.410917 13199 consensus_peers.cc:597] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:57.412266 11443 raft_consensus.cc:2272] T e64b5865b31f48158abb124846961f72 P 7ad68e814a7741488971822f2598183a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.415196 11443 tablet_replica.cc:333] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.416054 11443 raft_consensus.cc:2243] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.416868 11443 raft_consensus.cc:2272] T 7724ca15b4534948997fc02e3fe5445a P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.419683 11443 tablet_replica.cc:333] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.420529 11443 raft_consensus.cc:2243] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.421307 11443 raft_consensus.cc:2272] T f7bf456f0b724194a6e042403ee0b730 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:57.422716 13197 consensus_peers.cc:597] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:57.424248 11443 tablet_replica.cc:333] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.425206 11443 raft_consensus.cc:2243] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.426299 11443 raft_consensus.cc:2272] T dd40576623a84072be59a32d23cda14b P 7ad68e814a7741488971822f2598183a [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.429349 11443 tablet_replica.cc:333] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.430263 11443 raft_consensus.cc:2243] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.431304 11443 raft_consensus.cc:2272] T eb9d67599bec471cb17398de70b43841 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.434548 11443 tablet_replica.cc:333] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.435527 11443 raft_consensus.cc:2243] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.436734 11443 raft_consensus.cc:2272] T ddff67072e694e36addbc3b673b008d0 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.439843 11443 tablet_replica.cc:333] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.440666 11443 raft_consensus.cc:2243] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Raft consensus shutting down.
W20260709 13:06:57.441756 13199 consensus_peers.cc:597] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:57.441965 11443 raft_consensus.cc:2272] T 789704b18a5945318724c3ba1ca5b6e5 P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.444646 11443 tablet_replica.cc:333] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.445417 11443 raft_consensus.cc:2243] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.446547 11443 raft_consensus.cc:2272] T 7c94183b9e8b46989e1da72e911d7aee P 7ad68e814a7741488971822f2598183a [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.459537 11443 tablet_replica.cc:333] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.460430 11443 raft_consensus.cc:2243] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:06:57.461795 11443 raft_consensus.cc:2272] T d00b21d8b1e5471b8bf4e449c8b98cd7 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.463200 21443 raft_consensus.cc:493] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:06:57.463738 21443 raft_consensus.cc:515] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } }
W20260709 13:06:57.469941 13199 consensus_peers.cc:597] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:57.472554 11443 tablet_replica.cc:333] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a: stopping tablet replica
W20260709 13:06:57.479324 13197 consensus_peers.cc:597] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:57.479677 12662 leader_election.cc:336] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:57.480167 13197 consensus_peers.cc:597] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:57.480513 11443 raft_consensus.cc:2243] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.480937 21443 leader_election.cc:290] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
I20260709 13:06:57.481740 11443 raft_consensus.cc:2272] T d21e2686d5e84f6495f1b6f8a9b68dca P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.485002 11443 tablet_replica.cc:333] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a: stopping tablet replica
W20260709 13:06:57.485134 12659 consensus_peers.cc:597] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:57.486392 11443 raft_consensus.cc:2243] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 20 LEADER]: Raft consensus shutting down.
W20260709 13:06:57.489441 12659 leader_election.cc:336] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:57.490058 12659 leader_election.cc:304] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ad68e814a7741488971822f2598183a; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:57.490547 11443 raft_consensus.cc:2272] T 69bd963c45b34a92981b6663666fc7eb P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.491103 21443 raft_consensus.cc:2749] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:06:57.493646 11443 tablet_replica.cc:333] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
W20260709 13:06:57.480811 13199 consensus_peers.cc:597] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:57.499073 13199 consensus_peers.cc:597] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:57.501240 13200 consensus_peers.cc:597] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:57.502385 13200 consensus_peers.cc:597] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:06:57.509862 11443 raft_consensus.cc:2243] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.510885 11443 raft_consensus.cc:2272] T bf1f0526c7954a23b36c79f2c2b19122 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.514106 11443 tablet_replica.cc:333] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.515216 11443 raft_consensus.cc:2243] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:06:57.516778 11443 raft_consensus.cc:2272] T 5f0f42b279a3452b8aebddcb497afc9d P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.520066 11443 tablet_replica.cc:333] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.521258 11443 raft_consensus.cc:2243] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.522389 11443 raft_consensus.cc:2272] T 0f7c3aec6a56450cb76aab45d874eff7 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.525667 11443 tablet_replica.cc:333] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.526846 11443 raft_consensus.cc:2243] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.527669 11443 raft_consensus.cc:2272] T 9209cf88e9b140a58be2e0d349b1263b P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.530838 11443 tablet_replica.cc:333] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.531733 11443 raft_consensus.cc:2243] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:06:57.533027 11443 raft_consensus.cc:2272] T 8b8383d4233b4ad5871ffc0dc8d82321 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:57.537503 13199 consensus_peers.cc:597] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:57.538281 12659 consensus_peers.cc:597] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:57.540400 11443 tablet_replica.cc:333] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.541718 11443 raft_consensus.cc:2243] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.542490 11443 raft_consensus.cc:2272] T 7d31111d98c04e47baff178e562510a8 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.545435 11443 tablet_replica.cc:333] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.546371 11443 raft_consensus.cc:2243] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.547017 11443 raft_consensus.cc:2272] T ee851126f3964a84a26d5d9a400ec3a8 P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.551134 11443 tablet_replica.cc:333] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.552089 11443 raft_consensus.cc:2243] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:06:57.556248 11443 raft_consensus.cc:2272] T ec9f14432c254d7a84f0c763fabd3d34 P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.559649 11443 tablet_replica.cc:333] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.560586 11443 raft_consensus.cc:2243] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:06:57.564589 11443 raft_consensus.cc:2272] T 5589ff6a0b984c84a050ecad03db5a87 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.567410 11443 tablet_replica.cc:333] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.571866 11443 raft_consensus.cc:2243] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:06:57.573071 11443 raft_consensus.cc:2272] T dda7dbc055d64c86aedec4299e15f997 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.575940 11443 tablet_replica.cc:333] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.576715 11443 raft_consensus.cc:2243] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.578429 11443 raft_consensus.cc:2272] T fb1007aec88948499b3c20c4e58bba2f P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.581444 11443 tablet_replica.cc:333] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.582368 11443 raft_consensus.cc:2243] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:06:57.583909 11443 raft_consensus.cc:2272] T df093254fdff40f38b8370a4e884cc5d P 7ad68e814a7741488971822f2598183a [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.586898 11443 tablet_replica.cc:333] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.587903 11443 raft_consensus.cc:2243] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.588598 11443 raft_consensus.cc:2272] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 7ad68e814a7741488971822f2598183a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.591917 11443 tablet_replica.cc:333] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.592839 11443 raft_consensus.cc:2243] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.593478 11443 raft_consensus.cc:2272] T 0bcff91ac60a48ff97278bdb5c4d21dc P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:57.594951 13197 consensus_peers.cc:597] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:06:57.596572 11443 tablet_replica.cc:333] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.597524 11443 raft_consensus.cc:2243] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.598371 11443 raft_consensus.cc:2272] T ac31a22d7aa245e385188a5ff4068842 P 7ad68e814a7741488971822f2598183a [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.601027 11443 tablet_replica.cc:333] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.601897 11443 raft_consensus.cc:2243] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:06:57.603166 11443 raft_consensus.cc:2272] T 1d83186354414170b4775351916c56c2 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.606209 11443 tablet_replica.cc:333] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.607084 11443 raft_consensus.cc:2243] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 29 LEADER]: Raft consensus shutting down.
W20260709 13:06:57.608362 13197 consensus_peers.cc:597] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:57.608349 11443 raft_consensus.cc:2272] T 2f072313cdba43b09e842af6e98f0385 P 7ad68e814a7741488971822f2598183a [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.612154 11443 tablet_replica.cc:333] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.613020 11443 raft_consensus.cc:2243] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.613829 11443 raft_consensus.cc:2272] T a269dd3f9bbd4e53a58b736c0a5bf8b9 P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.616704 11443 tablet_replica.cc:333] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.617442 11443 raft_consensus.cc:2243] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.618387 11443 raft_consensus.cc:2272] T 4432abbae9994c048d249abe3143fa09 P 7ad68e814a7741488971822f2598183a [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:57.619700 13199 consensus_peers.cc:597] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:57.621315 11443 tablet_replica.cc:333] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.622272 11443 raft_consensus.cc:2243] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:06:57.623565 11443 raft_consensus.cc:2272] T 44ad8138d0594c32b4590c837a41891e P 7ad68e814a7741488971822f2598183a [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.626411 11443 tablet_replica.cc:333] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.627233 11443 raft_consensus.cc:2243] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.627967 11443 raft_consensus.cc:2272] T 6542f7c6287d4310b225c3c8479d4eca P 7ad68e814a7741488971822f2598183a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.630995 11443 tablet_replica.cc:333] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.631748 11443 raft_consensus.cc:2243] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:06:57.633104 11443 raft_consensus.cc:2272] T 8c94bcdd6f18485cabc0ed14df679880 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.636132 11443 tablet_replica.cc:333] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.636963 11443 raft_consensus.cc:2243] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.637732 11443 raft_consensus.cc:2272] T 22a877009d42412fb470ba88a418be05 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.640718 11443 tablet_replica.cc:333] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.641631 11443 raft_consensus.cc:2243] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.642374 11443 raft_consensus.cc:2272] T ab3ccbaad6d445c580a75e6a739a1422 P 7ad68e814a7741488971822f2598183a [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.645180 11443 tablet_replica.cc:333] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.646071 11443 raft_consensus.cc:2243] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.646787 11443 raft_consensus.cc:2272] T f46dfbe6726b4cdd862263f711c7d5d9 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.650003 11443 tablet_replica.cc:333] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.650759 11443 raft_consensus.cc:2243] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.651831 11443 raft_consensus.cc:2272] T 02ea9ad298ab4fa08087d24740b5a13b P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.655441 11443 tablet_replica.cc:333] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.656236 11443 raft_consensus.cc:2243] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:06:57.657431 11443 raft_consensus.cc:2272] T ba3a2645bcdf4ca5b8e0a2133dd93114 P 7ad68e814a7741488971822f2598183a [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:57.659127 13197 consensus_peers.cc:597] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:06:57.660122 11443 tablet_replica.cc:333] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.660948 11443 raft_consensus.cc:2243] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:06:57.662379 11443 raft_consensus.cc:2272] T 8dcafb50fd3c47afbf475b1da51b147a P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.665385 11443 tablet_replica.cc:333] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.666148 11443 raft_consensus.cc:2243] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.666805 11443 raft_consensus.cc:2272] T e396b3164bf5409c9d6b0dd8dc22cd2d P 7ad68e814a7741488971822f2598183a [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:57.668726 13199 consensus_peers.cc:597] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:57.669647 11443 tablet_replica.cc:333] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.670491 11443 raft_consensus.cc:2243] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:57.671450 11443 raft_consensus.cc:2272] T 5d48be0c79154aa3938113fc3c045740 P 7ad68e814a7741488971822f2598183a [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:57.674392 11443 tablet_replica.cc:333] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a: stopping tablet replica
I20260709 13:06:57.675036 11443 raft_consensus.cc:2243] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:06:57.676249 11443 raft_consensus.cc:2272] T 2ec4af0b6e774d2986c11b75c9460d83 P 7ad68e814a7741488971822f2598183a [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 13:06:57.683946 13197 consensus_peers.cc:597] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:57.684574 13197 consensus_peers.cc:597] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:57.686632 13199 consensus_peers.cc:597] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:57.687799 13200 consensus_peers.cc:597] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:57.728612 13197 consensus_peers.cc:597] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:57.742380 13200 consensus_peers.cc:597] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:57.755501 13199 consensus_peers.cc:597] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:57.767550 13197 consensus_peers.cc:597] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:57.778345 13197 consensus_peers.cc:597] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:57.808693 13197 consensus_peers.cc:597] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:57.943328 13200 consensus_peers.cc:597] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:58.051771 13200 consensus_peers.cc:597] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:58.053259 13197 consensus_peers.cc:597] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:06:58.077638 13200 consensus_peers.cc:597] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:58.100889 12432 catalog_manager.cc:4755] TS a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet f2abdbdc67164b32bd58bfe3763a4183: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:06:58.117774 13200 consensus_peers.cc:597] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:58.134166 13200 consensus_peers.cc:597] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:58.155256 13200 consensus_peers.cc:597] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:58.240293 13197 consensus_peers.cc:597] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:06:58.405910 13200 consensus_peers.cc:597] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:58.450209 13200 consensus_peers.cc:597] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:58.629534 13200 consensus_peers.cc:597] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:58.636446 21453 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:58.637310 21453 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:58.645068 13200 consensus_peers.cc:597] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:06:58.642633 21453 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:58.667922 13199 leader_election.cc:336] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111)
W20260709 13:06:58.674518 13200 leader_election.cc:336] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:58.678750 21331 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:58.679843 21331 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:58.683730 21331 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:58.684402 13200 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:58.691996 21453 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:06:58.733978 13199 leader_election.cc:336] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111)
I20260709 13:06:58.735718 21331 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:58.737013 21331 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:58.743957 21451 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:58.744733 21451 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:58.748034 21451 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:58.750643 13197 leader_election.cc:336] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:58.754503 13197 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:58.761790 21453 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:06:58.752905 21331 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:58.771920 13199 leader_election.cc:336] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111)
W20260709 13:06:58.772621 13199 leader_election.cc:336] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111)
I20260709 13:06:58.785791 21453 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:58.786440 21453 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:58.788429 21453 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:58.788915 21453 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:58.789331 21453 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:06:58.790122 13200 leader_election.cc:336] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:58.790577 13200 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:58.791235 21453 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:06:58.791738 21453 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:06:58.803125 13197 leader_election.cc:336] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:58.803570 13197 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:58.805239 21451 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:06:58.815289 13197 leader_election.cc:336] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
W20260709 13:06:58.816175 13197 leader_election.cc:336] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
W20260709 13:06:58.816548 13199 leader_election.cc:336] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111)
I20260709 13:06:58.817474 13199 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:58.818253 21331 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:06:58.818403 13199 leader_election.cc:336] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111)
I20260709 13:06:58.818830 13199 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:58.819474 21331 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:06:58.846767 11443 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 12717)
W20260709 13:06:58.878968 13200 consensus_peers.cc:597] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:06:59.054999 21453 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:59.055531 21453 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:59.057703 21453 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:59.070461 13199 leader_election.cc:336] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111)
W20260709 13:06:59.071303 13197 leader_election.cc:336] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:06:59.071697 13197 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:06:59.073962 21453 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260709 13:06:59.100785 21331 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:06:59.101358 21331 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:06:59.103626 21331 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:06:59.113662 13199 leader_election.cc:336] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111)
W20260709 13:06:59.115871 13200 leader_election.cc:336] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:06:59.117538 13200 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:06:59.125173 21331 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:06:59.245249 13200 consensus_peers.cc:597] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:59.297130 13197 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111) [suppressed 714 similar messages]
W20260709 13:06:59.308202 13200 consensus_peers.cc:597] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:59.334071 13200 consensus_peers.cc:597] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:06:59.361156 13199 consensus_peers.cc:597] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:59.471715 13200 consensus_peers.cc:597] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:06:59.542697 13197 consensus_peers.cc:597] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:59.555852 13199 consensus_peers.cc:597] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:59.647377 13199 consensus_peers.cc:597] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:59.661510 13199 consensus_peers.cc:597] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:59.717422 13197 consensus_peers.cc:597] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:59.730252 13199 consensus_peers.cc:597] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:59.754269 13197 consensus_peers.cc:597] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:59.775624 13197 consensus_peers.cc:597] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:59.847277 11443 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 12717)
W20260709 13:06:59.847652 13199 consensus_peers.cc:597] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:59.859143 13197 consensus_peers.cc:597] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:59.866880 13199 consensus_peers.cc:597] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:59.873090 13199 consensus_peers.cc:597] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:59.881392 13200 consensus_peers.cc:597] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:59.892378 13197 consensus_peers.cc:597] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:06:59.912972 13200 consensus_peers.cc:597] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:59.924573 13199 consensus_peers.cc:597] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:59.925412 13199 consensus_peers.cc:597] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:59.944617 13200 consensus_peers.cc:597] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:06:59.970185 13199 consensus_peers.cc:597] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:06:59.996417 13197 consensus_peers.cc:597] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:00.072583 13199 consensus_peers.cc:597] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:00.092551 13197 consensus_peers.cc:597] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:00.103863 13197 consensus_peers.cc:597] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:00.110548 13197 consensus_peers.cc:597] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:00.118844 13199 consensus_peers.cc:597] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:00.162381 21331 raft_consensus.cc:493] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:07:00.163017 21331 raft_consensus.cc:515] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:07:00.165115 21331 leader_election.cc:290] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653)
W20260709 13:07:00.174448 13197 consensus_peers.cc:597] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:00.178140 13200 leader_election.cc:336] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:07:00.182811 13197 consensus_peers.cc:597] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:00.199543 13199 consensus_peers.cc:597] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:00.200605 13199 consensus_peers.cc:597] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:00.210767 13197 leader_election.cc:336] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:07:00.211443 13197 leader_election.cc:304] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
I20260709 13:07:00.212447 21331 raft_consensus.cc:2749] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:07:00.215754 13197 consensus_peers.cc:597] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:00.233122 13200 consensus_peers.cc:597] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:00.265702 13200 consensus_peers.cc:597] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:00.293889 13197 consensus_peers.cc:597] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:00.318722 13199 consensus_peers.cc:597] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:00.365101 13199 consensus_peers.cc:597] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:00.383406 13197 consensus_peers.cc:597] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:00.391870 13197 consensus_peers.cc:597] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:07:00.418993 13200 consensus_peers.cc:597] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:07:00.425347 21453 raft_consensus.cc:493] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a11816c5d72e4d1295a242f3ced09e5f)
I20260709 13:07:00.426018 21453 raft_consensus.cc:515] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:07:00.429991 21453 leader_election.cc:290] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:07:00.435530 13197 leader_election.cc:336] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
W20260709 13:07:00.439381 13199 consensus_peers.cc:597] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:00.444684 13200 leader_election.cc:336] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:07:00.445220 13200 leader_election.cc:304] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: a11816c5d72e4d1295a242f3ced09e5f, a70479a3b4114f3581095e9890f5d653
W20260709 13:07:00.446358 13197 consensus_peers.cc:597] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:07:00.446620 21453 raft_consensus.cc:2749] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:07:00.447764 13199 leader_election.cc:336] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111)
W20260709 13:07:00.448604 13200 consensus_peers.cc:597] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:07:00.480986 21458 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:07:00.481652 21458 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:07:00.483852 21458 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:07:00.490088 13197 leader_election.cc:336] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
W20260709 13:07:00.491631 13199 leader_election.cc:336] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111)
I20260709 13:07:00.492101 13199 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:07:00.492810 21458 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:07:00.496781 13200 consensus_peers.cc:597] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:00.517771 13200 consensus_peers.cc:597] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:07:00.598405 21458 raft_consensus.cc:493] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:07:00.599045 21458 raft_consensus.cc:515] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:07:00.601317 21458 leader_election.cc:290] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:07:00.611021 13199 leader_election.cc:336] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111)
W20260709 13:07:00.612020 13200 leader_election.cc:336] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:07:00.612434 13200 leader_election.cc:304] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:07:00.613543 21458 raft_consensus.cc:2749] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:07:00.626909 13197 consensus_peers.cc:597] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:07:00.727514 13200 consensus_peers.cc:597] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:00.728083 13200 consensus_peers.cc:597] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:07:00.752666 21458 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:07:00.753187 21458 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:07:00.756549 21458 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:07:00.765025 13199 leader_election.cc:336] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111)
W20260709 13:07:00.768392 13197 leader_election.cc:336] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:07:00.769410 13197 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:07:00.770175 21458 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:00.849673 11443 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 12717)
W20260709 13:07:00.878638 13197 consensus_peers.cc:597] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:07:00.894925 21458 raft_consensus.cc:493] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:07:00.895565 21458 raft_consensus.cc:515] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
W20260709 13:07:00.910513 13199 leader_election.cc:336] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111)
W20260709 13:07:00.914798 13200 leader_election.cc:336] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:07:00.915324 13200 leader_election.cc:304] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:07:00.911484 21458 leader_election.cc:290] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
I20260709 13:07:00.917506 21453 raft_consensus.cc:493] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:07:00.918061 21453 raft_consensus.cc:515] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:07:00.920115 21453 leader_election.cc:290] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:07:00.921083 13200 consensus_peers.cc:597] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:07:00.921509 21458 raft_consensus.cc:2749] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:07:00.944702 13200 leader_election.cc:336] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
W20260709 13:07:00.947453 13199 leader_election.cc:336] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111)
I20260709 13:07:00.958295 13199 leader_election.cc:304] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a70479a3b4114f3581095e9890f5d653
I20260709 13:07:00.970516 21453 raft_consensus.cc:2749] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:07:01.018101 13200 consensus_peers.cc:597] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:07:01.021827 21458 raft_consensus.cc:493] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:07:01.022392 21458 raft_consensus.cc:515] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:07:01.024454 21458 leader_election.cc:290] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:07:01.039103 13197 leader_election.cc:336] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
W20260709 13:07:01.041231 13199 leader_election.cc:336] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111)
I20260709 13:07:01.042550 13199 leader_election.cc:304] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:07:01.044593 21458 raft_consensus.cc:2749] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:07:01.051234 21458 raft_consensus.cc:493] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:07:01.051767 21458 raft_consensus.cc:515] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:07:01.057461 21458 leader_election.cc:290] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:07:01.058888 13197 leader_election.cc:336] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
W20260709 13:07:01.077721 13199 leader_election.cc:336] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111)
I20260709 13:07:01.078259 13199 leader_election.cc:304] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:07:01.080935 21458 raft_consensus.cc:2749] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:07:01.160499 13200 consensus_peers.cc:597] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:07:01.220422 21453 raft_consensus.cc:493] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:07:01.220892 21453 raft_consensus.cc:515] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:07:01.223634 21453 leader_election.cc:290] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:07:01.229617 13199 leader_election.cc:336] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111)
W20260709 13:07:01.236478 13200 consensus_peers.cc:597] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:01.266451 13197 leader_election.cc:336] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:07:01.267342 13197 leader_election.cc:304] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:07:01.269425 21458 raft_consensus.cc:2749] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:07:01.307678 13200 consensus_peers.cc:597] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:01.401147 13200 consensus_peers.cc:597] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:01.422788 13200 consensus_peers.cc:597] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:01.530683 13200 consensus_peers.cc:597] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:07:01.624725 13200 consensus_peers.cc:597] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:07:01.853215 13200 consensus_peers.cc:597] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:07:01.938575 13199 consensus_peers.cc:597] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:01.944708 13199 consensus_peers.cc:597] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:02.048759 13199 consensus_peers.cc:597] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:02.119880 13197 consensus_peers.cc:597] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:02.131450 13199 consensus_peers.cc:597] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:02.139470 13197 consensus_peers.cc:597] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:07:02.165498 11443 tablet_server.cc:196] TabletServer@127.11.44.195:0 shutdown complete.
W20260709 13:07:02.243956 13199 consensus_peers.cc:597] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:02.245831 13197 consensus_peers.cc:597] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:02.258330 13199 consensus_peers.cc:597] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:02.262253 13200 consensus_peers.cc:597] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:07:02.298058 21458 raft_consensus.cc:493] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:07:02.298848 21458 raft_consensus.cc:515] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:07:02.302698 21458 leader_election.cc:290] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:07:02.307999 13199 leader_election.cc:336] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111)
W20260709 13:07:02.309602 13197 consensus_peers.cc:597] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:02.317152 13197 consensus_peers.cc:597] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:02.341091 13197 leader_election.cc:336] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
I20260709 13:07:02.342271 13197 leader_election.cc:304] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:07:02.344782 21458 raft_consensus.cc:2749] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:02.348441 11443 tablet_server.cc:179] TabletServer@127.11.44.196:0 shutting down...
W20260709 13:07:02.352890 13197 consensus_peers.cc:597] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:02.389952 13199 consensus_peers.cc:597] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:02.430234 13199 consensus_peers.cc:597] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:02.430835 13199 consensus_peers.cc:597] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:02.460486 13199 consensus_peers.cc:597] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:02.465081 21453 raft_consensus.cc:493] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 7ad68e814a7741488971822f2598183a)
I20260709 13:07:02.465739 21453 raft_consensus.cc:515] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } }
I20260709 13:07:02.468091 21453 leader_election.cc:290] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653), 7ad68e814a7741488971822f2598183a (127.11.44.195:34641)
W20260709 13:07:02.476431 13197 leader_election.cc:336] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111)
W20260709 13:07:02.478503 13199 leader_election.cc:336] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111)
I20260709 13:07:02.479084 13199 leader_election.cc:304] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66750b8bbd4c4b3a9695951d0ede3372; no voters: 7ad68e814a7741488971822f2598183a, a11816c5d72e4d1295a242f3ced09e5f
I20260709 13:07:02.480407 21453 raft_consensus.cc:2749] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:07:02.506351 13199 consensus_peers.cc:597] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:02.512744 13199 consensus_peers.cc:597] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:02.525396 13197 consensus_peers.cc:597] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:02.534554 13200 consensus_peers.cc:597] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:07:02.535720 13197 consensus_peers.cc:597] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:07:02.546339 13200 consensus_peers.cc:597] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:07:02.537362 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:02.552824 11443 tablet_replica.cc:333] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.553923 11443 raft_consensus.cc:2243] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.555320 11443 raft_consensus.cc:2272] T ddff67072e694e36addbc3b673b008d0 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.558526 11443 tablet_replica.cc:333] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.559561 11443 raft_consensus.cc:2243] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.560698 11443 raft_consensus.cc:2272] T f2abdbdc67164b32bd58bfe3763a4183 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.563743 11443 tablet_replica.cc:333] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.564673 11443 raft_consensus.cc:2243] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.565860 11443 raft_consensus.cc:2272] T 6cba1eecd7bd4c2b913bcfdaa3c7c88c P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.574946 11443 tablet_replica.cc:333] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.575873 11443 raft_consensus.cc:2243] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Raft consensus shutting down.
W20260709 13:07:02.580832 13199 consensus_peers.cc:597] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:02.582428 11443 raft_consensus.cc:2272] T 0767462f04d344b5a4fce9de7e885245 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.585579 11443 tablet_replica.cc:333] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.586440 11443 raft_consensus.cc:2243] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.587572 11443 pending_rounds.cc:70] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Trying to abort 1 pending ops.
I20260709 13:07:02.588280 11443 pending_rounds.cc:77] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372: Aborting op as it isn't in flight: id { term: 25 index: 15 } timestamp: 7305635471404883968 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "7724ca15b4534948997fc02e3fe5445a" old_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "7ad68e814a7741488971822f2598183a" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 34641 } attrs { replace: true } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } } new_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "a70479a3b4114f3581095e9890f5d653" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43307 } } peers { permanent_uuid: "a11816c5d72e4d1295a242f3ced09e5f" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 41653 } } peers { permanent_uuid: "66750b8bbd4c4b3a9695951d0ede3372" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 33997 } attrs { promote: false } } } }
I20260709 13:07:02.603796 11443 raft_consensus.cc:2917] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 LEADER]: Aborting config change with OpId 25.15: Aborted: Op aborted
I20260709 13:07:02.604350 11443 raft_consensus.cc:2889] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 LEADER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:07:02.605049 11443 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:43514 (request call id 1) took 12595 ms. Trace:
I20260709 13:07:02.605463 11443 rpcz_store.cc:276] 0709 13:06:50.010097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.010246 (+   149us) service_pool.cc:224] Handling call
0709 13:06:50.021831 (+ 11585us) log.cc:844] Serialized 501 byte log entry
0709 13:07:02.604949 (+12583118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2551,"raft.queue_time_us":5495,"raft.run_cpu_time_us":1290,"raft.run_wall_time_us":1289,"spinlock_wait_cycles":19712}
I20260709 13:07:02.607086 11443 raft_consensus.cc:2272] T 7724ca15b4534948997fc02e3fe5445a P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:02.607159 12432 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7724ca15b4534948997fc02e3fe5445a with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER failed with leader 66750b8bbd4c4b3a9695951d0ede3372 (127.11.44.196:33997) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted
I20260709 13:07:02.610466 11443 tablet_replica.cc:333] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.611641 11443 raft_consensus.cc:2243] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.612914 11443 raft_consensus.cc:2272] T f7bf456f0b724194a6e042403ee0b730 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.615945 11443 tablet_replica.cc:333] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.616977 11443 raft_consensus.cc:2243] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.623376 11443 raft_consensus.cc:2272] T 22a877009d42412fb470ba88a418be05 P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:02.633419 13200 consensus_peers.cc:597] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): Couldn't send request to peer a70479a3b4114f3581095e9890f5d653. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:07:02.636555 11443 tablet_replica.cc:333] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.637529 11443 raft_consensus.cc:2243] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.638443 11443 raft_consensus.cc:2272] T 1d83186354414170b4775351916c56c2 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.646266 11443 tablet_replica.cc:333] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.647163 11443 raft_consensus.cc:2243] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.648165 11443 raft_consensus.cc:2272] T 2f072313cdba43b09e842af6e98f0385 P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.651077 11443 tablet_replica.cc:333] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.651929 11443 raft_consensus.cc:2243] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.653463 11443 raft_consensus.cc:2272] T 9dbe6a90f99a44fe85d2c7a8bcb7c9ad P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.656535 11443 tablet_replica.cc:333] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.657364 11443 raft_consensus.cc:2243] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.658509 11443 raft_consensus.cc:2272] T d21e2686d5e84f6495f1b6f8a9b68dca P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.661412 11443 tablet_replica.cc:333] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.662555 11443 raft_consensus.cc:2243] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.663277 11443 raft_consensus.cc:2272] T 67b0620b67b94f25ad79a8b18732686a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.666383 11443 tablet_replica.cc:333] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.667188 11443 raft_consensus.cc:2243] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.667840 11443 raft_consensus.cc:2272] T 8dcafb50fd3c47afbf475b1da51b147a P 66750b8bbd4c4b3a9695951d0ede3372 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.670739 11443 tablet_replica.cc:333] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.671613 11443 raft_consensus.cc:2243] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.672838 11443 raft_consensus.cc:2272] T bf1f0526c7954a23b36c79f2c2b19122 P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.675705 11443 tablet_replica.cc:333] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.676576 11443 raft_consensus.cc:2243] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.677770 11443 raft_consensus.cc:2272] T 5d48be0c79154aa3938113fc3c045740 P 66750b8bbd4c4b3a9695951d0ede3372 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.680536 11443 tablet_replica.cc:333] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.681324 11443 raft_consensus.cc:2243] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.682500 11443 raft_consensus.cc:2272] T 588a15c12a6c46ab9373c48890191400 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.685384 11443 tablet_replica.cc:333] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.686349 11443 raft_consensus.cc:2243] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.687430 11443 raft_consensus.cc:2272] T e396b3164bf5409c9d6b0dd8dc22cd2d P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.690372 11443 tablet_replica.cc:333] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.691253 11443 raft_consensus.cc:2243] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.691834 11443 raft_consensus.cc:2272] T 44ad8138d0594c32b4590c837a41891e P 66750b8bbd4c4b3a9695951d0ede3372 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.694581 11443 tablet_replica.cc:333] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.695367 11443 raft_consensus.cc:2243] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.696460 11443 raft_consensus.cc:2272] T f6ccc9457e2e4aeaac5163b9bb9f13cb P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.699169 11443 tablet_replica.cc:333] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.699929 11443 raft_consensus.cc:2243] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.701372 11443 raft_consensus.cc:2272] T 4432abbae9994c048d249abe3143fa09 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.704489 11443 tablet_replica.cc:333] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.705366 11443 raft_consensus.cc:2243] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.706565 11443 raft_consensus.cc:2272] T d88c15b898154821b2931e6b0f47833e P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.709414 11443 tablet_replica.cc:333] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.710667 11443 raft_consensus.cc:2243] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Raft consensus shutting down.
W20260709 13:07:02.715879 13199 consensus_peers.cc:597] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer 7ad68e814a7741488971822f2598183a (127.11.44.195:34641): Couldn't send request to peer 7ad68e814a7741488971822f2598183a. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:34641: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:02.716771 11443 raft_consensus.cc:2272] T a059fe8e339d4b8f8fd0c9f18705f015 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.719861 11443 tablet_replica.cc:333] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.720726 11443 raft_consensus.cc:2243] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.721885 11443 raft_consensus.cc:2272] T ac31a22d7aa245e385188a5ff4068842 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.724630 11443 tablet_replica.cc:333] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.725665 11443 raft_consensus.cc:2243] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.726734 11443 raft_consensus.cc:2272] T d24f57e3f5524b1c8e167aff853a0218 P 66750b8bbd4c4b3a9695951d0ede3372 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.735508 11443 tablet_replica.cc:333] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.736366 11443 raft_consensus.cc:2243] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 30 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.737604 11443 raft_consensus.cc:2272] T 7c94183b9e8b46989e1da72e911d7aee P 66750b8bbd4c4b3a9695951d0ede3372 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.740490 11443 tablet_replica.cc:333] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.741276 11443 raft_consensus.cc:2243] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.742020 11443 raft_consensus.cc:2272] T df093254fdff40f38b8370a4e884cc5d P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.746671 11443 tablet_replica.cc:333] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.747546 11443 raft_consensus.cc:2243] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.748888 11443 raft_consensus.cc:2272] T 0f7c3aec6a56450cb76aab45d874eff7 P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.752197 11443 tablet_replica.cc:333] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.753131 11443 raft_consensus.cc:2243] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.754724 11443 raft_consensus.cc:2272] T 789704b18a5945318724c3ba1ca5b6e5 P 66750b8bbd4c4b3a9695951d0ede3372 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.757742 11443 tablet_replica.cc:333] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.758608 11443 raft_consensus.cc:2243] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.759904 11443 raft_consensus.cc:2272] T 5161235af1b440278d598161e1de2453 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.763135 11443 tablet_replica.cc:333] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.763937 11443 raft_consensus.cc:2243] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.765244 11443 raft_consensus.cc:2272] T 4b253d5a6b42486ba3b3a6e07c59f7ff P 66750b8bbd4c4b3a9695951d0ede3372 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.768685 11443 tablet_replica.cc:333] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.769626 11443 raft_consensus.cc:2243] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.771075 11443 raft_consensus.cc:2272] T 60708e41894c42b697291e905bff5dc6 P 66750b8bbd4c4b3a9695951d0ede3372 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.774425 11443 tablet_replica.cc:333] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.775241 11443 raft_consensus.cc:2243] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.775969 11443 raft_consensus.cc:2272] T dda7dbc055d64c86aedec4299e15f997 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:02.784875 13197 consensus_peers.cc:597] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 -> Peer a11816c5d72e4d1295a242f3ced09e5f (127.11.44.194:41653): Couldn't send request to peer a11816c5d72e4d1295a242f3ced09e5f. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:41653: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:07:02.786017 11443 tablet_replica.cc:333] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.786978 11443 raft_consensus.cc:2243] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.788246 11443 raft_consensus.cc:2272] T dd40576623a84072be59a32d23cda14b P 66750b8bbd4c4b3a9695951d0ede3372 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.791743 11443 tablet_replica.cc:333] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.792673 11443 raft_consensus.cc:2243] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.793865 11443 raft_consensus.cc:2272] T fb1007aec88948499b3c20c4e58bba2f P 66750b8bbd4c4b3a9695951d0ede3372 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.797017 11443 tablet_replica.cc:333] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.797829 11443 raft_consensus.cc:2243] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.799060 11443 raft_consensus.cc:2272] T 02ea9ad298ab4fa08087d24740b5a13b P 66750b8bbd4c4b3a9695951d0ede3372 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.802040 11443 tablet_replica.cc:333] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.802942 11443 raft_consensus.cc:2243] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:02.803682 11443 raft_consensus.cc:2272] T 5589ff6a0b984c84a050ecad03db5a87 P 66750b8bbd4c4b3a9695951d0ede3372 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.806679 11443 tablet_replica.cc:333] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.807435 11443 raft_consensus.cc:2243] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.808653 11443 raft_consensus.cc:2272] T 39a7784c61d94bd5a03c390c81d48e35 P 66750b8bbd4c4b3a9695951d0ede3372 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.811702 11443 tablet_replica.cc:333] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.812443 11443 raft_consensus.cc:2243] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.813912 11443 raft_consensus.cc:2272] T b8a1e8bdbd894ee4abb7a463446fe471 P 66750b8bbd4c4b3a9695951d0ede3372 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:02.816679 11443 tablet_replica.cc:333] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372: stopping tablet replica
I20260709 13:07:02.817395 11443 raft_consensus.cc:2243] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:07:02.818670 11443 raft_consensus.cc:2272] T ee851126f3964a84a26d5d9a400ec3a8 P 66750b8bbd4c4b3a9695951d0ede3372 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:04.181401 11443 tablet_server.cc:196] TabletServer@127.11.44.196:0 shutdown complete.
I20260709 13:07:04.377501 11443 master.cc:562] Master@127.11.44.254:44047 shutting down...
W20260709 13:07:04.422019 12493 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:07:04.422277 12493 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:07:04.422451 12493 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:07:05.340472 12476 debug-util.cc:398] Leaking SignalData structure 0x7b080017a740 after lost signal to thread 11446
W20260709 13:07:05.341508 12476 debug-util.cc:398] Leaking SignalData structure 0x7b08003dbca0 after lost signal to thread 12479
W20260709 13:07:06.329255 12432 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111) [suppressed 416 similar messages]
W20260709 13:07:06.333313 12432 catalog_manager.cc:4755] TS a70479a3b4114f3581095e9890f5d653 (127.11.44.193:43307): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet f2abdbdc67164b32bd58bfe3763a4183: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43307: connect: Connection refused (error 111)
I20260709 13:07:07.307605 11443 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:07.308609 11443 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:07.308990 11443 tablet_replica.cc:333] T 00000000000000000000000000000000 P 78966838052c4dd980a04a5b750887f1: stopping tablet replica
I20260709 13:07:07.503594 11443 master.cc:584] Master@127.11.44.254:44047 shutdown complete.
I20260709 13:07:07.551258 11443 test_util.cc:182] -----------------------------------------------
I20260709 13:07:07.551540 11443 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602132206461-11443-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (271711 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:07:07.555249 11443 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.44.254:41239
I20260709 13:07:07.556463 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:07.562552 21465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:07.562739 21464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:07.563987 21467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:07.564821 11443 server_base.cc:1061] running on GCE node
I20260709 13:07:07.568004 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:07.568207 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:07.568513 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602427568473 us; error 0 us; skew 500 ppm
I20260709 13:07:07.569118 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:07.571959 11443 webserver.cc:533] Webserver started at http://127.11.44.254:38677/ using document root <none> and password file <none>
I20260709 13:07:07.572455 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:07.572621 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:07.572853 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:07.574334 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/master-0-root/instance:
uuid: "c5c1c01ff0c44f9dafb08d045eab9aa1"
format_stamp: "Formatted at 2026-07-09 13:07:07 on dist-test-slave-qv7r"
I20260709 13:07:07.579077 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 13:07:07.582515 21472 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:07.583328 11443 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:07:07.583666 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/master-0-root
uuid: "c5c1c01ff0c44f9dafb08d045eab9aa1"
format_stamp: "Formatted at 2026-07-09 13:07:07 on dist-test-slave-qv7r"
I20260709 13:07:07.583956 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:07.599133 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:07.600347 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:07.640291 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.254:41239
I20260709 13:07:07.640442 21523 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.254:41239 every 8 connection(s)
I20260709 13:07:07.644979 21524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:07.656265 21524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1: Bootstrap starting.
I20260709 13:07:07.660948 21524 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:07.665331 21524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1: No bootstrap required, opened a new log
I20260709 13:07:07.667869 21524 raft_consensus.cc:359] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5c1c01ff0c44f9dafb08d045eab9aa1" member_type: VOTER }
I20260709 13:07:07.668359 21524 raft_consensus.cc:385] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:07.668568 21524 raft_consensus.cc:740] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5c1c01ff0c44f9dafb08d045eab9aa1, State: Initialized, Role: FOLLOWER
I20260709 13:07:07.669238 21524 consensus_queue.cc:260] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5c1c01ff0c44f9dafb08d045eab9aa1" member_type: VOTER }
I20260709 13:07:07.669734 21524 raft_consensus.cc:399] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:07.669965 21524 raft_consensus.cc:493] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:07.670202 21524 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:07.675292 21524 raft_consensus.cc:515] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5c1c01ff0c44f9dafb08d045eab9aa1" member_type: VOTER }
I20260709 13:07:07.675799 21524 leader_election.cc:304] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5c1c01ff0c44f9dafb08d045eab9aa1; no voters: 
I20260709 13:07:07.676963 21524 leader_election.cc:290] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:07.677454 21527 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:07.678962 21527 raft_consensus.cc:697] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1 [term 1 LEADER]: Becoming Leader. State: Replica: c5c1c01ff0c44f9dafb08d045eab9aa1, State: Running, Role: LEADER
I20260709 13:07:07.679694 21527 consensus_queue.cc:237] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5c1c01ff0c44f9dafb08d045eab9aa1" member_type: VOTER }
I20260709 13:07:07.679922 21524 sys_catalog.cc:565] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:07.684538 21528 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c5c1c01ff0c44f9dafb08d045eab9aa1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5c1c01ff0c44f9dafb08d045eab9aa1" member_type: VOTER } }
I20260709 13:07:07.685359 21528 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:07.685413 21529 sys_catalog.cc:455] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5c1c01ff0c44f9dafb08d045eab9aa1. Latest consensus state: current_term: 1 leader_uuid: "c5c1c01ff0c44f9dafb08d045eab9aa1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5c1c01ff0c44f9dafb08d045eab9aa1" member_type: VOTER } }
I20260709 13:07:07.686396 21529 sys_catalog.cc:458] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:07.689534 21535 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:07.697597 21535 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:07.698593 11443 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:07.707145 21535 catalog_manager.cc:1383] Generated new cluster ID: b5e7e7cb8e0143659415f10cfb8ab93a
I20260709 13:07:07.707450 21535 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:07.731572 21535 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:07.732944 21535 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:07.749822 21535 catalog_manager.cc:6070] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1: Generated new TSK 0
I20260709 13:07:07.750496 21535 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:07.765396 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:07.772912 21545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:07.773627 21546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:07.775791 21548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:07.776961 11443 server_base.cc:1061] running on GCE node
I20260709 13:07:07.779675 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:07.779889 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:07.780009 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602427779993 us; error 0 us; skew 500 ppm
I20260709 13:07:07.780635 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:07.783059 11443 webserver.cc:533] Webserver started at http://127.11.44.193:44849/ using document root <none> and password file <none>
I20260709 13:07:07.783550 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:07.783708 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:07.784041 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:07.785244 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-0-root/instance:
uuid: "3f1fa49d04344067941ffd03d9e7d48c"
format_stamp: "Formatted at 2026-07-09 13:07:07 on dist-test-slave-qv7r"
I20260709 13:07:07.790208 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:07:07.794209 21553 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:07.795064 11443 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:07:07.795387 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-0-root
uuid: "3f1fa49d04344067941ffd03d9e7d48c"
format_stamp: "Formatted at 2026-07-09 13:07:07 on dist-test-slave-qv7r"
I20260709 13:07:07.795658 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:07.816375 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:07.817716 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:07.819279 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:07.821781 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:07.821978 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:07.822263 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:07.822439 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:07.870545 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.193:35255
I20260709 13:07:07.870659 21615 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.193:35255 every 8 connection(s)
I20260709 13:07:07.875927 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:07.885013 21620 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:07.887125 21621 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:07.889858 21623 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:07.891036 11443 server_base.cc:1061] running on GCE node
I20260709 13:07:07.893467 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:07.893775 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:07.893972 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602427893937 us; error 0 us; skew 500 ppm
I20260709 13:07:07.894548 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:07.897168 11443 webserver.cc:533] Webserver started at http://127.11.44.194:46407/ using document root <none> and password file <none>
I20260709 13:07:07.897756 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:07.897969 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:07.898336 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:07.900101 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-1-root/instance:
uuid: "bed294de06e24ca4aba572ec722d2567"
format_stamp: "Formatted at 2026-07-09 13:07:07 on dist-test-slave-qv7r"
I20260709 13:07:07.901459 21616 heartbeater.cc:344] Connected to a master server at 127.11.44.254:41239
I20260709 13:07:07.901930 21616 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:07.902664 21616 heartbeater.cc:507] Master 127.11.44.254:41239 requested a full tablet report, sending...
I20260709 13:07:07.904920 21489 ts_manager.cc:194] Registered new tserver with Master: 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:07.905691 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:07:07.906980 21489 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54450
I20260709 13:07:07.909704 21628 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:07.910686 11443 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:07:07.911026 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-1-root
uuid: "bed294de06e24ca4aba572ec722d2567"
format_stamp: "Formatted at 2026-07-09 13:07:07 on dist-test-slave-qv7r"
I20260709 13:07:07.911417 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:07.934173 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:07.935385 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:07.936934 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:07.939093 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:07.939323 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:07.939565 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:07.939736 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:07.982810 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.194:35853
I20260709 13:07:07.982910 21690 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.194:35853 every 8 connection(s)
I20260709 13:07:07.987699 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:07.995990 21694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:07.996811 21695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:07.999464 11443 server_base.cc:1061] running on GCE node
W20260709 13:07:07.999692 21697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:08.001168 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:08.001502 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:08.001754 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602428001720 us; error 0 us; skew 500 ppm
I20260709 13:07:08.002246 21691 heartbeater.cc:344] Connected to a master server at 127.11.44.254:41239
I20260709 13:07:08.002483 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:08.002698 21691 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:08.003746 21691 heartbeater.cc:507] Master 127.11.44.254:41239 requested a full tablet report, sending...
I20260709 13:07:08.005429 11443 webserver.cc:533] Webserver started at http://127.11.44.195:45853/ using document root <none> and password file <none>
I20260709 13:07:08.006062 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:08.006246 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:08.006357 21489 ts_manager.cc:194] Registered new tserver with Master: bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:08.006549 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:08.007815 21489 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54464
I20260709 13:07:08.007835 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-2-root/instance:
uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
format_stamp: "Formatted at 2026-07-09 13:07:08 on dist-test-slave-qv7r"
I20260709 13:07:08.013428 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:08.017263 21702 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:08.018119 11443 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:07:08.018447 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-2-root
uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
format_stamp: "Formatted at 2026-07-09 13:07:08 on dist-test-slave-qv7r"
I20260709 13:07:08.018719 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:08.040537 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:08.041850 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:08.043408 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:08.045790 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:08.046321 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:08.046643 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:08.046953 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:08.092375 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.195:46013
I20260709 13:07:08.092478 21764 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.195:46013 every 8 connection(s)
I20260709 13:07:08.097445 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:08.106355 21769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:08.106895 21768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:08.108983 21771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:08.110558 11443 server_base.cc:1061] running on GCE node
I20260709 13:07:08.111112 21765 heartbeater.cc:344] Connected to a master server at 127.11.44.254:41239
I20260709 13:07:08.111536 21765 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:08.111814 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:08.112102 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:08.112313 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602428112284 us; error 0 us; skew 500 ppm
I20260709 13:07:08.112360 21765 heartbeater.cc:507] Master 127.11.44.254:41239 requested a full tablet report, sending...
I20260709 13:07:08.113029 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:08.114846 21489 ts_manager.cc:194] Registered new tserver with Master: 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:08.115898 11443 webserver.cc:533] Webserver started at http://127.11.44.196:38053/ using document root <none> and password file <none>
I20260709 13:07:08.116356 21489 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54472
I20260709 13:07:08.116518 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:08.116876 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:08.117259 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:08.118539 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-3-root/instance:
uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
format_stamp: "Formatted at 2026-07-09 13:07:08 on dist-test-slave-qv7r"
I20260709 13:07:08.124009 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:07:08.128351 21776 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:08.129333 11443 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:07:08.129711 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-3-root
uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
format_stamp: "Formatted at 2026-07-09 13:07:08 on dist-test-slave-qv7r"
I20260709 13:07:08.130025 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:08.149312 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:08.150592 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:08.152421 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:08.155149 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:08.155347 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:08.155534 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:08.155658 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:08.201649 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.196:41173
I20260709 13:07:08.201732 21838 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.196:41173 every 8 connection(s)
I20260709 13:07:08.216781 21839 heartbeater.cc:344] Connected to a master server at 127.11.44.254:41239
I20260709 13:07:08.217271 21839 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:08.218187 21839 heartbeater.cc:507] Master 127.11.44.254:41239 requested a full tablet report, sending...
I20260709 13:07:08.220388 21489 ts_manager.cc:194] Registered new tserver with Master: b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:08.221086 11443 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016397468s
I20260709 13:07:08.222249 21489 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54476
I20260709 13:07:08.254482 21489 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54492:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:07:08.499505 21581 tablet_service.cc:1511] Processing CreateTablet for tablet e7609574109349aeb89daee4d7aec6f7 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:07:08.501194 21581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7609574109349aeb89daee4d7aec6f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.502729 21580 tablet_service.cc:1511] Processing CreateTablet for tablet 4d4979f7a7c14c68ad359f624f114570 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:07:08.505441 21579 tablet_service.cc:1511] Processing CreateTablet for tablet bc118bb477224df8a4f953e308982c45 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:07:08.506929 21579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc118bb477224df8a4f953e308982c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.508576 21804 tablet_service.cc:1511] Processing CreateTablet for tablet e7609574109349aeb89daee4d7aec6f7 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:07:08.510003 21804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7609574109349aeb89daee4d7aec6f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.513025 21802 tablet_service.cc:1511] Processing CreateTablet for tablet ce5f20a869e24ab78d7677bc08d45963 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:07:08.515486 21801 tablet_service.cc:1511] Processing CreateTablet for tablet a7cf644bea63405f9d1a353862a5a110 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:07:08.516170 21729 tablet_service.cc:1511] Processing CreateTablet for tablet 4d4979f7a7c14c68ad359f624f114570 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:07:08.519483 21730 tablet_service.cc:1511] Processing CreateTablet for tablet e7609574109349aeb89daee4d7aec6f7 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:07:08.520236 21727 tablet_service.cc:1511] Processing CreateTablet for tablet 9932f1e440d442f8ab6ba25f33881d75 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:07:08.522059 21726 tablet_service.cc:1511] Processing CreateTablet for tablet 313ed31222454fe19290a9105f226521 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:07:08.522473 21728 tablet_service.cc:1511] Processing CreateTablet for tablet ce5f20a869e24ab78d7677bc08d45963 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:07:08.524787 21799 tablet_service.cc:1511] Processing CreateTablet for tablet d10699d4b9f347c783a7a00bb6cd772c (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:07:08.525914 21725 tablet_service.cc:1511] Processing CreateTablet for tablet d10699d4b9f347c783a7a00bb6cd772c (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:07:08.505456 21578 tablet_service.cc:1511] Processing CreateTablet for tablet 9932f1e440d442f8ab6ba25f33881d75 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:07:08.527400 21798 tablet_service.cc:1511] Processing CreateTablet for tablet a2f2d007d6e54bb3be541d9bbde02eca (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:07:08.528445 21578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9932f1e440d442f8ab6ba25f33881d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.528640 21577 tablet_service.cc:1511] Processing CreateTablet for tablet a7cf644bea63405f9d1a353862a5a110 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:07:08.531150 21576 tablet_service.cc:1511] Processing CreateTablet for tablet 313ed31222454fe19290a9105f226521 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:07:08.532954 21797 tablet_service.cc:1511] Processing CreateTablet for tablet 613b610452794d1192d3df796bedcd8e (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:07:08.534088 21575 tablet_service.cc:1511] Processing CreateTablet for tablet 83c22a51936f4415b7a99dcad7540239 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:07:08.534819 21574 tablet_service.cc:1511] Processing CreateTablet for tablet a2f2d007d6e54bb3be541d9bbde02eca (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:07:08.537577 21796 tablet_service.cc:1511] Processing CreateTablet for tablet 7d12f1f33e1a417088b0ae7332d600e3 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:07:08.538686 21573 tablet_service.cc:1511] Processing CreateTablet for tablet 613b610452794d1192d3df796bedcd8e (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:07:08.519483 21803 tablet_service.cc:1511] Processing CreateTablet for tablet bc118bb477224df8a4f953e308982c45 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:07:08.520397 21800 tablet_service.cc:1511] Processing CreateTablet for tablet 313ed31222454fe19290a9105f226521 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:07:08.542888 21572 tablet_service.cc:1511] Processing CreateTablet for tablet 9d8eb26670184a3dabe0c8e8162e1a4e (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:07:08.544426 21580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d4979f7a7c14c68ad359f624f114570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.544782 21795 tablet_service.cc:1511] Processing CreateTablet for tablet f2e7302faa874a2f874d979ae54331f3 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:07:08.548642 21577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7cf644bea63405f9d1a353862a5a110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.550594 21729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d4979f7a7c14c68ad359f624f114570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.552561 21730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7609574109349aeb89daee4d7aec6f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.559749 21802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce5f20a869e24ab78d7677bc08d45963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.560497 21797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 613b610452794d1192d3df796bedcd8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.561210 21795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e7302faa874a2f874d979ae54331f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.563282 21798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f2d007d6e54bb3be541d9bbde02eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.565929 21796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d12f1f33e1a417088b0ae7332d600e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.566075 21725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d10699d4b9f347c783a7a00bb6cd772c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.568285 21803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc118bb477224df8a4f953e308982c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.570036 21728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce5f20a869e24ab78d7677bc08d45963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.573967 21801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7cf644bea63405f9d1a353862a5a110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.578084 21800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 313ed31222454fe19290a9105f226521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.583688 21724 tablet_service.cc:1511] Processing CreateTablet for tablet 83c22a51936f4415b7a99dcad7540239 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:07:08.587504 21723 tablet_service.cc:1511] Processing CreateTablet for tablet 613b610452794d1192d3df796bedcd8e (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:07:08.589990 21799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d10699d4b9f347c783a7a00bb6cd772c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.590827 21721 tablet_service.cc:1511] Processing CreateTablet for tablet 9d8eb26670184a3dabe0c8e8162e1a4e (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:07:08.592984 21724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83c22a51936f4415b7a99dcad7540239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.593247 21722 tablet_service.cc:1511] Processing CreateTablet for tablet 7d12f1f33e1a417088b0ae7332d600e3 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:07:08.594736 21722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d12f1f33e1a417088b0ae7332d600e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.596889 21726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 313ed31222454fe19290a9105f226521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.597882 21721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d8eb26670184a3dabe0c8e8162e1a4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.598582 21727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9932f1e440d442f8ab6ba25f33881d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.599262 21723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 613b610452794d1192d3df796bedcd8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.557415 21573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 613b610452794d1192d3df796bedcd8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.604213 21574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f2d007d6e54bb3be541d9bbde02eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.605692 21575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83c22a51936f4415b7a99dcad7540239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.607714 21572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d8eb26670184a3dabe0c8e8162e1a4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.607512 21656 tablet_service.cc:1511] Processing CreateTablet for tablet 4d4979f7a7c14c68ad359f624f114570 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:07:08.608779 21576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 313ed31222454fe19290a9105f226521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.608961 21656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d4979f7a7c14c68ad359f624f114570. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.611161 21655 tablet_service.cc:1511] Processing CreateTablet for tablet bc118bb477224df8a4f953e308982c45 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:07:08.613248 21655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc118bb477224df8a4f953e308982c45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.640689 21654 tablet_service.cc:1511] Processing CreateTablet for tablet ce5f20a869e24ab78d7677bc08d45963 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:07:08.641687 21652 tablet_service.cc:1511] Processing CreateTablet for tablet a7cf644bea63405f9d1a353862a5a110 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:07:08.642894 21653 tablet_service.cc:1511] Processing CreateTablet for tablet 9932f1e440d442f8ab6ba25f33881d75 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:07:08.646852 21651 tablet_service.cc:1511] Processing CreateTablet for tablet d10699d4b9f347c783a7a00bb6cd772c (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:07:08.650969 21649 tablet_service.cc:1511] Processing CreateTablet for tablet a2f2d007d6e54bb3be541d9bbde02eca (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:07:08.653415 21648 tablet_service.cc:1511] Processing CreateTablet for tablet 7d12f1f33e1a417088b0ae7332d600e3 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:07:08.655879 21647 tablet_service.cc:1511] Processing CreateTablet for tablet 9d8eb26670184a3dabe0c8e8162e1a4e (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:07:08.649369 21650 tablet_service.cc:1511] Processing CreateTablet for tablet 83c22a51936f4415b7a99dcad7540239 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:07:08.659575 21652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7cf644bea63405f9d1a353862a5a110. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.665982 21651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d10699d4b9f347c783a7a00bb6cd772c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.670069 21654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce5f20a869e24ab78d7677bc08d45963. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.674330 21650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83c22a51936f4415b7a99dcad7540239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.678290 21653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9932f1e440d442f8ab6ba25f33881d75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.681782 21648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d12f1f33e1a417088b0ae7332d600e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.686041 21649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2f2d007d6e54bb3be541d9bbde02eca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.690099 21647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d8eb26670184a3dabe0c8e8162e1a4e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:08.693033 21537 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:08.796622 21724 tablet_service.cc:1511] Processing CreateTablet for tablet 6e46f3f1221a4fedac36e2252b8f2a34 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:07:08.833225 21573 tablet_service.cc:1511] Processing CreateTablet for tablet f2e7302faa874a2f874d979ae54331f3 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:07:08.834724 21573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e7302faa874a2f874d979ae54331f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.848192 21577 tablet_service.cc:1511] Processing CreateTablet for tablet 22735fa400464e149fa2d7263a8bd58a (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:07:08.851286 21577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22735fa400464e149fa2d7263a8bd58a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.862185 21724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e46f3f1221a4fedac36e2252b8f2a34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.873996 21573 tablet_service.cc:1511] Processing CreateTablet for tablet 6cc8f1a9d5ce413cb159ae69ce846c06 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:07:08.877219 21859 tablet_bootstrap.cc:492] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:08.877390 21573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cc8f1a9d5ce413cb159ae69ce846c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.887298 21729 tablet_service.cc:1511] Processing CreateTablet for tablet 8900bbb09a964e26aaab011b218c8f11 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:07:08.888830 21729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8900bbb09a964e26aaab011b218c8f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.890156 21580 tablet_service.cc:1511] Processing CreateTablet for tablet 8900bbb09a964e26aaab011b218c8f11 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:07:08.911556 21725 tablet_service.cc:1511] Processing CreateTablet for tablet 43e501f94be841fbb110db3ac40ede77 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:07:08.912503 21616 heartbeater.cc:499] Master 127.11.44.254:41239 was elected leader, sending a full tablet report...
I20260709 13:07:08.914884 21795 tablet_service.cc:1511] Processing CreateTablet for tablet 43e501f94be841fbb110db3ac40ede77 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:07:08.916224 21795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e501f94be841fbb110db3ac40ede77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.917130 21572 tablet_service.cc:1511] Processing CreateTablet for tablet bd0cbb2559034cf7b35ecfe777ae620c (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:07:08.918439 21572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0cbb2559034cf7b35ecfe777ae620c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.919059 21799 tablet_service.cc:1511] Processing CreateTablet for tablet 6cc8f1a9d5ce413cb159ae69ce846c06 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:07:08.920332 21799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cc8f1a9d5ce413cb159ae69ce846c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.922765 21722 tablet_service.cc:1511] Processing CreateTablet for tablet 22735fa400464e149fa2d7263a8bd58a (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:07:08.924429 21801 tablet_service.cc:1511] Processing CreateTablet for tablet 6e46f3f1221a4fedac36e2252b8f2a34 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:07:08.925839 21801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e46f3f1221a4fedac36e2252b8f2a34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.931254 21858 tablet_bootstrap.cc:492] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:08.933503 21580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8900bbb09a964e26aaab011b218c8f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.934166 21860 tablet_bootstrap.cc:492] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:08.945691 21800 tablet_service.cc:1511] Processing CreateTablet for tablet 8900bbb09a964e26aaab011b218c8f11 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:07:08.945956 21579 tablet_service.cc:1511] Processing CreateTablet for tablet e0beed3c60054461a60991c48b418bfc (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:07:08.907109 21575 tablet_service.cc:1511] Processing CreateTablet for tablet 6e46f3f1221a4fedac36e2252b8f2a34 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:07:08.959671 21725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e501f94be841fbb110db3ac40ede77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.963932 21654 tablet_service.cc:1511] Processing CreateTablet for tablet f2e7302faa874a2f874d979ae54331f3 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:07:08.965287 21654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2e7302faa874a2f874d979ae54331f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.965785 21722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22735fa400464e149fa2d7263a8bd58a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.966137 21579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0beed3c60054461a60991c48b418bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.977218 21860 tablet_bootstrap.cc:654] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:08.978641 21572 tablet_service.cc:1511] Processing CreateTablet for tablet 9cb99515c89d44c59276745ce3cbacd6 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:07:08.979082 21727 tablet_service.cc:1511] Processing CreateTablet for tablet e6f61ea1b37f4399a62f791777f0f481 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:07:09.008209 21727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f61ea1b37f4399a62f791777f0f481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.983156 21576 tablet_service.cc:1511] Processing CreateTablet for tablet 9de835ccc085481aaf56e24e6b6a055f (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:07:08.985785 21649 tablet_service.cc:1511] Processing CreateTablet for tablet 43e501f94be841fbb110db3ac40ede77 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:07:08.986740 21730 tablet_service.cc:1511] Processing CreateTablet for tablet ac0cb8d5a34c40c3a49464bfcd5f955f (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:07:08.986763 21578 tablet_service.cc:1511] Processing CreateTablet for tablet 2c540859ed0b48f1b7ed38ead0137a45 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:07:08.998940 21648 tablet_service.cc:1511] Processing CreateTablet for tablet 22735fa400464e149fa2d7263a8bd58a (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:07:09.007344 21572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cb99515c89d44c59276745ce3cbacd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:08.982481 21797 tablet_service.cc:1511] Processing CreateTablet for tablet ac0cb8d5a34c40c3a49464bfcd5f955f (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:07:09.004030 21800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8900bbb09a964e26aaab011b218c8f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.012751 21691 heartbeater.cc:499] Master 127.11.44.254:41239 was elected leader, sending a full tablet report...
I20260709 13:07:09.016638 21858 tablet_bootstrap.cc:654] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.000859 21804 tablet_service.cc:1511] Processing CreateTablet for tablet e0beed3c60054461a60991c48b418bfc (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:07:09.032497 21649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43e501f94be841fbb110db3ac40ede77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.037669 21797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac0cb8d5a34c40c3a49464bfcd5f955f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.039948 21730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac0cb8d5a34c40c3a49464bfcd5f955f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.040864 21861 tablet_bootstrap.cc:492] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:09.043126 21798 tablet_service.cc:1511] Processing CreateTablet for tablet e6f61ea1b37f4399a62f791777f0f481 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:07:09.026656 21803 tablet_service.cc:1511] Processing CreateTablet for tablet 2c540859ed0b48f1b7ed38ead0137a45 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:07:09.047187 21581 tablet_service.cc:1511] Processing CreateTablet for tablet 5c7c65eed72a42d0a91f36c764de4abb (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:07:09.052486 21648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22735fa400464e149fa2d7263a8bd58a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.054915 21859 tablet_bootstrap.cc:654] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.060261 21723 tablet_service.cc:1511] Processing CreateTablet for tablet bd0cbb2559034cf7b35ecfe777ae620c (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:07:09.083648 21723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0cbb2559034cf7b35ecfe777ae620c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.100559 21656 tablet_service.cc:1511] Processing CreateTablet for tablet ac0cb8d5a34c40c3a49464bfcd5f955f (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:07:09.102205 21656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac0cb8d5a34c40c3a49464bfcd5f955f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:09.103101 21474 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.11.44.196:41173, user_credentials={real_user=slave}} blocked reactor thread for 60525.3us
I20260709 13:07:09.062845 21804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0beed3c60054461a60991c48b418bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.106078 21803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c540859ed0b48f1b7ed38ead0137a45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.066300 21724 tablet_service.cc:1511] Processing CreateTablet for tablet 9cb99515c89d44c59276745ce3cbacd6 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:07:09.107210 21724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cb99515c89d44c59276745ce3cbacd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.031343 21576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9de835ccc085481aaf56e24e6b6a055f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.109864 21579 tablet_service.cc:1511] Processing CreateTablet for tablet 6ac5258f941c4bdbb2ba4e33a4eaca08 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:07:09.110795 21575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6e46f3f1221a4fedac36e2252b8f2a34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.113113 21858 tablet_bootstrap.cc:492] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:09.113689 21858 ts_tablet_manager.cc:1403] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.183s	user 0.008s	sys 0.022s
I20260709 13:07:09.114665 21578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c540859ed0b48f1b7ed38ead0137a45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.116664 21858 raft_consensus.cc:359] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:09.071368 21574 tablet_service.cc:1511] Processing CreateTablet for tablet d07198040872480db2c3b210d75e8c26 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:07:09.117415 21858 raft_consensus.cc:385] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.117830 21858 raft_consensus.cc:740] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.118044 21581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c7c65eed72a42d0a91f36c764de4abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.118901 21765 heartbeater.cc:499] Master 127.11.44.254:41239 was elected leader, sending a full tablet report...
I20260709 13:07:09.118639 21858 consensus_queue.cc:260] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:09.120083 21579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ac5258f941c4bdbb2ba4e33a4eaca08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.121201 21574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d07198040872480db2c3b210d75e8c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.132958 21798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f61ea1b37f4399a62f791777f0f481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.060505 21796 tablet_service.cc:1511] Processing CreateTablet for tablet 5c7c65eed72a42d0a91f36c764de4abb (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:07:09.075412 21726 tablet_service.cc:1511] Processing CreateTablet for tablet 2c540859ed0b48f1b7ed38ead0137a45 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:07:09.135587 21726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c540859ed0b48f1b7ed38ead0137a45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.140677 21721 tablet_service.cc:1511] Processing CreateTablet for tablet 5c7c65eed72a42d0a91f36c764de4abb (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:07:09.142204 21653 tablet_service.cc:1511] Processing CreateTablet for tablet 6cc8f1a9d5ce413cb159ae69ce846c06 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:07:09.143589 21653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6cc8f1a9d5ce413cb159ae69ce846c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.100718 21650 tablet_service.cc:1511] Processing CreateTablet for tablet bd0cbb2559034cf7b35ecfe777ae620c (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
W20260709 13:07:09.159192 21473 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.11.44.195:46013, user_credentials={real_user=slave}} blocked reactor thread for 91784.9us
I20260709 13:07:09.160112 21647 tablet_service.cc:1511] Processing CreateTablet for tablet e0beed3c60054461a60991c48b418bfc (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:07:09.047250 21802 tablet_service.cc:1511] Processing CreateTablet for tablet 9de835ccc085481aaf56e24e6b6a055f (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:07:09.162668 21796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c7c65eed72a42d0a91f36c764de4abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.169899 21802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9de835ccc085481aaf56e24e6b6a055f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.173481 21577 tablet_service.cc:1511] Processing CreateTablet for tablet e327a74ed0c544d28806d688941cd3f6 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:07:09.174928 21577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e327a74ed0c544d28806d688941cd3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.196816 21721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c7c65eed72a42d0a91f36c764de4abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.204705 21650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd0cbb2559034cf7b35ecfe777ae620c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.207893 21656 tablet_service.cc:1511] Processing CreateTablet for tablet e6f61ea1b37f4399a62f791777f0f481 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
W20260709 13:07:09.154783 21474 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.11.44.193:35255, user_credentials={real_user=slave}} blocked reactor thread for 49287.5us
I20260709 13:07:09.208801 21655 tablet_service.cc:1511] Processing CreateTablet for tablet 9cb99515c89d44c59276745ce3cbacd6 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:07:09.209244 21656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6f61ea1b37f4399a62f791777f0f481. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.212512 21647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0beed3c60054461a60991c48b418bfc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.216926 21652 tablet_service.cc:1511] Processing CreateTablet for tablet 9de835ccc085481aaf56e24e6b6a055f (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:07:09.218309 21652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9de835ccc085481aaf56e24e6b6a055f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.229019 21839 heartbeater.cc:499] Master 127.11.44.254:41239 was elected leader, sending a full tablet report...
I20260709 13:07:09.230376 21859 tablet_bootstrap.cc:492] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:09.230919 21859 ts_tablet_manager.cc:1403] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.354s	user 0.015s	sys 0.000s
I20260709 13:07:09.234807 21859 raft_consensus.cc:359] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:09.238621 21795 tablet_service.cc:1511] Processing CreateTablet for tablet 6ac5258f941c4bdbb2ba4e33a4eaca08 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:07:09.266356 21795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ac5258f941c4bdbb2ba4e33a4eaca08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.238621 21573 tablet_service.cc:1511] Processing CreateTablet for tablet e39d9076de054deca6b7548e13c39a3b (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:07:09.217432 21728 tablet_service.cc:1511] Processing CreateTablet for tablet 9eac649888d64d3b8f520993cb19b20e (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:07:09.270421 21573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e39d9076de054deca6b7548e13c39a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.270987 21728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eac649888d64d3b8f520993cb19b20e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.247839 21860 tablet_bootstrap.cc:492] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
W20260709 13:07:09.273835 21474 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.11.44.196:41173, user_credentials={real_user=slave}} blocked reactor thread for 45371.8us
I20260709 13:07:09.133527 21799 tablet_service.cc:1511] Processing CreateTablet for tablet 9eac649888d64d3b8f520993cb19b20e (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:07:09.261708 21656 tablet_service.cc:1511] Processing CreateTablet for tablet d07198040872480db2c3b210d75e8c26 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:07:09.277631 21799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eac649888d64d3b8f520993cb19b20e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.279178 21730 tablet_service.cc:1511] Processing CreateTablet for tablet d07198040872480db2c3b210d75e8c26 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:07:09.264427 21858 ts_tablet_manager.cc:1434] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.150s	user 0.036s	sys 0.040s
I20260709 13:07:09.273985 21860 ts_tablet_manager.cc:1403] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.340s	user 0.003s	sys 0.016s
I20260709 13:07:09.280865 21858 tablet_bootstrap.cc:492] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:09.283286 21652 tablet_service.cc:1511] Processing CreateTablet for tablet 6ac5258f941c4bdbb2ba4e33a4eaca08 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:07:09.259249 21655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cb99515c89d44c59276745ce3cbacd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.288903 21727 tablet_service.cc:1511] Processing CreateTablet for tablet e39d9076de054deca6b7548e13c39a3b (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:07:09.289956 21656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d07198040872480db2c3b210d75e8c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.261121 21651 tablet_service.cc:1511] Processing CreateTablet for tablet 9eac649888d64d3b8f520993cb19b20e (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:07:09.294126 21730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d07198040872480db2c3b210d75e8c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.283286 21860 raft_consensus.cc:359] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:09.294984 21860 raft_consensus.cc:385] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.295324 21860 raft_consensus.cc:740] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.296171 21860 consensus_queue.cc:260] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:09.298712 21722 tablet_service.cc:1511] Processing CreateTablet for tablet e327a74ed0c544d28806d688941cd3f6 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:07:09.300014 21722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e327a74ed0c544d28806d688941cd3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.302680 21797 tablet_service.cc:1511] Processing CreateTablet for tablet e327a74ed0c544d28806d688941cd3f6 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:07:09.303222 21861 tablet_bootstrap.cc:654] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.304540 21727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e39d9076de054deca6b7548e13c39a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.308832 21800 tablet_service.cc:1511] Processing CreateTablet for tablet d14ed1ed549d47eb828017479cccdd42 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:07:09.310202 21800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d14ed1ed549d47eb828017479cccdd42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.311408 21649 tablet_service.cc:1511] Processing CreateTablet for tablet e39d9076de054deca6b7548e13c39a3b (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:07:09.316303 21580 tablet_service.cc:1511] Processing CreateTablet for tablet 583c8787161e47ccb08cd01f6d26d5a4 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:07:09.294143 21651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eac649888d64d3b8f520993cb19b20e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.286686 21859 raft_consensus.cc:385] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.332809 21654 tablet_service.cc:1511] Processing CreateTablet for tablet d14ed1ed549d47eb828017479cccdd42 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:07:09.301153 21725 tablet_service.cc:1511] Processing CreateTablet for tablet d14ed1ed549d47eb828017479cccdd42 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:07:09.334837 21725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d14ed1ed549d47eb828017479cccdd42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.342727 21801 tablet_service.cc:1511] Processing CreateTablet for tablet c86c9ae384544389aed37a67c0cdb7b7 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:07:09.344941 21858 tablet_bootstrap.cc:654] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.346613 21729 tablet_service.cc:1511] Processing CreateTablet for tablet 583c8787161e47ccb08cd01f6d26d5a4 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:07:09.348487 21729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 583c8787161e47ccb08cd01f6d26d5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.354703 21723 tablet_service.cc:1511] Processing CreateTablet for tablet 2e8f2bbfbe0c49d8921f09a4a4e4875e (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:07:09.356215 21723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e8f2bbfbe0c49d8921f09a4a4e4875e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.340992 21859 raft_consensus.cc:740] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.357923 21859 consensus_queue.cc:260] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:09.358728 21804 tablet_service.cc:1511] Processing CreateTablet for tablet 583c8787161e47ccb08cd01f6d26d5a4 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:07:09.403442 21726 tablet_service.cc:1511] Processing CreateTablet for tablet 638d06604bc042cf8e846b13dbe634e7 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:07:09.404912 21726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 638d06604bc042cf8e846b13dbe634e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.404968 21797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e327a74ed0c544d28806d688941cd3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.405918 21801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c86c9ae384544389aed37a67c0cdb7b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.407266 21796 tablet_service.cc:1511] Processing CreateTablet for tablet 2e8f2bbfbe0c49d8921f09a4a4e4875e (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:07:09.408290 21649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e39d9076de054deca6b7548e13c39a3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.408953 21654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d14ed1ed549d47eb828017479cccdd42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.410073 21804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 583c8787161e47ccb08cd01f6d26d5a4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:09.405308 21617 tablet.cc:2406] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:07:09.417783 21579 tablet_service.cc:1511] Processing CreateTablet for tablet c86c9ae384544389aed37a67c0cdb7b7 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:07:09.419041 21580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 583c8787161e47ccb08cd01f6d26d5a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.428615 21579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c86c9ae384544389aed37a67c0cdb7b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.429980 21796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e8f2bbfbe0c49d8921f09a4a4e4875e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.430508 21867 raft_consensus.cc:493] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.436525 21652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ac5258f941c4bdbb2ba4e33a4eaca08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.437767 21863 raft_consensus.cc:493] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.418881 21798 tablet_service.cc:1511] Processing CreateTablet for tablet 6742efaede2f4dfeb0c1171e090e8dc0 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:07:09.438278 21863 raft_consensus.cc:515] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:09.439086 21798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6742efaede2f4dfeb0c1171e090e8dc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.442492 21578 tablet_service.cc:1511] Processing CreateTablet for tablet 638d06604bc042cf8e846b13dbe634e7 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:07:09.448210 21576 tablet_service.cc:1511] Processing CreateTablet for tablet 6742efaede2f4dfeb0c1171e090e8dc0 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:07:09.455262 21581 tablet_service.cc:1511] Processing CreateTablet for tablet 841639e17c5d4724afe9494276ba00a3 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:07:09.434278 21867 raft_consensus.cc:515] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:09.472491 21860 ts_tablet_manager.cc:1434] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.192s	user 0.025s	sys 0.040s
I20260709 13:07:09.489629 21578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 638d06604bc042cf8e846b13dbe634e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.492834 21574 tablet_service.cc:1511] Processing CreateTablet for tablet 69ca21ec420f4843b276f4f15b2b0f1b (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:07:09.493086 21575 tablet_service.cc:1511] Processing CreateTablet for tablet 7f558d81ff1b4d1fbb393d8dab70debb (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:07:09.477666 21867 leader_election.cc:290] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:09.513602 21572 tablet_service.cc:1511] Processing CreateTablet for tablet 7bb5613fc4c548ccaa3120ba22d4d0f8 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:07:09.514616 21728 tablet_service.cc:1511] Processing CreateTablet for tablet 841639e17c5d4724afe9494276ba00a3 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:07:09.516055 21728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841639e17c5d4724afe9494276ba00a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.508285 21863 leader_election.cc:290] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:09.520005 21860 tablet_bootstrap.cc:492] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:09.524425 21581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841639e17c5d4724afe9494276ba00a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.500773 21802 tablet_service.cc:1511] Processing CreateTablet for tablet 841639e17c5d4724afe9494276ba00a3 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:07:09.546803 21573 tablet_service.cc:1511] Processing CreateTablet for tablet 21a0bcc4561a4503aebdb0aab6b13b37 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:07:09.537173 21656 tablet_service.cc:1511] Processing CreateTablet for tablet c86c9ae384544389aed37a67c0cdb7b7 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:07:09.554618 21859 ts_tablet_manager.cc:1434] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.323s	user 0.008s	sys 0.018s
I20260709 13:07:09.545463 21648 tablet_service.cc:1511] Processing CreateTablet for tablet 2e8f2bbfbe0c49d8921f09a4a4e4875e (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:07:09.576581 21648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e8f2bbfbe0c49d8921f09a4a4e4875e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.558275 21576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6742efaede2f4dfeb0c1171e090e8dc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.586208 21802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 841639e17c5d4724afe9494276ba00a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.589959 21861 tablet_bootstrap.cc:492] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:09.590857 21861 ts_tablet_manager.cc:1403] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.550s	user 0.010s	sys 0.007s
I20260709 13:07:09.591887 21858 tablet_bootstrap.cc:492] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:09.592443 21858 ts_tablet_manager.cc:1403] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.312s	user 0.012s	sys 0.019s
I20260709 13:07:09.594427 21861 raft_consensus.cc:359] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:09.598138 21859 tablet_bootstrap.cc:492] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:09.600452 21858 raft_consensus.cc:359] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:09.601842 21574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ca21ec420f4843b276f4f15b2b0f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.604126 21724 tablet_service.cc:1511] Processing CreateTablet for tablet 705488f64a3e446babbfe5b0d7bc2122 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:07:09.611954 21579 tablet_service.cc:1511] Processing CreateTablet for tablet 86ba1219e0f34c48b4dcb1d1c5e177d0 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:07:09.615530 21579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86ba1219e0f34c48b4dcb1d1c5e177d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.618355 21796 tablet_service.cc:1511] Processing CreateTablet for tablet 7a21c3a2d0e04b27ad46365fd5ff3453 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:07:09.619845 21796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a21c3a2d0e04b27ad46365fd5ff3453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.619932 21649 tablet_service.cc:1511] Processing CreateTablet for tablet 638d06604bc042cf8e846b13dbe634e7 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:07:09.621366 21721 tablet_service.cc:1511] Processing CreateTablet for tablet 7f558d81ff1b4d1fbb393d8dab70debb (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:07:09.608422 21861 raft_consensus.cc:385] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.567701 21577 tablet_service.cc:1511] Processing CreateTablet for tablet 705488f64a3e446babbfe5b0d7bc2122 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:07:09.625449 21858 raft_consensus.cc:385] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:09.634250 21858 raft_consensus.cc:740] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.635794 21795 tablet_service.cc:1511] Processing CreateTablet for tablet 7bb5613fc4c548ccaa3120ba22d4d0f8 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:07:09.635123 21858 consensus_queue.cc:260] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:09.637104 21795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bb5613fc4c548ccaa3120ba22d4d0f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.638226 21801 tablet_service.cc:1511] Processing CreateTablet for tablet 7f558d81ff1b4d1fbb393d8dab70debb (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:07:09.635129 21861 raft_consensus.cc:740] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:09.631884 21572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bb5613fc4c548ccaa3120ba22d4d0f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.630788 21723 tablet_service.cc:1511] Processing CreateTablet for tablet 7a21c3a2d0e04b27ad46365fd5ff3453 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:07:09.641264 21861 consensus_queue.cc:260] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:09.640759 21577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 705488f64a3e446babbfe5b0d7bc2122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.640216 21726 tablet_service.cc:1511] Processing CreateTablet for tablet eaacd7d18a674b519da25daf5d8040cc (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:07:09.647398 21573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a0bcc4561a4503aebdb0aab6b13b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.651033 21651 tablet_service.cc:1511] Processing CreateTablet for tablet 6742efaede2f4dfeb0c1171e090e8dc0 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:07:09.651506 21803 tablet_service.cc:1511] Processing CreateTablet for tablet 69ca21ec420f4843b276f4f15b2b0f1b (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:07:09.653398 21803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ca21ec420f4843b276f4f15b2b0f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.653986 21723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a21c3a2d0e04b27ad46365fd5ff3453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.653482 21654 tablet_service.cc:1511] Processing CreateTablet for tablet 7a21c3a2d0e04b27ad46365fd5ff3453 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:07:09.657485 21726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaacd7d18a674b519da25daf5d8040cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.659678 21724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 705488f64a3e446babbfe5b0d7bc2122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.659888 21575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f558d81ff1b4d1fbb393d8dab70debb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.665915 21649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 638d06604bc042cf8e846b13dbe634e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.667403 21653 tablet_service.cc:1511] Processing CreateTablet for tablet 705488f64a3e446babbfe5b0d7bc2122 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:07:09.668434 21721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f558d81ff1b4d1fbb393d8dab70debb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.668814 21653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 705488f64a3e446babbfe5b0d7bc2122. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.679950 21647 tablet_service.cc:1511] Processing CreateTablet for tablet 7bb5613fc4c548ccaa3120ba22d4d0f8 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:07:09.682330 21869 raft_consensus.cc:493] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.682888 21869 raft_consensus.cc:515] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:09.664469 21799 tablet_service.cc:1511] Processing CreateTablet for tablet 317e3221976c47fa913d27f018a21910 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:07:09.700917 21652 tablet_service.cc:1511] Processing CreateTablet for tablet eaacd7d18a674b519da25daf5d8040cc (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:07:09.695097 21654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a21c3a2d0e04b27ad46365fd5ff3453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.701846 21801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f558d81ff1b4d1fbb393d8dab70debb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.716409 21879 raft_consensus.cc:493] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:09.717051 21879 raft_consensus.cc:515] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:09.719301 21879 leader_election.cc:290] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
W20260709 13:07:09.726373 21537 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:09.726804 21728 tablet_service.cc:1511] Processing CreateTablet for tablet 1e3f4d96c3d04d378fc88e817a7c4069 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:07:09.727345 21798 tablet_service.cc:1511] Processing CreateTablet for tablet 21a0bcc4561a4503aebdb0aab6b13b37 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:07:09.728662 21728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e3f4d96c3d04d378fc88e817a7c4069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.730327 21730 tablet_service.cc:1511] Processing CreateTablet for tablet 86ba1219e0f34c48b4dcb1d1c5e177d0 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:07:09.731736 21730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86ba1219e0f34c48b4dcb1d1c5e177d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.738674 21858 ts_tablet_manager.cc:1434] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.146s	user 0.009s	sys 0.001s
I20260709 13:07:09.740018 21858 tablet_bootstrap.cc:492] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:09.742451 21799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 317e3221976c47fa913d27f018a21910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.750639 21800 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40612 (request call id 23) took 1045 ms. Trace:
I20260709 13:07:09.750844 21861 ts_tablet_manager.cc:1434] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.159s	user 0.015s	sys 0.010s
I20260709 13:07:09.752671 21860 tablet_bootstrap.cc:700] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent opening tablet: real 0.135s	user 0.004s	sys 0.003s
I20260709 13:07:09.753415 21860 tablet_bootstrap.cc:654] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.751423 21651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6742efaede2f4dfeb0c1171e090e8dc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.771481 21652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaacd7d18a674b519da25daf5d8040cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.774016 21647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bb5613fc4c548ccaa3120ba22d4d0f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.687891 21869 leader_election.cc:290] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:09.776849 21803 tablet_service.cc:1511] Processing CreateTablet for tablet eaacd7d18a674b519da25daf5d8040cc (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:07:09.764076 21861 tablet_bootstrap.cc:492] T ce5f20a869e24ab78d7677bc08d45963 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:09.764647 21859 tablet_bootstrap.cc:654] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.764599 21576 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47970 (request call id 28) took 1001 ms. Trace:
I20260709 13:07:09.786542 21576 rpcz_store.cc:276] 0709 13:07:08.793811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.447020 (+653209us) service_pool.cc:224] Handling call
0709 13:07:09.484720 (+ 37700us) spinlock_profiling.cc:243] Waited 8.46 ms on lock 0x7b5800083d98. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454e9c 00007fc3a6454a5b 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5ad831 00007fc3ae58aac3 00007fc3ae539400 00007fc3a79beaf4 00007fc3a79bea82 00007fc3a79be9b1
0709 13:07:09.501818 (+ 17098us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.507595 (+  5777us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.685835 (+178240us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.764031 (+ 78196us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:09.764539 (+   508us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19462400}
I20260709 13:07:09.796120 21798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a0bcc4561a4503aebdb0aab6b13b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.797192 21725 tablet_service.cc:1511] Processing CreateTablet for tablet 317e3221976c47fa913d27f018a21910 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:07:09.797593 21576 tablet_service.cc:1511] Processing CreateTablet for tablet 317e3221976c47fa913d27f018a21910 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:07:09.798671 21725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 317e3221976c47fa913d27f018a21910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.798898 21576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 317e3221976c47fa913d27f018a21910. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.800161 21572 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47970 (request call id 31) took 1005 ms. Trace:
I20260709 13:07:09.800606 21572 rpcz_store.cc:276] 0709 13:07:08.794891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.494813 (+699922us) service_pool.cc:224] Handling call
0709 13:07:09.524911 (+ 30098us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.528253 (+  3342us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.737538 (+209285us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.799592 (+ 62054us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:09.800088 (+   496us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.807749 21803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eaacd7d18a674b519da25daf5d8040cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.811638 21804 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40612 (request call id 25) took 1076 ms. Trace:
I20260709 13:07:09.812301 21804 rpcz_store.cc:276] 0709 13:07:08.735714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.357623 (+621909us) service_pool.cc:224] Handling call
0709 13:07:09.409620 (+ 51997us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.409720 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.628315 (+218595us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.773500 (+145185us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:09.811560 (+ 38060us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.818643 21722 tablet_service.cc:1511] Processing CreateTablet for tablet 832d931fb3f84415aac4b1880e99c498 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:07:09.820109 21722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 832d931fb3f84415aac4b1880e99c498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.751240 21800 rpcz_store.cc:276] 0709 13:07:08.704954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.307927 (+602973us) service_pool.cc:224] Handling call
0709 13:07:09.309719 (+  1792us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.309824 (+   105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.516151 (+206327us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.750049 (+233898us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:09.750561 (+   512us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.826598 21800 tablet_service.cc:1511] Processing CreateTablet for tablet 36c6b2be38fb47e7a92c9b1b7f9678d7 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:07:09.827912 21800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c6b2be38fb47e7a92c9b1b7f9678d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.831398 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e7302faa874a2f874d979ae54331f3" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:09.832702 21656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c86c9ae384544389aed37a67c0cdb7b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.839555 21858 tablet_bootstrap.cc:654] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.837689 21650 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40496 (request call id 15) took 1050 ms. Trace:
I20260709 13:07:09.862249 21724 tablet_service.cc:1511] Processing CreateTablet for tablet 881467b2dd884d22b15e9ac3906b55cc (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:07:09.863612 21724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 881467b2dd884d22b15e9ac3906b55cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.867470 21721 tablet_service.cc:1511] Processing CreateTablet for tablet 36c6b2be38fb47e7a92c9b1b7f9678d7 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:07:09.874377 21721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c6b2be38fb47e7a92c9b1b7f9678d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.874492 21572 tablet_service.cc:1511] Processing CreateTablet for tablet 832d931fb3f84415aac4b1880e99c498 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:07:09.878923 21580 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47970 (request call id 26) took 1134 ms. Trace:
I20260709 13:07:09.879221 21572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 832d931fb3f84415aac4b1880e99c498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.879374 21580 rpcz_store.cc:276] 0709 13:07:08.744789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.315358 (+570569us) service_pool.cc:224] Handling call
0709 13:07:09.397787 (+ 82429us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.418655 (+ 20868us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.540003 (+121348us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.846192 (+306189us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:09.878841 (+ 32649us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12774}
I20260709 13:07:09.882396 21580 tablet_service.cc:1511] Processing CreateTablet for tablet 36c6b2be38fb47e7a92c9b1b7f9678d7 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:07:09.883836 21580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36c6b2be38fb47e7a92c9b1b7f9678d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.895907 21577 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47970 (request call id 30) took 1101 ms. Trace:
W20260709 13:07:09.896692 21778 leader_election.cc:343] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:09.897472 21578 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47970 (request call id 27) took 1140 ms. Trace:
I20260709 13:07:09.897989 21797 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40612 (request call id 22) took 1194 ms. Trace:
I20260709 13:07:09.898583 21797 rpcz_store.cc:276] 0709 13:07:08.703903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.301711 (+597808us) service_pool.cc:224] Handling call
0709 13:07:09.341206 (+ 39495us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.404643 (+ 63437us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.765247 (+360604us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.888701 (+123454us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:09.897927 (+  9226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.896396 21577 rpcz_store.cc:276] 0709 13:07:08.794599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.486855 (+692256us) service_pool.cc:224] Handling call
0709 13:07:09.634339 (+147484us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.634444 (+   105us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.700700 (+ 66256us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.862106 (+161406us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:09.895838 (+ 33732us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.901152 21577 tablet_service.cc:1511] Processing CreateTablet for tablet e7c18f9e23544d00a8d1cf17afda03c5 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:07:09.897497 21804 tablet_service.cc:1511] Processing CreateTablet for tablet 1e3f4d96c3d04d378fc88e817a7c4069 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:07:09.907641 21804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e3f4d96c3d04d378fc88e817a7c4069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.910925 21581 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47970 (request call id 29) took 1116 ms. Trace:
I20260709 13:07:09.911147 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9932f1e440d442f8ab6ba25f33881d75" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:09.911659 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9932f1e440d442f8ab6ba25f33881d75" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:09.912020 21591 raft_consensus.cc:2468] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 0.
I20260709 13:07:09.912402 21666 raft_consensus.cc:2468] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 0.
I20260709 13:07:09.896728 21655 tablet_service.cc:1511] Processing CreateTablet for tablet 86ba1219e0f34c48b4dcb1d1c5e177d0 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:07:09.908778 21861 tablet_bootstrap.cc:654] T ce5f20a869e24ab78d7677bc08d45963 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:09.914196 21723 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50692 (request call id 29) took 1010 ms. Trace:
I20260709 13:07:09.914608 21723 rpcz_store.cc:276] 0709 13:07:08.904148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.607008 (+702860us) service_pool.cc:224] Handling call
0709 13:07:09.641156 (+ 34148us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.641263 (+   107us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.747057 (+105794us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.913689 (+166632us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:09.914140 (+   451us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.912918 21577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7c18f9e23544d00a8d1cf17afda03c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.897923 21578 rpcz_store.cc:276] 0709 13:07:08.756798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.441516 (+684718us) service_pool.cc:224] Handling call
0709 13:07:09.489021 (+ 47505us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.489184 (+   163us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.575966 (+ 86782us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.866052 (+290086us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:09.897372 (+ 31320us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.919332 21578 tablet_service.cc:1511] Processing CreateTablet for tablet 23660cfe7a7e49db942526440533cdf9 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:07:09.920624 21578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23660cfe7a7e49db942526440533cdf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.911386 21581 rpcz_store.cc:276] 0709 13:07:08.794244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.454302 (+660058us) service_pool.cc:224] Handling call
0709 13:07:09.496327 (+ 42025us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.503343 (+  7016us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.747628 (+244285us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.875546 (+127918us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:09.910859 (+ 35313us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.922747 21581 tablet_service.cc:1511] Processing CreateTablet for tablet ba04167743094b89ba6e3596a48aba86 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:07:09.923106 21573 tablet_service.cc:1511] Processing CreateTablet for tablet 1681a1e8015648a692b9a5eacbbf9d6e (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:07:09.924131 21581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba04167743094b89ba6e3596a48aba86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.929972 21555 leader_election.cc:304] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:09.930133 21630 leader_election.cc:304] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:09.931034 21863 raft_consensus.cc:2804] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:09.931464 21863 raft_consensus.cc:493] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.931802 21863 raft_consensus.cc:3060] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.913895 21655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86ba1219e0f34c48b4dcb1d1c5e177d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.937925 21885 raft_consensus.cc:2804] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:09.938452 21885 raft_consensus.cc:493] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:09.938827 21885 raft_consensus.cc:3060] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:09.939335 21726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50692 (request call id 32) took 1034 ms. Trace:
I20260709 13:07:09.939769 21726 rpcz_store.cc:276] 0709 13:07:08.905126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.634157 (+729031us) service_pool.cc:224] Handling call
0709 13:07:09.644717 (+ 10560us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.645326 (+   609us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.822864 (+177538us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.938774 (+115910us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:09.939275 (+   501us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.942010 21863 raft_consensus.cc:515] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:09.964241 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9932f1e440d442f8ab6ba25f33881d75" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:09.964435 21863 leader_election.cc:290] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Requested vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:09.964594 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9932f1e440d442f8ab6ba25f33881d75" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:09.942556 21726 tablet_service.cc:1511] Processing CreateTablet for tablet e7c18f9e23544d00a8d1cf17afda03c5 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:07:09.946013 21796 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40612 (request call id 29) took 1154 ms. Trace:
I20260709 13:07:09.948401 21575 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47970 (request call id 32) took 1073 ms. Trace:
I20260709 13:07:09.948834 21654 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40496 (request call id 29) took 1143 ms. Trace:
I20260709 13:07:09.949882 21723 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed9b20099494a8c94a51f76692a8ec0 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:07:09.950937 21727 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50692 (request call id 24) took 1048 ms. Trace:
I20260709 13:07:09.954139 21797 tablet_service.cc:1511] Processing CreateTablet for tablet 881467b2dd884d22b15e9ac3906b55cc (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
W20260709 13:07:09.979439 21629 leader_election.cc:343] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:09.955183 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e7302faa874a2f874d979ae54331f3" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:09.980298 21797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 881467b2dd884d22b15e9ac3906b55cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.920696 21574 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed9b20099494a8c94a51f76692a8ec0 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:07:09.956916 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9932f1e440d442f8ab6ba25f33881d75" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:09.957392 21590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7609574109349aeb89daee4d7aec6f7" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:09.957547 21579 tablet_service.cc:1511] Processing CreateTablet for tablet 008742eefeb947f5a1f7decfb821a03d (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:07:09.977165 21573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1681a1e8015648a692b9a5eacbbf9d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.954599 21729 tablet_service.cc:1511] Processing CreateTablet for tablet b5745aab7e6c4a409a0ac98725e4e4c9 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:07:09.841676 21650 rpcz_store.cc:276] 0709 13:07:08.745216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.099717 (+354501us) service_pool.cc:224] Handling call
0709 13:07:09.204228 (+104511us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.204334 (+   106us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.607635 (+403301us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.694562 (+ 86927us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:09.795252 (+100690us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.984992 21650 tablet_service.cc:1511] Processing CreateTablet for tablet 69ca21ec420f4843b276f4f15b2b0f1b (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:07:09.989673 21574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed9b20099494a8c94a51f76692a8ec0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:09.992339 21778 leader_election.cc:343] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:09.992748 21554 leader_election.cc:343] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:09.992981 21778 leader_election.cc:304] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:09.993887 21867 raft_consensus.cc:2749] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:09.994004 21704 leader_election.cc:343] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:09.994194 21649 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40496 (request call id 27) took 1189 ms. Trace:
I20260709 13:07:09.994987 21579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008742eefeb947f5a1f7decfb821a03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:09.995352 21801 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40612 (request call id 31) took 1177 ms. Trace:
I20260709 13:07:09.995936 21801 rpcz_store.cc:276] 0709 13:07:08.819090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.637172 (+818082us) service_pool.cc:224] Handling call
0709 13:07:09.639325 (+  2153us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.639537 (+   212us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.812732 (+173195us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.994859 (+182127us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:09.995280 (+   421us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:09.976585 21795 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40612 (request call id 30) took 1184 ms. Trace:
I20260709 13:07:09.985781 21647 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40496 (request call id 31) took 1162 ms. Trace:
I20260709 13:07:10.000658 21647 rpcz_store.cc:276] 0709 13:07:08.832097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.679037 (+846940us) service_pool.cc:224] Handling call
0709 13:07:09.680887 (+  1850us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.680977 (+    90us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.864473 (+183496us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.916733 (+ 52260us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:09.985722 (+ 68989us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.002636 21647 tablet_service.cc:1511] Processing CreateTablet for tablet 1e3f4d96c3d04d378fc88e817a7c4069 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:07:09.970469 21796 rpcz_store.cc:276] 0709 13:07:08.792087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.585332 (+793245us) service_pool.cc:224] Handling call
0709 13:07:09.619364 (+ 34032us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.619468 (+   104us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.786271 (+166803us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.945469 (+159198us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:09.945954 (+   485us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.004815 21885 raft_consensus.cc:515] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:09.994653 21649 rpcz_store.cc:276] 0709 13:07:08.804963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.619042 (+814079us) service_pool.cc:224] Handling call
0709 13:07:09.620957 (+  1915us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.621046 (+    89us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.866053 (+245007us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.983004 (+116951us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:09.994136 (+ 11132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.005846 21796 tablet_service.cc:1511] Processing CreateTablet for tablet 23660cfe7a7e49db942526440533cdf9 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:07:10.007160 21649 tablet_service.cc:1511] Processing CreateTablet for tablet 832d931fb3f84415aac4b1880e99c498 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:07:10.000114 21795 rpcz_store.cc:276] 0709 13:07:08.792481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.634817 (+842336us) service_pool.cc:224] Handling call
0709 13:07:09.636645 (+  1828us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.636732 (+    87us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.897857 (+261125us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.953319 (+ 55462us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:09.975374 (+ 22055us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.010093 21650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ca21ec420f4843b276f4f15b2b0f1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:10.010437 21795 tablet_service.cc:1511] Processing CreateTablet for tablet 1ed9b20099494a8c94a51f76692a8ec0 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:07:10.011924 21728 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50692 (request call id 35) took 1088 ms. Trace:
I20260709 13:07:10.012367 21728 rpcz_store.cc:276] 0709 13:07:08.923482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.707188 (+783706us) service_pool.cc:224] Handling call
0709 13:07:09.728077 (+ 20889us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.728186 (+   109us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.850276 (+122090us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.933452 (+ 83176us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.011537 (+ 78085us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b5800925598. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a64552b8 00007fc3a64551db 00007fc3af396bb9 00007fc3ae4c7d88 00007fc3ae58e973 00007fc3ae58a70f 00007fc3ae58aecd 00007fc3ae539400 00007fc3a79beaf4 00007fc3a79bea82
0709 13:07:10.011863 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2662784}
I20260709 13:07:10.007661 21796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23660cfe7a7e49db942526440533cdf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:10.013671 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9932f1e440d442f8ab6ba25f33881d75" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:10.015878 21728 tablet_service.cc:1511] Processing CreateTablet for tablet 1681a1e8015648a692b9a5eacbbf9d6e (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:07:09.977105 21654 rpcz_store.cc:276] 0709 13:07:08.812576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.651154 (+838578us) service_pool.cc:224] Handling call
0709 13:07:09.655906 (+  4752us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.656045 (+   139us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.849774 (+193729us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.948319 (+ 98545us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:09.948777 (+   458us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.019670 21654 tablet_service.cc:1511] Processing CreateTablet for tablet 881467b2dd884d22b15e9ac3906b55cc (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:07:09.978206 21727 rpcz_store.cc:276] 0709 13:07:08.902617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.288015 (+385398us) service_pool.cc:224] Handling call
0709 13:07:09.303899 (+ 15884us) spinlock_profiling.cc:243] Waited 7.76 ms on lock 0x7b5800925598. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5ad831 00007fc3ae58aac3 00007fc3ae539400 00007fc3a79beaf4 00007fc3a79bea82 00007fc3a79be9b1
0709 13:07:09.304032 (+   133us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.304175 (+   143us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.675845 (+371670us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.916727 (+240882us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:09.950879 (+ 34152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17855232}
I20260709 13:07:10.025849 21801 tablet_service.cc:1511] Processing CreateTablet for tablet b5745aab7e6c4a409a0ac98725e4e4c9 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
W20260709 13:07:10.022001 21554 leader_election.cc:343] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.027216 21801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5745aab7e6c4a409a0ac98725e4e4c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:10.022696 21647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e3f4d96c3d04d378fc88e817a7c4069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:10.028719 21727 tablet_service.cc:1511] Processing CreateTablet for tablet 008742eefeb947f5a1f7decfb821a03d (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:07:10.022042 21860 tablet_bootstrap.cc:492] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:10.031486 21858 tablet_bootstrap.cc:492] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:10.031927 21860 ts_tablet_manager.cc:1403] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.527s	user 0.021s	sys 0.012s
I20260709 13:07:10.032089 21858 ts_tablet_manager.cc:1403] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.292s	user 0.007s	sys 0.010s
I20260709 13:07:10.034276 21859 tablet_bootstrap.cc:492] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:10.030473 21652 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40496 (request call id 32) took 1198 ms. Trace:
I20260709 13:07:10.029657 21649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 832d931fb3f84415aac4b1880e99c498. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:10.034837 21859 ts_tablet_manager.cc:1403] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.437s	user 0.020s	sys 0.003s
I20260709 13:07:09.999308 21648 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40496 (request call id 26) took 1193 ms. Trace:
I20260709 13:07:10.035647 21648 rpcz_store.cc:276] 0709 13:07:08.804638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.544442 (+739804us) service_pool.cc:224] Handling call
0709 13:07:09.576067 (+ 31625us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.576158 (+    91us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.844423 (+268265us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.980791 (+136368us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:09.997966 (+ 17175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.041025 21653 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40496 (request call id 30) took 1227 ms. Trace:
I20260709 13:07:10.041188 21648 tablet_service.cc:1511] Processing CreateTablet for tablet 21a0bcc4561a4503aebdb0aab6b13b37 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:07:10.041903 21654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 881467b2dd884d22b15e9ac3906b55cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:10.042148 21652 rpcz_store.cc:276] 0709 13:07:08.832499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.699950 (+867451us) service_pool.cc:224] Handling call
0709 13:07:09.732220 (+ 32270us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.732346 (+   126us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.866893 (+134547us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.975048 (+108155us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.030417 (+ 55369us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.043318 21666 raft_consensus.cc:2393] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f1fa49d04344067941ffd03d9e7d48c in current term 1: Already voted for candidate bed294de06e24ca4aba572ec722d2567 in this term.
I20260709 13:07:10.045783 21578 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47970 (request call id 40) took 1105 ms. Trace:
I20260709 13:07:10.070266 21726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7c18f9e23544d00a8d1cf17afda03c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:10.070154 21578 rpcz_store.cc:276] 0709 13:07:08.940663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.918354 (+977691us) service_pool.cc:224] Handling call
0709 13:07:09.920144 (+  1790us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.920256 (+   112us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.995943 (+ 75687us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.045167 (+ 49224us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.045720 (+   553us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.072994 21555 leader_election.cc:304] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:10.074235 21863 raft_consensus.cc:2749] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:10.074379 21723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed9b20099494a8c94a51f76692a8ec0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:10.069785 21653 rpcz_store.cc:276] 0709 13:07:08.813328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.666436 (+853108us) service_pool.cc:224] Handling call
0709 13:07:09.668323 (+  1887us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.668417 (+    94us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.950024 (+281607us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.040505 (+ 90481us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.040959 (+   454us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.045674 21590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9932f1e440d442f8ab6ba25f33881d75" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:10.045970 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9932f1e440d442f8ab6ba25f33881d75" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:10.081830 21590 raft_consensus.cc:2393] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bed294de06e24ca4aba572ec722d2567 in current term 1: Already voted for candidate 3f1fa49d04344067941ffd03d9e7d48c in this term.
I20260709 13:07:10.010314 21802 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40612 (request call id 28) took 1237 ms. Trace:
I20260709 13:07:10.047153 21860 raft_consensus.cc:359] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:10.048952 21859 raft_consensus.cc:359] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.082829 21859 raft_consensus.cc:385] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:10.083350 21629 leader_election.cc:343] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:09.977768 21575 rpcz_store.cc:276] 0709 13:07:08.908335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.491855 (+583520us) service_pool.cc:224] Handling call
0709 13:07:09.511489 (+ 19634us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.521308 (+  9819us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.844422 (+323114us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.947877 (+103455us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:09.948341 (+   464us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.084153 21629 leader_election.cc:304] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:10.084388 21725 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50692 (request call id 34) took 1161 ms. Trace:
I20260709 13:07:10.082695 21860 raft_consensus.cc:385] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.085213 21879 raft_consensus.cc:2749] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:10.085421 21860 raft_consensus.cc:740] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.055377 21795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ed9b20099494a8c94a51f76692a8ec0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:10.084558 21802 rpcz_store.cc:276] 0709 13:07:08.791636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.428804 (+637168us) service_pool.cc:224] Handling call
0709 13:07:09.584003 (+155199us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.585766 (+  1763us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.836378 (+250612us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.963307 (+126929us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.009964 (+ 46657us) spinlock_profiling.cc:243] Waited 4.53 ms on lock 0x7b5800010898. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a64551a2 00007fc3af396bb9 00007fc3ae4c7d88 00007fc3ae58e973 00007fc3ae58a70f 00007fc3ae58aecd 00007fc3ae539400 00007fc3a79beaf4 00007fc3a79bea82
0709 13:07:10.010253 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10428160}
I20260709 13:07:10.087847 21860 consensus_queue.cc:260] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:10.089404 21863 raft_consensus.cc:493] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.090041 21863 raft_consensus.cc:515] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.090502 21802 tablet_service.cc:1511] Processing CreateTablet for tablet 008742eefeb947f5a1f7decfb821a03d (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:07:10.082656 21722 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50692 (request call id 36) took 1158 ms. Trace:
I20260709 13:07:10.094056 21722 rpcz_store.cc:276] 0709 13:07:08.923821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.817636 (+893815us) service_pool.cc:224] Handling call
0709 13:07:09.819566 (+  1930us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.819673 (+   107us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.899872 (+ 80199us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.005076 (+105204us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.082508 (+ 77432us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.029353 21651 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40496 (request call id 28) took 1224 ms. Trace:
I20260709 13:07:10.098647 21651 rpcz_store.cc:276] 0709 13:07:08.805289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.649910 (+844621us) service_pool.cc:224] Handling call
0709 13:07:09.652193 (+  2283us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.652294 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.909174 (+256880us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.028818 (+119644us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.029290 (+   472us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.101635 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7609574109349aeb89daee4d7aec6f7" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:10.052423 21577 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47970 (request call id 39) took 1112 ms. Trace:
I20260709 13:07:10.043354 21861 tablet_bootstrap.cc:492] T ce5f20a869e24ab78d7677bc08d45963 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:10.062692 21858 raft_consensus.cc:359] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
W20260709 13:07:10.103792 21704 leader_election.cc:343] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.104137 21858 raft_consensus.cc:385] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.104480 21704 leader_election.cc:304] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:10.103492 21577 rpcz_store.cc:276] 0709 13:07:08.940394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.900183 (+959789us) service_pool.cc:224] Handling call
0709 13:07:09.912280 (+ 12097us) spinlock_profiling.cc:243] Waited 9.81 ms on lock 0x7b5800083d98. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a6454a22 00007fc3af36dc09 00007fc3ae4c7ee0 00007fc3ae5ad831 00007fc3ae58aac3 00007fc3ae539400 00007fc3a79beaf4 00007fc3a79bea82 00007fc3a79be9b1
0709 13:07:09.912425 (+   145us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.912528 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.935594 (+ 23066us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.051875 (+116281us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.052355 (+   480us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22560640}
I20260709 13:07:10.105551 21869 raft_consensus.cc:2749] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:10.106261 21861 ts_tablet_manager.cc:1403] T ce5f20a869e24ab78d7677bc08d45963 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.342s	user 0.011s	sys 0.004s
I20260709 13:07:10.114915 21802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008742eefeb947f5a1f7decfb821a03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:10.069438 21648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21a0bcc4561a4503aebdb0aab6b13b37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:10.076697 21652 tablet_service.cc:1511] Processing CreateTablet for tablet e7c18f9e23544d00a8d1cf17afda03c5 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:07:10.121138 21652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7c18f9e23544d00a8d1cf17afda03c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:10.122735 21796 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40612 (request call id 39) took 1209 ms. Trace:
I20260709 13:07:10.124861 21796 rpcz_store.cc:276] 0709 13:07:08.913597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.004854 (+1091257us) service_pool.cc:224] Handling call
0709 13:07:10.006689 (+  1835us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:10.007270 (+   581us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:10.052185 (+ 44915us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.079492 (+ 27307us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.122658 (+ 43166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.135867 21653 tablet_service.cc:1511] Processing CreateTablet for tablet b5745aab7e6c4a409a0ac98725e4e4c9 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:07:10.083421 21859 raft_consensus.cc:740] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.084869 21725 rpcz_store.cc:276] 0709 13:07:08.923125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.796119 (+872994us) service_pool.cc:224] Handling call
0709 13:07:09.798171 (+  2052us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.798271 (+   100us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.904753 (+106482us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.025812 (+121059us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.084321 (+ 58509us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.104616 21858 raft_consensus.cc:740] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.024340 21803 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40612 (request call id 32) took 1130 ms. Trace:
I20260709 13:07:10.139011 21858 consensus_queue.cc:260] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:10.139729 21650 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40496 (request call id 34) took 1306 ms. Trace:
I20260709 13:07:10.140194 21860 ts_tablet_manager.cc:1434] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.108s	user 0.010s	sys 0.001s
I20260709 13:07:10.140149 21650 rpcz_store.cc:276] 0709 13:07:08.833102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.984049 (+1150947us) service_pool.cc:224] Handling call
0709 13:07:09.997671 (+ 13622us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:10.009710 (+ 12039us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:10.061269 (+ 51559us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.139190 (+ 77921us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.139665 (+   475us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.140574 21859 consensus_queue.cc:260] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.138576 21803 rpcz_store.cc:276] 0709 13:07:08.893848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.775920 (+882072us) service_pool.cc:224] Handling call
0709 13:07:09.805145 (+ 29225us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.805267 (+   122us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.873330 (+ 68063us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.023843 (+150513us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.024281 (+   438us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.142428 21650 tablet_service.cc:1511] Processing CreateTablet for tablet 1681a1e8015648a692b9a5eacbbf9d6e (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:07:10.143082 21859 ts_tablet_manager.cc:1434] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.108s	user 0.005s	sys 0.003s
I20260709 13:07:10.143800 21650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1681a1e8015648a692b9a5eacbbf9d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:10.144865 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4979f7a7c14c68ad359f624f114570" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
W20260709 13:07:10.146190 21554 leader_election.cc:343] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.147369 21859 tablet_bootstrap.cc:492] T 7d12f1f33e1a417088b0ae7332d600e3 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
W20260709 13:07:10.147318 21473 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.11.44.195:46013, user_credentials={real_user=slave}} blocked reactor thread for 51568.2us
I20260709 13:07:10.116772 21798 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40612 (request call id 36) took 1221 ms. Trace:
I20260709 13:07:10.151410 21798 rpcz_store.cc:276] 0709 13:07:08.895180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.726248 (+831068us) service_pool.cc:224] Handling call
0709 13:07:09.728248 (+  2000us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.728346 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.863265 (+134919us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.039754 (+176489us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.116691 (+ 76937us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.062773 21656 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40496 (request call id 25) took 1258 ms. Trace:
W20260709 13:07:10.136209 21474 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.11.44.193:35255, user_credentials={real_user=slave}} blocked reactor thread for 51291.8us
I20260709 13:07:10.154101 21656 rpcz_store.cc:276] 0709 13:07:08.804336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.503276 (+698940us) service_pool.cc:224] Handling call
0709 13:07:09.832083 (+328807us) spinlock_profiling.cc:243] Waited 955 us on lock 0x7b58000f6398. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a6314db1 00007fc3a6454b71 00007fc3a64551a2 00007fc3af396bb9 00007fc3ae4c7d88 00007fc3ae58ab80 00007fc3ae539400 00007fc3a79beaf4 00007fc3a79bea82 00007fc3a79be9b1 00007fc3a79be92c
0709 13:07:09.832173 (+    90us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.832277 (+   104us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.887084 (+ 54807us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.062205 (+175121us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.062705 (+   500us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2196736}
I20260709 13:07:10.156467 21656 tablet_service.cc:1511] Processing CreateTablet for tablet ba04167743094b89ba6e3596a48aba86 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:07:10.157011 21729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5745aab7e6c4a409a0ac98725e4e4c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:10.157792 21656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba04167743094b89ba6e3596a48aba86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:10.068214 21655 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40496 (request call id 33) took 1235 ms. Trace:
I20260709 13:07:10.196094 21655 rpcz_store.cc:276] 0709 13:07:08.832795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.814447 (+981652us) service_pool.cc:224] Handling call
0709 13:07:09.913391 (+ 98944us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.913484 (+    93us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:10.015652 (+102168us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.067729 (+ 52077us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.068162 (+   433us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.197345 21653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5745aab7e6c4a409a0ac98725e4e4c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:10.117621 21799 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40612 (request call id 34) took 1223 ms. Trace:
I20260709 13:07:10.152262 21796 tablet_service.cc:1511] Processing CreateTablet for tablet ba04167743094b89ba6e3596a48aba86 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:07:10.141280 21860 tablet_bootstrap.cc:492] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:10.205363 21796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba04167743094b89ba6e3596a48aba86. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:10.131407 21576 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47970 (request call id 35) took 1192 ms. Trace:
I20260709 13:07:10.161911 21727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 008742eefeb947f5a1f7decfb821a03d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:10.207595 21728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1681a1e8015648a692b9a5eacbbf9d6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:10.206851 21576 rpcz_store.cc:276] 0709 13:07:08.939230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.796630 (+857400us) service_pool.cc:224] Handling call
0709 13:07:09.798439 (+  1809us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.798532 (+    93us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:10.006383 (+207851us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.130715 (+124332us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.131324 (+   609us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.115482 21651 tablet_service.cc:1511] Processing CreateTablet for tablet 23660cfe7a7e49db942526440533cdf9 (DEFAULT_TABLE table=test-workload [id=b0a970c8d9404f548c5d54ea48baa36f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:07:10.163029 21730 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50692 (request call id 33) took 1257 ms. Trace:
I20260709 13:07:10.208760 21730 rpcz_store.cc:276] 0709 13:07:08.905421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.676846 (+771425us) service_pool.cc:224] Handling call
0709 13:07:09.731253 (+ 54407us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.731349 (+    96us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.983305 (+251956us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.034931 (+ 51626us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.162967 (+128036us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.163735 21721 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50692 (request call id 37) took 1239 ms. Trace:
I20260709 13:07:10.167918 21800 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40612 (request call id 37) took 1272 ms. Trace:
I20260709 13:07:10.168695 21724 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50692 (request call id 38) took 1244 ms. Trace:
I20260709 13:07:10.210234 21721 rpcz_store.cc:276] 0709 13:07:08.924158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.866545 (+942387us) service_pool.cc:224] Handling call
0709 13:07:09.873892 (+  7347us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.873993 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:10.025501 (+151508us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.163283 (+137782us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.163678 (+   395us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.211437 21800 rpcz_store.cc:276] 0709 13:07:08.895478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.825611 (+930133us) service_pool.cc:224] Handling call
0709 13:07:09.827435 (+  1824us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.827528 (+    93us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.885492 (+ 57964us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.167411 (+281919us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.167857 (+   446us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.209527 21799 rpcz_store.cc:276] 0709 13:07:08.894566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.663410 (+768844us) service_pool.cc:224] Handling call
0709 13:07:09.697894 (+ 34484us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.698003 (+   109us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.852616 (+154613us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:09.998124 (+145508us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.117537 (+119413us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.061431 21580 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47970 (request call id 38) took 1121 ms. Trace:
I20260709 13:07:10.045288 21885 leader_election.cc:290] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:10.162294 21863 leader_election.cc:290] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:10.210427 21724 rpcz_store.cc:276] 0709 13:07:08.924450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.861223 (+936773us) service_pool.cc:224] Handling call
0709 13:07:09.863157 (+  1934us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.863242 (+    85us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.924560 (+ 61318us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.168228 (+243668us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.168636 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.230876 21804 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40612 (request call id 35) took 1336 ms. Trace:
I20260709 13:07:10.067798 21649 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40496 (request call id 36) took 1225 ms. Trace:
I20260709 13:07:10.228679 21580 rpcz_store.cc:276] 0709 13:07:08.940125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.881231 (+941106us) service_pool.cc:224] Handling call
0709 13:07:09.883319 (+  2088us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.883422 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.984604 (+101182us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.060892 (+ 76288us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.061365 (+   473us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.231343 21804 rpcz_store.cc:276] 0709 13:07:08.894878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.813793 (+918915us) service_pool.cc:224] Handling call
0709 13:07:09.907171 (+ 93378us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.907263 (+    92us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:09.961242 (+ 53979us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.230343 (+269101us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.230817 (+   474us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.231583 21649 rpcz_store.cc:276] 0709 13:07:08.842416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.006210 (+1163794us) service_pool.cc:224] Handling call
0709 13:07:10.023195 (+ 16985us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:10.023296 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:10.060445 (+ 37149us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.067219 (+  6774us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.067729 (+   510us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.237937 21572 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47970 (request call id 36) took 1298 ms. Trace:
I20260709 13:07:10.244517 21572 rpcz_store.cc:276] 0709 13:07:08.939566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.831465 (+891899us) service_pool.cc:224] Handling call
0709 13:07:09.878759 (+ 47294us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.878855 (+    96us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:10.063951 (+185096us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.237397 (+173446us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.237870 (+   473us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.240948 21574 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47970 (request call id 41) took 1110 ms. Trace:
I20260709 13:07:10.241509 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4979f7a7c14c68ad359f624f114570" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:10.251953 21574 rpcz_store.cc:276] 0709 13:07:09.130837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.919398 (+788561us) service_pool.cc:224] Handling call
0709 13:07:09.981117 (+ 61719us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.981208 (+    91us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:10.061472 (+ 80264us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.240455 (+178983us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.240889 (+   434us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.253101 21859 tablet_bootstrap.cc:654] T 7d12f1f33e1a417088b0ae7332d600e3 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.255155 21860 tablet_bootstrap.cc:654] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.238905 21861 raft_consensus.cc:359] T ce5f20a869e24ab78d7677bc08d45963 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:10.255582 21861 raft_consensus.cc:385] T ce5f20a869e24ab78d7677bc08d45963 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.255896 21861 raft_consensus.cc:740] T ce5f20a869e24ab78d7677bc08d45963 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.256808 21861 consensus_queue.cc:260] T ce5f20a869e24ab78d7677bc08d45963 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:10.260099 21723 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50692 (request call id 40) took 1305 ms. Trace:
I20260709 13:07:10.260941 21651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23660cfe7a7e49db942526440533cdf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:10.262689 21861 ts_tablet_manager.cc:1434] T ce5f20a869e24ab78d7677bc08d45963 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.156s	user 0.010s	sys 0.002s
I20260709 13:07:10.270741 21861 tablet_bootstrap.cc:492] T a2f2d007d6e54bb3be541d9bbde02eca P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:10.243871 21726 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50692 (request call id 39) took 1319 ms. Trace:
I20260709 13:07:10.275938 21726 rpcz_store.cc:276] 0709 13:07:08.924762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.941546 (+1016784us) service_pool.cc:224] Handling call
0709 13:07:10.069712 (+128166us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:10.069820 (+   108us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:10.137383 (+ 67563us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.243336 (+105953us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.243813 (+   477us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1980800}
I20260709 13:07:10.245409 21652 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40496 (request call id 39) took 1377 ms. Trace:
I20260709 13:07:10.277491 21723 rpcz_store.cc:276] 0709 13:07:08.954691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.948884 (+994193us) service_pool.cc:224] Handling call
0709 13:07:10.073673 (+124789us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:10.073840 (+   167us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:10.237194 (+163354us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.259538 (+ 22344us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.260039 (+   501us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.281771 21861 tablet_bootstrap.cc:654] T a2f2d007d6e54bb3be541d9bbde02eca P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.266885 21729 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:50692 (request call id 41) took 1063 ms. Trace:
I20260709 13:07:10.278380 21891 raft_consensus.cc:493] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.282680 21891 raft_consensus.cc:515] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:10.277169 21652 rpcz_store.cc:276] 0709 13:07:08.867628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.075728 (+1208100us) service_pool.cc:224] Handling call
0709 13:07:10.120658 (+ 44930us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:10.120751 (+    93us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:10.168851 (+ 48100us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.244900 (+ 76049us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.245348 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.283881 21858 ts_tablet_manager.cc:1434] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.251s	user 0.007s	sys 0.012s
W20260709 13:07:10.266091 21555 leader_election.cc:343] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.285063 21555 leader_election.cc:304] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:10.285282 21891 leader_election.cc:290] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:10.285858 21891 raft_consensus.cc:2749] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:10.286047 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b610452794d1192d3df796bedcd8e" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:10.287339 21858 tablet_bootstrap.cc:492] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
W20260709 13:07:10.289515 21554 leader_election.cc:343] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.288595 21729 rpcz_store.cc:276] 0709 13:07:09.203791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.953695 (+749904us) service_pool.cc:224] Handling call
0709 13:07:10.081803 (+128108us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:10.081930 (+   127us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:10.247697 (+165767us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.266357 (+ 18660us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.266818 (+   461us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.296478 21654 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40496 (request call id 38) took 1446 ms. Trace:
I20260709 13:07:10.303666 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b610452794d1192d3df796bedcd8e" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:10.299526 21654 rpcz_store.cc:276] 0709 13:07:08.850567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.018723 (+1168156us) service_pool.cc:224] Handling call
0709 13:07:10.022925 (+  4202us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:10.023024 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:10.276584 (+253560us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.295940 (+ 19356us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.296406 (+   466us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.309190 21859 tablet_bootstrap.cc:492] T 7d12f1f33e1a417088b0ae7332d600e3 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:10.311972 21859 ts_tablet_manager.cc:1403] T 7d12f1f33e1a417088b0ae7332d600e3 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.165s	user 0.005s	sys 0.010s
I20260709 13:07:10.313397 21860 tablet_bootstrap.cc:492] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:10.313572 21651 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40496 (request call id 40) took 1362 ms. Trace:
I20260709 13:07:10.314000 21860 ts_tablet_manager.cc:1403] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.173s	user 0.009s	sys 0.024s
I20260709 13:07:10.314064 21651 rpcz_store.cc:276] 0709 13:07:08.950876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.100290 (+1149414us) service_pool.cc:224] Handling call
0709 13:07:10.208328 (+108038us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:10.208423 (+    95us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:10.279825 (+ 71402us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.310946 (+ 31121us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.313503 (+  2557us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.315363 21861 tablet_bootstrap.cc:492] T a2f2d007d6e54bb3be541d9bbde02eca P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:10.315869 21861 ts_tablet_manager.cc:1403] T a2f2d007d6e54bb3be541d9bbde02eca P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.045s	user 0.000s	sys 0.025s
I20260709 13:07:10.316780 21647 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40496 (request call id 35) took 1474 ms. Trace:
I20260709 13:07:10.306403 21648 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40496 (request call id 37) took 1454 ms. Trace:
W20260709 13:07:10.311050 21555 leader_election.cc:343] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.317404 21860 raft_consensus.cc:359] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:10.319517 21860 raft_consensus.cc:385] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.320042 21860 raft_consensus.cc:740] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.318650 21648 rpcz_store.cc:276] 0709 13:07:08.842804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.037232 (+1194428us) service_pool.cc:224] Handling call
0709 13:07:10.068987 (+ 31755us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:10.069077 (+    90us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:10.290486 (+221409us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.297129 (+  6643us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.297533 (+   404us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.321276 21797 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40612 (request call id 38) took 1425 ms. Trace:
I20260709 13:07:10.320932 21860 consensus_queue.cc:260] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:10.322661 21859 raft_consensus.cc:359] T 7d12f1f33e1a417088b0ae7332d600e3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:10.326057 21859 raft_consensus.cc:385] T 7d12f1f33e1a417088b0ae7332d600e3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.324776 21797 rpcz_store.cc:276] 0709 13:07:08.895768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:09.900914 (+1005146us) service_pool.cc:224] Handling call
0709 13:07:09.979637 (+ 78723us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:09.979726 (+    89us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:10.171494 (+191768us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.320734 (+149240us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.321213 (+   479us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.317170 21647 rpcz_store.cc:276] 0709 13:07:08.842004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.001657 (+1159653us) service_pool.cc:224] Handling call
0709 13:07:10.022172 (+ 20515us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:10.022294 (+   122us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:10.079752 (+ 57458us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.316255 (+236503us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.316723 (+   468us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.329152 21858 tablet_bootstrap.cc:654] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.326401 21859 raft_consensus.cc:740] T 7d12f1f33e1a417088b0ae7332d600e3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.319495 21555 leader_election.cc:304] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:10.332690 21863 raft_consensus.cc:2749] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:10.334378 21859 consensus_queue.cc:260] T 7d12f1f33e1a417088b0ae7332d600e3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:10.336766 21859 ts_tablet_manager.cc:1434] T 7d12f1f33e1a417088b0ae7332d600e3 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.002s
I20260709 13:07:10.337241 21860 ts_tablet_manager.cc:1434] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:07:10.337713 21861 raft_consensus.cc:359] T a2f2d007d6e54bb3be541d9bbde02eca P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:10.338389 21860 tablet_bootstrap.cc:492] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:10.338464 21861 raft_consensus.cc:385] T a2f2d007d6e54bb3be541d9bbde02eca P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.338971 21861 raft_consensus.cc:740] T a2f2d007d6e54bb3be541d9bbde02eca P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.339727 21861 consensus_queue.cc:260] T a2f2d007d6e54bb3be541d9bbde02eca P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:10.341975 21859 tablet_bootstrap.cc:492] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:10.344455 21861 ts_tablet_manager.cc:1434] T a2f2d007d6e54bb3be541d9bbde02eca P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:07:10.345505 21861 tablet_bootstrap.cc:492] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:10.348752 21859 tablet_bootstrap.cc:654] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.353150 21653 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40496 (request call id 41) took 1076 ms. Trace:
I20260709 13:07:10.353852 21861 tablet_bootstrap.cc:654] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.353638 21653 rpcz_store.cc:276] 0709 13:07:09.276467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.119669 (+843202us) service_pool.cc:224] Handling call
0709 13:07:10.186071 (+ 66402us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:10.186205 (+   134us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:10.320604 (+134399us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.352601 (+ 31997us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.353088 (+   487us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.356472 21795 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40612 (request call id 40) took 1403 ms. Trace:
I20260709 13:07:10.356843 21795 rpcz_store.cc:276] 0709 13:07:08.952905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:10.009525 (+1056620us) service_pool.cc:224] Handling call
0709 13:07:10.011356 (+  1831us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:07:10.011458 (+   102us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:07:10.312155 (+300697us) tablet_metadata.cc:665] Metadata flushed
0709 13:07:10.356063 (+ 43908us) tablet_replica.cc:206] Creating consensus instance
0709 13:07:10.356426 (+   363us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:10.361263 21861 tablet_bootstrap.cc:492] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:10.361912 21861 ts_tablet_manager.cc:1403] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.003s
I20260709 13:07:10.362360 21860 tablet_bootstrap.cc:654] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.365147 21861 raft_consensus.cc:359] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:10.366174 21861 raft_consensus.cc:385] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.366513 21861 raft_consensus.cc:740] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.367280 21861 consensus_queue.cc:260] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:10.367823 21860 tablet_bootstrap.cc:492] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:10.368661 21860 ts_tablet_manager.cc:1403] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.003s
I20260709 13:07:10.369599 21861 ts_tablet_manager.cc:1434] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.004s
I20260709 13:07:10.370991 21861 tablet_bootstrap.cc:492] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:10.371732 21860 raft_consensus.cc:359] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:10.372462 21860 raft_consensus.cc:385] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.372740 21860 raft_consensus.cc:740] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.373594 21860 consensus_queue.cc:260] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:10.376209 21860 ts_tablet_manager.cc:1434] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:10.377233 21860 tablet_bootstrap.cc:492] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:10.378518 21861 tablet_bootstrap.cc:654] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.385004 21859 tablet_bootstrap.cc:492] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:10.368188 21858 tablet_bootstrap.cc:492] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:10.385634 21858 ts_tablet_manager.cc:1403] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.099s	user 0.009s	sys 0.007s
I20260709 13:07:10.385738 21859 ts_tablet_manager.cc:1403] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.000s
I20260709 13:07:10.386122 21860 tablet_bootstrap.cc:654] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.388749 21859 raft_consensus.cc:359] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:10.388957 21858 raft_consensus.cc:359] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.391449 21858 raft_consensus.cc:385] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.391794 21858 raft_consensus.cc:740] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.392586 21858 consensus_queue.cc:260] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.395200 21858 ts_tablet_manager.cc:1434] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:07:10.396725 21858 tablet_bootstrap.cc:492] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:10.389812 21859 raft_consensus.cc:385] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.405953 21858 tablet_bootstrap.cc:654] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.404925 21859 raft_consensus.cc:740] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.407357 21859 consensus_queue.cc:260] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:10.408243 21860 tablet_bootstrap.cc:492] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:10.408787 21860 ts_tablet_manager.cc:1403] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.032s	user 0.019s	sys 0.006s
I20260709 13:07:10.411309 21859 ts_tablet_manager.cc:1434] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:07:10.411940 21860 raft_consensus.cc:359] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:10.412766 21859 tablet_bootstrap.cc:492] T 4d4979f7a7c14c68ad359f624f114570 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:10.412957 21860 raft_consensus.cc:385] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.413582 21860 raft_consensus.cc:740] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.414775 21860 consensus_queue.cc:260] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:10.416981 21861 tablet_bootstrap.cc:492] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:10.420751 21861 ts_tablet_manager.cc:1403] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.022s
I20260709 13:07:10.422333 21885 raft_consensus.cc:493] T ce5f20a869e24ab78d7677bc08d45963 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.422554 21859 tablet_bootstrap.cc:654] T 4d4979f7a7c14c68ad359f624f114570 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.422904 21885 raft_consensus.cc:515] T ce5f20a869e24ab78d7677bc08d45963 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:10.423959 21861 raft_consensus.cc:359] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.424693 21861 raft_consensus.cc:385] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.424995 21861 raft_consensus.cc:740] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.425850 21861 consensus_queue.cc:260] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.428025 21859 tablet_bootstrap.cc:492] T 4d4979f7a7c14c68ad359f624f114570 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:10.419672 21860 ts_tablet_manager.cc:1434] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:07:10.428063 21861 ts_tablet_manager.cc:1434] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:10.429411 21860 tablet_bootstrap.cc:492] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:10.429579 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5f20a869e24ab78d7677bc08d45963" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:10.431233 21885 leader_election.cc:290] T ce5f20a869e24ab78d7677bc08d45963 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:10.429911 21861 tablet_bootstrap.cc:492] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
W20260709 13:07:10.432304 21629 leader_election.cc:343] T ce5f20a869e24ab78d7677bc08d45963 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.436554 21860 tablet_bootstrap.cc:654] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.438602 21861 tablet_bootstrap.cc:654] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.440119 21859 ts_tablet_manager.cc:1403] T 4d4979f7a7c14c68ad359f624f114570 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.000s
I20260709 13:07:10.418193 21858 tablet_bootstrap.cc:492] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:10.440940 21858 ts_tablet_manager.cc:1403] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.009s
I20260709 13:07:10.443555 21861 tablet_bootstrap.cc:492] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:10.444013 21861 ts_tablet_manager.cc:1403] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:07:10.445436 21859 raft_consensus.cc:359] T 4d4979f7a7c14c68ad359f624f114570 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.446261 21859 raft_consensus.cc:385] T 4d4979f7a7c14c68ad359f624f114570 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.446548 21859 raft_consensus.cc:740] T 4d4979f7a7c14c68ad359f624f114570 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.446954 21861 raft_consensus.cc:359] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.447718 21861 raft_consensus.cc:385] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.448046 21861 raft_consensus.cc:740] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.448915 21861 consensus_queue.cc:260] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.448977 21858 raft_consensus.cc:359] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:10.447275 21859 consensus_queue.cc:260] T 4d4979f7a7c14c68ad359f624f114570 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.449879 21858 raft_consensus.cc:385] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.451972 21858 raft_consensus.cc:740] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.452749 21859 ts_tablet_manager.cc:1434] T 4d4979f7a7c14c68ad359f624f114570 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:07:10.451261 21861 ts_tablet_manager.cc:1434] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.005s
I20260709 13:07:10.468408 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5f20a869e24ab78d7677bc08d45963" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:10.468892 21859 tablet_bootstrap.cc:492] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:10.469285 21861 tablet_bootstrap.cc:492] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
W20260709 13:07:10.470027 21630 leader_election.cc:343] T ce5f20a869e24ab78d7677bc08d45963 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.470551 21630 leader_election.cc:304] T ce5f20a869e24ab78d7677bc08d45963 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:10.471691 21885 raft_consensus.cc:2749] T ce5f20a869e24ab78d7677bc08d45963 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:10.459256 21867 raft_consensus.cc:493] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.454119 21863 raft_consensus.cc:493] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.473119 21867 raft_consensus.cc:515] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:10.473459 21863 raft_consensus.cc:515] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.476308 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83c22a51936f4415b7a99dcad7540239" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:10.476543 21859 tablet_bootstrap.cc:654] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.477021 21666 raft_consensus.cc:2468] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 0.
I20260709 13:07:10.478229 21555 leader_election.cc:304] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:10.479295 21891 raft_consensus.cc:2804] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:10.479794 21891 raft_consensus.cc:493] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.480216 21891 raft_consensus.cc:3060] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:10.483407 21867 leader_election.cc:290] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:10.450886 21860 tablet_bootstrap.cc:492] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:10.485482 21590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313ed31222454fe19290a9105f226521" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:10.485018 21860 ts_tablet_manager.cc:1403] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.006s
I20260709 13:07:10.487056 21859 tablet_bootstrap.cc:492] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
W20260709 13:07:10.487282 21778 leader_election.cc:343] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.487567 21859 ts_tablet_manager.cc:1403] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.009s
I20260709 13:07:10.487869 21861 tablet_bootstrap.cc:654] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.490988 21859 raft_consensus.cc:359] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:10.492274 21859 raft_consensus.cc:385] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.492769 21859 raft_consensus.cc:740] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.489302 21860 raft_consensus.cc:359] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.494246 21860 raft_consensus.cc:385] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.494591 21860 raft_consensus.cc:740] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.493907 21859 consensus_queue.cc:260] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:10.497160 21859 ts_tablet_manager.cc:1434] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:07:10.498636 21859 tablet_bootstrap.cc:492] T 9932f1e440d442f8ab6ba25f33881d75 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:10.499116 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83c22a51936f4415b7a99dcad7540239" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:10.499809 21740 raft_consensus.cc:2468] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 0.
I20260709 13:07:10.501482 21885 raft_consensus.cc:493] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.502020 21885 raft_consensus.cc:515] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:10.503268 21861 tablet_bootstrap.cc:492] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:10.503870 21861 ts_tablet_manager.cc:1403] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.008s
I20260709 13:07:10.504071 21885 leader_election.cc:290] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:10.505852 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d12f1f33e1a417088b0ae7332d600e3" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:10.506482 21740 raft_consensus.cc:2468] T 7d12f1f33e1a417088b0ae7332d600e3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 0.
I20260709 13:07:10.506917 21859 tablet_bootstrap.cc:654] T 9932f1e440d442f8ab6ba25f33881d75 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.507038 21861 raft_consensus.cc:359] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.507807 21629 leader_election.cc:304] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:10.508817 21885 raft_consensus.cc:2804] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:10.508963 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d12f1f33e1a417088b0ae7332d600e3" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:10.509271 21885 raft_consensus.cc:493] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.509721 21885 raft_consensus.cc:3060] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:10.510637 21630 leader_election.cc:343] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.511584 21863 leader_election.cc:290] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:10.514158 21860 consensus_queue.cc:260] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.507850 21861 raft_consensus.cc:385] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.516355 21861 raft_consensus.cc:740] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.517920 21861 consensus_queue.cc:260] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.452801 21858 consensus_queue.cc:260] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:10.497004 21891 raft_consensus.cc:515] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.520980 21860 ts_tablet_manager.cc:1434] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.001s
I20260709 13:07:10.525213 21861 ts_tablet_manager.cc:1434] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.003s
I20260709 13:07:10.527978 21867 raft_consensus.cc:493] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.532512 21867 raft_consensus.cc:515] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:10.534761 21867 leader_election.cc:290] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:10.534948 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83c22a51936f4415b7a99dcad7540239" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:10.535429 21861 tablet_bootstrap.cc:492] T ac0cb8d5a34c40c3a49464bfcd5f955f P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:10.535555 21666 raft_consensus.cc:3060] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:10.535632 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83c22a51936f4415b7a99dcad7540239" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:10.536369 21740 raft_consensus.cc:3060] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:10.539933 21590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cf644bea63405f9d1a353862a5a110" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:10.540311 21665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cf644bea63405f9d1a353862a5a110" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:10.540726 21590 raft_consensus.cc:2468] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:10.526942 21885 raft_consensus.cc:515] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:10.544142 21861 tablet_bootstrap.cc:654] T ac0cb8d5a34c40c3a49464bfcd5f955f P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:10.545878 21778 leader_election.cc:343] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.546561 21860 tablet_bootstrap.cc:492] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:10.546701 21778 leader_election.cc:304] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:10.547962 21867 raft_consensus.cc:2804] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:10.548326 21867 raft_consensus.cc:493] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.548663 21867 raft_consensus.cc:3060] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:10.551180 21879 raft_consensus.cc:493] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.551757 21879 raft_consensus.cc:515] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.554104 21879 leader_election.cc:290] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:10.555078 21860 tablet_bootstrap.cc:654] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.556195 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4979f7a7c14c68ad359f624f114570" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:10.556900 21739 raft_consensus.cc:2468] T 4d4979f7a7c14c68ad359f624f114570 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 0.
I20260709 13:07:10.557680 21891 leader_election.cc:290] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Requested vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:10.557327 21666 raft_consensus.cc:2468] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 1.
I20260709 13:07:10.560945 21861 tablet_bootstrap.cc:492] T ac0cb8d5a34c40c3a49464bfcd5f955f P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:10.561398 21861 ts_tablet_manager.cc:1403] T ac0cb8d5a34c40c3a49464bfcd5f955f P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.026s	user 0.005s	sys 0.005s
I20260709 13:07:10.558249 21629 leader_election.cc:304] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:10.562680 21879 raft_consensus.cc:2804] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:10.563249 21879 raft_consensus.cc:493] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.563683 21879 raft_consensus.cc:3060] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:10.564248 21861 raft_consensus.cc:359] T ac0cb8d5a34c40c3a49464bfcd5f955f P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:10.564961 21861 raft_consensus.cc:385] T ac0cb8d5a34c40c3a49464bfcd5f955f P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.565218 21861 raft_consensus.cc:740] T ac0cb8d5a34c40c3a49464bfcd5f955f P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.562721 21859 tablet_bootstrap.cc:492] T 9932f1e440d442f8ab6ba25f33881d75 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:10.565934 21861 consensus_queue.cc:260] T ac0cb8d5a34c40c3a49464bfcd5f955f P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:10.566552 21859 ts_tablet_manager.cc:1403] T 9932f1e440d442f8ab6ba25f33881d75 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.020s
I20260709 13:07:10.566597 21555 leader_election.cc:304] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:10.568347 21590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4979f7a7c14c68ad359f624f114570" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:10.569247 21590 raft_consensus.cc:2468] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 0.
I20260709 13:07:10.570783 21859 raft_consensus.cc:359] T 9932f1e440d442f8ab6ba25f33881d75 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.571821 21859 raft_consensus.cc:385] T 9932f1e440d442f8ab6ba25f33881d75 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.572186 21859 raft_consensus.cc:740] T 9932f1e440d442f8ab6ba25f33881d75 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.577818 21891 raft_consensus.cc:2804] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:10.578490 21891 raft_consensus.cc:697] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:10.578809 21859 consensus_queue.cc:260] T 9932f1e440d442f8ab6ba25f33881d75 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.579406 21891 consensus_queue.cc:237] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.580094 21869 raft_consensus.cc:493] T 9932f1e440d442f8ab6ba25f33881d75 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.580562 21869 raft_consensus.cc:515] T 9932f1e440d442f8ab6ba25f33881d75 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.582698 21860 tablet_bootstrap.cc:492] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:10.583050 21869 leader_election.cc:290] T 9932f1e440d442f8ab6ba25f33881d75 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:10.583424 21860 ts_tablet_manager.cc:1403] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.003s
I20260709 13:07:10.584719 21590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9932f1e440d442f8ab6ba25f33881d75" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:10.587971 21860 raft_consensus.cc:359] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:10.589040 21860 raft_consensus.cc:385] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.586308 21590 raft_consensus.cc:2393] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in current term 1: Already voted for candidate 3f1fa49d04344067941ffd03d9e7d48c in this term.
I20260709 13:07:10.595480 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d12f1f33e1a417088b0ae7332d600e3" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:10.596400 21739 raft_consensus.cc:3060] T 7d12f1f33e1a417088b0ae7332d600e3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:10.599547 21859 ts_tablet_manager.cc:1434] T 9932f1e440d442f8ab6ba25f33881d75 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.002s
I20260709 13:07:10.589452 21860 raft_consensus.cc:740] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.600991 21859 tablet_bootstrap.cc:492] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:10.600867 21860 consensus_queue.cc:260] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:10.608449 21885 leader_election.cc:290] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:10.621548 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d12f1f33e1a417088b0ae7332d600e3" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:10.630864 21858 ts_tablet_manager.cc:1434] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.189s	user 0.007s	sys 0.002s
I20260709 13:07:10.631590 21860 ts_tablet_manager.cc:1434] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.007s
I20260709 13:07:10.632105 21858 tablet_bootstrap.cc:492] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:10.633044 21860 tablet_bootstrap.cc:492] T 7d12f1f33e1a417088b0ae7332d600e3 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:10.643076 21860 tablet_bootstrap.cc:654] T 7d12f1f33e1a417088b0ae7332d600e3 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.642858 21867 raft_consensus.cc:515] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:10.645107 21867 leader_election.cc:290] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:10.650893 21859 tablet_bootstrap.cc:654] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.651947 21861 ts_tablet_manager.cc:1434] T ac0cb8d5a34c40c3a49464bfcd5f955f P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.090s	user 0.030s	sys 0.051s
I20260709 13:07:10.651937 21885 raft_consensus.cc:493] T a2f2d007d6e54bb3be541d9bbde02eca P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.653606 21861 tablet_bootstrap.cc:492] T bc118bb477224df8a4f953e308982c45 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:10.653249 21885 raft_consensus.cc:515] T a2f2d007d6e54bb3be541d9bbde02eca P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:10.655627 21885 leader_election.cc:290] T a2f2d007d6e54bb3be541d9bbde02eca P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:10.659219 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f2d007d6e54bb3be541d9bbde02eca" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:10.660593 21861 tablet_bootstrap.cc:654] T bc118bb477224df8a4f953e308982c45 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.660966 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cf644bea63405f9d1a353862a5a110" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
W20260709 13:07:10.667761 21630 leader_election.cc:343] T a2f2d007d6e54bb3be541d9bbde02eca P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.667871 21916 raft_consensus.cc:493] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:10.668540 21630 leader_election.cc:343] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.668610 21916 raft_consensus.cc:515] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
W20260709 13:07:10.669852 21778 leader_election.cc:343] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.665019 21867 raft_consensus.cc:493] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.674741 21916 leader_election.cc:290] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:10.675288 21916 raft_consensus.cc:493] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.675751 21916 raft_consensus.cc:515] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:10.676790 21869 raft_consensus.cc:493] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.670658 21590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cf644bea63405f9d1a353862a5a110" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:10.677281 21869 raft_consensus.cc:515] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:10.677888 21590 raft_consensus.cc:3060] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:10.678097 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b610452794d1192d3df796bedcd8e" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:10.678821 21591 raft_consensus.cc:2468] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:10.679313 21869 leader_election.cc:290] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:10.680110 21778 leader_election.cc:304] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:10.681318 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313ed31222454fe19290a9105f226521" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
W20260709 13:07:10.685079 21704 leader_election.cc:343] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.685271 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10699d4b9f347c783a7a00bb6cd772c" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
W20260709 13:07:10.687080 21778 leader_election.cc:343] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.688090 21916 leader_election.cc:290] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:10.688681 21916 raft_consensus.cc:2804] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:10.689061 21916 raft_consensus.cc:493] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.689457 21916 raft_consensus.cc:3060] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:10.690269 21885 raft_consensus.cc:493] T ac0cb8d5a34c40c3a49464bfcd5f955f P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.691107 21885 raft_consensus.cc:515] T ac0cb8d5a34c40c3a49464bfcd5f955f P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:10.693786 21869 raft_consensus.cc:493] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.694232 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0cb8d5a34c40c3a49464bfcd5f955f" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:10.694387 21869 raft_consensus.cc:515] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:10.695112 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f2d007d6e54bb3be541d9bbde02eca" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
W20260709 13:07:10.695824 21629 leader_election.cc:343] T ac0cb8d5a34c40c3a49464bfcd5f955f P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.696460 21869 leader_election.cc:290] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:10.696796 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313ed31222454fe19290a9105f226521" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:10.697391 21814 raft_consensus.cc:2468] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 0.
I20260709 13:07:10.698885 21704 leader_election.cc:304] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:10.699335 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10699d4b9f347c783a7a00bb6cd772c" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:10.699945 21814 raft_consensus.cc:2468] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 0.
I20260709 13:07:10.693327 21885 leader_election.cc:290] T ac0cb8d5a34c40c3a49464bfcd5f955f P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:10.700716 21665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10699d4b9f347c783a7a00bb6cd772c" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:10.700970 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9932f1e440d442f8ab6ba25f33881d75" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:10.701154 21869 raft_consensus.cc:2804] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:10.701716 21869 raft_consensus.cc:493] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.703413 21869 raft_consensus.cc:3060] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:10.702952 21630 leader_election.cc:343] T a2f2d007d6e54bb3be541d9bbde02eca P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.704541 21630 leader_election.cc:304] T a2f2d007d6e54bb3be541d9bbde02eca P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:10.704617 21704 leader_election.cc:304] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:10.701820 21666 raft_consensus.cc:2393] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in current term 1: Already voted for candidate bed294de06e24ca4aba572ec722d2567 in this term.
I20260709 13:07:10.703912 21739 raft_consensus.cc:2468] T 7d12f1f33e1a417088b0ae7332d600e3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 1.
I20260709 13:07:10.709237 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b610452794d1192d3df796bedcd8e" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:10.709296 21629 leader_election.cc:304] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:10.709831 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10699d4b9f347c783a7a00bb6cd772c" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:10.710637 21737 raft_consensus.cc:2468] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:10.711038 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313ed31222454fe19290a9105f226521" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:10.709854 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0cb8d5a34c40c3a49464bfcd5f955f" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:10.706545 21867 raft_consensus.cc:515] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.715047 21867 leader_election.cc:290] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
W20260709 13:07:10.711885 21777 leader_election.cc:343] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.716658 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7609574109349aeb89daee4d7aec6f7" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
W20260709 13:07:10.718220 21778 leader_election.cc:343] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.711637 21740 raft_consensus.cc:2468] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 1.
I20260709 13:07:10.722604 21858 tablet_bootstrap.cc:654] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.706616 21885 raft_consensus.cc:2749] T a2f2d007d6e54bb3be541d9bbde02eca P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:10.722652 21913 raft_consensus.cc:2804] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:07:10.725410 21630 leader_election.cc:343] T ac0cb8d5a34c40c3a49464bfcd5f955f P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.719333 21777 leader_election.cc:304] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:10.729923 21630 leader_election.cc:304] T ac0cb8d5a34c40c3a49464bfcd5f955f P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:10.724352 21879 raft_consensus.cc:515] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.732214 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7609574109349aeb89daee4d7aec6f7" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:10.733901 21917 raft_consensus.cc:2804] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:10.734328 21917 raft_consensus.cc:493] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.734809 21917 raft_consensus.cc:3060] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:10.734992 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4979f7a7c14c68ad359f624f114570" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:10.735836 21737 raft_consensus.cc:3060] T 4d4979f7a7c14c68ad359f624f114570 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:10.734367 21537 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:10.733347 21740 raft_consensus.cc:2468] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:10.739051 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4979f7a7c14c68ad359f624f114570" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:10.739730 21885 raft_consensus.cc:2749] T ac0cb8d5a34c40c3a49464bfcd5f955f P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:10.733311 21879 leader_election.cc:290] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:10.739842 21591 raft_consensus.cc:3060] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:10.760174 21590 raft_consensus.cc:2468] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:10.762028 21778 leader_election.cc:304] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:10.763830 21918 raft_consensus.cc:2804] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:10.768851 21861 tablet_bootstrap.cc:492] T bc118bb477224df8a4f953e308982c45 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:10.769403 21861 ts_tablet_manager.cc:1403] T bc118bb477224df8a4f953e308982c45 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.116s	user 0.015s	sys 0.000s
W20260709 13:07:10.770761 21704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:41173, user_credentials={real_user=slave}} blocked reactor thread for 66256us
W20260709 13:07:10.771457 21704 leader_election.cc:343] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.772248 21704 leader_election.cc:304] T 9932f1e440d442f8ab6ba25f33881d75 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:10.773845 21777 leader_election.cc:304] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:10.775180 21867 raft_consensus.cc:2804] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:10.775099 21591 raft_consensus.cc:2468] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 1.
I20260709 13:07:10.775810 21867 raft_consensus.cc:493] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.776367 21867 raft_consensus.cc:3060] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:10.776463 21861 raft_consensus.cc:359] T bc118bb477224df8a4f953e308982c45 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:10.777227 21861 raft_consensus.cc:385] T bc118bb477224df8a4f953e308982c45 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.777220 21630 leader_election.cc:304] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:10.777962 21861 raft_consensus.cc:740] T bc118bb477224df8a4f953e308982c45 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.778841 21885 raft_consensus.cc:2804] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:10.778934 21861 consensus_queue.cc:260] T bc118bb477224df8a4f953e308982c45 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:10.779896 21885 raft_consensus.cc:697] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 [term 1 LEADER]: Becoming Leader. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Running, Role: LEADER
I20260709 13:07:10.781378 21861 ts_tablet_manager.cc:1434] T bc118bb477224df8a4f953e308982c45 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:07:10.781077 21885 consensus_queue.cc:237] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.782368 21861 tablet_bootstrap.cc:492] T a7cf644bea63405f9d1a353862a5a110 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:10.784058 21916 raft_consensus.cc:515] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:10.764586 21918 raft_consensus.cc:697] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:10.766680 21869 raft_consensus.cc:515] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:10.788954 21739 raft_consensus.cc:2393] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c58d9f32b84e5bb79e2751ac41cdba in current term 1: Already voted for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in this term.
I20260709 13:07:10.788864 21918 consensus_queue.cc:237] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:10.790127 21869 leader_election.cc:290] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:10.790745 21869 raft_consensus.cc:2804] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:10.791092 21869 raft_consensus.cc:493] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.791292 21777 leader_election.cc:304] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:10.785884 21913 raft_consensus.cc:697] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 [term 1 LEADER]: Becoming Leader. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Running, Role: LEADER
I20260709 13:07:10.792443 21869 raft_consensus.cc:3060] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:10.806196 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b610452794d1192d3df796bedcd8e" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:10.806939 21591 raft_consensus.cc:3060] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:10.805403 21488 catalog_manager.cc:5697] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 1 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:10.799642 21916 leader_election.cc:290] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:10.810285 21916 raft_consensus.cc:3060] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:10.811981 21859 tablet_bootstrap.cc:492] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:10.812539 21859 ts_tablet_manager.cc:1403] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.212s	user 0.010s	sys 0.013s
I20260709 13:07:10.818109 21591 raft_consensus.cc:2468] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:10.818532 21917 raft_consensus.cc:515] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:10.819739 21778 leader_election.cc:304] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:10.820873 21917 leader_election.cc:290] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:10.821856 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10699d4b9f347c783a7a00bb6cd772c" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
W20260709 13:07:10.823685 21778 leader_election.cc:343] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.823869 21860 tablet_bootstrap.cc:492] T 7d12f1f33e1a417088b0ae7332d600e3 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:10.824877 21860 ts_tablet_manager.cc:1403] T 7d12f1f33e1a417088b0ae7332d600e3 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.192s	user 0.032s	sys 0.031s
I20260709 13:07:10.825695 21867 raft_consensus.cc:515] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.828096 21860 raft_consensus.cc:359] T 7d12f1f33e1a417088b0ae7332d600e3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:10.829093 21860 raft_consensus.cc:385] T 7d12f1f33e1a417088b0ae7332d600e3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.831214 21590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7609574109349aeb89daee4d7aec6f7" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
W20260709 13:07:10.833062 21778 leader_election.cc:343] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.828179 21859 raft_consensus.cc:359] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:10.833750 21923 raft_consensus.cc:3060] T 9932f1e440d442f8ab6ba25f33881d75 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:10.834007 21859 raft_consensus.cc:385] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.834525 21859 raft_consensus.cc:740] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.835373 21859 consensus_queue.cc:260] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:10.829412 21860 raft_consensus.cc:740] T 7d12f1f33e1a417088b0ae7332d600e3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.828104 21867 leader_election.cc:290] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:10.841814 21859 ts_tablet_manager.cc:1434] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.001s
I20260709 13:07:10.844734 21860 consensus_queue.cc:260] T 7d12f1f33e1a417088b0ae7332d600e3 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:10.821489 21917 raft_consensus.cc:2804] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:10.851537 21859 tablet_bootstrap.cc:492] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:10.853029 21860 ts_tablet_manager.cc:1434] T 7d12f1f33e1a417088b0ae7332d600e3 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:07:10.849745 21917 raft_consensus.cc:697] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
W20260709 13:07:10.858780 21704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:35853, user_credentials={real_user=slave}} blocked reactor thread for 86604.1us
I20260709 13:07:10.860239 21917 consensus_queue.cc:237] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
W20260709 13:07:10.854959 21777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:46013, user_credentials={real_user=slave}} blocked reactor thread for 63751.6us
I20260709 13:07:10.862527 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313ed31222454fe19290a9105f226521" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:10.863165 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b610452794d1192d3df796bedcd8e" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:10.864073 21739 raft_consensus.cc:3060] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:10.868939 21860 tablet_bootstrap.cc:492] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:10.875257 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10699d4b9f347c783a7a00bb6cd772c" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
W20260709 13:07:10.873759 21704 leader_election.cc:343] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.879434 21861 tablet_bootstrap.cc:654] T a7cf644bea63405f9d1a353862a5a110 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.856952 21913 consensus_queue.cc:237] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:10.882918 21923 raft_consensus.cc:2749] T 9932f1e440d442f8ab6ba25f33881d75 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:10.886698 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7609574109349aeb89daee4d7aec6f7" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:10.887367 21738 raft_consensus.cc:3060] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:10.888321 21737 raft_consensus.cc:2468] T 4d4979f7a7c14c68ad359f624f114570 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 1.
I20260709 13:07:10.888598 21739 raft_consensus.cc:2468] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:10.890829 21860 tablet_bootstrap.cc:654] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.893625 21869 raft_consensus.cc:515] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:10.894850 21740 raft_consensus.cc:2393] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c58d9f32b84e5bb79e2751ac41cdba in current term 1: Already voted for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in this term.
I20260709 13:07:10.897513 21869 leader_election.cc:290] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Requested vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:10.897972 21859 tablet_bootstrap.cc:654] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:10.898132 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10699d4b9f347c783a7a00bb6cd772c" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:10.898912 21928 raft_consensus.cc:493] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:10.899463 21928 raft_consensus.cc:515] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:10.898401 21916 raft_consensus.cc:2749] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:10.907109 21704 leader_election.cc:343] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:10.919771 21860 tablet_bootstrap.cc:492] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:10.920487 21860 ts_tablet_manager.cc:1403] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.000s
I20260709 13:07:10.921638 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10699d4b9f347c783a7a00bb6cd772c" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:10.922768 21813 raft_consensus.cc:2393] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in current term 1: Already voted for candidate b8c58d9f32b84e5bb79e2751ac41cdba in this term.
I20260709 13:07:10.923815 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313ed31222454fe19290a9105f226521" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:10.917346 21858 tablet_bootstrap.cc:492] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:10.936733 21777 leader_election.cc:304] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:10.938197 21916 raft_consensus.cc:2749] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:10.939954 21704 leader_election.cc:304] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:10.941891 21858 ts_tablet_manager.cc:1403] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.310s	user 0.021s	sys 0.044s
I20260709 13:07:10.942462 21869 raft_consensus.cc:2749] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:10.945266 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b610452794d1192d3df796bedcd8e" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:10.947512 21738 raft_consensus.cc:2468] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:10.949216 21777 leader_election.cc:304] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:10.950558 21916 raft_consensus.cc:2804] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:10.951195 21916 raft_consensus.cc:697] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:10.952495 21928 leader_election.cc:290] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:10.952279 21916 consensus_queue.cc:237] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:10.955550 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b610452794d1192d3df796bedcd8e" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:10.956452 21591 raft_consensus.cc:2468] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 1.
I20260709 13:07:10.958614 21704 leader_election.cc:304] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:10.959233 21858 raft_consensus.cc:359] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:10.962198 21858 raft_consensus.cc:385] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.969403 21489 catalog_manager.cc:5697] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 reported cstate change: term changed from 0 to 1, leader changed from <none> to bed294de06e24ca4aba572ec722d2567 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "bed294de06e24ca4aba572ec722d2567" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:10.965289 21928 raft_consensus.cc:2804] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:10.967331 21858 raft_consensus.cc:740] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.978344 21858 consensus_queue.cc:260] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:10.980322 21858 ts_tablet_manager.cc:1434] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:07:10.981276 21858 tablet_bootstrap.cc:492] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:10.973824 21928 raft_consensus.cc:493] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:10.981931 21928 raft_consensus.cc:3060] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:10.983155 21859 tablet_bootstrap.cc:492] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:10.983712 21859 ts_tablet_manager.cc:1403] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.135s	user 0.008s	sys 0.007s
I20260709 13:07:10.986405 21891 consensus_queue.cc:1048] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:10.986649 21859 raft_consensus.cc:359] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:10.987370 21859 raft_consensus.cc:385] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:10.987654 21859 raft_consensus.cc:740] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:10.989018 21859 consensus_queue.cc:260] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:10.991874 21814 raft_consensus.cc:2468] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 1.
I20260709 13:07:10.995046 21861 tablet_bootstrap.cc:492] T a7cf644bea63405f9d1a353862a5a110 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:10.995641 21861 ts_tablet_manager.cc:1403] T a7cf644bea63405f9d1a353862a5a110 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.213s	user 0.024s	sys 0.045s
I20260709 13:07:10.996057 21704 leader_election.cc:304] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:10.996973 21869 raft_consensus.cc:2804] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:10.997473 21869 raft_consensus.cc:697] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Running, Role: LEADER
I20260709 13:07:10.998342 21869 consensus_queue.cc:237] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:10.999241 21861 raft_consensus.cc:359] T a7cf644bea63405f9d1a353862a5a110 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.000098 21861 raft_consensus.cc:385] T a7cf644bea63405f9d1a353862a5a110 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.000370 21861 raft_consensus.cc:740] T a7cf644bea63405f9d1a353862a5a110 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.001227 21861 consensus_queue.cc:260] T a7cf644bea63405f9d1a353862a5a110 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.006582 21861 ts_tablet_manager.cc:1434] T a7cf644bea63405f9d1a353862a5a110 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:07:11.007655 21861 tablet_bootstrap.cc:492] T d10699d4b9f347c783a7a00bb6cd772c P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:11.008468 21913 raft_consensus.cc:493] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.008351 21860 raft_consensus.cc:359] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.009256 21860 raft_consensus.cc:385] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.009052 21913 raft_consensus.cc:515] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.011452 21860 raft_consensus.cc:740] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.012529 21859 ts_tablet_manager.cc:1434] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:07:11.013944 21859 tablet_bootstrap.cc:492] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:11.015838 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8eb26670184a3dabe0c8e8162e1a4e" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
W20260709 13:07:11.017894 21630 leader_election.cc:343] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:11.017485 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8eb26670184a3dabe0c8e8162e1a4e" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:11.020143 21861 tablet_bootstrap.cc:654] T d10699d4b9f347c783a7a00bb6cd772c P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:11.020244 21629 leader_election.cc:343] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:11.020725 21859 tablet_bootstrap.cc:654] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.020934 21629 leader_election.cc:304] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:11.012907 21860 consensus_queue.cc:260] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.028764 21885 raft_consensus.cc:2749] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:11.026094 21913 leader_election.cc:290] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:11.035004 21860 ts_tablet_manager.cc:1434] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.114s	user 0.005s	sys 0.005s
I20260709 13:07:11.036036 21860 tablet_bootstrap.cc:492] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:11.042182 21891 consensus_queue.cc:1048] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:11.046066 21859 tablet_bootstrap.cc:492] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:11.042313 21928 raft_consensus.cc:515] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:11.046998 21859 ts_tablet_manager.cc:1403] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.007s
I20260709 13:07:11.045487 21487 catalog_manager.cc:5697] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 1 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.050451 21913 raft_consensus.cc:493] T a7cf644bea63405f9d1a353862a5a110 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.051062 21913 raft_consensus.cc:515] T a7cf644bea63405f9d1a353862a5a110 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.060730 21916 raft_consensus.cc:493] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.061486 21916 raft_consensus.cc:515] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:11.064353 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b610452794d1192d3df796bedcd8e" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:11.066226 21928 leader_election.cc:290] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:11.066960 21665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc118bb477224df8a4f953e308982c45" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:11.067646 21665 raft_consensus.cc:2468] T bc118bb477224df8a4f953e308982c45 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:11.065249 21913 leader_election.cc:290] T a7cf644bea63405f9d1a353862a5a110 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:11.069056 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613b610452794d1192d3df796bedcd8e" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:11.069648 21591 raft_consensus.cc:3060] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.070961 21860 tablet_bootstrap.cc:654] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.051066 21858 tablet_bootstrap.cc:654] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.074589 21590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cf644bea63405f9d1a353862a5a110" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:11.075649 21590 raft_consensus.cc:2393] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bed294de06e24ca4aba572ec722d2567 in current term 1: Already voted for candidate b8c58d9f32b84e5bb79e2751ac41cdba in this term.
I20260709 13:07:11.077762 21778 leader_election.cc:304] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:11.079321 21918 raft_consensus.cc:2804] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:11.079901 21918 raft_consensus.cc:493] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.080320 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cf644bea63405f9d1a353862a5a110" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:11.080400 21918 raft_consensus.cc:3060] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:11.084697 21916 leader_election.cc:290] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:11.090660 21630 leader_election.cc:304] T a7cf644bea63405f9d1a353862a5a110 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:11.090778 21590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc118bb477224df8a4f953e308982c45" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:11.092172 21913 raft_consensus.cc:3060] T a7cf644bea63405f9d1a353862a5a110 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:11.092886 21778 leader_election.cc:343] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:11.095324 21591 raft_consensus.cc:2468] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 2.
I20260709 13:07:11.102463 21859 raft_consensus.cc:359] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.104655 21704 leader_election.cc:304] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:11.105630 21928 raft_consensus.cc:2804] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:11.106137 21928 raft_consensus.cc:697] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 LEADER]: Becoming Leader. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Running, Role: LEADER
I20260709 13:07:11.107309 21928 consensus_queue.cc:237] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:11.104387 21859 raft_consensus.cc:385] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.111443 21859 raft_consensus.cc:740] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.115407 21859 consensus_queue.cc:260] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.118546 21861 tablet_bootstrap.cc:492] T d10699d4b9f347c783a7a00bb6cd772c P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:11.119076 21861 ts_tablet_manager.cc:1403] T d10699d4b9f347c783a7a00bb6cd772c P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.112s	user 0.015s	sys 0.030s
I20260709 13:07:11.105554 21913 raft_consensus.cc:2749] T a7cf644bea63405f9d1a353862a5a110 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:11.134780 21861 raft_consensus.cc:359] T d10699d4b9f347c783a7a00bb6cd772c P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.135670 21861 raft_consensus.cc:385] T d10699d4b9f347c783a7a00bb6cd772c P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.136023 21861 raft_consensus.cc:740] T d10699d4b9f347c783a7a00bb6cd772c P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.137208 21858 tablet_bootstrap.cc:492] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:11.137933 21858 ts_tablet_manager.cc:1403] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.157s	user 0.014s	sys 0.004s
I20260709 13:07:11.138001 21918 raft_consensus.cc:515] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:11.141170 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc118bb477224df8a4f953e308982c45" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:11.141805 21666 raft_consensus.cc:3060] T bc118bb477224df8a4f953e308982c45 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:11.143018 21861 consensus_queue.cc:260] T d10699d4b9f347c783a7a00bb6cd772c P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.152045 21859 ts_tablet_manager.cc:1434] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.104s	user 0.008s	sys 0.000s
I20260709 13:07:11.145150 21869 raft_consensus.cc:493] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.154191 21859 tablet_bootstrap.cc:492] T ce5f20a869e24ab78d7677bc08d45963 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:11.154800 21861 ts_tablet_manager.cc:1434] T d10699d4b9f347c783a7a00bb6cd772c P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.002s
I20260709 13:07:11.155665 21869 raft_consensus.cc:515] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:11.160799 21869 leader_election.cc:290] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:11.161630 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e46f3f1221a4fedac36e2252b8f2a34" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
W20260709 13:07:11.163872 21704 leader_election.cc:343] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:11.164171 21666 raft_consensus.cc:2468] T bc118bb477224df8a4f953e308982c45 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:11.165347 21778 leader_election.cc:304] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:11.165993 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e46f3f1221a4fedac36e2252b8f2a34" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:11.166240 21916 raft_consensus.cc:2804] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:11.166857 21916 raft_consensus.cc:697] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:11.166055 21858 raft_consensus.cc:359] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
W20260709 13:07:11.167605 21704 leader_election.cc:343] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:11.167488 21858 raft_consensus.cc:385] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.168326 21858 raft_consensus.cc:740] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.168195 21704 leader_election.cc:304] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:11.167714 21916 consensus_queue.cc:237] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:11.169942 21869 raft_consensus.cc:2749] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:11.170861 21861 tablet_bootstrap.cc:492] T e6f61ea1b37f4399a62f791777f0f481 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:11.169399 21858 consensus_queue.cc:260] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.179150 21860 tablet_bootstrap.cc:492] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:11.179709 21860 ts_tablet_manager.cc:1403] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.144s	user 0.016s	sys 0.035s
I20260709 13:07:11.180315 21918 leader_election.cc:290] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:11.181820 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc118bb477224df8a4f953e308982c45" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
W20260709 13:07:11.183362 21778 leader_election.cc:343] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:11.183540 21860 raft_consensus.cc:359] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.184198 21860 raft_consensus.cc:385] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.184458 21860 raft_consensus.cc:740] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.186442 21860 consensus_queue.cc:260] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.193822 21858 ts_tablet_manager.cc:1434] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.002s
I20260709 13:07:11.198757 21858 tablet_bootstrap.cc:492] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:11.202566 21488 catalog_manager.cc:5697] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 reported cstate change: term changed from 0 to 1, leader changed from <none> to bed294de06e24ca4aba572ec722d2567 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "bed294de06e24ca4aba572ec722d2567" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.208951 21859 tablet_bootstrap.cc:654] T ce5f20a869e24ab78d7677bc08d45963 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.209290 21918 raft_consensus.cc:493] T 7d12f1f33e1a417088b0ae7332d600e3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.209916 21918 raft_consensus.cc:515] T 7d12f1f33e1a417088b0ae7332d600e3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.212118 21860 ts_tablet_manager.cc:1434] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.002s
I20260709 13:07:11.215183 21860 tablet_bootstrap.cc:492] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:11.216408 21918 leader_election.cc:290] T 7d12f1f33e1a417088b0ae7332d600e3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:11.214092 21861 tablet_bootstrap.cc:654] T e6f61ea1b37f4399a62f791777f0f481 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.217056 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d12f1f33e1a417088b0ae7332d600e3" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:11.216971 21486 catalog_manager.cc:5697] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.216992 21665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d12f1f33e1a417088b0ae7332d600e3" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:11.218602 21738 raft_consensus.cc:2393] T 7d12f1f33e1a417088b0ae7332d600e3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c58d9f32b84e5bb79e2751ac41cdba in current term 1: Already voted for candidate bed294de06e24ca4aba572ec722d2567 in this term.
I20260709 13:07:11.219976 21777 leader_election.cc:304] T 7d12f1f33e1a417088b0ae7332d600e3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:11.221859 21917 raft_consensus.cc:3060] T 7d12f1f33e1a417088b0ae7332d600e3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:11.226511 21926 consensus_queue.cc:1048] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:11.228188 21861 tablet_bootstrap.cc:492] T e6f61ea1b37f4399a62f791777f0f481 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:11.228703 21861 ts_tablet_manager.cc:1403] T e6f61ea1b37f4399a62f791777f0f481 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.073s	user 0.012s	sys 0.004s
I20260709 13:07:11.229519 21917 raft_consensus.cc:2749] T 7d12f1f33e1a417088b0ae7332d600e3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:11.231622 21861 raft_consensus.cc:359] T e6f61ea1b37f4399a62f791777f0f481 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.232404 21918 raft_consensus.cc:493] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.232398 21861 raft_consensus.cc:385] T e6f61ea1b37f4399a62f791777f0f481 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.233034 21861 raft_consensus.cc:740] T e6f61ea1b37f4399a62f791777f0f481 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.232982 21918 raft_consensus.cc:515] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.234170 21861 consensus_queue.cc:260] T e6f61ea1b37f4399a62f791777f0f481 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.235376 21918 leader_election.cc:290] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:11.236099 21858 tablet_bootstrap.cc:654] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.236794 21861 ts_tablet_manager.cc:1434] T e6f61ea1b37f4399a62f791777f0f481 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:07:11.238116 21590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f2d007d6e54bb3be541d9bbde02eca" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:11.239703 21861 tablet_bootstrap.cc:492] T 9de835ccc085481aaf56e24e6b6a055f P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:11.241747 21918 consensus_queue.cc:1048] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:11.250349 21778 leader_election.cc:343] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:11.239645 21859 tablet_bootstrap.cc:492] T ce5f20a869e24ab78d7677bc08d45963 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:11.250203 21487 catalog_manager.cc:5697] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 reported cstate change: term changed from 0 to 2, leader changed from <none> to 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195). New cstate: current_term: 2 leader_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.251217 21859 ts_tablet_manager.cc:1403] T ce5f20a869e24ab78d7677bc08d45963 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.097s	user 0.013s	sys 0.000s
I20260709 13:07:11.256122 21859 raft_consensus.cc:359] T ce5f20a869e24ab78d7677bc08d45963 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.293892 21861 tablet_bootstrap.cc:654] T 9de835ccc085481aaf56e24e6b6a055f P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.294112 21859 raft_consensus.cc:385] T ce5f20a869e24ab78d7677bc08d45963 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.294454 21859 raft_consensus.cc:740] T ce5f20a869e24ab78d7677bc08d45963 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.295212 21859 consensus_queue.cc:260] T ce5f20a869e24ab78d7677bc08d45963 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.256387 21913 consensus_queue.cc:1048] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 13:07:11.266284 21928 raft_consensus.cc:493] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.298743 21859 ts_tablet_manager.cc:1434] T ce5f20a869e24ab78d7677bc08d45963 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 13:07:11.299116 21928 raft_consensus.cc:515] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.300693 21859 tablet_bootstrap.cc:492] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:11.300961 21590 raft_consensus.cc:1240] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Rejecting Update request from peer b8c58d9f32b84e5bb79e2751ac41cdba for earlier term 1. Current term is 2. Ops: []
I20260709 13:07:11.301527 21928 leader_election.cc:290] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:11.303926 21664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8eb26670184a3dabe0c8e8162e1a4e" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:11.304697 21664 raft_consensus.cc:2468] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 0.
I20260709 13:07:11.306078 21704 leader_election.cc:304] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:11.306792 21913 consensus_queue.cc:1048] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:11.307487 21928 raft_consensus.cc:2804] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:11.309458 21928 raft_consensus.cc:493] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.309928 21928 raft_consensus.cc:3060] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:11.269919 21485 catalog_manager.cc:5697] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 1 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.311779 21485 catalog_manager.cc:5697] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 1 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.314114 21917 consensus_queue.cc:1059] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:11.314687 21859 tablet_bootstrap.cc:654] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.286522 21858 tablet_bootstrap.cc:492] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:11.316205 21858 ts_tablet_manager.cc:1403] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.118s	user 0.022s	sys 0.012s
I20260709 13:07:11.318202 21918 raft_consensus.cc:3055] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:11.318696 21918 raft_consensus.cc:740] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:11.319020 21858 raft_consensus.cc:359] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:11.319828 21858 raft_consensus.cc:385] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.320113 21858 raft_consensus.cc:740] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.255596 21665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f2d007d6e54bb3be541d9bbde02eca" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:11.319918 21918 consensus_queue.cc:260] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:11.307979 21860 tablet_bootstrap.cc:654] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.321777 21858 consensus_queue.cc:260] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:11.321908 21918 raft_consensus.cc:3060] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.321082 21665 raft_consensus.cc:2468] T a2f2d007d6e54bb3be541d9bbde02eca P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:11.337219 21778 leader_election.cc:304] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:11.338660 21917 raft_consensus.cc:493] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.342519 21917 raft_consensus.cc:515] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.331686 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8eb26670184a3dabe0c8e8162e1a4e" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:11.345997 21916 raft_consensus.cc:2804] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:11.346195 21591 raft_consensus.cc:2468] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 0.
I20260709 13:07:11.346436 21916 raft_consensus.cc:493] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.346817 21916 raft_consensus.cc:3060] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:11.351619 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5f20a869e24ab78d7677bc08d45963" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:11.352434 21740 raft_consensus.cc:2468] T ce5f20a869e24ab78d7677bc08d45963 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:11.351006 21917 leader_election.cc:290] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:11.353753 21777 leader_election.cc:304] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:11.354647 21926 raft_consensus.cc:2804] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:11.355021 21926 raft_consensus.cc:493] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.355111 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5f20a869e24ab78d7677bc08d45963" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:11.355386 21926 raft_consensus.cc:3060] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:11.355443 21885 consensus_queue.cc:1048] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:11.355821 21666 raft_consensus.cc:2468] T ce5f20a869e24ab78d7677bc08d45963 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:11.357859 21858 ts_tablet_manager.cc:1434] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:07:11.358903 21858 tablet_bootstrap.cc:492] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:11.367100 21926 raft_consensus.cc:515] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.370594 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5f20a869e24ab78d7677bc08d45963" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:11.371255 21740 raft_consensus.cc:3060] T ce5f20a869e24ab78d7677bc08d45963 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:11.374557 21665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce5f20a869e24ab78d7677bc08d45963" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:11.375180 21665 raft_consensus.cc:3060] T ce5f20a869e24ab78d7677bc08d45963 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:11.380059 21740 raft_consensus.cc:2468] T ce5f20a869e24ab78d7677bc08d45963 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:11.380517 21951 raft_consensus.cc:493] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.383404 21858 tablet_bootstrap.cc:654] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.369383 21926 leader_election.cc:290] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:11.387049 21951 raft_consensus.cc:515] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.396646 21928 raft_consensus.cc:515] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
W20260709 13:07:11.407438 21704 consensus_peers.cc:597] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:11.412720 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e7302faa874a2f874d979ae54331f3" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:11.413466 21814 raft_consensus.cc:2468] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 0.
I20260709 13:07:11.414017 21951 leader_election.cc:290] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:11.419103 21555 leader_election.cc:304] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:11.420051 21951 raft_consensus.cc:2804] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:11.420588 21951 raft_consensus.cc:493] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.416884 21665 raft_consensus.cc:2468] T ce5f20a869e24ab78d7677bc08d45963 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:11.424121 21778 leader_election.cc:304] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:11.425805 21859 tablet_bootstrap.cc:492] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:11.426492 21859 ts_tablet_manager.cc:1403] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.126s	user 0.013s	sys 0.009s
I20260709 13:07:11.426836 21918 raft_consensus.cc:2804] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:11.427379 21918 raft_consensus.cc:697] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:11.427539 21867 consensus_queue.cc:1048] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:11.430116 21916 raft_consensus.cc:515] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.433171 21916 leader_election.cc:290] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:11.433741 21590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f2d007d6e54bb3be541d9bbde02eca" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:11.435491 21665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f2d007d6e54bb3be541d9bbde02eca" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:11.436367 21861 tablet_bootstrap.cc:492] T 9de835ccc085481aaf56e24e6b6a055f P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:11.455781 21665 raft_consensus.cc:3060] T a2f2d007d6e54bb3be541d9bbde02eca P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:11.456317 21861 ts_tablet_manager.cc:1403] T 9de835ccc085481aaf56e24e6b6a055f P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.219s	user 0.070s	sys 0.015s
I20260709 13:07:11.436810 21859 raft_consensus.cc:359] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.458271 21859 raft_consensus.cc:385] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.458604 21859 raft_consensus.cc:740] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.459276 21859 consensus_queue.cc:260] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.461653 21861 raft_consensus.cc:359] T 9de835ccc085481aaf56e24e6b6a055f P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.462409 21861 raft_consensus.cc:385] T 9de835ccc085481aaf56e24e6b6a055f P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.462692 21861 raft_consensus.cc:740] T 9de835ccc085481aaf56e24e6b6a055f P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.463371 21861 consensus_queue.cc:260] T 9de835ccc085481aaf56e24e6b6a055f P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.465277 21860 tablet_bootstrap.cc:492] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:11.465341 21861 ts_tablet_manager.cc:1434] T 9de835ccc085481aaf56e24e6b6a055f P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.000s
I20260709 13:07:11.467068 21861 tablet_bootstrap.cc:492] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:11.422035 21951 raft_consensus.cc:3060] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:11.461504 21859 ts_tablet_manager.cc:1434] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.002s
I20260709 13:07:11.444581 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8eb26670184a3dabe0c8e8162e1a4e" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:11.468477 21664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e7302faa874a2f874d979ae54331f3" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:11.468796 21666 raft_consensus.cc:3060] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:11.470582 21555 leader_election.cc:343] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:11.472178 21968 consensus_queue.cc:1048] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:07:11.445755 21778 consensus_peers.cc:597] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:11.473672 21778 leader_election.cc:343] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:11.446367 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8eb26670184a3dabe0c8e8162e1a4e" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:11.474769 21591 raft_consensus.cc:3060] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:11.475145 21665 raft_consensus.cc:2468] T a2f2d007d6e54bb3be541d9bbde02eca P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:11.475740 21951 raft_consensus.cc:515] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.467839 21860 ts_tablet_manager.cc:1403] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.253s	user 0.016s	sys 0.014s
I20260709 13:07:11.428231 21918 consensus_queue.cc:237] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.480791 21778 leader_election.cc:304] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:11.482316 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e7302faa874a2f874d979ae54331f3" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:11.482963 21814 raft_consensus.cc:3060] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:11.483639 21917 raft_consensus.cc:2804] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:11.484355 21917 raft_consensus.cc:697] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:11.485484 21917 consensus_queue.cc:237] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.501830 21859 tablet_bootstrap.cc:492] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:11.503450 21869 consensus_queue.cc:1048] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:11.507568 21861 tablet_bootstrap.cc:654] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.503307 21860 raft_consensus.cc:359] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.443133 21928 leader_election.cc:290] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:11.510588 21860 raft_consensus.cc:385] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.511883 21666 raft_consensus.cc:2468] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 1.
I20260709 13:07:11.511680 21488 catalog_manager.cc:5697] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 1 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:11.513298 21860 raft_consensus.cc:740] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.511982 21951 leader_election.cc:290] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:11.514732 21704 leader_election.cc:304] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:11.513990 21814 raft_consensus.cc:2468] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 1.
I20260709 13:07:11.515349 21860 consensus_queue.cc:260] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.516098 21555 leader_election.cc:304] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:11.516571 21859 tablet_bootstrap.cc:654] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.517007 21951 raft_consensus.cc:2804] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:11.517736 21951 raft_consensus.cc:697] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:11.520571 21968 raft_consensus.cc:493] T d10699d4b9f347c783a7a00bb6cd772c P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.521085 21968 raft_consensus.cc:515] T d10699d4b9f347c783a7a00bb6cd772c P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.523962 21968 leader_election.cc:290] T d10699d4b9f347c783a7a00bb6cd772c P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:11.525213 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10699d4b9f347c783a7a00bb6cd772c" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:11.526150 21738 raft_consensus.cc:2393] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bed294de06e24ca4aba572ec722d2567 in current term 1: Already voted for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in this term.
I20260709 13:07:11.520084 21928 raft_consensus.cc:2804] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:11.529475 21860 ts_tablet_manager.cc:1434] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260709 13:07:11.530545 21860 tablet_bootstrap.cc:492] T 43e501f94be841fbb110db3ac40ede77 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:11.530718 21591 raft_consensus.cc:2468] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 1.
I20260709 13:07:11.519047 21951 consensus_queue.cc:237] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.533962 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e7302faa874a2f874d979ae54331f3" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
W20260709 13:07:11.535163 21555 leader_election.cc:343] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:11.539755 21858 tablet_bootstrap.cc:492] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:11.540432 21858 ts_tablet_manager.cc:1403] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.182s	user 0.010s	sys 0.010s
I20260709 13:07:11.541412 21928 raft_consensus.cc:697] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Running, Role: LEADER
I20260709 13:07:11.542409 21928 consensus_queue.cc:237] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.543419 21858 raft_consensus.cc:359] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.545871 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10699d4b9f347c783a7a00bb6cd772c" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:11.549945 21813 raft_consensus.cc:2393] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bed294de06e24ca4aba572ec722d2567 in current term 1: Already voted for candidate b8c58d9f32b84e5bb79e2751ac41cdba in this term.
I20260709 13:07:11.551224 21630 leader_election.cc:304] T d10699d4b9f347c783a7a00bb6cd772c P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:11.552438 21968 raft_consensus.cc:3060] T d10699d4b9f347c783a7a00bb6cd772c P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:11.553660 21858 raft_consensus.cc:385] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.554015 21858 raft_consensus.cc:740] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.554674 21858 consensus_queue.cc:260] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.558167 21858 ts_tablet_manager.cc:1434] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.002s
I20260709 13:07:11.559223 21858 tablet_bootstrap.cc:492] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:11.559640 21928 raft_consensus.cc:493] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.560560 21968 raft_consensus.cc:2749] T d10699d4b9f347c783a7a00bb6cd772c P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:11.560380 21928 raft_consensus.cc:515] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.562738 21860 tablet_bootstrap.cc:654] T 43e501f94be841fbb110db3ac40ede77 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.562917 21928 leader_election.cc:290] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:11.564823 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0cb8d5a34c40c3a49464bfcd5f955f" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:11.564946 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0cb8d5a34c40c3a49464bfcd5f955f" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:11.565515 21666 raft_consensus.cc:2468] T ac0cb8d5a34c40c3a49464bfcd5f955f P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 0.
I20260709 13:07:11.565802 21859 tablet_bootstrap.cc:492] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
W20260709 13:07:11.566368 21704 leader_election.cc:343] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:11.566494 21859 ts_tablet_manager.cc:1403] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.041s
I20260709 13:07:11.567302 21704 leader_election.cc:304] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:11.568133 21928 raft_consensus.cc:2804] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:11.568548 21928 raft_consensus.cc:493] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.568898 21928 raft_consensus.cc:3060] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:11.569113 21487 catalog_manager.cc:5697] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 1 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.570376 21859 raft_consensus.cc:359] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.571146 21859 raft_consensus.cc:385] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.571504 21859 raft_consensus.cc:740] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.572650 21859 consensus_queue.cc:260] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.575407 21859 ts_tablet_manager.cc:1434] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:11.576378 21859 tablet_bootstrap.cc:492] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:11.577339 21858 tablet_bootstrap.cc:654] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.582677 21488 catalog_manager.cc:5697] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 1 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.583529 21859 tablet_bootstrap.cc:654] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.593047 21813 raft_consensus.cc:1275] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Refusing update from remote peer 3e8f84032ed948908dc7fcffcfe2d6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:07:11.593600 21813 pending_rounds.cc:85] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba: Aborting all ops after (but not including) 0
I20260709 13:07:11.593874 21813 pending_rounds.cc:107] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:07:11.593850 21860 tablet_bootstrap.cc:492] T 43e501f94be841fbb110db3ac40ede77 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:11.594617 21813 raft_consensus.cc:2889] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:11.595039 21860 ts_tablet_manager.cc:1403] T 43e501f94be841fbb110db3ac40ede77 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.008s
I20260709 13:07:11.595000 21928 raft_consensus.cc:515] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.601339 21860 raft_consensus.cc:359] T 43e501f94be841fbb110db3ac40ede77 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.602108 21860 raft_consensus.cc:385] T 43e501f94be841fbb110db3ac40ede77 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.602448 21860 raft_consensus.cc:740] T 43e501f94be841fbb110db3ac40ede77 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.602785 21928 leader_election.cc:290] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Requested vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:11.605150 21928 consensus_queue.cc:1048] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:11.605679 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0cb8d5a34c40c3a49464bfcd5f955f" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:11.606333 21666 raft_consensus.cc:3060] T ac0cb8d5a34c40c3a49464bfcd5f955f P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:11.609854 21858 tablet_bootstrap.cc:492] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:11.610575 21858 ts_tablet_manager.cc:1403] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.004s
I20260709 13:07:11.603350 21926 consensus_queue.cc:1048] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:11.603359 21860 consensus_queue.cc:260] T 43e501f94be841fbb110db3ac40ede77 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.615896 21860 ts_tablet_manager.cc:1434] T 43e501f94be841fbb110db3ac40ede77 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:07:11.617229 21860 tablet_bootstrap.cc:492] T ac0cb8d5a34c40c3a49464bfcd5f955f P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:11.618254 21861 tablet_bootstrap.cc:492] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:11.622449 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0cb8d5a34c40c3a49464bfcd5f955f" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:11.621932 21861 ts_tablet_manager.cc:1403] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.155s	user 0.012s	sys 0.013s
W20260709 13:07:11.624399 21704 leader_election.cc:343] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:11.626744 21861 raft_consensus.cc:359] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.627451 21861 raft_consensus.cc:385] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.625097 21858 raft_consensus.cc:359] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.628222 21858 raft_consensus.cc:385] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.628652 21858 raft_consensus.cc:740] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.627848 21861 raft_consensus.cc:740] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.631911 21858 consensus_queue.cc:260] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.631829 21861 consensus_queue.cc:260] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.635882 21861 ts_tablet_manager.cc:1434] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:07:11.636916 21861 tablet_bootstrap.cc:492] T 43e501f94be841fbb110db3ac40ede77 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:11.637537 21858 ts_tablet_manager.cc:1434] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.002s
I20260709 13:07:11.638145 21591 raft_consensus.cc:1275] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Refusing update from remote peer 3e8f84032ed948908dc7fcffcfe2d6e5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:11.638983 21858 tablet_bootstrap.cc:492] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:11.642797 21928 consensus_queue.cc:1048] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:11.640995 21860 tablet_bootstrap.cc:654] T ac0cb8d5a34c40c3a49464bfcd5f955f P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.646361 21666 raft_consensus.cc:2468] T ac0cb8d5a34c40c3a49464bfcd5f955f P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 1.
I20260709 13:07:11.649722 21859 tablet_bootstrap.cc:492] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:11.652354 21859 ts_tablet_manager.cc:1403] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.037s
I20260709 13:07:11.655167 21861 tablet_bootstrap.cc:654] T 43e501f94be841fbb110db3ac40ede77 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.655222 21859 raft_consensus.cc:359] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.656277 21859 raft_consensus.cc:385] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.656561 21859 raft_consensus.cc:740] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.657352 21859 consensus_queue.cc:260] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.657542 21858 tablet_bootstrap.cc:654] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.660238 21859 ts_tablet_manager.cc:1434] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:11.661309 21859 tablet_bootstrap.cc:492] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:11.665551 21860 tablet_bootstrap.cc:492] T ac0cb8d5a34c40c3a49464bfcd5f955f P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:11.666141 21860 ts_tablet_manager.cc:1403] T ac0cb8d5a34c40c3a49464bfcd5f955f P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.005s
I20260709 13:07:11.667220 21859 tablet_bootstrap.cc:654] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.669911 21860 raft_consensus.cc:359] T ac0cb8d5a34c40c3a49464bfcd5f955f P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.670914 21860 raft_consensus.cc:385] T ac0cb8d5a34c40c3a49464bfcd5f955f P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.671028 21968 raft_consensus.cc:493] T e6f61ea1b37f4399a62f791777f0f481 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.671339 21860 raft_consensus.cc:740] T ac0cb8d5a34c40c3a49464bfcd5f955f P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.671861 21968 raft_consensus.cc:515] T e6f61ea1b37f4399a62f791777f0f481 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.672415 21860 consensus_queue.cc:260] T ac0cb8d5a34c40c3a49464bfcd5f955f P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.674096 21885 raft_consensus.cc:493] T 9de835ccc085481aaf56e24e6b6a055f P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.674765 21885 raft_consensus.cc:515] T 9de835ccc085481aaf56e24e6b6a055f P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.679581 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de835ccc085481aaf56e24e6b6a055f" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
W20260709 13:07:11.681824 21630 leader_election.cc:343] T 9de835ccc085481aaf56e24e6b6a055f P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:11.684904 21590 raft_consensus.cc:3060] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:11.690662 21928 raft_consensus.cc:493] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.691576 21928 raft_consensus.cc:515] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.692224 21968 leader_election.cc:290] T e6f61ea1b37f4399a62f791777f0f481 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:11.694823 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61ea1b37f4399a62f791777f0f481" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:11.694846 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61ea1b37f4399a62f791777f0f481" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:11.698231 21861 tablet_bootstrap.cc:492] T 43e501f94be841fbb110db3ac40ede77 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:11.698741 21861 ts_tablet_manager.cc:1403] T 43e501f94be841fbb110db3ac40ede77 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.062s	user 0.016s	sys 0.009s
I20260709 13:07:11.699312 21704 leader_election.cc:304] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:11.701489 21861 raft_consensus.cc:359] T 43e501f94be841fbb110db3ac40ede77 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
W20260709 13:07:11.702418 21629 leader_election.cc:343] T e6f61ea1b37f4399a62f791777f0f481 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:11.703619 21928 leader_election.cc:290] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
W20260709 13:07:11.705433 21630 leader_election.cc:343] T e6f61ea1b37f4399a62f791777f0f481 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:11.705636 21861 raft_consensus.cc:385] T 43e501f94be841fbb110db3ac40ede77 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.705967 21861 raft_consensus.cc:740] T 43e501f94be841fbb110db3ac40ede77 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.706662 21861 consensus_queue.cc:260] T 43e501f94be841fbb110db3ac40ede77 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.707726 21630 leader_election.cc:304] T e6f61ea1b37f4399a62f791777f0f481 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:11.708117 21858 tablet_bootstrap.cc:492] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:11.708811 21858 ts_tablet_manager.cc:1403] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.070s	user 0.015s	sys 0.000s
I20260709 13:07:11.709091 21861 ts_tablet_manager.cc:1434] T 43e501f94be841fbb110db3ac40ede77 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:07:11.710114 21861 tablet_bootstrap.cc:492] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:11.649729 21485 catalog_manager.cc:5697] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:11.712414 21858 raft_consensus.cc:359] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:11.715277 21976 raft_consensus.cc:2804] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:11.716192 21976 raft_consensus.cc:697] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Running, Role: LEADER
I20260709 13:07:11.716513 21861 tablet_bootstrap.cc:654] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.713357 21858 raft_consensus.cc:385] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.717078 21858 raft_consensus.cc:740] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.717134 21976 consensus_queue.cc:237] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.717903 21858 consensus_queue.cc:260] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:11.719879 21858 ts_tablet_manager.cc:1434] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.003s
I20260709 13:07:11.715634 21860 ts_tablet_manager.cc:1434] T ac0cb8d5a34c40c3a49464bfcd5f955f P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:07:11.722723 21859 tablet_bootstrap.cc:492] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:11.723176 21859 ts_tablet_manager.cc:1403] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.043s
I20260709 13:07:11.723555 21860 tablet_bootstrap.cc:492] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:11.715631 21885 leader_election.cc:290] T 9de835ccc085481aaf56e24e6b6a055f P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:11.724888 21967 raft_consensus.cc:2749] T e6f61ea1b37f4399a62f791777f0f481 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:11.728689 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de835ccc085481aaf56e24e6b6a055f" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:11.733975 21916 raft_consensus.cc:493] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.734479 21916 raft_consensus.cc:515] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.735349 21859 raft_consensus.cc:359] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.735402 21665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e501f94be841fbb110db3ac40ede77" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:11.736124 21859 raft_consensus.cc:385] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.736465 21859 raft_consensus.cc:740] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.736632 21916 leader_election.cc:290] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:11.737159 21859 consensus_queue.cc:260] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.738761 21589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc8f1a9d5ce413cb159ae69ce846c06" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:11.738901 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e501f94be841fbb110db3ac40ede77" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:11.739840 21813 raft_consensus.cc:2468] T 43e501f94be841fbb110db3ac40ede77 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 0.
W20260709 13:07:11.740181 21778 leader_election.cc:343] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:11.741532 21859 ts_tablet_manager.cc:1434] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:07:11.741863 21860 tablet_bootstrap.cc:654] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.742563 21859 tablet_bootstrap.cc:492] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:11.744611 21858 tablet_bootstrap.cc:492] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:11.739198 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc8f1a9d5ce413cb159ae69ce846c06" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:11.749176 21859 tablet_bootstrap.cc:654] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:11.751005 21537 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:11.736667 21665 raft_consensus.cc:2468] T 43e501f94be841fbb110db3ac40ede77 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 0.
I20260709 13:07:11.753221 21858 tablet_bootstrap.cc:654] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:11.755214 21630 leader_election.cc:343] T 9de835ccc085481aaf56e24e6b6a055f P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:11.751660 21860 tablet_bootstrap.cc:492] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:11.756059 21630 leader_election.cc:304] T 9de835ccc085481aaf56e24e6b6a055f P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:11.756389 21860 ts_tablet_manager.cc:1403] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.000s
I20260709 13:07:11.768566 21951 raft_consensus.cc:493] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.769083 21951 raft_consensus.cc:515] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:11.769501 21885 raft_consensus.cc:2749] T 9de835ccc085481aaf56e24e6b6a055f P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:11.769990 21860 raft_consensus.cc:359] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:11.770710 21860 raft_consensus.cc:385] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.771003 21860 raft_consensus.cc:740] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.771684 21860 consensus_queue.cc:260] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
W20260709 13:07:11.751896 21778 leader_election.cc:343] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:11.772651 21778 leader_election.cc:304] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:11.765162 21704 leader_election.cc:304] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:11.774312 21976 raft_consensus.cc:2804] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:11.764688 21861 tablet_bootstrap.cc:492] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:11.772786 21951 leader_election.cc:290] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:11.774703 21976 raft_consensus.cc:493] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.766291 21859 tablet_bootstrap.cc:492] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:11.775282 21861 ts_tablet_manager.cc:1403] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.065s	user 0.037s	sys 0.010s
I20260709 13:07:11.775759 21859 ts_tablet_manager.cc:1403] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.007s
I20260709 13:07:11.776087 21867 raft_consensus.cc:2749] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:11.776811 21867 consensus_queue.cc:1048] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:11.778491 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc118bb477224df8a4f953e308982c45" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:11.778795 21861 raft_consensus.cc:359] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.778869 21859 raft_consensus.cc:359] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.779822 21859 raft_consensus.cc:385] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.779727 21861 raft_consensus.cc:385] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.780243 21859 raft_consensus.cc:740] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.780325 21861 raft_consensus.cc:740] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.781090 21859 consensus_queue.cc:260] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.782065 21858 tablet_bootstrap.cc:492] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:11.781587 21861 consensus_queue.cc:260] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.783160 21858 ts_tablet_manager.cc:1403] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.002s
I20260709 13:07:11.783398 21859 ts_tablet_manager.cc:1434] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:11.784384 21859 tablet_bootstrap.cc:492] T 8900bbb09a964e26aaab011b218c8f11 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:11.784436 21861 ts_tablet_manager.cc:1434] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:07:11.785496 21861 tablet_bootstrap.cc:492] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:11.786391 21858 raft_consensus.cc:359] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.787153 21858 raft_consensus.cc:385] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.787767 21858 raft_consensus.cc:740] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.788671 21858 consensus_queue.cc:260] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.790081 21916 raft_consensus.cc:493] T ac0cb8d5a34c40c3a49464bfcd5f955f P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.775305 21976 raft_consensus.cc:3060] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:11.791043 21859 tablet_bootstrap.cc:654] T 8900bbb09a964e26aaab011b218c8f11 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.790611 21916 raft_consensus.cc:515] T ac0cb8d5a34c40c3a49464bfcd5f955f P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.791946 21861 tablet_bootstrap.cc:654] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.782583 21860 ts_tablet_manager.cc:1434] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:07:11.794531 21860 tablet_bootstrap.cc:492] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:11.794411 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0cb8d5a34c40c3a49464bfcd5f955f" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:11.796792 21916 leader_election.cc:290] T ac0cb8d5a34c40c3a49464bfcd5f955f P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:11.798323 21589 raft_consensus.cc:3060] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:11.799997 21858 ts_tablet_manager.cc:1434] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:07:11.801191 21858 tablet_bootstrap.cc:492] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:11.808714 21885 raft_consensus.cc:493] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.809389 21885 raft_consensus.cc:515] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.810307 21860 tablet_bootstrap.cc:654] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.811410 21858 tablet_bootstrap.cc:654] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.812158 21859 tablet_bootstrap.cc:492] T 8900bbb09a964e26aaab011b218c8f11 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:11.812790 21859 ts_tablet_manager.cc:1403] T 8900bbb09a964e26aaab011b218c8f11 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.012s
I20260709 13:07:11.813053 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07198040872480db2c3b210d75e8c26" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
W20260709 13:07:11.815145 21629 leader_election.cc:343] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:11.816001 21885 leader_election.cc:290] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:11.816449 21859 raft_consensus.cc:359] T 8900bbb09a964e26aaab011b218c8f11 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:11.817258 21859 raft_consensus.cc:385] T 8900bbb09a964e26aaab011b218c8f11 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.817574 21859 raft_consensus.cc:740] T 8900bbb09a964e26aaab011b218c8f11 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.818264 21859 consensus_queue.cc:260] T 8900bbb09a964e26aaab011b218c8f11 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:11.817263 21665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac0cb8d5a34c40c3a49464bfcd5f955f" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:11.819877 21665 raft_consensus.cc:2393] T ac0cb8d5a34c40c3a49464bfcd5f955f P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c58d9f32b84e5bb79e2751ac41cdba in current term 1: Already voted for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in this term.
I20260709 13:07:11.819844 21588 raft_consensus.cc:3060] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:11.821689 21778 leader_election.cc:304] T ac0cb8d5a34c40c3a49464bfcd5f955f P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:11.822423 21859 ts_tablet_manager.cc:1434] T 8900bbb09a964e26aaab011b218c8f11 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:07:11.823277 21916 raft_consensus.cc:3060] T ac0cb8d5a34c40c3a49464bfcd5f955f P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:11.823483 21859 tablet_bootstrap.cc:492] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:11.830863 21859 tablet_bootstrap.cc:654] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.855549 21916 raft_consensus.cc:2749] T ac0cb8d5a34c40c3a49464bfcd5f955f P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:11.856154 21858 tablet_bootstrap.cc:492] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:11.857193 21858 ts_tablet_manager.cc:1403] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.005s
I20260709 13:07:11.862121 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07198040872480db2c3b210d75e8c26" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:11.866184 21858 raft_consensus.cc:359] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.868798 21885 raft_consensus.cc:493] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.869015 21858 raft_consensus.cc:385] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.869822 21665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc118bb477224df8a4f953e308982c45" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:11.871387 21859 tablet_bootstrap.cc:492] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:11.869448 21858 raft_consensus.cc:740] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.871953 21859 ts_tablet_manager.cc:1403] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.049s	user 0.029s	sys 0.011s
I20260709 13:07:11.872714 21858 consensus_queue.cc:260] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.875187 21858 ts_tablet_manager.cc:1434] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:07:11.874841 21859 raft_consensus.cc:359] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:11.869431 21885 raft_consensus.cc:515] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.876317 21858 tablet_bootstrap.cc:492] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:11.879159 21885 leader_election.cc:290] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:11.880729 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9932f1e440d442f8ab6ba25f33881d75" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:11.881515 21737 raft_consensus.cc:2468] T 9932f1e440d442f8ab6ba25f33881d75 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 1.
W20260709 13:07:11.881923 21630 leader_election.cc:343] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:11.882639 21630 leader_election.cc:304] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:11.882954 21629 leader_election.cc:304] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:11.883452 21858 tablet_bootstrap.cc:654] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.883611 21968 raft_consensus.cc:2749] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:11.884169 21885 raft_consensus.cc:2804] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:11.884640 21885 raft_consensus.cc:493] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.885044 21885 raft_consensus.cc:3060] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.891800 21859 raft_consensus.cc:385] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.892246 21859 raft_consensus.cc:740] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.891916 21555 leader_election.cc:304] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:11.893007 21951 raft_consensus.cc:2749] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:11.894191 21867 consensus_queue.cc:1048] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:11.894543 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9932f1e440d442f8ab6ba25f33881d75" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:11.895166 21588 raft_consensus.cc:2468] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 1.
I20260709 13:07:11.898470 21859 consensus_queue.cc:260] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:11.899186 21858 tablet_bootstrap.cc:492] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:11.899683 21858 ts_tablet_manager.cc:1403] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.000s
I20260709 13:07:11.900930 21859 ts_tablet_manager.cc:1434] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 13:07:11.901942 21859 tablet_bootstrap.cc:492] T 9eac649888d64d3b8f520993cb19b20e P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:11.902311 21858 raft_consensus.cc:359] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.902982 21858 raft_consensus.cc:385] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.903255 21858 raft_consensus.cc:740] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.904078 21858 consensus_queue.cc:260] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.906323 21858 ts_tablet_manager.cc:1434] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:07:11.907217 21858 tablet_bootstrap.cc:492] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:11.908495 21885 raft_consensus.cc:515] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.913444 21858 tablet_bootstrap.cc:654] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.915042 21885 leader_election.cc:290] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:11.912927 21859 tablet_bootstrap.cc:654] T 9eac649888d64d3b8f520993cb19b20e P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.916565 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9932f1e440d442f8ab6ba25f33881d75" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:11.917383 21737 raft_consensus.cc:3060] T 9932f1e440d442f8ab6ba25f33881d75 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.926252 21928 raft_consensus.cc:493] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.926824 21928 raft_consensus.cc:515] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:11.929109 21737 raft_consensus.cc:2468] T 9932f1e440d442f8ab6ba25f33881d75 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 2.
I20260709 13:07:11.929832 21928 leader_election.cc:290] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:11.932021 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c540859ed0b48f1b7ed38ead0137a45" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:11.944679 21860 tablet_bootstrap.cc:492] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:11.926793 21858 tablet_bootstrap.cc:492] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:11.945267 21860 ts_tablet_manager.cc:1403] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.151s	user 0.028s	sys 0.050s
I20260709 13:07:11.935138 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c540859ed0b48f1b7ed38ead0137a45" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:11.945696 21858 ts_tablet_manager.cc:1403] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.007s
I20260709 13:07:11.948729 21858 raft_consensus.cc:359] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.937633 21859 tablet_bootstrap.cc:492] T 9eac649888d64d3b8f520993cb19b20e P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
W20260709 13:07:11.949867 21704 leader_election.cc:343] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:11.950376 21859 ts_tablet_manager.cc:1403] T 9eac649888d64d3b8f520993cb19b20e P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.049s	user 0.005s	sys 0.021s
W20260709 13:07:11.950634 21704 leader_election.cc:343] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:11.951063 21704 leader_election.cc:304] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:11.951872 21928 raft_consensus.cc:2749] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:11.951992 21867 consensus_queue.cc:1048] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:11.949417 21858 raft_consensus.cc:385] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.954097 21858 raft_consensus.cc:740] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.954355 21859 raft_consensus.cc:359] T 9eac649888d64d3b8f520993cb19b20e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.954872 21858 consensus_queue.cc:260] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:11.955339 21859 raft_consensus.cc:385] T 9eac649888d64d3b8f520993cb19b20e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.955726 21859 raft_consensus.cc:740] T 9eac649888d64d3b8f520993cb19b20e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:11.956403 21863 consensus_queue.cc:1048] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:11.957028 21858 ts_tablet_manager.cc:1434] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:07:11.956560 21859 consensus_queue.cc:260] T 9eac649888d64d3b8f520993cb19b20e P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.958144 21858 tablet_bootstrap.cc:492] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:11.958732 21859 ts_tablet_manager.cc:1434] T 9eac649888d64d3b8f520993cb19b20e P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:11.959697 21859 tablet_bootstrap.cc:492] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:11.962352 21629 leader_election.cc:304] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:11.963187 21885 raft_consensus.cc:2804] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:11.963845 21885 raft_consensus.cc:697] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [term 2 LEADER]: Becoming Leader. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Running, Role: LEADER
I20260709 13:07:11.965790 21976 raft_consensus.cc:515] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:11.967233 21861 tablet_bootstrap.cc:492] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:11.967731 21861 ts_tablet_manager.cc:1403] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.182s	user 0.022s	sys 0.050s
I20260709 13:07:11.969420 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9932f1e440d442f8ab6ba25f33881d75" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:11.969627 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e501f94be841fbb110db3ac40ede77" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:11.970155 21591 raft_consensus.cc:3060] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:11.970458 21666 raft_consensus.cc:3060] T 43e501f94be841fbb110db3ac40ede77 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:11.971589 21858 tablet_bootstrap.cc:654] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:11.972306 21951 raft_consensus.cc:493] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.973179 21976 leader_election.cc:290] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Requested vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:11.972959 21951 raft_consensus.cc:515] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.973867 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e501f94be841fbb110db3ac40ede77" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:11.974469 21814 raft_consensus.cc:3060] T 43e501f94be841fbb110db3ac40ede77 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:11.976329 21951 leader_election.cc:290] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:11.977006 21976 raft_consensus.cc:493] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.964952 21885 consensus_queue.cc:237] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.977448 21976 raft_consensus.cc:515] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.978014 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22735fa400464e149fa2d7263a8bd58a" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:11.978691 21740 raft_consensus.cc:2468] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 0.
I20260709 13:07:11.980142 21554 leader_election.cc:304] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: 
I20260709 13:07:11.981210 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cbb2559034cf7b35ecfe777ae620c" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:11.981906 21588 raft_consensus.cc:2468] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 0.
I20260709 13:07:11.937623 21488 catalog_manager.cc:5697] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:11.983063 21814 raft_consensus.cc:2468] T 43e501f94be841fbb110db3ac40ede77 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 1.
I20260709 13:07:11.983601 21951 raft_consensus.cc:2804] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:11.984030 21951 raft_consensus.cc:493] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:11.984364 21951 raft_consensus.cc:3060] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:11.985117 21916 raft_consensus.cc:493] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:11.986614 21861 raft_consensus.cc:359] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:11.988623 21861 raft_consensus.cc:385] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:11.985765 21916 raft_consensus.cc:515] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:12.001328 21916 leader_election.cc:290] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:11.986174 21704 leader_election.cc:304] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: 
I20260709 13:07:12.002543 21704 leader_election.cc:304] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:12.003540 21977 raft_consensus.cc:2804] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:12.003917 21977 raft_consensus.cc:493] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.004204 21928 raft_consensus.cc:2804] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:11.991667 21860 raft_consensus.cc:359] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:11.992583 21861 raft_consensus.cc:740] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:12.005259 21860 raft_consensus.cc:385] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:12.005716 21860 raft_consensus.cc:740] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:12.006043 21859 tablet_bootstrap.cc:654] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:12.002566 21591 raft_consensus.cc:2468] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 2.
I20260709 13:07:12.004257 21977 raft_consensus.cc:3060] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:12.011936 21861 consensus_queue.cc:260] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:12.014149 21923 consensus_queue.cc:1048] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:12.016642 21666 raft_consensus.cc:2468] T 43e501f94be841fbb110db3ac40ede77 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 1.
I20260709 13:07:12.018111 21860 consensus_queue.cc:260] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:12.021955 21951 raft_consensus.cc:515] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:12.027953 21863 raft_consensus.cc:493] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.020429 21665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22735fa400464e149fa2d7263a8bd58a" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:12.029801 21863 raft_consensus.cc:515] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:12.027503 21589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e46f3f1221a4fedac36e2252b8f2a34" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
W20260709 13:07:12.033887 21778 leader_election.cc:343] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.030084 21665 raft_consensus.cc:2468] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 0.
I20260709 13:07:12.034556 21863 leader_election.cc:290] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:12.041265 21977 raft_consensus.cc:515] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:12.045073 21861 ts_tablet_manager.cc:1434] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.002s
I20260709 13:07:12.046906 21861 tablet_bootstrap.cc:492] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:12.047194 21591 raft_consensus.cc:3060] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:12.049472 21916 raft_consensus.cc:493] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.050004 21916 raft_consensus.cc:515] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:12.050395 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cbb2559034cf7b35ecfe777ae620c" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
W20260709 13:07:12.052794 21704 leader_election.cc:343] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.053020 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8900bbb09a964e26aaab011b218c8f11" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:12.053220 21916 leader_election.cc:290] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:12.053741 21976 leader_election.cc:290] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:12.053810 21740 raft_consensus.cc:2468] T 8900bbb09a964e26aaab011b218c8f11 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:12.054430 21590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8900bbb09a964e26aaab011b218c8f11" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:12.054554 21951 leader_election.cc:290] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Requested vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:12.056151 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22735fa400464e149fa2d7263a8bd58a" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:12.045706 21589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cbb2559034cf7b35ecfe777ae620c" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:12.070644 21860 ts_tablet_manager.cc:1434] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.125s	user 0.005s	sys 0.002s
I20260709 13:07:12.028862 21928 raft_consensus.cc:697] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Running, Role: LEADER
I20260709 13:07:12.030851 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e46f3f1221a4fedac36e2252b8f2a34" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:12.074383 21860 tablet_bootstrap.cc:492] T 5c7c65eed72a42d0a91f36c764de4abb P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:12.058342 21923 consensus_queue.cc:1048] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:07:12.075048 21739 raft_consensus.cc:3060] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:12.079520 21777 leader_election.cc:304] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:12.076246 21589 raft_consensus.cc:3060] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:12.082456 21928 consensus_queue.cc:237] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:12.084249 21867 raft_consensus.cc:2804] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:12.086302 21867 raft_consensus.cc:493] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.086712 21867 raft_consensus.cc:3060] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:12.081916 22009 raft_consensus.cc:493] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.088171 22009 raft_consensus.cc:515] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:12.078114 21737 raft_consensus.cc:2468] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:12.094549 21485 catalog_manager.cc:5697] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 reported cstate change: term changed from 0 to 2, leader changed from <none> to bed294de06e24ca4aba572ec722d2567 (127.11.44.194). New cstate: current_term: 2 leader_uuid: "bed294de06e24ca4aba572ec722d2567" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:12.095319 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cbb2559034cf7b35ecfe777ae620c" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
W20260709 13:07:12.096977 21704 leader_election.cc:343] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:12.085548 21778 leader_election.cc:343] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:12.089035 21555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:41173, user_credentials={real_user=slave}} blocked reactor thread for 58557us
I20260709 13:07:12.093447 21977 leader_election.cc:290] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:12.111939 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f2d007d6e54bb3be541d9bbde02eca" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:12.113158 21666 raft_consensus.cc:2393] T a2f2d007d6e54bb3be541d9bbde02eca P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f1fa49d04344067941ffd03d9e7d48c in current term 1: Already voted for candidate b8c58d9f32b84e5bb79e2751ac41cdba in this term.
I20260709 13:07:12.114748 21859 tablet_bootstrap.cc:492] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:12.114651 21777 leader_election.cc:304] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:12.115294 21859 ts_tablet_manager.cc:1403] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.156s	user 0.031s	sys 0.030s
I20260709 13:07:12.117460 21916 raft_consensus.cc:2804] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:12.118013 21916 raft_consensus.cc:493] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.118391 21916 raft_consensus.cc:3060] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:12.118103 21859 raft_consensus.cc:359] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:12.118966 21859 raft_consensus.cc:385] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:12.119290 21859 raft_consensus.cc:740] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:12.119968 21859 consensus_queue.cc:260] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:12.122466 21859 ts_tablet_manager.cc:1434] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:12.123445 21859 tablet_bootstrap.cc:492] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:12.128024 21860 tablet_bootstrap.cc:654] T 5c7c65eed72a42d0a91f36c764de4abb P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:12.128731 21923 raft_consensus.cc:493] T 9eac649888d64d3b8f520993cb19b20e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.128839 22009 leader_election.cc:290] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:12.134532 21739 raft_consensus.cc:2468] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 1.
W20260709 13:07:12.135389 22007 log.cc:927] Time spent T ce5f20a869e24ab78d7677bc08d45963 P 3e8f84032ed948908dc7fcffcfe2d6e5: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 13:07:12.141758 21554 leader_election.cc:304] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: 
I20260709 13:07:12.135869 21858 tablet_bootstrap.cc:492] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:12.136431 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e7302faa874a2f874d979ae54331f3" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:12.142890 22018 raft_consensus.cc:2804] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:12.143412 22018 raft_consensus.cc:697] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:12.137040 21923 raft_consensus.cc:515] T 9eac649888d64d3b8f520993cb19b20e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:12.144277 22018 consensus_queue.cc:237] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:12.142899 21858 ts_tablet_manager.cc:1403] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.185s	user 0.012s	sys 0.006s
W20260709 13:07:12.150173 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:35255, user_credentials={real_user=slave}} blocked reactor thread for 69477.4us
I20260709 13:07:12.154803 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eac649888d64d3b8f520993cb19b20e" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:12.154803 21976 raft_consensus.cc:493] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.146559 21923 leader_election.cc:290] T 9eac649888d64d3b8f520993cb19b20e P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:12.156342 21976 raft_consensus.cc:515] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:12.157032 21858 raft_consensus.cc:359] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:12.157745 21858 raft_consensus.cc:385] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:12.158017 21858 raft_consensus.cc:740] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:12.158479 21976 leader_election.cc:290] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:12.158674 21858 consensus_queue.cc:260] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:12.137362 21859 tablet_bootstrap.cc:654] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:12.160846 21664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eac649888d64d3b8f520993cb19b20e" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:12.160900 21858 ts_tablet_manager.cc:1434] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.000s
I20260709 13:07:12.165266 21858 tablet_bootstrap.cc:492] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
W20260709 13:07:12.165933 21704 leader_election.cc:343] T 9eac649888d64d3b8f520993cb19b20e P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.166602 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2f2d007d6e54bb3be541d9bbde02eca" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:12.167773 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61ea1b37f4399a62f791777f0f481" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:12.168593 21918 consensus_queue.cc:1048] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:12.171169 21589 raft_consensus.cc:2468] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 1.
I20260709 13:07:12.177587 21858 tablet_bootstrap.cc:654] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:12.177934 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61ea1b37f4399a62f791777f0f481" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:12.178117 21918 consensus_queue.cc:1048] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:12.178781 21666 raft_consensus.cc:2468] T e6f61ea1b37f4399a62f791777f0f481 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 0.
I20260709 13:07:12.182062 21704 leader_election.cc:304] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:12.185178 21861 tablet_bootstrap.cc:654] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:12.186304 21923 raft_consensus.cc:2804] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:07:12.191984 21704 leader_election.cc:343] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.192934 21663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22735fa400464e149fa2d7263a8bd58a" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:12.191298 21867 raft_consensus.cc:515] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:12.208143 21923 raft_consensus.cc:697] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Running, Role: LEADER
I20260709 13:07:12.198154 21916 raft_consensus.cc:515] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:12.223909 21858 tablet_bootstrap.cc:492] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:12.224690 21858 ts_tablet_manager.cc:1403] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.005s
I20260709 13:07:12.229132 21916 leader_election.cc:290] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:12.231063 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e46f3f1221a4fedac36e2252b8f2a34" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:12.231779 21738 raft_consensus.cc:3060] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:12.233911 21704 leader_election.cc:343] T 9eac649888d64d3b8f520993cb19b20e P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.234594 21704 leader_election.cc:304] T 9eac649888d64d3b8f520993cb19b20e P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:12.236928 21923 consensus_queue.cc:237] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:12.243518 22017 raft_consensus.cc:493] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.243676 21555 leader_election.cc:304] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:12.244230 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e46f3f1221a4fedac36e2252b8f2a34" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:12.244128 22017 raft_consensus.cc:515] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:12.219129 21663 raft_consensus.cc:3060] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:12.246922 21664 raft_consensus.cc:3060] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:12.248898 22017 leader_election.cc:290] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:12.250169 21858 raft_consensus.cc:359] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:12.251986 21858 raft_consensus.cc:385] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:12.252321 21858 raft_consensus.cc:740] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:12.253023 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8900bbb09a964e26aaab011b218c8f11" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:12.252957 21858 consensus_queue.cc:260] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:12.253660 21739 raft_consensus.cc:3060] T 8900bbb09a964e26aaab011b218c8f11 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:12.254614 21858 ts_tablet_manager.cc:1434] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:07:12.255548 21858 tablet_bootstrap.cc:492] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:12.259434 21976 raft_consensus.cc:2749] T 9eac649888d64d3b8f520993cb19b20e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:12.271838 22017 raft_consensus.cc:2749] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:12.272042 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e7302faa874a2f874d979ae54331f3" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:12.288122 21859 tablet_bootstrap.cc:492] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:12.288630 21859 ts_tablet_manager.cc:1403] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.165s	user 0.011s	sys 0.008s
I20260709 13:07:12.282754 21867 leader_election.cc:290] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:12.294201 21662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc8f1a9d5ce413cb159ae69ce846c06" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:12.297067 21738 raft_consensus.cc:2468] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:12.282413 21928 consensus_queue.cc:1048] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
W20260709 13:07:12.289628 21778 leader_election.cc:343] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.308832 21860 tablet_bootstrap.cc:492] T 5c7c65eed72a42d0a91f36c764de4abb P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:12.309417 21860 ts_tablet_manager.cc:1403] T 5c7c65eed72a42d0a91f36c764de4abb P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.236s	user 0.026s	sys 0.012s
I20260709 13:07:12.312556 21630 leader_election.cc:304] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:12.315507 21739 raft_consensus.cc:2468] T 8900bbb09a964e26aaab011b218c8f11 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:12.316290 21777 leader_election.cc:304] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:12.319034 21859 raft_consensus.cc:359] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:12.319669 21859 raft_consensus.cc:385] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:12.321738 22017 raft_consensus.cc:493] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.322062 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8900bbb09a964e26aaab011b218c8f11" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:12.322854 21591 raft_consensus.cc:3060] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:12.323758 22019 log.cc:927] Time spent T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:07:12.325814 22009 raft_consensus.cc:2749] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:12.326133 22025 raft_consensus.cc:2804] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:12.326542 21777 leader_election.cc:304] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:12.322497 22017 raft_consensus.cc:515] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:12.319928 21859 raft_consensus.cc:740] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:12.302911 21704 leader_election.cc:304] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: b8c58d9f32b84e5bb79e2751ac41cdba
W20260709 13:07:12.341332 21555 leader_election.cc:343] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.343370 21863 consensus_queue.cc:1048] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:12.346930 21928 raft_consensus.cc:2804] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:12.348729 21928 raft_consensus.cc:493] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.349128 21928 raft_consensus.cc:3060] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:12.350047 22017 leader_election.cc:290] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:12.336671 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc8f1a9d5ce413cb159ae69ce846c06" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:12.351097 21813 raft_consensus.cc:2468] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 0.
I20260709 13:07:12.347492 21918 raft_consensus.cc:2804] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:12.350924 21591 raft_consensus.cc:2468] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:12.347922 21859 consensus_queue.cc:260] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
W20260709 13:07:12.353399 22024 log.cc:927] Time spent T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:12.347275 22025 raft_consensus.cc:697] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
W20260709 13:07:12.352504 21704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:35853, user_credentials={real_user=slave}} blocked reactor thread for 60806.3us
I20260709 13:07:12.358629 21858 tablet_bootstrap.cc:654] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:12.359689 21859 ts_tablet_manager.cc:1434] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.000s
I20260709 13:07:12.360729 21859 tablet_bootstrap.cc:492] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:12.371048 21928 raft_consensus.cc:515] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:12.373495 21928 leader_election.cc:290] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Requested vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:12.375241 21859 tablet_bootstrap.cc:654] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:12.359157 21486 catalog_manager.cc:5697] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 1 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:12.389760 21663 raft_consensus.cc:2468] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 1.
I20260709 13:07:12.390350 21662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61ea1b37f4399a62f791777f0f481" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:12.395912 21662 raft_consensus.cc:3060] T e6f61ea1b37f4399a62f791777f0f481 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:12.392575 21861 tablet_bootstrap.cc:492] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:12.397936 21861 ts_tablet_manager.cc:1403] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.351s	user 0.008s	sys 0.008s
I20260709 13:07:12.398384 21555 leader_election.cc:304] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:12.400205 22017 raft_consensus.cc:2804] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:12.400691 22017 raft_consensus.cc:493] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.400588 21861 raft_consensus.cc:359] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:12.392113 22025 consensus_queue.cc:237] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:12.401265 22017 raft_consensus.cc:3060] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:12.394492 21860 raft_consensus.cc:359] T 5c7c65eed72a42d0a91f36c764de4abb P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:12.409749 21860 raft_consensus.cc:385] T 5c7c65eed72a42d0a91f36c764de4abb P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:12.410066 21860 raft_consensus.cc:740] T 5c7c65eed72a42d0a91f36c764de4abb P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:12.401320 21861 raft_consensus.cc:385] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:12.410786 21861 raft_consensus.cc:740] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:12.413283 21860 consensus_queue.cc:260] T 5c7c65eed72a42d0a91f36c764de4abb P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:12.417681 21861 consensus_queue.cc:260] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:12.419134 21663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0beed3c60054461a60991c48b418bfc" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:12.421216 21860 ts_tablet_manager.cc:1434] T 5c7c65eed72a42d0a91f36c764de4abb P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.111s	user 0.008s	sys 0.000s
I20260709 13:07:12.409430 21662 raft_consensus.cc:2468] T e6f61ea1b37f4399a62f791777f0f481 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 1.
I20260709 13:07:12.426699 21704 leader_election.cc:304] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:12.427536 21869 raft_consensus.cc:2804] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:12.428931 21861 ts_tablet_manager.cc:1434] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:07:12.429989 21861 tablet_bootstrap.cc:492] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:12.429194 21885 raft_consensus.cc:493] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.431403 21869 raft_consensus.cc:697] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Running, Role: LEADER
W20260709 13:07:12.443341 21555 leader_election.cc:343] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:12.432085 21777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:46013, user_credentials={real_user=slave}} blocked reactor thread for 89868.5us
W20260709 13:07:12.431025 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:35255, user_credentials={real_user=slave}} blocked reactor thread for 73310us
I20260709 13:07:12.448038 21860 tablet_bootstrap.cc:492] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:12.440325 21918 raft_consensus.cc:697] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:12.461062 21861 tablet_bootstrap.cc:654] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:12.461858 21918 consensus_queue.cc:237] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:12.463824 21589 raft_consensus.cc:1275] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Refusing update from remote peer bed294de06e24ca4aba572ec722d2567: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:12.474974 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61ea1b37f4399a62f791777f0f481" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:12.477037 21976 raft_consensus.cc:493] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.460740 22017 raft_consensus.cc:515] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:12.444823 21885 raft_consensus.cc:515] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:12.481606 21869 consensus_queue.cc:237] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:12.480194 21968 consensus_queue.cc:1048] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:07:12.482069 21487 catalog_manager.cc:5697] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:12.488021 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0beed3c60054461a60991c48b418bfc" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:12.480221 21976 raft_consensus.cc:515] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:12.501888 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d9076de054deca6b7548e13c39a3b" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
W20260709 13:07:12.491374 21704 leader_election.cc:343] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.507473 21858 tablet_bootstrap.cc:492] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:12.508003 21858 ts_tablet_manager.cc:1403] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.253s	user 0.017s	sys 0.005s
W20260709 13:07:12.506018 21630 leader_election.cc:343] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.514443 21885 leader_election.cc:290] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:12.516234 21860 tablet_bootstrap.cc:654] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:12.516785 21664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc8f1a9d5ce413cb159ae69ce846c06" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
W20260709 13:07:12.518298 21555 leader_election.cc:343] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.514251 21858 raft_consensus.cc:359] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:12.514639 21923 consensus_queue.cc:1048] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:12.515666 22017 leader_election.cc:290] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:12.522110 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d9076de054deca6b7548e13c39a3b" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:12.522847 21858 raft_consensus.cc:385] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:12.523830 21976 leader_election.cc:290] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:12.526782 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8f2bbfbe0c49d8921f09a4a4e4875e" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:12.527568 21664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8f2bbfbe0c49d8921f09a4a4e4875e" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
W20260709 13:07:12.529103 21704 leader_election.cc:343] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:12.530092 21704 leader_election.cc:343] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.523241 21858 raft_consensus.cc:740] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:12.532320 21858 consensus_queue.cc:260] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
W20260709 13:07:12.535132 21555 leader_election.cc:343] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.535699 21555 leader_election.cc:304] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567
W20260709 13:07:12.536461 21629 leader_election.cc:343] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.536980 22017 raft_consensus.cc:2749] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:12.537045 21629 leader_election.cc:304] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:12.538178 21738 raft_consensus.cc:1275] T 9932f1e440d442f8ab6ba25f33881d75 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Refusing update from remote peer bed294de06e24ca4aba572ec722d2567: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:12.541661 21704 leader_election.cc:304] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:12.545631 22017 raft_consensus.cc:493] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.546326 22017 raft_consensus.cc:515] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:12.547060 21923 raft_consensus.cc:2749] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:12.548789 22017 leader_election.cc:290] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:12.541112 22025 raft_consensus.cc:493] T 5c7c65eed72a42d0a91f36c764de4abb P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.550415 22025 raft_consensus.cc:515] T 5c7c65eed72a42d0a91f36c764de4abb P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:12.551383 21664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac5258f941c4bdbb2ba4e33a4eaca08" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:12.554018 21858 ts_tablet_manager.cc:1434] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 13:07:12.552670 21968 raft_consensus.cc:2749] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:12.558635 21858 tablet_bootstrap.cc:492] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:12.557437 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc8f1a9d5ce413cb159ae69ce846c06" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:12.560274 21814 raft_consensus.cc:3060] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:12.560619 22025 leader_election.cc:290] T 5c7c65eed72a42d0a91f36c764de4abb P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:12.564498 22025 raft_consensus.cc:493] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.565140 22025 raft_consensus.cc:515] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:12.565738 21861 tablet_bootstrap.cc:492] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:12.566582 21861 ts_tablet_manager.cc:1403] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.137s	user 0.024s	sys 0.007s
I20260709 13:07:12.568136 22025 leader_election.cc:290] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:12.572193 21861 raft_consensus.cc:359] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:12.574115 21858 tablet_bootstrap.cc:654] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:12.576195 21859 tablet_bootstrap.cc:492] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:12.577428 21885 consensus_queue.cc:1048] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:12.583546 21859 ts_tablet_manager.cc:1403] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.223s	user 0.016s	sys 0.006s
I20260709 13:07:12.586484 21859 raft_consensus.cc:359] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:12.586624 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7c65eed72a42d0a91f36c764de4abb" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:12.587246 21859 raft_consensus.cc:385] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:12.587689 21859 raft_consensus.cc:740] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:12.588380 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10699d4b9f347c783a7a00bb6cd772c" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:12.588639 21859 consensus_queue.cc:260] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:12.589314 21737 raft_consensus.cc:2468] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:12.592489 21859 ts_tablet_manager.cc:1434] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:07:12.593935 21859 tablet_bootstrap.cc:492] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
W20260709 13:07:12.580651 21555 leader_election.cc:343] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.580323 21976 consensus_queue.cc:1048] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
W20260709 13:07:12.596252 21777 leader_election.cc:343] T 5c7c65eed72a42d0a91f36c764de4abb P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.604278 21777 leader_election.cc:304] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:12.607666 21861 raft_consensus.cc:385] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:12.609066 21861 raft_consensus.cc:740] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:12.618813 21861 consensus_queue.cc:260] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:12.622599 21860 tablet_bootstrap.cc:492] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:12.623358 21860 ts_tablet_manager.cc:1403] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.176s	user 0.022s	sys 0.000s
I20260709 13:07:12.608381 22025 raft_consensus.cc:2804] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:12.625599 22025 raft_consensus.cc:493] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.625921 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac5258f941c4bdbb2ba4e33a4eaca08" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:12.633323 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7c65eed72a42d0a91f36c764de4abb" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:12.635658 21814 raft_consensus.cc:2468] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 1.
I20260709 13:07:12.635567 21663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10699d4b9f347c783a7a00bb6cd772c" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:12.636458 21663 raft_consensus.cc:2468] T d10699d4b9f347c783a7a00bb6cd772c P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:12.636668 21976 raft_consensus.cc:493] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.637203 21976 raft_consensus.cc:515] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:12.639376 21976 leader_election.cc:290] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
W20260709 13:07:12.639451 21778 leader_election.cc:343] T 5c7c65eed72a42d0a91f36c764de4abb P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.640019 21778 leader_election.cc:304] T 5c7c65eed72a42d0a91f36c764de4abb P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:12.641196 22036 raft_consensus.cc:2749] T 5c7c65eed72a42d0a91f36c764de4abb P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:12.625968 22025 raft_consensus.cc:3060] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:12.643039 21555 leader_election.cc:343] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.643675 21555 leader_election.cc:304] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:12.644757 21860 raft_consensus.cc:359] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:12.644909 21863 consensus_queue.cc:1048] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:12.645532 21860 raft_consensus.cc:385] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:12.646070 21860 raft_consensus.cc:740] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:12.646826 21863 raft_consensus.cc:2749] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:12.648336 21861 ts_tablet_manager.cc:1434] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.000s
I20260709 13:07:12.648536 21555 leader_election.cc:304] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:12.649408 21861 tablet_bootstrap.cc:492] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:12.658265 21663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07198040872480db2c3b210d75e8c26" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:12.659003 21663 raft_consensus.cc:2468] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 0.
I20260709 13:07:12.659919 22025 raft_consensus.cc:515] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:12.660715 21704 leader_election.cc:304] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:12.661729 21858 tablet_bootstrap.cc:492] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:12.661662 21923 raft_consensus.cc:2804] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:12.662197 21923 raft_consensus.cc:493] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.662598 21923 raft_consensus.cc:3060] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:12.664062 21859 tablet_bootstrap.cc:654] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:12.652289 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07198040872480db2c3b210d75e8c26" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:12.665284 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10699d4b9f347c783a7a00bb6cd772c" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:12.665758 22025 leader_election.cc:290] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 election: Requested vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:12.666002 21738 raft_consensus.cc:3060] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:12.666914 21704 leader_election.cc:343] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.664942 21860 consensus_queue.cc:260] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:12.672243 21923 raft_consensus.cc:515] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:12.673918 21738 raft_consensus.cc:2468] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 2.
I20260709 13:07:12.674069 22017 raft_consensus.cc:2804] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:12.674579 22017 raft_consensus.cc:697] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:12.662293 21858 ts_tablet_manager.cc:1403] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.107s	user 0.010s	sys 0.005s
I20260709 13:07:12.675793 21976 raft_consensus.cc:493] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.676297 21976 raft_consensus.cc:515] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:12.678339 21976 leader_election.cc:290] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:12.679414 22017 consensus_queue.cc:237] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:12.680734 21860 ts_tablet_manager.cc:1434] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.057s	user 0.003s	sys 0.005s
I20260709 13:07:12.680984 21859 tablet_bootstrap.cc:492] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:12.683737 21859 ts_tablet_manager.cc:1403] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.090s	user 0.013s	sys 0.005s
I20260709 13:07:12.683578 21664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb99515c89d44c59276745ce3cbacd6" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:12.684326 21860 tablet_bootstrap.cc:492] T e6f61ea1b37f4399a62f791777f0f481 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:12.683183 21589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb99515c89d44c59276745ce3cbacd6" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:12.683138 21861 tablet_bootstrap.cc:654] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:12.687762 21859 raft_consensus.cc:359] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:12.688438 21859 raft_consensus.cc:385] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:12.688705 21859 raft_consensus.cc:740] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:12.689438 21859 consensus_queue.cc:260] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:12.690318 21777 leader_election.cc:304] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:12.691185 21918 raft_consensus.cc:2804] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:12.691720 21918 raft_consensus.cc:697] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:12.692265 21859 ts_tablet_manager.cc:1434] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:12.692621 21918 consensus_queue.cc:237] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:12.693252 21859 tablet_bootstrap.cc:492] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:12.699857 21860 tablet_bootstrap.cc:654] T e6f61ea1b37f4399a62f791777f0f481 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:12.700452 21859 tablet_bootstrap.cc:654] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:12.713471 21859 tablet_bootstrap.cc:492] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:12.713472 21861 tablet_bootstrap.cc:492] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:12.714298 21859 ts_tablet_manager.cc:1403] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
I20260709 13:07:12.714581 21861 ts_tablet_manager.cc:1403] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.005s
I20260709 13:07:12.717468 21859 raft_consensus.cc:359] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:12.717831 21861 raft_consensus.cc:359] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:12.719825 21861 raft_consensus.cc:385] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:12.720278 21861 raft_consensus.cc:740] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:12.718333 21859 raft_consensus.cc:385] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:12.722128 21859 raft_consensus.cc:740] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:12.722898 21859 consensus_queue.cc:260] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:12.721092 21861 consensus_queue.cc:260] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:12.726540 21861 ts_tablet_manager.cc:1434] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:07:12.728046 21861 tablet_bootstrap.cc:492] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:12.728613 21485 catalog_manager.cc:5697] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:12.727063 21859 ts_tablet_manager.cc:1434] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 13:07:12.730716 21859 tablet_bootstrap.cc:492] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:12.730768 21485 catalog_manager.cc:5697] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:12.734248 21863 consensus_queue.cc:1048] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:12.741135 21860 tablet_bootstrap.cc:492] T e6f61ea1b37f4399a62f791777f0f481 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:12.741847 21860 ts_tablet_manager.cc:1403] T e6f61ea1b37f4399a62f791777f0f481 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.000s
I20260709 13:07:12.745138 21860 raft_consensus.cc:359] T e6f61ea1b37f4399a62f791777f0f481 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:12.749771 21860 raft_consensus.cc:385] T e6f61ea1b37f4399a62f791777f0f481 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:12.750092 21860 raft_consensus.cc:740] T e6f61ea1b37f4399a62f791777f0f481 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:12.750950 21860 consensus_queue.cc:260] T e6f61ea1b37f4399a62f791777f0f481 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:12.752038 21861 tablet_bootstrap.cc:654] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:12.753104 21860 ts_tablet_manager.cc:1434] T e6f61ea1b37f4399a62f791777f0f481 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:07:12.754356 21860 tablet_bootstrap.cc:492] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:12.749341 21859 tablet_bootstrap.cc:654] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:12.758725 21704 leader_election.cc:343] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:12.759307 21704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:35853, user_credentials={real_user=slave}} blocked reactor thread for 48610.1us
I20260709 13:07:12.769114 21860 tablet_bootstrap.cc:654] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:12.776844 21858 raft_consensus.cc:359] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:12.777671 21858 raft_consensus.cc:385] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:12.777972 21858 raft_consensus.cc:740] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:12.778427 22018 raft_consensus.cc:493] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:12.779207 21537 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:12.779042 22018 raft_consensus.cc:515] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:12.782553 22018 leader_election.cc:290] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:12.782789 21860 tablet_bootstrap.cc:492] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:12.783567 21860 ts_tablet_manager.cc:1403] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.000s
I20260709 13:07:12.784026 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d10699d4b9f347c783a7a00bb6cd772c" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:12.784565 21923 leader_election.cc:290] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:12.784756 21666 raft_consensus.cc:3060] T d10699d4b9f347c783a7a00bb6cd772c P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:12.792075 21858 consensus_queue.cc:260] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:12.787559 21860 raft_consensus.cc:359] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:12.794104 21860 raft_consensus.cc:385] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:12.794445 21858 ts_tablet_manager.cc:1434] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.119s	user 0.006s	sys 0.000s
I20260709 13:07:12.799232 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c540859ed0b48f1b7ed38ead0137a45" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:12.800117 21738 raft_consensus.cc:2468] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 0.
I20260709 13:07:12.801715 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c540859ed0b48f1b7ed38ead0137a45" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:12.794483 21860 raft_consensus.cc:740] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:12.810619 21860 consensus_queue.cc:260] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
W20260709 13:07:12.812860 21704 leader_election.cc:343] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.813375 21858 tablet_bootstrap.cc:492] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:12.813791 21488 catalog_manager.cc:5697] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 1 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:12.814881 21554 leader_election.cc:304] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: 
I20260709 13:07:12.815873 22017 raft_consensus.cc:2804] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:12.816272 22017 raft_consensus.cc:493] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.816666 22017 raft_consensus.cc:3060] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:12.813431 21704 leader_election.cc:304] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:12.821789 21976 raft_consensus.cc:2749] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:12.822727 21976 consensus_queue.cc:1048] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:12.824270 21860 ts_tablet_manager.cc:1434] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.003s
I20260709 13:07:12.834254 21859 tablet_bootstrap.cc:492] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:12.835033 21859 ts_tablet_manager.cc:1403] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.105s	user 0.025s	sys 0.031s
I20260709 13:07:12.835129 21860 tablet_bootstrap.cc:492] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:12.838838 21859 raft_consensus.cc:359] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:12.839839 21859 raft_consensus.cc:385] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:12.843134 21858 tablet_bootstrap.cc:654] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:12.840190 21859 raft_consensus.cc:740] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:12.847298 21859 consensus_queue.cc:260] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:12.848500 21918 consensus_queue.cc:1048] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:07:12.854242 21859 ts_tablet_manager.cc:1434] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.001s
I20260709 13:07:12.858204 22017 raft_consensus.cc:515] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:12.865062 21859 tablet_bootstrap.cc:492] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:12.879397 21664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07198040872480db2c3b210d75e8c26" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:12.880086 21664 raft_consensus.cc:3060] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:12.881524 21923 raft_consensus.cc:493] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.882337 21923 raft_consensus.cc:515] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:12.884037 21860 tablet_bootstrap.cc:654] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:12.884377 21923 leader_election.cc:290] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:12.885129 21589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07198040872480db2c3b210d75e8c26" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
W20260709 13:07:12.881605 21704 consensus_peers.cc:597] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:12.891098 21923 consensus_queue.cc:1048] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:12.894210 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "638d06604bc042cf8e846b13dbe634e7" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:12.892094 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c540859ed0b48f1b7ed38ead0137a45" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:12.894845 21859 tablet_bootstrap.cc:654] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:12.895092 21737 raft_consensus.cc:3060] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:12.898200 21861 tablet_bootstrap.cc:492] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:12.898598 22030 raft_consensus.cc:493] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.887377 22017 leader_election.cc:290] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
W20260709 13:07:12.870713 21555 leader_election.cc:343] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.887995 21664 raft_consensus.cc:2468] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 1.
I20260709 13:07:12.898706 21861 ts_tablet_manager.cc:1403] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.171s	user 0.037s	sys 0.066s
I20260709 13:07:12.873718 21666 raft_consensus.cc:2468] T d10699d4b9f347c783a7a00bb6cd772c P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 2.
I20260709 13:07:12.887683 21485 catalog_manager.cc:5697] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 1 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:12.899891 21704 leader_election.cc:343] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:12.909488 21704 leader_election.cc:343] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.909870 21663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "638d06604bc042cf8e846b13dbe634e7" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:12.907866 21860 tablet_bootstrap.cc:492] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:12.910830 21860 ts_tablet_manager.cc:1403] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.085s	user 0.013s	sys 0.000s
I20260709 13:07:12.904214 22030 raft_consensus.cc:515] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:12.913980 22030 leader_election.cc:290] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
W20260709 13:07:12.914239 21704 leader_election.cc:343] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.914741 21704 leader_election.cc:304] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:12.915879 21704 leader_election.cc:304] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:12.917450 21664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0beed3c60054461a60991c48b418bfc" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:12.937229 21861 raft_consensus.cc:359] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
W20260709 13:07:12.937909 21778 leader_election.cc:343] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.917721 21923 raft_consensus.cc:2749] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:12.938102 21861 raft_consensus.cc:385] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:12.940397 21861 raft_consensus.cc:740] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:12.913343 21885 raft_consensus.cc:493] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:12.941372 21861 consensus_queue.cc:260] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:12.942557 21885 raft_consensus.cc:515] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:12.943243 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0beed3c60054461a60991c48b418bfc" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:12.944087 21591 raft_consensus.cc:2468] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:12.944629 21861 ts_tablet_manager.cc:1434] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:07:12.944864 21885 leader_election.cc:290] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:12.946359 21861 tablet_bootstrap.cc:492] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:12.916932 21860 raft_consensus.cc:359] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:12.937389 21485 catalog_manager.cc:5697] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 1 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:12.950572 21778 leader_election.cc:304] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:12.951663 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eac649888d64d3b8f520993cb19b20e" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:12.917110 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c540859ed0b48f1b7ed38ead0137a45" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:12.953161 22030 raft_consensus.cc:2804] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:12.953778 22030 raft_consensus.cc:493] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.954238 22030 raft_consensus.cc:3060] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:12.938992 21928 raft_consensus.cc:2804] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:12.955641 21928 raft_consensus.cc:697] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Running, Role: LEADER
I20260709 13:07:12.956559 21928 consensus_queue.cc:237] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:12.958037 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eac649888d64d3b8f520993cb19b20e" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:12.958519 21860 raft_consensus.cc:385] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:12.958887 21860 raft_consensus.cc:740] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:12.958979 21738 raft_consensus.cc:2468] T 9eac649888d64d3b8f520993cb19b20e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 0.
I20260709 13:07:12.959657 21860 consensus_queue.cc:260] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:12.968897 21629 leader_election.cc:304] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
W20260709 13:07:12.967170 21555 leader_election.cc:343] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:12.961002 21737 raft_consensus.cc:2468] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 1.
I20260709 13:07:12.976058 21860 ts_tablet_manager.cc:1434] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.011s
I20260709 13:07:12.976099 21968 raft_consensus.cc:2804] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:12.982555 21860 tablet_bootstrap.cc:492] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
W20260709 13:07:12.974566 21630 leader_election.cc:343] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:12.987625 21778 consensus_peers.cc:597] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:12.988270 22036 consensus_queue.cc:1048] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:12.989657 21554 leader_election.cc:304] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:12.981400 21968 raft_consensus.cc:493] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:12.990589 21968 raft_consensus.cc:3060] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:12.990942 22018 raft_consensus.cc:2804] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:12.991537 22018 raft_consensus.cc:697] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:12.992372 22018 consensus_queue.cc:237] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:12.995597 21859 tablet_bootstrap.cc:492] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:12.996166 21859 ts_tablet_manager.cc:1403] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.132s	user 0.015s	sys 0.006s
I20260709 13:07:13.000211 21861 tablet_bootstrap.cc:654] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:13.002650 22030 raft_consensus.cc:515] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
W20260709 13:07:13.023183 21630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:41173, user_credentials={real_user=slave}} blocked reactor thread for 51908.3us
I20260709 13:07:13.028968 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0beed3c60054461a60991c48b418bfc" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:13.029925 21591 raft_consensus.cc:3060] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:13.033015 21968 raft_consensus.cc:515] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:13.036700 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eac649888d64d3b8f520993cb19b20e" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:13.039427 21859 raft_consensus.cc:359] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:13.040491 21859 raft_consensus.cc:385] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:13.040766 21859 raft_consensus.cc:740] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:13.041940 21859 consensus_queue.cc:260] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:13.045274 22036 consensus_queue.cc:1048] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:13.045907 21858 tablet_bootstrap.cc:492] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:13.046371 21858 ts_tablet_manager.cc:1403] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.233s	user 0.043s	sys 0.030s
W20260709 13:07:13.050781 21630 leader_election.cc:343] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:13.051551 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eac649888d64d3b8f520993cb19b20e" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:13.051795 21858 raft_consensus.cc:359] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:13.052449 21858 raft_consensus.cc:385] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:13.053807 21858 raft_consensus.cc:740] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:13.058336 21858 consensus_queue.cc:260] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:13.060791 21858 ts_tablet_manager.cc:1434] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 13:07:13.063339 21859 ts_tablet_manager.cc:1434] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.000s
I20260709 13:07:13.064690 21858 tablet_bootstrap.cc:492] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:13.041141 21968 leader_election.cc:290] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:13.052438 21738 raft_consensus.cc:3060] T 9eac649888d64d3b8f520993cb19b20e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:13.079403 21814 raft_consensus.cc:3060] T e6f61ea1b37f4399a62f791777f0f481 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:13.088157 21859 tablet_bootstrap.cc:492] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:13.095263 21860 tablet_bootstrap.cc:654] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:13.109781 21869 consensus_queue.cc:1048] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:13.090124 22030 leader_election.cc:290] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:13.096789 22017 raft_consensus.cc:493] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.134187 21738 raft_consensus.cc:2468] T 9eac649888d64d3b8f520993cb19b20e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 1.
I20260709 13:07:13.124418 22017 raft_consensus.cc:515] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:13.136538 21629 leader_election.cc:304] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:13.137063 21591 raft_consensus.cc:2468] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:13.138219 21885 raft_consensus.cc:2804] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:13.138808 21885 raft_consensus.cc:697] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 [term 1 LEADER]: Becoming Leader. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Running, Role: LEADER
I20260709 13:07:13.139751 21885 consensus_queue.cc:237] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:13.141345 21858 tablet_bootstrap.cc:654] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:13.150736 21859 tablet_bootstrap.cc:654] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:13.158062 21664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb99515c89d44c59276745ce3cbacd6" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:13.160840 22009 raft_consensus.cc:493] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.161911 21923 raft_consensus.cc:493] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.161834 22009 raft_consensus.cc:515] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:13.162839 21737 raft_consensus.cc:1275] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Refusing update from remote peer b8c58d9f32b84e5bb79e2751ac41cdba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:13.162598 21923 raft_consensus.cc:515] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:13.164898 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb99515c89d44c59276745ce3cbacd6" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:13.165712 21739 raft_consensus.cc:2468] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 0.
I20260709 13:07:13.166920 21554 leader_election.cc:304] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: 
I20260709 13:07:13.138240 22017 leader_election.cc:290] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:13.170374 22018 raft_consensus.cc:2804] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:13.176740 22018 raft_consensus.cc:493] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.176786 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0beed3c60054461a60991c48b418bfc" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:13.177292 22018 raft_consensus.cc:3060] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:13.164916 21923 leader_election.cc:290] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:13.187134 21860 tablet_bootstrap.cc:492] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:13.187758 21860 ts_tablet_manager.cc:1403] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.208s	user 0.015s	sys 0.010s
I20260709 13:07:13.188632 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7c65eed72a42d0a91f36c764de4abb" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:13.189383 21813 raft_consensus.cc:2468] T 5c7c65eed72a42d0a91f36c764de4abb P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 0.
I20260709 13:07:13.186223 22036 raft_consensus.cc:493] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.190639 22036 raft_consensus.cc:515] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:13.190788 21860 raft_consensus.cc:359] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:13.191522 21860 raft_consensus.cc:385] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:13.191812 21860 raft_consensus.cc:740] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:13.192546 21860 consensus_queue.cc:260] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:13.193429 22036 leader_election.cc:290] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:13.193954 21918 consensus_queue.cc:1048] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:13.194114 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14ed1ed549d47eb828017479cccdd42" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:13.196004 21704 leader_election.cc:304] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:13.185971 21778 leader_election.cc:304] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:13.200340 22009 leader_election.cc:290] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:13.204892 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14ed1ed549d47eb828017479cccdd42" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:13.211477 22018 raft_consensus.cc:515] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:13.216039 21861 tablet_bootstrap.cc:492] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:13.217799 21861 ts_tablet_manager.cc:1403] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.272s	user 0.022s	sys 0.000s
I20260709 13:07:13.223892 22018 leader_election.cc:290] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Requested vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:13.226388 21860 ts_tablet_manager.cc:1434] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.038s	user 0.018s	sys 0.009s
I20260709 13:07:13.219480 21918 raft_consensus.cc:2804] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:13.233129 22025 raft_consensus.cc:493] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.233889 21918 raft_consensus.cc:697] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:13.234033 22025 raft_consensus.cc:515] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:13.235370 21918 consensus_queue.cc:237] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:13.237286 22025 leader_election.cc:290] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:13.245224 21860 tablet_bootstrap.cc:492] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:13.244335 21861 raft_consensus.cc:359] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:13.244710 22030 raft_consensus.cc:493] T e6f61ea1b37f4399a62f791777f0f481 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.249004 22030 raft_consensus.cc:515] T e6f61ea1b37f4399a62f791777f0f481 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:13.254429 22030 leader_election.cc:290] T e6f61ea1b37f4399a62f791777f0f481 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:13.248072 21861 raft_consensus.cc:385] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:13.257217 21861 raft_consensus.cc:740] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:13.258524 21861 consensus_queue.cc:260] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:13.262025 21861 ts_tablet_manager.cc:1434] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.044s	user 0.011s	sys 0.000s
I20260709 13:07:13.269457 21858 tablet_bootstrap.cc:492] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:13.270669 21859 tablet_bootstrap.cc:492] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:13.270984 21858 ts_tablet_manager.cc:1403] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.209s	user 0.038s	sys 0.019s
I20260709 13:07:13.271432 21859 ts_tablet_manager.cc:1403] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.184s	user 0.026s	sys 0.029s
I20260709 13:07:13.271974 21861 tablet_bootstrap.cc:492] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:13.274104 21858 raft_consensus.cc:359] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:13.274856 21858 raft_consensus.cc:385] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:13.275161 21858 raft_consensus.cc:740] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:13.270349 21860 tablet_bootstrap.cc:654] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:13.275895 21859 raft_consensus.cc:359] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:13.276990 21859 raft_consensus.cc:385] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:13.277390 21859 raft_consensus.cc:740] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:13.278411 21859 consensus_queue.cc:260] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:13.280793 21861 tablet_bootstrap.cc:654] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:13.325290 21630 leader_election.cc:343] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:13.334482 21629 leader_election.cc:343] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:13.335171 21629 leader_election.cc:304] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba
W20260709 13:07:13.337005 21704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:41173, user_credentials={real_user=slave}} blocked reactor thread for 140892us
I20260709 13:07:13.344965 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb99515c89d44c59276745ce3cbacd6" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:13.275933 21858 consensus_queue.cc:260] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
W20260709 13:07:13.347118 21777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:46013, user_credentials={real_user=slave}} blocked reactor thread for 149745us
I20260709 13:07:13.346434 21923 raft_consensus.cc:493] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.349809 21859 ts_tablet_manager.cc:1434] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.078s	user 0.009s	sys 0.005s
I20260709 13:07:13.349588 21923 raft_consensus.cc:515] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:13.350962 21918 raft_consensus.cc:493] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.352559 21859 tablet_bootstrap.cc:492] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:13.352221 21918 raft_consensus.cc:515] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:13.361774 22018 consensus_queue.cc:1048] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:13.363883 21918 leader_election.cc:290] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:13.365721 21664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de835ccc085481aaf56e24e6b6a055f" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:13.365975 22009 raft_consensus.cc:2749] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:13.346474 21739 raft_consensus.cc:3060] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:13.367022 21664 raft_consensus.cc:2468] T 9de835ccc085481aaf56e24e6b6a055f P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:13.373413 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8f2bbfbe0c49d8921f09a4a4e4875e" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:13.373916 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61ea1b37f4399a62f791777f0f481" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:13.374622 21737 raft_consensus.cc:2468] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:13.376291 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7c65eed72a42d0a91f36c764de4abb" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:13.377367 21588 raft_consensus.cc:2468] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 0.
I20260709 13:07:13.378386 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de835ccc085481aaf56e24e6b6a055f" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:13.379276 21591 raft_consensus.cc:2468] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:13.381137 22071 raft_consensus.cc:493] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.382198 22071 raft_consensus.cc:515] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:13.355031 21869 raft_consensus.cc:2804] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:13.384414 21869 raft_consensus.cc:493] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.384812 21869 raft_consensus.cc:3060] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:13.397650 21860 tablet_bootstrap.cc:492] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:13.398671 21860 ts_tablet_manager.cc:1403] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.169s	user 0.013s	sys 0.004s
W20260709 13:07:13.405824 21778 leader_election.cc:343] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:13.407285 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841639e17c5d4724afe9494276ba00a3" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:13.407388 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb99515c89d44c59276745ce3cbacd6" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:13.408115 21777 leader_election.cc:304] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
W20260709 13:07:13.409554 21555 leader_election.cc:343] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:13.410619 21858 ts_tablet_manager.cc:1434] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.139s	user 0.009s	sys 0.001s
I20260709 13:07:13.411613 21976 consensus_queue.cc:1048] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:13.415536 22071 leader_election.cc:290] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:13.416597 22078 raft_consensus.cc:493] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.429714 22078 raft_consensus.cc:515] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:13.431354 21858 tablet_bootstrap.cc:492] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:13.429054 22030 raft_consensus.cc:2804] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:13.432200 22030 raft_consensus.cc:493] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.432632 22078 leader_election.cc:290] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:13.432677 22030 raft_consensus.cc:3060] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:13.449307 21863 consensus_queue.cc:1048] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:07:13.450476 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:35853, user_credentials={real_user=slave}} blocked reactor thread for 104965us
I20260709 13:07:13.453315 21923 leader_election.cc:290] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
W20260709 13:07:13.460446 21704 leader_election.cc:343] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:13.461493 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841639e17c5d4724afe9494276ba00a3" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:13.463583 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc8f1a9d5ce413cb159ae69ce846c06" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:13.459918 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e327a74ed0c544d28806d688941cd3f6" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:13.464802 21812 raft_consensus.cc:2393] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bed294de06e24ca4aba572ec722d2567 in current term 1: Already voted for candidate 3f1fa49d04344067941ffd03d9e7d48c in this term.
I20260709 13:07:13.465677 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e327a74ed0c544d28806d688941cd3f6" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:13.466114 21778 leader_election.cc:304] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:13.473078 21859 tablet_bootstrap.cc:654] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:13.473831 22036 raft_consensus.cc:2804] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:13.474390 22036 raft_consensus.cc:493] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.474840 22036 raft_consensus.cc:3060] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:13.482182 21704 consensus_peers.cc:597] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:13.482360 21666 raft_consensus.cc:3060] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:13.483037 21704 leader_election.cc:343] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:13.483220 21664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8f2bbfbe0c49d8921f09a4a4e4875e" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
W20260709 13:07:13.483768 21704 leader_election.cc:343] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:13.484301 21704 leader_election.cc:304] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:13.468796 21739 raft_consensus.cc:2468] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 1.
W20260709 13:07:13.470935 21555 leader_election.cc:343] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:13.486142 21928 raft_consensus.cc:2749] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:13.488224 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc8f1a9d5ce413cb159ae69ce846c06" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:13.489102 21858 tablet_bootstrap.cc:654] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:13.464864 21860 raft_consensus.cc:359] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:13.492887 21860 raft_consensus.cc:385] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:13.493268 21860 raft_consensus.cc:740] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:13.494079 21860 consensus_queue.cc:260] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:13.513082 21860 ts_tablet_manager.cc:1434] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.088s	user 0.007s	sys 0.003s
I20260709 13:07:13.515174 21860 tablet_bootstrap.cc:492] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:13.525040 21630 leader_election.cc:304] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:13.526850 21486 catalog_manager.cc:5697] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 1 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:13.527750 21662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6f61ea1b37f4399a62f791777f0f481" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:13.544090 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac5258f941c4bdbb2ba4e33a4eaca08" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:13.545063 21591 raft_consensus.cc:2468] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:13.537472 21869 raft_consensus.cc:515] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:13.562637 21662 raft_consensus.cc:1275] T d10699d4b9f347c783a7a00bb6cd772c P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Refusing update from remote peer b8c58d9f32b84e5bb79e2751ac41cdba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:13.563850 21860 tablet_bootstrap.cc:654] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:13.563910 21661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac5258f941c4bdbb2ba4e33a4eaca08" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
W20260709 13:07:13.580113 21630 consensus_peers.cc:597] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 -> Peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Couldn't send request to peer b8c58d9f32b84e5bb79e2751ac41cdba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:13.573997 21487 catalog_manager.cc:5697] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 0 to 2, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 2 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:13.573163 21778 leader_election.cc:304] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
W20260709 13:07:13.587384 21704 leader_election.cc:343] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:13.561861 22030 raft_consensus.cc:515] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:13.591979 22030 leader_election.cc:290] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:13.592864 22082 raft_consensus.cc:2804] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:13.593358 22082 raft_consensus.cc:493] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.593765 22082 raft_consensus.cc:3060] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:13.594866 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8f2bbfbe0c49d8921f09a4a4e4875e" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:13.595604 21738 raft_consensus.cc:3060] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:13.599040 21778 leader_election.cc:343] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:13.593044 21858 tablet_bootstrap.cc:492] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:13.601672 21858 ts_tablet_manager.cc:1403] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.171s	user 0.018s	sys 0.005s
I20260709 13:07:13.599599 21869 leader_election.cc:290] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:13.603502 21704 leader_election.cc:304] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:13.607542 21859 tablet_bootstrap.cc:492] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:13.608223 21859 ts_tablet_manager.cc:1403] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.257s	user 0.014s	sys 0.007s
I20260709 13:07:13.612303 22078 raft_consensus.cc:2749] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:13.612177 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7c65eed72a42d0a91f36c764de4abb" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:13.609433 21869 raft_consensus.cc:493] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.614655 21869 raft_consensus.cc:515] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:13.615556 21661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e8f2bbfbe0c49d8921f09a4a4e4875e" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:13.615792 21812 raft_consensus.cc:3060] T 5c7c65eed72a42d0a91f36c764de4abb P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:13.628109 21860 tablet_bootstrap.cc:492] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:13.601047 21778 leader_election.cc:304] T e6f61ea1b37f4399a62f791777f0f481 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:13.616815 22088 raft_consensus.cc:2749] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:13.634681 22030 raft_consensus.cc:2749] T e6f61ea1b37f4399a62f791777f0f481 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:13.635772 22025 consensus_queue.cc:1048] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:13.637723 22078 consensus_queue.cc:1048] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:07:13.638301 21778 leader_election.cc:343] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:13.619863 21554 leader_election.cc:304] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: bed294de06e24ca4aba572ec722d2567
W20260709 13:07:13.625411 21555 consensus_peers.cc:597] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c -> Peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Couldn't send request to peer b8c58d9f32b84e5bb79e2751ac41cdba. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:13.619273 21861 tablet_bootstrap.cc:492] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:13.633749 21860 ts_tablet_manager.cc:1403] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.119s	user 0.017s	sys 0.000s
I20260709 13:07:13.642583 21863 raft_consensus.cc:2804] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:13.640820 21858 raft_consensus.cc:359] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:13.643653 21858 raft_consensus.cc:385] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:13.644153 22018 consensus_queue.cc:1048] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:13.643916 21858 raft_consensus.cc:740] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:13.645507 21812 raft_consensus.cc:2468] T 5c7c65eed72a42d0a91f36c764de4abb P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 1.
I20260709 13:07:13.645691 21863 raft_consensus.cc:697] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:13.646915 21863 consensus_queue.cc:237] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:13.647202 21858 consensus_queue.cc:260] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:13.640318 21869 leader_election.cc:290] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:13.642078 21861 ts_tablet_manager.cc:1403] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.370s	user 0.033s	sys 0.017s
I20260709 13:07:13.650975 21860 raft_consensus.cc:359] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:13.651906 21860 raft_consensus.cc:385] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:13.652908 22036 raft_consensus.cc:515] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:13.654222 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c7c65eed72a42d0a91f36c764de4abb" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:13.654946 21588 raft_consensus.cc:3060] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:13.652218 21860 raft_consensus.cc:740] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:13.653142 21861 raft_consensus.cc:359] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:13.659493 21861 raft_consensus.cc:385] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:13.658109 22088 consensus_queue.cc:1048] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:07:13.661386 21860 consensus_queue.cc:260] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:13.660204 21861 raft_consensus.cc:740] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
W20260709 13:07:13.658859 21778 leader_election.cc:343] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:13.658214 22036 leader_election.cc:290] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:13.668097 21860 ts_tablet_manager.cc:1434] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:07:13.670360 21858 ts_tablet_manager.cc:1434] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.002s
I20260709 13:07:13.673381 21859 raft_consensus.cc:359] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:13.674768 21859 raft_consensus.cc:385] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:13.675084 21859 raft_consensus.cc:740] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:13.675971 21861 consensus_queue.cc:260] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:13.682090 21859 consensus_queue.cc:260] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:13.658738 22082 raft_consensus.cc:515] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:13.693501 21860 tablet_bootstrap.cc:492] T 9eac649888d64d3b8f520993cb19b20e P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:13.698240 21859 ts_tablet_manager.cc:1434] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.090s	user 0.011s	sys 0.000s
I20260709 13:07:13.700125 21858 tablet_bootstrap.cc:492] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:13.698899 22018 raft_consensus.cc:493] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.703104 21663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de835ccc085481aaf56e24e6b6a055f" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:13.707767 21738 raft_consensus.cc:2468] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:13.708716 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de835ccc085481aaf56e24e6b6a055f" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:13.709348 22082 leader_election.cc:290] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:13.709757 21859 tablet_bootstrap.cc:492] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:13.722339 21591 raft_consensus.cc:3060] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:13.716290 21861 ts_tablet_manager.cc:1434] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.001s
I20260709 13:07:13.719683 21885 raft_consensus.cc:493] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.725314 21885 raft_consensus.cc:515] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:13.720120 21663 raft_consensus.cc:3060] T 9de835ccc085481aaf56e24e6b6a055f P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:13.729132 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac5258f941c4bdbb2ba4e33a4eaca08" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:13.730057 21813 raft_consensus.cc:2393] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bed294de06e24ca4aba572ec722d2567 in current term 1: Already voted for candidate b8c58d9f32b84e5bb79e2751ac41cdba in this term.
I20260709 13:07:13.731308 21777 leader_election.cc:304] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:13.733397 22036 raft_consensus.cc:2804] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:13.733955 22036 raft_consensus.cc:697] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:13.734983 22036 consensus_queue.cc:237] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:13.720806 22018 raft_consensus.cc:515] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:13.738597 21588 raft_consensus.cc:2468] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 1.
I20260709 13:07:13.739607 21885 leader_election.cc:290] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:13.741163 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14ed1ed549d47eb828017479cccdd42" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:13.744200 22018 leader_election.cc:290] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:13.744477 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac5258f941c4bdbb2ba4e33a4eaca08" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:13.744771 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e327a74ed0c544d28806d688941cd3f6" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:13.745240 21588 raft_consensus.cc:2468] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 0.
I20260709 13:07:13.746595 21738 raft_consensus.cc:2468] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 0.
I20260709 13:07:13.753163 21630 leader_election.cc:304] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567; no voters: b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:13.754233 21885 raft_consensus.cc:2804] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:13.754556 21554 leader_election.cc:304] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: 
I20260709 13:07:13.754680 21885 raft_consensus.cc:493] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.755157 21885 raft_consensus.cc:3060] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:13.755308 22018 raft_consensus.cc:2804] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:13.755904 22018 raft_consensus.cc:493] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.756362 22018 raft_consensus.cc:3060] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:13.765957 21660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac5258f941c4bdbb2ba4e33a4eaca08" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:13.769670 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14ed1ed549d47eb828017479cccdd42" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:13.770731 21666 raft_consensus.cc:2468] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 0.
I20260709 13:07:13.780843 21858 tablet_bootstrap.cc:654] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:13.782608 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac5258f941c4bdbb2ba4e33a4eaca08" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:13.783329 21588 raft_consensus.cc:3060] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:13.783898 21591 raft_consensus.cc:2468] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:13.793524 21704 leader_election.cc:304] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: 
I20260709 13:07:13.802059 21663 raft_consensus.cc:2468] T 9de835ccc085481aaf56e24e6b6a055f P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:13.814545 21860 tablet_bootstrap.cc:654] T 9eac649888d64d3b8f520993cb19b20e P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:13.815501 21588 raft_consensus.cc:2468] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:13.816465 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e327a74ed0c544d28806d688941cd3f6" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:13.817111 21859 tablet_bootstrap.cc:654] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:13.817142 22025 raft_consensus.cc:493] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.818418 21666 raft_consensus.cc:3060] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:13.819743 22018 raft_consensus.cc:515] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:13.821164 21861 tablet_bootstrap.cc:492] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:13.824036 21923 raft_consensus.cc:2804] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:13.810310 21885 raft_consensus.cc:515] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:13.826076 22025 raft_consensus.cc:515] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:13.828655 21923 raft_consensus.cc:697] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Running, Role: LEADER
W20260709 13:07:13.829288 21704 leader_election.cc:343] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:13.832243 21923 consensus_queue.cc:237] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:13.833158 22025 leader_election.cc:290] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:13.835470 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c540859ed0b48f1b7ed38ead0137a45" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:13.837769 21778 leader_election.cc:304] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:13.838853 21589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c540859ed0b48f1b7ed38ead0137a45" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:13.839882 21704 leader_election.cc:304] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:13.841032 21869 raft_consensus.cc:2804] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:07:13.841259 21555 leader_election.cc:343] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:13.841413 21869 raft_consensus.cc:493] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.851418 21660 raft_consensus.cc:2393] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c58d9f32b84e5bb79e2751ac41cdba in current term 1: Already voted for candidate bed294de06e24ca4aba572ec722d2567 in this term.
I20260709 13:07:13.853329 22018 leader_election.cc:290] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:13.844048 21869 raft_consensus.cc:3060] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:13.862578 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e327a74ed0c544d28806d688941cd3f6" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:13.863371 21738 raft_consensus.cc:3060] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:13.846421 22025 raft_consensus.cc:2804] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:13.868973 22025 raft_consensus.cc:697] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:13.870280 22025 consensus_queue.cc:237] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:13.872608 21738 raft_consensus.cc:2468] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 1.
I20260709 13:07:13.874469 21554 leader_election.cc:304] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: 
I20260709 13:07:13.875731 22018 raft_consensus.cc:2804] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:13.876695 21858 tablet_bootstrap.cc:492] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:13.877281 21858 ts_tablet_manager.cc:1403] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.182s	user 0.018s	sys 0.000s
I20260709 13:07:13.876731 22018 raft_consensus.cc:697] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:13.883898 22018 consensus_queue.cc:237] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:13.904938 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac5258f941c4bdbb2ba4e33a4eaca08" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:13.919507 21812 raft_consensus.cc:2393] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bed294de06e24ca4aba572ec722d2567 in current term 1: Already voted for candidate b8c58d9f32b84e5bb79e2751ac41cdba in this term.
I20260709 13:07:13.923345 21858 raft_consensus.cc:359] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:13.924266 21858 raft_consensus.cc:385] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:13.924628 21858 raft_consensus.cc:740] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:13.928596 21488 catalog_manager.cc:5697] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 reported cstate change: term changed from 0 to 1, leader changed from <none> to bed294de06e24ca4aba572ec722d2567 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "bed294de06e24ca4aba572ec722d2567" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:13.905205 21537 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:13.906121 22009 raft_consensus.cc:493] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.882763 21778 leader_election.cc:304] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:13.939941 21860 tablet_bootstrap.cc:492] T 9eac649888d64d3b8f520993cb19b20e P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:13.884342 21869 raft_consensus.cc:515] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:13.941929 21860 ts_tablet_manager.cc:1403] T 9eac649888d64d3b8f520993cb19b20e P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.272s	user 0.018s	sys 0.003s
I20260709 13:07:13.944981 21885 leader_election.cc:290] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:13.942651 22009 raft_consensus.cc:515] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:13.946214 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac5258f941c4bdbb2ba4e33a4eaca08" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:13.947278 21591 raft_consensus.cc:2393] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bed294de06e24ca4aba572ec722d2567 in current term 1: Already voted for candidate b8c58d9f32b84e5bb79e2751ac41cdba in this term.
I20260709 13:07:13.948235 21860 raft_consensus.cc:359] T 9eac649888d64d3b8f520993cb19b20e P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:13.948685 21630 leader_election.cc:304] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:13.949048 21860 raft_consensus.cc:385] T 9eac649888d64d3b8f520993cb19b20e P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:13.949482 21860 raft_consensus.cc:740] T 9eac649888d64d3b8f520993cb19b20e P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:13.949636 22030 raft_consensus.cc:2804] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:13.950217 22030 raft_consensus.cc:697] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:13.950681 21885 raft_consensus.cc:2749] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:13.951195 22030 consensus_queue.cc:237] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:13.950728 21860 consensus_queue.cc:260] T 9eac649888d64d3b8f520993cb19b20e P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:13.953861 21858 consensus_queue.cc:260] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:13.957607 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0beed3c60054461a60991c48b418bfc" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:13.958101 22009 leader_election.cc:290] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:13.960688 21869 leader_election.cc:290] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Requested vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:13.961326 21859 tablet_bootstrap.cc:492] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:13.961856 21859 ts_tablet_manager.cc:1403] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.252s	user 0.017s	sys 0.025s
I20260709 13:07:13.964751 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14ed1ed549d47eb828017479cccdd42" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
W20260709 13:07:13.944180 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:35255, user_credentials={real_user=slave}} blocked reactor thread for 92396us
I20260709 13:07:13.966259 21778 leader_election.cc:304] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:13.967408 22082 raft_consensus.cc:2749] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:13.968807 21918 consensus_queue.cc:1048] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:13.968843 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0beed3c60054461a60991c48b418bfc" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:13.970031 21591 raft_consensus.cc:2468] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 1.
I20260709 13:07:13.970589 21859 raft_consensus.cc:359] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
W20260709 13:07:13.972134 21704 leader_election.cc:343] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:13.972456 21858 ts_tablet_manager.cc:1434] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.000s
I20260709 13:07:13.971431 21859 raft_consensus.cc:385] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:13.972854 21664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14ed1ed549d47eb828017479cccdd42" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:13.973055 21859 raft_consensus.cc:740] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:13.973172 21630 leader_election.cc:304] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567; no voters: b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:13.973778 21858 tablet_bootstrap.cc:492] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:13.974184 22009 raft_consensus.cc:2804] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:13.974655 22009 raft_consensus.cc:493] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:13.974414 21859 consensus_queue.cc:260] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:13.975122 22009 raft_consensus.cc:3060] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:13.983529 21861 tablet_bootstrap.cc:654] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:13.973927 21664 raft_consensus.cc:3060] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:13.985746 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e327a74ed0c544d28806d688941cd3f6" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:13.986495 22071 raft_consensus.cc:493] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.987052 22071 raft_consensus.cc:515] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:13.988263 21918 raft_consensus.cc:493] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:13.989809 21860 ts_tablet_manager.cc:1434] T 9eac649888d64d3b8f520993cb19b20e P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260709 13:07:13.991369 21859 ts_tablet_manager.cc:1434] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 13:07:13.996631 21916 consensus_queue.cc:1048] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:13.998732 21859 tablet_bootstrap.cc:492] T 583c8787161e47ccb08cd01f6d26d5a4 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
W20260709 13:07:14.001296 21555 leader_election.cc:343] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:13.992146 21918 raft_consensus.cc:515] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:14.015192 22071 leader_election.cc:290] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:14.018234 21918 leader_election.cc:290] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:14.022341 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705488f64a3e446babbfe5b0d7bc2122" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:14.034698 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705488f64a3e446babbfe5b0d7bc2122" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:14.040279 21860 tablet_bootstrap.cc:492] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:14.041029 21485 catalog_manager.cc:5697] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:14.044467 21858 tablet_bootstrap.cc:654] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.049063 22009 raft_consensus.cc:515] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:14.056531 21660 raft_consensus.cc:1240] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Rejecting Update request from peer b8c58d9f32b84e5bb79e2751ac41cdba for earlier term 1. Current term is 2. Ops: [1.1-1.1]
W20260709 13:07:14.032210 21704 leader_election.cc:343] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.052896 21812 raft_consensus.cc:3060] T 9eac649888d64d3b8f520993cb19b20e P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.054769 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86c9ae384544389aed37a67c0cdb7b7" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
W20260709 13:07:14.065265 21778 leader_election.cc:343] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.067381 22030 consensus_queue.cc:1059] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:14.068092 21860 tablet_bootstrap.cc:654] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.069759 21664 raft_consensus.cc:2468] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 1.
I20260709 13:07:14.070637 21859 tablet_bootstrap.cc:654] T 583c8787161e47ccb08cd01f6d26d5a4 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.052917 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86c9ae384544389aed37a67c0cdb7b7" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
W20260709 13:07:14.077615 21778 leader_election.cc:343] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.078118 21778 leader_election.cc:304] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:14.080852 22030 raft_consensus.cc:3055] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:14.081516 22030 raft_consensus.cc:740] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:14.082978 22030 consensus_queue.cc:260] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:14.093039 21861 tablet_bootstrap.cc:492] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:14.093641 21861 ts_tablet_manager.cc:1403] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.294s	user 0.017s	sys 0.000s
I20260709 13:07:14.096891 21861 raft_consensus.cc:359] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:14.089464 22030 raft_consensus.cc:3060] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:14.100378 21589 raft_consensus.cc:3060] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.088833 21918 raft_consensus.cc:2749] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:14.098294 21704 leader_election.cc:343] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.102089 21704 leader_election.cc:304] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:14.103272 21923 raft_consensus.cc:2749] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:14.104782 21861 raft_consensus.cc:385] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.105083 21861 raft_consensus.cc:740] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.103780 21704 leader_election.cc:304] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:14.113257 21858 tablet_bootstrap.cc:492] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:14.113427 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0beed3c60054461a60991c48b418bfc" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:14.113863 21858 ts_tablet_manager.cc:1403] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.140s	user 0.019s	sys 0.012s
I20260709 13:07:14.114626 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0beed3c60054461a60991c48b418bfc" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:14.112388 21923 raft_consensus.cc:2804] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:14.115836 21923 raft_consensus.cc:697] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Running, Role: LEADER
I20260709 13:07:14.116947 21858 raft_consensus.cc:359] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:14.117722 21858 raft_consensus.cc:385] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.118140 21858 raft_consensus.cc:740] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.119194 21858 consensus_queue.cc:260] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:14.120812 21814 raft_consensus.cc:2410] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bed294de06e24ca4aba572ec722d2567 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
W20260709 13:07:14.123207 21555 consensus_peers.cc:597] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:14.124313 21858 ts_tablet_manager.cc:1434] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:07:14.117218 21923 consensus_queue.cc:237] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:14.111393 21861 consensus_queue.cc:260] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:14.129298 21858 tablet_bootstrap.cc:492] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:14.131880 21861 ts_tablet_manager.cc:1434] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:07:14.107012 22009 leader_election.cc:290] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:14.143131 21859 tablet_bootstrap.cc:492] T 583c8787161e47ccb08cd01f6d26d5a4 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:14.144862 21859 ts_tablet_manager.cc:1403] T 583c8787161e47ccb08cd01f6d26d5a4 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.146s	user 0.008s	sys 0.007s
I20260709 13:07:14.145470 21860 tablet_bootstrap.cc:492] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:14.146226 21860 ts_tablet_manager.cc:1403] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.117s	user 0.022s	sys 0.011s
I20260709 13:07:14.149968 21861 tablet_bootstrap.cc:492] T bd0cbb2559034cf7b35ecfe777ae620c P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:14.152565 21630 leader_election.cc:304] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:14.154096 22009 raft_consensus.cc:2749] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:14.155371 21814 raft_consensus.cc:3060] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.155994 22018 consensus_queue.cc:1048] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:14.150542 21487 catalog_manager.cc:5697] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 1 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:14.160625 21487 catalog_manager.cc:5697] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 1 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:14.172395 21860 raft_consensus.cc:359] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
W20260709 13:07:14.172830 21778 consensus_peers.cc:597] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:14.173270 21860 raft_consensus.cc:385] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.166692 21869 raft_consensus.cc:493] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.173961 21869 raft_consensus.cc:515] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:14.176383 21869 leader_election.cc:290] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:14.179953 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f558d81ff1b4d1fbb393d8dab70debb" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
W20260709 13:07:14.182233 21704 leader_election.cc:343] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.186748 21860 raft_consensus.cc:740] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.185658 21863 raft_consensus.cc:493] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.188992 21863 raft_consensus.cc:515] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:14.191841 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07198040872480db2c3b210d75e8c26" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:14.191874 21863 leader_election.cc:290] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:14.200700 21861 tablet_bootstrap.cc:654] T bd0cbb2559034cf7b35ecfe777ae620c P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.205890 21859 raft_consensus.cc:359] T 583c8787161e47ccb08cd01f6d26d5a4 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:14.227725 21859 raft_consensus.cc:385] T 583c8787161e47ccb08cd01f6d26d5a4 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.228142 21859 raft_consensus.cc:740] T 583c8787161e47ccb08cd01f6d26d5a4 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.202440 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f558d81ff1b4d1fbb393d8dab70debb" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:14.201303 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07198040872480db2c3b210d75e8c26" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:14.229067 21859 consensus_queue.cc:260] T 583c8787161e47ccb08cd01f6d26d5a4 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
W20260709 13:07:14.231004 21704 leader_election.cc:343] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.231494 21704 leader_election.cc:304] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:14.232322 21859 ts_tablet_manager.cc:1434] T 583c8787161e47ccb08cd01f6d26d5a4 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.087s	user 0.014s	sys 0.015s
I20260709 13:07:14.224200 21485 catalog_manager.cc:5697] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:14.215512 21858 tablet_bootstrap.cc:654] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.240410 21485 catalog_manager.cc:5697] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:14.232803 21923 raft_consensus.cc:2749] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:14.234392 21554 leader_election.cc:304] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:14.238322 22030 consensus_queue.cc:1048] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:14.244048 22089 raft_consensus.cc:2749] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:14.203732 21860 consensus_queue.cc:260] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:14.248529 21860 ts_tablet_manager.cc:1434] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.102s	user 0.013s	sys 0.007s
I20260709 13:07:14.256399 21860 tablet_bootstrap.cc:492] T d14ed1ed549d47eb828017479cccdd42 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:14.257055 21859 tablet_bootstrap.cc:492] T 7a21c3a2d0e04b27ad46365fd5ff3453 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:14.266808 21860 tablet_bootstrap.cc:654] T d14ed1ed549d47eb828017479cccdd42 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.280902 21860 tablet_bootstrap.cc:492] T d14ed1ed549d47eb828017479cccdd42 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:14.282243 21860 ts_tablet_manager.cc:1403] T d14ed1ed549d47eb828017479cccdd42 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.013s
I20260709 13:07:14.287148 21485 catalog_manager.cc:5697] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P 3e8f84032ed948908dc7fcffcfe2d6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 1 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } }
I20260709 13:07:14.291539 21923 consensus_queue.cc:1048] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:14.291827 21860 raft_consensus.cc:359] T d14ed1ed549d47eb828017479cccdd42 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:14.298465 21860 raft_consensus.cc:385] T d14ed1ed549d47eb828017479cccdd42 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.298760 21860 raft_consensus.cc:740] T d14ed1ed549d47eb828017479cccdd42 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.299813 21860 consensus_queue.cc:260] T d14ed1ed549d47eb828017479cccdd42 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:14.302624 21860 ts_tablet_manager.cc:1434] T d14ed1ed549d47eb828017479cccdd42 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.001s
I20260709 13:07:14.303716 21860 tablet_bootstrap.cc:492] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:14.305757 22018 raft_consensus.cc:493] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c58d9f32b84e5bb79e2751ac41cdba)
I20260709 13:07:14.306306 22018 raft_consensus.cc:515] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:14.308971 21923 raft_consensus.cc:493] T 583c8787161e47ccb08cd01f6d26d5a4 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.309722 21923 raft_consensus.cc:515] T 583c8787161e47ccb08cd01f6d26d5a4 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:14.310493 21860 tablet_bootstrap.cc:654] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.311635 21923 leader_election.cc:290] T 583c8787161e47ccb08cd01f6d26d5a4 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:14.311960 21861 tablet_bootstrap.cc:492] T bd0cbb2559034cf7b35ecfe777ae620c P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:14.312433 21861 ts_tablet_manager.cc:1403] T bd0cbb2559034cf7b35ecfe777ae620c P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.168s	user 0.036s	sys 0.032s
I20260709 13:07:14.313539 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583c8787161e47ccb08cd01f6d26d5a4" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:14.314152 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e46f3f1221a4fedac36e2252b8f2a34" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:14.315009 22018 leader_election.cc:290] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:14.296566 21858 tablet_bootstrap.cc:492] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
W20260709 13:07:14.315145 21704 leader_election.cc:343] T 583c8787161e47ccb08cd01f6d26d5a4 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.316257 21858 ts_tablet_manager.cc:1403] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.187s	user 0.010s	sys 0.010s
I20260709 13:07:14.315836 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6e46f3f1221a4fedac36e2252b8f2a34" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:14.318269 21554 leader_election.cc:304] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:14.319535 22018 raft_consensus.cc:2749] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:14.318215 21861 raft_consensus.cc:359] T bd0cbb2559034cf7b35ecfe777ae620c P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:14.321028 21861 raft_consensus.cc:385] T bd0cbb2559034cf7b35ecfe777ae620c P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.321733 21861 raft_consensus.cc:740] T bd0cbb2559034cf7b35ecfe777ae620c P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.322458 21861 consensus_queue.cc:260] T bd0cbb2559034cf7b35ecfe777ae620c P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:14.329095 21861 ts_tablet_manager.cc:1434] T bd0cbb2559034cf7b35ecfe777ae620c P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 13:07:14.330358 21861 tablet_bootstrap.cc:492] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:14.333181 21589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583c8787161e47ccb08cd01f6d26d5a4" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:14.293784 21859 tablet_bootstrap.cc:654] T 7a21c3a2d0e04b27ad46365fd5ff3453 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:14.334760 21704 leader_election.cc:343] T 583c8787161e47ccb08cd01f6d26d5a4 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.335258 21704 leader_election.cc:304] T 583c8787161e47ccb08cd01f6d26d5a4 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:14.335889 21923 raft_consensus.cc:2749] T 583c8787161e47ccb08cd01f6d26d5a4 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:14.336680 21860 tablet_bootstrap.cc:492] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:14.319820 21858 raft_consensus.cc:359] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:14.337430 21858 raft_consensus.cc:385] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.337781 21858 raft_consensus.cc:740] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.341178 21861 tablet_bootstrap.cc:654] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.337201 21860 ts_tablet_manager.cc:1403] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.008s
I20260709 13:07:14.343312 21858 consensus_queue.cc:260] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:14.344700 21860 raft_consensus.cc:359] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:14.348837 21860 raft_consensus.cc:385] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.349223 21860 raft_consensus.cc:740] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.350257 21860 consensus_queue.cc:260] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:14.352425 21860 ts_tablet_manager.cc:1434] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:07:14.353533 21860 tablet_bootstrap.cc:492] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:14.355381 21928 consensus_queue.cc:1048] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:14.362640 21860 tablet_bootstrap.cc:654] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.370324 21858 ts_tablet_manager.cc:1434] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.002s
I20260709 13:07:14.381980 21858 tablet_bootstrap.cc:492] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:14.367549 21488 catalog_manager.cc:5697] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 1 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:14.389213 21860 tablet_bootstrap.cc:492] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:14.389775 21860 ts_tablet_manager.cc:1403] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.004s
I20260709 13:07:14.389249 22030 raft_consensus.cc:493] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.393407 22030 raft_consensus.cc:515] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:14.393750 21860 raft_consensus.cc:359] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:14.394434 21860 raft_consensus.cc:385] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.394726 21860 raft_consensus.cc:740] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.395550 22030 leader_election.cc:290] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:14.398435 21664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ca21ec420f4843b276f4f15b2b0f1b" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:14.398343 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ca21ec420f4843b276f4f15b2b0f1b" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
W20260709 13:07:14.399940 21778 leader_election.cc:343] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:14.400694 21778 leader_election.cc:343] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.401068 21778 leader_election.cc:304] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:14.402156 22030 raft_consensus.cc:2749] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:14.387727 21488 catalog_manager.cc:5697] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 1 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:14.405951 21591 raft_consensus.cc:3060] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.410187 22030 consensus_queue.cc:1048] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:14.395606 21860 consensus_queue.cc:260] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:14.414108 21860 ts_tablet_manager.cc:1434] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.004s
I20260709 13:07:14.415020 21860 tablet_bootstrap.cc:492] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:14.418723 21859 tablet_bootstrap.cc:492] T 7a21c3a2d0e04b27ad46365fd5ff3453 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:14.419404 21859 ts_tablet_manager.cc:1403] T 7a21c3a2d0e04b27ad46365fd5ff3453 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.163s	user 0.020s	sys 0.036s
I20260709 13:07:14.419544 21861 tablet_bootstrap.cc:492] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:14.420176 21860 tablet_bootstrap.cc:654] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.420374 21861 ts_tablet_manager.cc:1403] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.090s	user 0.022s	sys 0.023s
I20260709 13:07:14.422289 21858 tablet_bootstrap.cc:654] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.422626 21859 raft_consensus.cc:359] T 7a21c3a2d0e04b27ad46365fd5ff3453 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:14.427594 21858 tablet_bootstrap.cc:492] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:14.425554 21861 raft_consensus.cc:359] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:14.428191 21858 ts_tablet_manager.cc:1403] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.046s	user 0.005s	sys 0.006s
I20260709 13:07:14.432029 21859 raft_consensus.cc:385] T 7a21c3a2d0e04b27ad46365fd5ff3453 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.432394 21859 raft_consensus.cc:740] T 7a21c3a2d0e04b27ad46365fd5ff3453 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.433066 21859 consensus_queue.cc:260] T 7a21c3a2d0e04b27ad46365fd5ff3453 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:14.434521 21858 raft_consensus.cc:359] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:14.435204 21858 raft_consensus.cc:385] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.435456 21858 raft_consensus.cc:740] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.435739 21859 ts_tablet_manager.cc:1434] T 7a21c3a2d0e04b27ad46365fd5ff3453 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:07:14.436774 22117 raft_consensus.cc:493] T bd0cbb2559034cf7b35ecfe777ae620c P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.437249 22117 raft_consensus.cc:515] T bd0cbb2559034cf7b35ecfe777ae620c P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:14.436810 21859 tablet_bootstrap.cc:492] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:14.439504 22117 leader_election.cc:290] T bd0cbb2559034cf7b35ecfe777ae620c P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:14.441103 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cbb2559034cf7b35ecfe777ae620c" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:14.442041 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cbb2559034cf7b35ecfe777ae620c" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:14.445329 21629 leader_election.cc:304] T bd0cbb2559034cf7b35ecfe777ae620c P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:14.447191 21487 catalog_manager.cc:5697] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 1 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } }
I20260709 13:07:14.447948 22117 raft_consensus.cc:2749] T bd0cbb2559034cf7b35ecfe777ae620c P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:14.436044 21858 consensus_queue.cc:260] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:14.449713 21861 raft_consensus.cc:385] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.450058 21861 raft_consensus.cc:740] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.450455 21858 ts_tablet_manager.cc:1434] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:07:14.450861 21861 consensus_queue.cc:260] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:14.451540 21858 tablet_bootstrap.cc:492] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:14.452451 21859 tablet_bootstrap.cc:654] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.453014 21861 ts_tablet_manager.cc:1434] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 13:07:14.471395 21858 tablet_bootstrap.cc:654] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.472043 21861 tablet_bootstrap.cc:492] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:14.474273 21860 tablet_bootstrap.cc:492] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:14.475162 21860 ts_tablet_manager.cc:1403] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.006s
I20260709 13:07:14.482089 22030 consensus_queue.cc:1048] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:14.486131 22030 consensus_queue.cc:1048] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:14.486768 21918 consensus_queue.cc:1048] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:14.507818 21859 tablet_bootstrap.cc:492] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:14.508412 21859 ts_tablet_manager.cc:1403] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.072s	user 0.012s	sys 0.006s
I20260709 13:07:14.509305 21660 raft_consensus.cc:3060] T bd0cbb2559034cf7b35ecfe777ae620c P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.511457 21859 raft_consensus.cc:359] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:14.512187 21859 raft_consensus.cc:385] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.512444 21859 raft_consensus.cc:740] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.515444 21861 tablet_bootstrap.cc:654] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.519985 21860 raft_consensus.cc:359] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:14.520735 21860 raft_consensus.cc:385] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.520990 21860 raft_consensus.cc:740] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.521582 21860 consensus_queue.cc:260] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:14.525017 21860 ts_tablet_manager.cc:1434] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.000s
I20260709 13:07:14.526450 21860 tablet_bootstrap.cc:492] T 7a21c3a2d0e04b27ad46365fd5ff3453 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:14.513171 21859 consensus_queue.cc:260] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:14.533855 21859 ts_tablet_manager.cc:1434] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 13:07:14.534732 21869 raft_consensus.cc:493] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.534951 21859 tablet_bootstrap.cc:492] T e39d9076de054deca6b7548e13c39a3b P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:14.535282 21869 raft_consensus.cc:515] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:14.536934 22018 consensus_queue.cc:1048] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:14.539394 21663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaacd7d18a674b519da25daf5d8040cc" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
W20260709 13:07:14.541879 21704 leader_election.cc:343] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.554415 21812 raft_consensus.cc:3060] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.556764 21869 leader_election.cc:290] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:14.558880 21858 tablet_bootstrap.cc:492] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:14.559706 21858 ts_tablet_manager.cc:1403] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.108s	user 0.013s	sys 0.013s
I20260709 13:07:14.572044 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaacd7d18a674b519da25daf5d8040cc" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:14.561408 22117 raft_consensus.cc:493] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:14.577447 21704 leader_election.cc:343] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.578083 21704 leader_election.cc:304] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:14.579902 21869 raft_consensus.cc:2749] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:14.600396 21858 raft_consensus.cc:359] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:14.601190 21858 raft_consensus.cc:385] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.601455 21858 raft_consensus.cc:740] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.602162 21858 consensus_queue.cc:260] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:14.581602 22117 raft_consensus.cc:515] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:14.604302 21858 ts_tablet_manager.cc:1434] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.000s
I20260709 13:07:14.605067 21861 tablet_bootstrap.cc:492] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:14.605302 21858 tablet_bootstrap.cc:492] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:14.605756 21861 ts_tablet_manager.cc:1403] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.138s	user 0.031s	sys 0.018s
I20260709 13:07:14.606010 22117 leader_election.cc:290] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:14.608544 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb99515c89d44c59276745ce3cbacd6" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:14.609710 21916 raft_consensus.cc:493] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.610244 21916 raft_consensus.cc:515] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:14.612290 21916 leader_election.cc:290] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:14.613915 22117 raft_consensus.cc:493] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.614137 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6742efaede2f4dfeb0c1171e090e8dc0" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:14.614565 21590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6742efaede2f4dfeb0c1171e090e8dc0" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:14.614609 22117 raft_consensus.cc:515] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:14.615499 21663 raft_consensus.cc:3060] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.615500 21590 raft_consensus.cc:2468] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:14.618655 21778 leader_election.cc:304] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:14.618723 21861 raft_consensus.cc:359] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:14.620512 21861 raft_consensus.cc:385] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.621292 21861 raft_consensus.cc:740] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.622681 22117 leader_election.cc:290] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:14.622996 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a21c3a2d0e04b27ad46365fd5ff3453" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:14.628818 21737 raft_consensus.cc:2468] T 7a21c3a2d0e04b27ad46365fd5ff3453 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 0.
W20260709 13:07:14.624125 21778 leader_election.cc:343] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.629017 22117 raft_consensus.cc:493] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.630091 22117 raft_consensus.cc:515] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:14.633298 21860 tablet_bootstrap.cc:654] T 7a21c3a2d0e04b27ad46365fd5ff3453 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.619794 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb99515c89d44c59276745ce3cbacd6" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:14.630990 21629 leader_election.cc:304] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:14.625792 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a21c3a2d0e04b27ad46365fd5ff3453" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:14.625120 21858 tablet_bootstrap.cc:654] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.637535 21861 consensus_queue.cc:260] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:14.637916 21916 raft_consensus.cc:2804] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:14.640280 22009 raft_consensus.cc:2804] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:07:14.651862 21630 leader_election.cc:343] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.653599 21861 ts_tablet_manager.cc:1434] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.003s
I20260709 13:07:14.644829 22117 leader_election.cc:290] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:14.657406 22089 raft_consensus.cc:493] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.664247 22089 raft_consensus.cc:515] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:14.667438 22089 leader_election.cc:290] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:14.647531 21916 raft_consensus.cc:493] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.668061 22030 raft_consensus.cc:493] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.668345 21916 raft_consensus.cc:3060] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.668614 22030 raft_consensus.cc:515] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:14.672443 22030 leader_election.cc:290] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:14.656747 21590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d9076de054deca6b7548e13c39a3b" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:14.676146 21590 raft_consensus.cc:2468] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 0.
I20260709 13:07:14.673592 21630 leader_election.cc:304] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:14.678862 21664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86c9ae384544389aed37a67c0cdb7b7" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:14.674223 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e327a74ed0c544d28806d688941cd3f6" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
W20260709 13:07:14.686064 21555 leader_election.cc:343] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.686757 21630 leader_election.cc:304] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:14.649518 22009 raft_consensus.cc:493] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.673188 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d9076de054deca6b7548e13c39a3b" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:14.697956 21859 tablet_bootstrap.cc:654] T e39d9076de054deca6b7548e13c39a3b P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.699572 21861 tablet_bootstrap.cc:492] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:14.703883 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86c9ae384544389aed37a67c0cdb7b7" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:14.704839 21813 raft_consensus.cc:2468] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 0.
I20260709 13:07:14.691766 22030 raft_consensus.cc:493] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.706550 22030 raft_consensus.cc:515] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:14.708787 22030 leader_election.cc:290] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:14.711400 22157 raft_consensus.cc:2804] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:14.712030 22157 raft_consensus.cc:493] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.712460 22157 raft_consensus.cc:3060] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.713634 22071 consensus_queue.cc:1048] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:14.714905 21814 raft_consensus.cc:3060] T d14ed1ed549d47eb828017479cccdd42 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.720424 21589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e327a74ed0c544d28806d688941cd3f6" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:14.697007 22009 raft_consensus.cc:3060] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.742720 21778 leader_election.cc:304] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:14.745149 21589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583c8787161e47ccb08cd01f6d26d5a4" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:14.732338 22018 consensus_queue.cc:1048] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
W20260709 13:07:14.750072 21629 leader_election.cc:343] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.748705 21916 raft_consensus.cc:515] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:14.753913 21861 tablet_bootstrap.cc:654] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.737757 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583c8787161e47ccb08cd01f6d26d5a4" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:14.748600 22009 raft_consensus.cc:515] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:14.738137 21555 leader_election.cc:304] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:14.756472 22030 raft_consensus.cc:2749] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:14.760900 21738 raft_consensus.cc:2468] T 583c8787161e47ccb08cd01f6d26d5a4 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:14.766955 21860 tablet_bootstrap.cc:492] T 7a21c3a2d0e04b27ad46365fd5ff3453 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:14.737030 22157 raft_consensus.cc:515] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:14.771059 22082 raft_consensus.cc:493] T d14ed1ed549d47eb828017479cccdd42 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.773763 22018 raft_consensus.cc:2804] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:14.773257 21916 leader_election.cc:290] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:14.779098 21858 tablet_bootstrap.cc:492] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:14.780812 21860 ts_tablet_manager.cc:1403] T 7a21c3a2d0e04b27ad46365fd5ff3453 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.255s	user 0.013s	sys 0.006s
I20260709 13:07:14.779121 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a21c3a2d0e04b27ad46365fd5ff3453" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:14.787433 21737 raft_consensus.cc:3060] T 7a21c3a2d0e04b27ad46365fd5ff3453 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.786747 22082 raft_consensus.cc:515] T d14ed1ed549d47eb828017479cccdd42 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:14.786499 21858 ts_tablet_manager.cc:1403] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.181s	user 0.016s	sys 0.033s
I20260709 13:07:14.778842 21923 consensus_queue.cc:1048] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:07:14.785975 22018 raft_consensus.cc:493] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.793767 22009 leader_election.cc:290] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:14.790253 22117 raft_consensus.cc:2749] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:14.794787 22018 raft_consensus.cc:3060] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.793354 21777 leader_election.cc:304] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:14.804113 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7a21c3a2d0e04b27ad46365fd5ff3453" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:14.805298 21858 raft_consensus.cc:359] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
W20260709 13:07:14.801828 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:35853, user_credentials={real_user=slave}} blocked reactor thread for 45023us
I20260709 13:07:14.811378 21858 raft_consensus.cc:385] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.808456 21737 raft_consensus.cc:2468] T 7a21c3a2d0e04b27ad46365fd5ff3453 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 1.
I20260709 13:07:14.811980 21858 raft_consensus.cc:740] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.816900 21858 consensus_queue.cc:260] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:14.818871 21589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6742efaede2f4dfeb0c1171e090e8dc0" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:14.819451 21589 raft_consensus.cc:3060] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:14.822141 21778 leader_election.cc:343] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.815133 21916 raft_consensus.cc:2804] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:14.826867 21859 tablet_bootstrap.cc:492] T e39d9076de054deca6b7548e13c39a3b P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:14.827466 21859 ts_tablet_manager.cc:1403] T e39d9076de054deca6b7548e13c39a3b P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.293s	user 0.005s	sys 0.010s
I20260709 13:07:14.832039 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14ed1ed549d47eb828017479cccdd42" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:14.828887 21916 raft_consensus.cc:493] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.839613 21916 raft_consensus.cc:3060] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.839952 21663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6742efaede2f4dfeb0c1171e090e8dc0" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:14.841377 22082 leader_election.cc:290] T d14ed1ed549d47eb828017479cccdd42 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:14.845186 22157 leader_election.cc:290] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:14.845754 21860 raft_consensus.cc:359] T 7a21c3a2d0e04b27ad46365fd5ff3453 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:14.848318 21860 raft_consensus.cc:385] T 7a21c3a2d0e04b27ad46365fd5ff3453 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.848634 21860 raft_consensus.cc:740] T 7a21c3a2d0e04b27ad46365fd5ff3453 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.849354 21860 consensus_queue.cc:260] T 7a21c3a2d0e04b27ad46365fd5ff3453 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:14.849726 21664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14ed1ed549d47eb828017479cccdd42" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:14.850268 21812 raft_consensus.cc:3060] T 7a21c3a2d0e04b27ad46365fd5ff3453 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.850903 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d9076de054deca6b7548e13c39a3b" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:14.851106 21629 leader_election.cc:304] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:14.856779 22163 raft_consensus.cc:2804] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:14.857322 22163 raft_consensus.cc:697] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567 [term 1 LEADER]: Becoming Leader. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Running, Role: LEADER
I20260709 13:07:14.859606 21858 ts_tablet_manager.cc:1434] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.000s
I20260709 13:07:14.834720 22018 raft_consensus.cc:515] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
W20260709 13:07:14.860787 21778 leader_election.cc:343] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.865058 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e39d9076de054deca6b7548e13c39a3b" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:14.873016 21588 raft_consensus.cc:3060] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.875931 21589 raft_consensus.cc:2468] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:14.869880 22162 raft_consensus.cc:493] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:14.879626 22162 raft_consensus.cc:515] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:14.881749 22162 leader_election.cc:290] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:14.884792 21778 leader_election.cc:304] T d14ed1ed549d47eb828017479cccdd42 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:14.883922 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb5613fc4c548ccaa3120ba22d4d0f8" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:14.885964 21590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb5613fc4c548ccaa3120ba22d4d0f8" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:14.886659 21590 raft_consensus.cc:2468] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 0.
I20260709 13:07:14.872473 21858 tablet_bootstrap.cc:492] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:14.858258 22163 consensus_queue.cc:237] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:14.894520 21630 leader_election.cc:304] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:14.878741 21859 raft_consensus.cc:359] T e39d9076de054deca6b7548e13c39a3b P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:14.896761 21778 leader_election.cc:304] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:14.898073 21859 raft_consensus.cc:385] T e39d9076de054deca6b7548e13c39a3b P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:14.898602 21859 raft_consensus.cc:740] T e39d9076de054deca6b7548e13c39a3b P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:14.880860 21588 raft_consensus.cc:2468] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 1.
I20260709 13:07:14.902117 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86c9ae384544389aed37a67c0cdb7b7" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:14.905819 21813 raft_consensus.cc:3060] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.912935 22025 raft_consensus.cc:2804] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:14.895084 21812 raft_consensus.cc:2468] T 7a21c3a2d0e04b27ad46365fd5ff3453 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 1.
I20260709 13:07:14.920051 22018 leader_election.cc:290] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:14.920960 22162 raft_consensus.cc:2804] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:14.921422 22162 raft_consensus.cc:493] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:14.921767 22162 raft_consensus.cc:3060] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:14.925048 21860 ts_tablet_manager.cc:1434] T 7a21c3a2d0e04b27ad46365fd5ff3453 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.139s	user 0.010s	sys 0.000s
I20260709 13:07:14.926385 21860 tablet_bootstrap.cc:492] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
W20260709 13:07:14.925062 21630 leader_election.cc:343] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.940083 21663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86c9ae384544389aed37a67c0cdb7b7" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:14.940078 21630 leader_election.cc:304] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:14.943069 22157 raft_consensus.cc:2804] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:14.943640 22157 raft_consensus.cc:697] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [term 1 LEADER]: Becoming Leader. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Running, Role: LEADER
I20260709 13:07:14.944543 22157 consensus_queue.cc:237] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:14.945739 21859 consensus_queue.cc:260] T e39d9076de054deca6b7548e13c39a3b P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:14.947197 21739 raft_consensus.cc:3060] T e39d9076de054deca6b7548e13c39a3b P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:14.950063 21555 leader_election.cc:343] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:14.955981 21860 tablet_bootstrap.cc:654] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.948602 21859 ts_tablet_manager.cc:1434] T e39d9076de054deca6b7548e13c39a3b P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.121s	user 0.000s	sys 0.006s
I20260709 13:07:14.962445 21858 tablet_bootstrap.cc:654] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:14.975011 22030 raft_consensus.cc:2749] T d14ed1ed549d47eb828017479cccdd42 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:14.992056 21859 tablet_bootstrap.cc:492] T 1e3f4d96c3d04d378fc88e817a7c4069 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:14.985848 22025 raft_consensus.cc:697] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:15.000775 21813 raft_consensus.cc:2468] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 1.
I20260709 13:07:15.011085 21739 raft_consensus.cc:2468] T e39d9076de054deca6b7548e13c39a3b P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 1.
I20260709 13:07:15.028203 21861 tablet_bootstrap.cc:492] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:15.028754 21861 ts_tablet_manager.cc:1403] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.329s	user 0.048s	sys 0.049s
I20260709 13:07:15.031558 21861 raft_consensus.cc:359] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:15.032312 21861 raft_consensus.cc:385] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.032629 21861 raft_consensus.cc:740] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.033589 21861 consensus_queue.cc:260] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:14.991801 22162 raft_consensus.cc:515] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:15.035571 21861 ts_tablet_manager.cc:1434] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:07:15.036595 21861 tablet_bootstrap.cc:492] T 638d06604bc042cf8e846b13dbe634e7 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:15.020342 21916 raft_consensus.cc:515] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.045631 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb5613fc4c548ccaa3120ba22d4d0f8" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
W20260709 13:07:15.047250 21630 leader_election.cc:343] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.049453 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583c8787161e47ccb08cd01f6d26d5a4" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:15.050309 21738 raft_consensus.cc:3060] T 583c8787161e47ccb08cd01f6d26d5a4 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.054066 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb5613fc4c548ccaa3120ba22d4d0f8" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:15.054788 21588 raft_consensus.cc:3060] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.039149 22025 consensus_queue.cc:237] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:15.056586 21861 tablet_bootstrap.cc:654] T 638d06604bc042cf8e846b13dbe634e7 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.058213 21488 catalog_manager.cc:5697] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567 reported cstate change: term changed from 0 to 1, leader changed from <none> to bed294de06e24ca4aba572ec722d2567 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "bed294de06e24ca4aba572ec722d2567" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:15.069844 22162 leader_election.cc:290] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:15.075310 21923 raft_consensus.cc:493] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.076612 21859 tablet_bootstrap.cc:654] T 1e3f4d96c3d04d378fc88e817a7c4069 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.078768 21555 leader_election.cc:304] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:15.079070 21589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583c8787161e47ccb08cd01f6d26d5a4" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:15.080181 21863 raft_consensus.cc:2804] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:15.080613 21916 leader_election.cc:290] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:15.080705 21863 raft_consensus.cc:697] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:15.081717 21863 consensus_queue.cc:237] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:15.082720 21860 tablet_bootstrap.cc:492] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:15.083214 21860 ts_tablet_manager.cc:1403] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.157s	user 0.017s	sys 0.008s
W20260709 13:07:15.084460 21778 leader_election.cc:343] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.076256 21923 raft_consensus.cc:515] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.087584 21923 leader_election.cc:290] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:15.091365 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841639e17c5d4724afe9494276ba00a3" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:15.091619 21588 raft_consensus.cc:2468] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 1.
I20260709 13:07:15.091737 21589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841639e17c5d4724afe9494276ba00a3" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
W20260709 13:07:15.093549 21704 leader_election.cc:343] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:15.094298 21704 leader_election.cc:343] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.094709 21704 leader_election.cc:304] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:15.097160 21860 raft_consensus.cc:359] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:15.099205 21860 raft_consensus.cc:385] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.099717 21860 raft_consensus.cc:740] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.097532 21923 raft_consensus.cc:2749] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:15.101357 21860 consensus_queue.cc:260] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:15.100986 21630 leader_election.cc:304] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567; no voters: b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:15.105723 22162 raft_consensus.cc:2804] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:15.106437 22162 raft_consensus.cc:697] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 [term 1 LEADER]: Becoming Leader. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Running, Role: LEADER
I20260709 13:07:15.107184 21861 tablet_bootstrap.cc:492] T 638d06604bc042cf8e846b13dbe634e7 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:15.107767 21861 ts_tablet_manager.cc:1403] T 638d06604bc042cf8e846b13dbe634e7 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.071s	user 0.009s	sys 0.002s
I20260709 13:07:15.107296 22162 consensus_queue.cc:237] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:15.104076 21738 raft_consensus.cc:2468] T 583c8787161e47ccb08cd01f6d26d5a4 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:15.110394 21777 leader_election.cc:304] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:15.111644 21918 raft_consensus.cc:2804] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:15.116608 21918 raft_consensus.cc:697] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:15.117751 21860 ts_tablet_manager.cc:1434] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.000s
W20260709 13:07:15.118222 21537 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:15.117460 21918 consensus_queue.cc:237] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.126240 21858 tablet_bootstrap.cc:492] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:15.126943 21858 ts_tablet_manager.cc:1403] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.255s	user 0.012s	sys 0.003s
I20260709 13:07:15.128108 21860 tablet_bootstrap.cc:492] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:15.132266 21861 raft_consensus.cc:359] T 638d06604bc042cf8e846b13dbe634e7 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.132449 21858 raft_consensus.cc:359] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.133826 21858 raft_consensus.cc:385] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.134198 21858 raft_consensus.cc:740] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.134969 21858 consensus_queue.cc:260] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.136593 21858 ts_tablet_manager.cc:1434] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:07:15.137081 21861 raft_consensus.cc:385] T 638d06604bc042cf8e846b13dbe634e7 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.137517 21861 raft_consensus.cc:740] T 638d06604bc042cf8e846b13dbe634e7 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.138581 21861 consensus_queue.cc:260] T 638d06604bc042cf8e846b13dbe634e7 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.140296 21859 tablet_bootstrap.cc:492] T 1e3f4d96c3d04d378fc88e817a7c4069 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:15.141978 21859 ts_tablet_manager.cc:1403] T 1e3f4d96c3d04d378fc88e817a7c4069 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.159s	user 0.012s	sys 0.021s
I20260709 13:07:15.141192 21861 ts_tablet_manager.cc:1434] T 638d06604bc042cf8e846b13dbe634e7 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.000s
I20260709 13:07:15.147923 21860 tablet_bootstrap.cc:654] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.148217 21861 tablet_bootstrap.cc:492] T 6742efaede2f4dfeb0c1171e090e8dc0 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:15.152981 21485 catalog_manager.cc:5697] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 1 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:15.153681 22018 raft_consensus.cc:493] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.159385 22018 raft_consensus.cc:515] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.162726 21861 tablet_bootstrap.cc:654] T 6742efaede2f4dfeb0c1171e090e8dc0 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.164115 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583c8787161e47ccb08cd01f6d26d5a4" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:15.165079 21738 raft_consensus.cc:2393] T 583c8787161e47ccb08cd01f6d26d5a4 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f1fa49d04344067941ffd03d9e7d48c in current term 1: Already voted for candidate b8c58d9f32b84e5bb79e2751ac41cdba in this term.
I20260709 13:07:15.168332 22018 leader_election.cc:290] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:15.170245 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583c8787161e47ccb08cd01f6d26d5a4" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:15.173622 21858 tablet_bootstrap.cc:492] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:15.173816 21555 leader_election.cc:304] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:15.175453 21863 raft_consensus.cc:3060] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.184579 21923 raft_consensus.cc:493] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.185420 21923 raft_consensus.cc:515] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.190511 21859 raft_consensus.cc:359] T 1e3f4d96c3d04d378fc88e817a7c4069 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:15.191752 21859 raft_consensus.cc:385] T 1e3f4d96c3d04d378fc88e817a7c4069 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.192149 21859 raft_consensus.cc:740] T 1e3f4d96c3d04d378fc88e817a7c4069 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.202106 21863 raft_consensus.cc:2749] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:15.203104 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "638d06604bc042cf8e846b13dbe634e7" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
W20260709 13:07:15.205322 21704 leader_election.cc:343] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.207171 21858 tablet_bootstrap.cc:654] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.212510 21859 consensus_queue.cc:260] T 1e3f4d96c3d04d378fc88e817a7c4069 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:15.216908 21662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "638d06604bc042cf8e846b13dbe634e7" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:15.219208 21663 raft_consensus.cc:3060] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.222553 21662 raft_consensus.cc:2468] T 638d06604bc042cf8e846b13dbe634e7 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 0.
I20260709 13:07:15.220252 21860 tablet_bootstrap.cc:492] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:15.224007 21704 leader_election.cc:304] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:15.224804 21860 ts_tablet_manager.cc:1403] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.102s	user 0.019s	sys 0.033s
I20260709 13:07:15.232610 21859 ts_tablet_manager.cc:1434] T 1e3f4d96c3d04d378fc88e817a7c4069 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.090s	user 0.004s	sys 0.003s
I20260709 13:07:15.232452 21869 raft_consensus.cc:2804] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:15.233827 21869 raft_consensus.cc:493] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.234337 21859 tablet_bootstrap.cc:492] T 832d931fb3f84415aac4b1880e99c498 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:15.234383 21869 raft_consensus.cc:3060] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.224807 21923 leader_election.cc:290] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:15.252343 21869 raft_consensus.cc:515] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.236894 21860 raft_consensus.cc:359] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.254997 21860 raft_consensus.cc:385] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.255330 21860 raft_consensus.cc:740] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.256088 21860 consensus_queue.cc:260] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.258328 21860 ts_tablet_manager.cc:1434] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.002s
I20260709 13:07:15.258565 21861 tablet_bootstrap.cc:492] T 6742efaede2f4dfeb0c1171e090e8dc0 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:15.263674 21869 leader_election.cc:290] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:15.264514 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "638d06604bc042cf8e846b13dbe634e7" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:15.264529 21861 ts_tablet_manager.cc:1403] T 6742efaede2f4dfeb0c1171e090e8dc0 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.117s	user 0.011s	sys 0.020s
I20260709 13:07:15.265128 21860 tablet_bootstrap.cc:492] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:15.266808 21859 tablet_bootstrap.cc:654] T 832d931fb3f84415aac4b1880e99c498 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.267889 21861 raft_consensus.cc:359] T 6742efaede2f4dfeb0c1171e090e8dc0 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:15.270145 21861 raft_consensus.cc:385] T 6742efaede2f4dfeb0c1171e090e8dc0 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.270457 21861 raft_consensus.cc:740] T 6742efaede2f4dfeb0c1171e090e8dc0 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
W20260709 13:07:15.271858 21704 leader_election.cc:343] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.272710 21663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "638d06604bc042cf8e846b13dbe634e7" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:15.273424 21663 raft_consensus.cc:3060] T 638d06604bc042cf8e846b13dbe634e7 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.275905 21860 tablet_bootstrap.cc:654] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.277660 21858 tablet_bootstrap.cc:492] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:15.281482 21858 ts_tablet_manager.cc:1403] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.123s	user 0.008s	sys 0.007s
I20260709 13:07:15.271166 21861 consensus_queue.cc:260] T 6742efaede2f4dfeb0c1171e090e8dc0 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:15.281548 21859 tablet_bootstrap.cc:492] T 832d931fb3f84415aac4b1880e99c498 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:15.282251 21859 ts_tablet_manager.cc:1403] T 832d931fb3f84415aac4b1880e99c498 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.000s
I20260709 13:07:15.284489 21858 raft_consensus.cc:359] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.285158 21861 ts_tablet_manager.cc:1434] T 6742efaede2f4dfeb0c1171e090e8dc0 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.020s	user 0.001s	sys 0.005s
I20260709 13:07:15.285665 21859 raft_consensus.cc:359] T 832d931fb3f84415aac4b1880e99c498 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.286388 21859 raft_consensus.cc:385] T 832d931fb3f84415aac4b1880e99c498 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.286684 21859 raft_consensus.cc:740] T 832d931fb3f84415aac4b1880e99c498 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.287282 21860 tablet_bootstrap.cc:492] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:15.287343 21861 tablet_bootstrap.cc:492] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:15.287984 21860 ts_tablet_manager.cc:1403] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.000s
I20260709 13:07:15.287513 21859 consensus_queue.cc:260] T 832d931fb3f84415aac4b1880e99c498 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.290230 21859 ts_tablet_manager.cc:1434] T 832d931fb3f84415aac4b1880e99c498 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:15.285213 21858 raft_consensus.cc:385] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.290995 21858 raft_consensus.cc:740] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.291436 21859 tablet_bootstrap.cc:492] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:15.291958 21858 consensus_queue.cc:260] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.293104 21860 raft_consensus.cc:359] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.294039 21860 raft_consensus.cc:385] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.294342 21860 raft_consensus.cc:740] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.295269 21860 consensus_queue.cc:260] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.301061 21860 ts_tablet_manager.cc:1434] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:07:15.303015 21861 tablet_bootstrap.cc:654] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.302805 21858 ts_tablet_manager.cc:1434] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:07:15.305737 21858 tablet_bootstrap.cc:492] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:15.315488 21860 tablet_bootstrap.cc:492] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:15.316075 22162 consensus_queue.cc:1048] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:15.327733 21858 tablet_bootstrap.cc:654] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.328573 21918 raft_consensus.cc:493] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.329110 21918 raft_consensus.cc:515] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.282933 21489 catalog_manager.cc:5697] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 reported cstate change: term changed from 0 to 1, leader changed from <none> to bed294de06e24ca4aba572ec722d2567 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "bed294de06e24ca4aba572ec722d2567" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:15.338645 21916 raft_consensus.cc:493] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.339941 21916 raft_consensus.cc:515] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.342128 21916 leader_election.cc:290] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:15.342794 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841639e17c5d4724afe9494276ba00a3" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:15.343504 21738 raft_consensus.cc:2468] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:15.343719 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841639e17c5d4724afe9494276ba00a3" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:15.344655 21859 tablet_bootstrap.cc:654] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.344892 21777 leader_election.cc:304] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
W20260709 13:07:15.345808 21778 leader_election.cc:343] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.346724 21916 raft_consensus.cc:2804] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:15.347177 21916 raft_consensus.cc:493] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.347568 21916 raft_consensus.cc:3060] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.349228 21860 tablet_bootstrap.cc:654] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.352680 21489 catalog_manager.cc:5697] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 reported cstate change: term changed from 0 to 1, leader changed from <none> to bed294de06e24ca4aba572ec722d2567 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "bed294de06e24ca4aba572ec722d2567" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:15.356317 21861 tablet_bootstrap.cc:492] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:15.356835 21861 ts_tablet_manager.cc:1403] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.070s	user 0.020s	sys 0.002s
I20260709 13:07:15.353304 21918 leader_election.cc:290] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:15.354727 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f558d81ff1b4d1fbb393d8dab70debb" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:15.354727 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f558d81ff1b4d1fbb393d8dab70debb" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:15.359938 21738 raft_consensus.cc:2468] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
W20260709 13:07:15.360128 21778 leader_election.cc:343] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.360994 21861 raft_consensus.cc:359] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:15.362043 21861 raft_consensus.cc:385] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.362380 21861 raft_consensus.cc:740] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.366448 21777 leader_election.cc:304] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:15.366777 21663 raft_consensus.cc:2468] T 638d06604bc042cf8e846b13dbe634e7 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 1.
I20260709 13:07:15.367380 22173 raft_consensus.cc:2804] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:15.367498 22157 consensus_queue.cc:1048] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:15.367940 21704 leader_election.cc:304] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:15.367815 22173 raft_consensus.cc:493] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.369540 22173 raft_consensus.cc:3060] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.358301 21916 raft_consensus.cc:515] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.369578 21923 raft_consensus.cc:2804] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:15.375943 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841639e17c5d4724afe9494276ba00a3" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:15.376173 21923 raft_consensus.cc:697] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Running, Role: LEADER
W20260709 13:07:15.377398 21778 leader_election.cc:343] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.377257 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841639e17c5d4724afe9494276ba00a3" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:15.378486 21739 raft_consensus.cc:3060] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.377229 21923 consensus_queue.cc:237] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.377941 21916 leader_election.cc:290] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:15.399107 22173 raft_consensus.cc:515] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.393548 21488 catalog_manager.cc:5697] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 1 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:15.405810 21858 tablet_bootstrap.cc:492] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:15.406327 21858 ts_tablet_manager.cc:1403] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.101s	user 0.015s	sys 0.002s
I20260709 13:07:15.406325 21488 catalog_manager.cc:5697] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 1 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:15.363224 21861 consensus_queue.cc:260] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:15.402642 21860 tablet_bootstrap.cc:492] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:15.410099 21860 ts_tablet_manager.cc:1403] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.095s	user 0.013s	sys 0.004s
I20260709 13:07:15.411302 21861 ts_tablet_manager.cc:1434] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260709 13:07:15.373368 21859 tablet_bootstrap.cc:492] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:15.411978 21859 ts_tablet_manager.cc:1403] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.121s	user 0.016s	sys 0.003s
I20260709 13:07:15.412927 21860 raft_consensus.cc:359] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:15.413653 21860 raft_consensus.cc:385] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.414124 21860 raft_consensus.cc:740] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.414729 21859 raft_consensus.cc:359] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.414842 21860 consensus_queue.cc:260] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:15.415599 21859 raft_consensus.cc:385] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.415937 21859 raft_consensus.cc:740] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.409252 21858 raft_consensus.cc:359] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.416354 21858 raft_consensus.cc:385] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.416676 21858 raft_consensus.cc:740] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.416774 21859 consensus_queue.cc:260] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.403162 21739 raft_consensus.cc:2468] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:15.417729 21858 consensus_queue.cc:260] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.419984 21777 leader_election.cc:304] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:15.420536 21858 ts_tablet_manager.cc:1434] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:07:15.421201 21916 raft_consensus.cc:2804] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:15.421753 21916 raft_consensus.cc:697] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:15.421840 21860 ts_tablet_manager.cc:1434] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:07:15.422688 21916 consensus_queue.cc:237] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.423754 21860 tablet_bootstrap.cc:492] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:15.424700 21859 ts_tablet_manager.cc:1434] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:07:15.425676 21858 tablet_bootstrap.cc:492] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:15.426196 21861 tablet_bootstrap.cc:492] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:15.430006 21859 tablet_bootstrap.cc:492] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:15.439865 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f558d81ff1b4d1fbb393d8dab70debb" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:15.440871 21738 raft_consensus.cc:3060] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.442370 21858 tablet_bootstrap.cc:654] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.443308 21860 tablet_bootstrap.cc:654] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.446884 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f558d81ff1b4d1fbb393d8dab70debb" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
W20260709 13:07:15.448590 21778 leader_election.cc:343] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.458333 21861 tablet_bootstrap.cc:654] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.459112 21860 tablet_bootstrap.cc:492] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:15.459836 21860 ts_tablet_manager.cc:1403] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.004s
I20260709 13:07:15.440006 22173 leader_election.cc:290] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:15.462713 21859 tablet_bootstrap.cc:654] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.466136 21487 catalog_manager.cc:5697] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:15.467468 22163 consensus_queue.cc:1048] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:15.473763 21738 raft_consensus.cc:2468] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:15.475598 21777 leader_election.cc:304] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:15.478528 21923 raft_consensus.cc:493] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.479074 21923 raft_consensus.cc:515] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.481499 22089 raft_consensus.cc:493] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c58d9f32b84e5bb79e2751ac41cdba)
I20260709 13:07:15.484942 22089 raft_consensus.cc:515] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:15.486059 21858 tablet_bootstrap.cc:492] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:15.486567 21858 ts_tablet_manager.cc:1403] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.001s
I20260709 13:07:15.487283 22089 leader_election.cc:290] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:15.489459 21858 raft_consensus.cc:359] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.490162 21858 raft_consensus.cc:385] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.484478 22173 raft_consensus.cc:2804] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:15.490458 21858 raft_consensus.cc:740] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.492372 21858 consensus_queue.cc:260] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.494289 22173 raft_consensus.cc:697] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:15.495391 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0beed3c60054461a60991c48b418bfc" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:15.495266 22173 consensus_queue.cc:237] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.495786 21662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0beed3c60054461a60991c48b418bfc" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:15.496043 21813 raft_consensus.cc:2468] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:15.496613 21662 raft_consensus.cc:2393] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f1fa49d04344067941ffd03d9e7d48c in current term 2: Already voted for candidate bed294de06e24ca4aba572ec722d2567 in this term.
I20260709 13:07:15.498840 21555 leader_election.cc:304] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:15.500003 21863 raft_consensus.cc:2804] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:15.500409 21863 raft_consensus.cc:493] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting leader election (detected failure of leader b8c58d9f32b84e5bb79e2751ac41cdba)
I20260709 13:07:15.501947 21863 raft_consensus.cc:3060] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:15.504284 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317e3221976c47fa913d27f018a21910" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
W20260709 13:07:15.506953 21704 leader_election.cc:343] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.518131 21923 leader_election.cc:290] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:15.519492 21589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317e3221976c47fa913d27f018a21910" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:15.521764 21858 ts_tablet_manager.cc:1434] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 13:07:15.522596 21663 raft_consensus.cc:3060] T 6742efaede2f4dfeb0c1171e090e8dc0 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:15.523190 21704 leader_election.cc:343] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.527073 21704 leader_election.cc:304] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:15.531282 21976 raft_consensus.cc:2749] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:15.533001 21863 raft_consensus.cc:515] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:15.537182 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0beed3c60054461a60991c48b418bfc" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:15.537966 21662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0beed3c60054461a60991c48b418bfc" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:15.538842 21662 raft_consensus.cc:2393] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f1fa49d04344067941ffd03d9e7d48c in current term 2: Already voted for candidate bed294de06e24ca4aba572ec722d2567 in this term.
I20260709 13:07:15.540172 21863 leader_election.cc:290] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:15.544453 21811 raft_consensus.cc:2468] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:15.545840 22025 raft_consensus.cc:493] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.548274 21860 raft_consensus.cc:359] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:15.550271 21860 raft_consensus.cc:385] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.552951 21858 tablet_bootstrap.cc:492] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:15.550559 21860 raft_consensus.cc:740] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.551021 22025 raft_consensus.cc:515] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:15.555962 22025 leader_election.cc:290] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:15.558811 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb5613fc4c548ccaa3120ba22d4d0f8" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:15.559597 21588 raft_consensus.cc:2393] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b8c58d9f32b84e5bb79e2751ac41cdba in current term 1: Already voted for candidate bed294de06e24ca4aba572ec722d2567 in this term.
I20260709 13:07:15.559727 21555 leader_election.cc:304] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:15.560923 22025 consensus_queue.cc:1048] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:15.561136 21863 raft_consensus.cc:2804] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:15.554147 21860 consensus_queue.cc:260] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:15.562301 21663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bb5613fc4c548ccaa3120ba22d4d0f8" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:15.563530 21860 ts_tablet_manager.cc:1434] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.103s	user 0.006s	sys 0.000s
I20260709 13:07:15.564262 21861 tablet_bootstrap.cc:492] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:15.564599 21860 tablet_bootstrap.cc:492] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:15.564800 21861 ts_tablet_manager.cc:1403] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.139s	user 0.009s	sys 0.027s
I20260709 13:07:15.568459 21918 consensus_queue.cc:1048] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:15.568881 21778 leader_election.cc:304] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:15.569975 21918 raft_consensus.cc:3060] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.574584 21863 raft_consensus.cc:697] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:15.574277 21861 raft_consensus.cc:359] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.575239 21859 tablet_bootstrap.cc:492] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:15.575387 21861 raft_consensus.cc:385] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.568033 21489 catalog_manager.cc:5697] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 1 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:15.579934 21858 tablet_bootstrap.cc:654] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.581403 22162 consensus_queue.cc:1048] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:15.575788 21863 consensus_queue.cc:237] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:15.588938 21916 raft_consensus.cc:493] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.589491 21916 raft_consensus.cc:515] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:15.575830 21859 ts_tablet_manager.cc:1403] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.146s	user 0.010s	sys 0.009s
I20260709 13:07:15.575917 21861 raft_consensus.cc:740] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.591526 21916 leader_election.cc:290] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:15.592298 21861 consensus_queue.cc:260] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.594146 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaacd7d18a674b519da25daf5d8040cc" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:15.594815 21738 raft_consensus.cc:2468] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:15.596146 21777 leader_election.cc:304] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:15.600286 22162 raft_consensus.cc:493] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.600932 21916 raft_consensus.cc:2804] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:15.601315 21916 raft_consensus.cc:493] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.601621 21916 raft_consensus.cc:3060] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.603212 21860 tablet_bootstrap.cc:654] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.597406 21664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaacd7d18a674b519da25daf5d8040cc" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:15.609673 21918 raft_consensus.cc:2749] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:15.608690 21916 raft_consensus.cc:515] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:15.595156 21861 ts_tablet_manager.cc:1434] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 13:07:15.593362 21859 raft_consensus.cc:359] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.611737 21859 raft_consensus.cc:385] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.612116 21859 raft_consensus.cc:740] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.613114 21859 consensus_queue.cc:260] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.614861 21859 ts_tablet_manager.cc:1434] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:07:15.615044 21858 tablet_bootstrap.cc:492] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:15.617197 22018 raft_consensus.cc:493] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.600960 22162 raft_consensus.cc:515] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:15.643359 22162 leader_election.cc:290] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:15.626708 21858 ts_tablet_manager.cc:1403] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.000s
I20260709 13:07:15.645094 22017 raft_consensus.cc:493] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.645691 22017 raft_consensus.cc:515] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.647853 22017 leader_election.cc:290] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:15.647747 21858 raft_consensus.cc:359] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.648587 21858 raft_consensus.cc:385] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.648886 21858 raft_consensus.cc:740] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.650806 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaacd7d18a674b519da25daf5d8040cc" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:15.651438 21738 raft_consensus.cc:2468] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 0.
I20260709 13:07:15.637923 21861 tablet_bootstrap.cc:492] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:15.653239 21664 raft_consensus.cc:2468] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:15.655149 21916 leader_election.cc:290] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:15.640872 22018 raft_consensus.cc:515] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.656040 21858 consensus_queue.cc:260] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.660899 21860 tablet_bootstrap.cc:492] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:15.661684 21860 ts_tablet_manager.cc:1403] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.097s	user 0.016s	sys 0.003s
I20260709 13:07:15.663419 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ba1219e0f34c48b4dcb1d1c5e177d0" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:15.664136 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ba1219e0f34c48b4dcb1d1c5e177d0" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:15.664764 21738 raft_consensus.cc:2468] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 0.
W20260709 13:07:15.666651 21555 leader_election.cc:343] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.655644 21662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaacd7d18a674b519da25daf5d8040cc" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:15.674266 21554 leader_election.cc:304] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:15.675228 22017 raft_consensus.cc:2804] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:15.675734 22017 raft_consensus.cc:493] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.676133 22017 raft_consensus.cc:3060] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.679131 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaacd7d18a674b519da25daf5d8040cc" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:15.680087 21811 raft_consensus.cc:2393] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bed294de06e24ca4aba572ec722d2567 in current term 1: Already voted for candidate b8c58d9f32b84e5bb79e2751ac41cdba in this term.
I20260709 13:07:15.680683 21859 tablet_bootstrap.cc:492] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:15.683058 21923 raft_consensus.cc:493] T 832d931fb3f84415aac4b1880e99c498 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.683605 21923 raft_consensus.cc:515] T 832d931fb3f84415aac4b1880e99c498 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.686667 21861 tablet_bootstrap.cc:654] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.688807 21858 ts_tablet_manager.cc:1434] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 13:07:15.691372 21860 raft_consensus.cc:359] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.692066 21860 raft_consensus.cc:385] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.692346 21860 raft_consensus.cc:740] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:15.692935 21860 consensus_queue.cc:260] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.687883 21918 consensus_queue.cc:1048] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:07:15.700397 21923 leader_election.cc:290] T 832d931fb3f84415aac4b1880e99c498 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:15.694053 22018 leader_election.cc:290] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:15.672870 21629 leader_election.cc:304] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:15.717379 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaacd7d18a674b519da25daf5d8040cc" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:15.718087 21738 raft_consensus.cc:3060] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.743229 21858 tablet_bootstrap.cc:492] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:15.741765 21869 raft_consensus.cc:493] T 1e3f4d96c3d04d378fc88e817a7c4069 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:15.753271 22208 log.cc:927] Time spent T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:07:15.742725 22162 raft_consensus.cc:2804] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:15.754796 22162 raft_consensus.cc:493] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.755628 21860 ts_tablet_manager.cc:1434] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.094s	user 0.028s	sys 0.005s
I20260709 13:07:15.755160 22162 raft_consensus.cc:3060] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.758658 21738 raft_consensus.cc:2468] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
W20260709 13:07:15.741534 21629 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:46013, user_credentials={real_user=slave}} blocked reactor thread for 75958.2us
I20260709 13:07:15.762151 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705488f64a3e446babbfe5b0d7bc2122" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:15.762789 21738 raft_consensus.cc:2468] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 0.
I20260709 13:07:15.777261 21861 tablet_bootstrap.cc:492] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:15.777848 21861 ts_tablet_manager.cc:1403] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.154s	user 0.019s	sys 0.000s
I20260709 13:07:15.780711 21487 catalog_manager.cc:5697] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 1 to 2, leader changed from b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196) to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 2 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:15.782958 22018 consensus_queue.cc:1048] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:15.784233 21589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "832d931fb3f84415aac4b1880e99c498" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:15.786096 21554 leader_election.cc:304] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: 
I20260709 13:07:15.770952 21662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "832d931fb3f84415aac4b1880e99c498" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:15.785449 21860 tablet_bootstrap.cc:492] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:15.757409 21869 raft_consensus.cc:515] T 1e3f4d96c3d04d378fc88e817a7c4069 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:15.781212 21861 raft_consensus.cc:359] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:15.792411 21861 raft_consensus.cc:385] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:15.792706 21861 raft_consensus.cc:740] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
W20260709 13:07:15.791726 21704 leader_election.cc:343] T 832d931fb3f84415aac4b1880e99c498 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.795666 21861 consensus_queue.cc:260] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:15.805823 22163 raft_consensus.cc:493] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.806423 22163 raft_consensus.cc:515] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.808475 22163 leader_election.cc:290] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:15.808705 22215 raft_consensus.cc:2804] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:15.816780 21859 tablet_bootstrap.cc:654] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
W20260709 13:07:15.827965 21630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:41173, user_credentials={real_user=slave}} blocked reactor thread for 141082us
I20260709 13:07:15.831902 21860 tablet_bootstrap.cc:654] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.822019 22017 raft_consensus.cc:515] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.835217 22017 leader_election.cc:290] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Requested vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:15.839140 21869 leader_election.cc:290] T 1e3f4d96c3d04d378fc88e817a7c4069 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:15.841336 21486 catalog_manager.cc:5697] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 1 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:15.847873 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705488f64a3e446babbfe5b0d7bc2122" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:15.848658 21740 raft_consensus.cc:2468] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 0.
I20260709 13:07:15.859694 21660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3f4d96c3d04d378fc88e817a7c4069" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:15.859701 22157 raft_consensus.cc:493] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.861815 22157 raft_consensus.cc:515] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:15.866746 21589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705488f64a3e446babbfe5b0d7bc2122" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:15.866791 22018 raft_consensus.cc:493] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.867930 22018 raft_consensus.cc:515] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:15.816452 22215 raft_consensus.cc:493] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.869951 22215 raft_consensus.cc:3060] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.870821 22018 leader_election.cc:290] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
W20260709 13:07:15.873584 21704 leader_election.cc:343] T 1e3f4d96c3d04d378fc88e817a7c4069 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:15.875725 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841639e17c5d4724afe9494276ba00a3" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:15.885676 21861 ts_tablet_manager.cc:1434] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.108s	user 0.008s	sys 0.000s
I20260709 13:07:15.896785 21861 tablet_bootstrap.cc:492] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:15.907903 22157 leader_election.cc:290] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
W20260709 13:07:15.886005 21554 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:46013, user_credentials={real_user=slave}} blocked reactor thread for 100007us
I20260709 13:07:15.922043 21629 leader_election.cc:304] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:15.940840 21861 tablet_bootstrap.cc:654] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:15.943342 21777 leader_election.cc:304] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:15.948153 22162 raft_consensus.cc:515] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:15.951551 22162 leader_election.cc:290] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:15.953671 22220 raft_consensus.cc:493] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:15.954202 22220 raft_consensus.cc:515] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.958563 22220 leader_election.cc:290] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:15.961249 22173 consensus_queue.cc:1048] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:15.939378 22157 raft_consensus.cc:2804] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:15.968250 22157 raft_consensus.cc:493] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:15.968602 22157 raft_consensus.cc:3060] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.968822 21916 raft_consensus.cc:2804] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:15.969511 21916 raft_consensus.cc:697] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:15.970558 21916 consensus_queue.cc:237] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:15.979038 21860 tablet_bootstrap.cc:492] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:15.979849 21860 ts_tablet_manager.cc:1403] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.211s	user 0.024s	sys 0.005s
I20260709 13:07:15.984388 21590 raft_consensus.cc:3060] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.989503 21585 raft_consensus.cc:3060] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:15.991601 22215 raft_consensus.cc:515] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:15.992944 21589 raft_consensus.cc:2393] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bed294de06e24ca4aba572ec722d2567 in current term 1: Already voted for candidate 3f1fa49d04344067941ffd03d9e7d48c in this term.
I20260709 13:07:16.001961 22217 raft_consensus.cc:493] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.002791 22217 raft_consensus.cc:515] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:16.004038 21858 tablet_bootstrap.cc:654] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:16.008569 21663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705488f64a3e446babbfe5b0d7bc2122" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:16.010754 21660 raft_consensus.cc:3060] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:16.014137 21662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "638d06604bc042cf8e846b13dbe634e7" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:16.015254 21662 raft_consensus.cc:2393] T 638d06604bc042cf8e846b13dbe634e7 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f1fa49d04344067941ffd03d9e7d48c in current term 1: Already voted for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in this term.
I20260709 13:07:16.011554 21664 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ba1219e0f34c48b4dcb1d1c5e177d0" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
W20260709 13:07:16.025683 21704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:35853, user_credentials={real_user=slave}} blocked reactor thread for 140810us
I20260709 13:07:16.003262 22215 leader_election.cc:290] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Requested vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:16.009228 22213 consensus_queue.cc:1048] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:07:16.030683 21585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86c9ae384544389aed37a67c0cdb7b7" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:16.033134 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3f4d96c3d04d378fc88e817a7c4069" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:16.034531 21860 raft_consensus.cc:359] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:16.035229 21860 raft_consensus.cc:385] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:16.035678 21860 raft_consensus.cc:740] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:16.043632 21859 tablet_bootstrap.cc:492] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:16.044286 21859 ts_tablet_manager.cc:1403] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.377s	user 0.022s	sys 0.014s
I20260709 13:07:16.053990 21860 consensus_queue.cc:260] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
W20260709 13:07:16.055382 21704 leader_election.cc:343] T 832d931fb3f84415aac4b1880e99c498 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:16.055995 21704 leader_election.cc:304] T 832d931fb3f84415aac4b1880e99c498 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:16.029863 22217 leader_election.cc:290] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:16.074427 22228 raft_consensus.cc:2749] T 832d931fb3f84415aac4b1880e99c498 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:16.076977 22219 consensus_queue.cc:1048] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:16.078166 22162 consensus_queue.cc:1048] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:16.080583 21590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a0bcc4561a4503aebdb0aab6b13b37" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:16.060581 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86c9ae384544389aed37a67c0cdb7b7" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:16.091178 22009 consensus_queue.cc:1048] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:16.093405 21858 tablet_bootstrap.cc:492] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:16.093919 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaacd7d18a674b519da25daf5d8040cc" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
W20260709 13:07:16.097285 21704 leader_election.cc:343] T 1e3f4d96c3d04d378fc88e817a7c4069 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:16.102123 21704 leader_election.cc:304] T 1e3f4d96c3d04d378fc88e817a7c4069 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:16.103538 22227 raft_consensus.cc:2749] T 1e3f4d96c3d04d378fc88e817a7c4069 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:16.105615 21859 raft_consensus.cc:359] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:16.097987 22226 consensus_queue.cc:1048] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:16.100301 21918 consensus_queue.cc:1048] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:16.106601 21858 ts_tablet_manager.cc:1403] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.391s	user 0.015s	sys 0.018s
W20260709 13:07:16.109176 21555 leader_election.cc:343] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:16.123354 21858 raft_consensus.cc:359] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
W20260709 13:07:16.098181 21778 leader_election.cc:343] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:16.124341 21858 raft_consensus.cc:385] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:16.110837 22157 raft_consensus.cc:515] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:16.153771 21663 raft_consensus.cc:2393] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f1fa49d04344067941ffd03d9e7d48c in current term 1: Already voted for candidate bed294de06e24ca4aba572ec722d2567 in this term.
I20260709 13:07:16.130057 22226 consensus_queue.cc:1048] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:16.130362 21813 raft_consensus.cc:1275] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:16.158475 22157 leader_election.cc:290] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:16.132367 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ba1219e0f34c48b4dcb1d1c5e177d0" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:16.164048 21737 raft_consensus.cc:3060] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:16.163884 22215 consensus_queue.cc:1048] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:07:16.167452 21778 consensus_peers.cc:597] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:16.171386 22217 raft_consensus.cc:493] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.132982 21859 raft_consensus.cc:385] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:16.134099 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841639e17c5d4724afe9494276ba00a3" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:16.182643 21859 raft_consensus.cc:740] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:16.188210 22157 raft_consensus.cc:493] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.189131 22157 raft_consensus.cc:515] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:16.134742 21860 ts_tablet_manager.cc:1434] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.155s	user 0.010s	sys 0.000s
I20260709 13:07:16.143136 21660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705488f64a3e446babbfe5b0d7bc2122" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:16.193223 21660 raft_consensus.cc:2393] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f1fa49d04344067941ffd03d9e7d48c in current term 1: Already voted for candidate bed294de06e24ca4aba572ec722d2567 in this term.
I20260709 13:07:16.150231 21736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "638d06604bc042cf8e846b13dbe634e7" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:16.114168 21630 leader_election.cc:304] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:16.196465 22231 raft_consensus.cc:2749] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:16.213183 21630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:41173, user_credentials={real_user=slave}} blocked reactor thread for 99084.6us
I20260709 13:07:16.214509 21859 consensus_queue.cc:260] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:16.218539 21858 raft_consensus.cc:740] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:16.172070 22217 raft_consensus.cc:515] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:16.238480 21858 consensus_queue.cc:260] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:16.243194 22217 leader_election.cc:290] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:16.258903 21860 tablet_bootstrap.cc:492] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:16.260416 21859 ts_tablet_manager.cc:1434] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.216s	user 0.009s	sys 0.003s
I20260709 13:07:16.255594 21486 catalog_manager.cc:5697] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 1 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:16.276136 21858 ts_tablet_manager.cc:1434] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.157s	user 0.008s	sys 0.000s
I20260709 13:07:16.237243 22089 consensus_queue.cc:1048] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 13:07:16.261960 21589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705488f64a3e446babbfe5b0d7bc2122" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:16.353718 21589 raft_consensus.cc:2393] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bed294de06e24ca4aba572ec722d2567 in current term 1: Already voted for candidate 3f1fa49d04344067941ffd03d9e7d48c in this term.
I20260709 13:07:16.354947 21735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705488f64a3e446babbfe5b0d7bc2122" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:16.355677 21735 raft_consensus.cc:3060] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:16.357252 22237 log.cc:927] Time spent T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:07:16.358701 21858 tablet_bootstrap.cc:492] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:16.359306 21859 tablet_bootstrap.cc:492] T 881467b2dd884d22b15e9ac3906b55cc P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:16.363601 21733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eaacd7d18a674b519da25daf5d8040cc" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:16.364604 21733 raft_consensus.cc:2393] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bed294de06e24ca4aba572ec722d2567 in current term 1: Already voted for candidate b8c58d9f32b84e5bb79e2751ac41cdba in this term.
I20260709 13:07:16.285313 21588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317e3221976c47fa913d27f018a21910" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:16.281769 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317e3221976c47fa913d27f018a21910" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:16.431746 22018 raft_consensus.cc:493] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.432348 22018 raft_consensus.cc:515] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:16.434005 21554 leader_election.cc:304] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:16.435061 22222 raft_consensus.cc:2749] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:16.435165 21554 leader_election.cc:304] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:16.436749 21859 tablet_bootstrap.cc:654] T 881467b2dd884d22b15e9ac3906b55cc P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:16.436671 21589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0beed3c60054461a60991c48b418bfc" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:16.437357 22221 raft_consensus.cc:2749] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:16.440922 21858 tablet_bootstrap.cc:654] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:16.383738 22157 leader_election.cc:290] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:16.379217 21735 raft_consensus.cc:2468] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 1.
I20260709 13:07:16.382495 21737 raft_consensus.cc:2468] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 1.
I20260709 13:07:16.457007 21916 raft_consensus.cc:493] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.429262 21811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0beed3c60054461a60991c48b418bfc" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:16.428954 21740 raft_consensus.cc:2468] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:16.457806 21916 raft_consensus.cc:515] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
W20260709 13:07:16.478902 22240 log.cc:927] Time spent T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:07:16.480226 21666 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a0bcc4561a4503aebdb0aab6b13b37" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:16.485661 22018 leader_election.cc:290] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:16.494437 21777 leader_election.cc:304] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:16.496443 21918 raft_consensus.cc:2804] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:16.496837 21918 raft_consensus.cc:493] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.497169 21918 raft_consensus.cc:3060] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:16.497761 22217 raft_consensus.cc:493] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.503953 21916 leader_election.cc:290] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:16.515719 21630 leader_election.cc:304] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:16.498299 22217 raft_consensus.cc:515] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:16.521622 22162 raft_consensus.cc:2749] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:16.522213 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a0bcc4561a4503aebdb0aab6b13b37" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:16.548486 22228 raft_consensus.cc:493] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.542171 21810 raft_consensus.cc:2468] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 0.
I20260709 13:07:16.560571 22228 raft_consensus.cc:515] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:16.578881 22228 leader_election.cc:290] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:16.584299 21665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a0bcc4561a4503aebdb0aab6b13b37" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
W20260709 13:07:16.587395 22241 log.cc:927] Time spent T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c: Append to log took a long time: real 0.301s	user 0.003s	sys 0.000s
I20260709 13:07:16.588514 21858 tablet_bootstrap.cc:492] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:16.589531 21858 ts_tablet_manager.cc:1403] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.231s	user 0.006s	sys 0.017s
I20260709 13:07:16.579100 21859 tablet_bootstrap.cc:492] T 881467b2dd884d22b15e9ac3906b55cc P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:16.590397 21859 ts_tablet_manager.cc:1403] T 881467b2dd884d22b15e9ac3906b55cc P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.231s	user 0.012s	sys 0.034s
W20260709 13:07:16.593102 21555 leader_election.cc:343] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:16.592350 21858 raft_consensus.cc:359] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:16.598803 21858 raft_consensus.cc:385] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:16.600916 21858 raft_consensus.cc:740] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:16.601758 21858 consensus_queue.cc:260] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:16.615851 22217 leader_election.cc:290] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:16.625854 21736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705488f64a3e446babbfe5b0d7bc2122" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:16.626825 21736 raft_consensus.cc:2393] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bed294de06e24ca4aba572ec722d2567 in current term 1: Already voted for candidate 3f1fa49d04344067941ffd03d9e7d48c in this term.
I20260709 13:07:16.629777 21918 raft_consensus.cc:515] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:16.630270 21859 raft_consensus.cc:359] T 881467b2dd884d22b15e9ac3906b55cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:16.631307 21861 tablet_bootstrap.cc:492] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:16.642302 21859 raft_consensus.cc:385] T 881467b2dd884d22b15e9ac3906b55cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:16.642791 21859 raft_consensus.cc:740] T 881467b2dd884d22b15e9ac3906b55cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:16.642999 21861 ts_tablet_manager.cc:1403] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.751s	user 0.017s	sys 0.011s
I20260709 13:07:16.643646 21858 ts_tablet_manager.cc:1434] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.054s	user 0.001s	sys 0.006s
I20260709 13:07:16.652724 21858 tablet_bootstrap.cc:492] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:16.632766 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c6b2be38fb47e7a92c9b1b7f9678d7" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:16.657971 21860 tablet_bootstrap.cc:654] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:16.652766 21861 raft_consensus.cc:359] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:16.658506 21861 raft_consensus.cc:385] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:16.658847 21861 raft_consensus.cc:740] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:16.659384 21918 leader_election.cc:290] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:16.659554 21861 consensus_queue.cc:260] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:16.660589 21859 consensus_queue.cc:260] T 881467b2dd884d22b15e9ac3906b55cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:16.666884 21859 ts_tablet_manager.cc:1434] T 881467b2dd884d22b15e9ac3906b55cc P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.003s
I20260709 13:07:16.667972 21859 tablet_bootstrap.cc:492] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:16.632033 21629 leader_election.cc:304] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:16.669899 22245 raft_consensus.cc:2749] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:16.671389 21861 ts_tablet_manager.cc:1434] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.002s
I20260709 13:07:16.664865 21858 tablet_bootstrap.cc:654] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:16.679750 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23660cfe7a7e49db942526440533cdf9" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:16.685603 21554 leader_election.cc:304] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:16.687129 21554 leader_election.cc:304] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: bed294de06e24ca4aba572ec722d2567
W20260709 13:07:16.695701 21778 leader_election.cc:343] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:16.700027 21704 leader_election.cc:343] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:16.706650 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ca21ec420f4843b276f4f15b2b0f1b" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:16.707732 21591 raft_consensus.cc:2468] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:16.689982 22220 raft_consensus.cc:2804] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:16.716465 21861 tablet_bootstrap.cc:492] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:16.719616 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317e3221976c47fa913d27f018a21910" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
W20260709 13:07:16.717406 21778 leader_election.cc:343] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:16.724346 21778 leader_election.cc:304] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:16.726079 21916 raft_consensus.cc:2804] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:16.726615 21916 raft_consensus.cc:493] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.727031 21916 raft_consensus.cc:3060] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:16.729614 21778 leader_election.cc:343] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:16.741112 21778 leader_election.cc:343] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:16.741780 21778 leader_election.cc:304] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:16.723426 21660 raft_consensus.cc:1275] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:16.733353 22246 raft_consensus.cc:2804] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:16.726305 22220 raft_consensus.cc:697] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:16.797675 21586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c6b2be38fb47e7a92c9b1b7f9678d7" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:16.804682 21555 leader_election.cc:304] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:16.771541 22213 raft_consensus.cc:2749] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:16.794786 21923 raft_consensus.cc:493] T 881467b2dd884d22b15e9ac3906b55cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:16.817927 21923 raft_consensus.cc:515] T 881467b2dd884d22b15e9ac3906b55cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:16.820794 21923 leader_election.cc:290] T 881467b2dd884d22b15e9ac3906b55cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:16.809360 22246 raft_consensus.cc:697] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:16.821385 21863 raft_consensus.cc:2804] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:07:16.853302 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:35853, user_credentials={real_user=slave}} blocked reactor thread for 97513.1us
I20260709 13:07:16.778417 21629 leader_election.cc:304] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:16.854622 21860 tablet_bootstrap.cc:492] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:16.862619 21860 ts_tablet_manager.cc:1403] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.613s	user 0.032s	sys 0.023s
W20260709 13:07:16.855018 21704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:35255, user_credentials={real_user=slave}} blocked reactor thread for 132325us
I20260709 13:07:16.864364 21858 tablet_bootstrap.cc:492] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:16.837515 21863 raft_consensus.cc:493] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:16.865823 21858 ts_tablet_manager.cc:1403] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.213s	user 0.025s	sys 0.038s
W20260709 13:07:16.870626 21629 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:46013, user_credentials={real_user=slave}} blocked reactor thread for 135481us
I20260709 13:07:16.870724 22246 consensus_queue.cc:237] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:16.873325 21661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881467b2dd884d22b15e9ac3906b55cc" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:16.873986 21916 raft_consensus.cc:515] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:16.875897 21916 leader_election.cc:290] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:16.876854 21859 tablet_bootstrap.cc:654] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:16.876715 22163 raft_consensus.cc:2749] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:16.885648 21657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23660cfe7a7e49db942526440533cdf9" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:16.886572 21662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ca21ec420f4843b276f4f15b2b0f1b" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:16.885654 22220 consensus_queue.cc:237] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:16.868336 21863 raft_consensus.cc:3060] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:16.891443 21555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:35853, user_credentials={real_user=slave}} blocked reactor thread for 54658.1us
I20260709 13:07:16.897018 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317e3221976c47fa913d27f018a21910" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:16.897897 21740 raft_consensus.cc:3060] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:16.900542 22018 consensus_queue.cc:1048] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:07:16.913594 21778 leader_election.cc:343] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:16.915184 21778 leader_election.cc:304] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:16.920759 21916 raft_consensus.cc:2749] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:16.922132 21778 leader_election.cc:343] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:16.927714 21918 consensus_queue.cc:1048] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:16.932710 21590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ca21ec420f4843b276f4f15b2b0f1b" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:16.933357 21590 raft_consensus.cc:3060] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:16.935639 21740 raft_consensus.cc:2468] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:16.949772 21662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ca21ec420f4843b276f4f15b2b0f1b" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:16.979650 21858 raft_consensus.cc:359] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:16.980764 21858 raft_consensus.cc:385] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:16.981117 21858 raft_consensus.cc:740] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:16.983070 21863 raft_consensus.cc:515] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:16.986096 21858 consensus_queue.cc:260] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:17.000411 21590 raft_consensus.cc:2468] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:17.016741 21861 tablet_bootstrap.cc:654] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:17.021726 21859 tablet_bootstrap.cc:492] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:17.022279 21859 ts_tablet_manager.cc:1403] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.355s	user 0.014s	sys 0.006s
I20260709 13:07:17.023198 21812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881467b2dd884d22b15e9ac3906b55cc" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
W20260709 13:07:17.022182 21778 leader_election.cc:343] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:17.029826 21860 raft_consensus.cc:359] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:17.030855 21860 raft_consensus.cc:385] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:17.031176 21860 raft_consensus.cc:740] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:17.031946 21860 consensus_queue.cc:260] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:17.034754 21860 ts_tablet_manager.cc:1434] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.172s	user 0.007s	sys 0.000s
I20260709 13:07:17.036006 21860 tablet_bootstrap.cc:492] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:17.039577 21777 leader_election.cc:304] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:17.041129 21863 leader_election.cc:290] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:17.043047 21858 ts_tablet_manager.cc:1434] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.176s	user 0.009s	sys 0.000s
I20260709 13:07:17.052971 21778 leader_election.cc:304] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:17.052202 22025 raft_consensus.cc:2804] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:17.066812 22213 raft_consensus.cc:2804] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:17.088308 22213 raft_consensus.cc:697] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:17.089982 22213 consensus_queue.cc:237] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:17.096426 21859 raft_consensus.cc:359] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
W20260709 13:07:17.098930 21704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:41173, user_credentials={real_user=slave}} blocked reactor thread for 203791us
I20260709 13:07:17.085542 22025 raft_consensus.cc:697] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
W20260709 13:07:17.100781 21704 leader_election.cc:343] T 881467b2dd884d22b15e9ac3906b55cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:17.103118 21858 tablet_bootstrap.cc:492] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:17.100406 22025 consensus_queue.cc:237] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:17.113453 21916 consensus_queue.cc:1048] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:17.097414 21859 raft_consensus.cc:385] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:17.118045 21859 raft_consensus.cc:740] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:17.121248 21859 consensus_queue.cc:260] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
W20260709 13:07:17.126235 21704 leader_election.cc:343] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:17.126947 21704 leader_election.cc:304] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
W20260709 13:07:17.130530 21555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:41173, user_credentials={real_user=slave}} blocked reactor thread for 137073us
W20260709 13:07:17.149475 21704 leader_election.cc:343] T 881467b2dd884d22b15e9ac3906b55cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:17.158257 21704 leader_election.cc:304] T 881467b2dd884d22b15e9ac3906b55cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:17.171685 21859 ts_tablet_manager.cc:1434] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.149s	user 0.008s	sys 0.000s
I20260709 13:07:17.142385 22261 raft_consensus.cc:2749] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:17.175401 21629 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:46013, user_credentials={real_user=slave}} blocked reactor thread for 58181.5us
I20260709 13:07:17.165716 22231 raft_consensus.cc:493] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.168673 22228 raft_consensus.cc:2749] T 881467b2dd884d22b15e9ac3906b55cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:17.182488 21861 tablet_bootstrap.cc:492] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:17.183385 21861 ts_tablet_manager.cc:1403] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.467s	user 0.033s	sys 0.022s
I20260709 13:07:17.171383 21923 raft_consensus.cc:493] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.184793 21923 raft_consensus.cc:515] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:17.186969 21923 leader_election.cc:290] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:17.189118 21858 tablet_bootstrap.cc:654] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:17.191418 21860 tablet_bootstrap.cc:654] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:17.184536 22213 raft_consensus.cc:493] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.196849 22213 raft_consensus.cc:515] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:17.198532 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a0bcc4561a4503aebdb0aab6b13b37" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:17.199286 21809 raft_consensus.cc:3060] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:17.201663 21736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c6b2be38fb47e7a92c9b1b7f9678d7" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:17.202479 21736 raft_consensus.cc:2468] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:17.183635 22231 raft_consensus.cc:515] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:17.206132 21777 leader_election.cc:304] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:17.207343 21918 raft_consensus.cc:2804] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:17.207698 21918 raft_consensus.cc:493] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.207844 22231 leader_election.cc:290] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:17.208020 21918 raft_consensus.cc:3060] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:17.214510 21584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "832d931fb3f84415aac4b1880e99c498" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:17.221948 21590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c6b2be38fb47e7a92c9b1b7f9678d7" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:17.223519 21661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a0bcc4561a4503aebdb0aab6b13b37" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:17.223863 21736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "832d931fb3f84415aac4b1880e99c498" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:17.224627 21736 raft_consensus.cc:2468] T 832d931fb3f84415aac4b1880e99c498 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 0.
W20260709 13:07:17.225907 21778 leader_election.cc:343] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:17.226490 21555 leader_election.cc:343] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:17.234810 21630 leader_election.cc:343] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:17.240100 21629 leader_election.cc:304] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:17.256929 22231 raft_consensus.cc:2804] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:17.257690 22231 raft_consensus.cc:493] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.258157 22231 raft_consensus.cc:3060] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:17.264485 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c18f9e23544d00a8d1cf17afda03c5" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:17.249620 22213 leader_election.cc:290] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:17.274278 21918 raft_consensus.cc:515] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
W20260709 13:07:17.299742 21704 leader_election.cc:343] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:17.300220 21537 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:17.301743 21859 tablet_bootstrap.cc:492] T 1ed9b20099494a8c94a51f76692a8ec0 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:17.312144 21861 raft_consensus.cc:359] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:17.312950 21861 raft_consensus.cc:385] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:17.313195 21861 raft_consensus.cc:740] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:17.313884 21861 consensus_queue.cc:260] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:17.315405 21861 ts_tablet_manager.cc:1434] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.132s	user 0.005s	sys 0.000s
I20260709 13:07:17.316329 21861 tablet_bootstrap.cc:492] T 69ca21ec420f4843b276f4f15b2b0f1b P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:17.319674 21662 raft_consensus.cc:3060] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:17.320588 22231 raft_consensus.cc:515] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:17.322130 21809 raft_consensus.cc:2468] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 1.
I20260709 13:07:17.323372 21555 leader_election.cc:304] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:17.324450 22220 raft_consensus.cc:2804] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:17.324920 22220 raft_consensus.cc:697] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:17.325806 22220 consensus_queue.cc:237] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:17.327200 21736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "832d931fb3f84415aac4b1880e99c498" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:17.327812 21736 raft_consensus.cc:3060] T 832d931fb3f84415aac4b1880e99c498 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:17.328344 21918 leader_election.cc:290] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:17.329015 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c6b2be38fb47e7a92c9b1b7f9678d7" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
W20260709 13:07:17.330948 21778 leader_election.cc:343] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:17.332316 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c6b2be38fb47e7a92c9b1b7f9678d7" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:17.332964 21737 raft_consensus.cc:3060] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:17.339303 22231 leader_election.cc:290] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:17.349583 21657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c18f9e23544d00a8d1cf17afda03c5" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:17.352365 21736 raft_consensus.cc:2468] T 832d931fb3f84415aac4b1880e99c498 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 1.
I20260709 13:07:17.354393 22273 consensus_queue.cc:1048] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:17.359588 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "832d931fb3f84415aac4b1880e99c498" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:17.360001 21859 tablet_bootstrap.cc:654] T 1ed9b20099494a8c94a51f76692a8ec0 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:17.397161 21629 leader_election.cc:304] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:17.398356 22231 raft_consensus.cc:2804] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:17.398901 22231 raft_consensus.cc:697] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 [term 1 LEADER]: Becoming Leader. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Running, Role: LEADER
I20260709 13:07:17.361953 21858 tablet_bootstrap.cc:492] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:17.400708 21858 ts_tablet_manager.cc:1403] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.298s	user 0.012s	sys 0.002s
I20260709 13:07:17.400612 22231 consensus_queue.cc:237] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
W20260709 13:07:17.402316 21630 leader_election.cc:343] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:17.403463 21858 raft_consensus.cc:359] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:17.404183 21858 raft_consensus.cc:385] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:17.404453 21858 raft_consensus.cc:740] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:17.405534 21861 tablet_bootstrap.cc:654] T 69ca21ec420f4843b276f4f15b2b0f1b P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:17.369745 21585 raft_consensus.cc:3060] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:17.365314 21489 catalog_manager.cc:5697] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 1 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:17.411019 21489 catalog_manager.cc:5697] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 1 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:17.377657 21704 leader_election.cc:343] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:17.415135 21704 leader_election.cc:304] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:17.385156 21860 tablet_bootstrap.cc:492] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:17.416252 21923 raft_consensus.cc:2749] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:17.416375 21860 ts_tablet_manager.cc:1403] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.381s	user 0.011s	sys 0.027s
I20260709 13:07:17.405088 21858 consensus_queue.cc:260] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:17.421238 21858 ts_tablet_manager.cc:1434] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:07:17.426596 21858 tablet_bootstrap.cc:492] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:17.345352 21737 raft_consensus.cc:2468] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:17.429862 21860 raft_consensus.cc:359] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:17.430413 21777 leader_election.cc:304] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:17.430855 21860 raft_consensus.cc:385] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:17.431219 21860 raft_consensus.cc:740] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:17.432224 21860 consensus_queue.cc:260] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:17.432941 22273 consensus_queue.cc:1048] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:17.433266 22025 raft_consensus.cc:2804] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:17.434396 21860 ts_tablet_manager.cc:1434] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.004s
I20260709 13:07:17.434404 22025 raft_consensus.cc:697] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:17.436687 22025 consensus_queue.cc:237] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:17.435854 21860 tablet_bootstrap.cc:492] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:17.445434 21860 tablet_bootstrap.cc:654] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:17.461899 22220 consensus_queue.cc:1048] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:17.462477 21860 tablet_bootstrap.cc:492] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:17.462972 21860 ts_tablet_manager.cc:1403] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.004s
I20260709 13:07:17.463702 22273 consensus_queue.cc:1048] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:17.465862 21860 raft_consensus.cc:359] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:17.466665 21860 raft_consensus.cc:385] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:17.467101 21860 raft_consensus.cc:740] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:17.473289 21859 tablet_bootstrap.cc:492] T 1ed9b20099494a8c94a51f76692a8ec0 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:17.467870 21860 consensus_queue.cc:260] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:17.480290 21860 ts_tablet_manager.cc:1434] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 13:07:17.480424 21858 tablet_bootstrap.cc:654] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:17.481506 21860 tablet_bootstrap.cc:492] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:17.478503 21859 ts_tablet_manager.cc:1403] T 1ed9b20099494a8c94a51f76692a8ec0 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.177s	user 0.016s	sys 0.006s
I20260709 13:07:17.495589 21860 tablet_bootstrap.cc:654] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:17.488826 21859 raft_consensus.cc:359] T 1ed9b20099494a8c94a51f76692a8ec0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:17.498847 21859 raft_consensus.cc:385] T 1ed9b20099494a8c94a51f76692a8ec0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:17.500864 21859 raft_consensus.cc:740] T 1ed9b20099494a8c94a51f76692a8ec0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:17.506789 21859 consensus_queue.cc:260] T 1ed9b20099494a8c94a51f76692a8ec0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:17.513602 21858 tablet_bootstrap.cc:492] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:17.516494 21860 tablet_bootstrap.cc:492] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:17.521999 22025 consensus_queue.cc:1048] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:17.525092 21860 ts_tablet_manager.cc:1403] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.044s	user 0.011s	sys 0.004s
I20260709 13:07:17.528236 21860 raft_consensus.cc:359] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:17.528890 21860 raft_consensus.cc:385] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:17.535383 22025 raft_consensus.cc:493] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.536213 22025 raft_consensus.cc:515] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:17.538691 21858 ts_tablet_manager.cc:1403] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.112s	user 0.016s	sys 0.000s
I20260709 13:07:17.529273 21860 raft_consensus.cc:740] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:17.544687 21860 consensus_queue.cc:260] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:17.547402 21860 ts_tablet_manager.cc:1434] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260709 13:07:17.547799 21736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3f4d96c3d04d378fc88e817a7c4069" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:17.548489 21736 raft_consensus.cc:2468] T 1e3f4d96c3d04d378fc88e817a7c4069 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:17.545212 22025 leader_election.cc:290] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:17.550151 21777 leader_election.cc:304] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:17.548498 21860 tablet_bootstrap.cc:492] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:17.551530 21918 raft_consensus.cc:2804] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:17.552054 21918 raft_consensus.cc:493] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.552404 21918 raft_consensus.cc:3060] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:17.551749 22025 consensus_queue.cc:1048] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:07:17.554605 21859 ts_tablet_manager.cc:1434] T 1ed9b20099494a8c94a51f76692a8ec0 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.001s
I20260709 13:07:17.562036 21859 tablet_bootstrap.cc:492] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:17.562793 21858 raft_consensus.cc:359] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:17.564492 21860 tablet_bootstrap.cc:654] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:17.572623 21662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3f4d96c3d04d378fc88e817a7c4069" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:17.601990 21861 tablet_bootstrap.cc:492] T 69ca21ec420f4843b276f4f15b2b0f1b P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
W20260709 13:07:17.584362 21778 consensus_peers.cc:597] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:17.603034 21778 leader_election.cc:343] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:17.606217 21861 ts_tablet_manager.cc:1403] T 69ca21ec420f4843b276f4f15b2b0f1b P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.290s	user 0.014s	sys 0.004s
I20260709 13:07:17.609190 21861 raft_consensus.cc:359] T 69ca21ec420f4843b276f4f15b2b0f1b P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:17.609982 21861 raft_consensus.cc:385] T 69ca21ec420f4843b276f4f15b2b0f1b P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:17.610281 21861 raft_consensus.cc:740] T 69ca21ec420f4843b276f4f15b2b0f1b P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:17.613103 21860 tablet_bootstrap.cc:492] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:17.613682 21860 ts_tablet_manager.cc:1403] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.009s
I20260709 13:07:17.615079 21861 consensus_queue.cc:260] T 69ca21ec420f4843b276f4f15b2b0f1b P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:17.617444 21861 ts_tablet_manager.cc:1434] T 69ca21ec420f4843b276f4f15b2b0f1b P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:07:17.618510 21861 tablet_bootstrap.cc:492] T 1681a1e8015648a692b9a5eacbbf9d6e P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:17.593946 21859 tablet_bootstrap.cc:654] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:17.576236 21858 raft_consensus.cc:385] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:17.621803 21858 raft_consensus.cc:740] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:17.571678 21918 raft_consensus.cc:515] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:17.638782 21858 consensus_queue.cc:260] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:17.642998 21858 ts_tablet_manager.cc:1434] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.103s	user 0.008s	sys 0.006s
I20260709 13:07:17.644061 21858 tablet_bootstrap.cc:492] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:17.643801 21860 raft_consensus.cc:359] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:17.644631 21860 raft_consensus.cc:385] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:17.644937 21860 raft_consensus.cc:740] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:17.649101 21662 raft_consensus.cc:3060] T 69ca21ec420f4843b276f4f15b2b0f1b P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:17.654662 21661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3f4d96c3d04d378fc88e817a7c4069" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
W20260709 13:07:17.657267 21778 leader_election.cc:343] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:17.662020 21860 consensus_queue.cc:260] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:17.667726 22219 raft_consensus.cc:493] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.669284 21858 tablet_bootstrap.cc:654] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:17.667774 22213 consensus_queue.cc:1048] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:07:17.668965 22219 raft_consensus.cc:515] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:17.674957 22219 leader_election.cc:290] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:17.678862 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e3f4d96c3d04d378fc88e817a7c4069" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:17.689307 21735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881467b2dd884d22b15e9ac3906b55cc" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:17.690214 21735 raft_consensus.cc:2468] T 881467b2dd884d22b15e9ac3906b55cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:17.691790 21860 ts_tablet_manager.cc:1434] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.078s	user 0.010s	sys 0.002s
I20260709 13:07:17.692901 21860 tablet_bootstrap.cc:492] T b5745aab7e6c4a409a0ac98725e4e4c9 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:17.692678 21657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881467b2dd884d22b15e9ac3906b55cc" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:17.679610 21737 raft_consensus.cc:3060] T 1e3f4d96c3d04d378fc88e817a7c4069 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:17.664758 21861 tablet_bootstrap.cc:654] T 1681a1e8015648a692b9a5eacbbf9d6e P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:17.695681 21488 catalog_manager.cc:5697] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 1 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:17.698064 21488 catalog_manager.cc:5697] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 1 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:17.699872 21859 tablet_bootstrap.cc:492] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:17.703156 21859 ts_tablet_manager.cc:1403] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.141s	user 0.014s	sys 0.003s
W20260709 13:07:17.701625 21778 leader_election.cc:343] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:17.706642 21859 raft_consensus.cc:359] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:17.707306 21859 raft_consensus.cc:385] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:17.707590 21859 raft_consensus.cc:740] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:17.708449 21777 leader_election.cc:304] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:17.709293 22219 raft_consensus.cc:2804] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:17.709159 21859 consensus_queue.cc:260] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:17.709663 22219 raft_consensus.cc:493] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:17.710049 22219 raft_consensus.cc:3060] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:17.717870 21859 ts_tablet_manager.cc:1434] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:07:17.718978 21859 tablet_bootstrap.cc:492] T 008742eefeb947f5a1f7decfb821a03d P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:17.725144 21859 tablet_bootstrap.cc:654] T 008742eefeb947f5a1f7decfb821a03d P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:17.726680 22219 raft_consensus.cc:515] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:17.728993 21860 tablet_bootstrap.cc:654] T b5745aab7e6c4a409a0ac98725e4e4c9 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:17.732509 21657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881467b2dd884d22b15e9ac3906b55cc" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
W20260709 13:07:17.733759 21778 leader_election.cc:343] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:17.731757 22219 leader_election.cc:290] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:17.741731 21918 leader_election.cc:290] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
W20260709 13:07:17.736965 21630 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:35255, user_credentials={real_user=slave}} blocked reactor thread for 67857.5us
I20260709 13:07:17.751787 21735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881467b2dd884d22b15e9ac3906b55cc" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:17.752518 21735 raft_consensus.cc:3060] T 881467b2dd884d22b15e9ac3906b55cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:17.755483 22219 raft_consensus.cc:493] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.756105 22219 raft_consensus.cc:515] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:17.760435 21587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba04167743094b89ba6e3596a48aba86" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
W20260709 13:07:17.762640 21778 leader_election.cc:343] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:17.765707 21657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba04167743094b89ba6e3596a48aba86" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:17.766428 22219 leader_election.cc:290] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:17.768064 21858 tablet_bootstrap.cc:492] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:17.768621 21858 ts_tablet_manager.cc:1403] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.125s	user 0.012s	sys 0.008s
W20260709 13:07:17.769047 21778 leader_election.cc:343] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:17.769548 21778 leader_election.cc:304] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:17.771410 21860 tablet_bootstrap.cc:492] T b5745aab7e6c4a409a0ac98725e4e4c9 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:17.771950 21860 ts_tablet_manager.cc:1403] T b5745aab7e6c4a409a0ac98725e4e4c9 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.079s	user 0.021s	sys 0.004s
I20260709 13:07:17.771735 21858 raft_consensus.cc:359] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:17.772603 21858 raft_consensus.cc:385] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:17.773227 21858 raft_consensus.cc:740] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:17.773764 22219 raft_consensus.cc:2749] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:17.689502 21555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:41173, user_credentials={real_user=slave}} blocked reactor thread for 48031.8us
I20260709 13:07:17.781850 21860 raft_consensus.cc:359] T b5745aab7e6c4a409a0ac98725e4e4c9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:17.782903 21860 raft_consensus.cc:385] T b5745aab7e6c4a409a0ac98725e4e4c9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:17.783293 21860 raft_consensus.cc:740] T b5745aab7e6c4a409a0ac98725e4e4c9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:17.787281 21860 consensus_queue.cc:260] T b5745aab7e6c4a409a0ac98725e4e4c9 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:17.789400 21860 ts_tablet_manager.cc:1434] T b5745aab7e6c4a409a0ac98725e4e4c9 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:07:17.794589 21860 tablet_bootstrap.cc:492] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba: Bootstrap starting.
I20260709 13:07:17.794401 21858 consensus_queue.cc:260] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:17.796808 21858 ts_tablet_manager.cc:1434] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:07:17.810822 21860 tablet_bootstrap.cc:654] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:17.818346 21737 raft_consensus.cc:2468] T 1e3f4d96c3d04d378fc88e817a7c4069 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:17.824216 21777 leader_election.cc:304] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:17.826561 22219 raft_consensus.cc:2804] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:17.827353 22219 raft_consensus.cc:697] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:17.828322 22219 consensus_queue.cc:237] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:17.832674 21861 tablet_bootstrap.cc:492] T 1681a1e8015648a692b9a5eacbbf9d6e P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:17.833251 21861 ts_tablet_manager.cc:1403] T 1681a1e8015648a692b9a5eacbbf9d6e P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.215s	user 0.018s	sys 0.011s
I20260709 13:07:17.834327 21858 tablet_bootstrap.cc:492] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:17.837237 21735 raft_consensus.cc:2468] T 881467b2dd884d22b15e9ac3906b55cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
W20260709 13:07:17.850041 21630 consensus_peers.cc:597] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:17.836073 21861 raft_consensus.cc:359] T 1681a1e8015648a692b9a5eacbbf9d6e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:17.854133 21861 raft_consensus.cc:385] T 1681a1e8015648a692b9a5eacbbf9d6e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:17.854588 21861 raft_consensus.cc:740] T 1681a1e8015648a692b9a5eacbbf9d6e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:17.852919 21777 leader_election.cc:304] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:17.856072 21488 catalog_manager.cc:5697] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 reported cstate change: term changed from 0 to 1, leader changed from <none> to bed294de06e24ca4aba572ec722d2567 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "bed294de06e24ca4aba572ec722d2567" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:17.856926 21861 consensus_queue.cc:260] T 1681a1e8015648a692b9a5eacbbf9d6e P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:17.859086 22213 raft_consensus.cc:493] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.859874 22213 raft_consensus.cc:515] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:17.862176 21858 tablet_bootstrap.cc:654] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:17.865041 21918 raft_consensus.cc:2804] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:17.865621 21918 raft_consensus.cc:697] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:17.866849 22213 leader_election.cc:290] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:17.869727 21916 consensus_queue.cc:1048] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:17.866544 21918 consensus_queue.cc:237] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:17.876579 21585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008742eefeb947f5a1f7decfb821a03d" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
W20260709 13:07:17.887068 21778 leader_election.cc:343] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:17.888978 21486 catalog_manager.cc:5697] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 1 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:17.895545 21859 tablet_bootstrap.cc:492] T 008742eefeb947f5a1f7decfb821a03d P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:17.896092 21859 ts_tablet_manager.cc:1403] T 008742eefeb947f5a1f7decfb821a03d P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.177s	user 0.021s	sys 0.021s
I20260709 13:07:17.899946 21859 raft_consensus.cc:359] T 008742eefeb947f5a1f7decfb821a03d P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:17.900869 21859 raft_consensus.cc:385] T 008742eefeb947f5a1f7decfb821a03d P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:17.901191 21859 raft_consensus.cc:740] T 008742eefeb947f5a1f7decfb821a03d P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:17.902724 21861 ts_tablet_manager.cc:1434] T 1681a1e8015648a692b9a5eacbbf9d6e P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.069s	user 0.009s	sys 0.000s
I20260709 13:07:17.894649 22220 raft_consensus.cc:493] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.912791 21859 consensus_queue.cc:260] T 008742eefeb947f5a1f7decfb821a03d P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:17.916409 21861 tablet_bootstrap.cc:492] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:17.919698 21859 ts_tablet_manager.cc:1434] T 008742eefeb947f5a1f7decfb821a03d P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.002s
W20260709 13:07:17.921124 21555 consensus_peers.cc:597] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:17.911113 22228 raft_consensus.cc:493] T 1ed9b20099494a8c94a51f76692a8ec0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.922500 22228 raft_consensus.cc:515] T 1ed9b20099494a8c94a51f76692a8ec0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:17.922976 21736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008742eefeb947f5a1f7decfb821a03d" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:17.923868 21736 raft_consensus.cc:2468] T 008742eefeb947f5a1f7decfb821a03d P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:17.924598 22228 leader_election.cc:290] T 1ed9b20099494a8c94a51f76692a8ec0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
W20260709 13:07:17.927145 21778 consensus_peers.cc:597] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:17.920426 22231 raft_consensus.cc:493] T 1681a1e8015648a692b9a5eacbbf9d6e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.919216 22220 raft_consensus.cc:515] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:17.937844 22220 leader_election.cc:290] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:17.935916 22231 raft_consensus.cc:515] T 1681a1e8015648a692b9a5eacbbf9d6e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:17.935873 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed9b20099494a8c94a51f76692a8ec0" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:17.944288 22270 consensus_queue.cc:1048] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:17.944741 21585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed9b20099494a8c94a51f76692a8ec0" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:17.945192 21860 tablet_bootstrap.cc:492] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba: No bootstrap required, opened a new log
I20260709 13:07:17.945686 21860 ts_tablet_manager.cc:1403] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent bootstrapping tablet: real 0.151s	user 0.026s	sys 0.010s
I20260709 13:07:17.947772 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23660cfe7a7e49db942526440533cdf9" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:17.948455 21809 raft_consensus.cc:2468] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 0.
I20260709 13:07:17.942461 22276 raft_consensus.cc:493] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.950407 22231 leader_election.cc:290] T 1681a1e8015648a692b9a5eacbbf9d6e P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:17.932508 22273 raft_consensus.cc:493] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.950565 22276 raft_consensus.cc:515] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:17.951145 22273 raft_consensus.cc:515] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:17.953284 22276 leader_election.cc:290] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:17.953816 21858 tablet_bootstrap.cc:492] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:17.954322 21858 ts_tablet_manager.cc:1403] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.120s	user 0.008s	sys 0.007s
I20260709 13:07:17.956254 22270 raft_consensus.cc:493] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:17.956887 22270 raft_consensus.cc:515] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:17.959442 22270 leader_election.cc:290] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:17.959774 21660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23660cfe7a7e49db942526440533cdf9" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:17.960916 21658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c18f9e23544d00a8d1cf17afda03c5" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:17.984831 21858 raft_consensus.cc:359] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:17.985141 21555 leader_election.cc:304] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:17.985687 21858 raft_consensus.cc:385] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:17.986028 21858 raft_consensus.cc:740] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:17.986101 21859 tablet_bootstrap.cc:492] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5: Bootstrap starting.
I20260709 13:07:17.988163 21777 leader_election.cc:304] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:17.994429 21858 consensus_queue.cc:260] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:17.994014 21658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba04167743094b89ba6e3596a48aba86" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:17.996515 21861 tablet_bootstrap.cc:654] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:17.994233 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5745aab7e6c4a409a0ac98725e4e4c9" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:18.001171 21814 raft_consensus.cc:2468] T b5745aab7e6c4a409a0ac98725e4e4c9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 0.
I20260709 13:07:18.000778 21735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c18f9e23544d00a8d1cf17afda03c5" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:18.001951 21735 raft_consensus.cc:2468] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 0.
I20260709 13:07:18.003120 21661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5745aab7e6c4a409a0ac98725e4e4c9" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:18.004364 21859 tablet_bootstrap.cc:654] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:17.978339 22273 leader_election.cc:290] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:18.005853 21860 raft_consensus.cc:359] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:18.007442 21860 raft_consensus.cc:385] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:18.007719 21860 raft_consensus.cc:740] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Initialized, Role: FOLLOWER
I20260709 13:07:18.008581 21858 ts_tablet_manager.cc:1434] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.054s	user 0.010s	sys 0.000s
I20260709 13:07:18.008490 21860 consensus_queue.cc:260] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:18.009392 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba04167743094b89ba6e3596a48aba86" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:18.010089 21810 raft_consensus.cc:2468] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 0.
I20260709 13:07:18.012108 21858 tablet_bootstrap.cc:492] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:17.995885 22220 raft_consensus.cc:2804] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:18.018033 22220 raft_consensus.cc:493] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.012928 21554 leader_election.cc:304] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: 
I20260709 13:07:18.013859 21487 catalog_manager.cc:5697] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 1 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:18.021694 22231 consensus_queue.cc:1048] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:07:18.024237 21555 leader_election.cc:343] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:18.019593 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681a1e8015648a692b9a5eacbbf9d6e" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
W20260709 13:07:18.026197 21555 leader_election.cc:343] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:18.028811 21860 ts_tablet_manager.cc:1434] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.000s
W20260709 13:07:18.027068 21555 leader_election.cc:343] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:18.029906 22173 raft_consensus.cc:2804] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:18.030017 22220 raft_consensus.cc:3060] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:18.031330 22270 raft_consensus.cc:2804] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:07:18.042212 21704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:35853, user_credentials={real_user=slave}} blocked reactor thread for 79188.4us
I20260709 13:07:18.070667 22323 raft_consensus.cc:493] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.083664 21555 leader_election.cc:304] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: bed294de06e24ca4aba572ec722d2567
W20260709 13:07:18.092948 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:35255, user_credentials={real_user=slave}} blocked reactor thread for 50936.3us
W20260709 13:07:18.090540 21704 leader_election.cc:343] T 1ed9b20099494a8c94a51f76692a8ec0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:18.096863 21704 leader_election.cc:343] T 1ed9b20099494a8c94a51f76692a8ec0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:18.097430 21704 leader_election.cc:304] T 1ed9b20099494a8c94a51f76692a8ec0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:18.101244 21704 leader_election.cc:304] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:18.038535 22173 raft_consensus.cc:493] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.088218 21585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681a1e8015648a692b9a5eacbbf9d6e" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
W20260709 13:07:18.107064 21629 leader_election.cc:343] T 1681a1e8015648a692b9a5eacbbf9d6e P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:18.088384 22270 raft_consensus.cc:493] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.103192 22273 raft_consensus.cc:2804] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:18.111143 22173 raft_consensus.cc:3060] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:18.105846 22319 raft_consensus.cc:2749] T 1ed9b20099494a8c94a51f76692a8ec0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:18.116657 22270 raft_consensus.cc:3060] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:18.122289 22273 raft_consensus.cc:493] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.139051 22273 raft_consensus.cc:3060] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:18.144266 21859 tablet_bootstrap.cc:492] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5: No bootstrap required, opened a new log
I20260709 13:07:18.144938 21859 ts_tablet_manager.cc:1403] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent bootstrapping tablet: real 0.159s	user 0.020s	sys 0.032s
I20260709 13:07:18.145315 21861 tablet_bootstrap.cc:492] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:18.145828 21861 ts_tablet_manager.cc:1403] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.236s	user 0.011s	sys 0.018s
I20260709 13:07:18.148164 21858 tablet_bootstrap.cc:654] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:18.148425 21861 raft_consensus.cc:359] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:18.149163 21861 raft_consensus.cc:385] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:18.150373 21630 leader_election.cc:343] T 1681a1e8015648a692b9a5eacbbf9d6e P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:18.150990 21630 leader_election.cc:304] T 1681a1e8015648a692b9a5eacbbf9d6e P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:18.149410 21861 raft_consensus.cc:740] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:18.094718 22323 raft_consensus.cc:515] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:18.162647 21861 consensus_queue.cc:260] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
W20260709 13:07:18.176101 21704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.196:41173, user_credentials={real_user=slave}} blocked reactor thread for 74969.6us
W20260709 13:07:18.177076 21704 leader_election.cc:343] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:18.177977 21861 ts_tablet_manager.cc:1434] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:07:18.166356 21869 raft_consensus.cc:2804] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:18.187243 21861 tablet_bootstrap.cc:492] T 881467b2dd884d22b15e9ac3906b55cc P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:18.167140 22278 raft_consensus.cc:2749] T 1681a1e8015648a692b9a5eacbbf9d6e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:07:18.199920 21555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:41173, user_credentials={real_user=slave}} blocked reactor thread for 50249us
I20260709 13:07:18.190565 21869 raft_consensus.cc:493] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.210294 21489 catalog_manager.cc:5697] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 1 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:18.212633 21869 raft_consensus.cc:3060] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:18.213927 22323 leader_election.cc:290] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:18.213352 21489 catalog_manager.cc:5697] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 1 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:18.233047 21869 raft_consensus.cc:515] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:18.236606 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c6b2be38fb47e7a92c9b1b7f9678d7" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:18.237622 21869 leader_election.cc:290] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Requested vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:18.242393 21859 raft_consensus.cc:359] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:18.243098 21859 raft_consensus.cc:385] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:18.243361 21859 raft_consensus.cc:740] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Initialized, Role: FOLLOWER
I20260709 13:07:18.243981 21859 consensus_queue.cc:260] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:18.244987 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c6b2be38fb47e7a92c9b1b7f9678d7" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:18.247609 21861 tablet_bootstrap.cc:654] T 881467b2dd884d22b15e9ac3906b55cc P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:18.251036 21555 leader_election.cc:304] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:18.252275 21859 ts_tablet_manager.cc:1434] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5: Time spent starting tablet: real 0.107s	user 0.005s	sys 0.005s
I20260709 13:07:18.266717 22273 raft_consensus.cc:515] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:18.292695 21918 raft_consensus.cc:493] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.279342 22332 raft_consensus.cc:2749] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:18.306347 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba04167743094b89ba6e3596a48aba86" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:18.306900 22273 leader_election.cc:290] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:18.293465 21918 raft_consensus.cc:515] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
W20260709 13:07:18.360885 21704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:35255, user_credentials={real_user=slave}} blocked reactor thread for 134175us
I20260709 13:07:18.370754 21918 leader_election.cc:290] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:18.372051 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed9b20099494a8c94a51f76692a8ec0" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
W20260709 13:07:18.373215 21778 leader_election.cc:343] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:18.375547 21662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba04167743094b89ba6e3596a48aba86" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:18.376385 21660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5745aab7e6c4a409a0ac98725e4e4c9" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:18.280156 22220 raft_consensus.cc:515] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:18.378898 22220 leader_election.cc:290] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:18.382776 21858 tablet_bootstrap.cc:492] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:18.383317 21858 ts_tablet_manager.cc:1403] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.371s	user 0.031s	sys 0.034s
I20260709 13:07:18.386824 21858 raft_consensus.cc:359] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:18.388634 22173 raft_consensus.cc:515] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:18.364306 21809 raft_consensus.cc:3060] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:18.393967 21858 raft_consensus.cc:385] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:07:18.395862 21555 leader_election.cc:343] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:18.396979 21858 raft_consensus.cc:740] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:18.400635 21858 consensus_queue.cc:260] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:18.405696 22278 raft_consensus.cc:493] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.402806 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23660cfe7a7e49db942526440533cdf9" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:18.406278 22278 raft_consensus.cc:515] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:18.407181 21810 raft_consensus.cc:3060] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:18.411314 21858 ts_tablet_manager.cc:1434] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.028s	user 0.004s	sys 0.003s
I20260709 13:07:18.414244 22278 leader_election.cc:290] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:18.422623 21861 tablet_bootstrap.cc:492] T 881467b2dd884d22b15e9ac3906b55cc P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:18.423357 21861 ts_tablet_manager.cc:1403] T 881467b2dd884d22b15e9ac3906b55cc P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.237s	user 0.010s	sys 0.007s
I20260709 13:07:18.427423 21590 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c18f9e23544d00a8d1cf17afda03c5" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:18.434007 21810 raft_consensus.cc:2468] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 1.
I20260709 13:07:18.437927 21858 tablet_bootstrap.cc:492] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
W20260709 13:07:18.485046 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:35255, user_credentials={real_user=slave}} blocked reactor thread for 48672.3us
I20260709 13:07:18.495029 22173 leader_election.cc:290] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:18.495903 22319 raft_consensus.cc:493] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.496616 22319 raft_consensus.cc:515] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:18.497749 21858 tablet_bootstrap.cc:654] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:18.499367 22319 leader_election.cc:290] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:18.443599 21736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c18f9e23544d00a8d1cf17afda03c5" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:18.512741 21736 raft_consensus.cc:2468] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 0.
I20260709 13:07:18.413133 22270 raft_consensus.cc:515] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:18.514899 21590 raft_consensus.cc:2393] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bed294de06e24ca4aba572ec722d2567 in current term 1: Already voted for candidate 3f1fa49d04344067941ffd03d9e7d48c in this term.
I20260709 13:07:18.515928 22270 leader_election.cc:290] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Requested vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:18.524082 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008742eefeb947f5a1f7decfb821a03d" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:18.524870 21591 raft_consensus.cc:3060] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:18.526562 21629 leader_election.cc:304] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:18.532385 21861 raft_consensus.cc:359] T 881467b2dd884d22b15e9ac3906b55cc P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:18.533828 21861 raft_consensus.cc:385] T 881467b2dd884d22b15e9ac3906b55cc P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:18.534438 21861 raft_consensus.cc:740] T 881467b2dd884d22b15e9ac3906b55cc P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
W20260709 13:07:18.542354 21778 consensus_peers.cc:597] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:18.555212 21861 consensus_queue.cc:260] T 881467b2dd884d22b15e9ac3906b55cc P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:18.538174 22278 raft_consensus.cc:2804] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:18.568991 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed9b20099494a8c94a51f76692a8ec0" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:18.569903 21738 raft_consensus.cc:2468] T 1ed9b20099494a8c94a51f76692a8ec0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 0.
I20260709 13:07:18.572710 21738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c18f9e23544d00a8d1cf17afda03c5" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:18.573529 21738 raft_consensus.cc:3060] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:18.571156 21555 leader_election.cc:304] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:18.565191 22278 raft_consensus.cc:493] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.602120 21591 raft_consensus.cc:2468] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:18.592501 22278 raft_consensus.cc:3060] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:18.618615 21738 raft_consensus.cc:2468] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 1.
I20260709 13:07:18.584332 21658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c18f9e23544d00a8d1cf17afda03c5" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:18.635672 22348 raft_consensus.cc:493] T 881467b2dd884d22b15e9ac3906b55cc P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.636250 22348 raft_consensus.cc:515] T 881467b2dd884d22b15e9ac3906b55cc P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:18.636534 21657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23660cfe7a7e49db942526440533cdf9" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:18.638540 22348 leader_election.cc:290] T 881467b2dd884d22b15e9ac3906b55cc P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:18.639904 21858 tablet_bootstrap.cc:492] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:18.640489 21858 ts_tablet_manager.cc:1403] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.206s	user 0.019s	sys 0.024s
I20260709 13:07:18.644506 21734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008742eefeb947f5a1f7decfb821a03d" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:18.645210 21734 raft_consensus.cc:3060] T 008742eefeb947f5a1f7decfb821a03d P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:18.652805 21809 raft_consensus.cc:2468] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 1.
I20260709 13:07:18.654093 21858 raft_consensus.cc:359] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:18.654944 21858 raft_consensus.cc:385] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:18.606956 22345 raft_consensus.cc:2804] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:18.655506 21858 raft_consensus.cc:740] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:18.661754 21554 leader_election.cc:304] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: 
I20260709 13:07:18.661644 21858 consensus_queue.cc:260] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
W20260709 13:07:18.664291 21555 leader_election.cc:343] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:18.621239 21778 leader_election.cc:304] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:18.669693 21858 ts_tablet_manager.cc:1434] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 13:07:18.671161 21858 tablet_bootstrap.cc:492] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
W20260709 13:07:18.683140 21537 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:18.664592 22332 raft_consensus.cc:2804] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:18.665972 22345 raft_consensus.cc:697] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:18.697497 21861 ts_tablet_manager.cc:1434] T 881467b2dd884d22b15e9ac3906b55cc P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.274s	user 0.019s	sys 0.022s
W20260709 13:07:18.711140 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:35255, user_credentials={real_user=slave}} blocked reactor thread for 90031.7us
I20260709 13:07:18.714970 21918 raft_consensus.cc:2804] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:18.715394 21918 raft_consensus.cc:697] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
W20260709 13:07:18.717803 21777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:46013, user_credentials={real_user=slave}} blocked reactor thread for 108665us
I20260709 13:07:18.699383 22332 raft_consensus.cc:697] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:18.722075 21861 tablet_bootstrap.cc:492] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:18.715958 21918 consensus_queue.cc:237] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
W20260709 13:07:18.732635 21555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:35853, user_credentials={real_user=slave}} blocked reactor thread for 66047.4us
I20260709 13:07:18.733244 21777 leader_election.cc:304] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:18.734413 21555 leader_election.cc:304] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:18.762416 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881467b2dd884d22b15e9ac3906b55cc" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:18.762769 21813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "881467b2dd884d22b15e9ac3906b55cc" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:18.763355 21737 raft_consensus.cc:2393] T 881467b2dd884d22b15e9ac3906b55cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bed294de06e24ca4aba572ec722d2567 in current term 1: Already voted for candidate b8c58d9f32b84e5bb79e2751ac41cdba in this term.
I20260709 13:07:18.764619 21584 raft_consensus.cc:3060] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:18.766942 22325 raft_consensus.cc:2804] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:18.781620 22355 raft_consensus.cc:2804] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:18.752209 22345 consensus_queue.cc:237] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:18.770671 22332 consensus_queue.cc:237] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:18.799517 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5745aab7e6c4a409a0ac98725e4e4c9" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:18.797712 22325 raft_consensus.cc:697] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:18.803378 21858 tablet_bootstrap.cc:654] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:18.807758 22355 raft_consensus.cc:493] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:18.812590 22325 consensus_queue.cc:237] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:18.813254 22355 raft_consensus.cc:3060] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:18.808531 21734 raft_consensus.cc:2468] T 008742eefeb947f5a1f7decfb821a03d P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:18.816368 21809 raft_consensus.cc:3060] T b5745aab7e6c4a409a0ac98725e4e4c9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:18.820624 21861 tablet_bootstrap.cc:654] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:18.846810 22278 raft_consensus.cc:515] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
W20260709 13:07:18.850162 21704 leader_election.cc:343] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:18.851495 21658 raft_consensus.cc:2393] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3f1fa49d04344067941ffd03d9e7d48c in current term 1: Already voted for candidate bed294de06e24ca4aba572ec722d2567 in this term.
I20260709 13:07:18.851998 22270 raft_consensus.cc:493] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:18.852545 22270 raft_consensus.cc:515] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
W20260709 13:07:18.858038 21554 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:46013, user_credentials={real_user=slave}} blocked reactor thread for 62036.7us
W20260709 13:07:18.907881 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:35853, user_credentials={real_user=slave}} blocked reactor thread for 47890.7us
W20260709 13:07:18.944286 21777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:46013, user_credentials={real_user=slave}} blocked reactor thread for 76532.1us
I20260709 13:07:18.947049 21858 tablet_bootstrap.cc:492] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:18.947642 21858 ts_tablet_manager.cc:1403] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.277s	user 0.019s	sys 0.006s
I20260709 13:07:18.949127 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681a1e8015648a692b9a5eacbbf9d6e" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:18.961280 22278 leader_election.cc:290] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:18.943495 22219 consensus_queue.cc:1048] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 13:07:18.964444 22355 raft_consensus.cc:515] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:18.967226 22355 leader_election.cc:290] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:18.970815 21858 raft_consensus.cc:359] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:18.972585 22270 leader_election.cc:290] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:18.973977 21858 raft_consensus.cc:385] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:18.974442 21858 raft_consensus.cc:740] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:18.979005 21858 consensus_queue.cc:260] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:18.998555 21861 tablet_bootstrap.cc:492] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:18.999402 21861 ts_tablet_manager.cc:1403] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.289s	user 0.011s	sys 0.004s
I20260709 13:07:19.014503 21733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c18f9e23544d00a8d1cf17afda03c5" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:19.015882 21733 raft_consensus.cc:2393] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bed294de06e24ca4aba572ec722d2567 in current term 1: Already voted for candidate 3f1fa49d04344067941ffd03d9e7d48c in this term.
I20260709 13:07:19.023077 21657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681a1e8015648a692b9a5eacbbf9d6e" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:19.024155 21657 raft_consensus.cc:2468] T 1681a1e8015648a692b9a5eacbbf9d6e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 0.
I20260709 13:07:19.027854 21809 raft_consensus.cc:2468] T b5745aab7e6c4a409a0ac98725e4e4c9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 1.
I20260709 13:07:19.030722 21704 leader_election.cc:304] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: bed294de06e24ca4aba572ec722d2567
I20260709 13:07:19.032224 22328 raft_consensus.cc:2804] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:19.032945 22328 raft_consensus.cc:697] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Running, Role: LEADER
I20260709 13:07:19.034102 22328 consensus_queue.cc:237] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:19.064113 21858 ts_tablet_manager.cc:1434] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.116s	user 0.007s	sys 0.002s
I20260709 13:07:19.100620 21858 tablet_bootstrap.cc:492] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
W20260709 13:07:19.096387 21704 leader_election.cc:343] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:19.105074 21591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed9b20099494a8c94a51f76692a8ec0" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
W20260709 13:07:19.124029 21778 leader_election.cc:343] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:19.128931 21661 raft_consensus.cc:3060] T 881467b2dd884d22b15e9ac3906b55cc P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:19.145961 21739 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed9b20099494a8c94a51f76692a8ec0" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:19.146651 21739 raft_consensus.cc:3060] T 1ed9b20099494a8c94a51f76692a8ec0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:19.140555 21583 raft_consensus.cc:3060] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:19.146880 21861 raft_consensus.cc:359] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:19.147773 21861 raft_consensus.cc:385] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:19.148048 21861 raft_consensus.cc:740] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:19.148717 21861 consensus_queue.cc:260] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:19.154156 21739 raft_consensus.cc:2468] T 1ed9b20099494a8c94a51f76692a8ec0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:19.207212 21630 leader_election.cc:304] T 881467b2dd884d22b15e9ac3906b55cc P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:19.216069 21861 ts_tablet_manager.cc:1434] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.216s	user 0.013s	sys 0.017s
I20260709 13:07:19.235256 21861 tablet_bootstrap.cc:492] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
W20260709 13:07:19.233646 21704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:35255, user_credentials={real_user=slave}} blocked reactor thread for 127184us
I20260709 13:07:19.245316 21586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c18f9e23544d00a8d1cf17afda03c5" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:19.246359 21587 raft_consensus.cc:3060] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:19.248867 21858 tablet_bootstrap.cc:654] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:19.263561 21777 leader_election.cc:304] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:19.282473 21861 tablet_bootstrap.cc:654] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:19.274547 22354 raft_consensus.cc:2804] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:19.298552 21630 leader_election.cc:304] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:19.288273 22356 raft_consensus.cc:493] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.300115 22356 raft_consensus.cc:515] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:19.302716 22356 leader_election.cc:290] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:19.286005 22346 raft_consensus.cc:493] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c58d9f32b84e5bb79e2751ac41cdba)
I20260709 13:07:19.303694 22346 raft_consensus.cc:515] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:19.303102 22348 raft_consensus.cc:2749] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:19.313967 22354 raft_consensus.cc:697] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:19.275524 22219 consensus_queue.cc:1048] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
W20260709 13:07:19.295989 21584 consensus_meta.cc:287] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent flushing consensus metadata: real 0.531s	user 0.012s	sys 0.000s
I20260709 13:07:19.328922 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a0bcc4561a4503aebdb0aab6b13b37" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
W20260709 13:07:19.333088 22375 log.cc:927] Time spent T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:07:19.343814 22346 leader_election.cc:290] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:19.356333 21736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841639e17c5d4724afe9494276ba00a3" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:19.356860 21809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317e3221976c47fa913d27f018a21910" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:19.363973 22354 consensus_queue.cc:237] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:19.364825 22359 consensus_queue.cc:1048] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 13:07:19.373888 21704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:35853, user_credentials={real_user=slave}} blocked reactor thread for 100194us
I20260709 13:07:19.374982 21704 leader_election.cc:304] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c
W20260709 13:07:19.378433 21555 consensus_peers.cc:597] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:19.379607 22374 raft_consensus.cc:2804] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:19.380070 22374 raft_consensus.cc:493] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:19.380383 22374 raft_consensus.cc:3060] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:19.380785 21861 tablet_bootstrap.cc:492] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:19.381315 21861 ts_tablet_manager.cc:1403] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.146s	user 0.007s	sys 0.011s
I20260709 13:07:19.394590 21858 tablet_bootstrap.cc:492] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:19.395308 21858 ts_tablet_manager.cc:1403] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.295s	user 0.014s	sys 0.016s
I20260709 13:07:19.396092 21861 raft_consensus.cc:359] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:19.404105 21861 raft_consensus.cc:385] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:19.408700 21861 raft_consensus.cc:740] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:19.401183 22355 consensus_queue.cc:1048] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:07:19.410465 22344 raft_consensus.cc:2749] T 881467b2dd884d22b15e9ac3906b55cc P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:19.410881 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841639e17c5d4724afe9494276ba00a3" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:19.417282 21858 raft_consensus.cc:359] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:19.420002 21858 raft_consensus.cc:385] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:19.420357 21858 raft_consensus.cc:740] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:19.409468 21861 consensus_queue.cc:260] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:19.427757 21861 ts_tablet_manager.cc:1434] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.003s
W20260709 13:07:19.434352 21778 consensus_peers.cc:597] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:19.450464 21589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a0bcc4561a4503aebdb0aab6b13b37" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
W20260709 13:07:19.451647 21555 consensus_peers.cc:597] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:19.452653 21630 leader_election.cc:304] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:19.453953 22344 raft_consensus.cc:2749] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:19.454136 22270 raft_consensus.cc:493] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader bed294de06e24ca4aba572ec722d2567)
I20260709 13:07:19.454663 22270 raft_consensus.cc:515] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:19.458158 21657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "832d931fb3f84415aac4b1880e99c498" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:19.462046 21858 consensus_queue.cc:260] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
W20260709 13:07:19.463853 21704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:41173, user_credentials={real_user=slave}} blocked reactor thread for 55153.4us
I20260709 13:07:19.468752 21740 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "832d931fb3f84415aac4b1880e99c498" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:19.462523 22270 leader_election.cc:290] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:19.473279 21858 ts_tablet_manager.cc:1434] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.000s
I20260709 13:07:19.474843 22374 raft_consensus.cc:515] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:19.477041 22374 leader_election.cc:290] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:19.474366 21858 tablet_bootstrap.cc:492] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:19.483292 21487 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54464 (request call id 55) took 1079 ms. Trace:
I20260709 13:07:19.494853 22363 consensus_queue.cc:1048] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:19.495941 21861 tablet_bootstrap.cc:492] T 1e3f4d96c3d04d378fc88e817a7c4069 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
W20260709 13:07:19.519158 21704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:41173, user_credentials={real_user=slave}} blocked reactor thread for 54534us
I20260709 13:07:19.521150 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317e3221976c47fa913d27f018a21910" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:19.489837 21487 rpcz_store.cc:276] 0709 13:07:18.404348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:18.404509 (+   161us) service_pool.cc:224] Handling call
0709 13:07:18.530767 (+126258us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b5400927cd4. stack: 00007fc3a645a343 00007fc3a645a240 00007fc3a5de91d4 00007fc3afb27304 00007fc3afb27299 00007fc3a94e3090 00007fc3a9581f3a 00007fc3af3381cc 00007fc3af43637e 00007fc3ad8f72a4 00007fc3ad8f7232 00007fc3ad8f7161 00007fc3ad8f70dc 00007fc3ad8f6392 00007fc3a78b448c 00007fc3a78b38c6
0709 13:07:19.483182 (+952415us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":185332,"reported_tablets":6,"spinlock_wait_cycles":73403776}
I20260709 13:07:19.522478 21554 leader_election.cc:304] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:19.523989 21861 tablet_bootstrap.cc:654] T 1e3f4d96c3d04d378fc88e817a7c4069 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:19.525234 21554 leader_election.cc:304] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:19.530404 21554 leader_election.cc:304] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:19.540591 21589 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681a1e8015648a692b9a5eacbbf9d6e" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
I20260709 13:07:19.544525 21657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681a1e8015648a692b9a5eacbbf9d6e" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:19.545331 21657 raft_consensus.cc:3060] T 1681a1e8015648a692b9a5eacbbf9d6e P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:19.545392 22362 raft_consensus.cc:2749] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:19.547806 21704 leader_election.cc:343] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:19.526687 22363 raft_consensus.cc:2749] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:19.565389 22220 raft_consensus.cc:2749] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:19.573937 21858 tablet_bootstrap.cc:654] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:19.577682 22270 raft_consensus.cc:493] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.584910 22270 raft_consensus.cc:515] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:19.593659 22363 consensus_queue.cc:1048] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:07:19.598084 22270 leader_election.cc:290] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:19.603724 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed9b20099494a8c94a51f76692a8ec0" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:19.604734 21737 raft_consensus.cc:2393] T 1ed9b20099494a8c94a51f76692a8ec0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f1fa49d04344067941ffd03d9e7d48c in current term 1: Already voted for candidate b8c58d9f32b84e5bb79e2751ac41cdba in this term.
I20260709 13:07:19.609503 22279 raft_consensus.cc:493] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:19.610402 22279 raft_consensus.cc:515] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:19.707249 22279 leader_election.cc:290] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:19.713624 21586 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23660cfe7a7e49db942526440533cdf9" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:19.714082 21808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ed9b20099494a8c94a51f76692a8ec0" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:19.718771 21657 raft_consensus.cc:2468] T 1681a1e8015648a692b9a5eacbbf9d6e P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 1.
I20260709 13:07:19.732558 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23660cfe7a7e49db942526440533cdf9" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:19.770215 21704 leader_election.cc:304] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c
W20260709 13:07:19.811224 21555 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:35853, user_credentials={real_user=slave}} blocked reactor thread for 65556.4us
I20260709 13:07:19.823695 22326 raft_consensus.cc:2804] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:19.819375 22332 consensus_queue.cc:1048] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:19.860642 22389 log.cc:927] Time spent T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 13:07:19.863248 22385 log.cc:927] Time spent T 881467b2dd884d22b15e9ac3906b55cc P bed294de06e24ca4aba572ec722d2567: Append to log took a long time: real 0.272s	user 0.001s	sys 0.000s
I20260709 13:07:19.838531 22326 raft_consensus.cc:697] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Becoming Leader. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Running, Role: LEADER
I20260709 13:07:19.882546 22326 consensus_queue.cc:237] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:19.937103 21861 tablet_bootstrap.cc:492] T 1e3f4d96c3d04d378fc88e817a7c4069 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:19.955874 21661 raft_consensus.cc:3060] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:19.956406 21660 raft_consensus.cc:3060] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:20.004724 21861 ts_tablet_manager.cc:1403] T 1e3f4d96c3d04d378fc88e817a7c4069 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.509s	user 0.046s	sys 0.056s
I20260709 13:07:20.032029 21858 tablet_bootstrap.cc:492] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c: No bootstrap required, opened a new log
I20260709 13:07:20.032645 21858 ts_tablet_manager.cc:1403] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.558s	user 0.025s	sys 0.002s
I20260709 13:07:20.035689 21858 raft_consensus.cc:359] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:20.036394 21858 raft_consensus.cc:385] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:20.036664 21858 raft_consensus.cc:740] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:20.036582 21861 raft_consensus.cc:359] T 1e3f4d96c3d04d378fc88e817a7c4069 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:20.038070 21858 consensus_queue.cc:260] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:20.040351 21858 ts_tablet_manager.cc:1434] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:07:20.037444 21861 raft_consensus.cc:385] T 1e3f4d96c3d04d378fc88e817a7c4069 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:20.045308 21861 raft_consensus.cc:740] T 1e3f4d96c3d04d378fc88e817a7c4069 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:20.046219 21861 consensus_queue.cc:260] T 1e3f4d96c3d04d378fc88e817a7c4069 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
W20260709 13:07:20.046710 21537 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:20.048987 21861 ts_tablet_manager.cc:1434] T 1e3f4d96c3d04d378fc88e817a7c4069 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
W20260709 13:07:20.070640 22396 log.cc:927] Time spent T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba: Append to log took a long time: real 0.252s	user 0.010s	sys 0.002s
I20260709 13:07:20.079427 21555 leader_election.cc:304] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:20.080973 22401 raft_consensus.cc:3060] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:20.083493 21661 raft_consensus.cc:3060] T 1e3f4d96c3d04d378fc88e817a7c4069 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:20.093662 22401 raft_consensus.cc:2749] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:20.096936 22353 consensus_queue.cc:1048] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:20.115386 22273 consensus_queue.cc:1048] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:20.429769 22360 raft_consensus.cc:493] T 43e501f94be841fbb110db3ac40ede77 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e8f84032ed948908dc7fcffcfe2d6e5)
I20260709 13:07:20.430456 22360 raft_consensus.cc:515] T 43e501f94be841fbb110db3ac40ede77 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:20.432998 22360 leader_election.cc:290] T 43e501f94be841fbb110db3ac40ede77 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:20.452919 22220 raft_consensus.cc:493] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e8f84032ed948908dc7fcffcfe2d6e5)
I20260709 13:07:20.453668 22220 raft_consensus.cc:515] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:20.455727 22220 leader_election.cc:290] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:20.525768 21861 tablet_bootstrap.cc:492] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
I20260709 13:07:20.530862 21861 tablet_bootstrap.cc:654] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:20.551026 22360 consensus_queue.cc:1048] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:20.563270 22329 raft_consensus.cc:493] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b8c58d9f32b84e5bb79e2751ac41cdba)
I20260709 13:07:20.563903 22329 raft_consensus.cc:515] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:20.565037 22220 raft_consensus.cc:493] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:20.565938 22329 leader_election.cc:290] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:20.568150 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de835ccc085481aaf56e24e6b6a055f" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:20.565693 22220 raft_consensus.cc:515] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:20.573642 21736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cbb2559034cf7b35ecfe777ae620c" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:20.574352 22220 leader_election.cc:290] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:20.576813 22350 raft_consensus.cc:493] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3e8f84032ed948908dc7fcffcfe2d6e5)
I20260709 13:07:20.584421 21861 tablet_bootstrap.cc:492] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:20.587618 21861 ts_tablet_manager.cc:1403] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.062s	user 0.004s	sys 0.009s
I20260709 13:07:20.587466 22350 raft_consensus.cc:515] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:20.590544 21861 raft_consensus.cc:359] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:20.591450 21861 raft_consensus.cc:385] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:20.591778 21861 raft_consensus.cc:740] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:20.592725 21861 consensus_queue.cc:260] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:20.549988 21659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e501f94be841fbb110db3ac40ede77" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:20.595821 21861 ts_tablet_manager.cc:1434] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:20.598381 21861 tablet_bootstrap.cc:492] T b5745aab7e6c4a409a0ac98725e4e4c9 P bed294de06e24ca4aba572ec722d2567: Bootstrap starting.
W20260709 13:07:20.599893 21704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:35853, user_credentials={real_user=slave}} blocked reactor thread for 50345.1us
I20260709 13:07:20.600847 22374 consensus_queue.cc:1048] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:20.604651 21861 tablet_bootstrap.cc:654] T b5745aab7e6c4a409a0ac98725e4e4c9 P bed294de06e24ca4aba572ec722d2567: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:20.623732 21731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43e501f94be841fbb110db3ac40ede77" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:20.629433 21486 catalog_manager.cc:5697] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 1 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:20.640113 21659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd0cbb2559034cf7b35ecfe777ae620c" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:20.640026 21486 catalog_manager.cc:5697] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 1 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } }
I20260709 13:07:20.645749 22350 leader_election.cc:290] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:20.645272 21486 catalog_manager.cc:5697] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 1 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:20.649742 21486 catalog_manager.cc:5697] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 1 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:20.682377 21777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:46013, user_credentials={real_user=slave}} blocked reactor thread for 65828.8us
W20260709 13:07:20.696657 21704 consensus_peers.cc:597] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:20.698320 21487 catalog_manager.cc:5697] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 0 to 1, leader changed from <none> to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 1 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:20.702105 21665 raft_consensus.cc:3060] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:20.705896 21663 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9de835ccc085481aaf56e24e6b6a055f" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:20.707312 21660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681a1e8015648a692b9a5eacbbf9d6e" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:20.708117 21660 raft_consensus.cc:2393] T 1681a1e8015648a692b9a5eacbbf9d6e P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3f1fa49d04344067941ffd03d9e7d48c in current term 1: Already voted for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in this term.
I20260709 13:07:20.709026 21584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8eb26670184a3dabe0c8e8162e1a4e" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
I20260709 13:07:20.730640 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d8eb26670184a3dabe0c8e8162e1a4e" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:20.747691 21587 raft_consensus.cc:3060] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:20.758630 21777 leader_election.cc:304] T 43e501f94be841fbb110db3ac40ede77 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:20.760525 21489 catalog_manager.cc:5697] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:20.762799 21489 catalog_manager.cc:5697] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:20.770429 22355 raft_consensus.cc:2749] T 43e501f94be841fbb110db3ac40ede77 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:20.776046 21630 leader_election.cc:304] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:20.777402 22326 consensus_queue.cc:1048] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:20.780743 21734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1681a1e8015648a692b9a5eacbbf9d6e" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:20.780786 22348 raft_consensus.cc:2749] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:20.786068 22326 consensus_queue.cc:1048] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:20.798933 21554 leader_election.cc:304] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:20.799831 22325 raft_consensus.cc:2749] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:20.819214 21861 tablet_bootstrap.cc:492] T b5745aab7e6c4a409a0ac98725e4e4c9 P bed294de06e24ca4aba572ec722d2567: No bootstrap required, opened a new log
I20260709 13:07:20.819801 21861 ts_tablet_manager.cc:1403] T b5745aab7e6c4a409a0ac98725e4e4c9 P bed294de06e24ca4aba572ec722d2567: Time spent bootstrapping tablet: real 0.222s	user 0.067s	sys 0.085s
I20260709 13:07:20.820598 21630 leader_election.cc:304] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:20.821460 22348 raft_consensus.cc:2749] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:20.824986 21555 leader_election.cc:304] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:20.826004 22325 raft_consensus.cc:2749] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:20.826661 21861 raft_consensus.cc:359] T b5745aab7e6c4a409a0ac98725e4e4c9 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:20.827754 21861 raft_consensus.cc:385] T b5745aab7e6c4a409a0ac98725e4e4c9 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:20.828145 21861 raft_consensus.cc:740] T b5745aab7e6c4a409a0ac98725e4e4c9 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Initialized, Role: FOLLOWER
I20260709 13:07:20.830307 21555 leader_election.cc:304] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:20.831856 21861 consensus_queue.cc:260] T b5745aab7e6c4a409a0ac98725e4e4c9 P bed294de06e24ca4aba572ec722d2567 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:20.835717 21861 ts_tablet_manager.cc:1434] T b5745aab7e6c4a409a0ac98725e4e4c9 P bed294de06e24ca4aba572ec722d2567: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 13:07:20.847935 22220 raft_consensus.cc:2749] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:21.083209 21657 raft_consensus.cc:3060] T b5745aab7e6c4a409a0ac98725e4e4c9 P bed294de06e24ca4aba572ec722d2567 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:21.138546 21520 debug-util.cc:398] Leaking SignalData structure 0x7b08003b2440 after lost signal to thread 11446
W20260709 13:07:21.139942 21520 debug-util.cc:398] Leaking SignalData structure 0x7b0800406140 after lost signal to thread 21523
W20260709 13:07:21.141382 21520 debug-util.cc:398] Leaking SignalData structure 0x7b0800132ac0 after lost signal to thread 21615
W20260709 13:07:21.142714 21520 debug-util.cc:398] Leaking SignalData structure 0x7b0800395ca0 after lost signal to thread 21690
W20260709 13:07:21.144001 21520 debug-util.cc:398] Leaking SignalData structure 0x7b08003feca0 after lost signal to thread 21764
W20260709 13:07:21.145015 21520 debug-util.cc:398] Leaking SignalData structure 0x7b080017f4a0 after lost signal to thread 21838
I20260709 13:07:21.373119 11443 tablet_server.cc:179] TabletServer@127.11.44.193:0 shutting down...
W20260709 13:07:21.386853 21704 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 1 similar messages]
W20260709 13:07:21.437688 21704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:35255, user_credentials={real_user=slave}} blocked reactor thread for 45089.6us
W20260709 13:07:21.438594 21630 consensus_peers.cc:597] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:21.441643 21704 consensus_peers.cc:597] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:21.444494 21704 consensus_peers.cc:597] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:21.453007 21778 consensus_peers.cc:597] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:21.458510 21704 consensus_peers.cc:597] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:21.466293 21778 consensus_peers.cc:597] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:21.469413 21778 consensus_peers.cc:597] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:21.483989 21778 consensus_peers.cc:597] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:21.484640 21778 consensus_peers.cc:597] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:21.495141 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:21.500066 11443 tablet_replica.cc:333] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.501075 11443 raft_consensus.cc:2243] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.501641 11443 raft_consensus.cc:2272] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.506896 11443 tablet_replica.cc:333] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.507825 11443 raft_consensus.cc:2243] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.508862 11443 raft_consensus.cc:2272] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:21.509440 21778 consensus_peers.cc:597] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:21.511626 11443 tablet_replica.cc:333] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.512567 11443 raft_consensus.cc:2243] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:21.513454 11443 raft_consensus.cc:2272] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.516993 11443 tablet_replica.cc:333] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.517971 11443 raft_consensus.cc:2243] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:21.519304 11443 raft_consensus.cc:2272] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.521626 11443 tablet_replica.cc:333] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.522285 11443 raft_consensus.cc:2243] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.522742 11443 raft_consensus.cc:2272] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:21.522986 21778 consensus_peers.cc:597] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:21.524649 11443 tablet_replica.cc:333] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.525328 11443 raft_consensus.cc:2243] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:21.526091 11443 raft_consensus.cc:2272] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.528201 11443 tablet_replica.cc:333] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.529071 11443 raft_consensus.cc:2243] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.529577 11443 raft_consensus.cc:2272] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.531975 11443 tablet_replica.cc:333] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.532750 11443 raft_consensus.cc:2243] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.533236 11443 raft_consensus.cc:2272] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.535648 11443 tablet_replica.cc:333] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.536468 11443 raft_consensus.cc:2243] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.536986 11443 raft_consensus.cc:2272] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.539285 11443 tablet_replica.cc:333] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.540053 11443 raft_consensus.cc:2243] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:21.541328 11443 raft_consensus.cc:2272] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:21.543758 21778 consensus_peers.cc:597] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:21.543948 11443 tablet_replica.cc:333] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.544962 11443 raft_consensus.cc:2243] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.545466 11443 raft_consensus.cc:2272] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.547761 11443 tablet_replica.cc:333] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.548672 11443 raft_consensus.cc:2243] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.549271 11443 raft_consensus.cc:2272] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.552008 11443 tablet_replica.cc:333] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.552767 11443 raft_consensus.cc:2243] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:21.553776 11443 raft_consensus.cc:2272] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.556075 11443 tablet_replica.cc:333] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.556912 11443 raft_consensus.cc:2243] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.557512 11443 raft_consensus.cc:2272] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.561146 11443 tablet_replica.cc:333] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.562021 11443 raft_consensus.cc:2243] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.562520 11443 raft_consensus.cc:2272] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:21.563683 21778 consensus_peers.cc:597] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:21.564764 11443 tablet_replica.cc:333] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.565626 11443 raft_consensus.cc:2243] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.566128 11443 raft_consensus.cc:2272] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.568619 11443 tablet_replica.cc:333] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.569459 11443 raft_consensus.cc:2243] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.569958 11443 raft_consensus.cc:2272] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.572079 11443 tablet_replica.cc:333] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.572693 11443 raft_consensus.cc:2243] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:21.573545 11443 raft_consensus.cc:2272] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.575819 11443 tablet_replica.cc:333] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.576682 11443 raft_consensus.cc:2243] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.577102 11443 raft_consensus.cc:2272] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:21.577859 21704 consensus_peers.cc:597] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:21.581184 11443 tablet_replica.cc:333] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.582156 11443 raft_consensus.cc:2243] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.582677 11443 raft_consensus.cc:2272] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.585268 11443 tablet_replica.cc:333] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.586104 11443 raft_consensus.cc:2243] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.586656 11443 raft_consensus.cc:2272] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.589463 11443 tablet_replica.cc:333] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.590245 11443 raft_consensus.cc:2243] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:21.591014 11443 raft_consensus.cc:2272] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.593355 11443 tablet_replica.cc:333] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.594100 11443 raft_consensus.cc:2243] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:21.595036 11443 raft_consensus.cc:2272] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.597224 11443 tablet_replica.cc:333] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.597976 11443 raft_consensus.cc:2243] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:21.598925 11443 raft_consensus.cc:2272] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.601505 11443 tablet_replica.cc:333] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.602488 11443 raft_consensus.cc:2243] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:21.603192 11443 raft_consensus.cc:2272] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.605605 11443 tablet_replica.cc:333] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.606443 11443 raft_consensus.cc:2243] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:21.607012 21778 consensus_peers.cc:597] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:21.607010 11443 raft_consensus.cc:2272] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:21.608793 21630 consensus_peers.cc:597] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:21.617677 11443 tablet_replica.cc:333] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.619114 11443 raft_consensus.cc:2243] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:21.620131 11443 raft_consensus.cc:2272] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.622789 11443 tablet_replica.cc:333] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.623571 11443 raft_consensus.cc:2243] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:21.624500 11443 raft_consensus.cc:2272] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:21.625360 21778 consensus_peers.cc:597] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:21.627085 11443 tablet_replica.cc:333] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.627867 11443 raft_consensus.cc:2243] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:07:21.628587 21778 consensus_peers.cc:597] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:21.628863 11443 raft_consensus.cc:2272] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.631575 11443 tablet_replica.cc:333] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.632345 11443 raft_consensus.cc:2243] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.632776 11443 raft_consensus.cc:2272] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.635509 11443 tablet_replica.cc:333] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.636081 11443 raft_consensus.cc:2243] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.636564 11443 raft_consensus.cc:2272] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.639344 11443 tablet_replica.cc:333] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.640094 11443 raft_consensus.cc:2243] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.640554 11443 raft_consensus.cc:2272] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:21.641358 21704 consensus_peers.cc:597] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:21.642014 21704 consensus_peers.cc:597] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:21.643064 11443 tablet_replica.cc:333] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.643954 11443 raft_consensus.cc:2243] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.644486 11443 raft_consensus.cc:2272] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:21.646202 21704 consensus_peers.cc:597] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:21.647109 11443 tablet_replica.cc:333] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.647912 11443 raft_consensus.cc:2243] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.648393 11443 raft_consensus.cc:2272] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.651083 11443 tablet_replica.cc:333] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.651803 11443 raft_consensus.cc:2243] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:21.652012 21778 consensus_peers.cc:597] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:21.652319 11443 raft_consensus.cc:2272] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.655067 11443 tablet_replica.cc:333] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.655642 11443 raft_consensus.cc:2243] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.656064 11443 raft_consensus.cc:2272] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.658378 11443 tablet_replica.cc:333] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.658934 11443 raft_consensus.cc:2243] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.659399 11443 raft_consensus.cc:2272] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.661623 11443 tablet_replica.cc:333] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.662318 11443 raft_consensus.cc:2243] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.662827 11443 raft_consensus.cc:2272] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.665297 11443 tablet_replica.cc:333] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.666007 11443 raft_consensus.cc:2243] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:21.666985 11443 raft_consensus.cc:2272] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.669319 11443 tablet_replica.cc:333] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.669981 11443 raft_consensus.cc:2243] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.670444 11443 raft_consensus.cc:2272] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.672791 11443 tablet_replica.cc:333] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
W20260709 13:07:21.673063 21630 consensus_peers.cc:597] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:21.673382 11443 raft_consensus.cc:2243] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.674181 11443 raft_consensus.cc:2272] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.676960 11443 tablet_replica.cc:333] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.677668 11443 raft_consensus.cc:2243] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:21.678501 11443 raft_consensus.cc:2272] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.680545 11443 tablet_replica.cc:333] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.681105 11443 raft_consensus.cc:2243] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.681516 11443 raft_consensus.cc:2272] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.683497 11443 tablet_replica.cc:333] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.684000 11443 raft_consensus.cc:2243] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.684393 11443 raft_consensus.cc:2272] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:21.686337 11443 tablet_replica.cc:333] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c: stopping tablet replica
I20260709 13:07:21.686791 11443 raft_consensus.cc:2243] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:21.687201 11443 raft_consensus.cc:2272] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:21.702739 21778 consensus_peers.cc:597] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:21.721621 21778 consensus_peers.cc:597] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:21.767537 11443 tablet_server.cc:196] TabletServer@127.11.44.193:0 shutdown complete.
W20260709 13:07:21.805177 21778 consensus_peers.cc:597] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:21.824244 21630 consensus_peers.cc:597] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:21.824859 21630 consensus_peers.cc:597] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:21.845103 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:21.861064 21778 consensus_peers.cc:597] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:21.884825 22442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:21.912578 21704 consensus_peers.cc:597] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:21.921937 22444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:21.947129 22446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:21.948329 11443 server_base.cc:1061] running on GCE node
I20260709 13:07:21.952607 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:21.952907 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:21.953195 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602441953175 us; error 0 us; skew 500 ppm
I20260709 13:07:21.954092 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:22.085646 11443 webserver.cc:533] Webserver started at http://127.11.44.193:44849/ using document root <none> and password file <none>
I20260709 13:07:22.086427 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:22.086692 11443 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:07:22.100435 11443 fs_manager.cc:714] Time spent opening directory manager: real 0.010s	user 0.001s	sys 0.008s
I20260709 13:07:22.120991 22453 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:22.122274 11443 fs_manager.cc:730] Time spent opening block manager: real 0.011s	user 0.002s	sys 0.008s
I20260709 13:07:22.122684 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-0-root
uuid: "3f1fa49d04344067941ffd03d9e7d48c"
format_stamp: "Formatted at 2026-07-09 13:07:07 on dist-test-slave-qv7r"
I20260709 13:07:22.123204 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602132206461-11443-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:22.149655 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:22.151437 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:22.174855 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:22.205349 22460 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:07:22.552273 22450 raft_consensus.cc:493] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.553002 22450 raft_consensus.cc:515] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:22.556846 22450 leader_election.cc:290] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:22.558063 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb99515c89d44c59276745ce3cbacd6" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
W20260709 13:07:22.567950 21630 leader_election.cc:336] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:22.568475 21630 leader_election.cc:304] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:22.570788 22449 raft_consensus.cc:493] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.571369 22449 raft_consensus.cc:515] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:22.574095 22328 raft_consensus.cc:493] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.573041 22450 raft_consensus.cc:2749] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:22.577128 22328 raft_consensus.cc:515] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:22.580549 22328 leader_election.cc:290] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:22.582067 22449 leader_election.cc:290] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:22.582736 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:07:22.583137 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.385s	user 0.012s	sys 0.000s
I20260709 13:07:22.583523 11443 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:07:22.584259 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ba1219e0f34c48b4dcb1d1c5e177d0" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
W20260709 13:07:22.587044 21630 leader_election.cc:336] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:22.587184 22449 raft_consensus.cc:493] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.587502 21630 leader_election.cc:304] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:22.587881 22449 raft_consensus.cc:515] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:22.590291 22348 raft_consensus.cc:2749] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:22.590314 22449 leader_election.cc:290] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:22.594419 22460 tablet_bootstrap.cc:492] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:22.594313 21657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22735fa400464e149fa2d7263a8bd58a" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:22.609330 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23660cfe7a7e49db942526440533cdf9" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:22.612573 22449 raft_consensus.cc:493] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.613209 22449 raft_consensus.cc:515] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:22.615444 22449 leader_election.cc:290] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:22.621080 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a0bcc4561a4503aebdb0aab6b13b37" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
W20260709 13:07:22.623538 21630 leader_election.cc:336] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:22.624094 21630 leader_election.cc:304] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:22.624899 22450 raft_consensus.cc:2749] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:22.627691 21704 leader_election.cc:336] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:22.627807 22460 tablet_bootstrap.cc:492] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:22.628237 21704 leader_election.cc:304] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:22.629134 22460 tablet_bootstrap.cc:492] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:22.629535 22461 raft_consensus.cc:2749] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:22.629916 22460 ts_tablet_manager.cc:1403] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.036s	user 0.021s	sys 0.003s
W20260709 13:07:22.631647 21630 leader_election.cc:336] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:22.632180 21630 leader_election.cc:304] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:22.632942 22450 raft_consensus.cc:2749] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:22.643380 22440 raft_consensus.cc:493] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.632776 22460 raft_consensus.cc:359] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:22.644279 22460 raft_consensus.cc:740] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:22.644109 22440 raft_consensus.cc:515] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:22.645229 22460 consensus_queue.cc:260] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:22.646792 22440 leader_election.cc:290] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:22.649916 21665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba04167743094b89ba6e3596a48aba86" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
W20260709 13:07:22.663467 21778 leader_election.cc:336] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:22.665923 21778 leader_election.cc:304] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:22.669898 22461 raft_consensus.cc:493] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.674110 22461 raft_consensus.cc:515] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:22.676641 22461 leader_election.cc:290] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:22.675710 22440 raft_consensus.cc:2749] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:22.681734 21657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ba1219e0f34c48b4dcb1d1c5e177d0" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:22.682773 21657 raft_consensus.cc:2468] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 1.
I20260709 13:07:22.685220 21704 leader_election.cc:304] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:22.686328 22461 raft_consensus.cc:2804] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:22.686743 22461 raft_consensus.cc:493] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.687114 22461 raft_consensus.cc:3060] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:22.690301 21704 leader_election.cc:336] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:22.691110 22460 ts_tablet_manager.cc:1434] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.061s	user 0.013s	sys 0.028s
I20260709 13:07:22.692107 22460 tablet_bootstrap.cc:492] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:22.695295 22461 raft_consensus.cc:515] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:22.697712 22461 leader_election.cc:290] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:22.700635 21657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86ba1219e0f34c48b4dcb1d1c5e177d0" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:22.701287 21657 raft_consensus.cc:3060] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:22.711345 21657 raft_consensus.cc:2468] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 2.
W20260709 13:07:22.719556 21704 leader_election.cc:336] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:22.720126 22450 raft_consensus.cc:493] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.727421 22450 raft_consensus.cc:515] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:22.729522 21704 leader_election.cc:304] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:22.729835 22450 leader_election.cc:290] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:22.730406 22461 raft_consensus.cc:2804] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:22.730939 22461 raft_consensus.cc:697] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 LEADER]: Becoming Leader. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Running, Role: LEADER
I20260709 13:07:22.731773 22461 consensus_queue.cc:237] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:22.732179 21734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705488f64a3e446babbfe5b0d7bc2122" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:22.735704 22460 tablet_bootstrap.cc:492] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:22.736862 22460 tablet_bootstrap.cc:492] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:22.737666 22460 ts_tablet_manager.cc:1403] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.023s
I20260709 13:07:22.740466 22460 raft_consensus.cc:359] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:22.741344 22460 raft_consensus.cc:740] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
W20260709 13:07:22.741442 21630 leader_election.cc:336] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:22.742219 22460 consensus_queue.cc:260] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:22.751690 22460 ts_tablet_manager.cc:1434] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:07:22.752753 22460 tablet_bootstrap.cc:492] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:22.749162 21630 leader_election.cc:304] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:22.757261 22449 raft_consensus.cc:2749] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:22.797490 22439 raft_consensus.cc:493] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.798503 22439 raft_consensus.cc:515] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:22.803333 21488 catalog_manager.cc:5697] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 reported cstate change: term changed from 1 to 2, leader changed from 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193) to 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195). New cstate: current_term: 2 leader_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:22.807374 22348 raft_consensus.cc:493] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.808084 22348 raft_consensus.cc:515] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:22.810725 22450 raft_consensus.cc:493] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.811424 22450 raft_consensus.cc:515] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:22.816742 22441 raft_consensus.cc:493] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.817639 22441 raft_consensus.cc:515] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:22.820526 22441 leader_election.cc:290] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:22.821745 22348 leader_election.cc:290] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:22.823625 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0beed3c60054461a60991c48b418bfc" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:22.825378 22450 leader_election.cc:290] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
W20260709 13:07:22.825464 21778 leader_election.cc:336] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
W20260709 13:07:22.826462 21778 leader_election.cc:336] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:22.827934 21734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c18f9e23544d00a8d1cf17afda03c5" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:22.828291 22439 leader_election.cc:290] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:22.830178 21657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23660cfe7a7e49db942526440533cdf9" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:22.831036 21657 raft_consensus.cc:2468] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:22.832901 22439 raft_consensus.cc:493] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.833480 22439 raft_consensus.cc:515] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:22.835659 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c540859ed0b48f1b7ed38ead0137a45" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:22.835850 22439 leader_election.cc:290] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:22.837457 21777 leader_election.cc:304] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:22.839359 21778 leader_election.cc:304] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:22.840433 22439 raft_consensus.cc:2804] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:22.840983 22439 raft_consensus.cc:493] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.841373 21657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc8f1a9d5ce413cb159ae69ce846c06" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:22.842005 22441 raft_consensus.cc:2749] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:22.841358 22439 raft_consensus.cc:3060] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:22.844194 21778 leader_election.cc:336] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:22.845633 21778 leader_election.cc:304] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:22.849507 22441 raft_consensus.cc:2749] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:22.848537 21630 leader_election.cc:336] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:22.850227 21630 leader_election.cc:304] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:22.850943 22348 raft_consensus.cc:2749] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:22.851135 21630 leader_election.cc:336] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:22.851658 21630 leader_election.cc:304] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:22.853341 22441 raft_consensus.cc:493] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.853956 22441 raft_consensus.cc:515] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:22.854928 22460 tablet_bootstrap.cc:492] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:22.856081 22441 leader_election.cc:290] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:22.860224 21657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0beed3c60054461a60991c48b418bfc" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:22.861292 22450 raft_consensus.cc:493] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.861908 22450 raft_consensus.cc:515] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
W20260709 13:07:22.862792 21778 leader_election.cc:336] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:22.856293 22460 tablet_bootstrap.cc:492] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:22.864318 22460 ts_tablet_manager.cc:1403] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.112s	user 0.023s	sys 0.033s
I20260709 13:07:22.865861 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc8f1a9d5ce413cb159ae69ce846c06" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:22.866654 21807 raft_consensus.cc:2468] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 1.
I20260709 13:07:22.854833 22348 raft_consensus.cc:2749] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:22.868328 21630 leader_election.cc:304] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:22.868973 21657 raft_consensus.cc:2468] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 2.
I20260709 13:07:22.864228 22450 leader_election.cc:290] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:22.871850 22450 raft_consensus.cc:2804] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:22.872229 22450 raft_consensus.cc:493] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.872666 22450 raft_consensus.cc:3060] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:22.872788 22441 raft_consensus.cc:493] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.873462 21778 leader_election.cc:304] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:22.873385 22441 raft_consensus.cc:515] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:22.874635 22440 raft_consensus.cc:2804] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:22.875023 22440 raft_consensus.cc:493] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Starting leader election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.875442 22440 raft_consensus.cc:3060] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:22.875960 22441 leader_election.cc:290] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
W20260709 13:07:22.879034 21630 leader_election.cc:336] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
W20260709 13:07:22.884876 21778 leader_election.cc:336] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:22.878839 22460 raft_consensus.cc:359] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:22.886726 22460 raft_consensus.cc:740] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:22.887197 21657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86c9ae384544389aed37a67c0cdb7b7" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:22.887545 22460 consensus_queue.cc:260] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:22.890625 22328 raft_consensus.cc:493] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.891182 22328 raft_consensus.cc:515] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:22.893018 22460 ts_tablet_manager.cc:1434] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 13:07:22.893327 22328 leader_election.cc:290] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:22.894688 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e327a74ed0c544d28806d688941cd3f6" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:22.897732 22460 tablet_bootstrap.cc:492] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
W20260709 13:07:22.903553 21704 leader_election.cc:336] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:22.904105 21704 leader_election.cc:304] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:22.904906 22328 raft_consensus.cc:2749] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:22.910215 22440 raft_consensus.cc:515] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:22.910527 21778 leader_election.cc:304] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:22.912531 22354 raft_consensus.cc:2749] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:22.914541 22328 raft_consensus.cc:493] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.915122 22328 raft_consensus.cc:515] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:22.917425 22328 leader_election.cc:290] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:22.918165 22440 leader_election.cc:290] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:22.923475 21665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0beed3c60054461a60991c48b418bfc" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
W20260709 13:07:22.921398 21778 leader_election.cc:336] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:22.924291 21665 raft_consensus.cc:3060] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:22.930023 22348 raft_consensus.cc:493] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.930632 22348 raft_consensus.cc:515] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:22.932713 22348 leader_election.cc:290] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:22.935956 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86c9ae384544389aed37a67c0cdb7b7" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:22.936692 21807 raft_consensus.cc:2468] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 1.
I20260709 13:07:22.938372 21630 leader_election.cc:304] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:22.939913 22449 raft_consensus.cc:2804] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:22.940299 22449 raft_consensus.cc:493] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.940675 22449 raft_consensus.cc:3060] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:22.945962 22439 raft_consensus.cc:515] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:22.950630 21665 raft_consensus.cc:2468] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 3.
W20260709 13:07:22.952812 21778 leader_election.cc:336] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:22.952934 21657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83c22a51936f4415b7a99dcad7540239" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:22.953877 21778 leader_election.cc:304] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:22.954687 22440 raft_consensus.cc:2804] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:22.955283 22440 raft_consensus.cc:697] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:22.956185 22440 consensus_queue.cc:237] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:22.960099 22461 raft_consensus.cc:493] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.960798 22461 raft_consensus.cc:515] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:22.963131 22461 leader_election.cc:290] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:22.944358 22450 raft_consensus.cc:515] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
W20260709 13:07:22.964448 21630 leader_election.cc:336] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:22.967808 22439 leader_election.cc:290] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:22.969012 21665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23660cfe7a7e49db942526440533cdf9" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:22.971117 21665 raft_consensus.cc:3060] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:22.978742 22348 raft_consensus.cc:493] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.979446 22348 raft_consensus.cc:515] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:22.983269 22348 leader_election.cc:290] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:22.984390 21734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83c22a51936f4415b7a99dcad7540239" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:22.985291 21657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705488f64a3e446babbfe5b0d7bc2122" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:22.985330 21734 raft_consensus.cc:2468] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 1.
I20260709 13:07:22.986284 21657 raft_consensus.cc:2468] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 1.
I20260709 13:07:22.987253 21629 leader_election.cc:304] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:22.990141 22441 raft_consensus.cc:493] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.990831 22441 raft_consensus.cc:515] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:22.993129 22441 leader_election.cc:290] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:22.994890 22475 raft_consensus.cc:2804] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:22.995682 22475 raft_consensus.cc:493] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:22.997044 22475 raft_consensus.cc:3060] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:22.998011 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e327a74ed0c544d28806d688941cd3f6" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:22.999866 21737 raft_consensus.cc:2468] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:22.998488 22441 raft_consensus.cc:493] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:23.000818 22441 raft_consensus.cc:515] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
W20260709 13:07:23.000233 21778 leader_election.cc:336] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:23.003053 22441 leader_election.cc:290] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:23.006096 22328 raft_consensus.cc:493] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:23.006697 22328 raft_consensus.cc:515] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:23.009123 21777 leader_election.cc:304] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:23.009553 22328 leader_election.cc:290] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:23.014415 22354 raft_consensus.cc:2804] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:23.020282 22354 raft_consensus.cc:493] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:23.020728 22354 raft_consensus.cc:3060] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.014876 22475 raft_consensus.cc:515] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:23.010722 21657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a0bcc4561a4503aebdb0aab6b13b37" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:23.024348 21657 raft_consensus.cc:2468] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
W20260709 13:07:23.014158 21778 leader_election.cc:336] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:23.026806 21778 leader_election.cc:304] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:23.029106 22441 raft_consensus.cc:2804] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:23.029553 22441 raft_consensus.cc:493] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:23.029984 22441 raft_consensus.cc:3060] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.013527 22449 raft_consensus.cc:515] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:23.013772 22474 raft_consensus.cc:493] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:23.035524 22474 raft_consensus.cc:515] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
W20260709 13:07:23.015694 21704 leader_election.cc:336] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:23.037802 21704 leader_election.cc:304] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5; no voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:23.038501 22328 raft_consensus.cc:2749] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:23.041203 22450 leader_election.cc:290] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:23.041802 21488 catalog_manager.cc:5697] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 2 to 3, leader changed from 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193) to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 3 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:23.046965 22449 leader_election.cc:290] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:23.047464 21704 leader_election.cc:304] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:23.050077 22354 raft_consensus.cc:515] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:23.054787 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83c22a51936f4415b7a99dcad7540239" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:23.055966 21737 raft_consensus.cc:3060] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.057361 22461 raft_consensus.cc:2804] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:23.057827 22461 raft_consensus.cc:493] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:23.058223 22461 raft_consensus.cc:3060] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.061455 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba04167743094b89ba6e3596a48aba86" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:23.062192 21814 raft_consensus.cc:2468] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 1.
I20260709 13:07:23.052090 22441 raft_consensus.cc:515] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:23.063305 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86c9ae384544389aed37a67c0cdb7b7" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:23.065212 21810 raft_consensus.cc:3060] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.065508 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6cc8f1a9d5ce413cb159ae69ce846c06" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:23.066160 21807 raft_consensus.cc:3060] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.067587 22461 raft_consensus.cc:515] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:23.064563 22475 leader_election.cc:290] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:23.074010 21810 raft_consensus.cc:2468] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 2.
I20260709 13:07:23.076038 22441 leader_election.cc:290] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:23.083976 22461 leader_election.cc:290] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:23.084818 22474 leader_election.cc:290] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:23.063685 21737 raft_consensus.cc:2468] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 2.
I20260709 13:07:23.081877 21814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c540859ed0b48f1b7ed38ead0137a45" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:23.086826 22475 raft_consensus.cc:493] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:23.093992 21814 raft_consensus.cc:2468] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 1.
I20260709 13:07:23.094167 21629 leader_election.cc:304] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:23.094435 22475 raft_consensus.cc:515] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:23.094144 22354 leader_election.cc:290] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:23.095224 22474 raft_consensus.cc:2804] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:23.096043 22474 raft_consensus.cc:697] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [term 2 LEADER]: Becoming Leader. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Running, Role: LEADER
I20260709 13:07:23.104364 22474 consensus_queue.cc:237] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:23.090420 21630 leader_election.cc:304] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:23.091267 22460 tablet_bootstrap.cc:492] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:23.106902 22348 raft_consensus.cc:2804] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:23.107322 22348 raft_consensus.cc:493] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:23.107745 22348 raft_consensus.cc:3060] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.108088 21630 leader_election.cc:304] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:23.078359 21665 raft_consensus.cc:2468] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 2.
I20260709 13:07:23.096731 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e327a74ed0c544d28806d688941cd3f6" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:23.098155 21734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22735fa400464e149fa2d7263a8bd58a" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:23.109292 21734 raft_consensus.cc:2468] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 1.
I20260709 13:07:23.110702 22449 raft_consensus.cc:2804] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:23.111402 21737 raft_consensus.cc:3060] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.111436 22449 raft_consensus.cc:697] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [term 2 LEADER]: Becoming Leader. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Running, Role: LEADER
I20260709 13:07:23.107626 22460 tablet_bootstrap.cc:492] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:23.089710 22439 raft_consensus.cc:493] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:23.102936 22328 raft_consensus.cc:493] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:23.092760 21807 raft_consensus.cc:2468] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 2.
I20260709 13:07:23.099141 21657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a0bcc4561a4503aebdb0aab6b13b37" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:23.117496 22328 raft_consensus.cc:515] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:23.099560 22475 leader_election.cc:290] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:23.118023 21657 raft_consensus.cc:3060] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.119850 22328 leader_election.cc:290] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:23.110688 21629 leader_election.cc:304] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:23.120777 22439 raft_consensus.cc:515] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
W20260709 13:07:23.122054 21704 leader_election.cc:336] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:23.123960 22439 leader_election.cc:290] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:23.125141 21737 raft_consensus.cc:2468] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 2.
I20260709 13:07:23.112584 22449 consensus_queue.cc:237] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:23.126433 21657 raft_consensus.cc:2468] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 2.
I20260709 13:07:23.127497 22460 ts_tablet_manager.cc:1403] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.230s	user 0.043s	sys 0.025s
I20260709 13:07:23.132444 22450 raft_consensus.cc:2804] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:23.132884 22450 raft_consensus.cc:493] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:23.133234 22450 raft_consensus.cc:3060] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.136759 21657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705488f64a3e446babbfe5b0d7bc2122" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:23.137428 21657 raft_consensus.cc:3060] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.137764 22475 raft_consensus.cc:493] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:23.138439 22475 raft_consensus.cc:515] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:23.141044 22475 leader_election.cc:290] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:23.142817 21704 leader_election.cc:304] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:23.143646 22328 raft_consensus.cc:2804] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:23.144248 22328 raft_consensus.cc:493] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:23.144655 22328 raft_consensus.cc:3060] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:23.148226 21630 leader_election.cc:336] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
W20260709 13:07:23.150803 21778 leader_election.cc:336] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:23.150799 22450 raft_consensus.cc:515] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:23.153266 22450 leader_election.cc:290] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
W20260709 13:07:23.154104 21630 leader_election.cc:336] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:23.154592 21665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb99515c89d44c59276745ce3cbacd6" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
W20260709 13:07:23.169477 21704 leader_election.cc:336] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:23.169584 21665 raft_consensus.cc:2468] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 1.
W20260709 13:07:23.170979 21630 leader_election.cc:336] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:23.171447 21778 leader_election.cc:304] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c
W20260709 13:07:23.171733 21630 leader_election.cc:336] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:23.172637 21778 leader_election.cc:304] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:23.161796 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22735fa400464e149fa2d7263a8bd58a" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:23.174619 21737 raft_consensus.cc:3060] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.175755 22354 raft_consensus.cc:2804] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:23.176288 22354 raft_consensus.cc:697] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:23.164754 21662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e7302faa874a2f874d979ae54331f3" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:23.178699 21662 raft_consensus.cc:2468] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 1.
I20260709 13:07:23.173221 22484 raft_consensus.cc:2804] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:23.173756 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e7302faa874a2f874d979ae54331f3" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:23.191059 22484 raft_consensus.cc:697] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:23.191160 21807 raft_consensus.cc:2468] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 1.
I20260709 13:07:23.192027 22484 consensus_queue.cc:237] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:23.195724 21704 leader_election.cc:304] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:23.196836 22481 raft_consensus.cc:2804] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:23.197242 22481 raft_consensus.cc:493] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:23.197642 22481 raft_consensus.cc:3060] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.167232 21777 leader_election.cc:304] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:23.160629 21657 raft_consensus.cc:2468] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 2.
I20260709 13:07:23.182103 21630 leader_election.cc:304] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:23.202631 22475 raft_consensus.cc:2804] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:23.203181 22475 raft_consensus.cc:697] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [term 2 LEADER]: Becoming Leader. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Running, Role: LEADER
W20260709 13:07:23.203574 21630 leader_election.cc:336] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
W20260709 13:07:23.204535 21630 leader_election.cc:336] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:23.204092 22475 consensus_queue.cc:237] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:23.177469 22354 consensus_queue.cc:237] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:23.211495 21488 catalog_manager.cc:5697] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 reported cstate change: term changed from 1 to 2, leader changed from 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193) to bed294de06e24ca4aba572ec722d2567 (127.11.44.194). New cstate: current_term: 2 leader_uuid: "bed294de06e24ca4aba572ec722d2567" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:23.188038 22348 raft_consensus.cc:515] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:23.220466 22348 leader_election.cc:290] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:23.188911 21737 raft_consensus.cc:2468] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 2.
I20260709 13:07:23.182339 22479 raft_consensus.cc:493] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:23.212260 22481 raft_consensus.cc:515] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:23.222415 22479 raft_consensus.cc:515] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:23.223575 21629 leader_election.cc:304] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:23.224933 22479 leader_election.cc:290] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:23.226200 22481 leader_election.cc:290] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
W20260709 13:07:23.214056 21778 leader_election.cc:336] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:23.215384 21704 leader_election.cc:304] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:23.203603 22476 raft_consensus.cc:2804] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:23.227587 22476 raft_consensus.cc:697] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:23.228600 21630 leader_election.cc:304] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:23.228535 22476 consensus_queue.cc:237] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:23.229835 22450 raft_consensus.cc:2804] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:23.230497 22450 raft_consensus.cc:697] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [term 2 LEADER]: Becoming Leader. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Running, Role: LEADER
I20260709 13:07:23.231392 22450 consensus_queue.cc:237] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
W20260709 13:07:23.233587 21704 leader_election.cc:336] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:23.233758 22474 raft_consensus.cc:2804] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:23.234293 22474 raft_consensus.cc:493] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:23.234697 22474 raft_consensus.cc:3060] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:23.234805 21704 leader_election.cc:336] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
W20260709 13:07:23.238624 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:35255, user_credentials={real_user=slave}} blocked reactor thread for 52348.9us
I20260709 13:07:23.190290 22328 raft_consensus.cc:515] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:23.131850 22460 raft_consensus.cc:359] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:23.241816 22328 leader_election.cc:290] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:23.246737 21657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c18f9e23544d00a8d1cf17afda03c5" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:23.256908 21657 raft_consensus.cc:2468] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 1.
I20260709 13:07:23.253480 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba04167743094b89ba6e3596a48aba86" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:23.258612 21807 raft_consensus.cc:3060] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:23.255089 21630 leader_election.cc:336] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
W20260709 13:07:23.262725 21630 leader_election.cc:336] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:23.255352 22460 raft_consensus.cc:740] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.253520 21662 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cb99515c89d44c59276745ce3cbacd6" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:23.265631 21662 raft_consensus.cc:3060] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.266031 22460 consensus_queue.cc:260] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:23.269316 22460 ts_tablet_manager.cc:1434] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.141s	user 0.004s	sys 0.001s
I20260709 13:07:23.282012 22460 tablet_bootstrap.cc:492] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:23.269948 22474 raft_consensus.cc:515] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:23.271924 21807 raft_consensus.cc:2468] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 2.
I20260709 13:07:23.277029 21662 raft_consensus.cc:2468] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 2.
I20260709 13:07:23.242987 22481 raft_consensus.cc:2804] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:23.293320 21704 leader_election.cc:304] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
W20260709 13:07:23.294067 21630 leader_election.cc:336] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
W20260709 13:07:23.301076 21778 leader_election.cc:336] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:23.315658 21778 leader_election.cc:304] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:23.335670 22474 leader_election.cc:290] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:23.337793 21704 leader_election.cc:304] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:23.339228 22461 raft_consensus.cc:2804] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:23.339749 22461 raft_consensus.cc:697] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 LEADER]: Becoming Leader. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Running, Role: LEADER
I20260709 13:07:23.340046 21660 raft_consensus.cc:1275] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Refusing update from remote peer 3e8f84032ed948908dc7fcffcfe2d6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:23.340695 22461 consensus_queue.cc:237] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:23.320778 22481 raft_consensus.cc:697] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 LEADER]: Becoming Leader. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Running, Role: LEADER
W20260709 13:07:23.347069 21704 leader_election.cc:336] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:23.321456 22479 raft_consensus.cc:2804] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:23.348944 22479 raft_consensus.cc:493] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:23.349354 22479 raft_consensus.cc:3060] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:23.348054 21704 leader_election.cc:336] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:23.346952 22481 consensus_queue.cc:237] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:23.357710 21630 leader_election.cc:304] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:23.358582 22449 raft_consensus.cc:2804] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:23.359082 22449 raft_consensus.cc:697] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 [term 2 LEADER]: Becoming Leader. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Running, Role: LEADER
W20260709 13:07:23.359345 21704 leader_election.cc:336] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:23.359920 22449 consensus_queue.cc:237] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:23.365020 22479 raft_consensus.cc:515] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:23.371649 22478 consensus_queue.cc:1048] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:07:23.373391 21630 leader_election.cc:336] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
W20260709 13:07:23.374198 21777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:46013, user_credentials={real_user=slave}} blocked reactor thread for 169479us
I20260709 13:07:23.375001 22485 raft_consensus.cc:2804] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:23.375519 22485 raft_consensus.cc:493] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Starting leader election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:23.375926 22485 raft_consensus.cc:3060] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:23.376678 21488 catalog_manager.cc:5697] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 reported cstate change: term changed from 1 to 2, leader changed from 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193) to bed294de06e24ca4aba572ec722d2567 (127.11.44.194). New cstate: current_term: 2 leader_uuid: "bed294de06e24ca4aba572ec722d2567" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:23.380352 21488 catalog_manager.cc:5697] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 reported cstate change: term changed from 1 to 2, leader changed from 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193) to bed294de06e24ca4aba572ec722d2567 (127.11.44.194). New cstate: current_term: 2 leader_uuid: "bed294de06e24ca4aba572ec722d2567" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:23.375053 21778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:35853, user_credentials={real_user=slave}} blocked reactor thread for 59504.5us
I20260709 13:07:23.385790 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e7302faa874a2f874d979ae54331f3" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:23.389071 21488 catalog_manager.cc:5697] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 reported cstate change: term changed from 1 to 2, leader changed from 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193) to bed294de06e24ca4aba572ec722d2567 (127.11.44.194). New cstate: current_term: 2 leader_uuid: "bed294de06e24ca4aba572ec722d2567" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:23.414278 21485 catalog_manager.cc:5697] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 1 to 2, leader changed from 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193) to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 2 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:23.420871 21487 catalog_manager.cc:5697] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 reported cstate change: term changed from 1 to 2, leader changed from 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193) to 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195). New cstate: current_term: 2 leader_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:23.420334 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c540859ed0b48f1b7ed38ead0137a45" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:23.424875 21810 raft_consensus.cc:3060] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:23.425417 22494 log.cc:927] Time spent T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:07:23.436484 22460 tablet_bootstrap.cc:492] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:23.437463 22460 tablet_bootstrap.cc:492] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:23.438113 22460 ts_tablet_manager.cc:1403] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.156s	user 0.014s	sys 0.014s
I20260709 13:07:23.439425 21665 raft_consensus.cc:1275] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 3 FOLLOWER]: Refusing update from remote peer b8c58d9f32b84e5bb79e2751ac41cdba: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:23.442716 21810 raft_consensus.cc:2468] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 2.
I20260709 13:07:23.444798 22439 consensus_queue.cc:1048] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:23.421679 22485 raft_consensus.cc:515] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:23.440524 22460 raft_consensus.cc:359] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:23.471071 22460 raft_consensus.cc:740] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.471938 22460 consensus_queue.cc:260] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:23.474756 22460 ts_tablet_manager.cc:1434] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 13:07:23.475076 21807 raft_consensus.cc:2393] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate bed294de06e24ca4aba572ec722d2567 in current term 2: Already voted for candidate b8c58d9f32b84e5bb79e2751ac41cdba in this term.
I20260709 13:07:23.475564 22460 tablet_bootstrap.cc:492] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:23.478742 22485 leader_election.cc:290] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:23.479111 21630 leader_election.cc:304] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba
W20260709 13:07:23.475565 21704 consensus_peers.cc:597] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:23.482182 21665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e7302faa874a2f874d979ae54331f3" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:23.483166 21665 raft_consensus.cc:2393] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b8c58d9f32b84e5bb79e2751ac41cdba in current term 2: Already voted for candidate bed294de06e24ca4aba572ec722d2567 in this term.
I20260709 13:07:23.484858 22449 raft_consensus.cc:2749] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:23.485816 21665 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7c18f9e23544d00a8d1cf17afda03c5" candidate_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:23.448846 22479 leader_election.cc:290] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:23.486503 21665 raft_consensus.cc:3060] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:23.490826 21778 leader_election.cc:336] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:23.495719 21665 raft_consensus.cc:2468] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3e8f84032ed948908dc7fcffcfe2d6e5 in term 2.
I20260709 13:07:23.498435 21704 leader_election.cc:304] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:23.491391 21778 leader_election.cc:304] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:23.503399 22479 raft_consensus.cc:2804] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:23.503985 22354 raft_consensus.cc:2749] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:07:23.504122 22479 raft_consensus.cc:697] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 LEADER]: Becoming Leader. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Running, Role: LEADER
I20260709 13:07:23.507306 22479 consensus_queue.cc:237] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:23.460319 21487 catalog_manager.cc:5697] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 reported cstate change: term changed from 1 to 2, leader changed from 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193) to bed294de06e24ca4aba572ec722d2567 (127.11.44.194). New cstate: current_term: 2 leader_uuid: "bed294de06e24ca4aba572ec722d2567" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:23.610584 21736 raft_consensus.cc:1275] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Refusing update from remote peer bed294de06e24ca4aba572ec722d2567: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:23.614897 22449 consensus_queue.cc:1048] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:07:23.617338 22501 log.cc:927] Time spent T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:07:23.613839 21485 catalog_manager.cc:5697] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 1 to 2, leader changed from 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193) to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 2 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:23.629496 21704 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.196:41173, user_credentials={real_user=slave}} blocked reactor thread for 65554.4us
I20260709 13:07:23.629669 21485 catalog_manager.cc:5697] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 1 to 2, leader changed from 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193) to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 2 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:23.631078 21704 leader_election.cc:304] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:23.634099 22461 raft_consensus.cc:2804] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:23.634824 22461 raft_consensus.cc:697] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 LEADER]: Becoming Leader. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Running, Role: LEADER
I20260709 13:07:23.636544 22461 consensus_queue.cc:237] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
W20260709 13:07:23.622679 21630 consensus_peers.cc:597] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:23.644608 21778 consensus_peers.cc:597] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:23.660419 22460 tablet_bootstrap.cc:492] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:23.662094 22460 tablet_bootstrap.cc:492] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:23.663530 22460 ts_tablet_manager.cc:1403] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.188s	user 0.027s	sys 0.003s
W20260709 13:07:23.669435 21630 consensus_peers.cc:597] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:23.676609 11443 ts_tablet_manager.cc:600] Registering tablets (34/45 complete)
I20260709 13:07:23.688369 21737 raft_consensus.cc:1275] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Refusing update from remote peer bed294de06e24ca4aba572ec722d2567: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:23.690958 22482 consensus_queue.cc:1048] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:07:23.697397 21630 consensus_peers.cc:597] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:23.715415 21659 raft_consensus.cc:1275] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Refusing update from remote peer b8c58d9f32b84e5bb79e2751ac41cdba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:23.720804 21485 catalog_manager.cc:5697] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 reported cstate change: term changed from 1 to 2, leader changed from 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193) to 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195). New cstate: current_term: 2 leader_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:23.732515 22476 consensus_queue.cc:1048] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:23.732508 21807 raft_consensus.cc:1275] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Refusing update from remote peer bed294de06e24ca4aba572ec722d2567: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:07:23.742671 21778 consensus_peers.cc:597] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:23.720958 22460 raft_consensus.cc:359] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:23.744874 22460 raft_consensus.cc:740] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:23.747694 22482 consensus_queue.cc:1048] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:23.750583 21810 raft_consensus.cc:1275] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Refusing update from remote peer bed294de06e24ca4aba572ec722d2567: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:23.747129 22460 consensus_queue.cc:260] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:23.768105 22460 ts_tablet_manager.cc:1434] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.104s	user 0.014s	sys 0.001s
I20260709 13:07:23.769658 22460 tablet_bootstrap.cc:492] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
W20260709 13:07:23.771308 21704 leader_election.cc:336] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:23.773665 21736 raft_consensus.cc:1275] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Refusing update from remote peer b8c58d9f32b84e5bb79e2751ac41cdba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:23.782994 22485 consensus_queue.cc:1048] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:07:23.794691 21630 consensus_peers.cc:597] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:23.794466 22474 consensus_queue.cc:1048] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:07:23.832670 21778 consensus_peers.cc:597] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:23.832619 21630 consensus_peers.cc:597] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:23.878443 21665 raft_consensus.cc:1275] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Refusing update from remote peer b8c58d9f32b84e5bb79e2751ac41cdba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:07:23.876451 21778 consensus_peers.cc:597] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:23.881907 21704 consensus_peers.cc:597] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:23.882543 21704 consensus_peers.cc:597] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:23.899501 21778 consensus_peers.cc:597] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:23.909010 22441 consensus_queue.cc:1048] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:23.921860 21665 raft_consensus.cc:1275] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Refusing update from remote peer 3e8f84032ed948908dc7fcffcfe2d6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:23.933981 21810 raft_consensus.cc:1275] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Refusing update from remote peer bed294de06e24ca4aba572ec722d2567: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:07:23.921252 21778 consensus_peers.cc:597] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:23.942446 21778 consensus_peers.cc:597] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:23.947259 22503 consensus_queue.cc:1048] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:23.952750 22474 consensus_queue.cc:1048] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:23.956502 21778 consensus_peers.cc:597] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:23.961894 21488 catalog_manager.cc:5697] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 reported cstate change: term changed from 1 to 2, leader changed from 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193) to 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195). New cstate: current_term: 2 leader_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:23.963974 21488 catalog_manager.cc:5697] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 reported cstate change: term changed from 1 to 2, leader changed from 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193) to 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195). New cstate: current_term: 2 leader_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:23.968307 11443 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:07:23.968916 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 1.385s	user 0.338s	sys 0.012s
W20260709 13:07:23.979549 21778 consensus_peers.cc:597] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:23.992151 22460 tablet_bootstrap.cc:492] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:23.994925 22460 tablet_bootstrap.cc:492] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:23.998189 22460 ts_tablet_manager.cc:1403] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.229s	user 0.017s	sys 0.006s
I20260709 13:07:23.998528 21660 raft_consensus.cc:1275] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Refusing update from remote peer 3e8f84032ed948908dc7fcffcfe2d6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:07:24.000278 21704 consensus_peers.cc:597] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:24.002755 22460 raft_consensus.cc:359] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:24.003530 22460 raft_consensus.cc:740] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.008494 22460 consensus_queue.cc:260] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:24.012168 22460 ts_tablet_manager.cc:1434] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
W20260709 13:07:24.021209 21630 consensus_peers.cc:597] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:24.030552 22460 tablet_bootstrap.cc:492] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:24.049540 22503 consensus_queue.cc:1048] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
W20260709 13:07:24.054466 21630 consensus_peers.cc:597] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:24.057541 21778 consensus_peers.cc:597] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:24.073410 21778 consensus_peers.cc:597] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:24.076139 21657 raft_consensus.cc:1275] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Refusing update from remote peer 3e8f84032ed948908dc7fcffcfe2d6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:24.080756 22463 raft_consensus.cc:493] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.100519 21807 raft_consensus.cc:1275] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Refusing update from remote peer 3e8f84032ed948908dc7fcffcfe2d6e5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:24.081480 22463 raft_consensus.cc:515] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
W20260709 13:07:24.102506 21630 consensus_peers.cc:597] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:24.104058 22328 consensus_queue.cc:1048] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:24.104749 22463 leader_election.cc:290] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:24.116963 22460 tablet_bootstrap.cc:492] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:24.118121 22460 tablet_bootstrap.cc:492] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:24.118824 22460 ts_tablet_manager.cc:1403] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.091s	user 0.015s	sys 0.006s
I20260709 13:07:24.122406 22460 raft_consensus.cc:359] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:24.123219 22460 raft_consensus.cc:740] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.124012 22460 consensus_queue.cc:260] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
W20260709 13:07:24.125591 21630 consensus_peers.cc:597] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:24.149104 22460 ts_tablet_manager.cc:1434] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.002s
I20260709 13:07:24.153888 22478 consensus_queue.cc:1048] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
W20260709 13:07:24.158305 21778 consensus_peers.cc:597] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:24.163802 21704 consensus_peers.cc:597] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:24.167460 21778 consensus_peers.cc:597] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:24.179162 22460 tablet_bootstrap.cc:492] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
W20260709 13:07:24.207614 21704 consensus_peers.cc:597] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:24.216549 21704 consensus_peers.cc:597] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:24.232764 22463 raft_consensus.cc:493] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.233387 22463 raft_consensus.cc:515] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
W20260709 13:07:24.236526 21778 consensus_peers.cc:597] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:24.237059 21778 consensus_peers.cc:597] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:24.237461 21778 consensus_peers.cc:597] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:24.242134 22463 leader_election.cc:290] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:24.275238 22460 tablet_bootstrap.cc:492] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:24.276264 22460 tablet_bootstrap.cc:492] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:24.276495 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cf644bea63405f9d1a353862a5a110" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:24.277915 22460 ts_tablet_manager.cc:1403] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.099s	user 0.028s	sys 0.007s
I20260709 13:07:24.280880 21659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cf644bea63405f9d1a353862a5a110" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:24.280810 22460 raft_consensus.cc:359] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:24.282153 21657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705488f64a3e446babbfe5b0d7bc2122" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:24.283633 22460 raft_consensus.cc:740] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.284585 22460 consensus_queue.cc:260] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:24.285403 22455 leader_election.cc:304] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:24.286754 22463 raft_consensus.cc:2749] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:24.288187 22460 ts_tablet_manager.cc:1434] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
W20260709 13:07:24.290475 21778 consensus_peers.cc:597] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:24.289310 22460 tablet_bootstrap.cc:492] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
W20260709 13:07:24.318079 21704 consensus_peers.cc:597] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:24.318778 21704 consensus_peers.cc:597] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:24.325978 22463 raft_consensus.cc:493] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.326620 22463 raft_consensus.cc:515] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:24.330579 21659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "832d931fb3f84415aac4b1880e99c498" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:24.335124 21736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "832d931fb3f84415aac4b1880e99c498" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:24.337654 22454 leader_election.cc:304] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:24.338611 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "705488f64a3e446babbfe5b0d7bc2122" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:24.354244 22463 leader_election.cc:290] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:24.354918 22463 raft_consensus.cc:2749] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:24.372196 22460 tablet_bootstrap.cc:492] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:24.373312 22460 tablet_bootstrap.cc:492] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
W20260709 13:07:24.374094 21704 consensus_peers.cc:597] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:24.376736 22460 ts_tablet_manager.cc:1403] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.088s	user 0.009s	sys 0.014s
W20260709 13:07:24.381000 22454 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:46013, user_credentials={real_user=slave}} blocked reactor thread for 43607.7us
I20260709 13:07:24.382062 22454 leader_election.cc:304] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:24.383389 22539 raft_consensus.cc:2749] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:24.389194 21704 consensus_peers.cc:597] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:24.388175 22460 raft_consensus.cc:359] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:24.391767 22460 raft_consensus.cc:740] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.394578 22460 consensus_queue.cc:260] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
W20260709 13:07:24.395273 21778 consensus_peers.cc:597] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:24.400118 22460 ts_tablet_manager.cc:1434] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:07:24.401337 22460 tablet_bootstrap.cc:492] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
W20260709 13:07:24.408875 21778 consensus_peers.cc:597] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:24.450800 22460 tablet_bootstrap.cc:492] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:24.452232 22460 tablet_bootstrap.cc:492] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:24.453204 22460 ts_tablet_manager.cc:1403] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.019s
I20260709 13:07:24.458470 22460 raft_consensus.cc:359] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:24.459208 22460 raft_consensus.cc:740] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.460001 22460 consensus_queue.cc:260] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:24.462944 22460 ts_tablet_manager.cc:1434] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:07:24.463958 22460 tablet_bootstrap.cc:492] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
W20260709 13:07:24.502802 21704 consensus_peers.cc:597] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:24.513356 22460 tablet_bootstrap.cc:492] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:24.515501 22460 tablet_bootstrap.cc:492] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:24.516237 22460 ts_tablet_manager.cc:1403] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.053s	user 0.024s	sys 0.012s
I20260709 13:07:24.521085 22460 raft_consensus.cc:359] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:24.521860 22460 raft_consensus.cc:740] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.522553 22460 consensus_queue.cc:260] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:24.524852 22460 ts_tablet_manager.cc:1434] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:07:24.525862 22460 tablet_bootstrap.cc:492] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
W20260709 13:07:24.551975 21778 consensus_peers.cc:597] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:24.553134 22460 tablet_bootstrap.cc:492] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:24.554242 22460 tablet_bootstrap.cc:492] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:24.555202 22460 ts_tablet_manager.cc:1403] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.007s
I20260709 13:07:24.558205 22460 raft_consensus.cc:359] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:24.559167 22460 raft_consensus.cc:740] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.559938 22460 consensus_queue.cc:260] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:24.562613 22460 ts_tablet_manager.cc:1434] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:07:24.563633 22460 tablet_bootstrap.cc:492] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:24.569114 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.193:35255
I20260709 13:07:24.573231 22589 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.193:35255 every 8 connection(s)
I20260709 13:07:24.588950 22460 tablet_bootstrap.cc:492] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:24.590458 22460 tablet_bootstrap.cc:492] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:24.591182 22460 ts_tablet_manager.cc:1403] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.028s	user 0.021s	sys 0.003s
I20260709 13:07:24.594121 22460 raft_consensus.cc:359] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:24.594841 22460 raft_consensus.cc:740] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.595749 22460 consensus_queue.cc:260] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:24.597470 22460 ts_tablet_manager.cc:1434] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:07:24.604929 22460 tablet_bootstrap.cc:492] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
W20260709 13:07:24.613744 21630 consensus_peers.cc:597] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:24.638454 22539 raft_consensus.cc:493] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.639060 22539 raft_consensus.cc:515] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:24.642424 22539 leader_election.cc:290] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:24.644265 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583c8787161e47ccb08cd01f6d26d5a4" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:24.654198 21737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583c8787161e47ccb08cd01f6d26d5a4" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" is_pre_election: true
I20260709 13:07:24.659395 22454 leader_election.cc:304] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, b8c58d9f32b84e5bb79e2751ac41cdba
I20260709 13:07:24.660296 22539 raft_consensus.cc:2749] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:24.662415 21704 consensus_peers.cc:597] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:24.670971 22590 heartbeater.cc:344] Connected to a master server at 127.11.44.254:41239
I20260709 13:07:24.671424 22590 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:24.672410 22590 heartbeater.cc:507] Master 127.11.44.254:41239 requested a full tablet report, sending...
I20260709 13:07:24.674618 22460 tablet_bootstrap.cc:492] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:24.675733 22460 tablet_bootstrap.cc:492] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:24.676481 22460 ts_tablet_manager.cc:1403] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.078s	user 0.022s	sys 0.010s
I20260709 13:07:24.679564 22460 raft_consensus.cc:359] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:24.680315 22460 raft_consensus.cc:740] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.682715 22460 consensus_queue.cc:260] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
W20260709 13:07:24.683552 21778 consensus_peers.cc:597] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:24.687165 22460 ts_tablet_manager.cc:1434] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:07:24.688213 22460 tablet_bootstrap.cc:492] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:24.702252 21487 ts_manager.cc:194] Re-registered known tserver with Master: 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:24.723945 22563 raft_consensus.cc:3060] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:24.726042 22539 raft_consensus.cc:493] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.726713 22539 raft_consensus.cc:515] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:24.729013 22539 leader_election.cc:290] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:24.732311 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac5258f941c4bdbb2ba4e33a4eaca08" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" is_pre_election: true
I20260709 13:07:24.735976 21659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac5258f941c4bdbb2ba4e33a4eaca08" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:24.752182 22455 leader_election.cc:304] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c; no voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:24.754091 22539 raft_consensus.cc:2749] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:24.764452 22560 raft_consensus.cc:3060] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:24.819585 22564 raft_consensus.cc:3060] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:24.833281 22559 raft_consensus.cc:3060] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:24.894380 22460 tablet_bootstrap.cc:492] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:24.899703 22460 tablet_bootstrap.cc:492] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:24.900452 22460 ts_tablet_manager.cc:1403] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.212s	user 0.034s	sys 0.061s
I20260709 13:07:24.905601 22460 raft_consensus.cc:359] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:24.906315 22460 raft_consensus.cc:740] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:24.910614 22460 consensus_queue.cc:260] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:24.947919 22558 raft_consensus.cc:3060] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:24.957990 22460 ts_tablet_manager.cc:1434] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.057s	user 0.010s	sys 0.001s
I20260709 13:07:24.958935 22460 tablet_bootstrap.cc:492] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:24.962561 22557 raft_consensus.cc:3060] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.020623 22599 raft_consensus.cc:493] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.021224 22599 raft_consensus.cc:515] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:25.026044 22559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e7302faa874a2f874d979ae54331f3" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c" is_pre_election: true
W20260709 13:07:25.028438 21778 leader_election.cc:343] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:25.026324 22599 leader_election.cc:290] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:25.026855 21660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e7302faa874a2f874d979ae54331f3" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567" is_pre_election: true
I20260709 13:07:25.029438 21660 raft_consensus.cc:2468] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 2.
I20260709 13:07:25.031016 21778 leader_election.cc:304] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:25.032284 22476 raft_consensus.cc:2804] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:07:25.032663 22476 raft_consensus.cc:493] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.032975 22476 raft_consensus.cc:3060] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:25.045642 22476 raft_consensus.cc:515] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:25.051436 22476 leader_election.cc:290] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 election: Requested vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:25.054342 21660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e7302faa874a2f874d979ae54331f3" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:25.055047 21660 raft_consensus.cc:3060] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:25.052135 22559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e7302faa874a2f874d979ae54331f3" candidate_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
W20260709 13:07:25.063985 21778 leader_election.cc:343] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:25.082974 21487 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56822
I20260709 13:07:25.085383 21660 raft_consensus.cc:2468] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8c58d9f32b84e5bb79e2751ac41cdba in term 3.
I20260709 13:07:25.088985 22590 heartbeater.cc:499] Master 127.11.44.254:41239 was elected leader, sending a full tablet report...
I20260709 13:07:25.089111 21778 leader_election.cc:304] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba, bed294de06e24ca4aba572ec722d2567; no voters: 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:25.090243 22476 raft_consensus.cc:2804] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:25.091871 22476 raft_consensus.cc:697] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 LEADER]: Becoming Leader. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:25.092948 22476 consensus_queue.cc:237] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:25.108817 22460 tablet_bootstrap.cc:492] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:25.117426 22460 tablet_bootstrap.cc:492] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:25.120599 22460 ts_tablet_manager.cc:1403] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.162s	user 0.021s	sys 0.002s
I20260709 13:07:25.123813 22460 raft_consensus.cc:359] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:25.124778 22460 raft_consensus.cc:740] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.125484 22460 consensus_queue.cc:260] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:25.128093 22460 ts_tablet_manager.cc:1434] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:07:25.129339 22460 tablet_bootstrap.cc:492] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:25.132285 21488 catalog_manager.cc:5697] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba reported cstate change: term changed from 1 to 3, leader changed from 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193) to b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196). New cstate: current_term: 3 leader_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:25.146792 22460 tablet_bootstrap.cc:492] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:25.147907 22460 tablet_bootstrap.cc:492] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:25.149349 22460 ts_tablet_manager.cc:1403] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 13:07:25.151957 22460 raft_consensus.cc:359] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:25.152659 22460 raft_consensus.cc:740] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.153473 22460 consensus_queue.cc:260] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:25.155534 22460 ts_tablet_manager.cc:1434] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:25.156410 22460 tablet_bootstrap.cc:492] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:25.176770 22460 tablet_bootstrap.cc:492] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:25.178050 22460 tablet_bootstrap.cc:492] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:25.178912 22460 ts_tablet_manager.cc:1403] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.010s
I20260709 13:07:25.182183 22460 raft_consensus.cc:359] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:25.183142 22460 raft_consensus.cc:740] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.184852 22460 consensus_queue.cc:260] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:25.189445 22460 ts_tablet_manager.cc:1434] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:07:25.190349 22460 tablet_bootstrap.cc:492] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:25.224335 22460 tablet_bootstrap.cc:492] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:25.225224 22460 tablet_bootstrap.cc:492] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:25.225842 22460 ts_tablet_manager.cc:1403] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.004s
I20260709 13:07:25.228140 22460 raft_consensus.cc:359] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:25.228833 22460 raft_consensus.cc:740] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.229475 22460 consensus_queue.cc:260] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:25.231660 22460 ts_tablet_manager.cc:1434] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:25.232496 22460 tablet_bootstrap.cc:492] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:25.264537 22460 tablet_bootstrap.cc:492] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:25.265878 22460 tablet_bootstrap.cc:492] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:25.266705 22460 ts_tablet_manager.cc:1403] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.012s
I20260709 13:07:25.269791 22460 raft_consensus.cc:359] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:25.270584 22460 raft_consensus.cc:740] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.271307 22460 consensus_queue.cc:260] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:25.273548 22460 ts_tablet_manager.cc:1434] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:25.275215 22460 tablet_bootstrap.cc:492] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:25.305059 22460 tablet_bootstrap.cc:492] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:25.306115 22460 tablet_bootstrap.cc:492] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:25.306833 22460 ts_tablet_manager.cc:1403] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.007s
I20260709 13:07:25.309401 22460 raft_consensus.cc:359] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:25.310055 22460 raft_consensus.cc:740] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.311352 22460 consensus_queue.cc:260] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:25.316933 22460 ts_tablet_manager.cc:1434] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:07:25.317875 22460 tablet_bootstrap.cc:492] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:25.346899 22460 tablet_bootstrap.cc:492] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:25.348023 22460 tablet_bootstrap.cc:492] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:25.348834 22460 ts_tablet_manager.cc:1403] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.015s
I20260709 13:07:25.351696 22460 raft_consensus.cc:359] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:25.352532 22460 raft_consensus.cc:740] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.353433 22460 consensus_queue.cc:260] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:25.364950 22460 ts_tablet_manager.cc:1434] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:07:25.366425 22460 tablet_bootstrap.cc:492] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:25.395799 22460 tablet_bootstrap.cc:492] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:25.396775 22460 tablet_bootstrap.cc:492] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:25.397464 22460 ts_tablet_manager.cc:1403] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.006s
I20260709 13:07:25.400233 22460 raft_consensus.cc:359] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:25.400942 22460 raft_consensus.cc:740] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.401677 22460 consensus_queue.cc:260] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:25.403970 22460 ts_tablet_manager.cc:1434] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:25.405596 22460 tablet_bootstrap.cc:492] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:25.424998 22460 tablet_bootstrap.cc:492] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:25.426017 22460 tablet_bootstrap.cc:492] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:25.426704 22460 ts_tablet_manager.cc:1403] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.004s
I20260709 13:07:25.429345 22460 raft_consensus.cc:359] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:25.430094 22460 raft_consensus.cc:740] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.430788 22460 consensus_queue.cc:260] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:25.437156 22460 ts_tablet_manager.cc:1434] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:07:25.438117 22460 tablet_bootstrap.cc:492] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:25.462198 22460 tablet_bootstrap.cc:492] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:25.463338 22460 tablet_bootstrap.cc:492] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:25.464162 22460 ts_tablet_manager.cc:1403] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.008s
I20260709 13:07:25.467051 22460 raft_consensus.cc:359] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:25.467849 22460 raft_consensus.cc:740] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.468658 22460 consensus_queue.cc:260] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:25.471050 22460 ts_tablet_manager.cc:1434] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:07:25.472291 22460 tablet_bootstrap.cc:492] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:25.498973 22460 tablet_bootstrap.cc:492] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:25.500070 22460 tablet_bootstrap.cc:492] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:25.500833 22460 ts_tablet_manager.cc:1403] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.006s
I20260709 13:07:25.504945 22460 raft_consensus.cc:359] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:25.505656 22460 raft_consensus.cc:740] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.506330 22460 consensus_queue.cc:260] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:25.508669 22460 ts_tablet_manager.cc:1434] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 13:07:25.509516 22460 tablet_bootstrap.cc:492] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:25.535440 22460 tablet_bootstrap.cc:492] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:25.536581 22460 tablet_bootstrap.cc:492] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:25.542016 22460 ts_tablet_manager.cc:1403] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.003s
I20260709 13:07:25.544586 22460 raft_consensus.cc:359] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:25.545311 22460 raft_consensus.cc:740] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.545982 22460 consensus_queue.cc:260] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:25.551257 22559 raft_consensus.cc:3060] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.554982 22563 raft_consensus.cc:3060] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:07:25.565474 22563 raft_consensus.cc:1275] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 3 FOLLOWER]: Refusing update from remote peer b8c58d9f32b84e5bb79e2751ac41cdba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:25.554982 22460 ts_tablet_manager.cc:1434] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:07:25.567432 22460 tablet_bootstrap.cc:492] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:25.567474 22598 consensus_queue.cc:1048] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:25.625341 22460 tablet_bootstrap.cc:492] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:25.626372 22460 tablet_bootstrap.cc:492] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:25.627040 22460 ts_tablet_manager.cc:1403] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.060s	user 0.021s	sys 0.003s
I20260709 13:07:25.629791 22460 raft_consensus.cc:359] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:25.630520 22460 raft_consensus.cc:740] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.631237 22460 consensus_queue.cc:260] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:25.634982 22460 ts_tablet_manager.cc:1434] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:07:25.636230 22460 tablet_bootstrap.cc:492] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:25.640390 22563 raft_consensus.cc:3060] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.651872 22558 raft_consensus.cc:3060] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:25.734427 21657 raft_consensus.cc:1275] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 3 FOLLOWER]: Refusing update from remote peer b8c58d9f32b84e5bb79e2751ac41cdba: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:25.739217 22460 tablet_bootstrap.cc:492] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:25.740404 22460 tablet_bootstrap.cc:492] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:25.740607 22564 raft_consensus.cc:3060] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:25.741209 22460 ts_tablet_manager.cc:1403] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.105s	user 0.028s	sys 0.038s
I20260709 13:07:25.779875 22460 raft_consensus.cc:359] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:25.780591 22460 raft_consensus.cc:740] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.787349 22476 consensus_queue.cc:1048] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:25.781288 22460 consensus_queue.cc:260] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:25.791363 22460 ts_tablet_manager.cc:1434] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:07:25.793713 22460 tablet_bootstrap.cc:492] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:25.839953 22460 tablet_bootstrap.cc:492] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:25.841581 22460 tablet_bootstrap.cc:492] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:25.842538 22460 ts_tablet_manager.cc:1403] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.049s	user 0.019s	sys 0.004s
I20260709 13:07:25.846419 22460 raft_consensus.cc:359] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:25.847446 22460 raft_consensus.cc:740] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.848188 22460 consensus_queue.cc:260] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
W20260709 13:07:25.851541 21704 consensus_peers.cc:597] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:25.855037 22460 ts_tablet_manager.cc:1434] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:07:25.856168 22460 tablet_bootstrap.cc:492] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:25.882702 22460 tablet_bootstrap.cc:492] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:25.884167 22460 tablet_bootstrap.cc:492] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:25.884869 22460 ts_tablet_manager.cc:1403] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.006s
I20260709 13:07:25.888041 22460 raft_consensus.cc:359] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:25.888784 22460 raft_consensus.cc:740] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.889525 22460 consensus_queue.cc:260] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:25.891947 22460 ts_tablet_manager.cc:1434] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:07:25.893407 22460 tablet_bootstrap.cc:492] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:25.927908 22460 tablet_bootstrap.cc:492] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:25.928881 22460 tablet_bootstrap.cc:492] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:25.929553 22460 ts_tablet_manager.cc:1403] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.017s
I20260709 13:07:25.932020 22460 raft_consensus.cc:359] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:25.932684 22460 raft_consensus.cc:740] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.933333 22460 consensus_queue.cc:260] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:25.935372 22460 ts_tablet_manager.cc:1434] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:25.938154 22460 tablet_bootstrap.cc:492] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:25.961576 22460 tablet_bootstrap.cc:492] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:25.962778 22460 tablet_bootstrap.cc:492] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:25.963591 22460 ts_tablet_manager.cc:1403] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.001s
I20260709 13:07:25.966959 22460 raft_consensus.cc:359] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:25.967887 22460 raft_consensus.cc:740] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.968742 22460 consensus_queue.cc:260] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:25.971500 22460 ts_tablet_manager.cc:1434] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 13:07:25.972434 22460 tablet_bootstrap.cc:492] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:25.990602 22460 tablet_bootstrap.cc:492] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:25.991717 22460 tablet_bootstrap.cc:492] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:25.992506 22460 ts_tablet_manager.cc:1403] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:07:25.995558 22460 raft_consensus.cc:359] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:25.996357 22460 raft_consensus.cc:740] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:25.997148 22460 consensus_queue.cc:260] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:25.999930 22460 ts_tablet_manager.cc:1434] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:07:26.001209 22460 tablet_bootstrap.cc:492] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:26.045356 22460 tablet_bootstrap.cc:492] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:26.046351 22460 tablet_bootstrap.cc:492] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:26.047062 22460 ts_tablet_manager.cc:1403] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.018s
I20260709 13:07:26.049937 22460 raft_consensus.cc:359] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:26.050624 22460 raft_consensus.cc:740] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.051359 22460 consensus_queue.cc:260] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:26.053001 22460 ts_tablet_manager.cc:1434] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:07:26.053823 22460 tablet_bootstrap.cc:492] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:26.076769 22460 tablet_bootstrap.cc:492] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:26.077867 22460 tablet_bootstrap.cc:492] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:26.078596 22460 ts_tablet_manager.cc:1403] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 13:07:26.086443 22460 raft_consensus.cc:359] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:26.087203 22460 raft_consensus.cc:740] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.088068 22460 consensus_queue.cc:260] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:26.090412 22460 ts_tablet_manager.cc:1434] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:07:26.091312 22460 tablet_bootstrap.cc:492] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
W20260709 13:07:26.104210 21630 consensus_peers.cc:597] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:26.113631 22460 tablet_bootstrap.cc:492] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:26.114867 22460 tablet_bootstrap.cc:492] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:26.115600 22460 ts_tablet_manager.cc:1403] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.024s	user 0.022s	sys 0.001s
I20260709 13:07:26.118600 22460 raft_consensus.cc:359] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:26.119313 22460 raft_consensus.cc:740] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.119951 22557 raft_consensus.cc:3060] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:26.120158 22460 consensus_queue.cc:260] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:26.122649 22460 ts_tablet_manager.cc:1434] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:07:26.123538 22460 tablet_bootstrap.cc:492] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
W20260709 13:07:26.231403 21778 consensus_peers.cc:597] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:26.309032 22460 tablet_bootstrap.cc:492] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:26.310375 22460 tablet_bootstrap.cc:492] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:26.311110 22460 ts_tablet_manager.cc:1403] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.188s	user 0.065s	sys 0.106s
I20260709 13:07:26.313802 22460 raft_consensus.cc:359] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:26.314495 22460 raft_consensus.cc:740] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.315299 22460 consensus_queue.cc:260] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:26.323895 22558 raft_consensus.cc:3060] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:26.331326 22460 ts_tablet_manager.cc:1434] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:07:26.344682 22460 tablet_bootstrap.cc:492] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:26.397100 22460 tablet_bootstrap.cc:492] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:26.398093 22460 tablet_bootstrap.cc:492] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:26.398734 22460 ts_tablet_manager.cc:1403] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.012s
I20260709 13:07:26.401223 22460 raft_consensus.cc:359] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:26.405006 22460 raft_consensus.cc:740] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.405877 22460 consensus_queue.cc:260] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:26.408519 22460 ts_tablet_manager.cc:1434] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:07:26.409456 22460 tablet_bootstrap.cc:492] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:26.426476 22460 tablet_bootstrap.cc:492] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:26.427392 22460 tablet_bootstrap.cc:492] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:26.428135 22460 ts_tablet_manager.cc:1403] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:07:26.431516 22460 raft_consensus.cc:359] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:26.432228 22460 raft_consensus.cc:740] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.432945 22460 consensus_queue.cc:260] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:26.435884 22460 ts_tablet_manager.cc:1434] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:26.436466 22564 raft_consensus.cc:3060] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:26.436965 22460 tablet_bootstrap.cc:492] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:26.466892 22460 tablet_bootstrap.cc:492] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:26.468207 22460 tablet_bootstrap.cc:492] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:26.469000 22460 ts_tablet_manager.cc:1403] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.010s
I20260709 13:07:26.472215 22460 raft_consensus.cc:359] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:26.472913 22460 raft_consensus.cc:740] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.473708 22460 consensus_queue.cc:260] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:26.476635 22460 ts_tablet_manager.cc:1434] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.004s
I20260709 13:07:26.477696 22460 tablet_bootstrap.cc:492] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:26.509155 22460 tablet_bootstrap.cc:492] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:26.510095 22460 tablet_bootstrap.cc:492] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:26.510727 22460 ts_tablet_manager.cc:1403] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.007s
I20260709 13:07:26.512883 22460 raft_consensus.cc:359] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:26.513612 22460 raft_consensus.cc:740] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.514401 22460 consensus_queue.cc:260] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:26.516731 22460 ts_tablet_manager.cc:1434] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:07:26.518883 22460 tablet_bootstrap.cc:492] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:26.536659 22460 tablet_bootstrap.cc:492] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:26.537429 22460 tablet_bootstrap.cc:492] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:26.538002 22460 ts_tablet_manager.cc:1403] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 13:07:26.540230 22460 raft_consensus.cc:359] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:26.540871 22460 raft_consensus.cc:740] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.541481 22460 consensus_queue.cc:260] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:26.543666 22460 ts_tablet_manager.cc:1434] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:07:26.546886 22460 tablet_bootstrap.cc:492] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap starting.
I20260709 13:07:26.639355 22460 tablet_bootstrap.cc:492] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:26.641535 22460 tablet_bootstrap.cc:492] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c: Bootstrap complete.
I20260709 13:07:26.642717 22460 ts_tablet_manager.cc:1403] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent bootstrapping tablet: real 0.096s	user 0.030s	sys 0.047s
I20260709 13:07:26.645140 22460 raft_consensus.cc:359] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:26.645835 22460 raft_consensus.cc:740] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Initialized, Role: FOLLOWER
I20260709 13:07:26.646621 22460 consensus_queue.cc:260] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:26.647994 22460 ts_tablet_manager.cc:1434] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:07:26.690383 22558 raft_consensus.cc:3060] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:34.595336 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:34.653697 21733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "313ed31222454fe19290a9105f226521"
dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
mode: GRACEFUL
new_leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:52866
I20260709 13:07:34.654819 21733 raft_consensus.cc:606] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Received request to transfer leadership to TS 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:34.657984 21733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d07198040872480db2c3b210d75e8c26"
dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
mode: GRACEFUL
new_leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:52866
I20260709 13:07:34.658509 21733 raft_consensus.cc:606] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Received request to transfer leadership to TS 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:34.661176 21733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d14ed1ed549d47eb828017479cccdd42"
dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
mode: GRACEFUL
new_leader_uuid: "bed294de06e24ca4aba572ec722d2567"
 from {username='slave'} at 127.0.0.1:52866
I20260709 13:07:34.661698 21733 raft_consensus.cc:606] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Received request to transfer leadership to TS bed294de06e24ca4aba572ec722d2567
I20260709 13:07:34.670908 22668 raft_consensus.cc:993] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5: : Instructing follower 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:34.671576 22667 raft_consensus.cc:1081] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Signalling peer 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:34.674716 22557 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "313ed31222454fe19290a9105f226521"
dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:43464
I20260709 13:07:34.675447 22557 raft_consensus.cc:493] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:34.675923 22557 raft_consensus.cc:3060] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:34.679299 21807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e0beed3c60054461a60991c48b418bfc"
dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
mode: GRACEFUL
new_leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:50432
I20260709 13:07:34.679960 21807 raft_consensus.cc:606] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 LEADER]: Received request to transfer leadership to TS 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:34.683137 21807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2e7302faa874a2f874d979ae54331f3"
dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
mode: GRACEFUL
new_leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:50432
I20260709 13:07:34.683743 21807 raft_consensus.cc:606] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 LEADER]: Received request to transfer leadership to TS 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:34.684988 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:34.686764 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:34.686405 22557 raft_consensus.cc:515] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:34.688743 22557 leader_election.cc:290] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:34.689414 21733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313ed31222454fe19290a9105f226521" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:34.690343 21733 raft_consensus.cc:3055] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:34.690455 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "313ed31222454fe19290a9105f226521" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:34.690678 21733 raft_consensus.cc:740] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Running, Role: LEADER
I20260709 13:07:34.691004 21807 raft_consensus.cc:3060] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:34.691726 21733 consensus_queue.cc:260] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:34.693086 21733 raft_consensus.cc:3060] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:34.698472 21807 raft_consensus.cc:2468] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:34.700161 22455 leader_election.cc:304] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:34.700567 21733 raft_consensus.cc:2468] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:34.702807 22686 raft_consensus.cc:2804] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:34.704223 22686 raft_consensus.cc:697] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:34.705363 22686 consensus_queue.cc:237] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:34.725548 21487 catalog_manager.cc:5697] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 1 to 2, leader changed from 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195) to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 2 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:34.810829 22685 raft_consensus.cc:993] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5: : Instructing follower bed294de06e24ca4aba572ec722d2567 to start an election
I20260709 13:07:34.811342 22685 raft_consensus.cc:1081] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Signalling peer bed294de06e24ca4aba572ec722d2567 to start an election
I20260709 13:07:34.813010 21660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d14ed1ed549d47eb828017479cccdd42"
dest_uuid: "bed294de06e24ca4aba572ec722d2567"
 from {username='slave'} at 127.0.0.1:40536
I20260709 13:07:34.813556 21660 raft_consensus.cc:493] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:34.813946 21660 raft_consensus.cc:3060] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:34.820382 21660 raft_consensus.cc:515] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:34.822984 21660 leader_election.cc:290] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:34.824137 21736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14ed1ed549d47eb828017479cccdd42" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:34.824776 21736 raft_consensus.cc:3055] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:34.825040 21736 raft_consensus.cc:740] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Running, Role: LEADER
I20260709 13:07:34.826004 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d14ed1ed549d47eb828017479cccdd42" candidate_uuid: "bed294de06e24ca4aba572ec722d2567" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:34.825906 21736 consensus_queue.cc:260] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:34.826582 21810 raft_consensus.cc:3060] T d14ed1ed549d47eb828017479cccdd42 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:34.827414 21736 raft_consensus.cc:3060] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:34.833536 21736 raft_consensus.cc:2468] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 2.
I20260709 13:07:34.833858 21810 raft_consensus.cc:2468] T d14ed1ed549d47eb828017479cccdd42 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bed294de06e24ca4aba572ec722d2567 in term 2.
I20260709 13:07:34.834702 21629 leader_election.cc:304] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:34.836241 22632 raft_consensus.cc:2804] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:34.837003 22632 raft_consensus.cc:697] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [term 2 LEADER]: Becoming Leader. State: Replica: bed294de06e24ca4aba572ec722d2567, State: Running, Role: LEADER
I20260709 13:07:34.837909 22632 consensus_queue.cc:237] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } }
I20260709 13:07:34.851450 21487 catalog_manager.cc:5697] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 reported cstate change: term changed from 1 to 2, leader changed from 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195) to bed294de06e24ca4aba572ec722d2567 (127.11.44.194). New cstate: current_term: 2 leader_uuid: "bed294de06e24ca4aba572ec722d2567" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:34.915041 22667 raft_consensus.cc:993] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5: : Instructing follower 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:34.915575 22667 raft_consensus.cc:1081] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Signalling peer 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:34.917421 22564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d07198040872480db2c3b210d75e8c26"
dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:43464
I20260709 13:07:34.917970 22564 raft_consensus.cc:493] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:34.918318 22564 raft_consensus.cc:3060] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:34.925616 22564 raft_consensus.cc:515] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:34.927537 22564 leader_election.cc:290] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Requested vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:34.928483 21659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07198040872480db2c3b210d75e8c26" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:34.928812 21736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d07198040872480db2c3b210d75e8c26" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:34.929132 21659 raft_consensus.cc:3060] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:34.929493 21736 raft_consensus.cc:3055] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:34.929942 21736 raft_consensus.cc:740] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3e8f84032ed948908dc7fcffcfe2d6e5, State: Running, Role: LEADER
I20260709 13:07:34.935887 21736 consensus_queue.cc:260] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:34.936869 21659 raft_consensus.cc:2468] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:34.938050 21736 raft_consensus.cc:3060] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:34.938364 22455 leader_election.cc:304] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:34.939225 22686 raft_consensus.cc:2804] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:34.939745 22686 raft_consensus.cc:697] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:34.940891 22686 consensus_queue.cc:237] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:34.950851 21736 raft_consensus.cc:2468] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:34.954886 21487 catalog_manager.cc:5697] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 1 to 2, leader changed from 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195) to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 2 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:34.989236 22680 raft_consensus.cc:993] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba: : Instructing follower 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:34.989863 22679 raft_consensus.cc:1081] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 LEADER]: Signalling peer 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:34.991411 22564 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e0beed3c60054461a60991c48b418bfc"
dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:43472
I20260709 13:07:34.991961 22564 raft_consensus.cc:493] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:34.992292 22564 raft_consensus.cc:3060] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:34.998499 22564 raft_consensus.cc:515] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:35.001094 22564 leader_election.cc:290] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 4 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:35.001371 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0beed3c60054461a60991c48b418bfc" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:35.001698 21659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0beed3c60054461a60991c48b418bfc" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:35.002048 21810 raft_consensus.cc:3055] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:35.002372 21659 raft_consensus.cc:3060] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:35.002405 21810 raft_consensus.cc:740] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:35.003296 21810 consensus_queue.cc:260] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:35.004487 21810 raft_consensus.cc:3060] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:35.011631 21659 raft_consensus.cc:2468] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 4.
I20260709 13:07:35.012158 21810 raft_consensus.cc:2468] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 4.
I20260709 13:07:35.013551 22455 leader_election.cc:304] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:35.014376 22686 raft_consensus.cc:2804] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:35.014906 22686 raft_consensus.cc:697] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 4 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:35.016283 22686 consensus_queue.cc:237] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:35.030406 21487 catalog_manager.cc:5697] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 3 to 4, leader changed from b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196) to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 4 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.134877 21736 raft_consensus.cc:1275] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:35.136204 22686 consensus_queue.cc:1048] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:35.154321 21807 raft_consensus.cc:1275] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:35.156615 22686 consensus_queue.cc:1048] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:35.254040 22680 raft_consensus.cc:993] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba: : Instructing follower 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:35.254791 22675 raft_consensus.cc:1081] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 LEADER]: Signalling peer 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:35.256541 22558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2e7302faa874a2f874d979ae54331f3"
dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:43472
I20260709 13:07:35.257067 22558 raft_consensus.cc:493] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:35.257423 22558 raft_consensus.cc:3060] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:35.263273 22558 raft_consensus.cc:515] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:35.265122 22558 leader_election.cc:290] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 4 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:35.266114 21659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e7302faa874a2f874d979ae54331f3" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:35.266568 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2e7302faa874a2f874d979ae54331f3" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:35.266774 21659 raft_consensus.cc:3060] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:35.267280 21807 raft_consensus.cc:3055] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:35.267663 21807 raft_consensus.cc:740] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:35.268352 21807 consensus_queue.cc:260] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:35.269361 21807 raft_consensus.cc:3060] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:35.273746 21659 raft_consensus.cc:2468] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 4.
I20260709 13:07:35.274852 22455 leader_election.cc:304] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:35.275640 22686 raft_consensus.cc:2804] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:35.275781 21807 raft_consensus.cc:2468] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 4.
I20260709 13:07:35.276166 22686 raft_consensus.cc:697] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 4 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:35.277062 22686 consensus_queue.cc:237] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:35.286962 21485 catalog_manager.cc:5697] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 3 to 4, leader changed from b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196) to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 4 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.371781 21807 raft_consensus.cc:1275] T d14ed1ed549d47eb828017479cccdd42 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Refusing update from remote peer bed294de06e24ca4aba572ec722d2567: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:35.373235 22632 consensus_queue.cc:1048] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:35.389878 21736 raft_consensus.cc:1275] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Refusing update from remote peer bed294de06e24ca4aba572ec722d2567: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:35.397746 22632 consensus_queue.cc:1048] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:35.438676 21659 raft_consensus.cc:1275] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:35.440268 22686 consensus_queue.cc:1048] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:35.452705 21736 raft_consensus.cc:1275] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:35.454058 22686 consensus_queue.cc:1048] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:35.615283 21807 raft_consensus.cc:1275] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 4 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:35.616647 22686 consensus_queue.cc:1048] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:35.626612 21659 raft_consensus.cc:1275] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 4 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:07:35.628185 22687 consensus_queue.cc:1048] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:07:35.677984 21660 raft_consensus.cc:1275] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 4 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:35.679685 22687 consensus_queue.cc:1048] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:35.688114 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:35.691047 21807 raft_consensus.cc:1275] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 4 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:35.692844 22710 consensus_queue.cc:1048] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:35.750941 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:35.792016 21807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "317e3221976c47fa913d27f018a21910"
dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
mode: GRACEFUL
new_leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:50432
I20260709 13:07:35.792614 21807 raft_consensus.cc:606] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Received request to transfer leadership to TS 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:35.795662 21807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6742efaede2f4dfeb0c1171e090e8dc0"
dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
mode: GRACEFUL
new_leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:50432
I20260709 13:07:35.796270 21807 raft_consensus.cc:606] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Received request to transfer leadership to TS 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:35.798840 21807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f558d81ff1b4d1fbb393d8dab70debb"
dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
mode: GRACEFUL
new_leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:50432
I20260709 13:07:35.799391 21807 raft_consensus.cc:606] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Received request to transfer leadership to TS 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:35.801720 21807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc118bb477224df8a4f953e308982c45"
dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
mode: GRACEFUL
new_leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:50432
I20260709 13:07:35.802295 21807 raft_consensus.cc:606] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Received request to transfer leadership to TS 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:35.804746 21807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7609574109349aeb89daee4d7aec6f7"
dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
mode: GRACEFUL
new_leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:50432
I20260709 13:07:35.805342 21807 raft_consensus.cc:606] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Received request to transfer leadership to TS 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:35.806483 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:35.809492 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:35.814088 22680 raft_consensus.cc:993] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba: : Instructing follower 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:35.814646 22675 raft_consensus.cc:1081] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Signalling peer 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:35.816226 22558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f558d81ff1b4d1fbb393d8dab70debb"
dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:43472
I20260709 13:07:35.816699 22558 raft_consensus.cc:493] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:35.817073 22558 raft_consensus.cc:3060] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:35.822599 22558 raft_consensus.cc:515] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:35.824209 22558 leader_election.cc:290] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:35.824998 21736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f558d81ff1b4d1fbb393d8dab70debb" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:35.825158 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f558d81ff1b4d1fbb393d8dab70debb" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:35.825657 21736 raft_consensus.cc:3060] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:35.825920 21807 raft_consensus.cc:3055] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:35.826295 21807 raft_consensus.cc:740] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:35.827128 21807 consensus_queue.cc:260] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:35.828235 21807 raft_consensus.cc:3060] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:35.830884 21736 raft_consensus.cc:2468] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:35.832296 22454 leader_election.cc:304] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: 
I20260709 13:07:35.833325 22687 raft_consensus.cc:2804] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:35.833905 22687 raft_consensus.cc:697] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:35.834930 22687 consensus_queue.cc:237] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:35.842391 21807 raft_consensus.cc:2468] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:35.852419 21485 catalog_manager.cc:5697] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 1 to 2, leader changed from b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196) to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 2 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:35.912447 22680 raft_consensus.cc:993] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba: : Instructing follower 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:35.912967 22675 raft_consensus.cc:1081] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Signalling peer 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:35.914640 22558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7609574109349aeb89daee4d7aec6f7"
dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:43472
I20260709 13:07:35.915412 22558 raft_consensus.cc:493] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:35.915709 22558 raft_consensus.cc:3060] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:35.921166 22558 raft_consensus.cc:515] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:35.922737 22558 leader_election.cc:290] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013)
I20260709 13:07:35.923619 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7609574109349aeb89daee4d7aec6f7" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:35.923800 21736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7609574109349aeb89daee4d7aec6f7" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:35.924294 21807 raft_consensus.cc:3055] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:35.924352 21736 raft_consensus.cc:3060] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:35.924664 21807 raft_consensus.cc:740] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:35.925500 21807 consensus_queue.cc:260] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:35.926669 21807 raft_consensus.cc:3060] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:35.930914 21736 raft_consensus.cc:2468] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:35.932101 22454 leader_election.cc:304] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: 
I20260709 13:07:35.932473 21807 raft_consensus.cc:2468] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:35.932906 22687 raft_consensus.cc:2804] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:35.933445 22687 raft_consensus.cc:697] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:35.934425 22687 consensus_queue.cc:237] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } }
I20260709 13:07:35.945958 21485 catalog_manager.cc:5697] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 1 to 2, leader changed from b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196) to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 2 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:36.037642 22679 raft_consensus.cc:993] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba: : Instructing follower 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:36.038316 22679 raft_consensus.cc:1081] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Signalling peer 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:36.040307 22558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6742efaede2f4dfeb0c1171e090e8dc0"
dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:43472
I20260709 13:07:36.040818 22558 raft_consensus.cc:493] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:36.041138 22558 raft_consensus.cc:3060] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.048651 22558 raft_consensus.cc:515] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:36.050784 22558 leader_election.cc:290] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:36.051890 21659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6742efaede2f4dfeb0c1171e090e8dc0" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:36.052021 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6742efaede2f4dfeb0c1171e090e8dc0" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:36.052726 21659 raft_consensus.cc:3060] T 6742efaede2f4dfeb0c1171e090e8dc0 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.052913 21810 raft_consensus.cc:3055] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:36.053320 21810 raft_consensus.cc:740] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:36.054291 21810 consensus_queue.cc:260] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:36.055608 21810 raft_consensus.cc:3060] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.060462 21659 raft_consensus.cc:2468] T 6742efaede2f4dfeb0c1171e090e8dc0 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:36.062261 22455 leader_election.cc:304] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:36.063529 22687 raft_consensus.cc:2804] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:36.064045 22687 raft_consensus.cc:697] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:36.065358 21810 raft_consensus.cc:2468] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:36.065017 22687 consensus_queue.cc:237] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:36.067371 22675 raft_consensus.cc:993] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba: : Instructing follower 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:36.067862 22680 raft_consensus.cc:1081] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Signalling peer 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:36.069746 22558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "317e3221976c47fa913d27f018a21910"
dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:43472
I20260709 13:07:36.070434 22558 raft_consensus.cc:493] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:36.070863 22558 raft_consensus.cc:3060] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.077677 21485 catalog_manager.cc:5697] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 1 to 2, leader changed from b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196) to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 2 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:36.078451 22558 raft_consensus.cc:515] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:36.080910 22558 leader_election.cc:290] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:36.081517 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317e3221976c47fa913d27f018a21910" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:36.082213 21810 raft_consensus.cc:3055] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:36.082509 21810 raft_consensus.cc:740] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:36.083410 21733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "317e3221976c47fa913d27f018a21910" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:36.083302 21810 consensus_queue.cc:260] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:36.083987 21733 raft_consensus.cc:3060] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.084568 21810 raft_consensus.cc:3060] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.090981 21810 raft_consensus.cc:2468] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:36.091921 22455 leader_election.cc:304] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:36.092247 21733 raft_consensus.cc:2468] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:36.093376 22710 raft_consensus.cc:2804] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:36.094154 22710 raft_consensus.cc:697] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:36.095134 22710 consensus_queue.cc:237] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:36.112226 21485 catalog_manager.cc:5697] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 1 to 2, leader changed from b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196) to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 2 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:36.167886 22675 raft_consensus.cc:993] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba: : Instructing follower 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:36.168468 22679 raft_consensus.cc:1081] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Signalling peer 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:36.170027 22559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc118bb477224df8a4f953e308982c45"
dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:43472
I20260709 13:07:36.170559 22559 raft_consensus.cc:493] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:36.170970 22559 raft_consensus.cc:3060] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.178915 22559 raft_consensus.cc:515] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:36.181663 22559 leader_election.cc:290] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Requested vote from peers bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:36.182657 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc118bb477224df8a4f953e308982c45" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:36.183276 21810 raft_consensus.cc:3055] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:36.183717 21810 raft_consensus.cc:740] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:36.184551 21810 consensus_queue.cc:260] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:36.185703 21810 raft_consensus.cc:3060] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.185824 21659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc118bb477224df8a4f953e308982c45" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:36.186460 21659 raft_consensus.cc:3060] T bc118bb477224df8a4f953e308982c45 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.191071 21810 raft_consensus.cc:2468] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:36.192425 22455 leader_election.cc:304] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 
I20260709 13:07:36.192546 21659 raft_consensus.cc:2468] T bc118bb477224df8a4f953e308982c45 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:36.193451 22687 raft_consensus.cc:2804] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:36.194113 22687 raft_consensus.cc:697] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:36.195134 22687 consensus_queue.cc:237] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:36.205674 21485 catalog_manager.cc:5697] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 1 to 2, leader changed from b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196) to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 2 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:36.336716 21810 raft_consensus.cc:1275] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:36.339650 22687 consensus_queue.cc:1048] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:36.351291 21736 raft_consensus.cc:1275] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:36.352599 22686 consensus_queue.cc:1048] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:36.479580 21810 raft_consensus.cc:1275] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:36.481099 22687 consensus_queue.cc:1048] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:36.491951 21733 raft_consensus.cc:1275] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:36.494357 21810 raft_consensus.cc:1275] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:36.495677 22731 consensus_queue.cc:1048] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:36.501796 22687 consensus_queue.cc:1048] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:36.532226 21733 raft_consensus.cc:1275] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:36.537216 22731 consensus_queue.cc:1048] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:36.590585 21807 raft_consensus.cc:1275] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:36.591902 22731 consensus_queue.cc:1048] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:36.607838 21659 raft_consensus.cc:1275] T bc118bb477224df8a4f953e308982c45 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:36.609884 22687 consensus_queue.cc:1048] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:36.630991 21659 raft_consensus.cc:1275] T 6742efaede2f4dfeb0c1171e090e8dc0 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:36.632647 22687 consensus_queue.cc:1048] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:36.636224 21807 raft_consensus.cc:1275] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:36.637703 22687 consensus_queue.cc:1048] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:36.810679 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:36.852391 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:36.893126 21807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21a0bcc4561a4503aebdb0aab6b13b37"
dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
mode: GRACEFUL
new_leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:50432
I20260709 13:07:36.893740 21807 raft_consensus.cc:606] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 LEADER]: Received request to transfer leadership to TS 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:36.896382 21807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36c6b2be38fb47e7a92c9b1b7f9678d7"
dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
mode: GRACEFUL
new_leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:50432
I20260709 13:07:36.897032 21807 raft_consensus.cc:606] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Received request to transfer leadership to TS 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:36.899988 21807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "841639e17c5d4724afe9494276ba00a3"
dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
mode: GRACEFUL
new_leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:50432
I20260709 13:07:36.900483 21807 raft_consensus.cc:606] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Received request to transfer leadership to TS 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:36.903764 21807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7cf644bea63405f9d1a353862a5a110"
dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
mode: GRACEFUL
new_leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:50432
I20260709 13:07:36.904347 21807 raft_consensus.cc:606] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Received request to transfer leadership to TS 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:36.906798 21807 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e327a74ed0c544d28806d688941cd3f6"
dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
mode: GRACEFUL
new_leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:50432
I20260709 13:07:36.907410 21807 raft_consensus.cc:606] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 LEADER]: Received request to transfer leadership to TS 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:36.908937 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:36.910595 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:36.975989 22680 raft_consensus.cc:993] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba: : Instructing follower 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:36.976660 22679 raft_consensus.cc:1081] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Signalling peer 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:36.978335 22558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "841639e17c5d4724afe9494276ba00a3"
dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:43472
I20260709 13:07:36.978940 22558 raft_consensus.cc:493] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:36.979349 22558 raft_consensus.cc:3060] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.986045 22558 raft_consensus.cc:515] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:36.987720 22558 leader_election.cc:290] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:36.988345 21736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841639e17c5d4724afe9494276ba00a3" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:36.988999 21736 raft_consensus.cc:3060] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.989326 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "841639e17c5d4724afe9494276ba00a3" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:36.989933 21810 raft_consensus.cc:3055] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:36.990231 21810 raft_consensus.cc:740] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:36.990980 21810 consensus_queue.cc:260] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:36.992183 21810 raft_consensus.cc:3060] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:36.995857 21736 raft_consensus.cc:2468] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:36.997023 22454 leader_election.cc:304] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: 
I20260709 13:07:36.997891 22731 raft_consensus.cc:2804] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:36.998353 22731 raft_consensus.cc:697] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:36.999006 21810 raft_consensus.cc:2468] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:36.999225 22731 consensus_queue.cc:237] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:37.009370 21488 catalog_manager.cc:5697] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 1 to 2, leader changed from b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196) to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 2 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:37.079185 22741 raft_consensus.cc:993] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba: : Instructing follower 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:37.079873 22680 raft_consensus.cc:1081] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Signalling peer 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:37.081400 22558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7cf644bea63405f9d1a353862a5a110"
dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:43472
I20260709 13:07:37.082031 22558 raft_consensus.cc:493] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:37.082445 22558 raft_consensus.cc:3060] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:37.088827 22741 raft_consensus.cc:993] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba: : Instructing follower 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:37.104066 22741 raft_consensus.cc:1081] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Signalling peer 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:37.105731 22559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36c6b2be38fb47e7a92c9b1b7f9678d7"
dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:43472
I20260709 13:07:37.106341 22559 raft_consensus.cc:493] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:37.106709 22559 raft_consensus.cc:3060] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:37.110878 22558 raft_consensus.cc:515] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:37.112887 22558 leader_election.cc:290] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:37.114521 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cf644bea63405f9d1a353862a5a110" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:37.114780 21659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7cf644bea63405f9d1a353862a5a110" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:37.115204 21810 raft_consensus.cc:3055] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:37.115365 21659 raft_consensus.cc:3060] T a7cf644bea63405f9d1a353862a5a110 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:37.115545 21810 raft_consensus.cc:740] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:37.116385 21810 consensus_queue.cc:260] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:37.117668 21810 raft_consensus.cc:3060] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:37.114494 22559 raft_consensus.cc:515] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:37.122769 22559 leader_election.cc:290] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:37.123337 21659 raft_consensus.cc:2468] T a7cf644bea63405f9d1a353862a5a110 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:37.124390 21733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c6b2be38fb47e7a92c9b1b7f9678d7" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:37.124537 21810 raft_consensus.cc:2468] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:37.124993 21733 raft_consensus.cc:3060] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:37.125694 22455 leader_election.cc:304] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:37.126029 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36c6b2be38fb47e7a92c9b1b7f9678d7" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:37.126556 21810 raft_consensus.cc:3055] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:37.126648 22731 raft_consensus.cc:2804] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:37.126940 21810 raft_consensus.cc:740] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:37.127588 22731 raft_consensus.cc:697] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:37.128221 21810 consensus_queue.cc:260] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:37.128535 22731 consensus_queue.cc:237] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:37.130505 21810 raft_consensus.cc:3060] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:37.132242 21733 raft_consensus.cc:2468] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:37.133764 22454 leader_election.cc:304] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: 
I20260709 13:07:37.134963 22731 raft_consensus.cc:2804] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:37.135504 22731 raft_consensus.cc:697] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:37.136374 22731 consensus_queue.cc:237] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:37.140252 21810 raft_consensus.cc:2468] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:37.141651 21488 catalog_manager.cc:5697] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 1 to 2, leader changed from b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196) to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 2 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:37.148046 22741 raft_consensus.cc:993] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba: : Instructing follower 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:37.148540 22741 raft_consensus.cc:1081] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 LEADER]: Signalling peer 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:37.151273 22559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21a0bcc4561a4503aebdb0aab6b13b37"
dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:43472
I20260709 13:07:37.151793 22559 raft_consensus.cc:493] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:37.152143 22559 raft_consensus.cc:3060] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:37.158646 22559 raft_consensus.cc:515] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:37.160343 22559 leader_election.cc:290] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 3 election: Requested vote from peers b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
I20260709 13:07:37.161163 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a0bcc4561a4503aebdb0aab6b13b37" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:37.161314 21659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21a0bcc4561a4503aebdb0aab6b13b37" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bed294de06e24ca4aba572ec722d2567"
I20260709 13:07:37.161957 21810 raft_consensus.cc:3055] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:37.162002 21659 raft_consensus.cc:3060] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:37.162266 21810 raft_consensus.cc:740] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:37.163038 21810 consensus_queue.cc:260] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:37.163931 21810 raft_consensus.cc:3060] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:37.169020 21659 raft_consensus.cc:2468] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 3.
I20260709 13:07:37.170639 21810 raft_consensus.cc:2468] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 3.
I20260709 13:07:37.170648 22455 leader_election.cc:304] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567; no voters: 
I20260709 13:07:37.172117 22731 raft_consensus.cc:2804] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:37.172645 22731 raft_consensus.cc:697] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [term 3 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:37.172912 21488 catalog_manager.cc:5697] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 1 to 2, leader changed from b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196) to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 2 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:37.173410 22731 consensus_queue.cc:237] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:37.191874 21488 catalog_manager.cc:5697] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 2 to 3, leader changed from b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196) to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 3 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:37.386104 21733 raft_consensus.cc:1275] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:37.387302 22710 consensus_queue.cc:1048] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:37.396317 22680 raft_consensus.cc:993] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba: : Instructing follower 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:37.396807 22680 raft_consensus.cc:1081] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 LEADER]: Signalling peer 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:37.405643 22558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e327a74ed0c544d28806d688941cd3f6"
dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:43472
I20260709 13:07:37.406204 22558 raft_consensus.cc:493] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:37.406597 22558 raft_consensus.cc:3060] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:37.405745 21810 raft_consensus.cc:1275] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:37.409307 22710 consensus_queue.cc:1048] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:37.413645 22558 raft_consensus.cc:515] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:37.419267 22558 leader_election.cc:290] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 3 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:37.422416 21807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e327a74ed0c544d28806d688941cd3f6" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:37.422983 21807 raft_consensus.cc:3055] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:37.423264 21807 raft_consensus.cc:740] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:37.423560 21733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e327a74ed0c544d28806d688941cd3f6" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:37.423998 21807 consensus_queue.cc:260] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:37.424178 21733 raft_consensus.cc:3060] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:37.425153 21807 raft_consensus.cc:3060] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:37.432132 21733 raft_consensus.cc:2468] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 3.
I20260709 13:07:37.432132 21807 raft_consensus.cc:2468] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 3.
I20260709 13:07:37.433395 22454 leader_election.cc:304] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: 
I20260709 13:07:37.434791 22710 raft_consensus.cc:2804] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:37.435391 22710 raft_consensus.cc:697] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [term 3 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:37.436309 22710 consensus_queue.cc:237] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:37.452136 21485 catalog_manager.cc:5697] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 2 to 3, leader changed from b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196) to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 3 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:37.553718 21657 raft_consensus.cc:1275] T a7cf644bea63405f9d1a353862a5a110 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:37.555092 22686 consensus_queue.cc:1048] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:37.558643 21733 raft_consensus.cc:1275] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:37.563849 22710 consensus_queue.cc:1048] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:37.571550 21807 raft_consensus.cc:1275] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:37.578118 22687 consensus_queue.cc:1048] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:37.587821 21807 raft_consensus.cc:1275] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:37.589368 22687 consensus_queue.cc:1048] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:37.593825 21657 raft_consensus.cc:1275] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [term 3 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:37.595520 22686 consensus_queue.cc:1048] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:37.627401 21810 raft_consensus.cc:1275] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:37.629469 22687 consensus_queue.cc:1048] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:37.910418 21810 raft_consensus.cc:1275] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:37.911528 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:37.911725 22710 consensus_queue.cc:1048] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:37.925171 21736 raft_consensus.cc:1275] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 3 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:37.927634 22751 consensus_queue.cc:1048] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:37.984864 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:38.026194 21810 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "008742eefeb947f5a1f7decfb821a03d"
dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
mode: GRACEFUL
new_leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:50432
I20260709 13:07:38.026803 21810 raft_consensus.cc:606] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Received request to transfer leadership to TS 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:38.028174 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:07:38.029492 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:38.332424 22741 raft_consensus.cc:993] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba: : Instructing follower 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:38.333308 22765 raft_consensus.cc:1081] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Signalling peer 3f1fa49d04344067941ffd03d9e7d48c to start an election
I20260709 13:07:38.334913 22559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "008742eefeb947f5a1f7decfb821a03d"
dest_uuid: "3f1fa49d04344067941ffd03d9e7d48c"
 from {username='slave'} at 127.0.0.1:43472
I20260709 13:07:38.335417 22559 raft_consensus.cc:493] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:38.335807 22559 raft_consensus.cc:3060] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.341773 22559 raft_consensus.cc:515] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:38.343335 22559 leader_election.cc:290] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Requested vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196:41173)
I20260709 13:07:38.344063 21733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008742eefeb947f5a1f7decfb821a03d" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5"
I20260709 13:07:38.344547 21810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "008742eefeb947f5a1f7decfb821a03d" candidate_uuid: "3f1fa49d04344067941ffd03d9e7d48c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba"
I20260709 13:07:38.344671 21733 raft_consensus.cc:3060] T 008742eefeb947f5a1f7decfb821a03d P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.345106 21810 raft_consensus.cc:3055] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:38.346117 21810 raft_consensus.cc:740] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b8c58d9f32b84e5bb79e2751ac41cdba, State: Running, Role: LEADER
I20260709 13:07:38.346992 21810 consensus_queue.cc:260] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:38.348285 21810 raft_consensus.cc:3060] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:38.351240 21733 raft_consensus.cc:2468] T 008742eefeb947f5a1f7decfb821a03d P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:38.352368 22454 leader_election.cc:304] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c; no voters: 
I20260709 13:07:38.353206 22687 raft_consensus.cc:2804] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:38.353698 21810 raft_consensus.cc:2468] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3f1fa49d04344067941ffd03d9e7d48c in term 2.
I20260709 13:07:38.353734 22687 raft_consensus.cc:697] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Becoming Leader. State: Replica: 3f1fa49d04344067941ffd03d9e7d48c, State: Running, Role: LEADER
I20260709 13:07:38.354835 22687 consensus_queue.cc:237] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:38.364775 21485 catalog_manager.cc:5697] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c reported cstate change: term changed from 1 to 2, leader changed from b8c58d9f32b84e5bb79e2751ac41cdba (127.11.44.196) to 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193). New cstate: current_term: 2 leader_uuid: "3f1fa49d04344067941ffd03d9e7d48c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:38.768947 21807 raft_consensus.cc:1275] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:38.770422 22731 consensus_queue.cc:1048] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:38.786563 21733 raft_consensus.cc:1275] T 008742eefeb947f5a1f7decfb821a03d P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Refusing update from remote peer 3f1fa49d04344067941ffd03d9e7d48c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:38.793458 22687 consensus_queue.cc:1048] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:39.030560 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:39.072041 11443 tablet_server.cc:179] TabletServer@127.11.44.193:35255 shutting down...
I20260709 13:07:39.105729 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:39.107434 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.108426 11443 raft_consensus.cc:2243] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.109344 11443 raft_consensus.cc:2272] T 1ed9b20099494a8c94a51f76692a8ec0 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.112540 11443 tablet_replica.cc:333] stopping tablet replica
W20260709 13:07:39.112687 21778 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 259 similar messages]
I20260709 13:07:39.113340 11443 raft_consensus.cc:2243] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.114023 11443 raft_consensus.cc:2272] T 4d4979f7a7c14c68ad359f624f114570 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:39.115964 21778 consensus_peers.cc:597] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.116647 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.117410 11443 raft_consensus.cc:2243] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.118297 11443 raft_consensus.cc:2272] T 6742efaede2f4dfeb0c1171e090e8dc0 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.120821 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.121500 11443 raft_consensus.cc:2243] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.122004 11443 raft_consensus.cc:2272] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.124679 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.125373 11443 raft_consensus.cc:2243] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.126291 11443 raft_consensus.cc:2272] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.129508 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.130365 11443 raft_consensus.cc:2243] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.131146 11443 raft_consensus.cc:2272] T 841639e17c5d4724afe9494276ba00a3 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.133230 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.134665 11443 raft_consensus.cc:2243] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.135104 11443 raft_consensus.cc:2272] T e7c18f9e23544d00a8d1cf17afda03c5 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.138422 11443 tablet_replica.cc:333] stopping tablet replica
W20260709 13:07:39.138286 21704 consensus_peers.cc:597] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.139247 11443 raft_consensus.cc:2243] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.139701 11443 raft_consensus.cc:2272] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.142735 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.143342 11443 raft_consensus.cc:2243] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.143929 11443 raft_consensus.cc:2272] T 83c22a51936f4415b7a99dcad7540239 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.146060 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.146651 11443 raft_consensus.cc:2243] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.147035 11443 raft_consensus.cc:2272] T 613b610452794d1192d3df796bedcd8e P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.149014 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.149650 11443 raft_consensus.cc:2243] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.150360 11443 raft_consensus.cc:2272] T e7609574109349aeb89daee4d7aec6f7 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.152259 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.152796 11443 raft_consensus.cc:2243] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.153332 11443 raft_consensus.cc:2272] T 9932f1e440d442f8ab6ba25f33881d75 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.156100 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.156641 11443 raft_consensus.cc:2243] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.157384 11443 raft_consensus.cc:2272] T 7f558d81ff1b4d1fbb393d8dab70debb P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.159507 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.160064 11443 raft_consensus.cc:2243] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.160799 11443 raft_consensus.cc:2272] T f2e7302faa874a2f874d979ae54331f3 P 3f1fa49d04344067941ffd03d9e7d48c [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:39.163030 21704 consensus_peers.cc:597] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.163779 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.164683 11443 raft_consensus.cc:2243] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.165320 11443 raft_consensus.cc:2272] T 6cc8f1a9d5ce413cb159ae69ce846c06 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.167994 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.168692 11443 raft_consensus.cc:2243] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.169684 11443 raft_consensus.cc:2272] T e0beed3c60054461a60991c48b418bfc P 3f1fa49d04344067941ffd03d9e7d48c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.173033 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.178099 11443 raft_consensus.cc:2243] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:39.178300 21630 consensus_peers.cc:597] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.178709 11443 raft_consensus.cc:2272] T 69ca21ec420f4843b276f4f15b2b0f1b P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.182013 11443 tablet_replica.cc:333] stopping tablet replica
W20260709 13:07:39.182551 21630 consensus_peers.cc:597] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.182771 11443 raft_consensus.cc:2243] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.183292 11443 raft_consensus.cc:2272] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.185328 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.185905 11443 raft_consensus.cc:2243] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.186304 11443 raft_consensus.cc:2272] T 8900bbb09a964e26aaab011b218c8f11 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.188306 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.189038 11443 raft_consensus.cc:2243] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.189878 11443 raft_consensus.cc:2272] T d07198040872480db2c3b210d75e8c26 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.192251 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.192886 11443 raft_consensus.cc:2243] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.193346 11443 raft_consensus.cc:2272] T 5c7c65eed72a42d0a91f36c764de4abb P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.196638 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.197398 11443 raft_consensus.cc:2243] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.197913 11443 raft_consensus.cc:2272] T 9de835ccc085481aaf56e24e6b6a055f P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.200778 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.201547 11443 raft_consensus.cc:2243] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.202741 11443 raft_consensus.cc:2272] T 313ed31222454fe19290a9105f226521 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.205585 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.206319 11443 raft_consensus.cc:2243] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.206900 11443 raft_consensus.cc:2272] T 22735fa400464e149fa2d7263a8bd58a P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.210078 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.210978 11443 raft_consensus.cc:2243] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.211972 11443 raft_consensus.cc:2272] T bc118bb477224df8a4f953e308982c45 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.214687 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.215238 11443 raft_consensus.cc:2243] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.215627 11443 raft_consensus.cc:2272] T 583c8787161e47ccb08cd01f6d26d5a4 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.217893 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.218457 11443 raft_consensus.cc:2243] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.218941 11443 raft_consensus.cc:2272] T c86c9ae384544389aed37a67c0cdb7b7 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.221060 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.221788 11443 raft_consensus.cc:2243] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.222219 11443 raft_consensus.cc:2272] T 638d06604bc042cf8e846b13dbe634e7 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.224730 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.225320 11443 raft_consensus.cc:2243] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.226182 11443 raft_consensus.cc:2272] T e327a74ed0c544d28806d688941cd3f6 P 3f1fa49d04344067941ffd03d9e7d48c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.228739 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.229276 11443 raft_consensus.cc:2243] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.229791 11443 raft_consensus.cc:2272] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:39.230866 21704 consensus_peers.cc:597] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.232163 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.232823 11443 raft_consensus.cc:2243] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.233256 11443 raft_consensus.cc:2272] T e39d9076de054deca6b7548e13c39a3b P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.235518 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.236112 11443 raft_consensus.cc:2243] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.236549 11443 raft_consensus.cc:2272] T ba04167743094b89ba6e3596a48aba86 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.238929 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.239527 11443 raft_consensus.cc:2243] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.240026 11443 raft_consensus.cc:2272] T bd0cbb2559034cf7b35ecfe777ae620c P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.243271 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.244040 11443 raft_consensus.cc:2243] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.245049 11443 raft_consensus.cc:2272] T 317e3221976c47fa913d27f018a21910 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:39.246529 21704 consensus_peers.cc:597] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.247650 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.248276 11443 raft_consensus.cc:2243] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.248790 11443 raft_consensus.cc:2272] T 23660cfe7a7e49db942526440533cdf9 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.251498 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.252151 11443 raft_consensus.cc:2243] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.253229 11443 raft_consensus.cc:2272] T 008742eefeb947f5a1f7decfb821a03d P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.256506 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.257310 11443 raft_consensus.cc:2243] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:07:39.257438 21778 consensus_peers.cc:597] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.258168 21778 consensus_peers.cc:597] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.258422 11443 raft_consensus.cc:2272] T 21a0bcc4561a4503aebdb0aab6b13b37 P 3f1fa49d04344067941ffd03d9e7d48c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.260674 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.261368 11443 raft_consensus.cc:2243] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.261827 11443 raft_consensus.cc:2272] T 1681a1e8015648a692b9a5eacbbf9d6e P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.264513 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.265033 11443 raft_consensus.cc:2243] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.265435 11443 raft_consensus.cc:2272] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.267541 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.268079 11443 raft_consensus.cc:2243] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.268461 11443 raft_consensus.cc:2272] T a2f2d007d6e54bb3be541d9bbde02eca P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.270519 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.271042 11443 raft_consensus.cc:2243] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.271512 11443 raft_consensus.cc:2272] T 9cb99515c89d44c59276745ce3cbacd6 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.273718 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.274240 11443 raft_consensus.cc:2243] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.274986 11443 raft_consensus.cc:2272] T a7cf644bea63405f9d1a353862a5a110 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.277544 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.278173 11443 raft_consensus.cc:2243] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.278743 11443 raft_consensus.cc:2272] T 2c540859ed0b48f1b7ed38ead0137a45 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:39.280179 21630 consensus_peers.cc:597] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.281083 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.281723 11443 raft_consensus.cc:2243] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.282157 11443 raft_consensus.cc:2272] T 705488f64a3e446babbfe5b0d7bc2122 P 3f1fa49d04344067941ffd03d9e7d48c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.284255 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:39.284917 11443 raft_consensus.cc:2243] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.285494 11443 raft_consensus.cc:2272] T 832d931fb3f84415aac4b1880e99c498 P 3f1fa49d04344067941ffd03d9e7d48c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:39.324901 21778 consensus_peers.cc:597] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.326113 21630 consensus_peers.cc:597] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.331815 21704 consensus_peers.cc:597] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.332249 21630 consensus_peers.cc:597] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.345453 21704 consensus_peers.cc:597] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.358666 11443 tablet_server.cc:196] TabletServer@127.11.44.193:35255 shutdown complete.
W20260709 13:07:39.374416 21778 consensus_peers.cc:597] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.396605 21630 consensus_peers.cc:597] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.405845 21630 consensus_peers.cc:597] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.430032 21778 consensus_peers.cc:597] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.447654 21704 consensus_peers.cc:597] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.448004 21778 consensus_peers.cc:597] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.448956 21704 consensus_peers.cc:597] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.455230 21630 consensus_peers.cc:597] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.461753 11443 tablet_server.cc:179] TabletServer@127.11.44.194:0 shutting down...
W20260709 13:07:39.486577 21630 consensus_peers.cc:597] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.487003 21778 consensus_peers.cc:597] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.500394 21778 consensus_peers.cc:597] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.504258 21778 consensus_peers.cc:597] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.510043 21630 consensus_peers.cc:597] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.526190 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:39.527069 11443 tablet_replica.cc:333] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.528030 11443 raft_consensus.cc:2243] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.529090 11443 raft_consensus.cc:2272] T ba04167743094b89ba6e3596a48aba86 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.532123 11443 tablet_replica.cc:333] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.532896 11443 raft_consensus.cc:2243] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.533370 11443 raft_consensus.cc:2272] T 23660cfe7a7e49db942526440533cdf9 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:39.535567 21704 consensus_peers.cc:597] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.536957 11443 tablet_replica.cc:333] T b5745aab7e6c4a409a0ac98725e4e4c9 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.537710 11443 raft_consensus.cc:2243] T b5745aab7e6c4a409a0ac98725e4e4c9 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.538296 11443 raft_consensus.cc:2272] T b5745aab7e6c4a409a0ac98725e4e4c9 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.540452 11443 tablet_replica.cc:333] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.541097 11443 raft_consensus.cc:2243] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.541644 11443 raft_consensus.cc:2272] T 21a0bcc4561a4503aebdb0aab6b13b37 P bed294de06e24ca4aba572ec722d2567 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.543661 11443 tablet_replica.cc:333] T 881467b2dd884d22b15e9ac3906b55cc P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.544466 11443 raft_consensus.cc:2243] T 881467b2dd884d22b15e9ac3906b55cc P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.544925 11443 raft_consensus.cc:2272] T 881467b2dd884d22b15e9ac3906b55cc P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.547077 11443 tablet_replica.cc:333] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.547659 11443 raft_consensus.cc:2243] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.548125 11443 raft_consensus.cc:2272] T e7c18f9e23544d00a8d1cf17afda03c5 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.550276 11443 tablet_replica.cc:333] T 69ca21ec420f4843b276f4f15b2b0f1b P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.550824 11443 raft_consensus.cc:2243] T 69ca21ec420f4843b276f4f15b2b0f1b P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.551501 11443 raft_consensus.cc:2272] T 69ca21ec420f4843b276f4f15b2b0f1b P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.553833 11443 tablet_replica.cc:333] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.554621 11443 raft_consensus.cc:2243] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.555111 11443 raft_consensus.cc:2272] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:39.555740 21704 consensus_peers.cc:597] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.557232 11443 tablet_replica.cc:333] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.557971 11443 raft_consensus.cc:2243] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.559005 11443 raft_consensus.cc:2272] T c86c9ae384544389aed37a67c0cdb7b7 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.561890 11443 tablet_replica.cc:333] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.562618 11443 raft_consensus.cc:2243] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.563153 11443 raft_consensus.cc:2272] T 705488f64a3e446babbfe5b0d7bc2122 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:39.563715 21704 consensus_peers.cc:597] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.565492 11443 tablet_replica.cc:333] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.566222 11443 raft_consensus.cc:2243] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.566680 11443 raft_consensus.cc:2272] T eaacd7d18a674b519da25daf5d8040cc P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.569586 11443 tablet_replica.cc:333] T 6742efaede2f4dfeb0c1171e090e8dc0 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.570420 11443 raft_consensus.cc:2243] T 6742efaede2f4dfeb0c1171e090e8dc0 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.570890 11443 raft_consensus.cc:2272] T 6742efaede2f4dfeb0c1171e090e8dc0 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:39.571310 21704 consensus_peers.cc:597] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.573318 11443 tablet_replica.cc:333] T 638d06604bc042cf8e846b13dbe634e7 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.574396 11443 raft_consensus.cc:2243] T 638d06604bc042cf8e846b13dbe634e7 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.574903 11443 raft_consensus.cc:2272] T 638d06604bc042cf8e846b13dbe634e7 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:39.577462 21778 consensus_peers.cc:597] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.578088 11443 tablet_replica.cc:333] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.578925 11443 raft_consensus.cc:2243] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.579470 11443 raft_consensus.cc:2272] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.582683 11443 tablet_replica.cc:333] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
W20260709 13:07:39.582953 21704 consensus_peers.cc:597] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.583564 11443 raft_consensus.cc:2243] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.584713 11443 raft_consensus.cc:2272] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.587698 11443 tablet_replica.cc:333] T bd0cbb2559034cf7b35ecfe777ae620c P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.588479 11443 raft_consensus.cc:2243] T bd0cbb2559034cf7b35ecfe777ae620c P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.589025 11443 raft_consensus.cc:2272] T bd0cbb2559034cf7b35ecfe777ae620c P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.591969 11443 tablet_replica.cc:333] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.592598 11443 raft_consensus.cc:2243] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.593705 11443 raft_consensus.cc:2272] T 6cc8f1a9d5ce413cb159ae69ce846c06 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.596222 11443 tablet_replica.cc:333] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.596839 11443 raft_consensus.cc:2243] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.597295 11443 raft_consensus.cc:2272] T e0beed3c60054461a60991c48b418bfc P bed294de06e24ca4aba572ec722d2567 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.599099 11443 tablet_replica.cc:333] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.599751 11443 raft_consensus.cc:2243] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.600533 11443 raft_consensus.cc:2272] T d14ed1ed549d47eb828017479cccdd42 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.602495 11443 tablet_replica.cc:333] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.603122 11443 raft_consensus.cc:2243] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.604131 11443 raft_consensus.cc:2272] T e39d9076de054deca6b7548e13c39a3b P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.607667 11443 tablet_replica.cc:333] T bc118bb477224df8a4f953e308982c45 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.609160 11443 raft_consensus.cc:2243] T bc118bb477224df8a4f953e308982c45 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.609913 11443 raft_consensus.cc:2272] T bc118bb477224df8a4f953e308982c45 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:39.611471 21778 consensus_peers.cc:597] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.612449 11443 tablet_replica.cc:333] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
W20260709 13:07:39.612581 21704 consensus_peers.cc:597] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.613377 11443 raft_consensus.cc:2243] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.614501 11443 raft_consensus.cc:2272] T 9eac649888d64d3b8f520993cb19b20e P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.617295 11443 tablet_replica.cc:333] T d10699d4b9f347c783a7a00bb6cd772c P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.618178 11443 raft_consensus.cc:2243] T d10699d4b9f347c783a7a00bb6cd772c P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.618788 11443 raft_consensus.cc:2272] T d10699d4b9f347c783a7a00bb6cd772c P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:39.619062 21704 consensus_peers.cc:597] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Couldn't send request to peer 3f1fa49d04344067941ffd03d9e7d48c. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.620726 21778 consensus_peers.cc:597] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.621392 11443 tablet_replica.cc:333] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.622088 11443 raft_consensus.cc:2243] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.622893 11443 raft_consensus.cc:2272] T 22735fa400464e149fa2d7263a8bd58a P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.624899 11443 tablet_replica.cc:333] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.625440 11443 raft_consensus.cc:2243] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.625908 11443 raft_consensus.cc:2272] T d07198040872480db2c3b210d75e8c26 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.627934 11443 tablet_replica.cc:333] T 43e501f94be841fbb110db3ac40ede77 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.628515 11443 raft_consensus.cc:2243] T 43e501f94be841fbb110db3ac40ede77 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.628963 11443 raft_consensus.cc:2272] T 43e501f94be841fbb110db3ac40ede77 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.631203 11443 tablet_replica.cc:333] T 1681a1e8015648a692b9a5eacbbf9d6e P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.631793 11443 raft_consensus.cc:2243] T 1681a1e8015648a692b9a5eacbbf9d6e P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.632287 11443 raft_consensus.cc:2272] T 1681a1e8015648a692b9a5eacbbf9d6e P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.635520 11443 tablet_replica.cc:333] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.636372 11443 raft_consensus.cc:2243] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.636979 11443 raft_consensus.cc:2272] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.639688 11443 tablet_replica.cc:333] T 1e3f4d96c3d04d378fc88e817a7c4069 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.640270 11443 raft_consensus.cc:2243] T 1e3f4d96c3d04d378fc88e817a7c4069 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.640753 11443 raft_consensus.cc:2272] T 1e3f4d96c3d04d378fc88e817a7c4069 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.642875 11443 tablet_replica.cc:333] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.643409 11443 raft_consensus.cc:2243] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.643829 11443 raft_consensus.cc:2272] T f2e7302faa874a2f874d979ae54331f3 P bed294de06e24ca4aba572ec722d2567 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.646039 11443 tablet_replica.cc:333] T e6f61ea1b37f4399a62f791777f0f481 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.646641 11443 raft_consensus.cc:2243] T e6f61ea1b37f4399a62f791777f0f481 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.647097 11443 raft_consensus.cc:2272] T e6f61ea1b37f4399a62f791777f0f481 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.649247 11443 tablet_replica.cc:333] T ac0cb8d5a34c40c3a49464bfcd5f955f P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.649839 11443 raft_consensus.cc:2243] T ac0cb8d5a34c40c3a49464bfcd5f955f P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.650243 11443 raft_consensus.cc:2272] T ac0cb8d5a34c40c3a49464bfcd5f955f P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.652072 11443 tablet_replica.cc:333] T a2f2d007d6e54bb3be541d9bbde02eca P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.652606 11443 raft_consensus.cc:2243] T a2f2d007d6e54bb3be541d9bbde02eca P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.653038 11443 raft_consensus.cc:2272] T a2f2d007d6e54bb3be541d9bbde02eca P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.655072 11443 tablet_replica.cc:333] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.655588 11443 raft_consensus.cc:2243] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.656014 11443 raft_consensus.cc:2272] T 9cb99515c89d44c59276745ce3cbacd6 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.658077 11443 tablet_replica.cc:333] T a7cf644bea63405f9d1a353862a5a110 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.658581 11443 raft_consensus.cc:2243] T a7cf644bea63405f9d1a353862a5a110 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.659003 11443 raft_consensus.cc:2272] T a7cf644bea63405f9d1a353862a5a110 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.660713 11443 tablet_replica.cc:333] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.661207 11443 raft_consensus.cc:2243] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.661672 11443 raft_consensus.cc:2272] T 9d8eb26670184a3dabe0c8e8162e1a4e P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.664207 11443 tablet_replica.cc:333] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.664868 11443 raft_consensus.cc:2243] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.666147 11443 raft_consensus.cc:2272] T 83c22a51936f4415b7a99dcad7540239 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.668754 11443 tablet_replica.cc:333] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.669525 11443 raft_consensus.cc:2243] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.670689 11443 raft_consensus.cc:2272] T 4d4979f7a7c14c68ad359f624f114570 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.673548 11443 tablet_replica.cc:333] T ce5f20a869e24ab78d7677bc08d45963 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.674510 11443 raft_consensus.cc:2243] T ce5f20a869e24ab78d7677bc08d45963 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.675093 11443 raft_consensus.cc:2272] T ce5f20a869e24ab78d7677bc08d45963 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.677876 11443 tablet_replica.cc:333] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.678978 11443 raft_consensus.cc:2243] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:07:39.680229 21778 consensus_peers.cc:597] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.680256 11443 raft_consensus.cc:2272] T 832d931fb3f84415aac4b1880e99c498 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.684326 11443 tablet_replica.cc:333] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.684969 11443 raft_consensus.cc:2243] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.685907 11443 raft_consensus.cc:2272] T 7d12f1f33e1a417088b0ae7332d600e3 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.688233 11443 tablet_replica.cc:333] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.688766 11443 raft_consensus.cc:2243] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.689697 11443 raft_consensus.cc:2272] T 7a21c3a2d0e04b27ad46365fd5ff3453 P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.692292 11443 tablet_replica.cc:333] T 9de835ccc085481aaf56e24e6b6a055f P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.692951 11443 raft_consensus.cc:2243] T 9de835ccc085481aaf56e24e6b6a055f P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.693428 11443 raft_consensus.cc:2272] T 9de835ccc085481aaf56e24e6b6a055f P bed294de06e24ca4aba572ec722d2567 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:39.694025 21704 consensus_peers.cc:597] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.695560 11443 tablet_replica.cc:333] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567: stopping tablet replica
I20260709 13:07:39.696208 11443 raft_consensus.cc:2243] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.697160 11443 raft_consensus.cc:2272] T 9932f1e440d442f8ab6ba25f33881d75 P bed294de06e24ca4aba572ec722d2567 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:39.712085 21778 consensus_peers.cc:597] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.763353 21704 consensus_peers.cc:597] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:35853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.764317 11443 tablet_server.cc:196] TabletServer@127.11.44.194:0 shutdown complete.
W20260709 13:07:39.768180 21778 consensus_peers.cc:597] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:35853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.778869 21778 consensus_peers.cc:597] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:35853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.809082 21704 consensus_peers.cc:597] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:35853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.836746 21778 consensus_peers.cc:597] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:35853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.845587 21704 consensus_peers.cc:597] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:35853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.851801 11443 tablet_server.cc:179] TabletServer@127.11.44.195:0 shutting down...
W20260709 13:07:39.884157 21704 consensus_peers.cc:597] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:35853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.886343 21777 consensus_peers.cc:597] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Couldn't send request to peer 3e8f84032ed948908dc7fcffcfe2d6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.887154 21704 consensus_peers.cc:597] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:35853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.887568 21704 consensus_peers.cc:597] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:35853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.926793 21777 consensus_peers.cc:597] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Couldn't send request to peer 3e8f84032ed948908dc7fcffcfe2d6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:39.940753 21778 consensus_peers.cc:597] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:35853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:39.944197 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:39.945184 11443 tablet_replica.cc:333] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:39.946141 11443 raft_consensus.cc:2243] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.947283 11443 raft_consensus.cc:2272] T 1681a1e8015648a692b9a5eacbbf9d6e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.950227 11443 tablet_replica.cc:333] T 008742eefeb947f5a1f7decfb821a03d P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:39.951006 11443 raft_consensus.cc:2243] T 008742eefeb947f5a1f7decfb821a03d P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.951510 11443 raft_consensus.cc:2272] T 008742eefeb947f5a1f7decfb821a03d P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.954267 11443 tablet_replica.cc:333] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:39.954829 11443 raft_consensus.cc:2243] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.955556 11443 raft_consensus.cc:2272] T b5745aab7e6c4a409a0ac98725e4e4c9 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.957394 11443 tablet_replica.cc:333] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:39.957983 11443 raft_consensus.cc:2243] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.958725 11443 raft_consensus.cc:2272] T e7c18f9e23544d00a8d1cf17afda03c5 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.960659 11443 tablet_replica.cc:333] T 881467b2dd884d22b15e9ac3906b55cc P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:39.961174 11443 raft_consensus.cc:2243] T 881467b2dd884d22b15e9ac3906b55cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.961575 11443 raft_consensus.cc:2272] T 881467b2dd884d22b15e9ac3906b55cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.963857 11443 tablet_replica.cc:333] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:39.964697 11443 raft_consensus.cc:2243] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.965308 11443 raft_consensus.cc:2272] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.967965 11443 tablet_replica.cc:333] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:39.968798 11443 raft_consensus.cc:2243] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.969660 11443 raft_consensus.cc:2272] T 86ba1219e0f34c48b4dcb1d1c5e177d0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.971645 11443 tablet_replica.cc:333] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:39.972381 11443 raft_consensus.cc:2243] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.972803 11443 raft_consensus.cc:2272] T 317e3221976c47fa913d27f018a21910 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.974669 11443 tablet_replica.cc:333] T 1e3f4d96c3d04d378fc88e817a7c4069 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:39.975207 11443 raft_consensus.cc:2243] T 1e3f4d96c3d04d378fc88e817a7c4069 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.975642 11443 raft_consensus.cc:2272] T 1e3f4d96c3d04d378fc88e817a7c4069 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.977666 11443 tablet_replica.cc:333] T 583c8787161e47ccb08cd01f6d26d5a4 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:39.978201 11443 raft_consensus.cc:2243] T 583c8787161e47ccb08cd01f6d26d5a4 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.978612 11443 raft_consensus.cc:2272] T 583c8787161e47ccb08cd01f6d26d5a4 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.980569 11443 tablet_replica.cc:333] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:39.981112 11443 raft_consensus.cc:2243] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.981562 11443 raft_consensus.cc:2272] T eaacd7d18a674b519da25daf5d8040cc P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.983991 11443 tablet_replica.cc:333] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:39.984953 11443 raft_consensus.cc:2243] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.985505 11443 raft_consensus.cc:2272] T 7f558d81ff1b4d1fbb393d8dab70debb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.987599 11443 tablet_replica.cc:333] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:39.988154 11443 raft_consensus.cc:2243] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.988562 11443 raft_consensus.cc:2272] T d14ed1ed549d47eb828017479cccdd42 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.990553 11443 tablet_replica.cc:333] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:39.991127 11443 raft_consensus.cc:2243] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.991621 11443 raft_consensus.cc:2272] T e327a74ed0c544d28806d688941cd3f6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.993397 11443 tablet_replica.cc:333] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:39.994040 11443 raft_consensus.cc:2243] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:39.994459 11443 raft_consensus.cc:2272] T 841639e17c5d4724afe9494276ba00a3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.996285 11443 tablet_replica.cc:333] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:39.996804 11443 raft_consensus.cc:2243] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:39.997644 11443 raft_consensus.cc:2272] T 638d06604bc042cf8e846b13dbe634e7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:39.999447 11443 tablet_replica.cc:333] T 8900bbb09a964e26aaab011b218c8f11 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:39.999974 11443 raft_consensus.cc:2243] T 8900bbb09a964e26aaab011b218c8f11 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.000383 11443 raft_consensus.cc:2272] T 8900bbb09a964e26aaab011b218c8f11 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.002344 11443 tablet_replica.cc:333] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.002959 11443 raft_consensus.cc:2243] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.003381 11443 raft_consensus.cc:2272] T d07198040872480db2c3b210d75e8c26 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.005278 11443 tablet_replica.cc:333] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.006189 11443 raft_consensus.cc:2243] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.006783 11443 raft_consensus.cc:2272] T d10699d4b9f347c783a7a00bb6cd772c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.008567 11443 tablet_replica.cc:333] T 9eac649888d64d3b8f520993cb19b20e P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.009055 11443 raft_consensus.cc:2243] T 9eac649888d64d3b8f520993cb19b20e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.009428 11443 raft_consensus.cc:2272] T 9eac649888d64d3b8f520993cb19b20e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.011332 11443 tablet_replica.cc:333] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.011804 11443 raft_consensus.cc:2243] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.012157 11443 raft_consensus.cc:2272] T 22735fa400464e149fa2d7263a8bd58a P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.013989 11443 tablet_replica.cc:333] T 1ed9b20099494a8c94a51f76692a8ec0 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.014464 11443 raft_consensus.cc:2243] T 1ed9b20099494a8c94a51f76692a8ec0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.014813 11443 raft_consensus.cc:2272] T 1ed9b20099494a8c94a51f76692a8ec0 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.016625 11443 tablet_replica.cc:333] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.017220 11443 raft_consensus.cc:2243] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.018123 11443 raft_consensus.cc:2272] T e6f61ea1b37f4399a62f791777f0f481 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.020174 11443 tablet_replica.cc:333] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.020741 11443 raft_consensus.cc:2243] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.021545 11443 raft_consensus.cc:2272] T bd0cbb2559034cf7b35ecfe777ae620c P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.024149 11443 tablet_replica.cc:333] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.024955 11443 raft_consensus.cc:2243] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.025900 11443 raft_consensus.cc:2272] T 705488f64a3e446babbfe5b0d7bc2122 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:40.026937 21777 consensus_peers.cc:597] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Couldn't send request to peer 3e8f84032ed948908dc7fcffcfe2d6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:40.028650 11443 tablet_replica.cc:333] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.029495 11443 raft_consensus.cc:2243] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.030499 11443 raft_consensus.cc:2272] T 2c540859ed0b48f1b7ed38ead0137a45 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.033224 11443 tablet_replica.cc:333] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.033962 11443 raft_consensus.cc:2243] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.034857 11443 raft_consensus.cc:2272] T 43e501f94be841fbb110db3ac40ede77 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:40.037071 21778 consensus_peers.cc:597] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:35853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:40.037619 11443 tablet_replica.cc:333] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.038512 11443 raft_consensus.cc:2243] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.039928 11443 raft_consensus.cc:2272] T ac0cb8d5a34c40c3a49464bfcd5f955f P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:40.041788 21704 consensus_peers.cc:597] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 -> Peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Couldn't send request to peer bed294de06e24ca4aba572ec722d2567. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:35853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:40.042919 11443 tablet_replica.cc:333] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.043744 11443 raft_consensus.cc:2243] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.044659 11443 raft_consensus.cc:2272] T 9cb99515c89d44c59276745ce3cbacd6 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.047601 11443 tablet_replica.cc:333] T ce5f20a869e24ab78d7677bc08d45963 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
W20260709 13:07:40.048319 21777 consensus_peers.cc:597] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Couldn't send request to peer 3e8f84032ed948908dc7fcffcfe2d6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:40.048445 11443 raft_consensus.cc:2243] T ce5f20a869e24ab78d7677bc08d45963 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:40.048934 21777 consensus_peers.cc:597] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Couldn't send request to peer 3e8f84032ed948908dc7fcffcfe2d6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:40.049073 11443 raft_consensus.cc:2272] T ce5f20a869e24ab78d7677bc08d45963 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.052111 11443 tablet_replica.cc:333] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.053076 11443 raft_consensus.cc:2243] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.053905 11443 raft_consensus.cc:2272] T e7609574109349aeb89daee4d7aec6f7 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.056327 11443 tablet_replica.cc:333] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.056999 11443 raft_consensus.cc:2243] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.057505 11443 raft_consensus.cc:2272] T 83c22a51936f4415b7a99dcad7540239 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.060034 11443 tablet_replica.cc:333] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.060623 11443 raft_consensus.cc:2243] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.061528 11443 raft_consensus.cc:2272] T 613b610452794d1192d3df796bedcd8e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.063619 11443 tablet_replica.cc:333] T 9932f1e440d442f8ab6ba25f33881d75 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.064177 11443 raft_consensus.cc:2243] T 9932f1e440d442f8ab6ba25f33881d75 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.064563 11443 raft_consensus.cc:2272] T 9932f1e440d442f8ab6ba25f33881d75 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.066814 11443 tablet_replica.cc:333] T e39d9076de054deca6b7548e13c39a3b P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.067408 11443 raft_consensus.cc:2243] T e39d9076de054deca6b7548e13c39a3b P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.067854 11443 raft_consensus.cc:2272] T e39d9076de054deca6b7548e13c39a3b P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.069965 11443 tablet_replica.cc:333] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.070559 11443 raft_consensus.cc:2243] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.071024 11443 raft_consensus.cc:2272] T 6e46f3f1221a4fedac36e2252b8f2a34 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.073376 11443 tablet_replica.cc:333] T 832d931fb3f84415aac4b1880e99c498 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.074146 11443 raft_consensus.cc:2243] T 832d931fb3f84415aac4b1880e99c498 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.074760 11443 raft_consensus.cc:2272] T 832d931fb3f84415aac4b1880e99c498 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.077652 11443 tablet_replica.cc:333] T 7d12f1f33e1a417088b0ae7332d600e3 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.078498 11443 raft_consensus.cc:2243] T 7d12f1f33e1a417088b0ae7332d600e3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.078954 11443 raft_consensus.cc:2272] T 7d12f1f33e1a417088b0ae7332d600e3 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.081598 11443 tablet_replica.cc:333] T 7a21c3a2d0e04b27ad46365fd5ff3453 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.082321 11443 raft_consensus.cc:2243] T 7a21c3a2d0e04b27ad46365fd5ff3453 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.083148 11443 raft_consensus.cc:2272] T 7a21c3a2d0e04b27ad46365fd5ff3453 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.086086 11443 tablet_replica.cc:333] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.086814 11443 raft_consensus.cc:2243] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.087345 11443 raft_consensus.cc:2272] T 313ed31222454fe19290a9105f226521 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:40.089130 21777 consensus_peers.cc:597] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Couldn't send request to peer 3e8f84032ed948908dc7fcffcfe2d6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:40.089788 11443 tablet_replica.cc:333] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.090642 11443 raft_consensus.cc:2243] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.091550 11443 raft_consensus.cc:2272] T 5c7c65eed72a42d0a91f36c764de4abb P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:40.093482 21777 consensus_peers.cc:597] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Couldn't send request to peer 3e8f84032ed948908dc7fcffcfe2d6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:40.094237 11443 tablet_replica.cc:333] T 4d4979f7a7c14c68ad359f624f114570 P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.095124 11443 raft_consensus.cc:2243] T 4d4979f7a7c14c68ad359f624f114570 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.095788 11443 raft_consensus.cc:2272] T 4d4979f7a7c14c68ad359f624f114570 P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.098541 11443 tablet_replica.cc:333] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.099161 11443 raft_consensus.cc:2243] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.099637 11443 raft_consensus.cc:2272] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.102330 11443 tablet_replica.cc:333] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5: stopping tablet replica
I20260709 13:07:40.103072 11443 raft_consensus.cc:2243] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.104104 11443 raft_consensus.cc:2272] T 9d8eb26670184a3dabe0c8e8162e1a4e P 3e8f84032ed948908dc7fcffcfe2d6e5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:40.109786 21777 consensus_peers.cc:597] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Couldn't send request to peer 3e8f84032ed948908dc7fcffcfe2d6e5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:40.187065 11443 tablet_server.cc:196] TabletServer@127.11.44.195:0 shutdown complete.
I20260709 13:07:40.189932 22783 raft_consensus.cc:493] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:40.190603 22783 raft_consensus.cc:515] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } } peers { permanent_uuid: "bed294de06e24ca4aba572ec722d2567" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35853 } }
I20260709 13:07:40.192766 22783 leader_election.cc:290] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255), bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853)
W20260709 13:07:40.197309 21778 leader_election.cc:336] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
W20260709 13:07:40.198009 21778 leader_election.cc:336] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer bed294de06e24ca4aba572ec722d2567 (127.11.44.194:35853): Network error: Client connection negotiation failed: client connection to 127.11.44.194:35853: connect: Connection refused (error 111)
I20260709 13:07:40.198293 21778 leader_election.cc:304] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3f1fa49d04344067941ffd03d9e7d48c, bed294de06e24ca4aba572ec722d2567
I20260709 13:07:40.198902 22783 raft_consensus.cc:2749] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:07:40.243397 21777 consensus_peers.cc:597] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Couldn't send request to peer 3e8f84032ed948908dc7fcffcfe2d6e5. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:46013: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:40.255817 21777 consensus_peers.cc:597] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba -> Peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Couldn't send request to peer 3e8f84032ed948908dc7fcffcfe2d6e5. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.195:46013: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:40.267652 11443 tablet_server.cc:179] TabletServer@127.11.44.196:0 shutting down...
I20260709 13:07:40.284191 22783 raft_consensus.cc:493] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:40.284881 22783 raft_consensus.cc:515] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:40.288887 22783 leader_election.cc:290] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
W20260709 13:07:40.295563 21777 leader_election.cc:336] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Network error: Client connection negotiation failed: client connection to 127.11.44.195:46013: connect: Connection refused (error 111)
W20260709 13:07:40.302640 21778 leader_election.cc:336] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:40.303078 21778 leader_election.cc:304] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:40.303743 22783 raft_consensus.cc:2749] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:40.326195 22783 raft_consensus.cc:493] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:40.326776 22783 raft_consensus.cc:515] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:40.328524 22783 leader_election.cc:290] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:40.330847 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:07:40.332098 21777 leader_election.cc:336] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Network error: Client connection negotiation failed: client connection to 127.11.44.195:46013: connect: Connection refused (error 111)
I20260709 13:07:40.332479 11443 tablet_replica.cc:333] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.333338 11443 raft_consensus.cc:2243] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:07:40.334228 21778 leader_election.cc:336] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:40.334412 11443 raft_consensus.cc:2272] T 881467b2dd884d22b15e9ac3906b55cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.334702 21778 leader_election.cc:304] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:40.335355 22783 raft_consensus.cc:2749] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:40.336877 11443 tablet_replica.cc:333] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.337460 11443 raft_consensus.cc:2243] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.337904 11443 raft_consensus.cc:2272] T ba04167743094b89ba6e3596a48aba86 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.339788 11443 tablet_replica.cc:333] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.340277 11443 raft_consensus.cc:2243] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.340960 11443 raft_consensus.cc:2272] T 23660cfe7a7e49db942526440533cdf9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.342738 11443 tablet_replica.cc:333] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.343240 11443 raft_consensus.cc:2243] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.343569 11443 raft_consensus.cc:2272] T 317e3221976c47fa913d27f018a21910 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.345235 11443 tablet_replica.cc:333] T b5745aab7e6c4a409a0ac98725e4e4c9 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.345786 11443 raft_consensus.cc:2243] T b5745aab7e6c4a409a0ac98725e4e4c9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.346132 11443 raft_consensus.cc:2272] T b5745aab7e6c4a409a0ac98725e4e4c9 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.347854 11443 tablet_replica.cc:333] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.348706 11443 raft_consensus.cc:2243] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.349416 11443 raft_consensus.cc:2272] T 008742eefeb947f5a1f7decfb821a03d P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.351164 11443 tablet_replica.cc:333] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.351660 11443 raft_consensus.cc:2243] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.351996 11443 raft_consensus.cc:2272] T 21a0bcc4561a4503aebdb0aab6b13b37 P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.353706 11443 tablet_replica.cc:333] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.354202 11443 raft_consensus.cc:2243] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.354547 11443 raft_consensus.cc:2272] T 841639e17c5d4724afe9494276ba00a3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.356146 11443 tablet_replica.cc:333] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.356663 11443 raft_consensus.cc:2243] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.357388 11443 raft_consensus.cc:2272] T eaacd7d18a674b519da25daf5d8040cc P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.359220 11443 tablet_replica.cc:333] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.359683 11443 raft_consensus.cc:2243] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.360021 11443 raft_consensus.cc:2272] T 7f558d81ff1b4d1fbb393d8dab70debb P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.361780 11443 tablet_replica.cc:333] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.362278 11443 raft_consensus.cc:2243] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.362635 11443 raft_consensus.cc:2272] T 36c6b2be38fb47e7a92c9b1b7f9678d7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.364316 11443 tablet_replica.cc:333] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.364791 11443 raft_consensus.cc:2243] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.365144 11443 raft_consensus.cc:2272] T 7bb5613fc4c548ccaa3120ba22d4d0f8 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.366956 11443 tablet_replica.cc:333] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.367424 11443 raft_consensus.cc:2243] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.367748 11443 raft_consensus.cc:2272] T e327a74ed0c544d28806d688941cd3f6 P b8c58d9f32b84e5bb79e2751ac41cdba [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.369450 11443 tablet_replica.cc:333] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.369997 11443 raft_consensus.cc:2243] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.370687 11443 raft_consensus.cc:2272] T 69ca21ec420f4843b276f4f15b2b0f1b P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.372396 11443 tablet_replica.cc:333] T d14ed1ed549d47eb828017479cccdd42 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.372864 11443 raft_consensus.cc:2243] T d14ed1ed549d47eb828017479cccdd42 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.373204 11443 raft_consensus.cc:2272] T d14ed1ed549d47eb828017479cccdd42 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.375044 11443 tablet_replica.cc:333] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.375504 11443 raft_consensus.cc:2243] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.375883 11443 raft_consensus.cc:2272] T 6742efaede2f4dfeb0c1171e090e8dc0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.377650 11443 tablet_replica.cc:333] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.378136 11443 raft_consensus.cc:2243] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.378860 11443 raft_consensus.cc:2272] T 583c8787161e47ccb08cd01f6d26d5a4 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.380669 11443 tablet_replica.cc:333] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.381309 11443 raft_consensus.cc:2243] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.381690 11443 raft_consensus.cc:2272] T c86c9ae384544389aed37a67c0cdb7b7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.383428 11443 tablet_replica.cc:333] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.383908 11443 raft_consensus.cc:2243] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.384930 11443 raft_consensus.cc:2272] T 2e8f2bbfbe0c49d8921f09a4a4e4875e P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.387660 11443 tablet_replica.cc:333] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.388473 11443 raft_consensus.cc:2243] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.389544 11443 raft_consensus.cc:2272] T 1ed9b20099494a8c94a51f76692a8ec0 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.392290 11443 tablet_replica.cc:333] T e6f61ea1b37f4399a62f791777f0f481 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.393077 11443 raft_consensus.cc:2243] T e6f61ea1b37f4399a62f791777f0f481 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.393683 11443 raft_consensus.cc:2272] T e6f61ea1b37f4399a62f791777f0f481 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.395844 11443 tablet_replica.cc:333] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.396355 11443 raft_consensus.cc:2243] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.396744 11443 raft_consensus.cc:2272] T 6cc8f1a9d5ce413cb159ae69ce846c06 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.398715 11443 tablet_replica.cc:333] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.399217 11443 raft_consensus.cc:2243] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.399602 11443 raft_consensus.cc:2272] T e0beed3c60054461a60991c48b418bfc P b8c58d9f32b84e5bb79e2751ac41cdba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.401387 11443 tablet_replica.cc:333] T 5c7c65eed72a42d0a91f36c764de4abb P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.401917 11443 raft_consensus.cc:2243] T 5c7c65eed72a42d0a91f36c764de4abb P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.402319 11443 raft_consensus.cc:2272] T 5c7c65eed72a42d0a91f36c764de4abb P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.404090 11443 tablet_replica.cc:333] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.404587 11443 raft_consensus.cc:2243] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.405349 11443 raft_consensus.cc:2272] T 8900bbb09a964e26aaab011b218c8f11 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.405858 22783 raft_consensus.cc:493] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 3f1fa49d04344067941ffd03d9e7d48c)
I20260709 13:07:40.406339 22783 raft_consensus.cc:515] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e8f84032ed948908dc7fcffcfe2d6e5" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 46013 } } peers { permanent_uuid: "b8c58d9f32b84e5bb79e2751ac41cdba" member_type: VOTER last_known_addr { host: "127.11.44.196" port: 41173 } } peers { permanent_uuid: "3f1fa49d04344067941ffd03d9e7d48c" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35255 } }
I20260709 13:07:40.407775 11443 tablet_replica.cc:333] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.408470 22783 leader_election.cc:290] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013), 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255)
I20260709 13:07:40.408615 11443 raft_consensus.cc:2243] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.409703 11443 raft_consensus.cc:2272] T 6e46f3f1221a4fedac36e2252b8f2a34 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.412252 11443 tablet_replica.cc:333] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
W20260709 13:07:40.412899 21777 leader_election.cc:336] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3e8f84032ed948908dc7fcffcfe2d6e5 (127.11.44.195:46013): Network error: Client connection negotiation failed: client connection to 127.11.44.195:46013: connect: Connection refused (error 111)
I20260709 13:07:40.413172 11443 raft_consensus.cc:2243] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:40.413467 21778 leader_election.cc:336] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 3f1fa49d04344067941ffd03d9e7d48c (127.11.44.193:35255): Network error: Client connection negotiation failed: client connection to 127.11.44.193:35255: connect: Connection refused (error 111)
I20260709 13:07:40.413869 11443 raft_consensus.cc:2272] T 2c540859ed0b48f1b7ed38ead0137a45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.413965 21778 leader_election.cc:304] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b8c58d9f32b84e5bb79e2751ac41cdba; no voters: 3e8f84032ed948908dc7fcffcfe2d6e5, 3f1fa49d04344067941ffd03d9e7d48c
I20260709 13:07:40.414706 22783 raft_consensus.cc:2749] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:40.416267 11443 tablet_replica.cc:333] T 43e501f94be841fbb110db3ac40ede77 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.416812 11443 raft_consensus.cc:2243] T 43e501f94be841fbb110db3ac40ede77 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.417189 11443 raft_consensus.cc:2272] T 43e501f94be841fbb110db3ac40ede77 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.419108 11443 tablet_replica.cc:333] T 7a21c3a2d0e04b27ad46365fd5ff3453 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.419553 11443 raft_consensus.cc:2243] T 7a21c3a2d0e04b27ad46365fd5ff3453 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.419899 11443 raft_consensus.cc:2272] T 7a21c3a2d0e04b27ad46365fd5ff3453 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.421692 11443 tablet_replica.cc:333] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.422175 11443 raft_consensus.cc:2243] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.422845 11443 raft_consensus.cc:2272] T 9de835ccc085481aaf56e24e6b6a055f P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.424551 11443 tablet_replica.cc:333] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.424988 11443 raft_consensus.cc:2243] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.425321 11443 raft_consensus.cc:2272] T 313ed31222454fe19290a9105f226521 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.427158 11443 tablet_replica.cc:333] T 7d12f1f33e1a417088b0ae7332d600e3 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.427583 11443 raft_consensus.cc:2243] T 7d12f1f33e1a417088b0ae7332d600e3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.427927 11443 raft_consensus.cc:2272] T 7d12f1f33e1a417088b0ae7332d600e3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.429971 11443 tablet_replica.cc:333] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.430423 11443 raft_consensus.cc:2243] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.431118 11443 raft_consensus.cc:2272] T ce5f20a869e24ab78d7677bc08d45963 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.432900 11443 tablet_replica.cc:333] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.433352 11443 raft_consensus.cc:2243] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.434165 11443 raft_consensus.cc:2272] T a2f2d007d6e54bb3be541d9bbde02eca P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.435945 11443 tablet_replica.cc:333] T ac0cb8d5a34c40c3a49464bfcd5f955f P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.436398 11443 raft_consensus.cc:2243] T ac0cb8d5a34c40c3a49464bfcd5f955f P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.436794 11443 raft_consensus.cc:2272] T ac0cb8d5a34c40c3a49464bfcd5f955f P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.438608 11443 tablet_replica.cc:333] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.439059 11443 raft_consensus.cc:2243] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.439394 11443 raft_consensus.cc:2272] T a7cf644bea63405f9d1a353862a5a110 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.441181 11443 tablet_replica.cc:333] T 9eac649888d64d3b8f520993cb19b20e P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.441735 11443 raft_consensus.cc:2243] T 9eac649888d64d3b8f520993cb19b20e P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.442122 11443 raft_consensus.cc:2272] T 9eac649888d64d3b8f520993cb19b20e P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.444008 11443 tablet_replica.cc:333] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.444430 11443 raft_consensus.cc:2243] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.445145 11443 raft_consensus.cc:2272] T d10699d4b9f347c783a7a00bb6cd772c P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.447393 11443 tablet_replica.cc:333] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.447860 11443 raft_consensus.cc:2243] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.448225 11443 raft_consensus.cc:2272] T bc118bb477224df8a4f953e308982c45 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.450330 11443 tablet_replica.cc:333] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.450858 11443 raft_consensus.cc:2243] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.451272 11443 raft_consensus.cc:2272] T e7609574109349aeb89daee4d7aec6f7 P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.453050 11443 tablet_replica.cc:333] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.453636 11443 raft_consensus.cc:2243] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.454115 11443 raft_consensus.cc:2272] T 613b610452794d1192d3df796bedcd8e P b8c58d9f32b84e5bb79e2751ac41cdba [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.456012 11443 tablet_replica.cc:333] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.456496 11443 raft_consensus.cc:2243] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.457240 11443 raft_consensus.cc:2272] T 6ac5258f941c4bdbb2ba4e33a4eaca08 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.459120 11443 tablet_replica.cc:333] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.459611 11443 raft_consensus.cc:2243] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.460353 11443 raft_consensus.cc:2272] T 1e3f4d96c3d04d378fc88e817a7c4069 P b8c58d9f32b84e5bb79e2751ac41cdba [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.462298 11443 tablet_replica.cc:333] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba: stopping tablet replica
I20260709 13:07:40.462759 11443 raft_consensus.cc:2243] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:40.463158 11443 raft_consensus.cc:2272] T f2e7302faa874a2f874d979ae54331f3 P b8c58d9f32b84e5bb79e2751ac41cdba [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.528415 11443 tablet_server.cc:196] TabletServer@127.11.44.196:0 shutdown complete.
I20260709 13:07:40.591178 11443 master.cc:562] Master@127.11.44.254:41239 shutting down...
I20260709 13:07:40.617722 11443 raft_consensus.cc:2243] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:40.618404 11443 raft_consensus.cc:2272] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:40.618705 11443 tablet_replica.cc:333] T 00000000000000000000000000000000 P c5c1c01ff0c44f9dafb08d045eab9aa1: stopping tablet replica
I20260709 13:07:40.671641 11443 master.cc:584] Master@127.11.44.254:41239 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (33221 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:07:40.776397 11443 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.44.254:39259
I20260709 13:07:40.777549 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:40.784366 22791 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:40.784205 22790 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:40.785100 22793 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:40.786909 11443 server_base.cc:1061] running on GCE node
I20260709 13:07:40.788048 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:40.788324 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:40.788480 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602460788465 us; error 0 us; skew 500 ppm
I20260709 13:07:40.789062 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:40.792580 11443 webserver.cc:533] Webserver started at http://127.11.44.254:46463/ using document root <none> and password file <none>
I20260709 13:07:40.793118 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:40.793308 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:40.793708 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:40.794919 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/master-0-root/instance:
uuid: "9bd1425d19824938ba5a03180c92b56a"
format_stamp: "Formatted at 2026-07-09 13:07:40 on dist-test-slave-qv7r"
I20260709 13:07:40.799551 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:07:40.803283 22798 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:40.804296 11443 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:07:40.804558 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/master-0-root
uuid: "9bd1425d19824938ba5a03180c92b56a"
format_stamp: "Formatted at 2026-07-09 13:07:40 on dist-test-slave-qv7r"
I20260709 13:07:40.804793 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:40.819429 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:40.820659 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:40.865799 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.254:39259
I20260709 13:07:40.866079 22849 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.254:39259 every 8 connection(s)
I20260709 13:07:40.870137 22850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:40.882733 22850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a: Bootstrap starting.
I20260709 13:07:40.888124 22850 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:40.893199 22850 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a: No bootstrap required, opened a new log
I20260709 13:07:40.895524 22850 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bd1425d19824938ba5a03180c92b56a" member_type: VOTER }
I20260709 13:07:40.895941 22850 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:40.896211 22850 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd1425d19824938ba5a03180c92b56a, State: Initialized, Role: FOLLOWER
I20260709 13:07:40.896876 22850 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bd1425d19824938ba5a03180c92b56a" member_type: VOTER }
I20260709 13:07:40.897378 22850 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:40.897687 22850 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:40.897946 22850 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:40.902724 22850 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bd1425d19824938ba5a03180c92b56a" member_type: VOTER }
I20260709 13:07:40.903263 22850 leader_election.cc:304] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9bd1425d19824938ba5a03180c92b56a; no voters: 
I20260709 13:07:40.904420 22850 leader_election.cc:290] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:40.904850 22853 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:40.906373 22853 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a [term 1 LEADER]: Becoming Leader. State: Replica: 9bd1425d19824938ba5a03180c92b56a, State: Running, Role: LEADER
I20260709 13:07:40.907034 22853 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bd1425d19824938ba5a03180c92b56a" member_type: VOTER }
I20260709 13:07:40.907563 22850 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:40.911566 22854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9bd1425d19824938ba5a03180c92b56a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bd1425d19824938ba5a03180c92b56a" member_type: VOTER } }
I20260709 13:07:40.912254 22854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:40.912055 22855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9bd1425d19824938ba5a03180c92b56a. Latest consensus state: current_term: 1 leader_uuid: "9bd1425d19824938ba5a03180c92b56a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bd1425d19824938ba5a03180c92b56a" member_type: VOTER } }
I20260709 13:07:40.912614 22855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:40.914987 22859 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:40.923338 22859 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:40.924389 11443 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:40.932467 22859 catalog_manager.cc:1383] Generated new cluster ID: 97083d21b5134026905e68f134c9b5aa
I20260709 13:07:40.932844 22859 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:40.959019 22859 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:40.960273 22859 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:40.975020 22859 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a: Generated new TSK 0
I20260709 13:07:40.975586 22859 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:40.991928 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:40.998407 22871 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:40.999334 22872 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:41.001192 22874 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:41.002329 11443 server_base.cc:1061] running on GCE node
I20260709 13:07:41.003243 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:41.003427 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:41.003545 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602461003534 us; error 0 us; skew 500 ppm
I20260709 13:07:41.003998 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:41.006752 11443 webserver.cc:533] Webserver started at http://127.11.44.193:37679/ using document root <none> and password file <none>
I20260709 13:07:41.007182 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:41.007342 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:41.007550 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:41.008581 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/ts-0-root/instance:
uuid: "695cc50fa39b4569b4248bab36962ab8"
format_stamp: "Formatted at 2026-07-09 13:07:41 on dist-test-slave-qv7r"
I20260709 13:07:41.013365 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:07:41.017179 22879 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:41.018162 11443 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:07:41.018446 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/ts-0-root
uuid: "695cc50fa39b4569b4248bab36962ab8"
format_stamp: "Formatted at 2026-07-09 13:07:41 on dist-test-slave-qv7r"
I20260709 13:07:41.018726 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:41.038828 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:41.040091 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:41.041497 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:41.043869 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:41.044044 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:41.044245 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:41.044386 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:41.086444 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.193:43907
I20260709 13:07:41.086551 22941 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.193:43907 every 8 connection(s)
I20260709 13:07:41.091580 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:41.099684 22946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:41.100096 22947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:41.102871 11443 server_base.cc:1061] running on GCE node
W20260709 13:07:41.103374 22950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:41.104532 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:41.104775 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:41.105104 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602461105080 us; error 0 us; skew 500 ppm
I20260709 13:07:41.105710 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:41.109732 22942 heartbeater.cc:344] Connected to a master server at 127.11.44.254:39259
I20260709 13:07:41.110133 22942 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:41.110875 22942 heartbeater.cc:507] Master 127.11.44.254:39259 requested a full tablet report, sending...
I20260709 13:07:41.113232 22815 ts_manager.cc:194] Registered new tserver with Master: 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907)
I20260709 13:07:41.114149 11443 webserver.cc:533] Webserver started at http://127.11.44.194:40061/ using document root <none> and password file <none>
I20260709 13:07:41.114866 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:41.115103 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:41.115409 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:41.115782 22815 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38458
I20260709 13:07:41.116860 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/ts-1-root/instance:
uuid: "116cbc3b8350497e9898dca20692f190"
format_stamp: "Formatted at 2026-07-09 13:07:41 on dist-test-slave-qv7r"
I20260709 13:07:41.121973 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:07:41.125135 22954 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:41.126112 11443 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:07:41.126420 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/ts-1-root
uuid: "116cbc3b8350497e9898dca20692f190"
format_stamp: "Formatted at 2026-07-09 13:07:41 on dist-test-slave-qv7r"
I20260709 13:07:41.126685 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:41.154325 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:41.155772 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:41.157320 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:41.159574 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:41.159770 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:41.160055 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:41.160200 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:41.206918 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.194:35067
I20260709 13:07:41.207079 23016 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.194:35067 every 8 connection(s)
I20260709 13:07:41.211874 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:41.220000 23020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:41.220252 23021 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:41.222859 23023 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:41.223491 11443 server_base.cc:1061] running on GCE node
I20260709 13:07:41.224525 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:41.224948 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:41.225119 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602461225087 us; error 0 us; skew 500 ppm
I20260709 13:07:41.225659 23017 heartbeater.cc:344] Connected to a master server at 127.11.44.254:39259
I20260709 13:07:41.225816 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:41.226349 23017 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:41.227156 23017 heartbeater.cc:507] Master 127.11.44.254:39259 requested a full tablet report, sending...
I20260709 13:07:41.229111 11443 webserver.cc:533] Webserver started at http://127.11.44.195:37789/ using document root <none> and password file <none>
I20260709 13:07:41.229509 22815 ts_manager.cc:194] Registered new tserver with Master: 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067)
I20260709 13:07:41.229750 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:41.230087 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:41.230348 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:41.231098 22815 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38470
I20260709 13:07:41.231500 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/ts-2-root/instance:
uuid: "8712fe9782134858a2b8c81ac5ed2892"
format_stamp: "Formatted at 2026-07-09 13:07:41 on dist-test-slave-qv7r"
I20260709 13:07:41.236222 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:07:41.239804 23028 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:41.240788 11443 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:07:41.241112 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/ts-2-root
uuid: "8712fe9782134858a2b8c81ac5ed2892"
format_stamp: "Formatted at 2026-07-09 13:07:41 on dist-test-slave-qv7r"
I20260709 13:07:41.241384 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:41.267148 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:41.268422 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:41.270004 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:41.272213 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:41.272456 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:41.272701 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:41.272881 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:41.314651 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.195:33835
I20260709 13:07:41.314767 23090 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.195:33835 every 8 connection(s)
I20260709 13:07:41.329196 23091 heartbeater.cc:344] Connected to a master server at 127.11.44.254:39259
I20260709 13:07:41.329682 23091 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:41.330484 23091 heartbeater.cc:507] Master 127.11.44.254:39259 requested a full tablet report, sending...
I20260709 13:07:41.332518 22815 ts_manager.cc:194] Registered new tserver with Master: 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835)
I20260709 13:07:41.332697 11443 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014895197s
I20260709 13:07:41.334017 22815 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38484
I20260709 13:07:41.362584 22815 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38492:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:41.366310 22815 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:41.451289 23056 tablet_service.cc:1511] Processing CreateTablet for tablet c643046686fb47f082d3202d19e99f55 (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:41.451593 23055 tablet_service.cc:1511] Processing CreateTablet for tablet 931da8ce024c4309b094499863b4ecb4 (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:41.452890 23056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c643046686fb47f082d3202d19e99f55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.453538 23055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 931da8ce024c4309b094499863b4ecb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.455734 23054 tablet_service.cc:1511] Processing CreateTablet for tablet 17d619dbcbc4444dace0141307000b2c (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:41.457197 23054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d619dbcbc4444dace0141307000b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.462107 22980 tablet_service.cc:1511] Processing CreateTablet for tablet 17d619dbcbc4444dace0141307000b2c (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:41.463599 22980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d619dbcbc4444dace0141307000b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.466823 22982 tablet_service.cc:1511] Processing CreateTablet for tablet c643046686fb47f082d3202d19e99f55 (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:41.468212 22982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c643046686fb47f082d3202d19e99f55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.470804 22981 tablet_service.cc:1511] Processing CreateTablet for tablet 931da8ce024c4309b094499863b4ecb4 (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:41.472398 22981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 931da8ce024c4309b094499863b4ecb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.474067 22907 tablet_service.cc:1511] Processing CreateTablet for tablet c643046686fb47f082d3202d19e99f55 (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:07:41.475451 22907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c643046686fb47f082d3202d19e99f55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.478235 22979 tablet_service.cc:1511] Processing CreateTablet for tablet 2ae997940026470cac76b83d5491c0ba (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:41.480499 22979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ae997940026470cac76b83d5491c0ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.482004 23053 tablet_service.cc:1511] Processing CreateTablet for tablet 2ae997940026470cac76b83d5491c0ba (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:41.483405 23053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ae997940026470cac76b83d5491c0ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.492002 22906 tablet_service.cc:1511] Processing CreateTablet for tablet 931da8ce024c4309b094499863b4ecb4 (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:07:41.495410 22905 tablet_service.cc:1511] Processing CreateTablet for tablet 17d619dbcbc4444dace0141307000b2c (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:07:41.497323 22906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 931da8ce024c4309b094499863b4ecb4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.498929 22905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 17d619dbcbc4444dace0141307000b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.510979 22904 tablet_service.cc:1511] Processing CreateTablet for tablet 2ae997940026470cac76b83d5491c0ba (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:07:41.512503 22904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ae997940026470cac76b83d5491c0ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.514680 22903 tablet_service.cc:1511] Processing CreateTablet for tablet 65ddfcead8484b458d5ca3075bfbe97f (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:41.516146 22903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ddfcead8484b458d5ca3075bfbe97f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.540618 22979 tablet_service.cc:1511] Processing CreateTablet for tablet 65ddfcead8484b458d5ca3075bfbe97f (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:41.543491 23055 tablet_service.cc:1511] Processing CreateTablet for tablet 65ddfcead8484b458d5ca3075bfbe97f (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:07:41.544526 22902 tablet_service.cc:1511] Processing CreateTablet for tablet 824c55bd593d4fb9ab4252e1b22cd881 (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:41.546075 22902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 824c55bd593d4fb9ab4252e1b22cd881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.548132 22978 tablet_service.cc:1511] Processing CreateTablet for tablet 824c55bd593d4fb9ab4252e1b22cd881 (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:41.549551 23055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ddfcead8484b458d5ca3075bfbe97f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.550805 23106 tablet_bootstrap.cc:492] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892: Bootstrap starting.
I20260709 13:07:41.558405 22979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65ddfcead8484b458d5ca3075bfbe97f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.562562 22978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 824c55bd593d4fb9ab4252e1b22cd881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.578529 23056 tablet_service.cc:1511] Processing CreateTablet for tablet 824c55bd593d4fb9ab4252e1b22cd881 (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:07:41.580054 23056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 824c55bd593d4fb9ab4252e1b22cd881. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.590631 23107 tablet_bootstrap.cc:492] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190: Bootstrap starting.
I20260709 13:07:41.594973 23108 tablet_bootstrap.cc:492] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8: Bootstrap starting.
I20260709 13:07:41.600267 23106 tablet_bootstrap.cc:654] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.604629 22904 tablet_service.cc:1511] Processing CreateTablet for tablet 44a6701b259a4df5927d49d8981ec85d (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:41.606099 22904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44a6701b259a4df5927d49d8981ec85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.613605 22979 tablet_service.cc:1511] Processing CreateTablet for tablet 44a6701b259a4df5927d49d8981ec85d (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:41.615204 22979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44a6701b259a4df5927d49d8981ec85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.615018 23053 tablet_service.cc:1511] Processing CreateTablet for tablet 44a6701b259a4df5927d49d8981ec85d (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:07:41.616976 23053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44a6701b259a4df5927d49d8981ec85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.617554 23107 tablet_bootstrap.cc:654] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.632085 22978 tablet_service.cc:1511] Processing CreateTablet for tablet edd328834c134e679a16fbf39dc81dcc (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:41.633591 22978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edd328834c134e679a16fbf39dc81dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.635265 23055 tablet_service.cc:1511] Processing CreateTablet for tablet edd328834c134e679a16fbf39dc81dcc (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:41.636744 23055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edd328834c134e679a16fbf39dc81dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.639997 23108 tablet_bootstrap.cc:654] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.641265 22980 tablet_service.cc:1511] Processing CreateTablet for tablet 2d0900e9b1ac43b5a46b67f8ea23e57d (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:41.642728 22980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d0900e9b1ac43b5a46b67f8ea23e57d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.642663 22906 tablet_service.cc:1511] Processing CreateTablet for tablet edd328834c134e679a16fbf39dc81dcc (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:07:41.643311 22902 tablet_service.cc:1511] Processing CreateTablet for tablet 2d0900e9b1ac43b5a46b67f8ea23e57d (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:41.644129 22906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edd328834c134e679a16fbf39dc81dcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.644276 23056 tablet_service.cc:1511] Processing CreateTablet for tablet 2d0900e9b1ac43b5a46b67f8ea23e57d (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:07:41.645726 23056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d0900e9b1ac43b5a46b67f8ea23e57d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.648289 23107 tablet_bootstrap.cc:492] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190: No bootstrap required, opened a new log
I20260709 13:07:41.648876 23107 ts_tablet_manager.cc:1403] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.000s
I20260709 13:07:41.652025 23107 raft_consensus.cc:359] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:41.652778 23107 raft_consensus.cc:385] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.653102 23107 raft_consensus.cc:740] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.653934 22905 tablet_service.cc:1511] Processing CreateTablet for tablet b863e345da0d47fda8644fb182123601 (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:41.653967 22902 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d0900e9b1ac43b5a46b67f8ea23e57d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.659822 22905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b863e345da0d47fda8644fb182123601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.670543 23107 consensus_queue.cc:260] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:41.674535 23106 tablet_bootstrap.cc:492] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892: No bootstrap required, opened a new log
I20260709 13:07:41.675120 23106 ts_tablet_manager.cc:1403] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892: Time spent bootstrapping tablet: real 0.125s	user 0.017s	sys 0.003s
I20260709 13:07:41.693991 22980 tablet_service.cc:1511] Processing CreateTablet for tablet b863e345da0d47fda8644fb182123601 (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:41.695773 23017 heartbeater.cc:499] Master 127.11.44.254:39259 was elected leader, sending a full tablet report...
I20260709 13:07:41.696476 22980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b863e345da0d47fda8644fb182123601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.696101 23106 raft_consensus.cc:359] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:41.696579 23108 tablet_bootstrap.cc:492] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8: No bootstrap required, opened a new log
I20260709 13:07:41.696946 23106 raft_consensus.cc:385] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.697203 23108 ts_tablet_manager.cc:1403] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8: Time spent bootstrapping tablet: real 0.103s	user 0.010s	sys 0.005s
I20260709 13:07:41.697265 23106 raft_consensus.cc:740] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.699049 23106 consensus_queue.cc:260] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:41.701015 23112 raft_consensus.cc:493] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.701822 23112 raft_consensus.cc:515] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:41.700908 23108 raft_consensus.cc:359] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:41.706785 23108 raft_consensus.cc:385] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.708887 23108 raft_consensus.cc:740] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 695cc50fa39b4569b4248bab36962ab8, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.710036 23108 consensus_queue.cc:260] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:41.708096 23055 tablet_service.cc:1511] Processing CreateTablet for tablet b863e345da0d47fda8644fb182123601 (DEFAULT_TABLE table=test-workload [id=0d47f76252eb4da995eb1d47177b3431]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:07:41.711859 23055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b863e345da0d47fda8644fb182123601. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:41.725459 22917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d619dbcbc4444dace0141307000b2c" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695cc50fa39b4569b4248bab36962ab8" is_pre_election: true
W20260709 13:07:41.727953 22956 leader_election.cc:343] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.740675 23107 ts_tablet_manager.cc:1434] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190: Time spent starting tablet: real 0.091s	user 0.009s	sys 0.018s
I20260709 13:07:41.741706 23112 leader_election.cc:290] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835)
I20260709 13:07:41.746357 23106 ts_tablet_manager.cc:1434] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892: Time spent starting tablet: real 0.071s	user 0.020s	sys 0.028s
I20260709 13:07:41.747390 23091 heartbeater.cc:499] Master 127.11.44.254:39259 was elected leader, sending a full tablet report...
I20260709 13:07:41.747727 23106 tablet_bootstrap.cc:492] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892: Bootstrap starting.
I20260709 13:07:41.747917 23107 tablet_bootstrap.cc:492] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190: Bootstrap starting.
I20260709 13:07:41.757738 22942 heartbeater.cc:499] Master 127.11.44.254:39259 was elected leader, sending a full tablet report...
I20260709 13:07:41.774214 23106 tablet_bootstrap.cc:654] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.775166 23108 ts_tablet_manager.cc:1434] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8: Time spent starting tablet: real 0.077s	user 0.016s	sys 0.021s
I20260709 13:07:41.776608 23108 tablet_bootstrap.cc:492] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8: Bootstrap starting.
I20260709 13:07:41.783824 23108 tablet_bootstrap.cc:654] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.796432 23108 tablet_bootstrap.cc:492] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8: No bootstrap required, opened a new log
I20260709 13:07:41.797173 23107 tablet_bootstrap.cc:654] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.797231 23108 ts_tablet_manager.cc:1403] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.001s
I20260709 13:07:41.801205 23108 raft_consensus.cc:359] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } }
I20260709 13:07:41.802145 23108 raft_consensus.cc:385] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.802562 23108 raft_consensus.cc:740] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 695cc50fa39b4569b4248bab36962ab8, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.804422 23108 consensus_queue.cc:260] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } }
I20260709 13:07:41.807392 23066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d619dbcbc4444dace0141307000b2c" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8712fe9782134858a2b8c81ac5ed2892" is_pre_election: true
I20260709 13:07:41.808043 23108 ts_tablet_manager.cc:1434] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:07:41.808211 23066 raft_consensus.cc:2468] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 0.
I20260709 13:07:41.809538 23108 tablet_bootstrap.cc:492] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8: Bootstrap starting.
I20260709 13:07:41.809998 22957 leader_election.cc:304] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 8712fe9782134858a2b8c81ac5ed2892; no voters: 695cc50fa39b4569b4248bab36962ab8
I20260709 13:07:41.811290 23112 raft_consensus.cc:2804] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:41.811676 23112 raft_consensus.cc:493] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.811983 23112 raft_consensus.cc:3060] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:41.818959 23092 tablet.cc:2406] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:07:41.820452 23108 tablet_bootstrap.cc:654] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.821763 23107 tablet_bootstrap.cc:492] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190: No bootstrap required, opened a new log
I20260709 13:07:41.821460 23112 raft_consensus.cc:515] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:41.822309 23107 ts_tablet_manager.cc:1403] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190: Time spent bootstrapping tablet: real 0.075s	user 0.008s	sys 0.006s
I20260709 13:07:41.822490 23106 tablet_bootstrap.cc:492] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892: No bootstrap required, opened a new log
I20260709 13:07:41.823045 23106 ts_tablet_manager.cc:1403] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892: Time spent bootstrapping tablet: real 0.076s	user 0.039s	sys 0.031s
I20260709 13:07:41.824724 22917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d619dbcbc4444dace0141307000b2c" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695cc50fa39b4569b4248bab36962ab8"
I20260709 13:07:41.825928 23107 raft_consensus.cc:359] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
W20260709 13:07:41.826508 22956 leader_election.cc:343] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.827137 23107 raft_consensus.cc:385] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.827754 23107 raft_consensus.cc:740] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.828012 23106 raft_consensus.cc:359] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } }
I20260709 13:07:41.829129 23106 raft_consensus.cc:385] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.829821 23066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d619dbcbc4444dace0141307000b2c" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8712fe9782134858a2b8c81ac5ed2892"
I20260709 13:07:41.829898 23106 raft_consensus.cc:740] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.830842 23066 raft_consensus.cc:3060] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.831418 23106 consensus_queue.cc:260] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } }
I20260709 13:07:41.829075 23107 consensus_queue.cc:260] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:41.836678 23106 ts_tablet_manager.cc:1434] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.004s
I20260709 13:07:41.838047 23106 tablet_bootstrap.cc:492] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892: Bootstrap starting.
I20260709 13:07:41.837307 23112 leader_election.cc:290] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 1 election: Requested vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835)
I20260709 13:07:41.847712 23106 tablet_bootstrap.cc:654] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.850907 23107 ts_tablet_manager.cc:1434] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.003s
I20260709 13:07:41.852517 23107 tablet_bootstrap.cc:492] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190: Bootstrap starting.
I20260709 13:07:41.852517 23066 raft_consensus.cc:2468] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 1.
I20260709 13:07:41.854367 22957 leader_election.cc:304] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 8712fe9782134858a2b8c81ac5ed2892; no voters: 695cc50fa39b4569b4248bab36962ab8
I20260709 13:07:41.861418 23107 tablet_bootstrap.cc:654] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.862372 23106 tablet_bootstrap.cc:492] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892: No bootstrap required, opened a new log
I20260709 13:07:41.863196 23106 ts_tablet_manager.cc:1403] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.004s
I20260709 13:07:41.866529 23112 raft_consensus.cc:2804] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:41.867385 23112 raft_consensus.cc:697] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 1 LEADER]: Becoming Leader. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Running, Role: LEADER
I20260709 13:07:41.868094 23106 raft_consensus.cc:359] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:41.869388 23106 raft_consensus.cc:385] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.870044 23106 raft_consensus.cc:740] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.868741 23112 consensus_queue.cc:237] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:41.871459 23106 consensus_queue.cc:260] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:41.877233 23106 ts_tablet_manager.cc:1434] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.005s
I20260709 13:07:41.878511 23106 tablet_bootstrap.cc:492] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892: Bootstrap starting.
I20260709 13:07:41.878649 23108 tablet_bootstrap.cc:492] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8: No bootstrap required, opened a new log
I20260709 13:07:41.879261 23108 ts_tablet_manager.cc:1403] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.040s
I20260709 13:07:41.882673 23108 raft_consensus.cc:359] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:41.883746 23108 raft_consensus.cc:385] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.884080 23108 raft_consensus.cc:740] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 695cc50fa39b4569b4248bab36962ab8, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.885022 23108 consensus_queue.cc:260] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:41.886632 23106 tablet_bootstrap.cc:654] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.891131 23107 tablet_bootstrap.cc:492] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190: No bootstrap required, opened a new log
I20260709 13:07:41.891785 23107 ts_tablet_manager.cc:1403] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190: Time spent bootstrapping tablet: real 0.040s	user 0.028s	sys 0.008s
I20260709 13:07:41.897030 23108 ts_tablet_manager.cc:1434] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:07:41.896358 22815 catalog_manager.cc:5697] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 reported cstate change: term changed from 0 to 1, leader changed from <none> to 116cbc3b8350497e9898dca20692f190 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "116cbc3b8350497e9898dca20692f190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.898195 23108 tablet_bootstrap.cc:492] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8: Bootstrap starting.
I20260709 13:07:41.899000 23106 tablet_bootstrap.cc:492] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892: No bootstrap required, opened a new log
I20260709 13:07:41.899572 23106 ts_tablet_manager.cc:1403] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.009s
I20260709 13:07:41.900332 23107 raft_consensus.cc:359] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:41.901096 23107 raft_consensus.cc:385] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.901412 23107 raft_consensus.cc:740] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.904136 23107 consensus_queue.cc:260] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:41.906642 23107 ts_tablet_manager.cc:1434] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:07:41.907116 23108 tablet_bootstrap.cc:654] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.907613 23107 tablet_bootstrap.cc:492] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190: Bootstrap starting.
I20260709 13:07:41.908548 23106 raft_consensus.cc:359] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:41.909366 23106 raft_consensus.cc:385] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.909680 23106 raft_consensus.cc:740] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.909689 23114 raft_consensus.cc:493] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.910578 23114 raft_consensus.cc:515] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:41.910913 23106 consensus_queue.cc:260] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:41.914434 23114 leader_election.cc:290] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067), 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835)
W20260709 13:07:41.922000 22863 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:41.922566 23113 raft_consensus.cc:493] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.923233 23113 raft_consensus.cc:515] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } }
I20260709 13:07:41.927349 23113 leader_election.cc:290] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067), 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907)
I20260709 13:07:41.935401 23106 ts_tablet_manager.cc:1434] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.005s
I20260709 13:07:41.937175 23114 raft_consensus.cc:493] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.938783 23114 raft_consensus.cc:515] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } }
I20260709 13:07:41.943813 23106 tablet_bootstrap.cc:492] T 65ddfcead8484b458d5ca3075bfbe97f P 8712fe9782134858a2b8c81ac5ed2892: Bootstrap starting.
I20260709 13:07:41.944782 23114 leader_election.cc:290] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835), 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067)
I20260709 13:07:41.949693 23107 tablet_bootstrap.cc:654] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.952418 23108 tablet_bootstrap.cc:492] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8: No bootstrap required, opened a new log
I20260709 13:07:41.953066 23108 ts_tablet_manager.cc:1403] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8: Time spent bootstrapping tablet: real 0.055s	user 0.019s	sys 0.015s
I20260709 13:07:41.955948 23106 tablet_bootstrap.cc:654] T 65ddfcead8484b458d5ca3075bfbe97f P 8712fe9782134858a2b8c81ac5ed2892: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:41.962107 23066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ddfcead8484b458d5ca3075bfbe97f" candidate_uuid: "695cc50fa39b4569b4248bab36962ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8712fe9782134858a2b8c81ac5ed2892" is_pre_election: true
I20260709 13:07:41.963609 23065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c643046686fb47f082d3202d19e99f55" candidate_uuid: "695cc50fa39b4569b4248bab36962ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8712fe9782134858a2b8c81ac5ed2892" is_pre_election: true
I20260709 13:07:41.964349 23065 raft_consensus.cc:2468] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 695cc50fa39b4569b4248bab36962ab8 in term 0.
W20260709 13:07:41.965881 22882 leader_election.cc:343] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.967833 22882 leader_election.cc:304] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 695cc50fa39b4569b4248bab36962ab8, 8712fe9782134858a2b8c81ac5ed2892; no voters: 
I20260709 13:07:41.968783 23114 raft_consensus.cc:2804] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:41.969170 23114 raft_consensus.cc:493] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.965919 23108 raft_consensus.cc:359] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:41.969538 23114 raft_consensus.cc:3060] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.969702 23108 raft_consensus.cc:385] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.970176 23108 raft_consensus.cc:740] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 695cc50fa39b4569b4248bab36962ab8, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.971174 23108 consensus_queue.cc:260] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:41.978008 23107 tablet_bootstrap.cc:492] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190: No bootstrap required, opened a new log
I20260709 13:07:41.978957 23106 tablet_bootstrap.cc:492] T 65ddfcead8484b458d5ca3075bfbe97f P 8712fe9782134858a2b8c81ac5ed2892: No bootstrap required, opened a new log
I20260709 13:07:41.984257 23107 ts_tablet_manager.cc:1403] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190: Time spent bootstrapping tablet: real 0.077s	user 0.022s	sys 0.012s
I20260709 13:07:41.984686 22992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c643046686fb47f082d3202d19e99f55" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116cbc3b8350497e9898dca20692f190" is_pre_election: true
I20260709 13:07:41.979516 23114 raft_consensus.cc:515] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } }
I20260709 13:07:41.984341 23106 ts_tablet_manager.cc:1403] T 65ddfcead8484b458d5ca3075bfbe97f P 8712fe9782134858a2b8c81ac5ed2892: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.015s
I20260709 13:07:41.985962 22991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ddfcead8484b458d5ca3075bfbe97f" candidate_uuid: "695cc50fa39b4569b4248bab36962ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116cbc3b8350497e9898dca20692f190" is_pre_election: true
I20260709 13:07:41.987679 22990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c643046686fb47f082d3202d19e99f55" candidate_uuid: "695cc50fa39b4569b4248bab36962ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116cbc3b8350497e9898dca20692f190" is_pre_election: true
I20260709 13:07:41.988024 23107 raft_consensus.cc:359] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } }
I20260709 13:07:41.988940 23107 raft_consensus.cc:385] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.989312 23107 raft_consensus.cc:740] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Initialized, Role: FOLLOWER
W20260709 13:07:41.989699 22880 leader_election.cc:343] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:41.989475 23106 raft_consensus.cc:359] T 65ddfcead8484b458d5ca3075bfbe97f P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:41.990428 23114 leader_election.cc:290] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [CANDIDATE]: Term 1 election: Requested vote from peers 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835), 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067)
I20260709 13:07:41.990840 23065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c643046686fb47f082d3202d19e99f55" candidate_uuid: "695cc50fa39b4569b4248bab36962ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8712fe9782134858a2b8c81ac5ed2892"
I20260709 13:07:41.990272 23107 consensus_queue.cc:260] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } }
I20260709 13:07:41.991477 23065 raft_consensus.cc:3060] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:41.993144 23107 ts_tablet_manager.cc:1434] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:07:41.993367 22992 raft_consensus.cc:2468] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 0.
I20260709 13:07:41.990224 22880 leader_election.cc:304] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 695cc50fa39b4569b4248bab36962ab8; no voters: 116cbc3b8350497e9898dca20692f190, 8712fe9782134858a2b8c81ac5ed2892
I20260709 13:07:41.994316 23107 tablet_bootstrap.cc:492] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190: Bootstrap starting.
I20260709 13:07:41.990339 23106 raft_consensus.cc:385] T 65ddfcead8484b458d5ca3075bfbe97f P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:41.997283 23106 raft_consensus.cc:740] T 65ddfcead8484b458d5ca3075bfbe97f P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Initialized, Role: FOLLOWER
I20260709 13:07:41.998188 23106 consensus_queue.cc:260] T 65ddfcead8484b458d5ca3075bfbe97f P 8712fe9782134858a2b8c81ac5ed2892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:41.998265 22917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c643046686fb47f082d3202d19e99f55" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695cc50fa39b4569b4248bab36962ab8" is_pre_election: true
I20260709 13:07:41.999430 22917 raft_consensus.cc:2393] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8712fe9782134858a2b8c81ac5ed2892 in current term 1: Already voted for candidate 695cc50fa39b4569b4248bab36962ab8 in this term.
I20260709 13:07:42.001367 22990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c643046686fb47f082d3202d19e99f55" candidate_uuid: "695cc50fa39b4569b4248bab36962ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116cbc3b8350497e9898dca20692f190"
I20260709 13:07:42.001997 23107 tablet_bootstrap.cc:654] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.002055 22990 raft_consensus.cc:3060] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.002776 23029 leader_election.cc:304] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 8712fe9782134858a2b8c81ac5ed2892; no voters: 695cc50fa39b4569b4248bab36962ab8
I20260709 13:07:42.004495 23114 raft_consensus.cc:2749] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:42.008564 23106 ts_tablet_manager.cc:1434] T 65ddfcead8484b458d5ca3075bfbe97f P 8712fe9782134858a2b8c81ac5ed2892: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:07:42.011080 23108 ts_tablet_manager.cc:1434] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8: Time spent starting tablet: real 0.054s	user 0.013s	sys 0.000s
I20260709 13:07:42.012279 23108 tablet_bootstrap.cc:492] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8: Bootstrap starting.
I20260709 13:07:42.020757 23108 tablet_bootstrap.cc:654] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.021585 23107 tablet_bootstrap.cc:492] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190: No bootstrap required, opened a new log
I20260709 13:07:42.021919 23106 tablet_bootstrap.cc:492] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892: Bootstrap starting.
I20260709 13:07:42.022307 23107 ts_tablet_manager.cc:1403] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190: Time spent bootstrapping tablet: real 0.028s	user 0.022s	sys 0.004s
I20260709 13:07:42.025483 23107 raft_consensus.cc:359] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.026145 23065 raft_consensus.cc:2468] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 695cc50fa39b4569b4248bab36962ab8 in term 1.
I20260709 13:07:42.026360 23107 raft_consensus.cc:385] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.026803 23107 raft_consensus.cc:740] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.027871 22882 leader_election.cc:304] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 695cc50fa39b4569b4248bab36962ab8, 8712fe9782134858a2b8c81ac5ed2892; no voters: 
I20260709 13:07:42.027940 23107 consensus_queue.cc:260] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.030556 23106 tablet_bootstrap.cc:654] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.031345 23107 ts_tablet_manager.cc:1434] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:07:42.031859 23132 raft_consensus.cc:2804] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.032580 23107 tablet_bootstrap.cc:492] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190: Bootstrap starting.
I20260709 13:07:42.032418 22990 raft_consensus.cc:2468] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 695cc50fa39b4569b4248bab36962ab8 in term 1.
I20260709 13:07:42.026795 23113 raft_consensus.cc:2764] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:07:42.032490 23132 raft_consensus.cc:697] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [term 1 LEADER]: Becoming Leader. State: Replica: 695cc50fa39b4569b4248bab36962ab8, State: Running, Role: LEADER
I20260709 13:07:42.038226 23132 consensus_queue.cc:237] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } }
I20260709 13:07:42.040107 23107 tablet_bootstrap.cc:654] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.042760 23106 tablet_bootstrap.cc:492] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892: No bootstrap required, opened a new log
I20260709 13:07:42.043496 23106 ts_tablet_manager.cc:1403] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.011s
I20260709 13:07:42.047986 23106 raft_consensus.cc:359] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.051097 23106 raft_consensus.cc:385] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.051851 23106 raft_consensus.cc:740] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.052846 23106 consensus_queue.cc:260] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.055820 23106 ts_tablet_manager.cc:1434] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:07:42.056051 23108 tablet_bootstrap.cc:492] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8: No bootstrap required, opened a new log
I20260709 13:07:42.056676 23112 raft_consensus.cc:493] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.056945 23106 tablet_bootstrap.cc:492] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892: Bootstrap starting.
I20260709 13:07:42.057395 23112 raft_consensus.cc:515] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.056705 22815 catalog_manager.cc:5697] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "695cc50fa39b4569b4248bab36962ab8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.060943 23065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931da8ce024c4309b094499863b4ecb4" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8712fe9782134858a2b8c81ac5ed2892" is_pre_election: true
I20260709 13:07:42.061640 23065 raft_consensus.cc:2468] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 0.
I20260709 13:07:42.064148 23106 tablet_bootstrap.cc:654] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.064934 22917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931da8ce024c4309b094499863b4ecb4" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695cc50fa39b4569b4248bab36962ab8" is_pre_election: true
I20260709 13:07:42.066955 22957 leader_election.cc:304] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 8712fe9782134858a2b8c81ac5ed2892; no voters: 
I20260709 13:07:42.067878 23119 raft_consensus.cc:2804] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.068295 23119 raft_consensus.cc:493] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.068612 23119 raft_consensus.cc:3060] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.070066 23112 leader_election.cc:290] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835)
I20260709 13:07:42.071043 23107 tablet_bootstrap.cc:492] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190: No bootstrap required, opened a new log
I20260709 13:07:42.071105 23113 raft_consensus.cc:493] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.073982 23107 ts_tablet_manager.cc:1403] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.015s
I20260709 13:07:42.074003 23108 ts_tablet_manager.cc:1403] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.007s
I20260709 13:07:42.073827 23113 raft_consensus.cc:515] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.076053 23113 leader_election.cc:290] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067)
W20260709 13:07:42.076678 22956 leader_election.cc:343] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.076825 23107 raft_consensus.cc:359] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.076959 22917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824c55bd593d4fb9ab4252e1b22cd881" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695cc50fa39b4569b4248bab36962ab8" is_pre_election: true
I20260709 13:07:42.077595 23107 raft_consensus.cc:385] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.077999 23107 raft_consensus.cc:740] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.078325 22990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824c55bd593d4fb9ab4252e1b22cd881" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116cbc3b8350497e9898dca20692f190" is_pre_election: true
W20260709 13:07:42.078852 23030 leader_election.cc:343] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.078987 23107 consensus_queue.cc:260] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.079569 23119 raft_consensus.cc:515] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.080034 22990 raft_consensus.cc:2468] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 0.
I20260709 13:07:42.081277 23108 raft_consensus.cc:359] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.082118 23108 raft_consensus.cc:385] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.082207 23107 ts_tablet_manager.cc:1434] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:42.082530 23108 raft_consensus.cc:740] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 695cc50fa39b4569b4248bab36962ab8, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.082757 23106 tablet_bootstrap.cc:492] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892: No bootstrap required, opened a new log
I20260709 13:07:42.082922 23029 leader_election.cc:304] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 8712fe9782134858a2b8c81ac5ed2892; no voters: 695cc50fa39b4569b4248bab36962ab8
I20260709 13:07:42.083429 23107 tablet_bootstrap.cc:492] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190: Bootstrap starting.
I20260709 13:07:42.083546 23108 consensus_queue.cc:260] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.083781 23113 raft_consensus.cc:2804] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.091029 23113 raft_consensus.cc:493] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.091518 23113 raft_consensus.cc:3060] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.092396 22917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931da8ce024c4309b094499863b4ecb4" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695cc50fa39b4569b4248bab36962ab8"
I20260709 13:07:42.093662 23119 leader_election.cc:290] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 1 election: Requested vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835)
I20260709 13:07:42.094767 23065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931da8ce024c4309b094499863b4ecb4" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8712fe9782134858a2b8c81ac5ed2892"
I20260709 13:07:42.095414 23065 raft_consensus.cc:3060] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.083376 23106 ts_tablet_manager.cc:1403] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.006s
I20260709 13:07:42.097812 22917 raft_consensus.cc:3060] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.098497 23107 tablet_bootstrap.cc:654] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.099107 23106 raft_consensus.cc:359] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.099952 23106 raft_consensus.cc:385] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.100246 23106 raft_consensus.cc:740] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.101013 23106 consensus_queue.cc:260] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.105337 22917 raft_consensus.cc:2468] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 1.
I20260709 13:07:42.107342 22956 leader_election.cc:304] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 695cc50fa39b4569b4248bab36962ab8; no voters: 
I20260709 13:07:42.108032 23065 raft_consensus.cc:2468] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 1.
I20260709 13:07:42.108505 23119 raft_consensus.cc:2804] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.109809 23119 raft_consensus.cc:697] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [term 1 LEADER]: Becoming Leader. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Running, Role: LEADER
I20260709 13:07:42.110565 23119 consensus_queue.cc:237] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.111845 23107 tablet_bootstrap.cc:492] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190: No bootstrap required, opened a new log
I20260709 13:07:42.112505 23107 ts_tablet_manager.cc:1403] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.012s
I20260709 13:07:42.112885 23106 ts_tablet_manager.cc:1434] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.008s
I20260709 13:07:42.114365 23106 tablet_bootstrap.cc:492] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892: Bootstrap starting.
I20260709 13:07:42.115795 23107 raft_consensus.cc:359] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.116605 23107 raft_consensus.cc:385] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.116937 23107 raft_consensus.cc:740] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.117022 23113 raft_consensus.cc:515] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.117892 23107 consensus_queue.cc:260] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.120249 23107 ts_tablet_manager.cc:1434] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:07:42.120390 22990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824c55bd593d4fb9ab4252e1b22cd881" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116cbc3b8350497e9898dca20692f190"
I20260709 13:07:42.121059 22990 raft_consensus.cc:3060] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.121506 23107 tablet_bootstrap.cc:492] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 116cbc3b8350497e9898dca20692f190: Bootstrap starting.
I20260709 13:07:42.122159 22917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824c55bd593d4fb9ab4252e1b22cd881" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695cc50fa39b4569b4248bab36962ab8"
I20260709 13:07:42.123095 23108 ts_tablet_manager.cc:1434] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.001s
W20260709 13:07:42.123412 23030 leader_election.cc:343] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.129288 23106 tablet_bootstrap.cc:654] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.129307 23107 tablet_bootstrap.cc:654] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 116cbc3b8350497e9898dca20692f190: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.132577 23108 tablet_bootstrap.cc:492] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8: Bootstrap starting.
I20260709 13:07:42.138845 22990 raft_consensus.cc:2468] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 1.
I20260709 13:07:42.138906 23113 leader_election.cc:290] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 1 election: Requested vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067)
I20260709 13:07:42.143908 23029 leader_election.cc:304] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 8712fe9782134858a2b8c81ac5ed2892; no voters: 695cc50fa39b4569b4248bab36962ab8
I20260709 13:07:42.145190 23113 raft_consensus.cc:2804] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.145416 23107 tablet_bootstrap.cc:492] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 116cbc3b8350497e9898dca20692f190: No bootstrap required, opened a new log
I20260709 13:07:42.145731 23113 raft_consensus.cc:697] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 LEADER]: Becoming Leader. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Running, Role: LEADER
I20260709 13:07:42.146162 23107 ts_tablet_manager.cc:1403] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 116cbc3b8350497e9898dca20692f190: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.007s
I20260709 13:07:42.147017 23108 tablet_bootstrap.cc:654] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.146770 23113 consensus_queue.cc:237] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.146538 22814 catalog_manager.cc:5697] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 reported cstate change: term changed from 0 to 1, leader changed from <none> to 116cbc3b8350497e9898dca20692f190 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "116cbc3b8350497e9898dca20692f190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.149369 23107 raft_consensus.cc:359] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.150180 23107 raft_consensus.cc:385] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.150488 23107 raft_consensus.cc:740] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.150765 23106 tablet_bootstrap.cc:492] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892: No bootstrap required, opened a new log
I20260709 13:07:42.151247 23106 ts_tablet_manager.cc:1403] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892: Time spent bootstrapping tablet: real 0.037s	user 0.009s	sys 0.008s
I20260709 13:07:42.151268 23107 consensus_queue.cc:260] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 116cbc3b8350497e9898dca20692f190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.153482 23107 ts_tablet_manager.cc:1434] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 116cbc3b8350497e9898dca20692f190: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:42.153992 23106 raft_consensus.cc:359] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.154475 23107 tablet_bootstrap.cc:492] T 44a6701b259a4df5927d49d8981ec85d P 116cbc3b8350497e9898dca20692f190: Bootstrap starting.
I20260709 13:07:42.154680 23106 raft_consensus.cc:385] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.155010 23106 raft_consensus.cc:740] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.158836 23106 consensus_queue.cc:260] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.161307 23107 tablet_bootstrap.cc:654] T 44a6701b259a4df5927d49d8981ec85d P 116cbc3b8350497e9898dca20692f190: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.162413 23106 ts_tablet_manager.cc:1434] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:07:42.163398 23106 tablet_bootstrap.cc:492] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892: Bootstrap starting.
I20260709 13:07:42.169832 22814 catalog_manager.cc:5697] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "8712fe9782134858a2b8c81ac5ed2892" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.180962 23106 tablet_bootstrap.cc:654] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.188701 23107 tablet_bootstrap.cc:492] T 44a6701b259a4df5927d49d8981ec85d P 116cbc3b8350497e9898dca20692f190: No bootstrap required, opened a new log
I20260709 13:07:42.189297 23107 ts_tablet_manager.cc:1403] T 44a6701b259a4df5927d49d8981ec85d P 116cbc3b8350497e9898dca20692f190: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.014s
I20260709 13:07:42.191318 23108 tablet_bootstrap.cc:492] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8: No bootstrap required, opened a new log
I20260709 13:07:42.192155 23108 ts_tablet_manager.cc:1403] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8: Time spent bootstrapping tablet: real 0.060s	user 0.029s	sys 0.013s
I20260709 13:07:42.192301 23107 raft_consensus.cc:359] T 44a6701b259a4df5927d49d8981ec85d P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.193364 23107 raft_consensus.cc:385] T 44a6701b259a4df5927d49d8981ec85d P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.193778 23107 raft_consensus.cc:740] T 44a6701b259a4df5927d49d8981ec85d P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.194882 23107 consensus_queue.cc:260] T 44a6701b259a4df5927d49d8981ec85d P 116cbc3b8350497e9898dca20692f190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.196238 23108 raft_consensus.cc:359] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.197041 23108 raft_consensus.cc:385] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.197422 23108 raft_consensus.cc:740] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 695cc50fa39b4569b4248bab36962ab8, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.197438 23107 ts_tablet_manager.cc:1434] T 44a6701b259a4df5927d49d8981ec85d P 116cbc3b8350497e9898dca20692f190: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:42.198585 23107 tablet_bootstrap.cc:492] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190: Bootstrap starting.
I20260709 13:07:42.198433 23108 consensus_queue.cc:260] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.201128 23108 ts_tablet_manager.cc:1434] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 13:07:42.202229 23108 tablet_bootstrap.cc:492] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8: Bootstrap starting.
I20260709 13:07:42.205402 23106 tablet_bootstrap.cc:492] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892: No bootstrap required, opened a new log
I20260709 13:07:42.214285 23106 ts_tablet_manager.cc:1403] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.009s
I20260709 13:07:42.214442 23107 tablet_bootstrap.cc:654] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.217352 23108 tablet_bootstrap.cc:654] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.217854 23106 raft_consensus.cc:359] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.218705 23106 raft_consensus.cc:385] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.219031 23106 raft_consensus.cc:740] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.219803 23106 consensus_queue.cc:260] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.220271 23107 tablet_bootstrap.cc:492] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190: No bootstrap required, opened a new log
I20260709 13:07:42.221026 23107 ts_tablet_manager.cc:1403] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.015s
I20260709 13:07:42.222167 23106 ts_tablet_manager.cc:1434] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:07:42.223286 23106 tablet_bootstrap.cc:492] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892: Bootstrap starting.
I20260709 13:07:42.223544 23107 raft_consensus.cc:359] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.224462 23107 raft_consensus.cc:385] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.224761 23107 raft_consensus.cc:740] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.224923 23108 tablet_bootstrap.cc:492] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8: No bootstrap required, opened a new log
I20260709 13:07:42.225660 23107 consensus_queue.cc:260] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.227833 23107 ts_tablet_manager.cc:1434] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:07:42.229552 23106 tablet_bootstrap.cc:654] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.225499 23108 ts_tablet_manager.cc:1403] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.002s
I20260709 13:07:42.233479 23108 raft_consensus.cc:359] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.234867 23108 raft_consensus.cc:385] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.235306 23108 raft_consensus.cc:740] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 695cc50fa39b4569b4248bab36962ab8, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.236438 23108 consensus_queue.cc:260] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.239658 23108 ts_tablet_manager.cc:1434] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:07:42.240720 23108 tablet_bootstrap.cc:492] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8: Bootstrap starting.
I20260709 13:07:42.242038 23106 tablet_bootstrap.cc:492] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892: No bootstrap required, opened a new log
I20260709 13:07:42.242589 23106 ts_tablet_manager.cc:1403] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.003s
I20260709 13:07:42.242766 23132 raft_consensus.cc:493] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.243537 23132 raft_consensus.cc:515] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.245757 23106 raft_consensus.cc:359] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.246539 23106 raft_consensus.cc:385] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.246811 23106 raft_consensus.cc:740] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.247463 23065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824c55bd593d4fb9ab4252e1b22cd881" candidate_uuid: "695cc50fa39b4569b4248bab36962ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8712fe9782134858a2b8c81ac5ed2892" is_pre_election: true
I20260709 13:07:42.247574 23106 consensus_queue.cc:260] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.248821 22990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824c55bd593d4fb9ab4252e1b22cd881" candidate_uuid: "695cc50fa39b4569b4248bab36962ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116cbc3b8350497e9898dca20692f190" is_pre_election: true
I20260709 13:07:42.249748 22990 raft_consensus.cc:2393] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 695cc50fa39b4569b4248bab36962ab8 in current term 1: Already voted for candidate 8712fe9782134858a2b8c81ac5ed2892 in this term.
I20260709 13:07:42.250425 23132 leader_election.cc:290] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067), 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835)
I20260709 13:07:42.249696 23108 tablet_bootstrap.cc:654] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.251214 22880 leader_election.cc:304] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 695cc50fa39b4569b4248bab36962ab8; no voters: 116cbc3b8350497e9898dca20692f190, 8712fe9782134858a2b8c81ac5ed2892
I20260709 13:07:42.253003 23106 ts_tablet_manager.cc:1434] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:07:42.256057 23113 raft_consensus.cc:493] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.256371 23140 raft_consensus.cc:493] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.256615 23113 raft_consensus.cc:515] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.256938 23140 raft_consensus.cc:515] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.259135 23140 leader_election.cc:290] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067)
I20260709 13:07:42.259183 23113 leader_election.cc:290] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067)
I20260709 13:07:42.259615 23119 raft_consensus.cc:493] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.260002 23119 raft_consensus.cc:515] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.261770 22917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0900e9b1ac43b5a46b67f8ea23e57d" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695cc50fa39b4569b4248bab36962ab8" is_pre_election: true
I20260709 13:07:42.262075 22916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae997940026470cac76b83d5491c0ba" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695cc50fa39b4569b4248bab36962ab8" is_pre_election: true
I20260709 13:07:42.262344 23119 leader_election.cc:290] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835)
I20260709 13:07:42.262895 23108 tablet_bootstrap.cc:492] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8: No bootstrap required, opened a new log
I20260709 13:07:42.262859 22916 raft_consensus.cc:2468] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 0.
I20260709 13:07:42.263573 23108 ts_tablet_manager.cc:1403] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.000s
I20260709 13:07:42.261234 22990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae997940026470cac76b83d5491c0ba" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116cbc3b8350497e9898dca20692f190" is_pre_election: true
W20260709 13:07:42.263446 23030 leader_election.cc:343] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.264266 22990 raft_consensus.cc:2468] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 0.
I20260709 13:07:42.264789 23030 leader_election.cc:304] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 695cc50fa39b4569b4248bab36962ab8, 8712fe9782134858a2b8c81ac5ed2892; no voters: 
I20260709 13:07:42.262946 23114 raft_consensus.cc:3060] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.265921 23113 raft_consensus.cc:2804] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.267179 23113 raft_consensus.cc:493] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.267580 23113 raft_consensus.cc:3060] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.267418 23108 raft_consensus.cc:359] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.268137 23108 raft_consensus.cc:385] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.268432 23108 raft_consensus.cc:740] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 695cc50fa39b4569b4248bab36962ab8, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.269135 23108 consensus_queue.cc:260] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.265867 23065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae997940026470cac76b83d5491c0ba" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8712fe9782134858a2b8c81ac5ed2892" is_pre_election: true
I20260709 13:07:42.270411 22916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae997940026470cac76b83d5491c0ba" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695cc50fa39b4569b4248bab36962ab8" is_pre_election: true
I20260709 13:07:42.271312 22916 raft_consensus.cc:2468] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 0.
I20260709 13:07:42.273290 22956 leader_election.cc:304] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 695cc50fa39b4569b4248bab36962ab8; no voters: 
I20260709 13:07:42.274585 23112 raft_consensus.cc:2804] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.275099 23112 raft_consensus.cc:493] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.275978 23112 raft_consensus.cc:3060] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.279371 23108 ts_tablet_manager.cc:1434] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8: Time spent starting tablet: real 0.015s	user 0.015s	sys 0.001s
I20260709 13:07:42.280483 23140 raft_consensus.cc:493] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.280742 23108 tablet_bootstrap.cc:492] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8: Bootstrap starting.
I20260709 13:07:42.281050 23140 raft_consensus.cc:515] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.282204 23119 consensus_queue.cc:1048] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:42.283393 23140 leader_election.cc:290] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067)
I20260709 13:07:42.287132 23108 tablet_bootstrap.cc:654] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.287704 23114 raft_consensus.cc:2749] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:42.288924 22990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0900e9b1ac43b5a46b67f8ea23e57d" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116cbc3b8350497e9898dca20692f190" is_pre_election: true
I20260709 13:07:42.289672 22990 raft_consensus.cc:2468] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 0.
I20260709 13:07:42.292798 23029 leader_election.cc:304] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 8712fe9782134858a2b8c81ac5ed2892; no voters: 695cc50fa39b4569b4248bab36962ab8
I20260709 13:07:42.294668 22990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a6701b259a4df5927d49d8981ec85d" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116cbc3b8350497e9898dca20692f190" is_pre_election: true
I20260709 13:07:42.295632 22990 raft_consensus.cc:2468] T 44a6701b259a4df5927d49d8981ec85d P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 0.
I20260709 13:07:42.297948 22916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a6701b259a4df5927d49d8981ec85d" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695cc50fa39b4569b4248bab36962ab8" is_pre_election: true
I20260709 13:07:42.299459 23140 raft_consensus.cc:2804] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:07:42.299508 23030 leader_election.cc:343] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:42.300068 23140 raft_consensus.cc:493] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.300563 23140 raft_consensus.cc:3060] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.303642 23113 raft_consensus.cc:515] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.305280 23065 raft_consensus.cc:2393] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 116cbc3b8350497e9898dca20692f190 in current term 1: Already voted for candidate 8712fe9782134858a2b8c81ac5ed2892 in this term.
I20260709 13:07:42.309855 23112 raft_consensus.cc:515] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.311786 23140 raft_consensus.cc:515] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.313651 23140 leader_election.cc:290] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 1 election: Requested vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067)
I20260709 13:07:42.314487 22916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0900e9b1ac43b5a46b67f8ea23e57d" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695cc50fa39b4569b4248bab36962ab8"
I20260709 13:07:42.315207 22916 raft_consensus.cc:3060] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.315784 23113 leader_election.cc:290] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 1 election: Requested vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067)
I20260709 13:07:42.316197 22917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae997940026470cac76b83d5491c0ba" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695cc50fa39b4569b4248bab36962ab8"
I20260709 13:07:42.316891 22917 raft_consensus.cc:3060] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.317003 23108 tablet_bootstrap.cc:492] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8: No bootstrap required, opened a new log
I20260709 13:07:42.317706 23108 ts_tablet_manager.cc:1403] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8: Time spent bootstrapping tablet: real 0.037s	user 0.029s	sys 0.007s
I20260709 13:07:42.318611 22990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d0900e9b1ac43b5a46b67f8ea23e57d" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116cbc3b8350497e9898dca20692f190"
I20260709 13:07:42.319208 22990 raft_consensus.cc:3060] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.320757 23108 raft_consensus.cc:359] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.323153 22916 raft_consensus.cc:2468] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 1.
I20260709 13:07:42.324219 23030 leader_election.cc:304] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 695cc50fa39b4569b4248bab36962ab8, 8712fe9782134858a2b8c81ac5ed2892; no voters: 
I20260709 13:07:42.324514 22992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae997940026470cac76b83d5491c0ba" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116cbc3b8350497e9898dca20692f190"
I20260709 13:07:42.325214 22917 raft_consensus.cc:2468] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 1.
I20260709 13:07:42.325361 22992 raft_consensus.cc:2393] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8712fe9782134858a2b8c81ac5ed2892 in current term 1: Already voted for candidate 116cbc3b8350497e9898dca20692f190 in this term.
I20260709 13:07:42.326406 23030 leader_election.cc:304] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 695cc50fa39b4569b4248bab36962ab8, 8712fe9782134858a2b8c81ac5ed2892; no voters: 
I20260709 13:07:42.322642 23108 raft_consensus.cc:385] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.327164 23108 raft_consensus.cc:740] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 695cc50fa39b4569b4248bab36962ab8, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.327900 23108 consensus_queue.cc:260] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.330849 23108 ts_tablet_manager.cc:1434] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:07:42.332028 23108 tablet_bootstrap.cc:492] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8: Bootstrap starting.
I20260709 13:07:42.335110 22917 raft_consensus.cc:3060] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.335959 23029 leader_election.cc:304] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 8712fe9782134858a2b8c81ac5ed2892; no voters: 695cc50fa39b4569b4248bab36962ab8
I20260709 13:07:42.338160 23108 tablet_bootstrap.cc:654] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:42.341742 23119 raft_consensus.cc:493] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.342461 23119 raft_consensus.cc:515] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.345259 23119 leader_election.cc:290] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835)
I20260709 13:07:42.348538 23140 raft_consensus.cc:2804] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.349400 23108 tablet_bootstrap.cc:492] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8: No bootstrap required, opened a new log
I20260709 13:07:42.349896 23108 ts_tablet_manager.cc:1403] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 13:07:42.349951 22916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae997940026470cac76b83d5491c0ba" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695cc50fa39b4569b4248bab36962ab8"
I20260709 13:07:42.347398 23153 consensus_queue.cc:1048] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:07:42.350814 22916 raft_consensus.cc:2393] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 116cbc3b8350497e9898dca20692f190 in current term 1: Already voted for candidate 8712fe9782134858a2b8c81ac5ed2892 in this term.
I20260709 13:07:42.351420 23153 raft_consensus.cc:493] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.351915 23153 raft_consensus.cc:515] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.352612 23108 raft_consensus.cc:359] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.353300 23108 raft_consensus.cc:385] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:42.353194 23066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ddfcead8484b458d5ca3075bfbe97f" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8712fe9782134858a2b8c81ac5ed2892" is_pre_election: true
I20260709 13:07:42.353842 23108 raft_consensus.cc:740] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 695cc50fa39b4569b4248bab36962ab8, State: Initialized, Role: FOLLOWER
I20260709 13:07:42.354401 23066 raft_consensus.cc:2468] T 65ddfcead8484b458d5ca3075bfbe97f P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 0.
I20260709 13:07:42.354732 23108 consensus_queue.cc:260] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.356127 22957 leader_election.cc:304] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 8712fe9782134858a2b8c81ac5ed2892; no voters: 
I20260709 13:07:42.357347 23119 raft_consensus.cc:2804] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.357717 23108 ts_tablet_manager.cc:1434] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:42.357806 23119 raft_consensus.cc:493] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.358255 23119 raft_consensus.cc:3060] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.359090 22915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd328834c134e679a16fbf39dc81dcc" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695cc50fa39b4569b4248bab36962ab8" is_pre_election: true
I20260709 13:07:42.359839 22915 raft_consensus.cc:2468] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 0.
I20260709 13:07:42.359952 23155 raft_consensus.cc:2804] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.360615 23155 raft_consensus.cc:493] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.361114 23155 raft_consensus.cc:3060] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.361243 22956 leader_election.cc:304] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 695cc50fa39b4569b4248bab36962ab8; no voters: 
I20260709 13:07:42.362406 23112 leader_election.cc:290] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 1 election: Requested vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835)
I20260709 13:07:42.363499 23065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae997940026470cac76b83d5491c0ba" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8712fe9782134858a2b8c81ac5ed2892"
I20260709 13:07:42.364327 23112 raft_consensus.cc:2804] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.364476 23066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd328834c134e679a16fbf39dc81dcc" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8712fe9782134858a2b8c81ac5ed2892" is_pre_election: true
I20260709 13:07:42.365530 23066 raft_consensus.cc:2468] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 0.
I20260709 13:07:42.365796 22917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ddfcead8484b458d5ca3075bfbe97f" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695cc50fa39b4569b4248bab36962ab8" is_pre_election: true
I20260709 13:07:42.357290 23113 raft_consensus.cc:2804] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.366629 23114 raft_consensus.cc:493] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.366411 23119 raft_consensus.cc:515] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.366922 22917 raft_consensus.cc:2468] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 0.
I20260709 13:07:42.366118 23112 raft_consensus.cc:493] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.367172 23114 raft_consensus.cc:515] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.358238 23153 leader_election.cc:290] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835)
I20260709 13:07:42.365746 22990 raft_consensus.cc:2468] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 1.
I20260709 13:07:42.370718 23064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ddfcead8484b458d5ca3075bfbe97f" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8712fe9782134858a2b8c81ac5ed2892"
I20260709 13:07:42.370569 23119 leader_election.cc:290] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 1 election: Requested vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835)
I20260709 13:07:42.367786 23112 raft_consensus.cc:3060] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.371516 23064 raft_consensus.cc:3060] T 65ddfcead8484b458d5ca3075bfbe97f P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.374589 23140 raft_consensus.cc:697] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 [term 1 LEADER]: Becoming Leader. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Running, Role: LEADER
I20260709 13:07:42.375628 23063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b863e345da0d47fda8644fb182123601" candidate_uuid: "695cc50fa39b4569b4248bab36962ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8712fe9782134858a2b8c81ac5ed2892" is_pre_election: true
I20260709 13:07:42.376421 23063 raft_consensus.cc:2468] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 695cc50fa39b4569b4248bab36962ab8 in term 0.
I20260709 13:07:42.375622 23140 consensus_queue.cc:237] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.377678 23114 leader_election.cc:290] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067), 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835)
I20260709 13:07:42.378772 22882 leader_election.cc:304] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 695cc50fa39b4569b4248bab36962ab8, 8712fe9782134858a2b8c81ac5ed2892; no voters: 
W20260709 13:07:42.380216 23029 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:35067, user_credentials={real_user=slave}} blocked reactor thread for 44363.4us
I20260709 13:07:42.381742 23114 raft_consensus.cc:2804] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:42.382177 23114 raft_consensus.cc:493] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.382524 23114 raft_consensus.cc:3060] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.386546 23064 raft_consensus.cc:2468] T 65ddfcead8484b458d5ca3075bfbe97f P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 1.
I20260709 13:07:42.387753 22957 leader_election.cc:304] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 8712fe9782134858a2b8c81ac5ed2892; no voters: 
I20260709 13:07:42.382503 23112 raft_consensus.cc:515] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.391249 23112 leader_election.cc:290] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 1 election: Requested vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835)
I20260709 13:07:42.388882 23113 raft_consensus.cc:697] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 1 LEADER]: Becoming Leader. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Running, Role: LEADER
I20260709 13:07:42.392378 22915 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd328834c134e679a16fbf39dc81dcc" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695cc50fa39b4569b4248bab36962ab8"
I20260709 13:07:42.397884 23163 raft_consensus.cc:2804] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.398257 22915 raft_consensus.cc:3060] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.398489 23163 raft_consensus.cc:697] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 [term 1 LEADER]: Becoming Leader. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Running, Role: LEADER
I20260709 13:07:42.398757 23113 consensus_queue.cc:237] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.399430 23163 consensus_queue.cc:237] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.391265 22917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65ddfcead8484b458d5ca3075bfbe97f" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695cc50fa39b4569b4248bab36962ab8"
I20260709 13:07:42.402422 22917 raft_consensus.cc:3060] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.405428 23155 raft_consensus.cc:515] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.411161 22914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a6701b259a4df5927d49d8981ec85d" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695cc50fa39b4569b4248bab36962ab8"
I20260709 13:07:42.411468 22992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44a6701b259a4df5927d49d8981ec85d" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116cbc3b8350497e9898dca20692f190"
I20260709 13:07:42.412173 22914 raft_consensus.cc:3060] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.412380 22992 raft_consensus.cc:3060] T 44a6701b259a4df5927d49d8981ec85d P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.429821 23152 consensus_queue.cc:1048] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:42.441406 22992 raft_consensus.cc:2468] T 44a6701b259a4df5927d49d8981ec85d P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 1.
I20260709 13:07:42.443939 23029 leader_election.cc:304] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 8712fe9782134858a2b8c81ac5ed2892; no voters: 
I20260709 13:07:42.445291 23140 raft_consensus.cc:2804] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.446049 23140 raft_consensus.cc:697] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 [term 1 LEADER]: Becoming Leader. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Running, Role: LEADER
I20260709 13:07:42.447239 23140 consensus_queue.cc:237] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.449832 22957 leader_election.cc:304] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 116cbc3b8350497e9898dca20692f190; no voters: 695cc50fa39b4569b4248bab36962ab8, 8712fe9782134858a2b8c81ac5ed2892
I20260709 13:07:42.451099 23163 raft_consensus.cc:2749] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:42.454571 23152 consensus_queue.cc:1048] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:42.456401 22915 raft_consensus.cc:2468] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 1.
I20260709 13:07:42.411182 23155 leader_election.cc:290] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 1 election: Requested vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067)
I20260709 13:07:42.396682 23114 raft_consensus.cc:515] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.394176 23064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd328834c134e679a16fbf39dc81dcc" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8712fe9782134858a2b8c81ac5ed2892"
I20260709 13:07:42.459426 22815 catalog_manager.cc:5697] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 reported cstate change: term changed from 0 to 1, leader changed from <none> to 116cbc3b8350497e9898dca20692f190 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "116cbc3b8350497e9898dca20692f190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.462265 23114 leader_election.cc:290] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [CANDIDATE]: Term 1 election: Requested vote from peers 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067), 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835)
I20260709 13:07:42.458995 22917 raft_consensus.cc:2468] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 1.
I20260709 13:07:42.463284 22814 catalog_manager.cc:5697] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "8712fe9782134858a2b8c81ac5ed2892" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.462160 22956 leader_election.cc:304] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 695cc50fa39b4569b4248bab36962ab8; no voters: 
I20260709 13:07:42.466531 23065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b863e345da0d47fda8644fb182123601" candidate_uuid: "695cc50fa39b4569b4248bab36962ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8712fe9782134858a2b8c81ac5ed2892"
I20260709 13:07:42.467350 23065 raft_consensus.cc:3060] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.469883 23163 raft_consensus.cc:2804] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.470045 22991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b863e345da0d47fda8644fb182123601" candidate_uuid: "695cc50fa39b4569b4248bab36962ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116cbc3b8350497e9898dca20692f190"
I20260709 13:07:42.393141 22990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b863e345da0d47fda8644fb182123601" candidate_uuid: "695cc50fa39b4569b4248bab36962ab8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116cbc3b8350497e9898dca20692f190" is_pre_election: true
I20260709 13:07:42.475693 22991 raft_consensus.cc:3060] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.475179 23064 raft_consensus.cc:3060] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:42.475817 23163 raft_consensus.cc:697] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 1 LEADER]: Becoming Leader. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Running, Role: LEADER
I20260709 13:07:42.479974 23163 consensus_queue.cc:237] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.490547 22814 catalog_manager.cc:5697] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "8712fe9782134858a2b8c81ac5ed2892" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.492214 22914 raft_consensus.cc:2468] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 1.
I20260709 13:07:42.498659 23064 raft_consensus.cc:2468] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 1.
I20260709 13:07:42.504835 22991 raft_consensus.cc:2468] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 695cc50fa39b4569b4248bab36962ab8 in term 1.
I20260709 13:07:42.504675 22815 catalog_manager.cc:5697] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 reported cstate change: term changed from 0 to 1, leader changed from <none> to 116cbc3b8350497e9898dca20692f190 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "116cbc3b8350497e9898dca20692f190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.506063 22880 leader_election.cc:304] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 695cc50fa39b4569b4248bab36962ab8; no voters: 
I20260709 13:07:42.507004 23114 raft_consensus.cc:2804] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:42.507529 23114 raft_consensus.cc:697] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 1 LEADER]: Becoming Leader. State: Replica: 695cc50fa39b4569b4248bab36962ab8, State: Running, Role: LEADER
I20260709 13:07:42.508519 23065 raft_consensus.cc:2468] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 695cc50fa39b4569b4248bab36962ab8 in term 1.
I20260709 13:07:42.508446 23114 consensus_queue.cc:237] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:42.518098 22814 catalog_manager.cc:5697] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "8712fe9782134858a2b8c81ac5ed2892" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:42.518959 22813 catalog_manager.cc:5697] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "695cc50fa39b4569b4248bab36962ab8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:42.524163 23163 consensus_queue.cc:1048] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:42.537536 23119 consensus_queue.cc:1048] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:42.549068 23140 consensus_queue.cc:1048] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Connected to new peer: Peer: permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:42.560266 11443 ts_manager.cc:295] Set tserver state for 695cc50fa39b4569b4248bab36962ab8 to MAINTENANCE_MODE
I20260709 13:07:42.561169 11443 tablet_server.cc:179] TabletServer@127.11.44.193:0 shutting down...
I20260709 13:07:42.563519 23140 consensus_queue.cc:1048] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Connected to new peer: Peer: permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:07:42.577960 23030 consensus_peers.cc:597] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:42.592211 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:42.593093 11443 tablet_replica.cc:333] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8: stopping tablet replica
I20260709 13:07:42.593961 11443 raft_consensus.cc:2243] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.594393 11443 raft_consensus.cc:2272] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.596663 11443 tablet_replica.cc:333] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8: stopping tablet replica
I20260709 13:07:42.597223 11443 raft_consensus.cc:2243] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.597664 11443 raft_consensus.cc:2272] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.599689 11443 tablet_replica.cc:333] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8: stopping tablet replica
I20260709 13:07:42.600425 11443 raft_consensus.cc:2243] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.601059 11443 pending_rounds.cc:70] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8: Trying to abort 1 pending ops.
I20260709 13:07:42.601269 11443 pending_rounds.cc:77] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305635686445862912 op_type: NO_OP noop_request { }
I20260709 13:07:42.601562 11443 raft_consensus.cc:2889] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:07:42.601905 11443 raft_consensus.cc:2272] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.604251 11443 tablet_replica.cc:333] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8: stopping tablet replica
I20260709 13:07:42.604809 11443 raft_consensus.cc:2243] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.605188 11443 raft_consensus.cc:2272] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.607167 11443 tablet_replica.cc:333] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8: stopping tablet replica
I20260709 13:07:42.607712 11443 raft_consensus.cc:2243] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.608091 11443 raft_consensus.cc:2272] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.609998 11443 tablet_replica.cc:333] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8: stopping tablet replica
I20260709 13:07:42.610589 11443 raft_consensus.cc:2243] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.611006 11443 raft_consensus.cc:2272] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.613216 11443 tablet_replica.cc:333] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8: stopping tablet replica
I20260709 13:07:42.613873 11443 raft_consensus.cc:2243] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.614316 11443 raft_consensus.cc:2272] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.616613 11443 tablet_replica.cc:333] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8: stopping tablet replica
I20260709 13:07:42.617141 11443 raft_consensus.cc:2243] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.617537 11443 raft_consensus.cc:2272] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.619285 11443 tablet_replica.cc:333] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8: stopping tablet replica
I20260709 13:07:42.619781 11443 raft_consensus.cc:2243] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:42.620702 11443 raft_consensus.cc:2272] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.622924 11443 tablet_replica.cc:333] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8: stopping tablet replica
I20260709 13:07:42.623365 11443 raft_consensus.cc:2243] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:42.623673 11443 raft_consensus.cc:2272] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:42.644048 11443 tablet_server.cc:196] TabletServer@127.11.44.193:0 shutdown complete.
W20260709 13:07:42.800416 23030 consensus_peers.cc:597] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:42.897019 23140 consensus_queue.cc:1048] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Connected to new peer: Peer: permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:42.910158 23030 consensus_peers.cc:597] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:42.923477 22863 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:07:42.925244 23140 consensus_queue.cc:1048] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Connected to new peer: Peer: permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:42.941075 23119 consensus_queue.cc:1048] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:42.958053 22956 consensus_peers.cc:597] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:42.961294 22956 consensus_peers.cc:597] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:42.963429 22956 consensus_peers.cc:597] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:42.968153 22956 consensus_peers.cc:597] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:42.973729 23163 consensus_queue.cc:1048] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:43.033514 23030 consensus_peers.cc:597] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:43.043792 23140 consensus_queue.cc:1048] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Connected to new peer: Peer: permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:43.925441 22863 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:07:43.946102 23140 raft_consensus.cc:493] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 695cc50fa39b4569b4248bab36962ab8)
I20260709 13:07:43.946991 23140 raft_consensus.cc:515] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } }
I20260709 13:07:43.949553 23140 leader_election.cc:290] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067), 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907)
I20260709 13:07:43.951761 22991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c643046686fb47f082d3202d19e99f55" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "116cbc3b8350497e9898dca20692f190" is_pre_election: true
W20260709 13:07:43.955327 23030 leader_election.cc:336] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111)
I20260709 13:07:43.955720 23030 leader_election.cc:304] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8712fe9782134858a2b8c81ac5ed2892; no voters: 116cbc3b8350497e9898dca20692f190, 695cc50fa39b4569b4248bab36962ab8
I20260709 13:07:43.956426 23140 raft_consensus.cc:2749] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:07:43.962082 23112 raft_consensus.cc:493] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 695cc50fa39b4569b4248bab36962ab8)
I20260709 13:07:43.962777 23112 raft_consensus.cc:515] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } }
I20260709 13:07:43.964953 23112 leader_election.cc:290] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835), 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907)
I20260709 13:07:43.965958 23065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c643046686fb47f082d3202d19e99f55" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8712fe9782134858a2b8c81ac5ed2892" is_pre_election: true
I20260709 13:07:43.966786 23065 raft_consensus.cc:2468] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 1.
I20260709 13:07:43.968386 22957 leader_election.cc:304] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 8712fe9782134858a2b8c81ac5ed2892; no voters: 
I20260709 13:07:43.969348 23112 raft_consensus.cc:2804] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:07:43.969695 22956 leader_election.cc:336] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111)
I20260709 13:07:43.969995 23112 raft_consensus.cc:493] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 695cc50fa39b4569b4248bab36962ab8)
I20260709 13:07:43.970376 23112 raft_consensus.cc:3060] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:43.978917 23112 raft_consensus.cc:515] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } }
I20260709 13:07:43.980553 23112 leader_election.cc:290] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 2 election: Requested vote from peers 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835), 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907)
I20260709 13:07:43.981272 23065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c643046686fb47f082d3202d19e99f55" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8712fe9782134858a2b8c81ac5ed2892"
I20260709 13:07:43.981860 23065 raft_consensus.cc:3060] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:43.984668 22956 leader_election.cc:336] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111)
I20260709 13:07:43.990324 23065 raft_consensus.cc:2468] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 2.
I20260709 13:07:43.991886 22957 leader_election.cc:304] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 8712fe9782134858a2b8c81ac5ed2892; no voters: 695cc50fa39b4569b4248bab36962ab8
I20260709 13:07:43.992911 23112 raft_consensus.cc:2804] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:43.993388 23112 raft_consensus.cc:697] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [term 2 LEADER]: Becoming Leader. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Running, Role: LEADER
I20260709 13:07:43.994781 23112 consensus_queue.cc:237] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } }
I20260709 13:07:44.004158 22813 catalog_manager.cc:5697] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 reported cstate change: term changed from 1 to 2, leader changed from 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193) to 116cbc3b8350497e9898dca20692f190 (127.11.44.194). New cstate: current_term: 2 leader_uuid: "116cbc3b8350497e9898dca20692f190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:44.154893 23030 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111) [suppressed 132 similar messages]
I20260709 13:07:44.434366 23140 raft_consensus.cc:493] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.435215 23140 raft_consensus.cc:515] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:44.437202 23140 leader_election.cc:290] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067)
I20260709 13:07:44.438512 22991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b863e345da0d47fda8644fb182123601" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116cbc3b8350497e9898dca20692f190" is_pre_election: true
I20260709 13:07:44.439527 22991 raft_consensus.cc:2468] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 1.
I20260709 13:07:44.440800 23029 leader_election.cc:304] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 8712fe9782134858a2b8c81ac5ed2892; no voters: 
W20260709 13:07:44.441435 23030 leader_election.cc:336] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111)
I20260709 13:07:44.441537 23140 raft_consensus.cc:2804] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:07:44.442015 23140 raft_consensus.cc:493] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.442306 23140 raft_consensus.cc:3060] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:44.449512 23140 raft_consensus.cc:515] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:44.451210 23140 leader_election.cc:290] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 2 election: Requested vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067)
I20260709 13:07:44.452255 22991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b863e345da0d47fda8644fb182123601" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "116cbc3b8350497e9898dca20692f190"
I20260709 13:07:44.452828 22991 raft_consensus.cc:3060] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:07:44.455309 23030 leader_election.cc:336] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111)
I20260709 13:07:44.459710 22991 raft_consensus.cc:2468] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 2.
I20260709 13:07:44.460929 23029 leader_election.cc:304] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 8712fe9782134858a2b8c81ac5ed2892; no voters: 695cc50fa39b4569b4248bab36962ab8
I20260709 13:07:44.461793 23140 raft_consensus.cc:2804] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:44.462675 23140 raft_consensus.cc:697] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 LEADER]: Becoming Leader. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Running, Role: LEADER
I20260709 13:07:44.463842 23140 consensus_queue.cc:237] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:44.471709 22813 catalog_manager.cc:5697] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 reported cstate change: term changed from 1 to 2, leader changed from 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193) to 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195). New cstate: current_term: 2 leader_uuid: "8712fe9782134858a2b8c81ac5ed2892" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.564814 23065 raft_consensus.cc:1275] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Refusing update from remote peer 116cbc3b8350497e9898dca20692f190: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:44.566147 23112 consensus_queue.cc:1048] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:44.582219 22956 consensus_peers.cc:597] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:44.885140 22991 raft_consensus.cc:1275] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Refusing update from remote peer 8712fe9782134858a2b8c81ac5ed2892: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:07:44.886595 23194 consensus_queue.cc:1048] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Connected to new peer: Peer: permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:07:44.902596 23030 consensus_peers.cc:597] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:44.926879 22863 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:07:45.015065 23030 consensus_peers.cc:597] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:45.342543 22956 consensus_peers.cc:597] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:45.379796 22956 consensus_peers.cc:597] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:45.420097 23030 consensus_peers.cc:597] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:45.431550 22956 consensus_peers.cc:597] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:45.504212 23030 consensus_peers.cc:597] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:45.547844 23030 consensus_peers.cc:597] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:45.805881 22956 consensus_peers.cc:597] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:45.928031 22863 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:07:46.929069 22863 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:07:47.288208 23030 consensus_peers.cc:597] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:07:47.318297 22956 consensus_peers.cc:597] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:07:47.664448 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:47.672466 23205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:47.673872 23206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:47.674655 23208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:47.676360 11443 server_base.cc:1061] running on GCE node
I20260709 13:07:47.678887 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:47.679097 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:47.679283 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602467679269 us; error 0 us; skew 500 ppm
I20260709 13:07:47.679836 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:47.682613 11443 webserver.cc:533] Webserver started at http://127.11.44.193:37679/ using document root <none> and password file <none>
I20260709 13:07:47.683095 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:47.683256 11443 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:07:47.687346 11443 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:07:47.691455 23213 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:47.692246 11443 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:07:47.692520 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/ts-0-root
uuid: "695cc50fa39b4569b4248bab36962ab8"
format_stamp: "Formatted at 2026-07-09 13:07:41 on dist-test-slave-qv7r"
I20260709 13:07:47.692838 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602132206461-11443-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:47.706449 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:47.707823 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:47.709519 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:47.713446 23220 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:07:47.726089 23030 consensus_peers.cc:597] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:47.765637 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:07:47.766026 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.054s	user 0.002s	sys 0.002s
I20260709 13:07:47.766336 11443 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:07:47.771538 23220 tablet_bootstrap.cc:492] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8: Bootstrap starting.
I20260709 13:07:47.787017 23220 tablet_bootstrap.cc:492] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:47.787940 23220 tablet_bootstrap.cc:492] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8: Bootstrap complete.
I20260709 13:07:47.788623 23220 ts_tablet_manager.cc:1403] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:07:47.791482 23220 raft_consensus.cc:359] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:47.792186 23220 raft_consensus.cc:740] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 695cc50fa39b4569b4248bab36962ab8, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.792918 23220 consensus_queue.cc:260] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:47.795539 23220 ts_tablet_manager.cc:1434] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:07:47.796401 23220 tablet_bootstrap.cc:492] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8: Bootstrap starting.
I20260709 13:07:47.811836 23220 tablet_bootstrap.cc:492] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:47.812623 23220 tablet_bootstrap.cc:492] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8: Bootstrap complete.
I20260709 13:07:47.813225 23220 ts_tablet_manager.cc:1403] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:07:47.815347 23220 raft_consensus.cc:359] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:47.815888 23220 raft_consensus.cc:740] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 695cc50fa39b4569b4248bab36962ab8, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.816587 23220 consensus_queue.cc:260] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:47.819265 23220 ts_tablet_manager.cc:1434] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:07:47.820087 23220 tablet_bootstrap.cc:492] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8: Bootstrap starting.
I20260709 13:07:47.823863 11443 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:07:47.824216 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.058s	user 0.052s	sys 0.004s
I20260709 13:07:47.834807 23220 tablet_bootstrap.cc:492] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:47.835974 23220 tablet_bootstrap.cc:492] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8: Bootstrap complete.
I20260709 13:07:47.836694 23220 ts_tablet_manager.cc:1403] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 13:07:47.839413 23220 raft_consensus.cc:359] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:47.840215 23220 raft_consensus.cc:740] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 695cc50fa39b4569b4248bab36962ab8, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.841040 23220 consensus_queue.cc:260] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
W20260709 13:07:47.841917 23030 consensus_peers.cc:597] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:47.843321 23220 ts_tablet_manager.cc:1434] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:07:47.844157 23220 tablet_bootstrap.cc:492] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8: Bootstrap starting.
W20260709 13:07:47.859661 23030 consensus_peers.cc:597] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:47.864795 23220 tablet_bootstrap.cc:492] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:47.866225 23220 tablet_bootstrap.cc:492] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8: Bootstrap complete.
I20260709 13:07:47.867026 23220 ts_tablet_manager.cc:1403] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.010s
I20260709 13:07:47.871522 23220 raft_consensus.cc:359] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:47.873761 23220 raft_consensus.cc:740] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 695cc50fa39b4569b4248bab36962ab8, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.874688 23220 consensus_queue.cc:260] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:47.877161 23220 ts_tablet_manager.cc:1434] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 13:07:47.878309 23220 tablet_bootstrap.cc:492] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8: Bootstrap starting.
I20260709 13:07:47.894337 23220 tablet_bootstrap.cc:492] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:47.895159 23220 tablet_bootstrap.cc:492] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8: Bootstrap complete.
I20260709 13:07:47.895808 23220 ts_tablet_manager.cc:1403] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.001s
I20260709 13:07:47.898430 23220 raft_consensus.cc:359] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:47.899140 23220 raft_consensus.cc:740] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 695cc50fa39b4569b4248bab36962ab8, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.899911 23220 consensus_queue.cc:260] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:47.901598 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.193:43907
I20260709 13:07:47.901736 23283 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.193:43907 every 8 connection(s)
I20260709 13:07:47.901974 23220 ts_tablet_manager.cc:1434] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:07:47.902937 23220 tablet_bootstrap.cc:492] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8: Bootstrap starting.
I20260709 13:07:47.911407 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:47.928649 22956 consensus_peers.cc:597] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:07:47.930287 22863 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:07:47.942001 22956 consensus_peers.cc:597] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:07:47.943367 23220 tablet_bootstrap.cc:492] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:47.944324 23220 tablet_bootstrap.cc:492] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8: Bootstrap complete.
I20260709 13:07:47.944903 23220 ts_tablet_manager.cc:1403] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8: Time spent bootstrapping tablet: real 0.042s	user 0.028s	sys 0.008s
I20260709 13:07:47.947650 23220 raft_consensus.cc:359] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:47.948508 23220 raft_consensus.cc:740] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 695cc50fa39b4569b4248bab36962ab8, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.949308 23220 consensus_queue.cc:260] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:47.951655 23220 ts_tablet_manager.cc:1434] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:07:47.951905 22992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17d619dbcbc4444dace0141307000b2c"
dest_uuid: "116cbc3b8350497e9898dca20692f190"
mode: GRACEFUL
new_leader_uuid: "8712fe9782134858a2b8c81ac5ed2892"
 from {username='slave'} at 127.0.0.1:46360
I20260709 13:07:47.952677 23220 tablet_bootstrap.cc:492] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8: Bootstrap starting.
I20260709 13:07:47.953104 22992 raft_consensus.cc:606] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 1 LEADER]: Received request to transfer leadership to TS 8712fe9782134858a2b8c81ac5ed2892
I20260709 13:07:47.953426 23285 heartbeater.cc:344] Connected to a master server at 127.11.44.254:39259
I20260709 13:07:47.953990 23285 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:47.955242 23285 heartbeater.cc:507] Master 127.11.44.254:39259 requested a full tablet report, sending...
I20260709 13:07:47.963212 22815 ts_manager.cc:194] Re-registered known tserver with Master: 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907)
I20260709 13:07:47.974859 23065 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "824c55bd593d4fb9ab4252e1b22cd881"
dest_uuid: "8712fe9782134858a2b8c81ac5ed2892"
mode: GRACEFUL
new_leader_uuid: "116cbc3b8350497e9898dca20692f190"
 from {username='slave'} at 127.0.0.1:48250
I20260709 13:07:47.975617 23220 tablet_bootstrap.cc:492] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:47.975592 23065 raft_consensus.cc:606] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 LEADER]: Received request to transfer leadership to TS 116cbc3b8350497e9898dca20692f190
I20260709 13:07:47.976024 22815 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58388
I20260709 13:07:47.977032 23220 tablet_bootstrap.cc:492] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8: Bootstrap complete.
I20260709 13:07:47.977743 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:47.978546 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:47.979367 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:47.980059 23285 heartbeater.cc:499] Master 127.11.44.254:39259 was elected leader, sending a full tablet report...
I20260709 13:07:47.980494 23220 ts_tablet_manager.cc:1403] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.008s
I20260709 13:07:47.988698 23220 raft_consensus.cc:359] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:47.989336 23220 raft_consensus.cc:740] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 695cc50fa39b4569b4248bab36962ab8, State: Initialized, Role: FOLLOWER
I20260709 13:07:47.990061 23220 consensus_queue.cc:260] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:47.992064 23220 ts_tablet_manager.cc:1434] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:07:47.992911 23220 tablet_bootstrap.cc:492] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8: Bootstrap starting.
I20260709 13:07:48.006132 23220 tablet_bootstrap.cc:492] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:48.006976 23220 tablet_bootstrap.cc:492] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8: Bootstrap complete.
I20260709 13:07:48.007531 23220 ts_tablet_manager.cc:1403] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 13:07:48.009629 23220 raft_consensus.cc:359] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } }
I20260709 13:07:48.010370 23220 raft_consensus.cc:740] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 695cc50fa39b4569b4248bab36962ab8, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.011051 23220 consensus_queue.cc:260] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } }
I20260709 13:07:48.013087 23220 ts_tablet_manager.cc:1434] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:48.014014 23220 tablet_bootstrap.cc:492] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8: Bootstrap starting.
I20260709 13:07:48.026161 23220 tablet_bootstrap.cc:492] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:48.026901 23220 tablet_bootstrap.cc:492] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8: Bootstrap complete.
I20260709 13:07:48.027508 23220 ts_tablet_manager.cc:1403] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:07:48.029590 23220 raft_consensus.cc:359] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:48.030143 23220 raft_consensus.cc:740] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 695cc50fa39b4569b4248bab36962ab8, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.030917 23220 consensus_queue.cc:260] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:48.032621 23220 ts_tablet_manager.cc:1434] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:48.033504 23220 tablet_bootstrap.cc:492] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8: Bootstrap starting.
I20260709 13:07:48.046514 23220 tablet_bootstrap.cc:492] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:07:48.047459 23220 tablet_bootstrap.cc:492] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8: Bootstrap complete.
I20260709 13:07:48.048084 23220 ts_tablet_manager.cc:1403] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:07:48.050125 23220 raft_consensus.cc:359] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:48.050786 23220 raft_consensus.cc:740] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 695cc50fa39b4569b4248bab36962ab8, State: Initialized, Role: FOLLOWER
I20260709 13:07:48.051549 23220 consensus_queue.cc:260] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:48.053507 23220 ts_tablet_manager.cc:1434] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:07:48.141969 23197 raft_consensus.cc:993] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190: : Instructing follower 8712fe9782134858a2b8c81ac5ed2892 to start an election
I20260709 13:07:48.142493 23197 raft_consensus.cc:1081] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 1 LEADER]: Signalling peer 8712fe9782134858a2b8c81ac5ed2892 to start an election
I20260709 13:07:48.144224 23065 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17d619dbcbc4444dace0141307000b2c"
dest_uuid: "8712fe9782134858a2b8c81ac5ed2892"
 from {username='slave'} at 127.0.0.1:48230
I20260709 13:07:48.144742 23065 raft_consensus.cc:493] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:48.145042 23065 raft_consensus.cc:3060] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:48.151074 23065 raft_consensus.cc:515] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:48.152886 23065 leader_election.cc:290] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 2 election: Requested vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067)
I20260709 13:07:48.153955 22992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d619dbcbc4444dace0141307000b2c" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "116cbc3b8350497e9898dca20692f190"
I20260709 13:07:48.154078 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d619dbcbc4444dace0141307000b2c" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "695cc50fa39b4569b4248bab36962ab8"
I20260709 13:07:48.154651 22992 raft_consensus.cc:3055] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:48.154886 23258 raft_consensus.cc:3060] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:48.155093 22992 raft_consensus.cc:740] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Running, Role: LEADER
I20260709 13:07:48.156113 22992 consensus_queue.cc:260] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:48.157497 22992 raft_consensus.cc:3060] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:48.160930 23258 raft_consensus.cc:2468] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 2.
I20260709 13:07:48.162180 23030 leader_election.cc:304] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 695cc50fa39b4569b4248bab36962ab8, 8712fe9782134858a2b8c81ac5ed2892; no voters: 
I20260709 13:07:48.163177 23241 raft_consensus.cc:2804] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:48.163789 23241 raft_consensus.cc:697] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [term 2 LEADER]: Becoming Leader. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Running, Role: LEADER
I20260709 13:07:48.164865 22992 raft_consensus.cc:2468] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 2.
I20260709 13:07:48.164844 23241 consensus_queue.cc:237] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:48.173444 22815 catalog_manager.cc:5697] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 reported cstate change: term changed from 1 to 2, leader changed from 116cbc3b8350497e9898dca20692f190 (127.11.44.194) to 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195). New cstate: current_term: 2 leader_uuid: "8712fe9782134858a2b8c81ac5ed2892" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:48.205538 23258 raft_consensus.cc:3060] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:48.211251 23258 pending_rounds.cc:85] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8: Aborting all ops after (but not including) 0
I20260709 13:07:48.211529 23258 pending_rounds.cc:107] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:07:48.211792 23258 raft_consensus.cc:2889] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:48.357059 23194 raft_consensus.cc:993] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892: : Instructing follower 116cbc3b8350497e9898dca20692f190 to start an election
I20260709 13:07:48.357580 23241 raft_consensus.cc:1081] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 LEADER]: Signalling peer 116cbc3b8350497e9898dca20692f190 to start an election
I20260709 13:07:48.359511 22992 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "824c55bd593d4fb9ab4252e1b22cd881"
dest_uuid: "116cbc3b8350497e9898dca20692f190"
 from {username='slave'} at 127.0.0.1:46356
I20260709 13:07:48.360085 22992 raft_consensus.cc:493] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:48.360386 22992 raft_consensus.cc:3060] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:48.366179 22992 raft_consensus.cc:515] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:48.368008 22992 leader_election.cc:290] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 2 election: Requested vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835)
I20260709 13:07:48.369108 23065 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824c55bd593d4fb9ab4252e1b22cd881" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8712fe9782134858a2b8c81ac5ed2892"
I20260709 13:07:48.369136 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824c55bd593d4fb9ab4252e1b22cd881" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "695cc50fa39b4569b4248bab36962ab8"
I20260709 13:07:48.369942 23065 raft_consensus.cc:3055] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:48.370338 23258 raft_consensus.cc:3060] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:48.370368 23065 raft_consensus.cc:740] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Running, Role: LEADER
I20260709 13:07:48.371618 23065 consensus_queue.cc:260] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:48.373009 23065 raft_consensus.cc:3060] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:48.377234 23258 raft_consensus.cc:2468] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 2.
I20260709 13:07:48.378620 22956 leader_election.cc:304] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 695cc50fa39b4569b4248bab36962ab8; no voters: 
I20260709 13:07:48.379400 23197 raft_consensus.cc:2804] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:48.379838 23197 raft_consensus.cc:697] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [term 2 LEADER]: Becoming Leader. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Running, Role: LEADER
I20260709 13:07:48.381023 23065 raft_consensus.cc:2468] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 2.
I20260709 13:07:48.380781 23197 consensus_queue.cc:237] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:48.388329 22815 catalog_manager.cc:5697] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 reported cstate change: term changed from 1 to 2, leader changed from 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195) to 116cbc3b8350497e9898dca20692f190 (127.11.44.194). New cstate: current_term: 2 leader_uuid: "116cbc3b8350497e9898dca20692f190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:48.429514 23258 raft_consensus.cc:3060] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:48.659138 23258 raft_consensus.cc:1275] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8 [term 2 FOLLOWER]: Refusing update from remote peer 8712fe9782134858a2b8c81ac5ed2892: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:48.660454 23313 consensus_queue.cc:1048] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Connected to new peer: Peer: permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:48.671291 22992 raft_consensus.cc:1275] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Refusing update from remote peer 8712fe9782134858a2b8c81ac5ed2892: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:48.673282 23241 consensus_queue.cc:1048] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Connected to new peer: Peer: permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:48.866401 23064 raft_consensus.cc:1275] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Refusing update from remote peer 116cbc3b8350497e9898dca20692f190: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:48.868008 23319 consensus_queue.cc:1048] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:48.878814 23258 raft_consensus.cc:1275] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8 [term 2 FOLLOWER]: Refusing update from remote peer 116cbc3b8350497e9898dca20692f190: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:48.880708 23197 consensus_queue.cc:1048] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:48.931449 22863 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:07:48.989209 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:48.996773 23064 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b863e345da0d47fda8644fb182123601"
dest_uuid: "8712fe9782134858a2b8c81ac5ed2892"
mode: GRACEFUL
new_leader_uuid: "116cbc3b8350497e9898dca20692f190"
 from {username='slave'} at 127.0.0.1:48250
I20260709 13:07:48.997267 23064 raft_consensus.cc:606] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 LEADER]: Received request to transfer leadership to TS 116cbc3b8350497e9898dca20692f190
I20260709 13:07:49.000118 22992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edd328834c134e679a16fbf39dc81dcc"
dest_uuid: "116cbc3b8350497e9898dca20692f190"
mode: GRACEFUL
new_leader_uuid: "8712fe9782134858a2b8c81ac5ed2892"
 from {username='slave'} at 127.0.0.1:46360
I20260709 13:07:49.000586 22992 raft_consensus.cc:606] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 1 LEADER]: Received request to transfer leadership to TS 8712fe9782134858a2b8c81ac5ed2892
I20260709 13:07:49.001871 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:49.002377 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:49.002926 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:49.179587 23299 raft_consensus.cc:993] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190: : Instructing follower 8712fe9782134858a2b8c81ac5ed2892 to start an election
I20260709 13:07:49.180143 23319 raft_consensus.cc:1081] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 1 LEADER]: Signalling peer 8712fe9782134858a2b8c81ac5ed2892 to start an election
I20260709 13:07:49.181825 23064 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edd328834c134e679a16fbf39dc81dcc"
dest_uuid: "8712fe9782134858a2b8c81ac5ed2892"
 from {username='slave'} at 127.0.0.1:48230
I20260709 13:07:49.182379 23064 raft_consensus.cc:493] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:49.182698 23064 raft_consensus.cc:3060] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:49.189044 23064 raft_consensus.cc:515] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:49.190924 23064 leader_election.cc:290] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 2 election: Requested vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067)
I20260709 13:07:49.191879 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd328834c134e679a16fbf39dc81dcc" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "695cc50fa39b4569b4248bab36962ab8"
I20260709 13:07:49.191963 22992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd328834c134e679a16fbf39dc81dcc" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "116cbc3b8350497e9898dca20692f190"
I20260709 13:07:49.192763 22992 raft_consensus.cc:3055] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:49.192683 23258 raft_consensus.cc:3060] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:49.193306 22992 raft_consensus.cc:740] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Running, Role: LEADER
I20260709 13:07:49.194450 22992 consensus_queue.cc:260] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:49.195652 22992 raft_consensus.cc:3060] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:49.200309 23258 raft_consensus.cc:2468] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 2.
I20260709 13:07:49.201745 23030 leader_election.cc:304] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 695cc50fa39b4569b4248bab36962ab8, 8712fe9782134858a2b8c81ac5ed2892; no voters: 
I20260709 13:07:49.202538 23241 raft_consensus.cc:2804] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:49.202775 22992 raft_consensus.cc:2468] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 2.
I20260709 13:07:49.202944 23241 raft_consensus.cc:697] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [term 2 LEADER]: Becoming Leader. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Running, Role: LEADER
I20260709 13:07:49.204141 23241 consensus_queue.cc:237] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:49.212832 22815 catalog_manager.cc:5697] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 reported cstate change: term changed from 1 to 2, leader changed from 116cbc3b8350497e9898dca20692f190 (127.11.44.194) to 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195). New cstate: current_term: 2 leader_uuid: "8712fe9782134858a2b8c81ac5ed2892" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:49.296094 23241 raft_consensus.cc:993] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892: : Instructing follower 116cbc3b8350497e9898dca20692f190 to start an election
I20260709 13:07:49.296591 23241 raft_consensus.cc:1081] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 LEADER]: Signalling peer 116cbc3b8350497e9898dca20692f190 to start an election
I20260709 13:07:49.298256 22992 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b863e345da0d47fda8644fb182123601"
dest_uuid: "116cbc3b8350497e9898dca20692f190"
 from {username='slave'} at 127.0.0.1:46356
I20260709 13:07:49.298869 22992 raft_consensus.cc:493] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:49.299165 22992 raft_consensus.cc:3060] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:49.304230 22992 raft_consensus.cc:515] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:49.305922 22992 leader_election.cc:290] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 3 election: Requested vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835)
I20260709 13:07:49.306720 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b863e345da0d47fda8644fb182123601" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "695cc50fa39b4569b4248bab36962ab8"
I20260709 13:07:49.307008 23064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b863e345da0d47fda8644fb182123601" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "8712fe9782134858a2b8c81ac5ed2892"
I20260709 13:07:49.307451 23258 raft_consensus.cc:3060] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:49.307612 23064 raft_consensus.cc:3055] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:49.307979 23064 raft_consensus.cc:740] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Running, Role: LEADER
I20260709 13:07:49.308622 23064 consensus_queue.cc:260] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:49.309710 23064 raft_consensus.cc:3060] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:49.313834 23258 raft_consensus.cc:2468] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 3.
I20260709 13:07:49.315296 22956 leader_election.cc:304] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 695cc50fa39b4569b4248bab36962ab8; no voters: 
I20260709 13:07:49.316031 23319 raft_consensus.cc:2804] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:49.316566 23319 raft_consensus.cc:697] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [term 3 LEADER]: Becoming Leader. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Running, Role: LEADER
I20260709 13:07:49.316938 23064 raft_consensus.cc:2468] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 3.
I20260709 13:07:49.317644 23319 consensus_queue.cc:237] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:49.324466 22815 catalog_manager.cc:5697] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 reported cstate change: term changed from 2 to 3, leader changed from 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195) to 116cbc3b8350497e9898dca20692f190 (127.11.44.194). New cstate: current_term: 3 leader_uuid: "116cbc3b8350497e9898dca20692f190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:49.746978 23064 raft_consensus.cc:1275] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 3 FOLLOWER]: Refusing update from remote peer 116cbc3b8350497e9898dca20692f190: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:49.748449 23319 consensus_queue.cc:1048] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:49.758502 23258 raft_consensus.cc:1275] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 3 FOLLOWER]: Refusing update from remote peer 116cbc3b8350497e9898dca20692f190: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:07:49.760557 23328 consensus_queue.cc:1048] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:49.792932 23258 raft_consensus.cc:1275] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8 [term 2 FOLLOWER]: Refusing update from remote peer 8712fe9782134858a2b8c81ac5ed2892: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:49.798537 23316 consensus_queue.cc:1048] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Connected to new peer: Peer: permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:50.225078 22992 raft_consensus.cc:1275] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Refusing update from remote peer 8712fe9782134858a2b8c81ac5ed2892: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:50.338479 23316 consensus_queue.cc:1048] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Connected to new peer: Peer: permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:07:50.355681 23241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.005s	sys 0.021s
W20260709 13:07:50.356055 23241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.005s	sys 0.021s
W20260709 13:07:50.388391 22863 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:07:50.481333 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:50.489300 22990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b863e345da0d47fda8644fb182123601"
dest_uuid: "116cbc3b8350497e9898dca20692f190"
mode: GRACEFUL
new_leader_uuid: "8712fe9782134858a2b8c81ac5ed2892"
 from {username='slave'} at 127.0.0.1:46360
I20260709 13:07:50.489928 22990 raft_consensus.cc:606] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [term 3 LEADER]: Received request to transfer leadership to TS 8712fe9782134858a2b8c81ac5ed2892
I20260709 13:07:50.492843 23063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edd328834c134e679a16fbf39dc81dcc"
dest_uuid: "8712fe9782134858a2b8c81ac5ed2892"
mode: GRACEFUL
new_leader_uuid: "116cbc3b8350497e9898dca20692f190"
 from {username='slave'} at 127.0.0.1:48250
I20260709 13:07:50.493366 23063 raft_consensus.cc:606] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [term 2 LEADER]: Received request to transfer leadership to TS 116cbc3b8350497e9898dca20692f190
I20260709 13:07:50.494853 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:50.495404 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:50.496040 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:50.867514 23299 raft_consensus.cc:993] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190: : Instructing follower 8712fe9782134858a2b8c81ac5ed2892 to start an election
I20260709 13:07:50.868057 23299 raft_consensus.cc:1081] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [term 3 LEADER]: Signalling peer 8712fe9782134858a2b8c81ac5ed2892 to start an election
I20260709 13:07:50.869647 23063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b863e345da0d47fda8644fb182123601"
dest_uuid: "8712fe9782134858a2b8c81ac5ed2892"
 from {username='slave'} at 127.0.0.1:48230
I20260709 13:07:50.870365 23063 raft_consensus.cc:493] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:50.870784 23063 raft_consensus.cc:3060] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:50.876646 23063 raft_consensus.cc:515] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:50.878316 23063 leader_election.cc:290] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 4 election: Requested vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067)
I20260709 13:07:50.879251 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b863e345da0d47fda8644fb182123601" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "695cc50fa39b4569b4248bab36962ab8"
I20260709 13:07:50.879391 22990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b863e345da0d47fda8644fb182123601" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "116cbc3b8350497e9898dca20692f190"
I20260709 13:07:50.880061 22990 raft_consensus.cc:3055] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:07:50.880026 23258 raft_consensus.cc:3060] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:50.880556 22990 raft_consensus.cc:740] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Running, Role: LEADER
I20260709 13:07:50.881358 22990 consensus_queue.cc:260] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:50.882336 22990 raft_consensus.cc:3060] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:07:50.886831 23258 raft_consensus.cc:2468] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 4.
I20260709 13:07:50.888098 23030 leader_election.cc:304] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 695cc50fa39b4569b4248bab36962ab8, 8712fe9782134858a2b8c81ac5ed2892; no voters: 
I20260709 13:07:50.888240 22990 raft_consensus.cc:2468] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 4.
I20260709 13:07:50.888932 23334 raft_consensus.cc:2804] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:07:50.889415 23334 raft_consensus.cc:697] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 4 LEADER]: Becoming Leader. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Running, Role: LEADER
I20260709 13:07:50.890177 23334 consensus_queue.cc:237] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:50.898157 22814 catalog_manager.cc:5697] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 reported cstate change: term changed from 3 to 4, leader changed from 116cbc3b8350497e9898dca20692f190 (127.11.44.194) to 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195). New cstate: current_term: 4 leader_uuid: "8712fe9782134858a2b8c81ac5ed2892" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:50.963964 23316 raft_consensus.cc:993] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892: : Instructing follower 116cbc3b8350497e9898dca20692f190 to start an election
I20260709 13:07:50.964838 23343 raft_consensus.cc:1081] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [term 2 LEADER]: Signalling peer 116cbc3b8350497e9898dca20692f190 to start an election
I20260709 13:07:50.966565 22990 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edd328834c134e679a16fbf39dc81dcc"
dest_uuid: "116cbc3b8350497e9898dca20692f190"
 from {username='slave'} at 127.0.0.1:46356
I20260709 13:07:50.967252 22990 raft_consensus.cc:493] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:50.967651 22990 raft_consensus.cc:3060] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:50.973081 22990 raft_consensus.cc:515] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:50.974856 22990 leader_election.cc:290] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 3 election: Requested vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835)
I20260709 13:07:50.975589 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd328834c134e679a16fbf39dc81dcc" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "695cc50fa39b4569b4248bab36962ab8"
I20260709 13:07:50.975997 23063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edd328834c134e679a16fbf39dc81dcc" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8712fe9782134858a2b8c81ac5ed2892"
I20260709 13:07:50.976261 23258 raft_consensus.cc:3060] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:50.976697 23063 raft_consensus.cc:3055] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:50.977111 23063 raft_consensus.cc:740] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Running, Role: LEADER
I20260709 13:07:50.977852 23063 consensus_queue.cc:260] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:50.978888 23063 raft_consensus.cc:3060] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:50.981727 23258 raft_consensus.cc:2468] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 3.
I20260709 13:07:50.982823 22956 leader_election.cc:304] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 695cc50fa39b4569b4248bab36962ab8; no voters: 
I20260709 13:07:50.983569 23299 raft_consensus.cc:2804] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:50.984081 23299 raft_consensus.cc:697] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 3 LEADER]: Becoming Leader. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Running, Role: LEADER
I20260709 13:07:50.984751 23063 raft_consensus.cc:2468] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 3.
I20260709 13:07:50.984882 23299 consensus_queue.cc:237] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:50.991634 22814 catalog_manager.cc:5697] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 reported cstate change: term changed from 2 to 3, leader changed from 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195) to 116cbc3b8350497e9898dca20692f190 (127.11.44.194). New cstate: current_term: 3 leader_uuid: "116cbc3b8350497e9898dca20692f190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:51.128374 23013 debug-util.cc:398] Leaking SignalData structure 0x7b080009ad80 after lost signal to thread 11446
W20260709 13:07:51.129623 23013 debug-util.cc:398] Leaking SignalData structure 0x7b080038f2c0 after lost signal to thread 22849
W20260709 13:07:51.130808 23013 debug-util.cc:398] Leaking SignalData structure 0x7b0800296de0 after lost signal to thread 23016
W20260709 13:07:51.131772 23013 debug-util.cc:398] Leaking SignalData structure 0x7b08002e4b80 after lost signal to thread 23090
W20260709 13:07:51.132805 23013 debug-util.cc:398] Leaking SignalData structure 0x7b08002636e0 after lost signal to thread 23283
W20260709 13:07:51.389880 22863 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:07:51.400153 22990 raft_consensus.cc:1275] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [term 4 FOLLOWER]: Refusing update from remote peer 8712fe9782134858a2b8c81ac5ed2892: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:51.402261 23343 consensus_queue.cc:1048] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Connected to new peer: Peer: permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:51.434793 23258 raft_consensus.cc:1275] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 4 FOLLOWER]: Refusing update from remote peer 8712fe9782134858a2b8c81ac5ed2892: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:07:51.436425 23343 consensus_queue.cc:1048] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Connected to new peer: Peer: permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:51.503289 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:51.515890 23063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ae997940026470cac76b83d5491c0ba"
dest_uuid: "8712fe9782134858a2b8c81ac5ed2892"
mode: GRACEFUL
new_leader_uuid: "116cbc3b8350497e9898dca20692f190"
 from {username='slave'} at 127.0.0.1:48250
I20260709 13:07:51.516640 23063 raft_consensus.cc:606] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 1 LEADER]: Received request to transfer leadership to TS 116cbc3b8350497e9898dca20692f190
I20260709 13:07:51.520191 22990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "824c55bd593d4fb9ab4252e1b22cd881"
dest_uuid: "116cbc3b8350497e9898dca20692f190"
mode: GRACEFUL
new_leader_uuid: "8712fe9782134858a2b8c81ac5ed2892"
 from {username='slave'} at 127.0.0.1:46360
I20260709 13:07:51.520854 22990 raft_consensus.cc:606] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [term 2 LEADER]: Received request to transfer leadership to TS 8712fe9782134858a2b8c81ac5ed2892
I20260709 13:07:51.522783 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:51.523336 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:51.523983 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:51.570273 23063 raft_consensus.cc:1275] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [term 3 FOLLOWER]: Refusing update from remote peer 116cbc3b8350497e9898dca20692f190: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:51.571760 23350 consensus_queue.cc:1048] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:51.589658 23258 raft_consensus.cc:1275] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8 [term 3 FOLLOWER]: Refusing update from remote peer 116cbc3b8350497e9898dca20692f190: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:51.591387 23350 consensus_queue.cc:1048] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:51.636997 23316 raft_consensus.cc:993] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892: : Instructing follower 116cbc3b8350497e9898dca20692f190 to start an election
I20260709 13:07:51.637499 23343 raft_consensus.cc:1081] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 1 LEADER]: Signalling peer 116cbc3b8350497e9898dca20692f190 to start an election
I20260709 13:07:51.639299 22990 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ae997940026470cac76b83d5491c0ba"
dest_uuid: "116cbc3b8350497e9898dca20692f190"
 from {username='slave'} at 127.0.0.1:46356
I20260709 13:07:51.639941 22990 raft_consensus.cc:493] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:51.640359 22990 raft_consensus.cc:3060] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:51.648929 22990 raft_consensus.cc:515] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:51.652045 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae997940026470cac76b83d5491c0ba" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "695cc50fa39b4569b4248bab36962ab8"
I20260709 13:07:51.652184 23063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ae997940026470cac76b83d5491c0ba" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8712fe9782134858a2b8c81ac5ed2892"
I20260709 13:07:51.651619 22990 leader_election.cc:290] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 2 election: Requested vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835)
I20260709 13:07:51.652689 23258 raft_consensus.cc:3060] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:51.652911 23063 raft_consensus.cc:3055] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:51.653353 23063 raft_consensus.cc:740] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Running, Role: LEADER
I20260709 13:07:51.654342 23063 consensus_queue.cc:260] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:51.655797 23063 raft_consensus.cc:3060] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:51.657979 23258 raft_consensus.cc:2468] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 2.
I20260709 13:07:51.658999 22956 leader_election.cc:304] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 695cc50fa39b4569b4248bab36962ab8; no voters: 
I20260709 13:07:51.659736 23350 raft_consensus.cc:2804] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:51.660156 23350 raft_consensus.cc:697] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [term 2 LEADER]: Becoming Leader. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Running, Role: LEADER
I20260709 13:07:51.660949 23350 consensus_queue.cc:237] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:51.664320 23063 raft_consensus.cc:2468] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 2.
I20260709 13:07:51.668793 22813 catalog_manager.cc:5697] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 reported cstate change: term changed from 1 to 2, leader changed from 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195) to 116cbc3b8350497e9898dca20692f190 (127.11.44.194). New cstate: current_term: 2 leader_uuid: "116cbc3b8350497e9898dca20692f190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:51.802376 23354 raft_consensus.cc:993] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190: : Instructing follower 8712fe9782134858a2b8c81ac5ed2892 to start an election
I20260709 13:07:51.802908 23350 raft_consensus.cc:1081] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [term 2 LEADER]: Signalling peer 8712fe9782134858a2b8c81ac5ed2892 to start an election
I20260709 13:07:51.804301 23063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "824c55bd593d4fb9ab4252e1b22cd881"
dest_uuid: "8712fe9782134858a2b8c81ac5ed2892"
 from {username='slave'} at 127.0.0.1:48230
I20260709 13:07:51.804772 23063 raft_consensus.cc:493] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:51.805079 23063 raft_consensus.cc:3060] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:51.810685 23063 raft_consensus.cc:515] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:51.812278 23063 leader_election.cc:290] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 3 election: Requested vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067)
I20260709 13:07:51.813247 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824c55bd593d4fb9ab4252e1b22cd881" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "695cc50fa39b4569b4248bab36962ab8"
I20260709 13:07:51.813304 22990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "824c55bd593d4fb9ab4252e1b22cd881" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "116cbc3b8350497e9898dca20692f190"
I20260709 13:07:51.814090 23258 raft_consensus.cc:3060] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:51.814162 22990 raft_consensus.cc:3055] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:51.814690 22990 raft_consensus.cc:740] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Running, Role: LEADER
I20260709 13:07:51.815469 22990 consensus_queue.cc:260] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:51.816468 22990 raft_consensus.cc:3060] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:51.822832 23258 raft_consensus.cc:2468] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 3.
I20260709 13:07:51.823469 22990 raft_consensus.cc:2468] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 3.
I20260709 13:07:51.824407 23030 leader_election.cc:304] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 695cc50fa39b4569b4248bab36962ab8, 8712fe9782134858a2b8c81ac5ed2892; no voters: 
I20260709 13:07:51.825234 23343 raft_consensus.cc:2804] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:51.825824 23343 raft_consensus.cc:697] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 3 LEADER]: Becoming Leader. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Running, Role: LEADER
I20260709 13:07:51.826530 23343 consensus_queue.cc:237] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:51.834183 22813 catalog_manager.cc:5697] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 reported cstate change: term changed from 2 to 3, leader changed from 116cbc3b8350497e9898dca20692f190 (127.11.44.194) to 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195). New cstate: current_term: 3 leader_uuid: "8712fe9782134858a2b8c81ac5ed2892" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:52.142696 23063 raft_consensus.cc:1275] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Refusing update from remote peer 116cbc3b8350497e9898dca20692f190: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:52.144140 23299 consensus_queue.cc:1048] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:52.155665 23258 raft_consensus.cc:1275] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8 [term 2 FOLLOWER]: Refusing update from remote peer 116cbc3b8350497e9898dca20692f190: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:52.160421 23350 consensus_queue.cc:1048] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:52.255306 23258 raft_consensus.cc:1275] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8 [term 3 FOLLOWER]: Refusing update from remote peer 8712fe9782134858a2b8c81ac5ed2892: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:52.256821 23343 consensus_queue.cc:1048] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Connected to new peer: Peer: permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:07:52.267870 22990 raft_consensus.cc:1275] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [term 3 FOLLOWER]: Refusing update from remote peer 8712fe9782134858a2b8c81ac5ed2892: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:52.269639 23334 consensus_queue.cc:1048] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Connected to new peer: Peer: permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:07:52.391141 22863 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:07:52.530730 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:52.538981 23063 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "17d619dbcbc4444dace0141307000b2c"
dest_uuid: "8712fe9782134858a2b8c81ac5ed2892"
mode: GRACEFUL
new_leader_uuid: "116cbc3b8350497e9898dca20692f190"
 from {username='slave'} at 127.0.0.1:48250
I20260709 13:07:52.539688 23063 raft_consensus.cc:606] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [term 2 LEADER]: Received request to transfer leadership to TS 116cbc3b8350497e9898dca20692f190
I20260709 13:07:52.542675 22990 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "931da8ce024c4309b094499863b4ecb4"
dest_uuid: "116cbc3b8350497e9898dca20692f190"
mode: GRACEFUL
new_leader_uuid: "8712fe9782134858a2b8c81ac5ed2892"
 from {username='slave'} at 127.0.0.1:46360
I20260709 13:07:52.543341 22990 raft_consensus.cc:606] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [term 1 LEADER]: Received request to transfer leadership to TS 8712fe9782134858a2b8c81ac5ed2892
I20260709 13:07:52.544620 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:52.545236 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:52.545857 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:52.638262 23334 raft_consensus.cc:993] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892: : Instructing follower 116cbc3b8350497e9898dca20692f190 to start an election
I20260709 13:07:52.638955 23316 raft_consensus.cc:1081] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [term 2 LEADER]: Signalling peer 116cbc3b8350497e9898dca20692f190 to start an election
I20260709 13:07:52.641288 22990 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "17d619dbcbc4444dace0141307000b2c"
dest_uuid: "116cbc3b8350497e9898dca20692f190"
 from {username='slave'} at 127.0.0.1:46356
I20260709 13:07:52.642182 22990 raft_consensus.cc:493] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:52.642517 22990 raft_consensus.cc:3060] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:52.648957 22990 raft_consensus.cc:515] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:52.651194 22990 leader_election.cc:290] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 3 election: Requested vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195:33835)
I20260709 13:07:52.652284 23063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d619dbcbc4444dace0141307000b2c" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8712fe9782134858a2b8c81ac5ed2892"
I20260709 13:07:52.652911 23063 raft_consensus.cc:3055] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:07:52.651685 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "17d619dbcbc4444dace0141307000b2c" candidate_uuid: "116cbc3b8350497e9898dca20692f190" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "695cc50fa39b4569b4248bab36962ab8"
I20260709 13:07:52.653183 23063 raft_consensus.cc:740] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Running, Role: LEADER
I20260709 13:07:52.653658 23258 raft_consensus.cc:3060] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:52.654160 23063 consensus_queue.cc:260] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:52.655237 23063 raft_consensus.cc:3060] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:07:52.660943 23063 raft_consensus.cc:2468] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 3.
I20260709 13:07:52.661662 23258 raft_consensus.cc:2468] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 116cbc3b8350497e9898dca20692f190 in term 3.
I20260709 13:07:52.662124 22957 leader_election.cc:304] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 116cbc3b8350497e9898dca20692f190, 8712fe9782134858a2b8c81ac5ed2892; no voters: 
I20260709 13:07:52.663304 23350 raft_consensus.cc:2804] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:07:52.663802 23350 raft_consensus.cc:697] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 3 LEADER]: Becoming Leader. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Running, Role: LEADER
I20260709 13:07:52.664570 23350 consensus_queue.cc:237] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:52.672617 22814 catalog_manager.cc:5697] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 reported cstate change: term changed from 2 to 3, leader changed from 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195) to 116cbc3b8350497e9898dca20692f190 (127.11.44.194). New cstate: current_term: 3 leader_uuid: "116cbc3b8350497e9898dca20692f190" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:52.861712 23354 raft_consensus.cc:993] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190: : Instructing follower 8712fe9782134858a2b8c81ac5ed2892 to start an election
I20260709 13:07:52.862293 23350 raft_consensus.cc:1081] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [term 1 LEADER]: Signalling peer 8712fe9782134858a2b8c81ac5ed2892 to start an election
I20260709 13:07:52.866106 23063 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "931da8ce024c4309b094499863b4ecb4"
dest_uuid: "8712fe9782134858a2b8c81ac5ed2892"
 from {username='slave'} at 127.0.0.1:48230
I20260709 13:07:52.866788 23063 raft_consensus.cc:493] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:52.867214 23063 raft_consensus.cc:3060] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:52.873376 23063 raft_consensus.cc:515] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:52.876348 23063 leader_election.cc:290] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 2 election: Requested vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067)
I20260709 13:07:52.876575 23258 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931da8ce024c4309b094499863b4ecb4" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "695cc50fa39b4569b4248bab36962ab8"
I20260709 13:07:52.877291 23258 raft_consensus.cc:3060] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:52.878545 22990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "931da8ce024c4309b094499863b4ecb4" candidate_uuid: "8712fe9782134858a2b8c81ac5ed2892" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "116cbc3b8350497e9898dca20692f190"
I20260709 13:07:52.879185 22990 raft_consensus.cc:3055] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:52.879519 22990 raft_consensus.cc:740] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 116cbc3b8350497e9898dca20692f190, State: Running, Role: LEADER
I20260709 13:07:52.880369 22990 consensus_queue.cc:260] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:52.881536 22990 raft_consensus.cc:3060] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:52.885061 23258 raft_consensus.cc:2468] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 2.
I20260709 13:07:52.886468 23030 leader_election.cc:304] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 695cc50fa39b4569b4248bab36962ab8, 8712fe9782134858a2b8c81ac5ed2892; no voters: 
I20260709 13:07:52.887339 23334 raft_consensus.cc:2804] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:52.887286 22990 raft_consensus.cc:2468] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8712fe9782134858a2b8c81ac5ed2892 in term 2.
I20260709 13:07:52.888150 23334 raft_consensus.cc:697] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 LEADER]: Becoming Leader. State: Replica: 8712fe9782134858a2b8c81ac5ed2892, State: Running, Role: LEADER
I20260709 13:07:52.889186 23334 consensus_queue.cc:237] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:52.898319 22814 catalog_manager.cc:5697] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892 reported cstate change: term changed from 1 to 2, leader changed from 116cbc3b8350497e9898dca20692f190 (127.11.44.194) to 8712fe9782134858a2b8c81ac5ed2892 (127.11.44.195). New cstate: current_term: 2 leader_uuid: "8712fe9782134858a2b8c81ac5ed2892" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:53.150460 23256 raft_consensus.cc:1275] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8 [term 3 FOLLOWER]: Refusing update from remote peer 116cbc3b8350497e9898dca20692f190: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:53.151407 23063 raft_consensus.cc:1275] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [term 3 FOLLOWER]: Refusing update from remote peer 116cbc3b8350497e9898dca20692f190: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:07:53.152755 23350 consensus_queue.cc:1048] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:07:53.154109 23354 consensus_queue.cc:1048] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:07:53.392393 22863 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:07:53.461717 23256 raft_consensus.cc:1275] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8 [term 2 FOLLOWER]: Refusing update from remote peer 8712fe9782134858a2b8c81ac5ed2892: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:53.463155 23382 consensus_queue.cc:1048] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Connected to new peer: Peer: permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:53.473352 22990 raft_consensus.cc:1275] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Refusing update from remote peer 8712fe9782134858a2b8c81ac5ed2892: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:53.475873 23382 consensus_queue.cc:1048] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892 [LEADER]: Connected to new peer: Peer: permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:53.552011 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:53.590546 11443 tablet_server.cc:179] TabletServer@127.11.44.193:43907 shutting down...
W20260709 13:07:53.609840 22956 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 75 similar messages]
W20260709 13:07:53.626941 22956 consensus_peers.cc:597] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:53.629467 22956 consensus_peers.cc:597] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:53.633769 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:53.634701 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:53.635633 11443 raft_consensus.cc:2243] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:53.636116 11443 raft_consensus.cc:2272] T 65ddfcead8484b458d5ca3075bfbe97f P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:53.638222 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:53.638824 11443 raft_consensus.cc:2243] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:53.639253 11443 raft_consensus.cc:2272] T c643046686fb47f082d3202d19e99f55 P 695cc50fa39b4569b4248bab36962ab8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:53.641155 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:53.641861 11443 raft_consensus.cc:2243] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:53.642293 11443 raft_consensus.cc:2272] T 931da8ce024c4309b094499863b4ecb4 P 695cc50fa39b4569b4248bab36962ab8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:53.645291 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:53.645932 11443 raft_consensus.cc:2243] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:53.646379 11443 raft_consensus.cc:2272] T edd328834c134e679a16fbf39dc81dcc P 695cc50fa39b4569b4248bab36962ab8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:53.648133 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:53.648658 11443 raft_consensus.cc:2243] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:53.649062 11443 raft_consensus.cc:2272] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:53.651438 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:53.652141 11443 raft_consensus.cc:2243] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:53.652616 11443 raft_consensus.cc:2272] T 17d619dbcbc4444dace0141307000b2c P 695cc50fa39b4569b4248bab36962ab8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:53.656224 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:53.656780 11443 raft_consensus.cc:2243] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:53.657193 11443 raft_consensus.cc:2272] T 2ae997940026470cac76b83d5491c0ba P 695cc50fa39b4569b4248bab36962ab8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:53.659155 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:53.659663 11443 raft_consensus.cc:2243] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:53.660133 11443 raft_consensus.cc:2272] T b863e345da0d47fda8644fb182123601 P 695cc50fa39b4569b4248bab36962ab8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:53.662518 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:53.663159 11443 raft_consensus.cc:2243] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:53.663611 11443 raft_consensus.cc:2272] T 824c55bd593d4fb9ab4252e1b22cd881 P 695cc50fa39b4569b4248bab36962ab8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:53.665400 11443 tablet_replica.cc:333] stopping tablet replica
I20260709 13:07:53.665881 11443 raft_consensus.cc:2243] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:53.666268 11443 raft_consensus.cc:2272] T 44a6701b259a4df5927d49d8981ec85d P 695cc50fa39b4569b4248bab36962ab8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:53.694914 23030 consensus_peers.cc:597] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:53.699149 11443 tablet_server.cc:196] TabletServer@127.11.44.193:43907 shutdown complete.
I20260709 13:07:53.721762 11443 tablet_server.cc:179] TabletServer@127.11.44.194:0 shutting down...
W20260709 13:07:53.764905 23030 consensus_peers.cc:597] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:53.768612 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:53.769688 11443 tablet_replica.cc:333] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 116cbc3b8350497e9898dca20692f190: stopping tablet replica
I20260709 13:07:53.770922 11443 raft_consensus.cc:2243] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:53.771255 23030 consensus_peers.cc:597] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:53.771687 11443 raft_consensus.cc:2272] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:53.774750 11443 tablet_replica.cc:333] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190: stopping tablet replica
I20260709 13:07:53.775523 11443 raft_consensus.cc:2243] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:53.776006 11443 raft_consensus.cc:2272] T b863e345da0d47fda8644fb182123601 P 116cbc3b8350497e9898dca20692f190 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:53.778689 11443 tablet_replica.cc:333] T 44a6701b259a4df5927d49d8981ec85d P 116cbc3b8350497e9898dca20692f190: stopping tablet replica
I20260709 13:07:53.779335 11443 raft_consensus.cc:2243] T 44a6701b259a4df5927d49d8981ec85d P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:53.779819 11443 raft_consensus.cc:2272] T 44a6701b259a4df5927d49d8981ec85d P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:53.782459 11443 tablet_replica.cc:333] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190: stopping tablet replica
I20260709 13:07:53.783087 11443 raft_consensus.cc:2243] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:53.783550 11443 raft_consensus.cc:2272] T 824c55bd593d4fb9ab4252e1b22cd881 P 116cbc3b8350497e9898dca20692f190 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:53.813869 11443 tablet_replica.cc:333] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190: stopping tablet replica
I20260709 13:07:53.816028 11443 raft_consensus.cc:2243] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:53.819607 11443 raft_consensus.cc:2272] T 65ddfcead8484b458d5ca3075bfbe97f P 116cbc3b8350497e9898dca20692f190 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:53.823814 23029 consensus_peers.cc:597] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 -> Peer 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067): Couldn't send request to peer 116cbc3b8350497e9898dca20692f190. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:53.825053 11443 tablet_replica.cc:333] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190: stopping tablet replica
I20260709 13:07:53.826144 11443 raft_consensus.cc:2243] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:53.828233 11443 raft_consensus.cc:2272] T c643046686fb47f082d3202d19e99f55 P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:53.832084 11443 tablet_replica.cc:333] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190: stopping tablet replica
I20260709 13:07:53.832903 11443 raft_consensus.cc:2243] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:53.835170 11443 raft_consensus.cc:2272] T edd328834c134e679a16fbf39dc81dcc P 116cbc3b8350497e9898dca20692f190 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:53.838937 11443 tablet_replica.cc:333] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190: stopping tablet replica
I20260709 13:07:53.839685 11443 raft_consensus.cc:2243] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:53.840682 11443 raft_consensus.cc:2272] T 931da8ce024c4309b094499863b4ecb4 P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:53.845772 11443 tablet_replica.cc:333] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190: stopping tablet replica
I20260709 13:07:53.846547 11443 raft_consensus.cc:2243] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:53.848640 11443 raft_consensus.cc:2272] T 2ae997940026470cac76b83d5491c0ba P 116cbc3b8350497e9898dca20692f190 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:53.853963 11443 tablet_replica.cc:333] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190: stopping tablet replica
I20260709 13:07:53.855078 11443 raft_consensus.cc:2243] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:07:53.857239 23029 consensus_peers.cc:597] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 -> Peer 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067): Couldn't send request to peer 116cbc3b8350497e9898dca20692f190. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:53.858211 11443 raft_consensus.cc:2272] T 17d619dbcbc4444dace0141307000b2c P 116cbc3b8350497e9898dca20692f190 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:07:53.876995 23029 consensus_peers.cc:597] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 -> Peer 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067): Couldn't send request to peer 116cbc3b8350497e9898dca20692f190. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:53.877174 23030 consensus_peers.cc:597] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:53.936239 23029 consensus_peers.cc:597] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892 -> Peer 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067): Couldn't send request to peer 116cbc3b8350497e9898dca20692f190. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:35067: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:54.019515 23030 consensus_peers.cc:597] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892 -> Peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Couldn't send request to peer 695cc50fa39b4569b4248bab36962ab8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:54.077036 23029 consensus_peers.cc:597] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 -> Peer 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067): Couldn't send request to peer 116cbc3b8350497e9898dca20692f190. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:35067: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:07:54.393942 22863 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:07:54.896692 11443 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 23013)
I20260709 13:07:55.076792 23391 raft_consensus.cc:493] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 116cbc3b8350497e9898dca20692f190)
I20260709 13:07:55.077750 23391 raft_consensus.cc:515] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:55.080899 23391 leader_election.cc:290] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067)
W20260709 13:07:55.085618 23030 leader_election.cc:336] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111)
W20260709 13:07:55.087056 23029 leader_election.cc:336] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067): Network error: Client connection negotiation failed: client connection to 127.11.44.194:35067: connect: Connection refused (error 111)
I20260709 13:07:55.087430 23029 leader_election.cc:304] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8712fe9782134858a2b8c81ac5ed2892; no voters: 116cbc3b8350497e9898dca20692f190, 695cc50fa39b4569b4248bab36962ab8
I20260709 13:07:55.088165 23391 raft_consensus.cc:2749] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:55.145502 23391 raft_consensus.cc:493] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 116cbc3b8350497e9898dca20692f190)
I20260709 13:07:55.146327 23391 raft_consensus.cc:515] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } }
I20260709 13:07:55.148914 23391 leader_election.cc:290] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067), 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907)
W20260709 13:07:55.153313 23029 leader_election.cc:336] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067): Network error: Client connection negotiation failed: client connection to 127.11.44.194:35067: connect: Connection refused (error 111)
W20260709 13:07:55.154042 23030 leader_election.cc:336] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111)
I20260709 13:07:55.154495 23030 leader_election.cc:304] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8712fe9782134858a2b8c81ac5ed2892; no voters: 116cbc3b8350497e9898dca20692f190, 695cc50fa39b4569b4248bab36962ab8
I20260709 13:07:55.155249 23391 raft_consensus.cc:2749] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:55.199772 23391 raft_consensus.cc:493] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 116cbc3b8350497e9898dca20692f190)
I20260709 13:07:55.200713 23391 raft_consensus.cc:515] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:55.203594 23391 leader_election.cc:290] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067)
W20260709 13:07:55.208289 23030 leader_election.cc:336] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111)
W20260709 13:07:55.208958 23029 leader_election.cc:336] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067): Network error: Client connection negotiation failed: client connection to 127.11.44.194:35067: connect: Connection refused (error 111)
I20260709 13:07:55.209349 23029 leader_election.cc:304] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8712fe9782134858a2b8c81ac5ed2892; no voters: 116cbc3b8350497e9898dca20692f190, 695cc50fa39b4569b4248bab36962ab8
I20260709 13:07:55.209978 23391 raft_consensus.cc:2749] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:07:55.210791 23391 raft_consensus.cc:493] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 116cbc3b8350497e9898dca20692f190)
I20260709 13:07:55.211678 23391 raft_consensus.cc:515] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:55.214450 23391 leader_election.cc:290] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067)
W20260709 13:07:55.218207 23030 leader_election.cc:336] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111)
W20260709 13:07:55.219662 23029 leader_election.cc:336] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067): Network error: Client connection negotiation failed: client connection to 127.11.44.194:35067: connect: Connection refused (error 111)
I20260709 13:07:55.220077 23029 leader_election.cc:304] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8712fe9782134858a2b8c81ac5ed2892; no voters: 116cbc3b8350497e9898dca20692f190, 695cc50fa39b4569b4248bab36962ab8
I20260709 13:07:55.220901 23391 raft_consensus.cc:2749] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:07:55.232129 23391 raft_consensus.cc:493] T 65ddfcead8484b458d5ca3075bfbe97f P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 116cbc3b8350497e9898dca20692f190)
I20260709 13:07:55.232738 23391 raft_consensus.cc:515] T 65ddfcead8484b458d5ca3075bfbe97f P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "695cc50fa39b4569b4248bab36962ab8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 43907 } } peers { permanent_uuid: "116cbc3b8350497e9898dca20692f190" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 35067 } } peers { permanent_uuid: "8712fe9782134858a2b8c81ac5ed2892" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 33835 } }
I20260709 13:07:55.234872 23391 leader_election.cc:290] T 65ddfcead8484b458d5ca3075bfbe97f P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907), 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067)
W20260709 13:07:55.238940 23029 leader_election.cc:336] T 65ddfcead8484b458d5ca3075bfbe97f P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 116cbc3b8350497e9898dca20692f190 (127.11.44.194:35067): Network error: Client connection negotiation failed: client connection to 127.11.44.194:35067: connect: Connection refused (error 111)
W20260709 13:07:55.239456 23030 leader_election.cc:336] T 65ddfcead8484b458d5ca3075bfbe97f P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 695cc50fa39b4569b4248bab36962ab8 (127.11.44.193:43907): Network error: Client connection negotiation failed: client connection to 127.11.44.193:43907: connect: Connection refused (error 111)
I20260709 13:07:55.239848 23030 leader_election.cc:304] T 65ddfcead8484b458d5ca3075bfbe97f P 8712fe9782134858a2b8c81ac5ed2892 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8712fe9782134858a2b8c81ac5ed2892; no voters: 116cbc3b8350497e9898dca20692f190, 695cc50fa39b4569b4248bab36962ab8
I20260709 13:07:55.240428 23391 raft_consensus.cc:2749] T 65ddfcead8484b458d5ca3075bfbe97f P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:07:55.394975 22863 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:07:55.446820 11443 tablet_server.cc:196] TabletServer@127.11.44.194:0 shutdown complete.
I20260709 13:07:55.483191 11443 tablet_server.cc:179] TabletServer@127.11.44.195:0 shutting down...
I20260709 13:07:55.515520 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:55.516503 11443 tablet_replica.cc:333] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892: stopping tablet replica
I20260709 13:07:55.517616 11443 raft_consensus.cc:2243] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:55.518623 11443 raft_consensus.cc:2272] T 2d0900e9b1ac43b5a46b67f8ea23e57d P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:55.521325 11443 tablet_replica.cc:333] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892: stopping tablet replica
I20260709 13:07:55.522009 11443 raft_consensus.cc:2243] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:07:55.522948 11443 raft_consensus.cc:2272] T b863e345da0d47fda8644fb182123601 P 8712fe9782134858a2b8c81ac5ed2892 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:55.525261 11443 tablet_replica.cc:333] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892: stopping tablet replica
I20260709 13:07:55.525868 11443 raft_consensus.cc:2243] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:55.526876 11443 raft_consensus.cc:2272] T 44a6701b259a4df5927d49d8981ec85d P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:55.529323 11443 tablet_replica.cc:333] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892: stopping tablet replica
I20260709 13:07:55.529969 11443 raft_consensus.cc:2243] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:07:55.530865 11443 raft_consensus.cc:2272] T 824c55bd593d4fb9ab4252e1b22cd881 P 8712fe9782134858a2b8c81ac5ed2892 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:55.533298 11443 tablet_replica.cc:333] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892: stopping tablet replica
I20260709 13:07:55.533999 11443 raft_consensus.cc:2243] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:55.534523 11443 raft_consensus.cc:2272] T edd328834c134e679a16fbf39dc81dcc P 8712fe9782134858a2b8c81ac5ed2892 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:55.536895 11443 tablet_replica.cc:333] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892: stopping tablet replica
I20260709 13:07:55.537515 11443 raft_consensus.cc:2243] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:55.538811 11443 raft_consensus.cc:2272] T 931da8ce024c4309b094499863b4ecb4 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:55.541327 11443 tablet_replica.cc:333] T 65ddfcead8484b458d5ca3075bfbe97f P 8712fe9782134858a2b8c81ac5ed2892: stopping tablet replica
I20260709 13:07:55.541945 11443 raft_consensus.cc:2243] T 65ddfcead8484b458d5ca3075bfbe97f P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:55.542420 11443 raft_consensus.cc:2272] T 65ddfcead8484b458d5ca3075bfbe97f P 8712fe9782134858a2b8c81ac5ed2892 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:55.544953 11443 tablet_replica.cc:333] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892: stopping tablet replica
I20260709 13:07:55.545545 11443 raft_consensus.cc:2243] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:55.546154 11443 raft_consensus.cc:2272] T c643046686fb47f082d3202d19e99f55 P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:55.548760 11443 tablet_replica.cc:333] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892: stopping tablet replica
I20260709 13:07:55.549360 11443 raft_consensus.cc:2243] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:55.549901 11443 raft_consensus.cc:2272] T 2ae997940026470cac76b83d5491c0ba P 8712fe9782134858a2b8c81ac5ed2892 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:55.552156 11443 tablet_replica.cc:333] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892: stopping tablet replica
I20260709 13:07:55.552591 11443 raft_consensus.cc:2243] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:55.553020 11443 raft_consensus.cc:2272] T 17d619dbcbc4444dace0141307000b2c P 8712fe9782134858a2b8c81ac5ed2892 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:55.589145 11443 tablet_server.cc:196] TabletServer@127.11.44.195:0 shutdown complete.
I20260709 13:07:55.618116 11443 master.cc:562] Master@127.11.44.254:39259 shutting down...
I20260709 13:07:55.647796 11443 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:55.648483 11443 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:55.648774 11443 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9bd1425d19824938ba5a03180c92b56a: stopping tablet replica
I20260709 13:07:55.671434 11443 master.cc:584] Master@127.11.44.254:39259 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (14950 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:07:55.728010 11443 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.44.254:37563
I20260709 13:07:55.729367 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:55.737118 23397 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:55.737181 23398 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:55.738884 11443 server_base.cc:1061] running on GCE node
W20260709 13:07:55.738610 23400 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:55.740151 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:55.740393 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:55.740554 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602475740536 us; error 0 us; skew 500 ppm
I20260709 13:07:55.741372 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:55.744761 11443 webserver.cc:533] Webserver started at http://127.11.44.254:44695/ using document root <none> and password file <none>
I20260709 13:07:55.745386 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:55.745661 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:55.745988 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:55.747390 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132206461-11443-0/minicluster-data/master-0-root/instance:
uuid: "e652ab46ae624418a3cd4caa4baeb405"
format_stamp: "Formatted at 2026-07-09 13:07:55 on dist-test-slave-qv7r"
I20260709 13:07:55.754813 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.005s
I20260709 13:07:55.760721 23405 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:55.762223 11443 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:07:55.762522 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132206461-11443-0/minicluster-data/master-0-root
uuid: "e652ab46ae624418a3cd4caa4baeb405"
format_stamp: "Formatted at 2026-07-09 13:07:55 on dist-test-slave-qv7r"
I20260709 13:07:55.762794 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132206461-11443-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132206461-11443-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132206461-11443-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:55.777226 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:55.778561 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:55.822057 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.254:37563
I20260709 13:07:55.822283 23456 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.254:37563 every 8 connection(s)
I20260709 13:07:55.827346 23457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:55.844183 23457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405: Bootstrap starting.
I20260709 13:07:55.850322 23457 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:55.855981 23457 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405: No bootstrap required, opened a new log
I20260709 13:07:55.858494 23457 raft_consensus.cc:359] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e652ab46ae624418a3cd4caa4baeb405" member_type: VOTER }
I20260709 13:07:55.859123 23457 raft_consensus.cc:385] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:55.859367 23457 raft_consensus.cc:740] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e652ab46ae624418a3cd4caa4baeb405, State: Initialized, Role: FOLLOWER
I20260709 13:07:55.860041 23457 consensus_queue.cc:260] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e652ab46ae624418a3cd4caa4baeb405" member_type: VOTER }
I20260709 13:07:55.860494 23457 raft_consensus.cc:399] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:55.860778 23457 raft_consensus.cc:493] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:55.861064 23457 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:55.867877 23457 raft_consensus.cc:515] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e652ab46ae624418a3cd4caa4baeb405" member_type: VOTER }
I20260709 13:07:55.868465 23457 leader_election.cc:304] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e652ab46ae624418a3cd4caa4baeb405; no voters: 
I20260709 13:07:55.870875 23457 leader_election.cc:290] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:55.871404 23460 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:55.873790 23460 raft_consensus.cc:697] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405 [term 1 LEADER]: Becoming Leader. State: Replica: e652ab46ae624418a3cd4caa4baeb405, State: Running, Role: LEADER
I20260709 13:07:55.874601 23460 consensus_queue.cc:237] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e652ab46ae624418a3cd4caa4baeb405" member_type: VOTER }
I20260709 13:07:55.874804 23457 sys_catalog.cc:565] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:55.880412 23461 sys_catalog.cc:455] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e652ab46ae624418a3cd4caa4baeb405" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e652ab46ae624418a3cd4caa4baeb405" member_type: VOTER } }
I20260709 13:07:55.880522 23462 sys_catalog.cc:455] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e652ab46ae624418a3cd4caa4baeb405. Latest consensus state: current_term: 1 leader_uuid: "e652ab46ae624418a3cd4caa4baeb405" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e652ab46ae624418a3cd4caa4baeb405" member_type: VOTER } }
I20260709 13:07:55.881084 23461 sys_catalog.cc:458] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:55.881181 23462 sys_catalog.cc:458] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:55.886719 23467 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:55.892803 23467 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:55.894974 11443 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:55.903316 23467 catalog_manager.cc:1383] Generated new cluster ID: 731a1044f3604911b1470c7a7d9e9879
I20260709 13:07:55.903633 23467 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:55.933279 23467 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:55.934681 23467 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:55.954506 23467 catalog_manager.cc:6070] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405: Generated new TSK 0
I20260709 13:07:55.955132 23467 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:55.961710 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:55.968345 23478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:55.969796 23479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:55.972357 11443 server_base.cc:1061] running on GCE node
W20260709 13:07:55.972401 23481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:55.973747 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:55.973940 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:55.974062 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602475974051 us; error 0 us; skew 500 ppm
I20260709 13:07:55.974587 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:55.977237 11443 webserver.cc:533] Webserver started at http://127.11.44.193:35669/ using document root <none> and password file <none>
I20260709 13:07:55.977747 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:55.977913 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:55.978127 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:55.979259 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132206461-11443-0/minicluster-data/ts-0-root/instance:
uuid: "ffcf2f5109634570a41b34baa7fd6ef9"
format_stamp: "Formatted at 2026-07-09 13:07:55 on dist-test-slave-qv7r"
I20260709 13:07:55.984315 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:07:55.988035 23486 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:55.989305 11443 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:07:55.989723 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132206461-11443-0/minicluster-data/ts-0-root
uuid: "ffcf2f5109634570a41b34baa7fd6ef9"
format_stamp: "Formatted at 2026-07-09 13:07:55 on dist-test-slave-qv7r"
I20260709 13:07:55.990054 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132206461-11443-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132206461-11443-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132206461-11443-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:56.040462 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:56.042019 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:56.043815 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:56.046693 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:56.046975 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:56.047283 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:56.047500 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:56.096588 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.193:42553
I20260709 13:07:56.096699 23548 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.193:42553 every 8 connection(s)
I20260709 13:07:56.103097 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:56.112471 23553 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:56.112917 23554 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:56.116783 23556 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:56.117446 11443 server_base.cc:1061] running on GCE node
I20260709 13:07:56.117905 23549 heartbeater.cc:344] Connected to a master server at 127.11.44.254:37563
I20260709 13:07:56.118402 23549 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:56.119036 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:56.119364 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:56.119462 23549 heartbeater.cc:507] Master 127.11.44.254:37563 requested a full tablet report, sending...
I20260709 13:07:56.119617 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602476119593 us; error 0 us; skew 500 ppm
I20260709 13:07:56.120611 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:56.122423 23422 ts_manager.cc:194] Registered new tserver with Master: ffcf2f5109634570a41b34baa7fd6ef9 (127.11.44.193:42553)
I20260709 13:07:56.123559 11443 webserver.cc:533] Webserver started at http://127.11.44.194:46461/ using document root <none> and password file <none>
I20260709 13:07:56.124203 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:56.124432 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:56.124748 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:56.124972 23422 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60956
I20260709 13:07:56.126338 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132206461-11443-0/minicluster-data/ts-1-root/instance:
uuid: "6f4c86f091044344a16b1e47e77c3dc0"
format_stamp: "Formatted at 2026-07-09 13:07:56 on dist-test-slave-qv7r"
I20260709 13:07:56.132018 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:07:56.135908 23561 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:56.137132 11443 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:07:56.137507 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132206461-11443-0/minicluster-data/ts-1-root
uuid: "6f4c86f091044344a16b1e47e77c3dc0"
format_stamp: "Formatted at 2026-07-09 13:07:56 on dist-test-slave-qv7r"
I20260709 13:07:56.138017 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132206461-11443-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132206461-11443-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132206461-11443-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:56.157027 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:56.158443 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:56.160048 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:56.162609 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:56.162871 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:56.163138 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:56.163339 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:56.210294 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.194:44147
I20260709 13:07:56.210433 23623 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.194:44147 every 8 connection(s)
I20260709 13:07:56.216149 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:56.225726 23627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:56.227783 23628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:56.232120 23630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:56.232296 23624 heartbeater.cc:344] Connected to a master server at 127.11.44.254:37563
I20260709 13:07:56.232568 11443 server_base.cc:1061] running on GCE node
I20260709 13:07:56.233232 23624 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:56.234069 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:56.234433 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:56.234392 23624 heartbeater.cc:507] Master 127.11.44.254:37563 requested a full tablet report, sending...
I20260709 13:07:56.234934 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602476234910 us; error 0 us; skew 500 ppm
I20260709 13:07:56.235877 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:56.237041 23422 ts_manager.cc:194] Registered new tserver with Master: 6f4c86f091044344a16b1e47e77c3dc0 (127.11.44.194:44147)
I20260709 13:07:56.238760 11443 webserver.cc:533] Webserver started at http://127.11.44.195:37105/ using document root <none> and password file <none>
I20260709 13:07:56.238865 23422 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60958
I20260709 13:07:56.239547 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:56.239830 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:56.240173 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:56.241519 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132206461-11443-0/minicluster-data/ts-2-root/instance:
uuid: "92d59f76af9047e7a7f178c42581582d"
format_stamp: "Formatted at 2026-07-09 13:07:56 on dist-test-slave-qv7r"
I20260709 13:07:56.246958 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:07:56.250594 23635 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:56.251761 11443 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:07:56.252135 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132206461-11443-0/minicluster-data/ts-2-root
uuid: "92d59f76af9047e7a7f178c42581582d"
format_stamp: "Formatted at 2026-07-09 13:07:56 on dist-test-slave-qv7r"
I20260709 13:07:56.252496 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132206461-11443-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132206461-11443-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602132206461-11443-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:56.270360 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:56.271674 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:56.273072 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:56.275552 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:56.275831 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:56.276134 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:56.276331 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:56.324047 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.195:35235
I20260709 13:07:56.324142 23697 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.195:35235 every 8 connection(s)
I20260709 13:07:56.339375 23698 heartbeater.cc:344] Connected to a master server at 127.11.44.254:37563
I20260709 13:07:56.339921 23698 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:56.340755 23698 heartbeater.cc:507] Master 127.11.44.254:37563 requested a full tablet report, sending...
I20260709 13:07:56.342931 23422 ts_manager.cc:194] Registered new tserver with Master: 92d59f76af9047e7a7f178c42581582d (127.11.44.195:35235)
I20260709 13:07:56.343820 11443 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016230861s
I20260709 13:07:56.344340 23422 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60972
I20260709 13:07:56.371816 23422 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60984:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:56.374025 23422 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:56.426517 23663 tablet_service.cc:1511] Processing CreateTablet for tablet 18e841f0ca414515990ebbae1338c2ba (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=487fdbe5dd3d4fd696af561fd605e487]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:07:56.426750 23662 tablet_service.cc:1511] Processing CreateTablet for tablet 2dd4921f9ea84b19b03740562109e417 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=487fdbe5dd3d4fd696af561fd605e487]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:07:56.428144 23663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18e841f0ca414515990ebbae1338c2ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:56.428597 23514 tablet_service.cc:1511] Processing CreateTablet for tablet 18e841f0ca414515990ebbae1338c2ba (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=487fdbe5dd3d4fd696af561fd605e487]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:07:56.429278 23662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dd4921f9ea84b19b03740562109e417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:56.429999 23514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18e841f0ca414515990ebbae1338c2ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:56.434510 23513 tablet_service.cc:1511] Processing CreateTablet for tablet 2dd4921f9ea84b19b03740562109e417 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=487fdbe5dd3d4fd696af561fd605e487]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:07:56.435949 23513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dd4921f9ea84b19b03740562109e417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:56.447501 23589 tablet_service.cc:1511] Processing CreateTablet for tablet 18e841f0ca414515990ebbae1338c2ba (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=487fdbe5dd3d4fd696af561fd605e487]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:07:56.449414 23589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18e841f0ca414515990ebbae1338c2ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:56.451371 23588 tablet_service.cc:1511] Processing CreateTablet for tablet 2dd4921f9ea84b19b03740562109e417 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=487fdbe5dd3d4fd696af561fd605e487]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:07:56.453301 23588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2dd4921f9ea84b19b03740562109e417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:56.466722 23713 tablet_bootstrap.cc:492] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d: Bootstrap starting.
I20260709 13:07:56.472853 23714 tablet_bootstrap.cc:492] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9: Bootstrap starting.
I20260709 13:07:56.474857 23715 tablet_bootstrap.cc:492] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0: Bootstrap starting.
I20260709 13:07:56.476449 23713 tablet_bootstrap.cc:654] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.481261 23714 tablet_bootstrap.cc:654] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.484369 23715 tablet_bootstrap.cc:654] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.488885 23713 tablet_bootstrap.cc:492] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d: No bootstrap required, opened a new log
I20260709 13:07:56.489578 23713 ts_tablet_manager.cc:1403] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.009s
I20260709 13:07:56.492358 23715 tablet_bootstrap.cc:492] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0: No bootstrap required, opened a new log
I20260709 13:07:56.492682 23714 tablet_bootstrap.cc:492] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9: No bootstrap required, opened a new log
I20260709 13:07:56.492895 23715 ts_tablet_manager.cc:1403] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:07:56.493275 23714 ts_tablet_manager.cc:1403] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 13:07:56.493773 23713 raft_consensus.cc:359] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } } peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } }
I20260709 13:07:56.494689 23713 raft_consensus.cc:385] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.495023 23713 raft_consensus.cc:740] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d59f76af9047e7a7f178c42581582d, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.495483 23715 raft_consensus.cc:359] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } } peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } }
I20260709 13:07:56.496212 23715 raft_consensus.cc:385] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.496507 23715 raft_consensus.cc:740] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f4c86f091044344a16b1e47e77c3dc0, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.495914 23713 consensus_queue.cc:260] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } } peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } }
I20260709 13:07:56.496863 23714 raft_consensus.cc:359] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } } peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } }
I20260709 13:07:56.497263 23715 consensus_queue.cc:260] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } } peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } }
I20260709 13:07:56.497882 23714 raft_consensus.cc:385] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.498425 23714 raft_consensus.cc:740] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffcf2f5109634570a41b34baa7fd6ef9, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.499526 23714 consensus_queue.cc:260] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } } peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } }
I20260709 13:07:56.505544 23698 heartbeater.cc:499] Master 127.11.44.254:37563 was elected leader, sending a full tablet report...
I20260709 13:07:56.507268 23713 ts_tablet_manager.cc:1434] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.008s
I20260709 13:07:56.509953 23713 tablet_bootstrap.cc:492] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d: Bootstrap starting.
I20260709 13:07:56.518682 23624 heartbeater.cc:499] Master 127.11.44.254:37563 was elected leader, sending a full tablet report...
I20260709 13:07:56.519263 23714 ts_tablet_manager.cc:1434] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9: Time spent starting tablet: real 0.026s	user 0.012s	sys 0.013s
I20260709 13:07:56.520798 23715 ts_tablet_manager.cc:1434] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0: Time spent starting tablet: real 0.027s	user 0.011s	sys 0.017s
I20260709 13:07:56.521130 23549 heartbeater.cc:499] Master 127.11.44.254:37563 was elected leader, sending a full tablet report...
I20260709 13:07:56.521354 23713 tablet_bootstrap.cc:654] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.521971 23715 tablet_bootstrap.cc:492] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0: Bootstrap starting.
I20260709 13:07:56.525202 23714 tablet_bootstrap.cc:492] T 2dd4921f9ea84b19b03740562109e417 P ffcf2f5109634570a41b34baa7fd6ef9: Bootstrap starting.
I20260709 13:07:56.530246 23715 tablet_bootstrap.cc:654] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.533545 23714 tablet_bootstrap.cc:654] T 2dd4921f9ea84b19b03740562109e417 P ffcf2f5109634570a41b34baa7fd6ef9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:56.543396 23715 tablet_bootstrap.cc:492] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0: No bootstrap required, opened a new log
I20260709 13:07:56.543762 23714 tablet_bootstrap.cc:492] T 2dd4921f9ea84b19b03740562109e417 P ffcf2f5109634570a41b34baa7fd6ef9: No bootstrap required, opened a new log
I20260709 13:07:56.544010 23715 ts_tablet_manager.cc:1403] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:07:56.544399 23714 ts_tablet_manager.cc:1403] T 2dd4921f9ea84b19b03740562109e417 P ffcf2f5109634570a41b34baa7fd6ef9: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 13:07:56.547670 23715 raft_consensus.cc:359] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:56.547982 23714 raft_consensus.cc:359] T 2dd4921f9ea84b19b03740562109e417 P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:56.548610 23715 raft_consensus.cc:385] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.548911 23714 raft_consensus.cc:385] T 2dd4921f9ea84b19b03740562109e417 P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.549028 23715 raft_consensus.cc:740] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f4c86f091044344a16b1e47e77c3dc0, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.549350 23714 raft_consensus.cc:740] T 2dd4921f9ea84b19b03740562109e417 P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffcf2f5109634570a41b34baa7fd6ef9, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.550264 23715 consensus_queue.cc:260] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:56.550433 23714 consensus_queue.cc:260] T 2dd4921f9ea84b19b03740562109e417 P ffcf2f5109634570a41b34baa7fd6ef9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:56.555857 23715 ts_tablet_manager.cc:1434] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 13:07:56.558441 23714 ts_tablet_manager.cc:1434] T 2dd4921f9ea84b19b03740562109e417 P ffcf2f5109634570a41b34baa7fd6ef9: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260709 13:07:56.566097 23713 tablet_bootstrap.cc:492] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d: No bootstrap required, opened a new log
I20260709 13:07:56.566617 23713 ts_tablet_manager.cc:1403] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.036s
I20260709 13:07:56.569443 23713 raft_consensus.cc:359] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:56.570135 23713 raft_consensus.cc:385] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:56.570405 23713 raft_consensus.cc:740] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d59f76af9047e7a7f178c42581582d, State: Initialized, Role: FOLLOWER
I20260709 13:07:56.571242 23713 consensus_queue.cc:260] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:56.573374 23713 ts_tablet_manager.cc:1434] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:07:56.603644 23719 raft_consensus.cc:493] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.604137 23719 raft_consensus.cc:515] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:56.606343 23719 leader_election.cc:290] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffcf2f5109634570a41b34baa7fd6ef9 (127.11.44.193:42553), 6f4c86f091044344a16b1e47e77c3dc0 (127.11.44.194:44147)
I20260709 13:07:56.616479 23524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dd4921f9ea84b19b03740562109e417" candidate_uuid: "92d59f76af9047e7a7f178c42581582d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" is_pre_election: true
I20260709 13:07:56.617486 23524 raft_consensus.cc:2468] T 2dd4921f9ea84b19b03740562109e417 P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d59f76af9047e7a7f178c42581582d in term 0.
I20260709 13:07:56.617959 23599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dd4921f9ea84b19b03740562109e417" candidate_uuid: "92d59f76af9047e7a7f178c42581582d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f4c86f091044344a16b1e47e77c3dc0" is_pre_election: true
I20260709 13:07:56.618584 23599 raft_consensus.cc:2468] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d59f76af9047e7a7f178c42581582d in term 0.
I20260709 13:07:56.618860 23636 leader_election.cc:304] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92d59f76af9047e7a7f178c42581582d, ffcf2f5109634570a41b34baa7fd6ef9; no voters: 
I20260709 13:07:56.619769 23719 raft_consensus.cc:2804] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:56.620066 23719 raft_consensus.cc:493] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.620290 23719 raft_consensus.cc:3060] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.625865 23719 raft_consensus.cc:515] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:56.627435 23719 leader_election.cc:290] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [CANDIDATE]: Term 1 election: Requested vote from peers ffcf2f5109634570a41b34baa7fd6ef9 (127.11.44.193:42553), 6f4c86f091044344a16b1e47e77c3dc0 (127.11.44.194:44147)
I20260709 13:07:56.628364 23524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dd4921f9ea84b19b03740562109e417" candidate_uuid: "92d59f76af9047e7a7f178c42581582d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffcf2f5109634570a41b34baa7fd6ef9"
I20260709 13:07:56.628948 23524 raft_consensus.cc:3060] T 2dd4921f9ea84b19b03740562109e417 P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.628737 23599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dd4921f9ea84b19b03740562109e417" candidate_uuid: "92d59f76af9047e7a7f178c42581582d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f4c86f091044344a16b1e47e77c3dc0"
I20260709 13:07:56.629534 23599 raft_consensus.cc:3060] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.635514 23524 raft_consensus.cc:2468] T 2dd4921f9ea84b19b03740562109e417 P ffcf2f5109634570a41b34baa7fd6ef9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d59f76af9047e7a7f178c42581582d in term 1.
I20260709 13:07:56.636552 23599 raft_consensus.cc:2468] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d59f76af9047e7a7f178c42581582d in term 1.
I20260709 13:07:56.636662 23636 leader_election.cc:304] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92d59f76af9047e7a7f178c42581582d, ffcf2f5109634570a41b34baa7fd6ef9; no voters: 
I20260709 13:07:56.637650 23719 raft_consensus.cc:2804] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:56.638620 23719 raft_consensus.cc:697] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [term 1 LEADER]: Becoming Leader. State: Replica: 92d59f76af9047e7a7f178c42581582d, State: Running, Role: LEADER
I20260709 13:07:56.639441 23719 consensus_queue.cc:237] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:56.647027 23422 catalog_manager.cc:5697] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d reported cstate change: term changed from 0 to 1, leader changed from <none> to 92d59f76af9047e7a7f178c42581582d (127.11.44.195). New cstate: current_term: 1 leader_uuid: "92d59f76af9047e7a7f178c42581582d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } health_report { overall_health: HEALTHY } } }
W20260709 13:07:56.888990 23470 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:07:56.913635 23720 raft_consensus.cc:493] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.914306 23720 raft_consensus.cc:515] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } } peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } }
I20260709 13:07:56.916412 23720 leader_election.cc:290] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 92d59f76af9047e7a7f178c42581582d (127.11.44.195:35235), ffcf2f5109634570a41b34baa7fd6ef9 (127.11.44.193:42553)
I20260709 13:07:56.925907 23719 raft_consensus.cc:493] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.926448 23719 raft_consensus.cc:515] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } } peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } }
I20260709 13:07:56.926782 23673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e841f0ca414515990ebbae1338c2ba" candidate_uuid: "6f4c86f091044344a16b1e47e77c3dc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d59f76af9047e7a7f178c42581582d" is_pre_election: true
I20260709 13:07:56.927470 23673 raft_consensus.cc:2468] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f4c86f091044344a16b1e47e77c3dc0 in term 0.
I20260709 13:07:56.927955 23524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e841f0ca414515990ebbae1338c2ba" candidate_uuid: "6f4c86f091044344a16b1e47e77c3dc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" is_pre_election: true
I20260709 13:07:56.928594 23524 raft_consensus.cc:2468] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f4c86f091044344a16b1e47e77c3dc0 in term 0.
I20260709 13:07:56.928637 23719 leader_election.cc:290] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffcf2f5109634570a41b34baa7fd6ef9 (127.11.44.193:42553), 6f4c86f091044344a16b1e47e77c3dc0 (127.11.44.194:44147)
I20260709 13:07:56.928817 23562 leader_election.cc:304] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f4c86f091044344a16b1e47e77c3dc0, 92d59f76af9047e7a7f178c42581582d; no voters: 
I20260709 13:07:56.929756 23523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e841f0ca414515990ebbae1338c2ba" candidate_uuid: "92d59f76af9047e7a7f178c42581582d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" is_pre_election: true
I20260709 13:07:56.930157 23720 raft_consensus.cc:2804] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:56.930464 23523 raft_consensus.cc:2468] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92d59f76af9047e7a7f178c42581582d in term 0.
I20260709 13:07:56.930509 23599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e841f0ca414515990ebbae1338c2ba" candidate_uuid: "92d59f76af9047e7a7f178c42581582d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f4c86f091044344a16b1e47e77c3dc0" is_pre_election: true
I20260709 13:07:56.930771 23720 raft_consensus.cc:493] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.931214 23720 raft_consensus.cc:3060] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.931656 23636 leader_election.cc:304] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92d59f76af9047e7a7f178c42581582d, ffcf2f5109634570a41b34baa7fd6ef9; no voters: 
I20260709 13:07:56.932523 23719 raft_consensus.cc:2804] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:56.932893 23719 raft_consensus.cc:493] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.933219 23719 raft_consensus.cc:3060] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.937530 23720 raft_consensus.cc:515] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } } peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } }
I20260709 13:07:56.938809 23599 raft_consensus.cc:2393] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 92d59f76af9047e7a7f178c42581582d in current term 1: Already voted for candidate 6f4c86f091044344a16b1e47e77c3dc0 in this term.
I20260709 13:07:56.938944 23719 raft_consensus.cc:515] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } } peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } }
I20260709 13:07:56.939673 23720 leader_election.cc:290] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [CANDIDATE]: Term 1 election: Requested vote from peers 92d59f76af9047e7a7f178c42581582d (127.11.44.195:35235), ffcf2f5109634570a41b34baa7fd6ef9 (127.11.44.193:42553)
I20260709 13:07:56.940822 23673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e841f0ca414515990ebbae1338c2ba" candidate_uuid: "6f4c86f091044344a16b1e47e77c3dc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d59f76af9047e7a7f178c42581582d"
I20260709 13:07:56.941550 23523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e841f0ca414515990ebbae1338c2ba" candidate_uuid: "6f4c86f091044344a16b1e47e77c3dc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffcf2f5109634570a41b34baa7fd6ef9"
I20260709 13:07:56.941625 23673 raft_consensus.cc:2393] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f4c86f091044344a16b1e47e77c3dc0 in current term 1: Already voted for candidate 92d59f76af9047e7a7f178c42581582d in this term.
I20260709 13:07:56.942200 23523 raft_consensus.cc:3060] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:56.943400 23599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e841f0ca414515990ebbae1338c2ba" candidate_uuid: "92d59f76af9047e7a7f178c42581582d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f4c86f091044344a16b1e47e77c3dc0"
I20260709 13:07:56.942780 23524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e841f0ca414515990ebbae1338c2ba" candidate_uuid: "92d59f76af9047e7a7f178c42581582d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffcf2f5109634570a41b34baa7fd6ef9"
I20260709 13:07:56.944012 23599 raft_consensus.cc:2393] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 92d59f76af9047e7a7f178c42581582d in current term 1: Already voted for candidate 6f4c86f091044344a16b1e47e77c3dc0 in this term.
I20260709 13:07:56.941929 23719 leader_election.cc:290] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d [CANDIDATE]: Term 1 election: Requested vote from peers ffcf2f5109634570a41b34baa7fd6ef9 (127.11.44.193:42553), 6f4c86f091044344a16b1e47e77c3dc0 (127.11.44.194:44147)
I20260709 13:07:56.945263 23636 leader_election.cc:304] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 92d59f76af9047e7a7f178c42581582d; no voters: 6f4c86f091044344a16b1e47e77c3dc0, ffcf2f5109634570a41b34baa7fd6ef9
I20260709 13:07:56.946010 23719 raft_consensus.cc:2749] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:07:56.949366 23523 raft_consensus.cc:2468] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f4c86f091044344a16b1e47e77c3dc0 in term 1.
I20260709 13:07:56.950418 23562 leader_election.cc:304] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f4c86f091044344a16b1e47e77c3dc0, ffcf2f5109634570a41b34baa7fd6ef9; no voters: 92d59f76af9047e7a7f178c42581582d
I20260709 13:07:56.951053 23720 raft_consensus.cc:2804] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:56.951969 23720 raft_consensus.cc:697] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [term 1 LEADER]: Becoming Leader. State: Replica: 6f4c86f091044344a16b1e47e77c3dc0, State: Running, Role: LEADER
I20260709 13:07:56.952769 23720 consensus_queue.cc:237] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } } peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } }
I20260709 13:07:56.960139 23422 catalog_manager.cc:5697] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f4c86f091044344a16b1e47e77c3dc0 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "6f4c86f091044344a16b1e47e77c3dc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:57.035463 23422 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60998:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:57.037503 23422 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:57.062244 23514 tablet_service.cc:1511] Processing CreateTablet for tablet 5b61a34c58b8453db19d2f29f1deda41 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0968ddb8658249268163cf11c26fa6dc]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:07:57.063417 23588 tablet_service.cc:1511] Processing CreateTablet for tablet 5b61a34c58b8453db19d2f29f1deda41 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0968ddb8658249268163cf11c26fa6dc]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:07:57.064815 23588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b61a34c58b8453db19d2f29f1deda41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:57.063900 23514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b61a34c58b8453db19d2f29f1deda41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:57.066043 23663 tablet_service.cc:1511] Processing CreateTablet for tablet 5b61a34c58b8453db19d2f29f1deda41 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0968ddb8658249268163cf11c26fa6dc]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:07:57.067379 23663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b61a34c58b8453db19d2f29f1deda41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:57.068022 23589 tablet_service.cc:1511] Processing CreateTablet for tablet 28e7a0a3d1054315891ad572d76b7ac4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0968ddb8658249268163cf11c26fa6dc]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:07:57.069378 23589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28e7a0a3d1054315891ad572d76b7ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:57.071501 23662 tablet_service.cc:1511] Processing CreateTablet for tablet 28e7a0a3d1054315891ad572d76b7ac4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0968ddb8658249268163cf11c26fa6dc]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:07:57.072793 23662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28e7a0a3d1054315891ad572d76b7ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:57.077320 23513 tablet_service.cc:1511] Processing CreateTablet for tablet 28e7a0a3d1054315891ad572d76b7ac4 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=0968ddb8658249268163cf11c26fa6dc]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:07:57.078758 23513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28e7a0a3d1054315891ad572d76b7ac4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:57.108417 23740 tablet_bootstrap.cc:492] T 28e7a0a3d1054315891ad572d76b7ac4 P 92d59f76af9047e7a7f178c42581582d: Bootstrap starting.
I20260709 13:07:57.110669 23738 tablet_bootstrap.cc:492] T 5b61a34c58b8453db19d2f29f1deda41 P 6f4c86f091044344a16b1e47e77c3dc0: Bootstrap starting.
I20260709 13:07:57.109501 23739 tablet_bootstrap.cc:492] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9: Bootstrap starting.
I20260709 13:07:57.117673 23738 tablet_bootstrap.cc:654] T 5b61a34c58b8453db19d2f29f1deda41 P 6f4c86f091044344a16b1e47e77c3dc0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:57.118207 23739 tablet_bootstrap.cc:654] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:57.119058 23740 tablet_bootstrap.cc:654] T 28e7a0a3d1054315891ad572d76b7ac4 P 92d59f76af9047e7a7f178c42581582d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:57.124631 23719 consensus_queue.cc:1048] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:57.124788 23739 tablet_bootstrap.cc:492] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9: No bootstrap required, opened a new log
I20260709 13:07:57.124830 23738 tablet_bootstrap.cc:492] T 5b61a34c58b8453db19d2f29f1deda41 P 6f4c86f091044344a16b1e47e77c3dc0: No bootstrap required, opened a new log
I20260709 13:07:57.125540 23740 tablet_bootstrap.cc:492] T 28e7a0a3d1054315891ad572d76b7ac4 P 92d59f76af9047e7a7f178c42581582d: No bootstrap required, opened a new log
I20260709 13:07:57.125845 23739 ts_tablet_manager.cc:1403] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260709 13:07:57.125929 23738 ts_tablet_manager.cc:1403] T 5b61a34c58b8453db19d2f29f1deda41 P 6f4c86f091044344a16b1e47e77c3dc0: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:07:57.126086 23740 ts_tablet_manager.cc:1403] T 28e7a0a3d1054315891ad572d76b7ac4 P 92d59f76af9047e7a7f178c42581582d: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 13:07:57.129312 23738 raft_consensus.cc:359] T 5b61a34c58b8453db19d2f29f1deda41 P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.130280 23738 raft_consensus.cc:385] T 5b61a34c58b8453db19d2f29f1deda41 P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:57.130671 23738 raft_consensus.cc:740] T 5b61a34c58b8453db19d2f29f1deda41 P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f4c86f091044344a16b1e47e77c3dc0, State: Initialized, Role: FOLLOWER
I20260709 13:07:57.130383 23740 raft_consensus.cc:359] T 28e7a0a3d1054315891ad572d76b7ac4 P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.131471 23740 raft_consensus.cc:385] T 28e7a0a3d1054315891ad572d76b7ac4 P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:57.131872 23740 raft_consensus.cc:740] T 28e7a0a3d1054315891ad572d76b7ac4 P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d59f76af9047e7a7f178c42581582d, State: Initialized, Role: FOLLOWER
I20260709 13:07:57.131752 23738 consensus_queue.cc:260] T 5b61a34c58b8453db19d2f29f1deda41 P 6f4c86f091044344a16b1e47e77c3dc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.133059 23740 consensus_queue.cc:260] T 28e7a0a3d1054315891ad572d76b7ac4 P 92d59f76af9047e7a7f178c42581582d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.135282 23738 ts_tablet_manager.cc:1434] T 5b61a34c58b8453db19d2f29f1deda41 P 6f4c86f091044344a16b1e47e77c3dc0: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:07:57.135509 23740 ts_tablet_manager.cc:1434] T 28e7a0a3d1054315891ad572d76b7ac4 P 92d59f76af9047e7a7f178c42581582d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:07:57.136476 23738 tablet_bootstrap.cc:492] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0: Bootstrap starting.
I20260709 13:07:57.136574 23740 tablet_bootstrap.cc:492] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d: Bootstrap starting.
I20260709 13:07:57.137928 23719 consensus_queue.cc:1048] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:57.144033 23738 tablet_bootstrap.cc:654] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:57.144161 23740 tablet_bootstrap.cc:654] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:57.132304 23739 raft_consensus.cc:359] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.159830 23739 raft_consensus.cc:385] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:57.160305 23739 raft_consensus.cc:740] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffcf2f5109634570a41b34baa7fd6ef9, State: Initialized, Role: FOLLOWER
I20260709 13:07:57.161718 23739 consensus_queue.cc:260] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.163093 23744 raft_consensus.cc:493] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.163686 23744 raft_consensus.cc:515] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.172089 23744 leader_election.cc:290] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f4c86f091044344a16b1e47e77c3dc0 (127.11.44.194:44147), 92d59f76af9047e7a7f178c42581582d (127.11.44.195:35235)
I20260709 13:07:57.178155 23739 ts_tablet_manager.cc:1434] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.001s
I20260709 13:07:57.179595 23739 tablet_bootstrap.cc:492] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9: Bootstrap starting.
I20260709 13:07:57.191584 23739 tablet_bootstrap.cc:654] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:57.201797 23740 tablet_bootstrap.cc:492] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d: No bootstrap required, opened a new log
I20260709 13:07:57.201804 23738 tablet_bootstrap.cc:492] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0: No bootstrap required, opened a new log
I20260709 13:07:57.202629 23740 ts_tablet_manager.cc:1403] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.049s
I20260709 13:07:57.202690 23738 ts_tablet_manager.cc:1403] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0: Time spent bootstrapping tablet: real 0.066s	user 0.024s	sys 0.039s
I20260709 13:07:57.205929 23740 raft_consensus.cc:359] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.206857 23740 raft_consensus.cc:385] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:57.207145 23740 raft_consensus.cc:740] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92d59f76af9047e7a7f178c42581582d, State: Initialized, Role: FOLLOWER
I20260709 13:07:57.208045 23740 consensus_queue.cc:260] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.210868 23738 raft_consensus.cc:359] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.211920 23738 raft_consensus.cc:385] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:57.212386 23738 raft_consensus.cc:740] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f4c86f091044344a16b1e47e77c3dc0, State: Initialized, Role: FOLLOWER
I20260709 13:07:57.213459 23738 consensus_queue.cc:260] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.216566 23738 ts_tablet_manager.cc:1434] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:07:57.235172 23599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b61a34c58b8453db19d2f29f1deda41" candidate_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f4c86f091044344a16b1e47e77c3dc0" is_pre_election: true
I20260709 13:07:57.236052 23599 raft_consensus.cc:2468] T 5b61a34c58b8453db19d2f29f1deda41 P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffcf2f5109634570a41b34baa7fd6ef9 in term 0.
I20260709 13:07:57.238003 23488 leader_election.cc:304] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f4c86f091044344a16b1e47e77c3dc0, ffcf2f5109634570a41b34baa7fd6ef9; no voters: 
I20260709 13:07:57.239068 23744 raft_consensus.cc:2804] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:57.239535 23744 raft_consensus.cc:493] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.239915 23744 raft_consensus.cc:3060] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:57.247475 23673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b61a34c58b8453db19d2f29f1deda41" candidate_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d59f76af9047e7a7f178c42581582d" is_pre_election: true
I20260709 13:07:57.248576 23673 raft_consensus.cc:2468] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffcf2f5109634570a41b34baa7fd6ef9 in term 0.
I20260709 13:07:57.253697 23744 raft_consensus.cc:515] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.255685 23740 ts_tablet_manager.cc:1434] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d: Time spent starting tablet: real 0.053s	user 0.020s	sys 0.009s
I20260709 13:07:57.256752 23739 tablet_bootstrap.cc:492] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9: No bootstrap required, opened a new log
I20260709 13:07:57.257366 23739 ts_tablet_manager.cc:1403] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.022s
I20260709 13:07:57.258452 23744 leader_election.cc:290] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [CANDIDATE]: Term 1 election: Requested vote from peers 6f4c86f091044344a16b1e47e77c3dc0 (127.11.44.194:44147), 92d59f76af9047e7a7f178c42581582d (127.11.44.195:35235)
I20260709 13:07:57.259609 23673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b61a34c58b8453db19d2f29f1deda41" candidate_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d59f76af9047e7a7f178c42581582d"
I20260709 13:07:57.259493 23598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b61a34c58b8453db19d2f29f1deda41" candidate_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f4c86f091044344a16b1e47e77c3dc0"
I20260709 13:07:57.260551 23673 raft_consensus.cc:3060] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:57.260705 23598 raft_consensus.cc:3060] T 5b61a34c58b8453db19d2f29f1deda41 P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:57.271355 23739 raft_consensus.cc:359] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.272527 23739 raft_consensus.cc:385] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:57.272838 23598 raft_consensus.cc:2468] T 5b61a34c58b8453db19d2f29f1deda41 P 6f4c86f091044344a16b1e47e77c3dc0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffcf2f5109634570a41b34baa7fd6ef9 in term 1.
I20260709 13:07:57.272871 23739 raft_consensus.cc:740] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffcf2f5109634570a41b34baa7fd6ef9, State: Initialized, Role: FOLLOWER
I20260709 13:07:57.275157 23488 leader_election.cc:304] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f4c86f091044344a16b1e47e77c3dc0, ffcf2f5109634570a41b34baa7fd6ef9; no voters: 
I20260709 13:07:57.275328 23673 raft_consensus.cc:2468] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffcf2f5109634570a41b34baa7fd6ef9 in term 1.
I20260709 13:07:57.276160 23744 raft_consensus.cc:2804] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:57.276825 23739 consensus_queue.cc:260] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.277756 23744 raft_consensus.cc:697] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [term 1 LEADER]: Becoming Leader. State: Replica: ffcf2f5109634570a41b34baa7fd6ef9, State: Running, Role: LEADER
I20260709 13:07:57.278883 23744 consensus_queue.cc:237] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.288552 23739 ts_tablet_manager.cc:1434] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9: Time spent starting tablet: real 0.031s	user 0.011s	sys 0.003s
I20260709 13:07:57.291633 23422 catalog_manager.cc:5697] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 reported cstate change: term changed from 0 to 1, leader changed from <none> to ffcf2f5109634570a41b34baa7fd6ef9 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.330404 23720 raft_consensus.cc:493] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.331032 23720 raft_consensus.cc:515] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.332818 23720 leader_election.cc:290] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffcf2f5109634570a41b34baa7fd6ef9 (127.11.44.193:42553), 92d59f76af9047e7a7f178c42581582d (127.11.44.195:35235)
I20260709 13:07:57.334005 23523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a0a3d1054315891ad572d76b7ac4" candidate_uuid: "6f4c86f091044344a16b1e47e77c3dc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" is_pre_election: true
I20260709 13:07:57.334116 23673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a0a3d1054315891ad572d76b7ac4" candidate_uuid: "6f4c86f091044344a16b1e47e77c3dc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d59f76af9047e7a7f178c42581582d" is_pre_election: true
I20260709 13:07:57.334874 23523 raft_consensus.cc:2468] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f4c86f091044344a16b1e47e77c3dc0 in term 0.
I20260709 13:07:57.334882 23673 raft_consensus.cc:2468] T 28e7a0a3d1054315891ad572d76b7ac4 P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f4c86f091044344a16b1e47e77c3dc0 in term 0.
I20260709 13:07:57.335963 23562 leader_election.cc:304] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f4c86f091044344a16b1e47e77c3dc0, ffcf2f5109634570a41b34baa7fd6ef9; no voters: 
I20260709 13:07:57.336638 23720 raft_consensus.cc:2804] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:57.337005 23720 raft_consensus.cc:493] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.337368 23720 raft_consensus.cc:3060] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:57.337762 23730 consensus_queue.cc:1048] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:57.343744 23720 raft_consensus.cc:515] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.349327 23523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a0a3d1054315891ad572d76b7ac4" candidate_uuid: "6f4c86f091044344a16b1e47e77c3dc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffcf2f5109634570a41b34baa7fd6ef9"
I20260709 13:07:57.349988 23523 raft_consensus.cc:3060] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:57.350143 23720 leader_election.cc:290] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [CANDIDATE]: Term 1 election: Requested vote from peers ffcf2f5109634570a41b34baa7fd6ef9 (127.11.44.193:42553), 92d59f76af9047e7a7f178c42581582d (127.11.44.195:35235)
I20260709 13:07:57.350739 23720 consensus_queue.cc:1048] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:57.359323 23673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a0a3d1054315891ad572d76b7ac4" candidate_uuid: "6f4c86f091044344a16b1e47e77c3dc0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "92d59f76af9047e7a7f178c42581582d"
I20260709 13:07:57.360118 23673 raft_consensus.cc:3060] T 28e7a0a3d1054315891ad572d76b7ac4 P 92d59f76af9047e7a7f178c42581582d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:57.362815 23523 raft_consensus.cc:2468] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f4c86f091044344a16b1e47e77c3dc0 in term 1.
I20260709 13:07:57.364725 23562 leader_election.cc:304] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f4c86f091044344a16b1e47e77c3dc0, ffcf2f5109634570a41b34baa7fd6ef9; no voters: 
I20260709 13:07:57.366302 23730 raft_consensus.cc:2804] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:57.366796 23730 raft_consensus.cc:697] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [term 1 LEADER]: Becoming Leader. State: Replica: 6f4c86f091044344a16b1e47e77c3dc0, State: Running, Role: LEADER
I20260709 13:07:57.367656 23730 consensus_queue.cc:237] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.369195 23673 raft_consensus.cc:2468] T 28e7a0a3d1054315891ad572d76b7ac4 P 92d59f76af9047e7a7f178c42581582d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f4c86f091044344a16b1e47e77c3dc0 in term 1.
I20260709 13:07:57.379635 23420 catalog_manager.cc:5697] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f4c86f091044344a16b1e47e77c3dc0 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "6f4c86f091044344a16b1e47e77c3dc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.429059 23598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18e841f0ca414515990ebbae1338c2ba"
dest_uuid: "6f4c86f091044344a16b1e47e77c3dc0"
mode: GRACEFUL
new_leader_uuid: "ffcf2f5109634570a41b34baa7fd6ef9"
 from {username='slave'} at 127.0.0.1:43262
I20260709 13:07:57.429713 23598 raft_consensus.cc:606] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [term 1 LEADER]: Received request to transfer leadership to TS ffcf2f5109634570a41b34baa7fd6ef9
I20260709 13:07:57.443778 23673 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2dd4921f9ea84b19b03740562109e417"
dest_uuid: "92d59f76af9047e7a7f178c42581582d"
mode: GRACEFUL
new_leader_uuid: "6f4c86f091044344a16b1e47e77c3dc0"
 from {username='slave'} at 127.0.0.1:56000
I20260709 13:07:57.444324 23673 raft_consensus.cc:606] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [term 1 LEADER]: Received request to transfer leadership to TS 6f4c86f091044344a16b1e47e77c3dc0
I20260709 13:07:57.454100 23598 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28e7a0a3d1054315891ad572d76b7ac4"
dest_uuid: "6f4c86f091044344a16b1e47e77c3dc0"
mode: GRACEFUL
new_leader_uuid: "ffcf2f5109634570a41b34baa7fd6ef9"
 from {username='slave'} at 127.0.0.1:43262
I20260709 13:07:57.454665 23598 raft_consensus.cc:606] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [term 1 LEADER]: Received request to transfer leadership to TS ffcf2f5109634570a41b34baa7fd6ef9
I20260709 13:07:57.638733 23719 raft_consensus.cc:993] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d: : Instructing follower 6f4c86f091044344a16b1e47e77c3dc0 to start an election
I20260709 13:07:57.639350 23755 raft_consensus.cc:1081] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [term 1 LEADER]: Signalling peer 6f4c86f091044344a16b1e47e77c3dc0 to start an election
I20260709 13:07:57.640911 23598 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2dd4921f9ea84b19b03740562109e417"
dest_uuid: "6f4c86f091044344a16b1e47e77c3dc0"
 from {username='slave'} at 127.0.0.1:43254
I20260709 13:07:57.641389 23598 raft_consensus.cc:493] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:57.641705 23598 raft_consensus.cc:3060] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:57.646757 23598 raft_consensus.cc:515] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.648607 23598 leader_election.cc:290] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0 [CANDIDATE]: Term 2 election: Requested vote from peers ffcf2f5109634570a41b34baa7fd6ef9 (127.11.44.193:42553), 92d59f76af9047e7a7f178c42581582d (127.11.44.195:35235)
I20260709 13:07:57.649595 23524 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dd4921f9ea84b19b03740562109e417" candidate_uuid: "6f4c86f091044344a16b1e47e77c3dc0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ffcf2f5109634570a41b34baa7fd6ef9"
I20260709 13:07:57.649866 23673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2dd4921f9ea84b19b03740562109e417" candidate_uuid: "6f4c86f091044344a16b1e47e77c3dc0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92d59f76af9047e7a7f178c42581582d"
I20260709 13:07:57.650173 23524 raft_consensus.cc:3060] T 2dd4921f9ea84b19b03740562109e417 P ffcf2f5109634570a41b34baa7fd6ef9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:57.650472 23673 raft_consensus.cc:3055] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:57.650836 23673 raft_consensus.cc:740] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 92d59f76af9047e7a7f178c42581582d, State: Running, Role: LEADER
I20260709 13:07:57.651547 23673 consensus_queue.cc:260] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.652725 23673 raft_consensus.cc:3060] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:57.656625 23524 raft_consensus.cc:2468] T 2dd4921f9ea84b19b03740562109e417 P ffcf2f5109634570a41b34baa7fd6ef9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f4c86f091044344a16b1e47e77c3dc0 in term 2.
I20260709 13:07:57.657886 23562 leader_election.cc:304] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f4c86f091044344a16b1e47e77c3dc0, ffcf2f5109634570a41b34baa7fd6ef9; no voters: 
I20260709 13:07:57.658708 23730 raft_consensus.cc:2804] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:57.659247 23730 raft_consensus.cc:697] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0 [term 2 LEADER]: Becoming Leader. State: Replica: 6f4c86f091044344a16b1e47e77c3dc0, State: Running, Role: LEADER
I20260709 13:07:57.659582 23673 raft_consensus.cc:2468] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f4c86f091044344a16b1e47e77c3dc0 in term 2.
I20260709 13:07:57.660120 23730 consensus_queue.cc:237] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.667560 23422 catalog_manager.cc:5697] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0 reported cstate change: term changed from 1 to 2, leader changed from 92d59f76af9047e7a7f178c42581582d (127.11.44.195) to 6f4c86f091044344a16b1e47e77c3dc0 (127.11.44.194). New cstate: current_term: 2 leader_uuid: "6f4c86f091044344a16b1e47e77c3dc0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.699584 23744 consensus_queue.cc:1048] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:57.711544 23744 consensus_queue.cc:1048] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:57.783181 23730 consensus_queue.cc:1048] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:07:57.793952 23764 raft_consensus.cc:993] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0: : Instructing follower ffcf2f5109634570a41b34baa7fd6ef9 to start an election
I20260709 13:07:57.794530 23764 raft_consensus.cc:1081] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [term 1 LEADER]: Signalling peer ffcf2f5109634570a41b34baa7fd6ef9 to start an election
I20260709 13:07:57.796563 23524 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18e841f0ca414515990ebbae1338c2ba"
dest_uuid: "ffcf2f5109634570a41b34baa7fd6ef9"
 from {username='slave'} at 127.0.0.1:55062
I20260709 13:07:57.797209 23524 raft_consensus.cc:493] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:57.797631 23524 raft_consensus.cc:3060] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:57.797586 23764 consensus_queue.cc:1048] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:07:57.807382 23524 raft_consensus.cc:515] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } } peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } }
I20260709 13:07:57.809005 23720 raft_consensus.cc:993] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0: : Instructing follower ffcf2f5109634570a41b34baa7fd6ef9 to start an election
I20260709 13:07:57.809610 23720 raft_consensus.cc:1081] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [term 1 LEADER]: Signalling peer ffcf2f5109634570a41b34baa7fd6ef9 to start an election
I20260709 13:07:57.811067 23524 leader_election.cc:290] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9 [CANDIDATE]: Term 2 election: Requested vote from peers 92d59f76af9047e7a7f178c42581582d (127.11.44.195:35235), 6f4c86f091044344a16b1e47e77c3dc0 (127.11.44.194:44147)
I20260709 13:07:57.811880 23673 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e841f0ca414515990ebbae1338c2ba" candidate_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92d59f76af9047e7a7f178c42581582d"
I20260709 13:07:57.811949 23523 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28e7a0a3d1054315891ad572d76b7ac4"
dest_uuid: "ffcf2f5109634570a41b34baa7fd6ef9"
 from {username='slave'} at 127.0.0.1:55062
I20260709 13:07:57.812703 23673 raft_consensus.cc:3060] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:57.812997 23523 raft_consensus.cc:493] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:57.813707 23523 raft_consensus.cc:3060] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:57.812700 23598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18e841f0ca414515990ebbae1338c2ba" candidate_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f4c86f091044344a16b1e47e77c3dc0"
I20260709 13:07:57.814448 23598 raft_consensus.cc:3055] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:57.814929 23598 raft_consensus.cc:740] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f4c86f091044344a16b1e47e77c3dc0, State: Running, Role: LEADER
I20260709 13:07:57.815876 23598 consensus_queue.cc:260] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } } peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } }
I20260709 13:07:57.817284 23598 raft_consensus.cc:3060] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:57.819914 23523 raft_consensus.cc:515] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.821424 23673 raft_consensus.cc:2468] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffcf2f5109634570a41b34baa7fd6ef9 in term 2.
I20260709 13:07:57.822889 23487 leader_election.cc:304] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92d59f76af9047e7a7f178c42581582d, ffcf2f5109634570a41b34baa7fd6ef9; no voters: 
I20260709 13:07:57.824059 23599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a0a3d1054315891ad572d76b7ac4" candidate_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f4c86f091044344a16b1e47e77c3dc0"
I20260709 13:07:57.824805 23599 raft_consensus.cc:3055] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:57.825084 23672 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28e7a0a3d1054315891ad572d76b7ac4" candidate_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "92d59f76af9047e7a7f178c42581582d"
I20260709 13:07:57.825179 23599 raft_consensus.cc:740] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f4c86f091044344a16b1e47e77c3dc0, State: Running, Role: LEADER
I20260709 13:07:57.825613 23598 raft_consensus.cc:2468] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffcf2f5109634570a41b34baa7fd6ef9 in term 2.
I20260709 13:07:57.825838 23672 raft_consensus.cc:3060] T 28e7a0a3d1054315891ad572d76b7ac4 P 92d59f76af9047e7a7f178c42581582d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:57.826375 23599 consensus_queue.cc:260] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.827565 23744 raft_consensus.cc:2804] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:57.828202 23744 raft_consensus.cc:697] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9 [term 2 LEADER]: Becoming Leader. State: Replica: ffcf2f5109634570a41b34baa7fd6ef9, State: Running, Role: LEADER
I20260709 13:07:57.827720 23599 raft_consensus.cc:3060] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:57.829137 23744 consensus_queue.cc:237] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } } peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } }
I20260709 13:07:57.822907 23523 leader_election.cc:290] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9 [CANDIDATE]: Term 2 election: Requested vote from peers 6f4c86f091044344a16b1e47e77c3dc0 (127.11.44.194:44147), 92d59f76af9047e7a7f178c42581582d (127.11.44.195:35235)
I20260709 13:07:57.834486 23672 raft_consensus.cc:2468] T 28e7a0a3d1054315891ad572d76b7ac4 P 92d59f76af9047e7a7f178c42581582d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffcf2f5109634570a41b34baa7fd6ef9 in term 2.
I20260709 13:07:57.835863 23487 leader_election.cc:304] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 92d59f76af9047e7a7f178c42581582d, ffcf2f5109634570a41b34baa7fd6ef9; no voters: 
I20260709 13:07:57.836709 23599 raft_consensus.cc:2468] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffcf2f5109634570a41b34baa7fd6ef9 in term 2.
I20260709 13:07:57.836758 23744 raft_consensus.cc:2804] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:57.837914 23744 raft_consensus.cc:697] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9 [term 2 LEADER]: Becoming Leader. State: Replica: ffcf2f5109634570a41b34baa7fd6ef9, State: Running, Role: LEADER
I20260709 13:07:57.838897 23744 consensus_queue.cc:237] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:57.838841 23422 catalog_manager.cc:5697] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9 reported cstate change: term changed from 1 to 2, leader changed from 6f4c86f091044344a16b1e47e77c3dc0 (127.11.44.194) to ffcf2f5109634570a41b34baa7fd6ef9 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.850809 23422 catalog_manager.cc:5697] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9 reported cstate change: term changed from 1 to 2, leader changed from 6f4c86f091044344a16b1e47e77c3dc0 (127.11.44.194) to ffcf2f5109634570a41b34baa7fd6ef9 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:57.911562 11443 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:07:57.913050 11443 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:07:57.913383 11443 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:07:57.925992 23523 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b61a34c58b8453db19d2f29f1deda41"
dest_uuid: "ffcf2f5109634570a41b34baa7fd6ef9"
mode: GRACEFUL
new_leader_uuid: "92d59f76af9047e7a7f178c42581582d"
 from {username='slave'} at 127.0.0.1:55066
I20260709 13:07:57.926487 23523 raft_consensus.cc:606] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [term 1 LEADER]: Received request to transfer leadership to TS 92d59f76af9047e7a7f178c42581582d
I20260709 13:07:57.927690 11443 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:07:58.052695 23523 raft_consensus.cc:1275] T 2dd4921f9ea84b19b03740562109e417 P ffcf2f5109634570a41b34baa7fd6ef9 [term 2 FOLLOWER]: Refusing update from remote peer 6f4c86f091044344a16b1e47e77c3dc0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:58.054168 23720 consensus_queue.cc:1048] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:58.064152 23672 raft_consensus.cc:1275] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [term 2 FOLLOWER]: Refusing update from remote peer 6f4c86f091044344a16b1e47e77c3dc0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:58.065827 23730 consensus_queue.cc:1048] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:58.160808 23760 raft_consensus.cc:993] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9: : Instructing follower 92d59f76af9047e7a7f178c42581582d to start an election
I20260709 13:07:58.161330 23744 raft_consensus.cc:1081] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [term 1 LEADER]: Signalling peer 92d59f76af9047e7a7f178c42581582d to start an election
I20260709 13:07:58.162787 23672 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b61a34c58b8453db19d2f29f1deda41"
dest_uuid: "92d59f76af9047e7a7f178c42581582d"
 from {username='slave'} at 127.0.0.1:55990
I20260709 13:07:58.163335 23672 raft_consensus.cc:493] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:58.163596 23672 raft_consensus.cc:3060] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:58.168546 23672 raft_consensus.cc:515] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:58.170210 23672 leader_election.cc:290] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d [CANDIDATE]: Term 2 election: Requested vote from peers ffcf2f5109634570a41b34baa7fd6ef9 (127.11.44.193:42553), 6f4c86f091044344a16b1e47e77c3dc0 (127.11.44.194:44147)
I20260709 13:07:58.171063 23523 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b61a34c58b8453db19d2f29f1deda41" candidate_uuid: "92d59f76af9047e7a7f178c42581582d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ffcf2f5109634570a41b34baa7fd6ef9"
I20260709 13:07:58.171380 23599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b61a34c58b8453db19d2f29f1deda41" candidate_uuid: "92d59f76af9047e7a7f178c42581582d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f4c86f091044344a16b1e47e77c3dc0"
I20260709 13:07:58.171746 23523 raft_consensus.cc:3055] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:07:58.171984 23599 raft_consensus.cc:3060] T 5b61a34c58b8453db19d2f29f1deda41 P 6f4c86f091044344a16b1e47e77c3dc0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:58.172137 23523 raft_consensus.cc:740] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ffcf2f5109634570a41b34baa7fd6ef9, State: Running, Role: LEADER
I20260709 13:07:58.172952 23523 consensus_queue.cc:260] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:58.173951 23523 raft_consensus.cc:3060] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:07:58.177325 23599 raft_consensus.cc:2468] T 5b61a34c58b8453db19d2f29f1deda41 P 6f4c86f091044344a16b1e47e77c3dc0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d59f76af9047e7a7f178c42581582d in term 2.
I20260709 13:07:58.178900 23637 leader_election.cc:304] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f4c86f091044344a16b1e47e77c3dc0, 92d59f76af9047e7a7f178c42581582d; no voters: 
I20260709 13:07:58.179466 23523 raft_consensus.cc:2468] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92d59f76af9047e7a7f178c42581582d in term 2.
I20260709 13:07:58.180035 23755 raft_consensus.cc:2804] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:07:58.181094 23755 raft_consensus.cc:697] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d [term 2 LEADER]: Becoming Leader. State: Replica: 92d59f76af9047e7a7f178c42581582d, State: Running, Role: LEADER
I20260709 13:07:58.182003 23755 consensus_queue.cc:237] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } }
I20260709 13:07:58.187774 23422 catalog_manager.cc:5697] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d reported cstate change: term changed from 1 to 2, leader changed from ffcf2f5109634570a41b34baa7fd6ef9 (127.11.44.193) to 92d59f76af9047e7a7f178c42581582d (127.11.44.195). New cstate: current_term: 2 leader_uuid: "92d59f76af9047e7a7f178c42581582d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffcf2f5109634570a41b34baa7fd6ef9" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 42553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:58.225162 23672 raft_consensus.cc:1275] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d [term 2 FOLLOWER]: Refusing update from remote peer ffcf2f5109634570a41b34baa7fd6ef9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:58.226610 23744 consensus_queue.cc:1048] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:58.234387 23599 raft_consensus.cc:1275] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [term 2 FOLLOWER]: Refusing update from remote peer ffcf2f5109634570a41b34baa7fd6ef9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:58.234387 23672 raft_consensus.cc:1275] T 28e7a0a3d1054315891ad572d76b7ac4 P 92d59f76af9047e7a7f178c42581582d [term 2 FOLLOWER]: Refusing update from remote peer ffcf2f5109634570a41b34baa7fd6ef9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:58.236040 23760 consensus_queue.cc:1048] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:58.237555 23744 consensus_queue.cc:1048] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "92d59f76af9047e7a7f178c42581582d" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 35235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:07:58.249277 23599 raft_consensus.cc:1275] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [term 2 FOLLOWER]: Refusing update from remote peer ffcf2f5109634570a41b34baa7fd6ef9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:07:58.250825 23759 consensus_queue.cc:1048] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f4c86f091044344a16b1e47e77c3dc0" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 44147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:07:58.276695 11443 tablet_server.cc:179] TabletServer@127.11.44.193:0 shutting down...
I20260709 13:07:58.296181 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:58.296797 11443 tablet_replica.cc:333] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9: stopping tablet replica
I20260709 13:07:58.297326 11443 raft_consensus.cc:2243] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.298228 11443 raft_consensus.cc:2272] T 28e7a0a3d1054315891ad572d76b7ac4 P ffcf2f5109634570a41b34baa7fd6ef9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.300833 11443 tablet_replica.cc:333] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9: stopping tablet replica
I20260709 13:07:58.301338 11443 raft_consensus.cc:2243] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.301743 11443 raft_consensus.cc:2272] T 5b61a34c58b8453db19d2f29f1deda41 P ffcf2f5109634570a41b34baa7fd6ef9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.303958 11443 tablet_replica.cc:333] T 2dd4921f9ea84b19b03740562109e417 P ffcf2f5109634570a41b34baa7fd6ef9: stopping tablet replica
I20260709 13:07:58.304440 11443 raft_consensus.cc:2243] T 2dd4921f9ea84b19b03740562109e417 P ffcf2f5109634570a41b34baa7fd6ef9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.304801 11443 raft_consensus.cc:2272] T 2dd4921f9ea84b19b03740562109e417 P ffcf2f5109634570a41b34baa7fd6ef9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.307009 11443 tablet_replica.cc:333] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9: stopping tablet replica
I20260709 13:07:58.307482 11443 raft_consensus.cc:2243] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.308214 11443 raft_consensus.cc:2272] T 18e841f0ca414515990ebbae1338c2ba P ffcf2f5109634570a41b34baa7fd6ef9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.323355 11443 tablet_server.cc:196] TabletServer@127.11.44.193:0 shutdown complete.
I20260709 13:07:58.335237 11443 tablet_server.cc:179] TabletServer@127.11.44.194:0 shutting down...
I20260709 13:07:58.356670 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:58.357707 11443 tablet_replica.cc:333] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0: stopping tablet replica
I20260709 13:07:58.358299 11443 raft_consensus.cc:2243] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.358801 11443 raft_consensus.cc:2272] T 28e7a0a3d1054315891ad572d76b7ac4 P 6f4c86f091044344a16b1e47e77c3dc0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.361197 11443 tablet_replica.cc:333] T 5b61a34c58b8453db19d2f29f1deda41 P 6f4c86f091044344a16b1e47e77c3dc0: stopping tablet replica
I20260709 13:07:58.362653 11443 raft_consensus.cc:2243] T 5b61a34c58b8453db19d2f29f1deda41 P 6f4c86f091044344a16b1e47e77c3dc0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.363202 11443 raft_consensus.cc:2272] T 5b61a34c58b8453db19d2f29f1deda41 P 6f4c86f091044344a16b1e47e77c3dc0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.366583 11443 tablet_replica.cc:333] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0: stopping tablet replica
I20260709 13:07:58.367332 11443 raft_consensus.cc:2243] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.368561 11443 raft_consensus.cc:2272] T 2dd4921f9ea84b19b03740562109e417 P 6f4c86f091044344a16b1e47e77c3dc0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.371542 11443 tablet_replica.cc:333] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0: stopping tablet replica
I20260709 13:07:58.372098 11443 raft_consensus.cc:2243] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.372496 11443 raft_consensus.cc:2272] T 18e841f0ca414515990ebbae1338c2ba P 6f4c86f091044344a16b1e47e77c3dc0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.400749 11443 tablet_server.cc:196] TabletServer@127.11.44.194:0 shutdown complete.
I20260709 13:07:58.413674 11443 tablet_server.cc:179] TabletServer@127.11.44.195:0 shutting down...
I20260709 13:07:58.432274 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:07:58.432948 11443 tablet_replica.cc:333] T 28e7a0a3d1054315891ad572d76b7ac4 P 92d59f76af9047e7a7f178c42581582d: stopping tablet replica
I20260709 13:07:58.433531 11443 raft_consensus.cc:2243] T 28e7a0a3d1054315891ad572d76b7ac4 P 92d59f76af9047e7a7f178c42581582d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.434144 11443 raft_consensus.cc:2272] T 28e7a0a3d1054315891ad572d76b7ac4 P 92d59f76af9047e7a7f178c42581582d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.436336 11443 tablet_replica.cc:333] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d: stopping tablet replica
I20260709 13:07:58.436896 11443 raft_consensus.cc:2243] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.437443 11443 pending_rounds.cc:70] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d: Trying to abort 1 pending ops.
I20260709 13:07:58.437672 11443 pending_rounds.cc:77] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305635750640738304 op_type: NO_OP noop_request { }
I20260709 13:07:58.437934 11443 raft_consensus.cc:2889] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:07:58.438153 11443 raft_consensus.cc:2272] T 5b61a34c58b8453db19d2f29f1deda41 P 92d59f76af9047e7a7f178c42581582d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.440289 11443 tablet_replica.cc:333] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d: stopping tablet replica
I20260709 13:07:58.440738 11443 raft_consensus.cc:2243] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.441103 11443 raft_consensus.cc:2272] T 2dd4921f9ea84b19b03740562109e417 P 92d59f76af9047e7a7f178c42581582d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.443205 11443 tablet_replica.cc:333] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d: stopping tablet replica
I20260709 13:07:58.443631 11443 raft_consensus.cc:2243] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:58.444029 11443 raft_consensus.cc:2272] T 18e841f0ca414515990ebbae1338c2ba P 92d59f76af9047e7a7f178c42581582d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.467314 11443 tablet_server.cc:196] TabletServer@127.11.44.195:0 shutdown complete.
I20260709 13:07:58.479316 11443 master.cc:562] Master@127.11.44.254:37563 shutting down...
I20260709 13:07:58.495782 11443 raft_consensus.cc:2243] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:07:58.496304 11443 raft_consensus.cc:2272] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:58.496568 11443 tablet_replica.cc:333] T 00000000000000000000000000000000 P e652ab46ae624418a3cd4caa4baeb405: stopping tablet replica
I20260709 13:07:58.516930 11443 master.cc:584] Master@127.11.44.254:37563 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2818 ms)
[----------] 6 tests from LeaderRebalancerTest (346159 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:07:58.545701 11443 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.44.254:40023
I20260709 13:07:58.547001 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:58.552019 23776 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:58.553040 23777 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:58.554121 23779 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:58.555583 11443 server_base.cc:1061] running on GCE node
I20260709 13:07:58.556681 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:58.556857 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:58.557076 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602478557038 us; error 0 us; skew 500 ppm
I20260709 13:07:58.557678 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:58.560007 11443 webserver.cc:533] Webserver started at http://127.11.44.254:43909/ using document root <none> and password file <none>
I20260709 13:07:58.560539 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:58.560709 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:58.561020 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:58.562297 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132206461-11443-0/minicluster-data/master-0-root/instance:
uuid: "ad564820aa6344a8b7b44fe626cddbe8"
format_stamp: "Formatted at 2026-07-09 13:07:58 on dist-test-slave-qv7r"
I20260709 13:07:58.566625 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:07:58.570096 23784 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:58.571060 11443 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:07:58.571343 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132206461-11443-0/minicluster-data/master-0-root
uuid: "ad564820aa6344a8b7b44fe626cddbe8"
format_stamp: "Formatted at 2026-07-09 13:07:58 on dist-test-slave-qv7r"
I20260709 13:07:58.571610 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132206461-11443-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132206461-11443-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132206461-11443-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:58.588793 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:58.589862 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:58.629148 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.254:40023
I20260709 13:07:58.629302 23835 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.254:40023 every 8 connection(s)
I20260709 13:07:58.634316 23836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:58.645366 23836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8: Bootstrap starting.
I20260709 13:07:58.649814 23836 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:58.654196 23836 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8: No bootstrap required, opened a new log
I20260709 13:07:58.656406 23836 raft_consensus.cc:359] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad564820aa6344a8b7b44fe626cddbe8" member_type: VOTER }
I20260709 13:07:58.656824 23836 raft_consensus.cc:385] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:58.657021 23836 raft_consensus.cc:740] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad564820aa6344a8b7b44fe626cddbe8, State: Initialized, Role: FOLLOWER
I20260709 13:07:58.657636 23836 consensus_queue.cc:260] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad564820aa6344a8b7b44fe626cddbe8" member_type: VOTER }
I20260709 13:07:58.658143 23836 raft_consensus.cc:399] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:07:58.658356 23836 raft_consensus.cc:493] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:07:58.658583 23836 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:58.663802 23836 raft_consensus.cc:515] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad564820aa6344a8b7b44fe626cddbe8" member_type: VOTER }
I20260709 13:07:58.664371 23836 leader_election.cc:304] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ad564820aa6344a8b7b44fe626cddbe8; no voters: 
I20260709 13:07:58.665545 23836 leader_election.cc:290] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:07:58.666208 23839 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:58.667598 23839 raft_consensus.cc:697] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8 [term 1 LEADER]: Becoming Leader. State: Replica: ad564820aa6344a8b7b44fe626cddbe8, State: Running, Role: LEADER
I20260709 13:07:58.668292 23839 consensus_queue.cc:237] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad564820aa6344a8b7b44fe626cddbe8" member_type: VOTER }
I20260709 13:07:58.668908 23836 sys_catalog.cc:565] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:07:58.671242 23841 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ad564820aa6344a8b7b44fe626cddbe8. Latest consensus state: current_term: 1 leader_uuid: "ad564820aa6344a8b7b44fe626cddbe8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad564820aa6344a8b7b44fe626cddbe8" member_type: VOTER } }
I20260709 13:07:58.671190 23840 sys_catalog.cc:455] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ad564820aa6344a8b7b44fe626cddbe8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ad564820aa6344a8b7b44fe626cddbe8" member_type: VOTER } }
I20260709 13:07:58.671980 23841 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:58.672073 23840 sys_catalog.cc:458] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8 [sys.catalog]: This master's current role is: LEADER
I20260709 13:07:58.675769 23844 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:07:58.684532 23844 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:07:58.686412 11443 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:07:58.694767 23844 catalog_manager.cc:1383] Generated new cluster ID: 6154e91af09f44c4bd2f368cf323da14
I20260709 13:07:58.695108 23844 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:07:58.715941 23844 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:07:58.717278 23844 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:07:58.734797 23844 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8: Generated new TSK 0
I20260709 13:07:58.735369 23844 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:07:58.753773 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:58.761138 23857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:58.761847 23858 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:58.765640 11443 server_base.cc:1061] running on GCE node
W20260709 13:07:58.767063 23860 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:58.768020 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:58.768235 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:58.768359 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602478768348 us; error 0 us; skew 500 ppm
I20260709 13:07:58.768810 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:58.771404 11443 webserver.cc:533] Webserver started at http://127.11.44.193:38253/ using document root <none> and password file <none>
I20260709 13:07:58.771839 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:58.771991 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:58.772210 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:58.773268 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132206461-11443-0/minicluster-data/ts-0-root/instance:
uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
format_stamp: "Formatted at 2026-07-09 13:07:58 on dist-test-slave-qv7r"
I20260709 13:07:58.778031 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:07:58.782016 23865 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:58.783005 11443 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:07:58.783377 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132206461-11443-0/minicluster-data/ts-0-root
uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
format_stamp: "Formatted at 2026-07-09 13:07:58 on dist-test-slave-qv7r"
I20260709 13:07:58.783695 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132206461-11443-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132206461-11443-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132206461-11443-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:58.806346 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:58.807519 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:58.808996 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:58.811228 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:58.811455 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:58.811704 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:58.811888 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:58.855038 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.193:39291
I20260709 13:07:58.855144 23927 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.193:39291 every 8 connection(s)
I20260709 13:07:58.860713 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:58.868494 23932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:58.869552 23933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:58.873973 23935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:58.874022 11443 server_base.cc:1061] running on GCE node
I20260709 13:07:58.875983 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:58.876271 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:58.876471 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602478876447 us; error 0 us; skew 500 ppm
I20260709 13:07:58.877049 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:58.879709 11443 webserver.cc:533] Webserver started at http://127.11.44.194:39993/ using document root <none> and password file <none>
I20260709 13:07:58.880270 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:58.880528 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:58.880836 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:58.882162 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132206461-11443-0/minicluster-data/ts-1-root/instance:
uuid: "c21ae6936247494094e53b5674e80e25"
format_stamp: "Formatted at 2026-07-09 13:07:58 on dist-test-slave-qv7r"
I20260709 13:07:58.886195 23928 heartbeater.cc:344] Connected to a master server at 127.11.44.254:40023
I20260709 13:07:58.886714 23928 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:58.887744 23928 heartbeater.cc:507] Master 127.11.44.254:40023 requested a full tablet report, sending...
I20260709 13:07:58.888440 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:07:58.890570 23801 ts_manager.cc:194] Registered new tserver with Master: 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291)
I20260709 13:07:58.893098 23940 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:58.893172 23801 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54914
I20260709 13:07:58.894217 11443 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:07:58.894618 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132206461-11443-0/minicluster-data/ts-1-root
uuid: "c21ae6936247494094e53b5674e80e25"
format_stamp: "Formatted at 2026-07-09 13:07:58 on dist-test-slave-qv7r"
I20260709 13:07:58.894963 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132206461-11443-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132206461-11443-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132206461-11443-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:58.910148 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:58.911314 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:58.912814 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:58.915309 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:58.915500 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:58.915807 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:58.915982 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:58.960068 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.194:33653
I20260709 13:07:58.960171 24002 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.194:33653 every 8 connection(s)
I20260709 13:07:58.965488 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:07:58.972774 24006 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:58.974043 24007 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:07:58.976379 24009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:07:58.978790 24003 heartbeater.cc:344] Connected to a master server at 127.11.44.254:40023
I20260709 13:07:58.979264 11443 server_base.cc:1061] running on GCE node
I20260709 13:07:58.979405 24003 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:58.980451 24003 heartbeater.cc:507] Master 127.11.44.254:40023 requested a full tablet report, sending...
I20260709 13:07:58.980609 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:07:58.980929 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:07:58.981127 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602478981107 us; error 0 us; skew 500 ppm
I20260709 13:07:58.981940 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:07:58.982803 23801 ts_manager.cc:194] Registered new tserver with Master: c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653)
I20260709 13:07:58.984601 11443 webserver.cc:533] Webserver started at http://127.11.44.195:37551/ using document root <none> and password file <none>
I20260709 13:07:58.984743 23801 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54922
I20260709 13:07:58.985180 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:07:58.985481 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:07:58.985850 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:07:58.987356 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132206461-11443-0/minicluster-data/ts-2-root/instance:
uuid: "4ac0744564624cecaf9c8806254c3b24"
format_stamp: "Formatted at 2026-07-09 13:07:58 on dist-test-slave-qv7r"
I20260709 13:07:58.992133 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:07:58.995749 24014 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:58.996708 11443 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:07:58.996979 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132206461-11443-0/minicluster-data/ts-2-root
uuid: "4ac0744564624cecaf9c8806254c3b24"
format_stamp: "Formatted at 2026-07-09 13:07:58 on dist-test-slave-qv7r"
I20260709 13:07:58.997303 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132206461-11443-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132206461-11443-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602132206461-11443-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:07:59.019410 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:07:59.020458 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:07:59.021991 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:07:59.024399 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:07:59.024608 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:59.024873 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:07:59.025018 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:07:59.064640 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.195:36999
I20260709 13:07:59.064756 24076 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.195:36999 every 8 connection(s)
I20260709 13:07:59.081080 24077 heartbeater.cc:344] Connected to a master server at 127.11.44.254:40023
I20260709 13:07:59.081709 24077 heartbeater.cc:461] Registering TS with master...
I20260709 13:07:59.082481 24077 heartbeater.cc:507] Master 127.11.44.254:40023 requested a full tablet report, sending...
I20260709 13:07:59.084595 23801 ts_manager.cc:194] Registered new tserver with Master: 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:07:59.085469 11443 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017568787s
I20260709 13:07:59.086418 23801 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54932
I20260709 13:07:59.114478 23801 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54934:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:07:59.117269 23801 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:07:59.205313 23893 tablet_service.cc:1511] Processing CreateTablet for tablet 689f94e16e69480a85ba6b0e823624e8 (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:59.206828 23893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 689f94e16e69480a85ba6b0e823624e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.215422 23892 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9c65ae9eaa4c7abfaece0d9674a9ce (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:59.216988 23892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9c65ae9eaa4c7abfaece0d9674a9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.217024 24042 tablet_service.cc:1511] Processing CreateTablet for tablet 689f94e16e69480a85ba6b0e823624e8 (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:59.218807 24042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 689f94e16e69480a85ba6b0e823624e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.218560 24041 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9c65ae9eaa4c7abfaece0d9674a9ce (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:59.219933 24041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9c65ae9eaa4c7abfaece0d9674a9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.223611 24040 tablet_service.cc:1511] Processing CreateTablet for tablet c32a002d2cab4ce286b7ebeb0602d1a5 (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:59.225065 24040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c32a002d2cab4ce286b7ebeb0602d1a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.226243 23891 tablet_service.cc:1511] Processing CreateTablet for tablet c32a002d2cab4ce286b7ebeb0602d1a5 (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:59.227658 23891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c32a002d2cab4ce286b7ebeb0602d1a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.235435 24039 tablet_service.cc:1511] Processing CreateTablet for tablet 3acc3cd5da084f91a092454501bb2280 (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:59.237170 24039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3acc3cd5da084f91a092454501bb2280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.247633 23967 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9c65ae9eaa4c7abfaece0d9674a9ce (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:07:59.238221 23890 tablet_service.cc:1511] Processing CreateTablet for tablet 3acc3cd5da084f91a092454501bb2280 (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:59.250247 24092 tablet_bootstrap.cc:492] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24: Bootstrap starting.
I20260709 13:07:59.250473 23890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3acc3cd5da084f91a092454501bb2280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.239265 24038 tablet_service.cc:1511] Processing CreateTablet for tablet 6447060a38b04932bf5c6b794319bfdb (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:59.254580 24038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6447060a38b04932bf5c6b794319bfdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.256592 24092 tablet_bootstrap.cc:654] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.240980 23968 tablet_service.cc:1511] Processing CreateTablet for tablet 689f94e16e69480a85ba6b0e823624e8 (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:07:59.241294 24037 tablet_service.cc:1511] Processing CreateTablet for tablet a2e3a18f58ed43899a18da4f19e44a9e (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:59.259336 24037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e3a18f58ed43899a18da4f19e44a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.243223 24036 tablet_service.cc:1511] Processing CreateTablet for tablet 3e307bece597495db95ccd648adc8908 (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:59.245126 24035 tablet_service.cc:1511] Processing CreateTablet for tablet eb19b00e0b1540948179cc4c95b224bd (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:59.246975 24034 tablet_service.cc:1511] Processing CreateTablet for tablet bc21a182d5354dd9a801b72554c3a88c (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:59.261555 24036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e307bece597495db95ccd648adc8908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.262652 24035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb19b00e0b1540948179cc4c95b224bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.264484 24034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc21a182d5354dd9a801b72554c3a88c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.249457 23967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9c65ae9eaa4c7abfaece0d9674a9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.266863 23968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 689f94e16e69480a85ba6b0e823624e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.300024 23889 tablet_service.cc:1511] Processing CreateTablet for tablet 6447060a38b04932bf5c6b794319bfdb (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:59.302938 23888 tablet_service.cc:1511] Processing CreateTablet for tablet a2e3a18f58ed43899a18da4f19e44a9e (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:59.303242 23966 tablet_service.cc:1511] Processing CreateTablet for tablet c32a002d2cab4ce286b7ebeb0602d1a5 (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:07:59.304634 23966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c32a002d2cab4ce286b7ebeb0602d1a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.305364 23887 tablet_service.cc:1511] Processing CreateTablet for tablet 3e307bece597495db95ccd648adc8908 (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:59.306622 23965 tablet_service.cc:1511] Processing CreateTablet for tablet 3acc3cd5da084f91a092454501bb2280 (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:07:59.307686 23886 tablet_service.cc:1511] Processing CreateTablet for tablet eb19b00e0b1540948179cc4c95b224bd (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:59.308787 23964 tablet_service.cc:1511] Processing CreateTablet for tablet 6447060a38b04932bf5c6b794319bfdb (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:07:59.309458 23889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6447060a38b04932bf5c6b794319bfdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.310956 23963 tablet_service.cc:1511] Processing CreateTablet for tablet a2e3a18f58ed43899a18da4f19e44a9e (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:07:59.313133 23962 tablet_service.cc:1511] Processing CreateTablet for tablet 3e307bece597495db95ccd648adc8908 (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:07:59.314030 23887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e307bece597495db95ccd648adc8908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.315327 23961 tablet_service.cc:1511] Processing CreateTablet for tablet eb19b00e0b1540948179cc4c95b224bd (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:07:59.317580 23960 tablet_service.cc:1511] Processing CreateTablet for tablet bc21a182d5354dd9a801b72554c3a88c (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:59.317414 23885 tablet_service.cc:1511] Processing CreateTablet for tablet bc21a182d5354dd9a801b72554c3a88c (DEFAULT_TABLE table=test-workload [id=a1916a2982664de8b8bbca4ab257a099]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:07:59.322088 23886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb19b00e0b1540948179cc4c95b224bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.325871 23888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e3a18f58ed43899a18da4f19e44a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.332856 23885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc21a182d5354dd9a801b72554c3a88c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.342027 23965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3acc3cd5da084f91a092454501bb2280. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.345943 23963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a2e3a18f58ed43899a18da4f19e44a9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.349900 23961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb19b00e0b1540948179cc4c95b224bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.354946 23960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc21a182d5354dd9a801b72554c3a88c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.370100 23962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e307bece597495db95ccd648adc8908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.387993 23964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6447060a38b04932bf5c6b794319bfdb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:59.422134 24094 tablet_bootstrap.cc:492] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc: Bootstrap starting.
I20260709 13:07:59.422312 24095 tablet_bootstrap.cc:492] T 689f94e16e69480a85ba6b0e823624e8 P c21ae6936247494094e53b5674e80e25: Bootstrap starting.
I20260709 13:07:59.429394 24095 tablet_bootstrap.cc:654] T 689f94e16e69480a85ba6b0e823624e8 P c21ae6936247494094e53b5674e80e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.442691 24092 tablet_bootstrap.cc:492] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24: No bootstrap required, opened a new log
I20260709 13:07:59.443356 24092 ts_tablet_manager.cc:1403] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24: Time spent bootstrapping tablet: real 0.193s	user 0.026s	sys 0.033s
I20260709 13:07:59.446714 24095 tablet_bootstrap.cc:492] T 689f94e16e69480a85ba6b0e823624e8 P c21ae6936247494094e53b5674e80e25: No bootstrap required, opened a new log
I20260709 13:07:59.446635 24092 raft_consensus.cc:359] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.447646 24092 raft_consensus.cc:385] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.448071 24092 raft_consensus.cc:740] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.447340 24095 ts_tablet_manager.cc:1403] T 689f94e16e69480a85ba6b0e823624e8 P c21ae6936247494094e53b5674e80e25: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.004s
I20260709 13:07:59.448961 24092 consensus_queue.cc:260] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.451553 24094 tablet_bootstrap.cc:654] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.452486 24095 raft_consensus.cc:359] T 689f94e16e69480a85ba6b0e823624e8 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.453260 24095 raft_consensus.cc:385] T 689f94e16e69480a85ba6b0e823624e8 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.453619 24095 raft_consensus.cc:740] T 689f94e16e69480a85ba6b0e823624e8 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21ae6936247494094e53b5674e80e25, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.454701 24095 consensus_queue.cc:260] T 689f94e16e69480a85ba6b0e823624e8 P c21ae6936247494094e53b5674e80e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.458787 24077 heartbeater.cc:499] Master 127.11.44.254:40023 was elected leader, sending a full tablet report...
I20260709 13:07:59.459722 24003 heartbeater.cc:499] Master 127.11.44.254:40023 was elected leader, sending a full tablet report...
I20260709 13:07:59.458359 24092 ts_tablet_manager.cc:1434] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 13:07:59.460429 24095 ts_tablet_manager.cc:1434] T 689f94e16e69480a85ba6b0e823624e8 P c21ae6936247494094e53b5674e80e25: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:07:59.461484 24095 tablet_bootstrap.cc:492] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25: Bootstrap starting.
I20260709 13:07:59.461489 24092 tablet_bootstrap.cc:492] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 4ac0744564624cecaf9c8806254c3b24: Bootstrap starting.
I20260709 13:07:59.466252 24094 tablet_bootstrap.cc:492] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc: No bootstrap required, opened a new log
I20260709 13:07:59.466846 24094 ts_tablet_manager.cc:1403] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent bootstrapping tablet: real 0.045s	user 0.011s	sys 0.005s
I20260709 13:07:59.467708 24095 tablet_bootstrap.cc:654] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.468931 24092 tablet_bootstrap.cc:654] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 4ac0744564624cecaf9c8806254c3b24: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.470041 24094 raft_consensus.cc:359] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.471231 24094 raft_consensus.cc:385] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.471614 24094 raft_consensus.cc:740] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.472771 24094 consensus_queue.cc:260] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.477528 24095 tablet_bootstrap.cc:492] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25: No bootstrap required, opened a new log
I20260709 13:07:59.477595 24092 tablet_bootstrap.cc:492] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 4ac0744564624cecaf9c8806254c3b24: No bootstrap required, opened a new log
I20260709 13:07:59.478375 24095 ts_tablet_manager.cc:1403] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.003s
I20260709 13:07:59.478382 24092 ts_tablet_manager.cc:1403] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 4ac0744564624cecaf9c8806254c3b24: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:07:59.480508 24094 ts_tablet_manager.cc:1434] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.007s
I20260709 13:07:59.481392 23928 heartbeater.cc:499] Master 127.11.44.254:40023 was elected leader, sending a full tablet report...
I20260709 13:07:59.481700 24095 raft_consensus.cc:359] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.482543 24095 raft_consensus.cc:385] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.482203 24092 raft_consensus.cc:359] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.482880 24095 raft_consensus.cc:740] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21ae6936247494094e53b5674e80e25, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.482981 24092 raft_consensus.cc:385] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.483372 24092 raft_consensus.cc:740] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.483928 24095 consensus_queue.cc:260] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.484294 24092 consensus_queue.cc:260] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.486333 24095 ts_tablet_manager.cc:1434] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:07:59.486703 24092 ts_tablet_manager.cc:1434] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 4ac0744564624cecaf9c8806254c3b24: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:07:59.487586 24095 tablet_bootstrap.cc:492] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25: Bootstrap starting.
I20260709 13:07:59.486356 24094 tablet_bootstrap.cc:492] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc: Bootstrap starting.
I20260709 13:07:59.491303 24092 tablet_bootstrap.cc:492] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24: Bootstrap starting.
I20260709 13:07:59.494596 24095 tablet_bootstrap.cc:654] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.495514 24094 tablet_bootstrap.cc:654] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.498545 24092 tablet_bootstrap.cc:654] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.501881 24097 raft_consensus.cc:493] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.502641 24097 raft_consensus.cc:515] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.516049 24097 leader_election.cc:290] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653)
I20260709 13:07:59.529469 23903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9c65ae9eaa4c7abfaece0d9674a9ce" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" is_pre_election: true
W20260709 13:07:59.531977 24016 leader_election.cc:343] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.558944 24095 tablet_bootstrap.cc:492] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25: No bootstrap required, opened a new log
I20260709 13:07:59.559175 24094 tablet_bootstrap.cc:492] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc: No bootstrap required, opened a new log
I20260709 13:07:59.559450 23978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9c65ae9eaa4c7abfaece0d9674a9ce" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25" is_pre_election: true
I20260709 13:07:59.559891 24094 ts_tablet_manager.cc:1403] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent bootstrapping tablet: real 0.074s	user 0.033s	sys 0.037s
I20260709 13:07:59.559891 24095 ts_tablet_manager.cc:1403] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25: Time spent bootstrapping tablet: real 0.073s	user 0.047s	sys 0.024s
I20260709 13:07:59.560521 24092 tablet_bootstrap.cc:492] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24: No bootstrap required, opened a new log
I20260709 13:07:59.561071 24092 ts_tablet_manager.cc:1403] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24: Time spent bootstrapping tablet: real 0.074s	user 0.013s	sys 0.002s
W20260709 13:07:59.561345 24017 leader_election.cc:343] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.561842 24017 leader_election.cc:304] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ac0744564624cecaf9c8806254c3b24; no voters: 1ffb2868f51d400b80d2f376cd1b44dc, c21ae6936247494094e53b5674e80e25
I20260709 13:07:59.562630 24097 raft_consensus.cc:2749] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:59.563625 24094 raft_consensus.cc:359] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.563983 24102 raft_consensus.cc:493] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.563922 24095 raft_consensus.cc:359] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.564472 24092 raft_consensus.cc:359] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.564966 24095 raft_consensus.cc:385] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.564707 24102 raft_consensus.cc:515] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.565331 24092 raft_consensus.cc:385] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.564502 24094 raft_consensus.cc:385] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.565478 24095 raft_consensus.cc:740] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21ae6936247494094e53b5674e80e25, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.565905 24092 raft_consensus.cc:740] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.566041 24094 raft_consensus.cc:740] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.566817 24092 consensus_queue.cc:260] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.566943 24094 consensus_queue.cc:260] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.566969 24095 consensus_queue.cc:260] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.569286 24092 ts_tablet_manager.cc:1434] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:07:59.572508 24095 ts_tablet_manager.cc:1434] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:07:59.572830 24092 tablet_bootstrap.cc:492] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24: Bootstrap starting.
I20260709 13:07:59.573782 24095 tablet_bootstrap.cc:492] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25: Bootstrap starting.
I20260709 13:07:59.581524 24095 tablet_bootstrap.cc:654] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.582295 24092 tablet_bootstrap.cc:654] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.593850 24095 tablet_bootstrap.cc:492] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25: No bootstrap required, opened a new log
I20260709 13:07:59.594652 24095 ts_tablet_manager.cc:1403] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.011s
I20260709 13:07:59.593779 24102 leader_election.cc:290] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:07:59.599306 24095 raft_consensus.cc:359] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.600159 24095 raft_consensus.cc:385] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.600466 24095 raft_consensus.cc:740] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21ae6936247494094e53b5674e80e25, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.601430 24095 consensus_queue.cc:260] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.604321 24095 ts_tablet_manager.cc:1434] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:07:59.605719 24095 tablet_bootstrap.cc:492] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25: Bootstrap starting.
I20260709 13:07:59.612708 24095 tablet_bootstrap.cc:654] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.617533 24102 raft_consensus.cc:493] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.618364 24102 raft_consensus.cc:515] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.621181 24102 leader_election.cc:290] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:07:59.629313 24095 tablet_bootstrap.cc:492] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25: No bootstrap required, opened a new log
I20260709 13:07:59.630043 24095 ts_tablet_manager.cc:1403] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.004s
I20260709 13:07:59.633299 24095 raft_consensus.cc:359] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.634398 24095 raft_consensus.cc:385] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.634788 24095 raft_consensus.cc:740] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21ae6936247494094e53b5674e80e25, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.635977 24095 consensus_queue.cc:260] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.641113 24095 ts_tablet_manager.cc:1434] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:07:59.642218 24095 tablet_bootstrap.cc:492] T 3acc3cd5da084f91a092454501bb2280 P c21ae6936247494094e53b5674e80e25: Bootstrap starting.
I20260709 13:07:59.647781 24099 raft_consensus.cc:493] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.648458 24095 tablet_bootstrap.cc:654] T 3acc3cd5da084f91a092454501bb2280 P c21ae6936247494094e53b5674e80e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.648418 24099 raft_consensus.cc:515] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.651403 24099 leader_election.cc:290] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:07:59.654347 24097 raft_consensus.cc:493] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.655041 24097 raft_consensus.cc:515] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.658917 23978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689f94e16e69480a85ba6b0e823624e8" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25" is_pre_election: true
I20260709 13:07:59.659838 23978 raft_consensus.cc:2468] T 689f94e16e69480a85ba6b0e823624e8 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 0.
I20260709 13:07:59.662658 24017 leader_election.cc:304] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ac0744564624cecaf9c8806254c3b24, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:07:59.664614 24097 leader_election.cc:290] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291)
I20260709 13:07:59.665316 24097 raft_consensus.cc:2804] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:59.665825 24097 raft_consensus.cc:493] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.666277 24097 raft_consensus.cc:3060] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.679312 23903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689f94e16e69480a85ba6b0e823624e8" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" is_pre_election: true
W20260709 13:07:59.680953 23849 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:07:59.680990 24016 leader_election.cc:343] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.692912 24097 raft_consensus.cc:515] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.695685 24094 ts_tablet_manager.cc:1434] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent starting tablet: real 0.135s	user 0.033s	sys 0.064s
I20260709 13:07:59.696326 23978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689f94e16e69480a85ba6b0e823624e8" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:07:59.696923 23978 raft_consensus.cc:3060] T 689f94e16e69480a85ba6b0e823624e8 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.697666 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9c65ae9eaa4c7abfaece0d9674a9ce" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24" is_pre_election: true
I20260709 13:07:59.698390 24052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e307bece597495db95ccd648adc8908" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24" is_pre_election: true
I20260709 13:07:59.699484 24092 tablet_bootstrap.cc:492] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24: No bootstrap required, opened a new log
I20260709 13:07:59.700076 24092 ts_tablet_manager.cc:1403] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24: Time spent bootstrapping tablet: real 0.128s	user 0.057s	sys 0.061s
I20260709 13:07:59.698392 24051 raft_consensus.cc:2468] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 0.
I20260709 13:07:59.702201 24099 raft_consensus.cc:493] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.702690 24099 raft_consensus.cc:515] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.704108 23977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e307bece597495db95ccd648adc8908" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25" is_pre_election: true
I20260709 13:07:59.704838 24099 leader_election.cc:290] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:07:59.704926 23978 raft_consensus.cc:2468] T 689f94e16e69480a85ba6b0e823624e8 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 1.
I20260709 13:07:59.704802 23977 raft_consensus.cc:2468] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 0.
I20260709 13:07:59.706058 23976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9c65ae9eaa4c7abfaece0d9674a9ce" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25" is_pre_election: true
I20260709 13:07:59.706970 23868 leader_election.cc:304] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:07:59.707322 24017 leader_election.cc:304] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ac0744564624cecaf9c8806254c3b24, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:07:59.706220 24097 leader_election.cc:290] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 election: Requested vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291)
W20260709 13:07:59.708156 23866 leader_election.cc:343] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.707715 24092 raft_consensus.cc:359] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.708458 23903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689f94e16e69480a85ba6b0e823624e8" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:07:59.708801 24092 raft_consensus.cc:385] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.708540 24097 raft_consensus.cc:2804] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.709344 24092 raft_consensus.cc:740] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.709372 23866 leader_election.cc:304] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, 4ac0744564624cecaf9c8806254c3b24; no voters: 
I20260709 13:07:59.709865 24097 raft_consensus.cc:697] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Becoming Leader. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Running, Role: LEADER
I20260709 13:07:59.710137 24108 raft_consensus.cc:2804] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:59.710377 24102 raft_consensus.cc:2804] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:59.710932 24102 raft_consensus.cc:493] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.711408 24102 raft_consensus.cc:3060] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.710619 24092 consensus_queue.cc:260] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.710798 24097 consensus_queue.cc:237] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.709452 24094 tablet_bootstrap.cc:492] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc: Bootstrap starting.
I20260709 13:07:59.714325 24092 ts_tablet_manager.cc:1434] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:07:59.715667 24092 tablet_bootstrap.cc:492] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24: Bootstrap starting.
W20260709 13:07:59.717772 23868 leader_election.cc:343] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.722262 24094 tablet_bootstrap.cc:654] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.723658 24102 raft_consensus.cc:515] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.710661 24108 raft_consensus.cc:493] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.726171 24108 raft_consensus.cc:3060] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.726874 24092 tablet_bootstrap.cc:654] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.732240 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc21a182d5354dd9a801b72554c3a88c" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24" is_pre_election: true
I20260709 13:07:59.733165 24051 raft_consensus.cc:2468] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 0.
I20260709 13:07:59.735077 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32a002d2cab4ce286b7ebeb0602d1a5" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24" is_pre_election: true
I20260709 13:07:59.735858 24051 raft_consensus.cc:2468] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 0.
I20260709 13:07:59.737498 23941 leader_election.cc:304] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ac0744564624cecaf9c8806254c3b24, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:07:59.738581 24099 raft_consensus.cc:2804] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:59.739038 24099 raft_consensus.cc:493] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.739419 24099 raft_consensus.cc:3060] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.747848 23941 leader_election.cc:304] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ac0744564624cecaf9c8806254c3b24, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:07:59.752151 24102 leader_election.cc:290] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 election: Requested vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:07:59.755421 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9c65ae9eaa4c7abfaece0d9674a9ce" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
I20260709 13:07:59.756271 24051 raft_consensus.cc:3060] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.769065 24095 tablet_bootstrap.cc:492] T 3acc3cd5da084f91a092454501bb2280 P c21ae6936247494094e53b5674e80e25: No bootstrap required, opened a new log
I20260709 13:07:59.769945 24095 ts_tablet_manager.cc:1403] T 3acc3cd5da084f91a092454501bb2280 P c21ae6936247494094e53b5674e80e25: Time spent bootstrapping tablet: real 0.128s	user 0.012s	sys 0.025s
W20260709 13:07:59.772420 23868 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:33653, user_credentials={real_user=slave}} blocked reactor thread for 62660.8us
W20260709 13:07:59.773941 24016 leader_election.cc:343] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.774343 24095 raft_consensus.cc:359] T 3acc3cd5da084f91a092454501bb2280 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.775441 24095 raft_consensus.cc:385] T 3acc3cd5da084f91a092454501bb2280 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.775836 24095 raft_consensus.cc:740] T 3acc3cd5da084f91a092454501bb2280 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21ae6936247494094e53b5674e80e25, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.776543 23978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9c65ae9eaa4c7abfaece0d9674a9ce" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:07:59.777091 23903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc21a182d5354dd9a801b72554c3a88c" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" is_pre_election: true
I20260709 13:07:59.777992 23902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32a002d2cab4ce286b7ebeb0602d1a5" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" is_pre_election: true
I20260709 13:07:59.777021 24095 consensus_queue.cc:260] T 3acc3cd5da084f91a092454501bb2280 P c21ae6936247494094e53b5674e80e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
W20260709 13:07:59.779944 23942 leader_election.cc:343] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:07:59.787153 23942 leader_election.cc:343] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.790758 24121 raft_consensus.cc:2804] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:07:59.791399 24121 raft_consensus.cc:493] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.791826 24121 raft_consensus.cc:3060] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:07:59.797417 23941 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.195:36999, user_credentials={real_user=slave}} blocked reactor thread for 49706.9us
I20260709 13:07:59.797907 24095 ts_tablet_manager.cc:1434] T 3acc3cd5da084f91a092454501bb2280 P c21ae6936247494094e53b5674e80e25: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.009s
W20260709 13:07:59.780006 23868 leader_election.cc:343] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.799146 24095 tablet_bootstrap.cc:492] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25: Bootstrap starting.
I20260709 13:07:59.801687 24108 raft_consensus.cc:515] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.801117 23798 catalog_manager.cc:5697] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "4ac0744564624cecaf9c8806254c3b24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:59.809607 24095 tablet_bootstrap.cc:654] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.808262 24051 raft_consensus.cc:2468] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 1.
I20260709 13:07:59.815063 24099 raft_consensus.cc:515] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.817349 24094 tablet_bootstrap.cc:492] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc: No bootstrap required, opened a new log
I20260709 13:07:59.818002 24094 ts_tablet_manager.cc:1403] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent bootstrapping tablet: real 0.109s	user 0.027s	sys 0.017s
I20260709 13:07:59.818450 24099 leader_election.cc:290] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 election: Requested vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:07:59.819578 23902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc21a182d5354dd9a801b72554c3a88c" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:07:59.823158 24092 tablet_bootstrap.cc:492] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24: No bootstrap required, opened a new log
I20260709 13:07:59.823926 24092 ts_tablet_manager.cc:1403] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24: Time spent bootstrapping tablet: real 0.109s	user 0.024s	sys 0.061s
I20260709 13:07:59.824361 23866 leader_election.cc:304] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, 4ac0744564624cecaf9c8806254c3b24; no voters: c21ae6936247494094e53b5674e80e25
I20260709 13:07:59.826097 24102 raft_consensus.cc:2804] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.826779 24108 leader_election.cc:290] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 election: Requested vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:07:59.834976 24092 raft_consensus.cc:359] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.835419 24052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e307bece597495db95ccd648adc8908" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
W20260709 13:07:59.828681 23942 leader_election.cc:343] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.838665 23978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e307bece597495db95ccd648adc8908" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:07:59.839267 23978 raft_consensus.cc:3060] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.838971 24094 raft_consensus.cc:359] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.839766 24094 raft_consensus.cc:385] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.840057 24094 raft_consensus.cc:740] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.840831 24094 consensus_queue.cc:260] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.835836 24092 raft_consensus.cc:385] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.841760 24092 raft_consensus.cc:740] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Initialized, Role: FOLLOWER
W20260709 13:07:59.842032 23866 leader_election.cc:343] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.847745 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc21a182d5354dd9a801b72554c3a88c" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
I20260709 13:07:59.847852 24092 consensus_queue.cc:260] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.848578 24051 raft_consensus.cc:3060] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.850355 24092 ts_tablet_manager.cc:1434] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.001s
I20260709 13:07:59.851411 24092 tablet_bootstrap.cc:492] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24: Bootstrap starting.
I20260709 13:07:59.855518 24094 ts_tablet_manager.cc:1434] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:07:59.844398 24121 raft_consensus.cc:515] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.857216 24094 tablet_bootstrap.cc:492] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc: Bootstrap starting.
I20260709 13:07:59.857201 23978 raft_consensus.cc:2468] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 1.
I20260709 13:07:59.859055 24121 leader_election.cc:290] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 election: Requested vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:07:59.859311 23868 leader_election.cc:304] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, c21ae6936247494094e53b5674e80e25; no voters: 4ac0744564624cecaf9c8806254c3b24
I20260709 13:07:59.861122 24092 tablet_bootstrap.cc:654] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.860944 23902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32a002d2cab4ce286b7ebeb0602d1a5" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:07:59.862223 24051 raft_consensus.cc:2468] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 1.
I20260709 13:07:59.862763 23902 raft_consensus.cc:3060] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.866024 24095 tablet_bootstrap.cc:492] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25: No bootstrap required, opened a new log
I20260709 13:07:59.866648 24095 ts_tablet_manager.cc:1403] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25: Time spent bootstrapping tablet: real 0.068s	user 0.017s	sys 0.019s
I20260709 13:07:59.866695 23941 leader_election.cc:304] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ac0744564624cecaf9c8806254c3b24, c21ae6936247494094e53b5674e80e25; no voters: 1ffb2868f51d400b80d2f376cd1b44dc
I20260709 13:07:59.868216 24121 raft_consensus.cc:2804] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.861994 24052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32a002d2cab4ce286b7ebeb0602d1a5" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
I20260709 13:07:59.868768 24121 raft_consensus.cc:697] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [term 1 LEADER]: Becoming Leader. State: Replica: c21ae6936247494094e53b5674e80e25, State: Running, Role: LEADER
I20260709 13:07:59.868997 24052 raft_consensus.cc:3060] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:07:59.863395 24126 raft_consensus.cc:2804] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.869793 24121 consensus_queue.cc:237] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.870456 24126 raft_consensus.cc:697] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Becoming Leader. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Running, Role: LEADER
I20260709 13:07:59.871172 24095 raft_consensus.cc:359] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.871384 24126 consensus_queue.cc:237] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.872144 24095 raft_consensus.cc:385] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.872767 24095 raft_consensus.cc:740] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21ae6936247494094e53b5674e80e25, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.873819 24095 consensus_queue.cc:260] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.877655 24095 ts_tablet_manager.cc:1434] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:07:59.879268 24095 tablet_bootstrap.cc:492] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25: Bootstrap starting.
I20260709 13:07:59.887415 24095 tablet_bootstrap.cc:654] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.886940 23798 catalog_manager.cc:5697] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to c21ae6936247494094e53b5674e80e25 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "c21ae6936247494094e53b5674e80e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.892969 23902 raft_consensus.cc:2468] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 1.
I20260709 13:07:59.854612 24102 raft_consensus.cc:697] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Becoming Leader. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Running, Role: LEADER
I20260709 13:07:59.865032 24094 tablet_bootstrap.cc:654] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.897293 24102 consensus_queue.cc:237] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.899441 24121 raft_consensus.cc:493] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.900152 24121 raft_consensus.cc:515] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.902813 24052 raft_consensus.cc:2468] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 1.
I20260709 13:07:59.903096 24094 tablet_bootstrap.cc:492] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc: No bootstrap required, opened a new log
I20260709 13:07:59.903121 24095 tablet_bootstrap.cc:492] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25: No bootstrap required, opened a new log
I20260709 13:07:59.903630 24094 ts_tablet_manager.cc:1403] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.002s
I20260709 13:07:59.904021 24095 ts_tablet_manager.cc:1403] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.007s
I20260709 13:07:59.904771 23941 leader_election.cc:304] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ac0744564624cecaf9c8806254c3b24, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:07:59.905144 23903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6447060a38b04932bf5c6b794319bfdb" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" is_pre_election: true
I20260709 13:07:59.905745 24099 raft_consensus.cc:2804] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:07:59.906239 24099 raft_consensus.cc:697] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [term 1 LEADER]: Becoming Leader. State: Replica: c21ae6936247494094e53b5674e80e25, State: Running, Role: LEADER
W20260709 13:07:59.906814 23942 leader_election.cc:343] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.907089 24099 consensus_queue.cc:237] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.907648 24095 raft_consensus.cc:359] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.908578 24095 raft_consensus.cc:385] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.908952 24095 raft_consensus.cc:740] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21ae6936247494094e53b5674e80e25, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.905745 24121 leader_election.cc:290] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:07:59.908733 24092 tablet_bootstrap.cc:492] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24: No bootstrap required, opened a new log
I20260709 13:07:59.910530 24092 ts_tablet_manager.cc:1403] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.004s
I20260709 13:07:59.909847 24095 consensus_queue.cc:260] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.911729 24052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6447060a38b04932bf5c6b794319bfdb" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24" is_pre_election: true
I20260709 13:07:59.912839 24095 ts_tablet_manager.cc:1434] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:59.913713 24092 raft_consensus.cc:359] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.914654 24092 raft_consensus.cc:385] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.914785 24095 tablet_bootstrap.cc:492] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P c21ae6936247494094e53b5674e80e25: Bootstrap starting.
I20260709 13:07:59.914988 24092 raft_consensus.cc:740] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.915964 24092 consensus_queue.cc:260] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.918751 24092 ts_tablet_manager.cc:1434] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:07:59.919736 24092 tablet_bootstrap.cc:492] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24: Bootstrap starting.
I20260709 13:07:59.919519 23798 catalog_manager.cc:5697] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193). New cstate: current_term: 1 leader_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.922103 24095 tablet_bootstrap.cc:654] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P c21ae6936247494094e53b5674e80e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.927006 24092 tablet_bootstrap.cc:654] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.912670 24094 raft_consensus.cc:359] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
W20260709 13:07:59.913208 23941 leader_election.cc:343] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:07:59.932348 23941 leader_election.cc:304] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c21ae6936247494094e53b5674e80e25; no voters: 1ffb2868f51d400b80d2f376cd1b44dc, 4ac0744564624cecaf9c8806254c3b24
I20260709 13:07:59.933470 24121 raft_consensus.cc:2749] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:07:59.934065 24094 raft_consensus.cc:385] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.934535 24094 raft_consensus.cc:740] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.937288 24094 consensus_queue.cc:260] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.942524 24094 ts_tablet_manager.cc:1434] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.001s
I20260709 13:07:59.944116 24094 tablet_bootstrap.cc:492] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc: Bootstrap starting.
I20260709 13:07:59.947420 23800 catalog_manager.cc:5697] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193). New cstate: current_term: 1 leader_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.962841 24092 tablet_bootstrap.cc:492] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24: No bootstrap required, opened a new log
I20260709 13:07:59.963438 24092 ts_tablet_manager.cc:1403] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24: Time spent bootstrapping tablet: real 0.044s	user 0.031s	sys 0.009s
I20260709 13:07:59.963594 24095 tablet_bootstrap.cc:492] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P c21ae6936247494094e53b5674e80e25: No bootstrap required, opened a new log
I20260709 13:07:59.964084 24095 ts_tablet_manager.cc:1403] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P c21ae6936247494094e53b5674e80e25: Time spent bootstrapping tablet: real 0.050s	user 0.026s	sys 0.020s
I20260709 13:07:59.966291 23798 catalog_manager.cc:5697] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to c21ae6936247494094e53b5674e80e25 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "c21ae6936247494094e53b5674e80e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:59.966863 24092 raft_consensus.cc:359] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.967736 24092 raft_consensus.cc:385] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.967347 24095 raft_consensus.cc:359] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.968062 24092 raft_consensus.cc:740] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.968200 24095 raft_consensus.cc:385] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.968567 24095 raft_consensus.cc:740] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21ae6936247494094e53b5674e80e25, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.969238 24094 tablet_bootstrap.cc:654] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.969094 24092 consensus_queue.cc:260] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.969277 24095 consensus_queue.cc:260] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P c21ae6936247494094e53b5674e80e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.977169 24095 ts_tablet_manager.cc:1434] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P c21ae6936247494094e53b5674e80e25: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:07:59.974677 24092 ts_tablet_manager.cc:1434] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:07:59.980984 24092 tablet_bootstrap.cc:492] T a2e3a18f58ed43899a18da4f19e44a9e P 4ac0744564624cecaf9c8806254c3b24: Bootstrap starting.
I20260709 13:07:59.981809 24094 tablet_bootstrap.cc:492] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc: No bootstrap required, opened a new log
I20260709 13:07:59.982338 24094 ts_tablet_manager.cc:1403] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.000s
I20260709 13:07:59.985348 24094 raft_consensus.cc:359] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.986256 24094 raft_consensus.cc:385] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:07:59.986546 24094 raft_consensus.cc:740] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Initialized, Role: FOLLOWER
I20260709 13:07:59.987453 24094 consensus_queue.cc:260] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:07:59.990913 24092 tablet_bootstrap.cc:654] T a2e3a18f58ed43899a18da4f19e44a9e P 4ac0744564624cecaf9c8806254c3b24: Neither blocks nor log segments found. Creating new log.
I20260709 13:07:59.990926 24094 ts_tablet_manager.cc:1434] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:07:59.992388 24094 tablet_bootstrap.cc:492] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc: Bootstrap starting.
I20260709 13:07:59.998567 24094 tablet_bootstrap.cc:654] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.003945 24092 tablet_bootstrap.cc:492] T a2e3a18f58ed43899a18da4f19e44a9e P 4ac0744564624cecaf9c8806254c3b24: No bootstrap required, opened a new log
I20260709 13:08:00.004382 24092 ts_tablet_manager.cc:1403] T a2e3a18f58ed43899a18da4f19e44a9e P 4ac0744564624cecaf9c8806254c3b24: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.003s
I20260709 13:08:00.005251 24094 tablet_bootstrap.cc:492] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc: No bootstrap required, opened a new log
I20260709 13:08:00.005795 24094 ts_tablet_manager.cc:1403] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 13:08:00.006791 24092 raft_consensus.cc:359] T a2e3a18f58ed43899a18da4f19e44a9e P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.007570 24092 raft_consensus.cc:385] T a2e3a18f58ed43899a18da4f19e44a9e P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.007804 24092 raft_consensus.cc:740] T a2e3a18f58ed43899a18da4f19e44a9e P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.008450 24092 consensus_queue.cc:260] T a2e3a18f58ed43899a18da4f19e44a9e P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.008733 24094 raft_consensus.cc:359] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.009601 24094 raft_consensus.cc:385] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.009900 24094 raft_consensus.cc:740] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.010536 24092 ts_tablet_manager.cc:1434] T a2e3a18f58ed43899a18da4f19e44a9e P 4ac0744564624cecaf9c8806254c3b24: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:08:00.010634 24094 consensus_queue.cc:260] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.011745 24092 tablet_bootstrap.cc:492] T 3e307bece597495db95ccd648adc8908 P 4ac0744564624cecaf9c8806254c3b24: Bootstrap starting.
I20260709 13:08:00.012887 24094 ts_tablet_manager.cc:1434] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:08:00.014516 24094 tablet_bootstrap.cc:492] T 6447060a38b04932bf5c6b794319bfdb P 1ffb2868f51d400b80d2f376cd1b44dc: Bootstrap starting.
I20260709 13:08:00.015525 24102 raft_consensus.cc:493] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.016287 24102 raft_consensus.cc:515] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.019507 24092 tablet_bootstrap.cc:654] T 3e307bece597495db95ccd648adc8908 P 4ac0744564624cecaf9c8806254c3b24: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.019768 23978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689f94e16e69480a85ba6b0e823624e8" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25" is_pre_election: true
I20260709 13:08:00.020560 23978 raft_consensus.cc:2393] T 689f94e16e69480a85ba6b0e823624e8 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ffb2868f51d400b80d2f376cd1b44dc in current term 1: Already voted for candidate 4ac0744564624cecaf9c8806254c3b24 in this term.
I20260709 13:08:00.021911 24094 tablet_bootstrap.cc:654] T 6447060a38b04932bf5c6b794319bfdb P 1ffb2868f51d400b80d2f376cd1b44dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.026226 24052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689f94e16e69480a85ba6b0e823624e8" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24" is_pre_election: true
I20260709 13:08:00.028014 24099 raft_consensus.cc:493] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.028491 24099 raft_consensus.cc:515] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.030362 24099 leader_election.cc:290] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:00.030658 24092 tablet_bootstrap.cc:492] T 3e307bece597495db95ccd648adc8908 P 4ac0744564624cecaf9c8806254c3b24: No bootstrap required, opened a new log
I20260709 13:08:00.031174 24092 ts_tablet_manager.cc:1403] T 3e307bece597495db95ccd648adc8908 P 4ac0744564624cecaf9c8806254c3b24: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:08:00.031535 24102 leader_election.cc:290] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:00.033555 23902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb19b00e0b1540948179cc4c95b224bd" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" is_pre_election: true
I20260709 13:08:00.034137 24092 raft_consensus.cc:359] T 3e307bece597495db95ccd648adc8908 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.034883 24092 raft_consensus.cc:385] T 3e307bece597495db95ccd648adc8908 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.031919 23866 leader_election.cc:304] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc; no voters: 4ac0744564624cecaf9c8806254c3b24, c21ae6936247494094e53b5674e80e25
W20260709 13:08:00.035104 23942 leader_election.cc:343] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:00.035938 24102 raft_consensus.cc:3060] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.036712 24094 tablet_bootstrap.cc:492] T 6447060a38b04932bf5c6b794319bfdb P 1ffb2868f51d400b80d2f376cd1b44dc: No bootstrap required, opened a new log
I20260709 13:08:00.037249 24094 ts_tablet_manager.cc:1403] T 6447060a38b04932bf5c6b794319bfdb P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.010s
I20260709 13:08:00.037781 24052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb19b00e0b1540948179cc4c95b224bd" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24" is_pre_election: true
I20260709 13:08:00.038455 24052 raft_consensus.cc:2468] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 0.
I20260709 13:08:00.035159 24092 raft_consensus.cc:740] T 3e307bece597495db95ccd648adc8908 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.040337 24094 raft_consensus.cc:359] T 6447060a38b04932bf5c6b794319bfdb P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.040663 23941 leader_election.cc:304] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ac0744564624cecaf9c8806254c3b24, c21ae6936247494094e53b5674e80e25; no voters: 1ffb2868f51d400b80d2f376cd1b44dc
I20260709 13:08:00.041106 24094 raft_consensus.cc:385] T 6447060a38b04932bf5c6b794319bfdb P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.041478 24094 raft_consensus.cc:740] T 6447060a38b04932bf5c6b794319bfdb P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.040346 24092 consensus_queue.cc:260] T 3e307bece597495db95ccd648adc8908 P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.042341 24094 consensus_queue.cc:260] T 6447060a38b04932bf5c6b794319bfdb P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.043952 24092 ts_tablet_manager.cc:1434] T 3e307bece597495db95ccd648adc8908 P 4ac0744564624cecaf9c8806254c3b24: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:08:00.044656 24094 ts_tablet_manager.cc:1434] T 6447060a38b04932bf5c6b794319bfdb P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:00.044745 24099 raft_consensus.cc:2804] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:00.045331 24099 raft_consensus.cc:493] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.045715 24099 raft_consensus.cc:3060] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.045951 24094 tablet_bootstrap.cc:492] T eb19b00e0b1540948179cc4c95b224bd P 1ffb2868f51d400b80d2f376cd1b44dc: Bootstrap starting.
I20260709 13:08:00.053272 24094 tablet_bootstrap.cc:654] T eb19b00e0b1540948179cc4c95b224bd P 1ffb2868f51d400b80d2f376cd1b44dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.052938 24099 raft_consensus.cc:515] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.055830 23902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb19b00e0b1540948179cc4c95b224bd" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:08:00.056126 24052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb19b00e0b1540948179cc4c95b224bd" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
I20260709 13:08:00.056721 24052 raft_consensus.cc:3060] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:00.060329 23942 leader_election.cc:343] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:00.062518 24102 raft_consensus.cc:2749] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:00.063289 24099 leader_election.cc:290] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 election: Requested vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:00.063617 24094 tablet_bootstrap.cc:492] T eb19b00e0b1540948179cc4c95b224bd P 1ffb2868f51d400b80d2f376cd1b44dc: No bootstrap required, opened a new log
I20260709 13:08:00.064213 24094 ts_tablet_manager.cc:1403] T eb19b00e0b1540948179cc4c95b224bd P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.009s
I20260709 13:08:00.065093 24052 raft_consensus.cc:2468] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 1.
I20260709 13:08:00.066293 23941 leader_election.cc:304] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4ac0744564624cecaf9c8806254c3b24, c21ae6936247494094e53b5674e80e25; no voters: 1ffb2868f51d400b80d2f376cd1b44dc
I20260709 13:08:00.067061 24099 raft_consensus.cc:2804] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:00.066869 24094 raft_consensus.cc:359] T eb19b00e0b1540948179cc4c95b224bd P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.067580 24099 raft_consensus.cc:697] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [term 1 LEADER]: Becoming Leader. State: Replica: c21ae6936247494094e53b5674e80e25, State: Running, Role: LEADER
I20260709 13:08:00.067610 24094 raft_consensus.cc:385] T eb19b00e0b1540948179cc4c95b224bd P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.068223 24094 raft_consensus.cc:740] T eb19b00e0b1540948179cc4c95b224bd P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.068651 24099 consensus_queue.cc:237] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.068867 24094 consensus_queue.cc:260] T eb19b00e0b1540948179cc4c95b224bd P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.070959 24094 ts_tablet_manager.cc:1434] T eb19b00e0b1540948179cc4c95b224bd P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:08:00.071913 24094 tablet_bootstrap.cc:492] T bc21a182d5354dd9a801b72554c3a88c P 1ffb2868f51d400b80d2f376cd1b44dc: Bootstrap starting.
I20260709 13:08:00.077895 24094 tablet_bootstrap.cc:654] T bc21a182d5354dd9a801b72554c3a88c P 1ffb2868f51d400b80d2f376cd1b44dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:00.080289 23799 catalog_manager.cc:5697] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to c21ae6936247494094e53b5674e80e25 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "c21ae6936247494094e53b5674e80e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:00.082147 24094 tablet_bootstrap.cc:492] T bc21a182d5354dd9a801b72554c3a88c P 1ffb2868f51d400b80d2f376cd1b44dc: No bootstrap required, opened a new log
I20260709 13:08:00.082662 24094 ts_tablet_manager.cc:1403] T bc21a182d5354dd9a801b72554c3a88c P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:08:00.084810 24094 raft_consensus.cc:359] T bc21a182d5354dd9a801b72554c3a88c P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.085438 24094 raft_consensus.cc:385] T bc21a182d5354dd9a801b72554c3a88c P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:00.085716 24094 raft_consensus.cc:740] T bc21a182d5354dd9a801b72554c3a88c P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Initialized, Role: FOLLOWER
I20260709 13:08:00.086303 24094 consensus_queue.cc:260] T bc21a182d5354dd9a801b72554c3a88c P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.088191 24094 ts_tablet_manager.cc:1434] T bc21a182d5354dd9a801b72554c3a88c P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:08:00.097479 24097 raft_consensus.cc:493] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.098165 24097 raft_consensus.cc:515] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.099907 24097 leader_election.cc:290] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653)
I20260709 13:08:00.100720 23902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3acc3cd5da084f91a092454501bb2280" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" is_pre_election: true
I20260709 13:08:00.101022 23978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3acc3cd5da084f91a092454501bb2280" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25" is_pre_election: true
I20260709 13:08:00.101516 23902 raft_consensus.cc:2468] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 0.
I20260709 13:08:00.101625 23978 raft_consensus.cc:2468] T 3acc3cd5da084f91a092454501bb2280 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 0.
I20260709 13:08:00.102818 24016 leader_election.cc:304] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, 4ac0744564624cecaf9c8806254c3b24; no voters: 
I20260709 13:08:00.103556 24097 raft_consensus.cc:2804] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:00.103926 24097 raft_consensus.cc:493] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.104202 24097 raft_consensus.cc:3060] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.109081 24097 raft_consensus.cc:515] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.110819 24097 leader_election.cc:290] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 election: Requested vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653)
I20260709 13:08:00.111807 23902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3acc3cd5da084f91a092454501bb2280" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:08:00.111802 23978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3acc3cd5da084f91a092454501bb2280" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:08:00.112500 23902 raft_consensus.cc:3060] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.112718 23978 raft_consensus.cc:3060] T 3acc3cd5da084f91a092454501bb2280 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.114846 24117 consensus_queue.cc:1048] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:00.119841 23978 raft_consensus.cc:2468] T 3acc3cd5da084f91a092454501bb2280 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 1.
I20260709 13:08:00.119881 23902 raft_consensus.cc:2468] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 1.
I20260709 13:08:00.121222 24017 leader_election.cc:304] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ac0744564624cecaf9c8806254c3b24, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:00.122246 24117 raft_consensus.cc:2804] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:00.122786 24117 raft_consensus.cc:697] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Becoming Leader. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Running, Role: LEADER
I20260709 13:08:00.123593 24117 consensus_queue.cc:237] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.134137 24151 raft_consensus.cc:493] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.134832 24151 raft_consensus.cc:515] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.139325 24151 leader_election.cc:290] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653)
I20260709 13:08:00.139792 23902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6447060a38b04932bf5c6b794319bfdb" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" is_pre_election: true
I20260709 13:08:00.140489 23902 raft_consensus.cc:2468] T 6447060a38b04932bf5c6b794319bfdb P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 0.
I20260709 13:08:00.141801 24016 leader_election.cc:304] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, 4ac0744564624cecaf9c8806254c3b24; no voters: 
I20260709 13:08:00.142403 23978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6447060a38b04932bf5c6b794319bfdb" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25" is_pre_election: true
I20260709 13:08:00.143095 23978 raft_consensus.cc:2468] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 0.
I20260709 13:08:00.143641 24151 raft_consensus.cc:2804] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:00.144073 24151 raft_consensus.cc:493] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.144434 24151 raft_consensus.cc:3060] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.146155 23798 catalog_manager.cc:5697] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "4ac0744564624cecaf9c8806254c3b24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.149979 24102 raft_consensus.cc:493] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.150877 24102 raft_consensus.cc:515] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.152562 24151 raft_consensus.cc:515] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.153692 24097 consensus_queue.cc:1048] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:00.155262 24151 leader_election.cc:290] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 election: Requested vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653)
I20260709 13:08:00.156908 23977 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6447060a38b04932bf5c6b794319bfdb" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:08:00.157650 23977 raft_consensus.cc:3060] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.157950 23903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6447060a38b04932bf5c6b794319bfdb" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:08:00.158650 23903 raft_consensus.cc:3060] T 6447060a38b04932bf5c6b794319bfdb P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.161983 23978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e3a18f58ed43899a18da4f19e44a9e" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25" is_pre_election: true
I20260709 13:08:00.162719 23978 raft_consensus.cc:2468] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 0.
I20260709 13:08:00.164968 24102 leader_election.cc:290] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:00.166141 24052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e3a18f58ed43899a18da4f19e44a9e" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24" is_pre_election: true
I20260709 13:08:00.167750 23977 raft_consensus.cc:2468] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 1.
I20260709 13:08:00.170917 23868 leader_election.cc:304] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:00.171182 24052 raft_consensus.cc:2468] T a2e3a18f58ed43899a18da4f19e44a9e P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 0.
I20260709 13:08:00.171945 24017 leader_election.cc:304] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ac0744564624cecaf9c8806254c3b24, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:00.172600 23903 raft_consensus.cc:2468] T 6447060a38b04932bf5c6b794319bfdb P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 1.
I20260709 13:08:00.172976 24117 raft_consensus.cc:2804] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:00.175451 24117 raft_consensus.cc:697] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Becoming Leader. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Running, Role: LEADER
I20260709 13:08:00.176447 24117 consensus_queue.cc:237] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.173015 24102 raft_consensus.cc:2804] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:00.178359 24102 raft_consensus.cc:493] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.178747 24102 raft_consensus.cc:3060] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.186115 24102 raft_consensus.cc:515] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.188319 24102 leader_election.cc:290] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 election: Requested vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:00.189487 23976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e3a18f58ed43899a18da4f19e44a9e" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:08:00.190272 24052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e3a18f58ed43899a18da4f19e44a9e" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
I20260709 13:08:00.190918 24052 raft_consensus.cc:3060] T a2e3a18f58ed43899a18da4f19e44a9e P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.190325 23976 raft_consensus.cc:3060] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.196969 24052 raft_consensus.cc:2468] T a2e3a18f58ed43899a18da4f19e44a9e P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 1.
I20260709 13:08:00.198076 23866 leader_election.cc:304] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, 4ac0744564624cecaf9c8806254c3b24; no voters: 
I20260709 13:08:00.197553 23799 catalog_manager.cc:5697] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "4ac0744564624cecaf9c8806254c3b24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.198757 24102 raft_consensus.cc:2804] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:00.199414 24102 raft_consensus.cc:697] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Becoming Leader. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Running, Role: LEADER
I20260709 13:08:00.199981 23976 raft_consensus.cc:2468] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 1.
I20260709 13:08:00.200237 24102 consensus_queue.cc:237] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.209223 23798 catalog_manager.cc:5697] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193). New cstate: current_term: 1 leader_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:00.263484 23903 raft_consensus.cc:3060] T bc21a182d5354dd9a801b72554c3a88c P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.270090 24099 consensus_queue.cc:1048] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:00.280936 24099 consensus_queue.cc:1048] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:00.323918 24102 raft_consensus.cc:493] T eb19b00e0b1540948179cc4c95b224bd P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.324524 24102 raft_consensus.cc:515] T eb19b00e0b1540948179cc4c95b224bd P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.325533 24099 consensus_queue.cc:1048] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:00.326547 24102 leader_election.cc:290] T eb19b00e0b1540948179cc4c95b224bd P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:00.328090 23976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb19b00e0b1540948179cc4c95b224bd" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25" is_pre_election: true
I20260709 13:08:00.328400 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb19b00e0b1540948179cc4c95b224bd" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24" is_pre_election: true
I20260709 13:08:00.329144 24051 raft_consensus.cc:2393] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ffb2868f51d400b80d2f376cd1b44dc in current term 1: Already voted for candidate c21ae6936247494094e53b5674e80e25 in this term.
I20260709 13:08:00.330367 23866 leader_election.cc:304] T eb19b00e0b1540948179cc4c95b224bd P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc; no voters: 4ac0744564624cecaf9c8806254c3b24, c21ae6936247494094e53b5674e80e25
I20260709 13:08:00.331588 24102 raft_consensus.cc:3060] T eb19b00e0b1540948179cc4c95b224bd P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.339613 24126 consensus_queue.cc:1048] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:00.340031 24121 consensus_queue.cc:1048] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:00.351523 23977 raft_consensus.cc:3060] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.352285 24102 raft_consensus.cc:2749] T eb19b00e0b1540948179cc4c95b224bd P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:00.359433 24052 raft_consensus.cc:3060] T 3e307bece597495db95ccd648adc8908 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:00.361644 24102 consensus_queue.cc:1048] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:00.372279 24161 consensus_queue.cc:1048] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:00.380000 24108 consensus_queue.cc:1048] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:00.406942 24051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "689f94e16e69480a85ba6b0e823624e8"
dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
mode: GRACEFUL
new_leader_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
 from {username='slave'} at 127.0.0.1:36076
I20260709 13:08:00.407449 24051 raft_consensus.cc:606] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Received request to transfer leadership to TS 1ffb2868f51d400b80d2f376cd1b44dc
I20260709 13:08:00.425518 23977 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c32a002d2cab4ce286b7ebeb0602d1a5"
dest_uuid: "c21ae6936247494094e53b5674e80e25"
mode: GRACEFUL
new_leader_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
 from {username='slave'} at 127.0.0.1:43262
I20260709 13:08:00.426129 23977 raft_consensus.cc:606] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [term 1 LEADER]: Received request to transfer leadership to TS 1ffb2868f51d400b80d2f376cd1b44dc
I20260709 13:08:00.432406 24051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3acc3cd5da084f91a092454501bb2280"
dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
mode: GRACEFUL
new_leader_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
 from {username='slave'} at 127.0.0.1:36076
I20260709 13:08:00.432922 24051 raft_consensus.cc:606] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Received request to transfer leadership to TS 1ffb2868f51d400b80d2f376cd1b44dc
I20260709 13:08:00.438405 24051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6447060a38b04932bf5c6b794319bfdb"
dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
mode: GRACEFUL
new_leader_uuid: "c21ae6936247494094e53b5674e80e25"
 from {username='slave'} at 127.0.0.1:36076
I20260709 13:08:00.438864 24051 raft_consensus.cc:606] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Received request to transfer leadership to TS c21ae6936247494094e53b5674e80e25
I20260709 13:08:00.452970 23903 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a2e3a18f58ed43899a18da4f19e44a9e"
dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
mode: GRACEFUL
new_leader_uuid: "c21ae6936247494094e53b5674e80e25"
 from {username='slave'} at 127.0.0.1:41500
I20260709 13:08:00.453459 23903 raft_consensus.cc:606] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Received request to transfer leadership to TS c21ae6936247494094e53b5674e80e25
I20260709 13:08:00.458963 23903 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e307bece597495db95ccd648adc8908"
dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
mode: GRACEFUL
new_leader_uuid: "c21ae6936247494094e53b5674e80e25"
 from {username='slave'} at 127.0.0.1:41500
I20260709 13:08:00.459475 23903 raft_consensus.cc:606] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Received request to transfer leadership to TS c21ae6936247494094e53b5674e80e25
I20260709 13:08:00.467540 23977 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc21a182d5354dd9a801b72554c3a88c"
dest_uuid: "c21ae6936247494094e53b5674e80e25"
mode: GRACEFUL
new_leader_uuid: "4ac0744564624cecaf9c8806254c3b24"
 from {username='slave'} at 127.0.0.1:43262
I20260709 13:08:00.468166 23977 raft_consensus.cc:606] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [term 1 LEADER]: Received request to transfer leadership to TS 4ac0744564624cecaf9c8806254c3b24
I20260709 13:08:00.619817 24122 consensus_queue.cc:1048] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:00.632094 24122 consensus_queue.cc:1048] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:00.640653 24117 consensus_queue.cc:1048] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:00.642702 24108 consensus_queue.cc:1048] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:00.643031 24117 consensus_queue.cc:1048] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:00.658279 24126 consensus_queue.cc:1048] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:00.661438 24117 consensus_queue.cc:1048] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:00.672807 24151 consensus_queue.cc:1048] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:00.695806 24147 raft_consensus.cc:993] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24: : Instructing follower c21ae6936247494094e53b5674e80e25 to start an election
I20260709 13:08:00.696283 24147 raft_consensus.cc:1081] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Signalling peer c21ae6936247494094e53b5674e80e25 to start an election
I20260709 13:08:00.698519 23976 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6447060a38b04932bf5c6b794319bfdb"
dest_uuid: "c21ae6936247494094e53b5674e80e25"
 from {username='slave'} at 127.0.0.1:43234
I20260709 13:08:00.699048 24161 raft_consensus.cc:993] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc: : Instructing follower c21ae6936247494094e53b5674e80e25 to start an election
I20260709 13:08:00.699290 23976 raft_consensus.cc:493] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:00.699833 24161 raft_consensus.cc:1081] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Signalling peer c21ae6936247494094e53b5674e80e25 to start an election
I20260709 13:08:00.700008 23976 raft_consensus.cc:3060] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.703109 23978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a2e3a18f58ed43899a18da4f19e44a9e"
dest_uuid: "c21ae6936247494094e53b5674e80e25"
 from {username='slave'} at 127.0.0.1:43248
I20260709 13:08:00.703926 23978 raft_consensus.cc:493] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:00.704460 23978 raft_consensus.cc:3060] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.709857 23976 raft_consensus.cc:515] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.715019 24052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6447060a38b04932bf5c6b794319bfdb" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
I20260709 13:08:00.715727 24052 raft_consensus.cc:3055] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:00.716115 24052 raft_consensus.cc:740] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Running, Role: LEADER
I20260709 13:08:00.717048 24052 consensus_queue.cc:260] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.718611 23902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6447060a38b04932bf5c6b794319bfdb" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:08:00.719273 23902 raft_consensus.cc:3060] T 6447060a38b04932bf5c6b794319bfdb P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.719513 24052 raft_consensus.cc:3060] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.720170 23978 raft_consensus.cc:515] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.722759 23978 leader_election.cc:290] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 2 election: Requested vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:00.725684 23901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e3a18f58ed43899a18da4f19e44a9e" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:08:00.725894 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a2e3a18f58ed43899a18da4f19e44a9e" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
I20260709 13:08:00.726413 23901 raft_consensus.cc:3055] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:00.726603 24051 raft_consensus.cc:3060] T a2e3a18f58ed43899a18da4f19e44a9e P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.726795 23901 raft_consensus.cc:740] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Running, Role: LEADER
I20260709 13:08:00.727707 23901 consensus_queue.cc:260] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.729221 23901 raft_consensus.cc:3060] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.729626 23976 leader_election.cc:290] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 2 election: Requested vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:00.730736 23902 raft_consensus.cc:2468] T 6447060a38b04932bf5c6b794319bfdb P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 2.
I20260709 13:08:00.731184 24117 raft_consensus.cc:993] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24: : Instructing follower 1ffb2868f51d400b80d2f376cd1b44dc to start an election
I20260709 13:08:00.731702 24117 raft_consensus.cc:1081] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Signalling peer 1ffb2868f51d400b80d2f376cd1b44dc to start an election
I20260709 13:08:00.732838 23942 leader_election.cc:304] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:00.733788 24122 raft_consensus.cc:2804] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:00.734311 24122 raft_consensus.cc:697] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [term 2 LEADER]: Becoming Leader. State: Replica: c21ae6936247494094e53b5674e80e25, State: Running, Role: LEADER
I20260709 13:08:00.735217 24122 consensus_queue.cc:237] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.736898 23903 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3acc3cd5da084f91a092454501bb2280"
dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
 from {username='slave'} at 127.0.0.1:41474
I20260709 13:08:00.737505 23903 raft_consensus.cc:493] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:00.737584 23901 raft_consensus.cc:2468] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 2.
I20260709 13:08:00.738062 23903 raft_consensus.cc:3060] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.739038 23942 leader_election.cc:304] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:00.741273 24122 raft_consensus.cc:2804] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:00.742647 24122 raft_consensus.cc:697] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25 [term 2 LEADER]: Becoming Leader. State: Replica: c21ae6936247494094e53b5674e80e25, State: Running, Role: LEADER
I20260709 13:08:00.743947 24051 raft_consensus.cc:2468] T a2e3a18f58ed43899a18da4f19e44a9e P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 2.
I20260709 13:08:00.745154 23903 raft_consensus.cc:515] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.743712 24122 consensus_queue.cc:237] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.732878 24052 raft_consensus.cc:2468] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 2.
I20260709 13:08:00.747282 24151 raft_consensus.cc:993] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24: : Instructing follower 1ffb2868f51d400b80d2f376cd1b44dc to start an election
I20260709 13:08:00.747748 24151 raft_consensus.cc:1081] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Signalling peer 1ffb2868f51d400b80d2f376cd1b44dc to start an election
I20260709 13:08:00.748960 23903 leader_election.cc:290] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 2 election: Requested vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:00.750468 23902 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "689f94e16e69480a85ba6b0e823624e8"
dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
 from {username='slave'} at 127.0.0.1:41474
I20260709 13:08:00.751307 23902 raft_consensus.cc:493] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:00.751706 23902 raft_consensus.cc:3060] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.750496 23976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3acc3cd5da084f91a092454501bb2280" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:08:00.754704 23976 raft_consensus.cc:3060] T 3acc3cd5da084f91a092454501bb2280 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.757493 23801 catalog_manager.cc:5697] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 reported cstate change: term changed from 1 to 2, leader changed from 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195) to c21ae6936247494094e53b5674e80e25 (127.11.44.194). New cstate: current_term: 2 leader_uuid: "c21ae6936247494094e53b5674e80e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:00.750365 24052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3acc3cd5da084f91a092454501bb2280" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
I20260709 13:08:00.759219 24052 raft_consensus.cc:3055] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:00.759562 24052 raft_consensus.cc:740] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Running, Role: LEADER
I20260709 13:08:00.760571 23902 raft_consensus.cc:515] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.760963 24052 consensus_queue.cc:260] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.762954 24052 raft_consensus.cc:3060] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.764022 23902 leader_election.cc:290] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 2 election: Requested vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:00.764271 23978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689f94e16e69480a85ba6b0e823624e8" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:08:00.765417 23978 raft_consensus.cc:3060] T 689f94e16e69480a85ba6b0e823624e8 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.765808 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "689f94e16e69480a85ba6b0e823624e8" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
I20260709 13:08:00.766546 24051 raft_consensus.cc:3055] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:00.766911 24051 raft_consensus.cc:740] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Running, Role: LEADER
I20260709 13:08:00.768117 24051 consensus_queue.cc:260] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.770632 24051 raft_consensus.cc:3060] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.773803 23978 raft_consensus.cc:2468] T 689f94e16e69480a85ba6b0e823624e8 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 2.
I20260709 13:08:00.776016 23868 leader_election.cc:304] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:00.777148 24126 raft_consensus.cc:2804] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:00.777849 24126 raft_consensus.cc:697] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 LEADER]: Becoming Leader. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Running, Role: LEADER
I20260709 13:08:00.779193 24052 raft_consensus.cc:2468] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 2.
I20260709 13:08:00.769934 23976 raft_consensus.cc:2468] T 3acc3cd5da084f91a092454501bb2280 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 2.
I20260709 13:08:00.778762 24126 consensus_queue.cc:237] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.780928 23866 leader_election.cc:304] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, 4ac0744564624cecaf9c8806254c3b24; no voters: 
I20260709 13:08:00.782051 24051 raft_consensus.cc:2468] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 2.
I20260709 13:08:00.784359 24108 raft_consensus.cc:2804] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:00.784997 24108 raft_consensus.cc:697] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 LEADER]: Becoming Leader. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Running, Role: LEADER
I20260709 13:08:00.785969 24108 consensus_queue.cc:237] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.790441 23800 catalog_manager.cc:5697] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc reported cstate change: term changed from 1 to 2, leader changed from 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195) to 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193). New cstate: current_term: 2 leader_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:00.797509 23801 catalog_manager.cc:5697] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25 reported cstate change: term changed from 1 to 2, leader changed from 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193) to c21ae6936247494094e53b5674e80e25 (127.11.44.194). New cstate: current_term: 2 leader_uuid: "c21ae6936247494094e53b5674e80e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:00.805295 23800 catalog_manager.cc:5697] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc reported cstate change: term changed from 1 to 2, leader changed from 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195) to 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193). New cstate: current_term: 2 leader_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:00.898571 24126 raft_consensus.cc:993] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc: : Instructing follower c21ae6936247494094e53b5674e80e25 to start an election
I20260709 13:08:00.899070 24126 raft_consensus.cc:1081] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Signalling peer c21ae6936247494094e53b5674e80e25 to start an election
I20260709 13:08:00.899780 24099 raft_consensus.cc:993] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25: : Instructing follower 4ac0744564624cecaf9c8806254c3b24 to start an election
I20260709 13:08:00.900322 24099 raft_consensus.cc:1081] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [term 1 LEADER]: Signalling peer 4ac0744564624cecaf9c8806254c3b24 to start an election
I20260709 13:08:00.900769 23978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e307bece597495db95ccd648adc8908"
dest_uuid: "c21ae6936247494094e53b5674e80e25"
 from {username='slave'} at 127.0.0.1:43248
I20260709 13:08:00.901685 23978 raft_consensus.cc:493] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:00.901944 24051 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc21a182d5354dd9a801b72554c3a88c"
dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
 from {username='slave'} at 127.0.0.1:36066
I20260709 13:08:00.902055 23978 raft_consensus.cc:3060] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.902608 24051 raft_consensus.cc:493] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:00.902997 24051 raft_consensus.cc:3060] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.908360 24051 raft_consensus.cc:515] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.908785 23978 raft_consensus.cc:515] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.910140 24051 leader_election.cc:290] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 2 election: Requested vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653)
I20260709 13:08:00.911087 23902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc21a182d5354dd9a801b72554c3a88c" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:08:00.911283 23976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc21a182d5354dd9a801b72554c3a88c" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:08:00.911592 23903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e307bece597495db95ccd648adc8908" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:08:00.911746 23902 raft_consensus.cc:3060] T bc21a182d5354dd9a801b72554c3a88c P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.911955 23976 raft_consensus.cc:3055] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:00.912304 23903 raft_consensus.cc:3055] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:00.912438 23976 raft_consensus.cc:740] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c21ae6936247494094e53b5674e80e25, State: Running, Role: LEADER
I20260709 13:08:00.912729 23903 raft_consensus.cc:740] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Running, Role: LEADER
I20260709 13:08:00.913522 23978 leader_election.cc:290] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 2 election: Requested vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:00.913419 23976 consensus_queue.cc:260] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.913676 23903 consensus_queue.cc:260] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.914919 23976 raft_consensus.cc:3060] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.913443 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e307bece597495db95ccd648adc8908" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
I20260709 13:08:00.915789 24051 raft_consensus.cc:3060] T 3e307bece597495db95ccd648adc8908 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.915032 23903 raft_consensus.cc:3060] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.920229 24122 raft_consensus.cc:993] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25: : Instructing follower 1ffb2868f51d400b80d2f376cd1b44dc to start an election
I20260709 13:08:00.920706 24122 raft_consensus.cc:1081] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [term 1 LEADER]: Signalling peer 1ffb2868f51d400b80d2f376cd1b44dc to start an election
I20260709 13:08:00.922488 23976 raft_consensus.cc:2468] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 2.
I20260709 13:08:00.922907 24051 raft_consensus.cc:2468] T 3e307bece597495db95ccd648adc8908 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 2.
I20260709 13:08:00.923846 24017 leader_election.cc:304] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ac0744564624cecaf9c8806254c3b24, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:00.924372 23941 leader_election.cc:304] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ac0744564624cecaf9c8806254c3b24, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:00.924918 24117 raft_consensus.cc:2804] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:00.925312 24121 raft_consensus.cc:2804] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:00.925442 24117 raft_consensus.cc:697] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24 [term 2 LEADER]: Becoming Leader. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Running, Role: LEADER
I20260709 13:08:00.925806 23901 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c32a002d2cab4ce286b7ebeb0602d1a5"
dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
 from {username='slave'} at 127.0.0.1:41488
I20260709 13:08:00.925863 24121 raft_consensus.cc:697] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25 [term 2 LEADER]: Becoming Leader. State: Replica: c21ae6936247494094e53b5674e80e25, State: Running, Role: LEADER
I20260709 13:08:00.926373 24117 consensus_queue.cc:237] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.927064 23903 raft_consensus.cc:2468] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 2.
I20260709 13:08:00.927629 24121 consensus_queue.cc:237] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.926432 23901 raft_consensus.cc:493] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:00.928758 23901 raft_consensus.cc:3060] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.919400 23902 raft_consensus.cc:2468] T bc21a182d5354dd9a801b72554c3a88c P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 2.
I20260709 13:08:00.935707 23901 raft_consensus.cc:515] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.935719 23800 catalog_manager.cc:5697] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24 reported cstate change: term changed from 1 to 2, leader changed from c21ae6936247494094e53b5674e80e25 (127.11.44.194) to 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195). New cstate: current_term: 2 leader_uuid: "4ac0744564624cecaf9c8806254c3b24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:00.937252 23801 catalog_manager.cc:5697] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25 reported cstate change: term changed from 1 to 2, leader changed from 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193) to c21ae6936247494094e53b5674e80e25 (127.11.44.194). New cstate: current_term: 2 leader_uuid: "c21ae6936247494094e53b5674e80e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:00.938432 23976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32a002d2cab4ce286b7ebeb0602d1a5" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:08:00.938835 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32a002d2cab4ce286b7ebeb0602d1a5" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
I20260709 13:08:00.939211 23976 raft_consensus.cc:3055] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:00.939419 24051 raft_consensus.cc:3060] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.939699 23976 raft_consensus.cc:740] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c21ae6936247494094e53b5674e80e25, State: Running, Role: LEADER
I20260709 13:08:00.940680 23976 consensus_queue.cc:260] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.941900 23976 raft_consensus.cc:3060] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:00.943990 23901 leader_election.cc:290] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 2 election: Requested vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:00.946732 24051 raft_consensus.cc:2468] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 2.
I20260709 13:08:00.948127 23866 leader_election.cc:304] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, 4ac0744564624cecaf9c8806254c3b24; no voters: 
I20260709 13:08:00.949028 24126 raft_consensus.cc:2804] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:00.949510 24126 raft_consensus.cc:697] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 LEADER]: Becoming Leader. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Running, Role: LEADER
I20260709 13:08:00.950340 24126 consensus_queue.cc:237] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:00.950929 23976 raft_consensus.cc:2468] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 2.
I20260709 13:08:00.958302 23801 catalog_manager.cc:5697] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc reported cstate change: term changed from 1 to 2, leader changed from c21ae6936247494094e53b5674e80e25 (127.11.44.194) to 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193). New cstate: current_term: 2 leader_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:01.130242 24051 raft_consensus.cc:1275] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Refusing update from remote peer c21ae6936247494094e53b5674e80e25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:01.131677 24121 consensus_queue.cc:1048] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:01.140640 23901 raft_consensus.cc:1275] T 6447060a38b04932bf5c6b794319bfdb P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Refusing update from remote peer c21ae6936247494094e53b5674e80e25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:01.142462 24099 consensus_queue.cc:1048] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:01.174018 23976 raft_consensus.cc:1275] T 3acc3cd5da084f91a092454501bb2280 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Refusing update from remote peer 1ffb2868f51d400b80d2f376cd1b44dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:01.175446 24126 consensus_queue.cc:1048] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:01.183566 24051 raft_consensus.cc:1275] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Refusing update from remote peer 1ffb2868f51d400b80d2f376cd1b44dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:01.185804 24126 consensus_queue.cc:1048] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:01.206966 24051 raft_consensus.cc:1275] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Refusing update from remote peer 1ffb2868f51d400b80d2f376cd1b44dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:01.208324 24126 consensus_queue.cc:1048] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:01.217936 23976 raft_consensus.cc:1275] T 689f94e16e69480a85ba6b0e823624e8 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Refusing update from remote peer 1ffb2868f51d400b80d2f376cd1b44dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:01.219489 24102 consensus_queue.cc:1048] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:01.291419 24051 raft_consensus.cc:1275] T a2e3a18f58ed43899a18da4f19e44a9e P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Refusing update from remote peer c21ae6936247494094e53b5674e80e25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:01.293042 24121 consensus_queue.cc:1048] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:01.301232 23901 raft_consensus.cc:1275] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Refusing update from remote peer c21ae6936247494094e53b5674e80e25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:01.302875 24099 consensus_queue.cc:1048] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:01.394182 23901 raft_consensus.cc:1275] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Refusing update from remote peer c21ae6936247494094e53b5674e80e25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:01.395515 24099 consensus_queue.cc:1048] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:01.406271 24051 raft_consensus.cc:1275] T 3e307bece597495db95ccd648adc8908 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Refusing update from remote peer c21ae6936247494094e53b5674e80e25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:01.408465 24099 consensus_queue.cc:1048] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:01.433055 23901 raft_consensus.cc:1275] T bc21a182d5354dd9a801b72554c3a88c P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Refusing update from remote peer 4ac0744564624cecaf9c8806254c3b24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:01.434403 24117 consensus_queue.cc:1048] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:01.441501 24051 raft_consensus.cc:1275] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Refusing update from remote peer 1ffb2868f51d400b80d2f376cd1b44dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:01.443020 24126 consensus_queue.cc:1048] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:01.445163 23976 raft_consensus.cc:1275] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Refusing update from remote peer 4ac0744564624cecaf9c8806254c3b24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:01.455018 24187 consensus_queue.cc:1048] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:01.468451 23976 raft_consensus.cc:1275] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Refusing update from remote peer 1ffb2868f51d400b80d2f376cd1b44dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:01.470111 24108 consensus_queue.cc:1048] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:03.499030 23798 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53484:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:08:03.501480 23798 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:08:03.554127 23885 tablet_service.cc:1511] Processing CreateTablet for tablet 59ecee468eab4a3c9042df77e4201792 (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:03.555001 23967 tablet_service.cc:1511] Processing CreateTablet for tablet 59ecee468eab4a3c9042df77e4201792 (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:03.555447 23885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ecee468eab4a3c9042df77e4201792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.556330 23967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ecee468eab4a3c9042df77e4201792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.557266 23889 tablet_service.cc:1511] Processing CreateTablet for tablet 18a7f98926e246c88b9d0fc7860b4314 (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:03.558530 24037 tablet_service.cc:1511] Processing CreateTablet for tablet 59ecee468eab4a3c9042df77e4201792 (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:03.559859 24037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59ecee468eab4a3c9042df77e4201792. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.562736 23886 tablet_service.cc:1511] Processing CreateTablet for tablet 4a6bf2bb57004015a2864887cf0a5f9d (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:03.563512 24036 tablet_service.cc:1511] Processing CreateTablet for tablet 18a7f98926e246c88b9d0fc7860b4314 (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:03.564800 24036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a7f98926e246c88b9d0fc7860b4314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.564827 23964 tablet_service.cc:1511] Processing CreateTablet for tablet 18a7f98926e246c88b9d0fc7860b4314 (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:03.565655 23963 tablet_service.cc:1511] Processing CreateTablet for tablet 4a6bf2bb57004015a2864887cf0a5f9d (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:03.566314 23964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a7f98926e246c88b9d0fc7860b4314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.566932 23963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6bf2bb57004015a2864887cf0a5f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.558586 23889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a7f98926e246c88b9d0fc7860b4314. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.570937 23886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6bf2bb57004015a2864887cf0a5f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.582851 24038 tablet_service.cc:1511] Processing CreateTablet for tablet 4a6bf2bb57004015a2864887cf0a5f9d (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:03.584694 24038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a6bf2bb57004015a2864887cf0a5f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.589447 23890 tablet_service.cc:1511] Processing CreateTablet for tablet 5978d96a07b343bbaed141cac26fe3c9 (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:03.590975 23890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5978d96a07b343bbaed141cac26fe3c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.596297 23965 tablet_service.cc:1511] Processing CreateTablet for tablet 5978d96a07b343bbaed141cac26fe3c9 (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:03.597786 23965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5978d96a07b343bbaed141cac26fe3c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.600215 24039 tablet_service.cc:1511] Processing CreateTablet for tablet 5978d96a07b343bbaed141cac26fe3c9 (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:03.602664 23888 tablet_service.cc:1511] Processing CreateTablet for tablet 390dc3de8e9c483db58dc139361223f3 (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:03.604068 23888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390dc3de8e9c483db58dc139361223f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.609747 24039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5978d96a07b343bbaed141cac26fe3c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.619663 23961 tablet_service.cc:1511] Processing CreateTablet for tablet 390dc3de8e9c483db58dc139361223f3 (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:03.621201 23961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390dc3de8e9c483db58dc139361223f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.621933 24034 tablet_service.cc:1511] Processing CreateTablet for tablet 390dc3de8e9c483db58dc139361223f3 (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:03.623317 24034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390dc3de8e9c483db58dc139361223f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.627436 23893 tablet_service.cc:1511] Processing CreateTablet for tablet 68ba6038bc094d98859b0b6ade6c83d1 (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:03.628844 23893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68ba6038bc094d98859b0b6ade6c83d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.650373 23967 tablet_service.cc:1511] Processing CreateTablet for tablet 68ba6038bc094d98859b0b6ade6c83d1 (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:03.650667 24035 tablet_service.cc:1511] Processing CreateTablet for tablet 68ba6038bc094d98859b0b6ade6c83d1 (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:03.657670 23967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68ba6038bc094d98859b0b6ade6c83d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.658008 24035 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68ba6038bc094d98859b0b6ade6c83d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.660821 24038 tablet_service.cc:1511] Processing CreateTablet for tablet b281bbfb7e724d61b35f26f082cf89ef (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:03.651964 23891 tablet_service.cc:1511] Processing CreateTablet for tablet b281bbfb7e724d61b35f26f082cf89ef (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:03.662254 24038 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b281bbfb7e724d61b35f26f082cf89ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.664100 23964 tablet_service.cc:1511] Processing CreateTablet for tablet b281bbfb7e724d61b35f26f082cf89ef (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:03.662254 23891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b281bbfb7e724d61b35f26f082cf89ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.665619 23964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b281bbfb7e724d61b35f26f082cf89ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.666676 24209 tablet_bootstrap.cc:492] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24: Bootstrap starting.
I20260709 13:08:03.668452 24208 tablet_bootstrap.cc:492] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc: Bootstrap starting.
I20260709 13:08:03.677732 23962 tablet_service.cc:1511] Processing CreateTablet for tablet aa09d546b66644e8adab35389c543f3e (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:03.679188 23962 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa09d546b66644e8adab35389c543f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.682188 23889 tablet_service.cc:1511] Processing CreateTablet for tablet d9f364f61ea14310914861a311638607 (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:03.683537 23889 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9f364f61ea14310914861a311638607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.686638 24037 tablet_service.cc:1511] Processing CreateTablet for tablet aa09d546b66644e8adab35389c543f3e (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:03.688042 24037 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa09d546b66644e8adab35389c543f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.694363 23963 tablet_service.cc:1511] Processing CreateTablet for tablet d9f364f61ea14310914861a311638607 (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:03.695333 24036 tablet_service.cc:1511] Processing CreateTablet for tablet d9f364f61ea14310914861a311638607 (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:03.695767 23963 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9f364f61ea14310914861a311638607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.696656 24036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9f364f61ea14310914861a311638607. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.700337 24209 tablet_bootstrap.cc:654] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.655764 24207 tablet_bootstrap.cc:492] T 4a6bf2bb57004015a2864887cf0a5f9d P c21ae6936247494094e53b5674e80e25: Bootstrap starting.
I20260709 13:08:03.717132 24208 tablet_bootstrap.cc:654] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.694446 23885 tablet_service.cc:1511] Processing CreateTablet for tablet aa09d546b66644e8adab35389c543f3e (DEFAULT_TABLE table=soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:03.731861 23885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa09d546b66644e8adab35389c543f3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:03.733294 24207 tablet_bootstrap.cc:654] T 4a6bf2bb57004015a2864887cf0a5f9d P c21ae6936247494094e53b5674e80e25: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:03.743364 23849 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:03.744191 24209 tablet_bootstrap.cc:492] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24: No bootstrap required, opened a new log
I20260709 13:08:03.746008 24209 ts_tablet_manager.cc:1403] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.002s
I20260709 13:08:03.749138 24209 raft_consensus.cc:359] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.749939 24209 raft_consensus.cc:385] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:03.750234 24209 raft_consensus.cc:740] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Initialized, Role: FOLLOWER
I20260709 13:08:03.752295 24209 consensus_queue.cc:260] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.754604 24209 ts_tablet_manager.cc:1434] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:08:03.756889 24209 tablet_bootstrap.cc:492] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24: Bootstrap starting.
I20260709 13:08:03.758342 24207 tablet_bootstrap.cc:492] T 4a6bf2bb57004015a2864887cf0a5f9d P c21ae6936247494094e53b5674e80e25: No bootstrap required, opened a new log
I20260709 13:08:03.758688 24208 tablet_bootstrap.cc:492] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc: No bootstrap required, opened a new log
I20260709 13:08:03.758894 24207 ts_tablet_manager.cc:1403] T 4a6bf2bb57004015a2864887cf0a5f9d P c21ae6936247494094e53b5674e80e25: Time spent bootstrapping tablet: real 0.103s	user 0.019s	sys 0.000s
I20260709 13:08:03.763482 24209 tablet_bootstrap.cc:654] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.763136 24207 raft_consensus.cc:359] T 4a6bf2bb57004015a2864887cf0a5f9d P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.764057 24207 raft_consensus.cc:385] T 4a6bf2bb57004015a2864887cf0a5f9d P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:03.764475 24207 raft_consensus.cc:740] T 4a6bf2bb57004015a2864887cf0a5f9d P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21ae6936247494094e53b5674e80e25, State: Initialized, Role: FOLLOWER
I20260709 13:08:03.765323 24207 consensus_queue.cc:260] T 4a6bf2bb57004015a2864887cf0a5f9d P c21ae6936247494094e53b5674e80e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.766273 24208 ts_tablet_manager.cc:1403] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent bootstrapping tablet: real 0.098s	user 0.010s	sys 0.022s
I20260709 13:08:03.768653 24207 ts_tablet_manager.cc:1434] T 4a6bf2bb57004015a2864887cf0a5f9d P c21ae6936247494094e53b5674e80e25: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:03.770541 24207 tablet_bootstrap.cc:492] T 59ecee468eab4a3c9042df77e4201792 P c21ae6936247494094e53b5674e80e25: Bootstrap starting.
I20260709 13:08:03.771523 24209 tablet_bootstrap.cc:492] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24: No bootstrap required, opened a new log
I20260709 13:08:03.772102 24209 ts_tablet_manager.cc:1403] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:08:03.774092 24208 raft_consensus.cc:359] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.775064 24208 raft_consensus.cc:385] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:03.775381 24208 raft_consensus.cc:740] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Initialized, Role: FOLLOWER
I20260709 13:08:03.775669 24209 raft_consensus.cc:359] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.776451 24209 raft_consensus.cc:385] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:03.776199 24208 consensus_queue.cc:260] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.776777 24209 raft_consensus.cc:740] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Initialized, Role: FOLLOWER
I20260709 13:08:03.777820 24209 consensus_queue.cc:260] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.778992 24208 ts_tablet_manager.cc:1434] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:08:03.780170 24209 ts_tablet_manager.cc:1434] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:03.780169 24208 tablet_bootstrap.cc:492] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc: Bootstrap starting.
I20260709 13:08:03.782498 24207 tablet_bootstrap.cc:654] T 59ecee468eab4a3c9042df77e4201792 P c21ae6936247494094e53b5674e80e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.788558 24209 tablet_bootstrap.cc:492] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24: Bootstrap starting.
I20260709 13:08:03.789328 24208 tablet_bootstrap.cc:654] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.796589 24209 tablet_bootstrap.cc:654] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.799001 24207 tablet_bootstrap.cc:492] T 59ecee468eab4a3c9042df77e4201792 P c21ae6936247494094e53b5674e80e25: No bootstrap required, opened a new log
I20260709 13:08:03.799822 24207 ts_tablet_manager.cc:1403] T 59ecee468eab4a3c9042df77e4201792 P c21ae6936247494094e53b5674e80e25: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.004s
I20260709 13:08:03.803694 24209 tablet_bootstrap.cc:492] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24: No bootstrap required, opened a new log
I20260709 13:08:03.803592 24207 raft_consensus.cc:359] T 59ecee468eab4a3c9042df77e4201792 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.804013 24208 tablet_bootstrap.cc:492] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc: No bootstrap required, opened a new log
I20260709 13:08:03.804281 24209 ts_tablet_manager.cc:1403] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:08:03.804399 24207 raft_consensus.cc:385] T 59ecee468eab4a3c9042df77e4201792 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:03.804809 24208 ts_tablet_manager.cc:1403] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.002s
I20260709 13:08:03.804798 24207 raft_consensus.cc:740] T 59ecee468eab4a3c9042df77e4201792 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21ae6936247494094e53b5674e80e25, State: Initialized, Role: FOLLOWER
I20260709 13:08:03.805794 24207 consensus_queue.cc:260] T 59ecee468eab4a3c9042df77e4201792 P c21ae6936247494094e53b5674e80e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.807565 24209 raft_consensus.cc:359] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.808310 24207 ts_tablet_manager.cc:1434] T 59ecee468eab4a3c9042df77e4201792 P c21ae6936247494094e53b5674e80e25: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:08:03.809357 24207 tablet_bootstrap.cc:492] T 18a7f98926e246c88b9d0fc7860b4314 P c21ae6936247494094e53b5674e80e25: Bootstrap starting.
I20260709 13:08:03.809973 24208 raft_consensus.cc:359] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.810715 24208 raft_consensus.cc:385] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:03.811000 24208 raft_consensus.cc:740] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Initialized, Role: FOLLOWER
I20260709 13:08:03.811745 24208 consensus_queue.cc:260] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.808355 24209 raft_consensus.cc:385] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:03.814069 24208 ts_tablet_manager.cc:1434] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:08:03.814386 24209 raft_consensus.cc:740] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Initialized, Role: FOLLOWER
I20260709 13:08:03.815327 24208 tablet_bootstrap.cc:492] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc: Bootstrap starting.
I20260709 13:08:03.815207 24209 consensus_queue.cc:260] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.817670 24209 ts_tablet_manager.cc:1434] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:08:03.822486 24209 tablet_bootstrap.cc:492] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24: Bootstrap starting.
I20260709 13:08:03.822727 24208 tablet_bootstrap.cc:654] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.830974 24209 tablet_bootstrap.cc:654] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.834050 24207 tablet_bootstrap.cc:654] T 18a7f98926e246c88b9d0fc7860b4314 P c21ae6936247494094e53b5674e80e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.838884 24208 tablet_bootstrap.cc:492] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc: No bootstrap required, opened a new log
I20260709 13:08:03.839600 24208 ts_tablet_manager.cc:1403] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.006s
I20260709 13:08:03.842845 24208 raft_consensus.cc:359] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.843672 24208 raft_consensus.cc:385] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:03.844023 24208 raft_consensus.cc:740] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Initialized, Role: FOLLOWER
I20260709 13:08:03.844931 24208 consensus_queue.cc:260] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.847615 24209 tablet_bootstrap.cc:492] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24: No bootstrap required, opened a new log
I20260709 13:08:03.847923 24208 ts_tablet_manager.cc:1434] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:03.848620 24209 ts_tablet_manager.cc:1403] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.004s
I20260709 13:08:03.849170 24208 tablet_bootstrap.cc:492] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc: Bootstrap starting.
I20260709 13:08:03.856714 24208 tablet_bootstrap.cc:654] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.853180 24209 raft_consensus.cc:359] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.859484 24209 raft_consensus.cc:385] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:03.859907 24209 raft_consensus.cc:740] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Initialized, Role: FOLLOWER
I20260709 13:08:03.860913 24209 consensus_queue.cc:260] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.864416 24209 ts_tablet_manager.cc:1434] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24: Time spent starting tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:08:03.859107 24207 tablet_bootstrap.cc:492] T 18a7f98926e246c88b9d0fc7860b4314 P c21ae6936247494094e53b5674e80e25: No bootstrap required, opened a new log
I20260709 13:08:03.866053 24207 ts_tablet_manager.cc:1403] T 18a7f98926e246c88b9d0fc7860b4314 P c21ae6936247494094e53b5674e80e25: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.013s
I20260709 13:08:03.870625 24207 raft_consensus.cc:359] T 18a7f98926e246c88b9d0fc7860b4314 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.872387 24209 tablet_bootstrap.cc:492] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24: Bootstrap starting.
I20260709 13:08:03.871760 24207 raft_consensus.cc:385] T 18a7f98926e246c88b9d0fc7860b4314 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:03.874046 24207 raft_consensus.cc:740] T 18a7f98926e246c88b9d0fc7860b4314 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21ae6936247494094e53b5674e80e25, State: Initialized, Role: FOLLOWER
I20260709 13:08:03.875355 24207 consensus_queue.cc:260] T 18a7f98926e246c88b9d0fc7860b4314 P c21ae6936247494094e53b5674e80e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.895144 24209 tablet_bootstrap.cc:654] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.898123 24207 ts_tablet_manager.cc:1434] T 18a7f98926e246c88b9d0fc7860b4314 P c21ae6936247494094e53b5674e80e25: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.002s
I20260709 13:08:03.899753 24207 tablet_bootstrap.cc:492] T 5978d96a07b343bbaed141cac26fe3c9 P c21ae6936247494094e53b5674e80e25: Bootstrap starting.
I20260709 13:08:03.908414 24207 tablet_bootstrap.cc:654] T 5978d96a07b343bbaed141cac26fe3c9 P c21ae6936247494094e53b5674e80e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:03.919512 24102 raft_consensus.cc:493] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.920115 24102 raft_consensus.cc:515] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.920936 24208 tablet_bootstrap.cc:492] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc: No bootstrap required, opened a new log
I20260709 13:08:03.921589 24208 ts_tablet_manager.cc:1403] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent bootstrapping tablet: real 0.073s	user 0.030s	sys 0.021s
I20260709 13:08:03.921898 24196 raft_consensus.cc:493] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.922443 24196 raft_consensus.cc:515] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.924721 24196 leader_election.cc:290] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653)
I20260709 13:08:03.924999 24208 raft_consensus.cc:359] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.925917 24208 raft_consensus.cc:385] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:03.926273 24208 raft_consensus.cc:740] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Initialized, Role: FOLLOWER
I20260709 13:08:03.927290 23901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6bf2bb57004015a2864887cf0a5f9d" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" is_pre_election: true
I20260709 13:08:03.927181 24208 consensus_queue.cc:260] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.928401 23978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6bf2bb57004015a2864887cf0a5f9d" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25" is_pre_election: true
I20260709 13:08:03.929244 23978 raft_consensus.cc:2468] T 4a6bf2bb57004015a2864887cf0a5f9d P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 0.
I20260709 13:08:03.931275 24017 leader_election.cc:304] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ac0744564624cecaf9c8806254c3b24, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:03.933346 24102 leader_election.cc:290] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:03.934639 23978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6bf2bb57004015a2864887cf0a5f9d" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25" is_pre_election: true
I20260709 13:08:03.934815 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6bf2bb57004015a2864887cf0a5f9d" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24" is_pre_election: true
I20260709 13:08:03.935356 24196 raft_consensus.cc:2804] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:03.935810 23978 raft_consensus.cc:2468] T 4a6bf2bb57004015a2864887cf0a5f9d P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 0.
I20260709 13:08:03.937579 23868 leader_election.cc:304] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:03.935851 24051 raft_consensus.cc:2468] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 0.
I20260709 13:08:03.927968 23901 raft_consensus.cc:2468] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 0.
I20260709 13:08:03.939388 24102 raft_consensus.cc:2804] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:03.940474 24102 raft_consensus.cc:493] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.941028 24196 raft_consensus.cc:493] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.941412 24102 raft_consensus.cc:3060] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:03.941694 24196 raft_consensus.cc:3060] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:03.953083 24225 raft_consensus.cc:493] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.954491 24225 raft_consensus.cc:515] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:03.949502 24102 raft_consensus.cc:515] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.001484 24196 raft_consensus.cc:515] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.014350 24209 tablet_bootstrap.cc:492] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24: No bootstrap required, opened a new log
I20260709 13:08:04.014889 24208 ts_tablet_manager.cc:1434] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent starting tablet: real 0.093s	user 0.013s	sys 0.003s
I20260709 13:08:04.015537 24209 ts_tablet_manager.cc:1403] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24: Time spent bootstrapping tablet: real 0.144s	user 0.020s	sys 0.038s
I20260709 13:08:04.019470 24102 leader_election.cc:290] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 election: Requested vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:04.020812 24207 tablet_bootstrap.cc:492] T 5978d96a07b343bbaed141cac26fe3c9 P c21ae6936247494094e53b5674e80e25: No bootstrap required, opened a new log
I20260709 13:08:04.021302 23978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6bf2bb57004015a2864887cf0a5f9d" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:08:04.022540 23978 raft_consensus.cc:3060] T 4a6bf2bb57004015a2864887cf0a5f9d P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.024192 24207 ts_tablet_manager.cc:1403] T 5978d96a07b343bbaed141cac26fe3c9 P c21ae6936247494094e53b5674e80e25: Time spent bootstrapping tablet: real 0.125s	user 0.033s	sys 0.021s
I20260709 13:08:04.024838 23976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ba6038bc094d98859b0b6ade6c83d1" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25" is_pre_election: true
I20260709 13:08:04.026688 24225 leader_election.cc:290] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
W20260709 13:08:04.027109 23868 leader_election.cc:343] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.031358 24208 tablet_bootstrap.cc:492] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc: Bootstrap starting.
I20260709 13:08:04.033231 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6bf2bb57004015a2864887cf0a5f9d" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
I20260709 13:08:04.034436 24051 raft_consensus.cc:2393] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1ffb2868f51d400b80d2f376cd1b44dc in current term 1: Already voted for candidate 4ac0744564624cecaf9c8806254c3b24 in this term.
I20260709 13:08:04.036962 23901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6bf2bb57004015a2864887cf0a5f9d" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:08:04.037000 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ba6038bc094d98859b0b6ade6c83d1" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24" is_pre_election: true
I20260709 13:08:04.037191 24209 raft_consensus.cc:359] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.038759 24209 raft_consensus.cc:385] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.039139 23901 raft_consensus.cc:2393] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ac0744564624cecaf9c8806254c3b24 in current term 1: Already voted for candidate 1ffb2868f51d400b80d2f376cd1b44dc in this term.
I20260709 13:08:04.039310 24209 raft_consensus.cc:740] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.038064 23976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6bf2bb57004015a2864887cf0a5f9d" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:08:04.037627 24196 leader_election.cc:290] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 election: Requested vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653)
I20260709 13:08:04.040639 24209 consensus_queue.cc:260] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
W20260709 13:08:04.042870 23866 leader_election.cc:343] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.042963 24017 leader_election.cc:304] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ac0744564624cecaf9c8806254c3b24; no voters: 1ffb2868f51d400b80d2f376cd1b44dc, c21ae6936247494094e53b5674e80e25
I20260709 13:08:04.043701 24207 raft_consensus.cc:359] T 5978d96a07b343bbaed141cac26fe3c9 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.044837 24207 raft_consensus.cc:385] T 5978d96a07b343bbaed141cac26fe3c9 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.045212 24207 raft_consensus.cc:740] T 5978d96a07b343bbaed141cac26fe3c9 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21ae6936247494094e53b5674e80e25, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.046048 24196 raft_consensus.cc:2749] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:04.043716 23866 leader_election.cc:304] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc; no voters: 4ac0744564624cecaf9c8806254c3b24, c21ae6936247494094e53b5674e80e25
I20260709 13:08:04.047744 24196 raft_consensus.cc:493] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.046275 24207 consensus_queue.cc:260] T 5978d96a07b343bbaed141cac26fe3c9 P c21ae6936247494094e53b5674e80e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.049281 24225 raft_consensus.cc:2749] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:04.049811 24196 raft_consensus.cc:515] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.056738 23901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a7f98926e246c88b9d0fc7860b4314" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" is_pre_election: true
I20260709 13:08:04.056954 24209 ts_tablet_manager.cc:1434] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.008s
I20260709 13:08:04.058027 23901 raft_consensus.cc:2468] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 0.
I20260709 13:08:04.061167 24209 tablet_bootstrap.cc:492] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24: Bootstrap starting.
I20260709 13:08:04.065006 24208 tablet_bootstrap.cc:654] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.065789 24016 leader_election.cc:304] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, 4ac0744564624cecaf9c8806254c3b24; no voters: 
I20260709 13:08:04.068118 24196 leader_election.cc:290] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653)
I20260709 13:08:04.073454 23978 raft_consensus.cc:2468] T 4a6bf2bb57004015a2864887cf0a5f9d P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 1.
I20260709 13:08:04.075600 23976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a7f98926e246c88b9d0fc7860b4314" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25" is_pre_election: true
I20260709 13:08:04.076998 23976 raft_consensus.cc:2468] T 18a7f98926e246c88b9d0fc7860b4314 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 0.
I20260709 13:08:04.072922 24207 ts_tablet_manager.cc:1434] T 5978d96a07b343bbaed141cac26fe3c9 P c21ae6936247494094e53b5674e80e25: Time spent starting tablet: real 0.048s	user 0.012s	sys 0.004s
I20260709 13:08:04.079996 24196 raft_consensus.cc:493] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.080322 24227 raft_consensus.cc:2804] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:04.080801 24196 raft_consensus.cc:515] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.081149 24227 raft_consensus.cc:493] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.081740 24227 raft_consensus.cc:3060] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.083398 24196 leader_election.cc:290] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653)
I20260709 13:08:04.084741 24207 tablet_bootstrap.cc:492] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25: Bootstrap starting.
I20260709 13:08:04.084959 23976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ecee468eab4a3c9042df77e4201792" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25" is_pre_election: true
I20260709 13:08:04.086042 23976 raft_consensus.cc:2468] T 59ecee468eab4a3c9042df77e4201792 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 0.
I20260709 13:08:04.087626 24226 raft_consensus.cc:493] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.088536 24226 raft_consensus.cc:515] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.092825 23976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ecee468eab4a3c9042df77e4201792" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25" is_pre_election: true
I20260709 13:08:04.094853 23976 raft_consensus.cc:2468] T 59ecee468eab4a3c9042df77e4201792 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 0.
I20260709 13:08:04.093897 24017 leader_election.cc:304] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ac0744564624cecaf9c8806254c3b24, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:04.097091 24226 leader_election.cc:290] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:04.098129 24196 raft_consensus.cc:2804] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:04.098718 24196 raft_consensus.cc:493] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.099103 24196 raft_consensus.cc:3060] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.102233 24209 tablet_bootstrap.cc:654] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.102669 23868 leader_election.cc:304] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:04.103822 23868 leader_election.cc:304] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, c21ae6936247494094e53b5674e80e25; no voters: 4ac0744564624cecaf9c8806254c3b24
I20260709 13:08:04.104848 24102 raft_consensus.cc:2804] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:04.105222 24102 raft_consensus.cc:493] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.105582 24102 raft_consensus.cc:3060] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.108037 24226 raft_consensus.cc:2804] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:04.108777 24226 raft_consensus.cc:697] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Becoming Leader. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Running, Role: LEADER
I20260709 13:08:04.098037 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ecee468eab4a3c9042df77e4201792" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24" is_pre_election: true
I20260709 13:08:04.116063 24207 tablet_bootstrap.cc:654] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.110603 24226 consensus_queue.cc:237] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.123135 24209 tablet_bootstrap.cc:492] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24: No bootstrap required, opened a new log
I20260709 13:08:04.123745 24209 ts_tablet_manager.cc:1403] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.003s
I20260709 13:08:04.124832 24208 tablet_bootstrap.cc:492] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc: No bootstrap required, opened a new log
I20260709 13:08:04.125530 24208 ts_tablet_manager.cc:1403] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent bootstrapping tablet: real 0.100s	user 0.016s	sys 0.010s
I20260709 13:08:04.127213 24209 raft_consensus.cc:359] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.128144 24209 raft_consensus.cc:385] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.121380 24102 raft_consensus.cc:515] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.128530 24209 raft_consensus.cc:740] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.129488 24209 consensus_queue.cc:260] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.130227 24208 raft_consensus.cc:359] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.132647 23976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ecee468eab4a3c9042df77e4201792" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25"
W20260709 13:08:04.129977 24016 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:39291, user_credentials={real_user=slave}} blocked reactor thread for 64426.4us
I20260709 13:08:04.133811 23976 raft_consensus.cc:3060] T 59ecee468eab4a3c9042df77e4201792 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.134181 24209 ts_tablet_manager.cc:1434] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.007s
I20260709 13:08:04.135160 23901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ecee468eab4a3c9042df77e4201792" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" is_pre_election: true
I20260709 13:08:04.135035 24227 raft_consensus.cc:515] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.136294 23901 raft_consensus.cc:2393] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ac0744564624cecaf9c8806254c3b24 in current term 1: Already voted for candidate 1ffb2868f51d400b80d2f376cd1b44dc in this term.
I20260709 13:08:04.140667 23978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a7f98926e246c88b9d0fc7860b4314" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:08:04.141479 23978 raft_consensus.cc:3060] T 18a7f98926e246c88b9d0fc7860b4314 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.141438 24208 raft_consensus.cc:385] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.142622 23901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a7f98926e246c88b9d0fc7860b4314" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:08:04.151754 24208 raft_consensus.cc:740] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.151947 23901 raft_consensus.cc:3060] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.152359 23978 raft_consensus.cc:2468] T 18a7f98926e246c88b9d0fc7860b4314 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 1.
I20260709 13:08:04.152935 24208 consensus_queue.cc:260] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.153822 24017 leader_election.cc:304] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ac0744564624cecaf9c8806254c3b24, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:04.155143 24229 raft_consensus.cc:2804] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:04.155579 23800 catalog_manager.cc:5697] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193). New cstate: current_term: 1 leader_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.144879 24102 leader_election.cc:290] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 election: Requested vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:04.127835 24196 raft_consensus.cc:515] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.146955 24052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ecee468eab4a3c9042df77e4201792" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
I20260709 13:08:04.150547 24207 tablet_bootstrap.cc:492] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25: No bootstrap required, opened a new log
I20260709 13:08:04.161366 24207 ts_tablet_manager.cc:1403] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25: Time spent bootstrapping tablet: real 0.083s	user 0.015s	sys 0.004s
I20260709 13:08:04.163094 24227 leader_election.cc:290] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 election: Requested vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653)
I20260709 13:08:04.164137 24227 raft_consensus.cc:493] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.165122 24051 raft_consensus.cc:2393] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1ffb2868f51d400b80d2f376cd1b44dc in current term 1: Already voted for candidate 4ac0744564624cecaf9c8806254c3b24 in this term.
I20260709 13:08:04.165211 24207 raft_consensus.cc:359] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.166181 24207 raft_consensus.cc:385] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.166513 24207 raft_consensus.cc:740] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21ae6936247494094e53b5674e80e25, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.148465 24209 tablet_bootstrap.cc:492] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24: Bootstrap starting.
I20260709 13:08:04.164913 24227 raft_consensus.cc:515] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.170894 23902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ecee468eab4a3c9042df77e4201792" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:08:04.171810 23902 raft_consensus.cc:2393] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ac0744564624cecaf9c8806254c3b24 in current term 1: Already voted for candidate 1ffb2868f51d400b80d2f376cd1b44dc in this term.
I20260709 13:08:04.171945 23903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5978d96a07b343bbaed141cac26fe3c9" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" is_pre_election: true
I20260709 13:08:04.172911 23903 raft_consensus.cc:2468] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 0.
I20260709 13:08:04.173741 24207 consensus_queue.cc:260] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.174572 24016 leader_election.cc:304] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, 4ac0744564624cecaf9c8806254c3b24; no voters: 
I20260709 13:08:04.174968 23901 raft_consensus.cc:2468] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 1.
I20260709 13:08:04.176553 24207 ts_tablet_manager.cc:1434] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.001s
I20260709 13:08:04.171866 24196 leader_election.cc:290] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 election: Requested vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653)
I20260709 13:08:04.170228 24227 leader_election.cc:290] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653)
I20260709 13:08:04.170037 24208 ts_tablet_manager.cc:1434] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.005s
I20260709 13:08:04.177364 24196 raft_consensus.cc:2804] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:04.195191 24209 tablet_bootstrap.cc:654] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.195067 24196 raft_consensus.cc:493] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.195773 24196 raft_consensus.cc:3060] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.188285 24207 tablet_bootstrap.cc:492] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25: Bootstrap starting.
I20260709 13:08:04.191970 24229 raft_consensus.cc:697] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Becoming Leader. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Running, Role: LEADER
I20260709 13:08:04.176893 23976 raft_consensus.cc:2468] T 59ecee468eab4a3c9042df77e4201792 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 1.
I20260709 13:08:04.208775 24229 consensus_queue.cc:237] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.209317 23868 leader_election.cc:304] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, c21ae6936247494094e53b5674e80e25; no voters: 4ac0744564624cecaf9c8806254c3b24
I20260709 13:08:04.211264 24102 raft_consensus.cc:2804] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:04.211994 24102 raft_consensus.cc:697] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Becoming Leader. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Running, Role: LEADER
I20260709 13:08:04.213246 24102 consensus_queue.cc:237] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.203197 24208 tablet_bootstrap.cc:492] T 390dc3de8e9c483db58dc139361223f3 P 1ffb2868f51d400b80d2f376cd1b44dc: Bootstrap starting.
I20260709 13:08:04.219257 24196 raft_consensus.cc:515] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.220904 23976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5978d96a07b343bbaed141cac26fe3c9" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25" is_pre_election: true
I20260709 13:08:04.221625 23978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59ecee468eab4a3c9042df77e4201792" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:08:04.222707 23978 raft_consensus.cc:2393] T 59ecee468eab4a3c9042df77e4201792 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ac0744564624cecaf9c8806254c3b24 in current term 1: Already voted for candidate 1ffb2868f51d400b80d2f376cd1b44dc in this term.
I20260709 13:08:04.225682 24017 leader_election.cc:304] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ac0744564624cecaf9c8806254c3b24; no voters: 1ffb2868f51d400b80d2f376cd1b44dc, c21ae6936247494094e53b5674e80e25
I20260709 13:08:04.226678 24233 raft_consensus.cc:2749] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:04.221711 23976 raft_consensus.cc:2468] T 5978d96a07b343bbaed141cac26fe3c9 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 0.
I20260709 13:08:04.229800 24207 tablet_bootstrap.cc:654] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.233810 24208 tablet_bootstrap.cc:654] T 390dc3de8e9c483db58dc139361223f3 P 1ffb2868f51d400b80d2f376cd1b44dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.234660 23901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5978d96a07b343bbaed141cac26fe3c9" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:08:04.235426 23901 raft_consensus.cc:3060] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.237603 24209 tablet_bootstrap.cc:492] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24: No bootstrap required, opened a new log
I20260709 13:08:04.238224 24209 ts_tablet_manager.cc:1403] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24: Time spent bootstrapping tablet: real 0.090s	user 0.017s	sys 0.017s
I20260709 13:08:04.241667 24209 raft_consensus.cc:359] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.242491 24209 raft_consensus.cc:385] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.242858 24209 raft_consensus.cc:740] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.243626 24209 consensus_queue.cc:260] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.244136 23901 raft_consensus.cc:2468] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 1.
I20260709 13:08:04.245608 24016 leader_election.cc:304] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, 4ac0744564624cecaf9c8806254c3b24; no voters: 
I20260709 13:08:04.246621 24208 tablet_bootstrap.cc:492] T 390dc3de8e9c483db58dc139361223f3 P 1ffb2868f51d400b80d2f376cd1b44dc: No bootstrap required, opened a new log
I20260709 13:08:04.247473 24196 leader_election.cc:290] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 election: Requested vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653)
I20260709 13:08:04.248708 23976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5978d96a07b343bbaed141cac26fe3c9" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:08:04.250020 23976 raft_consensus.cc:3060] T 5978d96a07b343bbaed141cac26fe3c9 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.247399 24208 ts_tablet_manager.cc:1403] T 390dc3de8e9c483db58dc139361223f3 P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.005s
I20260709 13:08:04.257072 23976 raft_consensus.cc:2468] T 5978d96a07b343bbaed141cac26fe3c9 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 1.
I20260709 13:08:04.257247 24208 raft_consensus.cc:359] T 390dc3de8e9c483db58dc139361223f3 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.259152 24208 raft_consensus.cc:385] T 390dc3de8e9c483db58dc139361223f3 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.259714 24208 raft_consensus.cc:740] T 390dc3de8e9c483db58dc139361223f3 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.260281 24235 raft_consensus.cc:2804] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:04.260615 24209 ts_tablet_manager.cc:1434] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 13:08:04.260902 24235 raft_consensus.cc:697] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Becoming Leader. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Running, Role: LEADER
I20260709 13:08:04.260639 24208 consensus_queue.cc:260] T 390dc3de8e9c483db58dc139361223f3 P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.261374 23800 catalog_manager.cc:5697] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193). New cstate: current_term: 1 leader_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.262284 24235 consensus_queue.cc:237] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.264104 24208 ts_tablet_manager.cc:1434] T 390dc3de8e9c483db58dc139361223f3 P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:08:04.265580 24208 tablet_bootstrap.cc:492] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc: Bootstrap starting.
I20260709 13:08:04.265905 24229 raft_consensus.cc:493] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.266633 24229 raft_consensus.cc:515] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.262312 24209 tablet_bootstrap.cc:492] T b281bbfb7e724d61b35f26f082cf89ef P 4ac0744564624cecaf9c8806254c3b24: Bootstrap starting.
I20260709 13:08:04.271459 23976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390dc3de8e9c483db58dc139361223f3" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25" is_pre_election: true
I20260709 13:08:04.268635 23799 catalog_manager.cc:5697] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "4ac0744564624cecaf9c8806254c3b24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.272900 23901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390dc3de8e9c483db58dc139361223f3" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" is_pre_election: true
W20260709 13:08:04.273046 24017 leader_election.cc:343] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.273614 23901 raft_consensus.cc:2468] T 390dc3de8e9c483db58dc139361223f3 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 0.
I20260709 13:08:04.275904 24208 tablet_bootstrap.cc:654] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.278381 24016 leader_election.cc:304] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, 4ac0744564624cecaf9c8806254c3b24; no voters: c21ae6936247494094e53b5674e80e25
I20260709 13:08:04.279816 24196 raft_consensus.cc:2804] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:04.280251 24196 raft_consensus.cc:493] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.280609 24196 raft_consensus.cc:3060] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.282342 24207 tablet_bootstrap.cc:492] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25: No bootstrap required, opened a new log
I20260709 13:08:04.283089 24207 ts_tablet_manager.cc:1403] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25: Time spent bootstrapping tablet: real 0.095s	user 0.017s	sys 0.008s
I20260709 13:08:04.288266 24209 tablet_bootstrap.cc:654] T b281bbfb7e724d61b35f26f082cf89ef P 4ac0744564624cecaf9c8806254c3b24: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.289726 24229 leader_election.cc:290] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653)
I20260709 13:08:04.291293 24208 tablet_bootstrap.cc:492] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc: No bootstrap required, opened a new log
I20260709 13:08:04.291904 24208 ts_tablet_manager.cc:1403] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.009s
I20260709 13:08:04.292810 24207 raft_consensus.cc:359] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.293661 24207 raft_consensus.cc:385] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.293977 24207 raft_consensus.cc:740] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21ae6936247494094e53b5674e80e25, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.294842 24207 consensus_queue.cc:260] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.295866 24208 raft_consensus.cc:359] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.296715 24208 raft_consensus.cc:385] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.297272 24208 raft_consensus.cc:740] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.297412 24207 ts_tablet_manager.cc:1434] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.001s
I20260709 13:08:04.300014 24207 tablet_bootstrap.cc:492] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25: Bootstrap starting.
I20260709 13:08:04.302042 24209 tablet_bootstrap.cc:492] T b281bbfb7e724d61b35f26f082cf89ef P 4ac0744564624cecaf9c8806254c3b24: No bootstrap required, opened a new log
I20260709 13:08:04.298291 24208 consensus_queue.cc:260] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.302636 24209 ts_tablet_manager.cc:1403] T b281bbfb7e724d61b35f26f082cf89ef P 4ac0744564624cecaf9c8806254c3b24: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.004s
I20260709 13:08:04.306077 24209 raft_consensus.cc:359] T b281bbfb7e724d61b35f26f082cf89ef P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.312073 24209 raft_consensus.cc:385] T b281bbfb7e724d61b35f26f082cf89ef P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.312458 24209 raft_consensus.cc:740] T b281bbfb7e724d61b35f26f082cf89ef P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.313544 24209 consensus_queue.cc:260] T b281bbfb7e724d61b35f26f082cf89ef P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.315836 24209 ts_tablet_manager.cc:1434] T b281bbfb7e724d61b35f26f082cf89ef P 4ac0744564624cecaf9c8806254c3b24: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:08:04.308959 24208 ts_tablet_manager.cc:1434] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 13:08:04.317193 24209 tablet_bootstrap.cc:492] T aa09d546b66644e8adab35389c543f3e P 4ac0744564624cecaf9c8806254c3b24: Bootstrap starting.
I20260709 13:08:04.318222 24208 tablet_bootstrap.cc:492] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc: Bootstrap starting.
I20260709 13:08:04.309777 24196 raft_consensus.cc:515] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.311672 24207 tablet_bootstrap.cc:654] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.324434 24102 raft_consensus.cc:493] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.324949 24102 raft_consensus.cc:515] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.327987 23901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390dc3de8e9c483db58dc139361223f3" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:08:04.328771 23901 raft_consensus.cc:3060] T 390dc3de8e9c483db58dc139361223f3 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.329321 23976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390dc3de8e9c483db58dc139361223f3" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:08:04.330207 24209 tablet_bootstrap.cc:654] T aa09d546b66644e8adab35389c543f3e P 4ac0744564624cecaf9c8806254c3b24: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:04.331725 24017 leader_election.cc:343] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.332707 24196 leader_election.cc:290] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 election: Requested vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653)
I20260709 13:08:04.334483 23976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f364f61ea14310914861a311638607" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25" is_pre_election: true
W20260709 13:08:04.336316 23868 leader_election.cc:343] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.338693 24208 tablet_bootstrap.cc:654] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.338807 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f364f61ea14310914861a311638607" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24" is_pre_election: true
I20260709 13:08:04.339555 24051 raft_consensus.cc:2468] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 0.
I20260709 13:08:04.340204 24102 leader_election.cc:290] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:04.341102 23866 leader_election.cc:304] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, 4ac0744564624cecaf9c8806254c3b24; no voters: c21ae6936247494094e53b5674e80e25
I20260709 13:08:04.342483 24102 raft_consensus.cc:2804] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:04.342983 24102 raft_consensus.cc:493] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.343382 24102 raft_consensus.cc:3060] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.345407 24209 tablet_bootstrap.cc:492] T aa09d546b66644e8adab35389c543f3e P 4ac0744564624cecaf9c8806254c3b24: No bootstrap required, opened a new log
I20260709 13:08:04.347535 24207 tablet_bootstrap.cc:492] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25: No bootstrap required, opened a new log
I20260709 13:08:04.348335 24207 ts_tablet_manager.cc:1403] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25: Time spent bootstrapping tablet: real 0.049s	user 0.006s	sys 0.014s
I20260709 13:08:04.350551 23901 raft_consensus.cc:2468] T 390dc3de8e9c483db58dc139361223f3 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 1.
I20260709 13:08:04.351516 24207 raft_consensus.cc:359] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.351898 24016 leader_election.cc:304] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, 4ac0744564624cecaf9c8806254c3b24; no voters: c21ae6936247494094e53b5674e80e25
I20260709 13:08:04.352520 24209 ts_tablet_manager.cc:1403] T aa09d546b66644e8adab35389c543f3e P 4ac0744564624cecaf9c8806254c3b24: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.006s
I20260709 13:08:04.353364 24196 raft_consensus.cc:2804] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:04.354063 24196 raft_consensus.cc:697] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Becoming Leader. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Running, Role: LEADER
I20260709 13:08:04.354566 24207 raft_consensus.cc:385] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.357581 24207 raft_consensus.cc:740] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21ae6936247494094e53b5674e80e25, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.357214 24209 raft_consensus.cc:359] T aa09d546b66644e8adab35389c543f3e P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.358179 24209 raft_consensus.cc:385] T aa09d546b66644e8adab35389c543f3e P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.358552 24209 raft_consensus.cc:740] T aa09d546b66644e8adab35389c543f3e P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.358505 24207 consensus_queue.cc:260] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.359659 24209 consensus_queue.cc:260] T aa09d546b66644e8adab35389c543f3e P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.355149 24196 consensus_queue.cc:237] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.362170 24209 ts_tablet_manager.cc:1434] T aa09d546b66644e8adab35389c543f3e P 4ac0744564624cecaf9c8806254c3b24: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:08:04.364216 24207 ts_tablet_manager.cc:1434] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:08:04.365442 24207 tablet_bootstrap.cc:492] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25: Bootstrap starting.
I20260709 13:08:04.367373 24102 raft_consensus.cc:515] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.373054 23798 catalog_manager.cc:5697] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "4ac0744564624cecaf9c8806254c3b24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.376581 24207 tablet_bootstrap.cc:654] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.384130 24207 tablet_bootstrap.cc:492] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25: No bootstrap required, opened a new log
I20260709 13:08:04.384392 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f364f61ea14310914861a311638607" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
I20260709 13:08:04.384836 24207 ts_tablet_manager.cc:1403] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.001s
I20260709 13:08:04.385197 24051 raft_consensus.cc:3060] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.387490 24102 leader_election.cc:290] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 election: Requested vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:04.388376 24207 raft_consensus.cc:359] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.389149 24207 raft_consensus.cc:385] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.389468 24207 raft_consensus.cc:740] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21ae6936247494094e53b5674e80e25, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.389529 24208 tablet_bootstrap.cc:492] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc: No bootstrap required, opened a new log
I20260709 13:08:04.391173 24208 ts_tablet_manager.cc:1403] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent bootstrapping tablet: real 0.073s	user 0.017s	sys 0.014s
I20260709 13:08:04.392021 23976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f364f61ea14310914861a311638607" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:08:04.390302 24207 consensus_queue.cc:260] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
W20260709 13:08:04.393586 23868 leader_election.cc:343] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:04.393504 24208 raft_consensus.cc:359] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.394519 24208 raft_consensus.cc:385] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.394814 24208 raft_consensus.cc:740] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.393289 24051 raft_consensus.cc:2468] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 1.
I20260709 13:08:04.395524 24208 consensus_queue.cc:260] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.398180 24208 ts_tablet_manager.cc:1434] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:04.395524 24207 ts_tablet_manager.cc:1434] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:08:04.397854 23798 catalog_manager.cc:5697] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "4ac0744564624cecaf9c8806254c3b24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:04.399792 24207 tablet_bootstrap.cc:492] T d9f364f61ea14310914861a311638607 P c21ae6936247494094e53b5674e80e25: Bootstrap starting.
I20260709 13:08:04.406713 24208 tablet_bootstrap.cc:492] T aa09d546b66644e8adab35389c543f3e P 1ffb2868f51d400b80d2f376cd1b44dc: Bootstrap starting.
I20260709 13:08:04.407101 24207 tablet_bootstrap.cc:654] T d9f364f61ea14310914861a311638607 P c21ae6936247494094e53b5674e80e25: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.407176 23866 leader_election.cc:304] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, 4ac0744564624cecaf9c8806254c3b24; no voters: c21ae6936247494094e53b5674e80e25
I20260709 13:08:04.408697 24226 raft_consensus.cc:2804] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:04.409202 24226 raft_consensus.cc:697] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Becoming Leader. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Running, Role: LEADER
I20260709 13:08:04.410063 24226 consensus_queue.cc:237] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.413800 24208 tablet_bootstrap.cc:654] T aa09d546b66644e8adab35389c543f3e P 1ffb2868f51d400b80d2f376cd1b44dc: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:04.426358 24207 tablet_bootstrap.cc:492] T d9f364f61ea14310914861a311638607 P c21ae6936247494094e53b5674e80e25: No bootstrap required, opened a new log
I20260709 13:08:04.426954 24207 ts_tablet_manager.cc:1403] T d9f364f61ea14310914861a311638607 P c21ae6936247494094e53b5674e80e25: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.012s
I20260709 13:08:04.430012 24207 raft_consensus.cc:359] T d9f364f61ea14310914861a311638607 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.430861 24207 raft_consensus.cc:385] T d9f364f61ea14310914861a311638607 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.431236 24207 raft_consensus.cc:740] T d9f364f61ea14310914861a311638607 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c21ae6936247494094e53b5674e80e25, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.432075 24208 tablet_bootstrap.cc:492] T aa09d546b66644e8adab35389c543f3e P 1ffb2868f51d400b80d2f376cd1b44dc: No bootstrap required, opened a new log
I20260709 13:08:04.431979 24207 consensus_queue.cc:260] T d9f364f61ea14310914861a311638607 P c21ae6936247494094e53b5674e80e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.432935 24208 ts_tablet_manager.cc:1403] T aa09d546b66644e8adab35389c543f3e P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.012s
I20260709 13:08:04.433931 24207 ts_tablet_manager.cc:1434] T d9f364f61ea14310914861a311638607 P c21ae6936247494094e53b5674e80e25: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:04.434749 23798 catalog_manager.cc:5697] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193). New cstate: current_term: 1 leader_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.435961 24208 raft_consensus.cc:359] T aa09d546b66644e8adab35389c543f3e P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.436697 24208 raft_consensus.cc:385] T aa09d546b66644e8adab35389c543f3e P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:04.436951 24208 raft_consensus.cc:740] T aa09d546b66644e8adab35389c543f3e P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Initialized, Role: FOLLOWER
I20260709 13:08:04.437727 24208 consensus_queue.cc:260] T aa09d546b66644e8adab35389c543f3e P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.439847 24208 ts_tablet_manager.cc:1434] T aa09d546b66644e8adab35389c543f3e P 1ffb2868f51d400b80d2f376cd1b44dc: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:08:04.441418 24226 raft_consensus.cc:493] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.441969 24226 raft_consensus.cc:515] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.444891 23976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b281bbfb7e724d61b35f26f082cf89ef" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25" is_pre_election: true
I20260709 13:08:04.445639 23976 raft_consensus.cc:2468] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 0.
I20260709 13:08:04.445838 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b281bbfb7e724d61b35f26f082cf89ef" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24" is_pre_election: true
I20260709 13:08:04.446702 24051 raft_consensus.cc:2468] T b281bbfb7e724d61b35f26f082cf89ef P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 0.
I20260709 13:08:04.447610 23868 leader_election.cc:304] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:04.448487 24102 raft_consensus.cc:2804] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:04.448796 24102 raft_consensus.cc:493] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.449047 24102 raft_consensus.cc:3060] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.450548 24226 leader_election.cc:290] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:04.456851 24102 raft_consensus.cc:515] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.458644 24102 leader_election.cc:290] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 election: Requested vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:04.459589 23976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b281bbfb7e724d61b35f26f082cf89ef" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:08:04.459617 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b281bbfb7e724d61b35f26f082cf89ef" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
I20260709 13:08:04.460186 23976 raft_consensus.cc:3060] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.460278 24051 raft_consensus.cc:3060] T b281bbfb7e724d61b35f26f082cf89ef P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.464847 24051 raft_consensus.cc:2468] T b281bbfb7e724d61b35f26f082cf89ef P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 1.
I20260709 13:08:04.465615 23976 raft_consensus.cc:2468] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 1.
I20260709 13:08:04.465795 23866 leader_election.cc:304] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, 4ac0744564624cecaf9c8806254c3b24; no voters: 
I20260709 13:08:04.466737 24102 raft_consensus.cc:2804] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:04.467298 24102 raft_consensus.cc:697] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Becoming Leader. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Running, Role: LEADER
I20260709 13:08:04.467849 24102 consensus_queue.cc:237] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.475369 23799 catalog_manager.cc:5697] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193). New cstate: current_term: 1 leader_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.561244 24102 consensus_queue.cc:1048] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:04.572314 24102 consensus_queue.cc:1048] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:04.597538 24099 raft_consensus.cc:493] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.598065 24099 raft_consensus.cc:515] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.599933 24099 leader_election.cc:290] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:04.600735 23901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ba6038bc094d98859b0b6ade6c83d1" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" is_pre_election: true
I20260709 13:08:04.601120 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ba6038bc094d98859b0b6ade6c83d1" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24" is_pre_election: true
I20260709 13:08:04.601600 23901 raft_consensus.cc:2468] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 0.
I20260709 13:08:04.601704 24051 raft_consensus.cc:2468] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 0.
I20260709 13:08:04.602792 23942 leader_election.cc:304] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:04.603597 24099 raft_consensus.cc:2804] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:04.603886 24099 raft_consensus.cc:493] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.604161 24099 raft_consensus.cc:3060] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.610062 24099 raft_consensus.cc:515] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.611639 24099 leader_election.cc:290] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 election: Requested vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:04.612460 23901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ba6038bc094d98859b0b6ade6c83d1" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:08:04.612653 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ba6038bc094d98859b0b6ade6c83d1" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
I20260709 13:08:04.613004 23901 raft_consensus.cc:3060] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.613338 24051 raft_consensus.cc:3060] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.618994 24051 raft_consensus.cc:2468] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 1.
I20260709 13:08:04.619736 23901 raft_consensus.cc:2468] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 1.
I20260709 13:08:04.620055 23941 leader_election.cc:304] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ac0744564624cecaf9c8806254c3b24, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:04.620877 24099 raft_consensus.cc:2804] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:04.622279 24099 raft_consensus.cc:697] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [term 1 LEADER]: Becoming Leader. State: Replica: c21ae6936247494094e53b5674e80e25, State: Running, Role: LEADER
I20260709 13:08:04.623227 24099 consensus_queue.cc:237] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.631693 23798 catalog_manager.cc:5697] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to c21ae6936247494094e53b5674e80e25 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "c21ae6936247494094e53b5674e80e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.639081 24196 consensus_queue.cc:1048] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:04.649151 24229 consensus_queue.cc:1048] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:04.651320 24196 consensus_queue.cc:1048] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:04.654925 24229 consensus_queue.cc:1048] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:04.672626 24102 consensus_queue.cc:1048] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:04.685911 24099 raft_consensus.cc:493] T d9f364f61ea14310914861a311638607 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.686523 24099 raft_consensus.cc:515] T d9f364f61ea14310914861a311638607 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.688673 24099 leader_election.cc:290] T d9f364f61ea14310914861a311638607 P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:04.689373 23903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f364f61ea14310914861a311638607" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" is_pre_election: true
I20260709 13:08:04.689970 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f364f61ea14310914861a311638607" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24" is_pre_election: true
I20260709 13:08:04.691776 24051 raft_consensus.cc:2393] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c21ae6936247494094e53b5674e80e25 in current term 1: Already voted for candidate 1ffb2868f51d400b80d2f376cd1b44dc in this term.
I20260709 13:08:04.692469 24225 consensus_queue.cc:1048] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:04.692792 23941 leader_election.cc:304] T d9f364f61ea14310914861a311638607 P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c21ae6936247494094e53b5674e80e25; no voters: 1ffb2868f51d400b80d2f376cd1b44dc, 4ac0744564624cecaf9c8806254c3b24
I20260709 13:08:04.694123 24099 raft_consensus.cc:3060] T d9f364f61ea14310914861a311638607 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.702316 24099 raft_consensus.cc:2749] T d9f364f61ea14310914861a311638607 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:04.726110 24099 raft_consensus.cc:493] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.726608 24099 raft_consensus.cc:515] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.728401 24099 leader_election.cc:290] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:04.729708 23903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa09d546b66644e8adab35389c543f3e" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" is_pre_election: true
I20260709 13:08:04.729684 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa09d546b66644e8adab35389c543f3e" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24" is_pre_election: true
I20260709 13:08:04.730690 24051 raft_consensus.cc:2468] T aa09d546b66644e8adab35389c543f3e P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 0.
I20260709 13:08:04.730700 23903 raft_consensus.cc:2468] T aa09d546b66644e8adab35389c543f3e P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 0.
I20260709 13:08:04.732015 23942 leader_election.cc:304] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:04.732838 24099 raft_consensus.cc:2804] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:04.733198 24099 raft_consensus.cc:493] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.733474 24099 raft_consensus.cc:3060] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.739653 24099 raft_consensus.cc:515] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.741914 24099 leader_election.cc:290] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 election: Requested vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:04.742811 23903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa09d546b66644e8adab35389c543f3e" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:08:04.742955 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa09d546b66644e8adab35389c543f3e" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
I20260709 13:08:04.743712 23903 raft_consensus.cc:3060] T aa09d546b66644e8adab35389c543f3e P 1ffb2868f51d400b80d2f376cd1b44dc [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.743799 24051 raft_consensus.cc:3060] T aa09d546b66644e8adab35389c543f3e P 4ac0744564624cecaf9c8806254c3b24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.753983 24051 raft_consensus.cc:2468] T aa09d546b66644e8adab35389c543f3e P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 1.
W20260709 13:08:04.754923 23849 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:04.755308 23941 leader_election.cc:304] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ac0744564624cecaf9c8806254c3b24, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:04.756276 24099 raft_consensus.cc:2804] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:04.756855 24099 raft_consensus.cc:697] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25 [term 1 LEADER]: Becoming Leader. State: Replica: c21ae6936247494094e53b5674e80e25, State: Running, Role: LEADER
I20260709 13:08:04.756961 23903 raft_consensus.cc:2468] T aa09d546b66644e8adab35389c543f3e P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 1.
I20260709 13:08:04.757746 24099 consensus_queue.cc:237] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.765101 23798 catalog_manager.cc:5697] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25 reported cstate change: term changed from 0 to 1, leader changed from <none> to c21ae6936247494094e53b5674e80e25 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "c21ae6936247494094e53b5674e80e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.774324 24099 raft_consensus.cc:493] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.774848 24099 raft_consensus.cc:515] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:04.776356 24099 leader_election.cc:290] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:04.777112 23901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390dc3de8e9c483db58dc139361223f3" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" is_pre_election: true
I20260709 13:08:04.777256 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390dc3de8e9c483db58dc139361223f3" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ac0744564624cecaf9c8806254c3b24" is_pre_election: true
I20260709 13:08:04.777907 23901 raft_consensus.cc:2393] T 390dc3de8e9c483db58dc139361223f3 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c21ae6936247494094e53b5674e80e25 in current term 1: Already voted for candidate 4ac0744564624cecaf9c8806254c3b24 in this term.
I20260709 13:08:04.778890 23942 leader_election.cc:304] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c21ae6936247494094e53b5674e80e25; no voters: 1ffb2868f51d400b80d2f376cd1b44dc, 4ac0744564624cecaf9c8806254c3b24
I20260709 13:08:04.779644 24099 raft_consensus.cc:3060] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:04.785475 24099 raft_consensus.cc:2749] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:04.791913 24196 consensus_queue.cc:1048] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:04.803229 24233 consensus_queue.cc:1048] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:04.838001 24225 consensus_queue.cc:1048] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:04.848609 24225 consensus_queue.cc:1048] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:04.885985 24225 consensus_queue.cc:1048] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:04.900329 24226 consensus_queue.cc:1048] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:05.027357 24051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18a7f98926e246c88b9d0fc7860b4314"
dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
mode: GRACEFUL
new_leader_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
 from {username='slave'} at 127.0.0.1:36076
I20260709 13:08:05.027976 24051 raft_consensus.cc:606] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Received request to transfer leadership to TS 1ffb2868f51d400b80d2f376cd1b44dc
I20260709 13:08:05.037093 24051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5978d96a07b343bbaed141cac26fe3c9"
dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
mode: GRACEFUL
new_leader_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
 from {username='slave'} at 127.0.0.1:36076
I20260709 13:08:05.037635 24051 raft_consensus.cc:606] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Received request to transfer leadership to TS 1ffb2868f51d400b80d2f376cd1b44dc
I20260709 13:08:05.043298 24051 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "390dc3de8e9c483db58dc139361223f3"
dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
mode: GRACEFUL
new_leader_uuid: "c21ae6936247494094e53b5674e80e25"
 from {username='slave'} at 127.0.0.1:36076
I20260709 13:08:05.043836 24051 raft_consensus.cc:606] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Received request to transfer leadership to TS c21ae6936247494094e53b5674e80e25
I20260709 13:08:05.050622 24099 consensus_queue.cc:1048] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:05.053072 23901 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b281bbfb7e724d61b35f26f082cf89ef"
dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
mode: GRACEFUL
new_leader_uuid: "c21ae6936247494094e53b5674e80e25"
 from {username='slave'} at 127.0.0.1:41500
I20260709 13:08:05.053666 23901 raft_consensus.cc:606] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Received request to transfer leadership to TS c21ae6936247494094e53b5674e80e25
I20260709 13:08:05.064486 23903 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9f364f61ea14310914861a311638607"
dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
mode: GRACEFUL
new_leader_uuid: "4ac0744564624cecaf9c8806254c3b24"
 from {username='slave'} at 127.0.0.1:41500
I20260709 13:08:05.065085 23903 raft_consensus.cc:606] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Received request to transfer leadership to TS 4ac0744564624cecaf9c8806254c3b24
I20260709 13:08:05.067118 24260 consensus_queue.cc:1048] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:05.219107 24196 raft_consensus.cc:993] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24: : Instructing follower 1ffb2868f51d400b80d2f376cd1b44dc to start an election
I20260709 13:08:05.219203 24099 consensus_queue.cc:1048] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:05.219632 24233 raft_consensus.cc:1081] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Signalling peer 1ffb2868f51d400b80d2f376cd1b44dc to start an election
I20260709 13:08:05.221215 23901 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5978d96a07b343bbaed141cac26fe3c9"
dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
 from {username='slave'} at 127.0.0.1:41474
I20260709 13:08:05.221845 23901 raft_consensus.cc:493] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:05.222138 23901 raft_consensus.cc:3060] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:05.230365 24260 consensus_queue.cc:1048] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:05.232195 23901 raft_consensus.cc:515] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:05.235047 23976 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5978d96a07b343bbaed141cac26fe3c9" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:08:05.235637 23976 raft_consensus.cc:3060] T 5978d96a07b343bbaed141cac26fe3c9 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:05.251873 24229 raft_consensus.cc:993] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24: : Instructing follower c21ae6936247494094e53b5674e80e25 to start an election
I20260709 13:08:05.251806 23976 raft_consensus.cc:2468] T 5978d96a07b343bbaed141cac26fe3c9 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 2.
I20260709 13:08:05.252555 24229 raft_consensus.cc:1081] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Signalling peer c21ae6936247494094e53b5674e80e25 to start an election
I20260709 13:08:05.253103 23901 leader_election.cc:290] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 2 election: Requested vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:05.253328 23868 leader_election.cc:304] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:05.254295 24225 raft_consensus.cc:2804] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:05.254464 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5978d96a07b343bbaed141cac26fe3c9" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
I20260709 13:08:05.254803 24225 raft_consensus.cc:697] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 LEADER]: Becoming Leader. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Running, Role: LEADER
I20260709 13:08:05.255012 23978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "390dc3de8e9c483db58dc139361223f3"
dest_uuid: "c21ae6936247494094e53b5674e80e25"
 from {username='slave'} at 127.0.0.1:43234
I20260709 13:08:05.255645 23978 raft_consensus.cc:493] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:05.255084 24051 raft_consensus.cc:3055] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:05.256116 23978 raft_consensus.cc:3060] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:05.255673 24225 consensus_queue.cc:237] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:05.256348 24051 raft_consensus.cc:740] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Running, Role: LEADER
I20260709 13:08:05.258198 24051 consensus_queue.cc:260] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:05.261207 24051 raft_consensus.cc:3060] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:05.262701 23978 raft_consensus.cc:515] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:05.263938 23799 catalog_manager.cc:5697] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc reported cstate change: term changed from 1 to 2, leader changed from 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195) to 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193). New cstate: current_term: 2 leader_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:05.266183 23901 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390dc3de8e9c483db58dc139361223f3" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:08:05.266870 23901 raft_consensus.cc:3060] T 390dc3de8e9c483db58dc139361223f3 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:05.267750 24051 raft_consensus.cc:2468] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 2.
I20260709 13:08:05.270002 23978 leader_election.cc:290] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 2 election: Requested vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:05.271878 24229 raft_consensus.cc:993] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24: : Instructing follower 1ffb2868f51d400b80d2f376cd1b44dc to start an election
I20260709 13:08:05.272151 24051 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390dc3de8e9c483db58dc139361223f3" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
I20260709 13:08:05.272378 24229 raft_consensus.cc:1081] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Signalling peer 1ffb2868f51d400b80d2f376cd1b44dc to start an election
I20260709 13:08:05.272758 24051 raft_consensus.cc:3055] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:05.273113 24051 raft_consensus.cc:740] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Running, Role: LEADER
I20260709 13:08:05.274525 23903 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18a7f98926e246c88b9d0fc7860b4314"
dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
 from {username='slave'} at 127.0.0.1:41474
I20260709 13:08:05.275156 23903 raft_consensus.cc:493] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:05.275529 23903 raft_consensus.cc:3060] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:05.276211 23901 raft_consensus.cc:2468] T 390dc3de8e9c483db58dc139361223f3 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 2.
I20260709 13:08:05.273896 24051 consensus_queue.cc:260] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:05.277662 23942 leader_election.cc:304] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:05.278228 24051 raft_consensus.cc:3060] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:05.278561 24260 raft_consensus.cc:2804] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:05.279063 24260 raft_consensus.cc:697] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 [term 2 LEADER]: Becoming Leader. State: Replica: c21ae6936247494094e53b5674e80e25, State: Running, Role: LEADER
I20260709 13:08:05.279943 24260 consensus_queue.cc:237] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:05.283761 23903 raft_consensus.cc:515] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:05.286823 23978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a7f98926e246c88b9d0fc7860b4314" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:08:05.287021 24051 raft_consensus.cc:2468] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 2.
I20260709 13:08:05.287778 24052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a7f98926e246c88b9d0fc7860b4314" candidate_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
I20260709 13:08:05.287560 23903 leader_election.cc:290] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 2 election: Requested vote from peers c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:05.288748 24052 raft_consensus.cc:3055] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:05.289124 24052 raft_consensus.cc:740] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Running, Role: LEADER
I20260709 13:08:05.289374 23978 raft_consensus.cc:3060] T 18a7f98926e246c88b9d0fc7860b4314 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:05.289975 24052 consensus_queue.cc:260] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:05.291069 24052 raft_consensus.cc:3060] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:05.290743 23799 catalog_manager.cc:5697] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 reported cstate change: term changed from 1 to 2, leader changed from 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195) to c21ae6936247494094e53b5674e80e25 (127.11.44.194). New cstate: current_term: 2 leader_uuid: "c21ae6936247494094e53b5674e80e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:05.298439 24225 raft_consensus.cc:993] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc: : Instructing follower 4ac0744564624cecaf9c8806254c3b24 to start an election
I20260709 13:08:05.299014 24225 raft_consensus.cc:1081] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Signalling peer 4ac0744564624cecaf9c8806254c3b24 to start an election
I20260709 13:08:05.301764 24049 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9f364f61ea14310914861a311638607"
dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
 from {username='slave'} at 127.0.0.1:36056
I20260709 13:08:05.302403 24049 raft_consensus.cc:493] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:05.302773 24049 raft_consensus.cc:3060] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:05.303355 23978 raft_consensus.cc:2468] T 18a7f98926e246c88b9d0fc7860b4314 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 2.
I20260709 13:08:05.304804 23868 leader_election.cc:304] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:05.306134 24226 raft_consensus.cc:2804] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:05.306612 24226 raft_consensus.cc:697] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 LEADER]: Becoming Leader. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Running, Role: LEADER
I20260709 13:08:05.307487 24226 consensus_queue.cc:237] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:05.311475 24049 raft_consensus.cc:515] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:05.313903 24049 leader_election.cc:290] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 2 election: Requested vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653)
I20260709 13:08:05.315217 23978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f364f61ea14310914861a311638607" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:08:05.315848 23978 raft_consensus.cc:3060] T d9f364f61ea14310914861a311638607 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:05.316784 24052 raft_consensus.cc:2468] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ffb2868f51d400b80d2f376cd1b44dc in term 2.
I20260709 13:08:05.320082 23903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9f364f61ea14310914861a311638607" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:08:05.320751 23903 raft_consensus.cc:3055] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:05.321043 23903 raft_consensus.cc:740] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Running, Role: LEADER
I20260709 13:08:05.321959 23978 raft_consensus.cc:2468] T d9f364f61ea14310914861a311638607 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 2.
I20260709 13:08:05.321875 23903 consensus_queue.cc:260] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:05.323155 24017 leader_election.cc:304] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ac0744564624cecaf9c8806254c3b24, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:05.323335 23903 raft_consensus.cc:3060] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:05.323993 24196 raft_consensus.cc:2804] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:05.324507 24196 raft_consensus.cc:697] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24 [term 2 LEADER]: Becoming Leader. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Running, Role: LEADER
I20260709 13:08:05.325323 24196 consensus_queue.cc:237] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:05.327112 23799 catalog_manager.cc:5697] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc reported cstate change: term changed from 1 to 2, leader changed from 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195) to 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193). New cstate: current_term: 2 leader_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:05.333648 23903 raft_consensus.cc:2468] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 2.
I20260709 13:08:05.333043 23798 catalog_manager.cc:5697] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24 reported cstate change: term changed from 1 to 2, leader changed from 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193) to 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195). New cstate: current_term: 2 leader_uuid: "4ac0744564624cecaf9c8806254c3b24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:05.486640 24225 raft_consensus.cc:993] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc: : Instructing follower c21ae6936247494094e53b5674e80e25 to start an election
I20260709 13:08:05.487226 24283 raft_consensus.cc:1081] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Signalling peer c21ae6936247494094e53b5674e80e25 to start an election
I20260709 13:08:05.488888 23978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b281bbfb7e724d61b35f26f082cf89ef"
dest_uuid: "c21ae6936247494094e53b5674e80e25"
 from {username='slave'} at 127.0.0.1:43248
I20260709 13:08:05.489456 23978 raft_consensus.cc:493] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:05.489850 23978 raft_consensus.cc:3060] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:05.494855 23978 raft_consensus.cc:515] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:05.496230 23978 leader_election.cc:290] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 2 election: Requested vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195:36999)
I20260709 13:08:05.497251 23903 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b281bbfb7e724d61b35f26f082cf89ef" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:08:05.497409 24052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b281bbfb7e724d61b35f26f082cf89ef" candidate_uuid: "c21ae6936247494094e53b5674e80e25" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
I20260709 13:08:05.497915 23903 raft_consensus.cc:3055] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:05.498157 24052 raft_consensus.cc:3060] T b281bbfb7e724d61b35f26f082cf89ef P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:05.498332 23903 raft_consensus.cc:740] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Running, Role: LEADER
I20260709 13:08:05.499147 23903 consensus_queue.cc:260] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:05.500180 23903 raft_consensus.cc:3060] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:05.505877 24052 raft_consensus.cc:2468] T b281bbfb7e724d61b35f26f082cf89ef P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 2.
I20260709 13:08:05.506955 23903 raft_consensus.cc:2468] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c21ae6936247494094e53b5674e80e25 in term 2.
I20260709 13:08:05.507227 23941 leader_election.cc:304] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ac0744564624cecaf9c8806254c3b24, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:05.508235 24260 raft_consensus.cc:2804] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:05.508651 24260 raft_consensus.cc:697] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25 [term 2 LEADER]: Becoming Leader. State: Replica: c21ae6936247494094e53b5674e80e25, State: Running, Role: LEADER
I20260709 13:08:05.509294 24260 consensus_queue.cc:237] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:05.515604 23798 catalog_manager.cc:5697] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25 reported cstate change: term changed from 1 to 2, leader changed from 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193) to c21ae6936247494094e53b5674e80e25 (127.11.44.194). New cstate: current_term: 2 leader_uuid: "c21ae6936247494094e53b5674e80e25" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:05.683382 24049 raft_consensus.cc:1275] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Refusing update from remote peer c21ae6936247494094e53b5674e80e25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:05.684805 24260 consensus_queue.cc:1048] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:05.692812 23903 raft_consensus.cc:1275] T 390dc3de8e9c483db58dc139361223f3 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Refusing update from remote peer c21ae6936247494094e53b5674e80e25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:05.694633 24277 consensus_queue.cc:1048] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:05.723824 24049 raft_consensus.cc:1275] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Refusing update from remote peer 1ffb2868f51d400b80d2f376cd1b44dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:05.725230 24283 consensus_queue.cc:1048] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:05.735123 23978 raft_consensus.cc:1275] T 18a7f98926e246c88b9d0fc7860b4314 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Refusing update from remote peer 1ffb2868f51d400b80d2f376cd1b44dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:05.736829 24226 consensus_queue.cc:1048] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:05.775318 24052 raft_consensus.cc:1275] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Refusing update from remote peer 1ffb2868f51d400b80d2f376cd1b44dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:05.776822 24226 consensus_queue.cc:1048] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:05.787659 23978 raft_consensus.cc:1275] T 5978d96a07b343bbaed141cac26fe3c9 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Refusing update from remote peer 1ffb2868f51d400b80d2f376cd1b44dc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:05.789212 24102 consensus_queue.cc:1048] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:05.851644 23903 raft_consensus.cc:1275] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Refusing update from remote peer 4ac0744564624cecaf9c8806254c3b24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:05.852985 24196 consensus_queue.cc:1048] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:05.864404 23978 raft_consensus.cc:1275] T d9f364f61ea14310914861a311638607 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Refusing update from remote peer 4ac0744564624cecaf9c8806254c3b24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:05.866222 24196 consensus_queue.cc:1048] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:05.926301 23903 raft_consensus.cc:1275] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Refusing update from remote peer c21ae6936247494094e53b5674e80e25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:05.927763 24277 consensus_queue.cc:1048] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:05.937436 24052 raft_consensus.cc:1275] T b281bbfb7e724d61b35f26f082cf89ef P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Refusing update from remote peer c21ae6936247494094e53b5674e80e25: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:05.940259 24293 consensus_queue.cc:1048] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:08.068924 23798 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53484:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:08:08.090328 23798 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:53484:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:08:08.131821 11443 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:08:08.309424 24323 log.cc:927] Time spent T 5978d96a07b343bbaed141cac26fe3c9 P c21ae6936247494094e53b5674e80e25: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
W20260709 13:08:08.323342 24325 log.cc:927] Time spent T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24: Append to log took a long time: real 0.081s	user 0.002s	sys 0.000s
W20260709 13:08:08.353026 24331 log.cc:927] Time spent T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24: Append to log took a long time: real 0.066s	user 0.002s	sys 0.000s
W20260709 13:08:08.354517 24333 log.cc:927] Time spent T 18a7f98926e246c88b9d0fc7860b4314 P c21ae6936247494094e53b5674e80e25: Append to log took a long time: real 0.058s	user 0.002s	sys 0.000s
I20260709 13:08:08.414017 24350 tablet.cc:1724] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.417292 24343 tablet.cc:1724] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.450726 24349 tablet.cc:1724] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:08:08.484946 23942 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:39291, user_credentials={real_user=slave}} blocked reactor thread for 130272us
I20260709 13:08:08.487841 24353 tablet.cc:1724] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.513305 24346 tablet.cc:1724] T 4a6bf2bb57004015a2864887cf0a5f9d P c21ae6936247494094e53b5674e80e25: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:08:08.517958 24340 log.cc:927] Time spent T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:08:08.511356 24359 tablet.cc:1724] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:08:08.544385 23929 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:18a7f98926e246c88b9d0fc7860b4314)
W20260709 13:08:08.548655 23941 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:36999, user_credentials={real_user=slave}} blocked reactor thread for 94646.5us
W20260709 13:08:08.554361 24017 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:33653, user_credentials={real_user=slave}} blocked reactor thread for 52363.6us
W20260709 13:08:08.563349 23929 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:18a7f98926e246c88b9d0fc7860b4314)
W20260709 13:08:08.566643 23929 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:18a7f98926e246c88b9d0fc7860b4314)
I20260709 13:08:08.570390 24365 tablet.cc:1724] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.583897 24350 tablet.cc:1724] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.588047 24343 tablet.cc:1724] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.591035 23902 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a6bf2bb57004015a2864887cf0a5f9d"
dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
mode: GRACEFUL
new_leader_uuid: "4ac0744564624cecaf9c8806254c3b24"
 from {username='slave'} at 127.0.0.1:59890
I20260709 13:08:08.591733 23902 raft_consensus.cc:606] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Received request to transfer leadership to TS 4ac0744564624cecaf9c8806254c3b24
I20260709 13:08:08.564949 24367 tablet.cc:1724] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.593609 24364 tablet.cc:1724] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.573125 24361 tablet.cc:1724] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.608775 24349 tablet.cc:1724] T aa09d546b66644e8adab35389c543f3e P 1ffb2868f51d400b80d2f376cd1b44dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.628827 24370 tablet.cc:1724] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.630725 24368 tablet.cc:1724] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.643987 24359 tablet.cc:1724] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.662709 24346 tablet.cc:1724] T 5978d96a07b343bbaed141cac26fe3c9 P c21ae6936247494094e53b5674e80e25: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.674248 24364 tablet.cc:1724] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.676368 24365 tablet.cc:1724] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.680984 24349 tablet.cc:1724] T 390dc3de8e9c483db58dc139361223f3 P 1ffb2868f51d400b80d2f376cd1b44dc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.683102 24353 tablet.cc:1724] T 18a7f98926e246c88b9d0fc7860b4314 P c21ae6936247494094e53b5674e80e25: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.698025 24359 tablet.cc:1724] T b281bbfb7e724d61b35f26f082cf89ef P 4ac0744564624cecaf9c8806254c3b24: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.704157 24346 tablet.cc:1724] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.714238 24361 tablet.cc:1724] T 59ecee468eab4a3c9042df77e4201792 P c21ae6936247494094e53b5674e80e25: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.719892 24368 tablet.cc:1724] T aa09d546b66644e8adab35389c543f3e P 4ac0744564624cecaf9c8806254c3b24: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.725796 24359 tablet.cc:1724] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.732267 23974 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68ba6038bc094d98859b0b6ade6c83d1"
dest_uuid: "c21ae6936247494094e53b5674e80e25"
mode: GRACEFUL
new_leader_uuid: "4ac0744564624cecaf9c8806254c3b24"
 from {username='slave'} at 127.0.0.1:43254
I20260709 13:08:08.732963 23974 raft_consensus.cc:606] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [term 1 LEADER]: Received request to transfer leadership to TS 4ac0744564624cecaf9c8806254c3b24
I20260709 13:08:08.734906 11443 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:08:08.735564 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:08.729681 24367 tablet.cc:1724] T d9f364f61ea14310914861a311638607 P c21ae6936247494094e53b5674e80e25: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:08.767800 23902 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c32a002d2cab4ce286b7ebeb0602d1a5"
dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
mode: GRACEFUL
new_leader_uuid: "4ac0744564624cecaf9c8806254c3b24"
 from {username='slave'} at 127.0.0.1:59890
I20260709 13:08:08.768471 23902 raft_consensus.cc:606] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 LEADER]: Received request to transfer leadership to TS 4ac0744564624cecaf9c8806254c3b24
I20260709 13:08:08.771251 23974 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eb19b00e0b1540948179cc4c95b224bd"
dest_uuid: "c21ae6936247494094e53b5674e80e25"
mode: GRACEFUL
new_leader_uuid: "4ac0744564624cecaf9c8806254c3b24"
 from {username='slave'} at 127.0.0.1:43254
I20260709 13:08:08.771832 23974 raft_consensus.cc:606] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [term 1 LEADER]: Received request to transfer leadership to TS 4ac0744564624cecaf9c8806254c3b24
I20260709 13:08:08.773490 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:08.774111 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:08.775710 23797 catalog_manager.cc:6242] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8: soft_deleted_table [id=02c0aeaa2e394a75a46639e102cfbd00] alter complete (version 1)
I20260709 13:08:08.915808 24328 raft_consensus.cc:993] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc: : Instructing follower 4ac0744564624cecaf9c8806254c3b24 to start an election
I20260709 13:08:08.916347 24226 raft_consensus.cc:1081] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 LEADER]: Signalling peer 4ac0744564624cecaf9c8806254c3b24 to start an election
I20260709 13:08:08.918334 24051 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c32a002d2cab4ce286b7ebeb0602d1a5"
dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
 from {username='slave'} at 127.0.0.1:36056
I20260709 13:08:08.918936 24051 raft_consensus.cc:493] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:08.919301 24051 raft_consensus.cc:3060] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.924055 24051 raft_consensus.cc:515] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:08.925504 24051 leader_election.cc:290] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 3 election: Requested vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653)
I20260709 13:08:08.926402 23902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32a002d2cab4ce286b7ebeb0602d1a5" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:08:08.926731 23974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c32a002d2cab4ce286b7ebeb0602d1a5" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:08:08.927129 23902 raft_consensus.cc:3055] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:08.927393 23974 raft_consensus.cc:3060] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.927517 23902 raft_consensus.cc:740] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Running, Role: LEADER
I20260709 13:08:08.928364 23902 consensus_queue.cc:260] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:08.929374 23902 raft_consensus.cc:3060] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:08.934196 23974 raft_consensus.cc:2468] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 3.
I20260709 13:08:08.935578 24017 leader_election.cc:304] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ac0744564624cecaf9c8806254c3b24, c21ae6936247494094e53b5674e80e25; no voters: 
I20260709 13:08:08.936144 23902 raft_consensus.cc:2468] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 3.
I20260709 13:08:08.936616 24363 raft_consensus.cc:2804] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:08.937856 24363 raft_consensus.cc:697] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 [term 3 LEADER]: Becoming Leader. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Running, Role: LEADER
I20260709 13:08:08.938637 24363 consensus_queue.cc:237] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:08.942338 24369 raft_consensus.cc:993] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25: : Instructing follower 4ac0744564624cecaf9c8806254c3b24 to start an election
I20260709 13:08:08.942840 24099 raft_consensus.cc:1081] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [term 1 LEADER]: Signalling peer 4ac0744564624cecaf9c8806254c3b24 to start an election
I20260709 13:08:08.944414 24051 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eb19b00e0b1540948179cc4c95b224bd"
dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
 from {username='slave'} at 127.0.0.1:36066
I20260709 13:08:08.944875 24051 raft_consensus.cc:493] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:08.945195 24051 raft_consensus.cc:3060] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:08.947983 23799 catalog_manager.cc:5697] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 reported cstate change: term changed from 2 to 3, leader changed from 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193) to 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195). New cstate: current_term: 3 leader_uuid: "4ac0744564624cecaf9c8806254c3b24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:08.952181 24051 raft_consensus.cc:515] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:08.952644 24226 raft_consensus.cc:993] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc: : Instructing follower 4ac0744564624cecaf9c8806254c3b24 to start an election
I20260709 13:08:08.953253 24226 raft_consensus.cc:1081] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Signalling peer 4ac0744564624cecaf9c8806254c3b24 to start an election
I20260709 13:08:08.954362 24051 leader_election.cc:290] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 2 election: Requested vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653)
I20260709 13:08:08.955229 23902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb19b00e0b1540948179cc4c95b224bd" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:08:08.955677 23974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb19b00e0b1540948179cc4c95b224bd" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:08:08.955885 23902 raft_consensus.cc:3060] T eb19b00e0b1540948179cc4c95b224bd P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:08.956275 23974 raft_consensus.cc:3055] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:08.956296 24051 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a6bf2bb57004015a2864887cf0a5f9d"
dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
 from {username='slave'} at 127.0.0.1:36056
I20260709 13:08:08.956790 23974 raft_consensus.cc:740] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c21ae6936247494094e53b5674e80e25, State: Running, Role: LEADER
I20260709 13:08:08.957176 24051 raft_consensus.cc:493] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:08.957618 24051 raft_consensus.cc:3060] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:08.958091 23974 consensus_queue.cc:260] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:08.959527 23974 raft_consensus.cc:3060] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:08.963063 23902 raft_consensus.cc:2468] T eb19b00e0b1540948179cc4c95b224bd P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 2.
I20260709 13:08:08.964244 24016 leader_election.cc:304] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, 4ac0744564624cecaf9c8806254c3b24; no voters: 
I20260709 13:08:08.964529 24051 raft_consensus.cc:515] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:08.964967 24363 raft_consensus.cc:2804] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:08.965540 24363 raft_consensus.cc:697] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24 [term 2 LEADER]: Becoming Leader. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Running, Role: LEADER
I20260709 13:08:08.966430 24363 consensus_queue.cc:237] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:08.966715 24051 leader_election.cc:290] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 2 election: Requested vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653)
I20260709 13:08:08.966741 23974 raft_consensus.cc:2468] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 2.
I20260709 13:08:08.967502 23902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6bf2bb57004015a2864887cf0a5f9d" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:08:08.968096 23902 raft_consensus.cc:3055] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:08.968416 23902 raft_consensus.cc:740] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1ffb2868f51d400b80d2f376cd1b44dc, State: Running, Role: LEADER
I20260709 13:08:08.969458 23974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a6bf2bb57004015a2864887cf0a5f9d" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:08:08.969307 23902 consensus_queue.cc:260] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:08.970157 23974 raft_consensus.cc:3060] T 4a6bf2bb57004015a2864887cf0a5f9d P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:08.972474 23902 raft_consensus.cc:3060] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:08.976943 23799 catalog_manager.cc:5697] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24 reported cstate change: term changed from 1 to 2, leader changed from c21ae6936247494094e53b5674e80e25 (127.11.44.194) to 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195). New cstate: current_term: 2 leader_uuid: "4ac0744564624cecaf9c8806254c3b24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:08.979924 23902 raft_consensus.cc:2468] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 2.
I20260709 13:08:08.979959 23974 raft_consensus.cc:2468] T 4a6bf2bb57004015a2864887cf0a5f9d P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 2.
I20260709 13:08:08.981238 24016 leader_election.cc:304] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, 4ac0744564624cecaf9c8806254c3b24; no voters: 
I20260709 13:08:08.982452 24363 raft_consensus.cc:2804] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:08.982936 24363 raft_consensus.cc:697] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [term 2 LEADER]: Becoming Leader. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Running, Role: LEADER
I20260709 13:08:08.983717 24363 consensus_queue.cc:237] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:08.994006 23799 catalog_manager.cc:5697] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 reported cstate change: term changed from 1 to 2, leader changed from 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193) to 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195). New cstate: current_term: 2 leader_uuid: "4ac0744564624cecaf9c8806254c3b24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:09.115412 24099 raft_consensus.cc:993] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25: : Instructing follower 4ac0744564624cecaf9c8806254c3b24 to start an election
I20260709 13:08:09.115976 24369 raft_consensus.cc:1081] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [term 1 LEADER]: Signalling peer 4ac0744564624cecaf9c8806254c3b24 to start an election
I20260709 13:08:09.118050 24051 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68ba6038bc094d98859b0b6ade6c83d1"
dest_uuid: "4ac0744564624cecaf9c8806254c3b24"
 from {username='slave'} at 127.0.0.1:36066
I20260709 13:08:09.118708 24051 raft_consensus.cc:493] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:09.119103 24051 raft_consensus.cc:3060] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:09.124290 24051 raft_consensus.cc:515] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:09.126088 24051 leader_election.cc:290] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 2 election: Requested vote from peers 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291), c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653)
I20260709 13:08:09.126959 23902 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ba6038bc094d98859b0b6ade6c83d1" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "1ffb2868f51d400b80d2f376cd1b44dc"
I20260709 13:08:09.127342 23974 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68ba6038bc094d98859b0b6ade6c83d1" candidate_uuid: "4ac0744564624cecaf9c8806254c3b24" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "c21ae6936247494094e53b5674e80e25"
I20260709 13:08:09.127628 23902 raft_consensus.cc:3060] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:09.128043 23974 raft_consensus.cc:3055] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:09.128379 23974 raft_consensus.cc:740] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c21ae6936247494094e53b5674e80e25, State: Running, Role: LEADER
I20260709 13:08:09.129231 23974 consensus_queue.cc:260] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:09.130421 23974 raft_consensus.cc:3060] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:09.133128 23902 raft_consensus.cc:2468] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 2.
I20260709 13:08:09.134529 24016 leader_election.cc:304] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ffb2868f51d400b80d2f376cd1b44dc, 4ac0744564624cecaf9c8806254c3b24; no voters: 
I20260709 13:08:09.135362 24363 raft_consensus.cc:2804] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:09.135828 24363 raft_consensus.cc:697] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24 [term 2 LEADER]: Becoming Leader. State: Replica: 4ac0744564624cecaf9c8806254c3b24, State: Running, Role: LEADER
I20260709 13:08:09.136384 23974 raft_consensus.cc:2468] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ac0744564624cecaf9c8806254c3b24 in term 2.
I20260709 13:08:09.136623 24363 consensus_queue.cc:237] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } }
I20260709 13:08:09.144773 23799 catalog_manager.cc:5697] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24 reported cstate change: term changed from 1 to 2, leader changed from c21ae6936247494094e53b5674e80e25 (127.11.44.194) to 4ac0744564624cecaf9c8806254c3b24 (127.11.44.195). New cstate: current_term: 2 leader_uuid: "4ac0744564624cecaf9c8806254c3b24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ac0744564624cecaf9c8806254c3b24" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 36999 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:09.381556 23902 raft_consensus.cc:1275] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Refusing update from remote peer 4ac0744564624cecaf9c8806254c3b24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:09.382912 24363 consensus_queue.cc:1048] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:09.400219 23974 raft_consensus.cc:1275] T 4a6bf2bb57004015a2864887cf0a5f9d P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Refusing update from remote peer 4ac0744564624cecaf9c8806254c3b24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:09.401467 24290 consensus_queue.cc:1048] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:09.406816 23902 raft_consensus.cc:1275] T eb19b00e0b1540948179cc4c95b224bd P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Refusing update from remote peer 4ac0744564624cecaf9c8806254c3b24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:09.409794 24382 consensus_queue.cc:1048] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:09.411806 23902 raft_consensus.cc:1275] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [term 3 FOLLOWER]: Refusing update from remote peer 4ac0744564624cecaf9c8806254c3b24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:09.413378 24290 consensus_queue.cc:1048] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:09.422725 23974 raft_consensus.cc:1275] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [term 3 FOLLOWER]: Refusing update from remote peer 4ac0744564624cecaf9c8806254c3b24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:09.424535 24381 consensus_queue.cc:1048] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:09.435742 23973 raft_consensus.cc:1275] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Refusing update from remote peer 4ac0744564624cecaf9c8806254c3b24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:09.437482 24290 consensus_queue.cc:1048] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:09.658386 23899 raft_consensus.cc:1275] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Refusing update from remote peer 4ac0744564624cecaf9c8806254c3b24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:09.659796 24290 consensus_queue.cc:1048] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1ffb2868f51d400b80d2f376cd1b44dc" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 39291 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:09.667551 23974 raft_consensus.cc:1275] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Refusing update from remote peer 4ac0744564624cecaf9c8806254c3b24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:08:09.669083 24363 consensus_queue.cc:1048] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c21ae6936247494094e53b5674e80e25" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 33653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:09.843948 11443 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:08:09.851867 11443 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:08:09.852456 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:09.859083 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:08:09.859457 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:08:10.894539 11443 tablet_server.cc:179] TabletServer@127.11.44.193:0 shutting down...
W20260709 13:08:10.921166 23942 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 50 similar messages]
W20260709 13:08:10.925361 23942 consensus_peers.cc:597] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25 -> Peer 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291): Couldn't send request to peer 1ffb2868f51d400b80d2f376cd1b44dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:10.926718 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:10.927688 11443 tablet_replica.cc:333] T aa09d546b66644e8adab35389c543f3e P 1ffb2868f51d400b80d2f376cd1b44dc: stopping tablet replica
I20260709 13:08:10.928687 11443 raft_consensus.cc:2243] T aa09d546b66644e8adab35389c543f3e P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:10.929272 11443 raft_consensus.cc:2272] T aa09d546b66644e8adab35389c543f3e P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:10.931326 11443 tablet_replica.cc:333] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc: stopping tablet replica
I20260709 13:08:10.932011 11443 raft_consensus.cc:2243] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:10.932451 11443 raft_consensus.cc:2272] T b281bbfb7e724d61b35f26f082cf89ef P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:10.934371 11443 tablet_replica.cc:333] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc: stopping tablet replica
I20260709 13:08:10.934888 11443 raft_consensus.cc:2243] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:10.935264 11443 raft_consensus.cc:2272] T 68ba6038bc094d98859b0b6ade6c83d1 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:10.936987 11443 tablet_replica.cc:333] T bc21a182d5354dd9a801b72554c3a88c P 1ffb2868f51d400b80d2f376cd1b44dc: stopping tablet replica
I20260709 13:08:10.937445 11443 raft_consensus.cc:2243] T bc21a182d5354dd9a801b72554c3a88c P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:10.937925 11443 raft_consensus.cc:2272] T bc21a182d5354dd9a801b72554c3a88c P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:10.939929 11443 tablet_replica.cc:333] T eb19b00e0b1540948179cc4c95b224bd P 1ffb2868f51d400b80d2f376cd1b44dc: stopping tablet replica
I20260709 13:08:10.940408 11443 raft_consensus.cc:2243] T eb19b00e0b1540948179cc4c95b224bd P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:10.940755 11443 raft_consensus.cc:2272] T eb19b00e0b1540948179cc4c95b224bd P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:10.943323 11443 tablet_replica.cc:333] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc: stopping tablet replica
I20260709 13:08:10.943866 11443 raft_consensus.cc:2243] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:10.944353 11443 raft_consensus.cc:2272] T d9f364f61ea14310914861a311638607 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:10.946271 11443 tablet_replica.cc:333] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc: stopping tablet replica
I20260709 13:08:10.946866 11443 raft_consensus.cc:2243] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:10.947623 11443 raft_consensus.cc:2272] T 5978d96a07b343bbaed141cac26fe3c9 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:10.949698 11443 tablet_replica.cc:333] T 6447060a38b04932bf5c6b794319bfdb P 1ffb2868f51d400b80d2f376cd1b44dc: stopping tablet replica
I20260709 13:08:10.950407 11443 raft_consensus.cc:2243] T 6447060a38b04932bf5c6b794319bfdb P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:10.950984 11443 raft_consensus.cc:2272] T 6447060a38b04932bf5c6b794319bfdb P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:10.953589 11443 tablet_replica.cc:333] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc: stopping tablet replica
I20260709 13:08:10.954236 11443 raft_consensus.cc:2243] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:10.954691 11443 raft_consensus.cc:2272] T c32a002d2cab4ce286b7ebeb0602d1a5 P 1ffb2868f51d400b80d2f376cd1b44dc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:10.956940 11443 tablet_replica.cc:333] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc: stopping tablet replica
I20260709 13:08:10.957551 11443 raft_consensus.cc:2243] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:10.958096 11443 raft_consensus.cc:2272] T a2e3a18f58ed43899a18da4f19e44a9e P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:10.960457 11443 tablet_replica.cc:333] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc: stopping tablet replica
I20260709 13:08:10.961160 11443 raft_consensus.cc:2243] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:10.962249 11443 raft_consensus.cc:2272] T 59ecee468eab4a3c9042df77e4201792 P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:10.964177 24016 consensus_peers.cc:597] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24 -> Peer 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291): Couldn't send request to peer 1ffb2868f51d400b80d2f376cd1b44dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:10.964892 11443 tablet_replica.cc:333] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc: stopping tablet replica
I20260709 13:08:10.965684 11443 raft_consensus.cc:2243] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:10.966584 11443 raft_consensus.cc:2272] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 1ffb2868f51d400b80d2f376cd1b44dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:10.968729 11443 tablet_replica.cc:333] T 390dc3de8e9c483db58dc139361223f3 P 1ffb2868f51d400b80d2f376cd1b44dc: stopping tablet replica
I20260709 13:08:10.969208 11443 raft_consensus.cc:2243] T 390dc3de8e9c483db58dc139361223f3 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:10.969610 11443 raft_consensus.cc:2272] T 390dc3de8e9c483db58dc139361223f3 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:10.971477 11443 tablet_replica.cc:333] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc: stopping tablet replica
I20260709 13:08:10.972019 11443 raft_consensus.cc:2243] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:10.972872 11443 raft_consensus.cc:2272] T 689f94e16e69480a85ba6b0e823624e8 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:10.975190 11443 tablet_replica.cc:333] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc: stopping tablet replica
I20260709 13:08:10.975709 11443 raft_consensus.cc:2243] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:10.976449 11443 raft_consensus.cc:2272] T 18a7f98926e246c88b9d0fc7860b4314 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:10.978492 11443 tablet_replica.cc:333] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc: stopping tablet replica
I20260709 13:08:10.978991 11443 raft_consensus.cc:2243] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:10.979393 11443 raft_consensus.cc:2272] T 4a6bf2bb57004015a2864887cf0a5f9d P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:10.981202 11443 tablet_replica.cc:333] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc: stopping tablet replica
I20260709 13:08:10.981804 11443 raft_consensus.cc:2243] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:10.982682 11443 raft_consensus.cc:2272] T 3acc3cd5da084f91a092454501bb2280 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:10.985211 11443 tablet_replica.cc:333] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc: stopping tablet replica
I20260709 13:08:10.985827 11443 raft_consensus.cc:2243] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:10.985973 24016 consensus_peers.cc:597] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 -> Peer 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291): Couldn't send request to peer 1ffb2868f51d400b80d2f376cd1b44dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:10.986419 11443 raft_consensus.cc:2272] T 3e307bece597495db95ccd648adc8908 P 1ffb2868f51d400b80d2f376cd1b44dc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:10.988559 23942 consensus_peers.cc:597] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 -> Peer 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291): Couldn't send request to peer 1ffb2868f51d400b80d2f376cd1b44dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:10.991707 23942 consensus_peers.cc:597] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25 -> Peer 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291): Couldn't send request to peer 1ffb2868f51d400b80d2f376cd1b44dc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:11.031509 11443 tablet_server.cc:196] TabletServer@127.11.44.193:0 shutdown complete.
W20260709 13:08:11.038154 23942 consensus_peers.cc:597] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 -> Peer 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291): Couldn't send request to peer 1ffb2868f51d400b80d2f376cd1b44dc. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:39291: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:11.065440 11443 tablet_server.cc:179] TabletServer@127.11.44.194:0 shutting down...
W20260709 13:08:11.069905 24016 consensus_peers.cc:597] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24 -> Peer 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291): Couldn't send request to peer 1ffb2868f51d400b80d2f376cd1b44dc. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:39291: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:11.078527 24017 consensus_peers.cc:597] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24 -> Peer c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653): Couldn't send request to peer c21ae6936247494094e53b5674e80e25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:11.097237 24016 consensus_peers.cc:597] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24 -> Peer 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291): Couldn't send request to peer 1ffb2868f51d400b80d2f376cd1b44dc. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:39291: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:11.102595 24016 consensus_peers.cc:597] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24 -> Peer 1ffb2868f51d400b80d2f376cd1b44dc (127.11.44.193:39291): Couldn't send request to peer 1ffb2868f51d400b80d2f376cd1b44dc. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:39291: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:11.105283 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:11.106463 11443 tablet_replica.cc:333] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25: stopping tablet replica
I20260709 13:08:11.107417 11443 raft_consensus.cc:2243] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.108455 11443 raft_consensus.cc:2272] T aa09d546b66644e8adab35389c543f3e P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.110407 11443 tablet_replica.cc:333] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25: stopping tablet replica
I20260709 13:08:11.110918 11443 raft_consensus.cc:2243] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.111660 11443 raft_consensus.cc:2272] T b281bbfb7e724d61b35f26f082cf89ef P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.113638 11443 tablet_replica.cc:333] T 18a7f98926e246c88b9d0fc7860b4314 P c21ae6936247494094e53b5674e80e25: stopping tablet replica
I20260709 13:08:11.114210 11443 raft_consensus.cc:2243] T 18a7f98926e246c88b9d0fc7860b4314 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.114645 11443 raft_consensus.cc:2272] T 18a7f98926e246c88b9d0fc7860b4314 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.116791 11443 tablet_replica.cc:333] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P c21ae6936247494094e53b5674e80e25: stopping tablet replica
I20260709 13:08:11.117393 11443 raft_consensus.cc:2243] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.117884 11443 raft_consensus.cc:2272] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.120116 11443 tablet_replica.cc:333] T 59ecee468eab4a3c9042df77e4201792 P c21ae6936247494094e53b5674e80e25: stopping tablet replica
I20260709 13:08:11.120677 11443 raft_consensus.cc:2243] T 59ecee468eab4a3c9042df77e4201792 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.121085 11443 raft_consensus.cc:2272] T 59ecee468eab4a3c9042df77e4201792 P c21ae6936247494094e53b5674e80e25 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.123027 11443 tablet_replica.cc:333] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25: stopping tablet replica
I20260709 13:08:11.123528 11443 raft_consensus.cc:2243] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.123935 11443 raft_consensus.cc:2272] T c32a002d2cab4ce286b7ebeb0602d1a5 P c21ae6936247494094e53b5674e80e25 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.126377 11443 tablet_replica.cc:333] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25: stopping tablet replica
I20260709 13:08:11.126917 11443 raft_consensus.cc:2243] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.127673 11443 raft_consensus.cc:2272] T a2e3a18f58ed43899a18da4f19e44a9e P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.129806 11443 tablet_replica.cc:333] T d9f364f61ea14310914861a311638607 P c21ae6936247494094e53b5674e80e25: stopping tablet replica
I20260709 13:08:11.130349 11443 raft_consensus.cc:2243] T d9f364f61ea14310914861a311638607 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.130789 11443 raft_consensus.cc:2272] T d9f364f61ea14310914861a311638607 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.132520 11443 tablet_replica.cc:333] T 5978d96a07b343bbaed141cac26fe3c9 P c21ae6936247494094e53b5674e80e25: stopping tablet replica
I20260709 13:08:11.133073 11443 raft_consensus.cc:2243] T 5978d96a07b343bbaed141cac26fe3c9 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.133664 11443 raft_consensus.cc:2272] T 5978d96a07b343bbaed141cac26fe3c9 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.135879 11443 tablet_replica.cc:333] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25: stopping tablet replica
I20260709 13:08:11.136478 11443 raft_consensus.cc:2243] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:08:11.137279 24017 consensus_peers.cc:597] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 -> Peer c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653): Couldn't send request to peer c21ae6936247494094e53b5674e80e25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:11.137354 11443 raft_consensus.cc:2272] T 6447060a38b04932bf5c6b794319bfdb P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.139748 11443 tablet_replica.cc:333] T 4a6bf2bb57004015a2864887cf0a5f9d P c21ae6936247494094e53b5674e80e25: stopping tablet replica
I20260709 13:08:11.140393 11443 raft_consensus.cc:2243] T 4a6bf2bb57004015a2864887cf0a5f9d P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.140822 11443 raft_consensus.cc:2272] T 4a6bf2bb57004015a2864887cf0a5f9d P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.143178 11443 tablet_replica.cc:333] T 3acc3cd5da084f91a092454501bb2280 P c21ae6936247494094e53b5674e80e25: stopping tablet replica
I20260709 13:08:11.143823 11443 raft_consensus.cc:2243] T 3acc3cd5da084f91a092454501bb2280 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.144330 11443 raft_consensus.cc:2272] T 3acc3cd5da084f91a092454501bb2280 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.147060 11443 tablet_replica.cc:333] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25: stopping tablet replica
W20260709 13:08:11.146991 24017 consensus_peers.cc:597] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24 -> Peer c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653): Couldn't send request to peer c21ae6936247494094e53b5674e80e25. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:11.148211 11443 raft_consensus.cc:2243] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.149394 11443 raft_consensus.cc:2272] T 3e307bece597495db95ccd648adc8908 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.151651 11443 tablet_replica.cc:333] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25: stopping tablet replica
I20260709 13:08:11.152217 11443 raft_consensus.cc:2243] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.152644 11443 raft_consensus.cc:2272] T 68ba6038bc094d98859b0b6ade6c83d1 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.154500 11443 tablet_replica.cc:333] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25: stopping tablet replica
I20260709 13:08:11.155099 11443 raft_consensus.cc:2243] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.155556 11443 raft_consensus.cc:2272] T bc21a182d5354dd9a801b72554c3a88c P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.157454 11443 tablet_replica.cc:333] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25: stopping tablet replica
I20260709 13:08:11.158069 11443 raft_consensus.cc:2243] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.158437 11443 raft_consensus.cc:2272] T eb19b00e0b1540948179cc4c95b224bd P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.160302 11443 tablet_replica.cc:333] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25: stopping tablet replica
I20260709 13:08:11.160741 11443 raft_consensus.cc:2243] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.161414 11443 raft_consensus.cc:2272] T 390dc3de8e9c483db58dc139361223f3 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.163311 11443 tablet_replica.cc:333] T 689f94e16e69480a85ba6b0e823624e8 P c21ae6936247494094e53b5674e80e25: stopping tablet replica
I20260709 13:08:11.163738 11443 raft_consensus.cc:2243] T 689f94e16e69480a85ba6b0e823624e8 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.164103 11443 raft_consensus.cc:2272] T 689f94e16e69480a85ba6b0e823624e8 P c21ae6936247494094e53b5674e80e25 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.204663 11443 tablet_server.cc:196] TabletServer@127.11.44.194:0 shutdown complete.
W20260709 13:08:11.227499 24017 consensus_peers.cc:597] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 -> Peer c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653): Couldn't send request to peer c21ae6936247494094e53b5674e80e25. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:33653: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:11.239022 11443 tablet_server.cc:179] TabletServer@127.11.44.195:0 shutting down...
I20260709 13:08:11.271158 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:11.271978 11443 tablet_replica.cc:333] T aa09d546b66644e8adab35389c543f3e P 4ac0744564624cecaf9c8806254c3b24: stopping tablet replica
I20260709 13:08:11.272768 11443 raft_consensus.cc:2243] T aa09d546b66644e8adab35389c543f3e P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.273267 11443 raft_consensus.cc:2272] T aa09d546b66644e8adab35389c543f3e P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.275298 11443 tablet_replica.cc:333] T b281bbfb7e724d61b35f26f082cf89ef P 4ac0744564624cecaf9c8806254c3b24: stopping tablet replica
I20260709 13:08:11.275875 11443 raft_consensus.cc:2243] T b281bbfb7e724d61b35f26f082cf89ef P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.276332 11443 raft_consensus.cc:2272] T b281bbfb7e724d61b35f26f082cf89ef P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.278247 11443 tablet_replica.cc:333] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24: stopping tablet replica
I20260709 13:08:11.278816 11443 raft_consensus.cc:2243] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.279574 11443 raft_consensus.cc:2272] T c32a002d2cab4ce286b7ebeb0602d1a5 P 4ac0744564624cecaf9c8806254c3b24 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.281736 11443 tablet_replica.cc:333] T a2e3a18f58ed43899a18da4f19e44a9e P 4ac0744564624cecaf9c8806254c3b24: stopping tablet replica
I20260709 13:08:11.282281 11443 raft_consensus.cc:2243] T a2e3a18f58ed43899a18da4f19e44a9e P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.282763 11443 raft_consensus.cc:2272] T a2e3a18f58ed43899a18da4f19e44a9e P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.284898 11443 tablet_replica.cc:333] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24: stopping tablet replica
I20260709 13:08:11.285447 11443 raft_consensus.cc:2243] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.286309 11443 raft_consensus.cc:2272] T d9f364f61ea14310914861a311638607 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.288072 11443 tablet_replica.cc:333] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24: stopping tablet replica
I20260709 13:08:11.288661 11443 raft_consensus.cc:2243] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.289100 11443 raft_consensus.cc:2272] T 5978d96a07b343bbaed141cac26fe3c9 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.291041 11443 tablet_replica.cc:333] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24: stopping tablet replica
I20260709 13:08:11.291565 11443 raft_consensus.cc:2243] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.292021 11443 raft_consensus.cc:2272] T 6447060a38b04932bf5c6b794319bfdb P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.294020 11443 tablet_replica.cc:333] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24: stopping tablet replica
I20260709 13:08:11.294565 11443 raft_consensus.cc:2243] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.295333 11443 raft_consensus.cc:2272] T 4a6bf2bb57004015a2864887cf0a5f9d P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.297796 11443 tablet_replica.cc:333] T 3e307bece597495db95ccd648adc8908 P 4ac0744564624cecaf9c8806254c3b24: stopping tablet replica
I20260709 13:08:11.298614 11443 raft_consensus.cc:2243] T 3e307bece597495db95ccd648adc8908 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.299171 11443 raft_consensus.cc:2272] T 3e307bece597495db95ccd648adc8908 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:11.301362 24017 consensus_peers.cc:597] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24 -> Peer c21ae6936247494094e53b5674e80e25 (127.11.44.194:33653): Couldn't send request to peer c21ae6936247494094e53b5674e80e25. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:33653: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:11.302246 11443 tablet_replica.cc:333] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24: stopping tablet replica
I20260709 13:08:11.302914 11443 raft_consensus.cc:2243] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.303413 11443 raft_consensus.cc:2272] T 3acc3cd5da084f91a092454501bb2280 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.305505 11443 tablet_replica.cc:333] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24: stopping tablet replica
I20260709 13:08:11.306152 11443 raft_consensus.cc:2243] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.306607 11443 raft_consensus.cc:2272] T 59ecee468eab4a3c9042df77e4201792 P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.308662 11443 tablet_replica.cc:333] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 4ac0744564624cecaf9c8806254c3b24: stopping tablet replica
I20260709 13:08:11.309250 11443 raft_consensus.cc:2243] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.309767 11443 raft_consensus.cc:2272] T 2d9c65ae9eaa4c7abfaece0d9674a9ce P 4ac0744564624cecaf9c8806254c3b24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.313760 11443 tablet_replica.cc:333] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24: stopping tablet replica
I20260709 13:08:11.314345 11443 raft_consensus.cc:2243] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.314814 11443 raft_consensus.cc:2272] T 390dc3de8e9c483db58dc139361223f3 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.316742 11443 tablet_replica.cc:333] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24: stopping tablet replica
I20260709 13:08:11.317252 11443 raft_consensus.cc:2243] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.317768 11443 raft_consensus.cc:2272] T 689f94e16e69480a85ba6b0e823624e8 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.319782 11443 tablet_replica.cc:333] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24: stopping tablet replica
I20260709 13:08:11.320297 11443 raft_consensus.cc:2243] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.321072 11443 raft_consensus.cc:2272] T 68ba6038bc094d98859b0b6ade6c83d1 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.322965 11443 tablet_replica.cc:333] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24: stopping tablet replica
I20260709 13:08:11.323485 11443 raft_consensus.cc:2243] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.324262 11443 raft_consensus.cc:2272] T eb19b00e0b1540948179cc4c95b224bd P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.326992 11443 tablet_replica.cc:333] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24: stopping tablet replica
I20260709 13:08:11.327538 11443 raft_consensus.cc:2243] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.328325 11443 raft_consensus.cc:2272] T bc21a182d5354dd9a801b72554c3a88c P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.330406 11443 tablet_replica.cc:333] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24: stopping tablet replica
I20260709 13:08:11.330864 11443 raft_consensus.cc:2243] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:11.331305 11443 raft_consensus.cc:2272] T 18a7f98926e246c88b9d0fc7860b4314 P 4ac0744564624cecaf9c8806254c3b24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.371840 11443 tablet_server.cc:196] TabletServer@127.11.44.195:0 shutdown complete.
I20260709 13:08:11.406117 11443 master.cc:562] Master@127.11.44.254:40023 shutting down...
I20260709 13:08:11.429512 11443 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:11.430163 11443 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:11.430496 11443 tablet_replica.cc:333] T 00000000000000000000000000000000 P ad564820aa6344a8b7b44fe626cddbe8: stopping tablet replica
I20260709 13:08:11.451459 11443 master.cc:584] Master@127.11.44.254:40023 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12957 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:08:11.503166 11443 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.44.254:40303
I20260709 13:08:11.504261 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:11.510298 24394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:11.510317 24393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:11.510867 24396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:11.511636 11443 server_base.cc:1061] running on GCE node
I20260709 13:08:11.512656 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:11.512843 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:11.512955 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602491512943 us; error 0 us; skew 500 ppm
I20260709 13:08:11.513413 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:11.519923 11443 webserver.cc:533] Webserver started at http://127.11.44.254:42023/ using document root <none> and password file <none>
I20260709 13:08:11.520402 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:11.520551 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:11.520780 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:11.521888 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132206461-11443-0/minicluster-data/master-0-root/instance:
uuid: "523fe5d389f64f2fbb27427f76f19332"
format_stamp: "Formatted at 2026-07-09 13:08:11 on dist-test-slave-qv7r"
I20260709 13:08:11.528525 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:11.533968 24401 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:11.535184 11443 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:08:11.535633 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132206461-11443-0/minicluster-data/master-0-root
uuid: "523fe5d389f64f2fbb27427f76f19332"
format_stamp: "Formatted at 2026-07-09 13:08:11 on dist-test-slave-qv7r"
I20260709 13:08:11.536034 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132206461-11443-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132206461-11443-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132206461-11443-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:11.566283 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:11.567549 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:11.607290 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.254:40303
I20260709 13:08:11.607409 24452 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.254:40303 every 8 connection(s)
I20260709 13:08:11.611373 24453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:11.622496 24453 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332: Bootstrap starting.
I20260709 13:08:11.627523 24453 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:11.632071 24453 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332: No bootstrap required, opened a new log
I20260709 13:08:11.634407 24453 raft_consensus.cc:359] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "523fe5d389f64f2fbb27427f76f19332" member_type: VOTER }
I20260709 13:08:11.634804 24453 raft_consensus.cc:385] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:11.635072 24453 raft_consensus.cc:740] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 523fe5d389f64f2fbb27427f76f19332, State: Initialized, Role: FOLLOWER
I20260709 13:08:11.635793 24453 consensus_queue.cc:260] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "523fe5d389f64f2fbb27427f76f19332" member_type: VOTER }
I20260709 13:08:11.636253 24453 raft_consensus.cc:399] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:08:11.636492 24453 raft_consensus.cc:493] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:08:11.636746 24453 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:11.642040 24453 raft_consensus.cc:515] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "523fe5d389f64f2fbb27427f76f19332" member_type: VOTER }
I20260709 13:08:11.642578 24453 leader_election.cc:304] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 523fe5d389f64f2fbb27427f76f19332; no voters: 
I20260709 13:08:11.644017 24453 leader_election.cc:290] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:08:11.644456 24456 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:11.645967 24456 raft_consensus.cc:697] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332 [term 1 LEADER]: Becoming Leader. State: Replica: 523fe5d389f64f2fbb27427f76f19332, State: Running, Role: LEADER
I20260709 13:08:11.646674 24456 consensus_queue.cc:237] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "523fe5d389f64f2fbb27427f76f19332" member_type: VOTER }
I20260709 13:08:11.647330 24453 sys_catalog.cc:565] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:08:11.651189 24458 sys_catalog.cc:455] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 523fe5d389f64f2fbb27427f76f19332. Latest consensus state: current_term: 1 leader_uuid: "523fe5d389f64f2fbb27427f76f19332" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "523fe5d389f64f2fbb27427f76f19332" member_type: VOTER } }
I20260709 13:08:11.651758 24458 sys_catalog.cc:458] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332 [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:11.651577 24457 sys_catalog.cc:455] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "523fe5d389f64f2fbb27427f76f19332" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "523fe5d389f64f2fbb27427f76f19332" member_type: VOTER } }
I20260709 13:08:11.652454 24457 sys_catalog.cc:458] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332 [sys.catalog]: This master's current role is: LEADER
I20260709 13:08:11.656004 24462 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:08:11.660969 24462 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:08:11.665017 11443 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:08:11.670324 24462 catalog_manager.cc:1383] Generated new cluster ID: 2a59fbcef9ec47da83731017acb15a8c
I20260709 13:08:11.670657 24462 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:08:11.693320 24462 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:08:11.694775 24462 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:08:11.711658 24462 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332: Generated new TSK 0
I20260709 13:08:11.712286 24462 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:08:11.731829 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:11.738915 24474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:11.739581 24475 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:11.741395 24477 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:11.742165 11443 server_base.cc:1061] running on GCE node
I20260709 13:08:11.743228 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:11.743430 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:11.743654 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602491743638 us; error 0 us; skew 500 ppm
I20260709 13:08:11.744287 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:11.747128 11443 webserver.cc:533] Webserver started at http://127.11.44.193:43635/ using document root <none> and password file <none>
I20260709 13:08:11.747689 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:11.747905 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:11.748227 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:11.749693 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132206461-11443-0/minicluster-data/ts-0-root/instance:
uuid: "c3378e831c4f417a81e4cd63bde179a8"
format_stamp: "Formatted at 2026-07-09 13:08:11 on dist-test-slave-qv7r"
I20260709 13:08:11.755663 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 13:08:11.760560 24482 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:11.761544 11443 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:08:11.761916 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132206461-11443-0/minicluster-data/ts-0-root
uuid: "c3378e831c4f417a81e4cd63bde179a8"
format_stamp: "Formatted at 2026-07-09 13:08:11 on dist-test-slave-qv7r"
I20260709 13:08:11.762176 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132206461-11443-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132206461-11443-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132206461-11443-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:11.788100 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:11.789693 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:11.791656 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:11.794224 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:11.794421 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:11.794749 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:11.794921 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:11.843932 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.193:35831
I20260709 13:08:11.844025 24544 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.193:35831 every 8 connection(s)
I20260709 13:08:11.849881 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:11.858600 24549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:11.859419 24550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:11.863788 24552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:11.865624 24545 heartbeater.cc:344] Connected to a master server at 127.11.44.254:40303
I20260709 13:08:11.865864 11443 server_base.cc:1061] running on GCE node
I20260709 13:08:11.866274 24545 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:11.866914 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:11.867167 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:11.867304 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602491867291 us; error 0 us; skew 500 ppm
I20260709 13:08:11.867401 24545 heartbeater.cc:507] Master 127.11.44.254:40303 requested a full tablet report, sending...
I20260709 13:08:11.867875 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:11.870270 24418 ts_manager.cc:194] Registered new tserver with Master: c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831)
I20260709 13:08:11.871285 11443 webserver.cc:533] Webserver started at http://127.11.44.194:41593/ using document root <none> and password file <none>
I20260709 13:08:11.872045 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:11.872290 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:11.872625 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:11.872848 24418 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49926
I20260709 13:08:11.874298 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132206461-11443-0/minicluster-data/ts-1-root/instance:
uuid: "26b8e896a2a74a22999486af393f83f8"
format_stamp: "Formatted at 2026-07-09 13:08:11 on dist-test-slave-qv7r"
I20260709 13:08:11.879261 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:08:11.883139 24557 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:11.884105 11443 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 13:08:11.884455 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132206461-11443-0/minicluster-data/ts-1-root
uuid: "26b8e896a2a74a22999486af393f83f8"
format_stamp: "Formatted at 2026-07-09 13:08:11 on dist-test-slave-qv7r"
I20260709 13:08:11.884801 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132206461-11443-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132206461-11443-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132206461-11443-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:11.916393 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:11.917593 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:11.919086 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:11.921615 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:11.921847 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:11.922116 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:11.922294 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:11.969238 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.194:45553
I20260709 13:08:11.969372 24619 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.194:45553 every 8 connection(s)
I20260709 13:08:11.974289 11443 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:08:11.981871 24623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:11.983548 24624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:08:11.985340 24626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:08:11.987196 24620 heartbeater.cc:344] Connected to a master server at 127.11.44.254:40303
I20260709 13:08:11.987876 24620 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:11.987818 11443 server_base.cc:1061] running on GCE node
I20260709 13:08:11.988967 24620 heartbeater.cc:507] Master 127.11.44.254:40303 requested a full tablet report, sending...
I20260709 13:08:11.989118 11443 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:08:11.989419 11443 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:08:11.989652 11443 hybrid_clock.cc:648] HybridClock initialized: now 1783602491989634 us; error 0 us; skew 500 ppm
I20260709 13:08:11.990415 11443 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:08:11.991439 24418 ts_manager.cc:194] Registered new tserver with Master: 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553)
I20260709 13:08:11.993196 24418 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49936
I20260709 13:08:11.993691 11443 webserver.cc:533] Webserver started at http://127.11.44.195:45215/ using document root <none> and password file <none>
I20260709 13:08:11.994411 11443 fs_manager.cc:362] Metadata directory not provided
I20260709 13:08:11.994668 11443 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:08:11.994962 11443 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:08:11.996127 11443 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132206461-11443-0/minicluster-data/ts-2-root/instance:
uuid: "48f59673e33a4636acca78951e868651"
format_stamp: "Formatted at 2026-07-09 13:08:11 on dist-test-slave-qv7r"
I20260709 13:08:12.001009 11443 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.001s
I20260709 13:08:12.005543 24631 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:12.006443 11443 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:08:12.006795 11443 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132206461-11443-0/minicluster-data/ts-2-root
uuid: "48f59673e33a4636acca78951e868651"
format_stamp: "Formatted at 2026-07-09 13:08:11 on dist-test-slave-qv7r"
I20260709 13:08:12.007176 11443 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132206461-11443-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132206461-11443-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskjH7F98/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602132206461-11443-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:08:12.031276 11443 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:08:12.032717 11443 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:08:12.034519 11443 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:08:12.036900 11443 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:08:12.037168 11443 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:08:12.037420 11443 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:08:12.037643 11443 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:08:12.083412 11443 rpc_server.cc:307] RPC server started. Bound to: 127.11.44.195:39911
I20260709 13:08:12.083523 24693 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.44.195:39911 every 8 connection(s)
I20260709 13:08:12.099053 24694 heartbeater.cc:344] Connected to a master server at 127.11.44.254:40303
I20260709 13:08:12.099486 24694 heartbeater.cc:461] Registering TS with master...
I20260709 13:08:12.100375 24694 heartbeater.cc:507] Master 127.11.44.254:40303 requested a full tablet report, sending...
I20260709 13:08:12.102891 24418 ts_manager.cc:194] Registered new tserver with Master: 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:12.103456 11443 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016271732s
I20260709 13:08:12.104398 24418 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49940
I20260709 13:08:12.132120 24418 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49948:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:08:12.135082 24418 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:08:12.214772 24510 tablet_service.cc:1511] Processing CreateTablet for tablet 5587c38c35e6480e9f60445cfba5c6d6 (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:12.215746 24508 tablet_service.cc:1511] Processing CreateTablet for tablet f3281cd03afa4f269851daf856bcc0ec (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:12.216351 24510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5587c38c35e6480e9f60445cfba5c6d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.217195 24508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3281cd03afa4f269851daf856bcc0ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.219339 24509 tablet_service.cc:1511] Processing CreateTablet for tablet a51ff652d2a24a81a51cdd8d20e1fd25 (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:12.220749 24509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a51ff652d2a24a81a51cdd8d20e1fd25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.220927 24659 tablet_service.cc:1511] Processing CreateTablet for tablet 5587c38c35e6480e9f60445cfba5c6d6 (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:12.222334 24659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5587c38c35e6480e9f60445cfba5c6d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.224263 24657 tablet_service.cc:1511] Processing CreateTablet for tablet f3281cd03afa4f269851daf856bcc0ec (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:12.226653 24656 tablet_service.cc:1511] Processing CreateTablet for tablet a0eaf0a51afd41ee8b06d2f3c60da098 (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:12.228925 24655 tablet_service.cc:1511] Processing CreateTablet for tablet d42119e7b9b546fb8742111dc9fc01c4 (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:12.231259 24658 tablet_service.cc:1511] Processing CreateTablet for tablet a51ff652d2a24a81a51cdd8d20e1fd25 (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:12.233153 24657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3281cd03afa4f269851daf856bcc0ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.234834 24654 tablet_service.cc:1511] Processing CreateTablet for tablet f8d01567151542098a0cc1638736f603 (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:12.235347 24507 tablet_service.cc:1511] Processing CreateTablet for tablet a0eaf0a51afd41ee8b06d2f3c60da098 (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:12.236289 24654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8d01567151542098a0cc1638736f603. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.236754 24507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0eaf0a51afd41ee8b06d2f3c60da098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.238075 24656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0eaf0a51afd41ee8b06d2f3c60da098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.239482 24655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d42119e7b9b546fb8742111dc9fc01c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.241008 24653 tablet_service.cc:1511] Processing CreateTablet for tablet 67f0d862a4be40d68fdcfe809b66c897 (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:12.242081 24506 tablet_service.cc:1511] Processing CreateTablet for tablet d42119e7b9b546fb8742111dc9fc01c4 (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:12.242872 24653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67f0d862a4be40d68fdcfe809b66c897. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.243597 24506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d42119e7b9b546fb8742111dc9fc01c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.244406 24658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a51ff652d2a24a81a51cdd8d20e1fd25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.247330 24652 tablet_service.cc:1511] Processing CreateTablet for tablet 97bd80b3c6af4dd0b6a6933cdc6dc892 (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:12.249203 24652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97bd80b3c6af4dd0b6a6933cdc6dc892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.252405 24651 tablet_service.cc:1511] Processing CreateTablet for tablet 9491028dda7d4ca09d41395fa0996fdc (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:12.254163 24651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9491028dda7d4ca09d41395fa0996fdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.254456 24505 tablet_service.cc:1511] Processing CreateTablet for tablet f8d01567151542098a0cc1638736f603 (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:12.256618 24505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8d01567151542098a0cc1638736f603. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.272147 24504 tablet_service.cc:1511] Processing CreateTablet for tablet 67f0d862a4be40d68fdcfe809b66c897 (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:12.273897 24504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67f0d862a4be40d68fdcfe809b66c897. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.296247 24509 tablet_service.cc:1511] Processing CreateTablet for tablet 97bd80b3c6af4dd0b6a6933cdc6dc892 (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:12.298308 24509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97bd80b3c6af4dd0b6a6933cdc6dc892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.308933 24510 tablet_service.cc:1511] Processing CreateTablet for tablet 9491028dda7d4ca09d41395fa0996fdc (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:12.310520 24510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9491028dda7d4ca09d41395fa0996fdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.319849 24585 tablet_service.cc:1511] Processing CreateTablet for tablet 5587c38c35e6480e9f60445cfba5c6d6 (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:12.321394 24585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5587c38c35e6480e9f60445cfba5c6d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.322691 24709 tablet_bootstrap.cc:492] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8: Bootstrap starting.
I20260709 13:08:12.331647 24709 tablet_bootstrap.cc:654] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.335443 24584 tablet_service.cc:1511] Processing CreateTablet for tablet a51ff652d2a24a81a51cdd8d20e1fd25 (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:12.336977 24584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a51ff652d2a24a81a51cdd8d20e1fd25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.344864 24710 tablet_bootstrap.cc:492] T f3281cd03afa4f269851daf856bcc0ec P 48f59673e33a4636acca78951e868651: Bootstrap starting.
I20260709 13:08:12.345619 24583 tablet_service.cc:1511] Processing CreateTablet for tablet f3281cd03afa4f269851daf856bcc0ec (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:12.345986 24582 tablet_service.cc:1511] Processing CreateTablet for tablet a0eaf0a51afd41ee8b06d2f3c60da098 (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:12.347075 24583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3281cd03afa4f269851daf856bcc0ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.348842 24582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0eaf0a51afd41ee8b06d2f3c60da098. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.353179 24710 tablet_bootstrap.cc:654] T f3281cd03afa4f269851daf856bcc0ec P 48f59673e33a4636acca78951e868651: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.358649 24579 tablet_service.cc:1511] Processing CreateTablet for tablet 67f0d862a4be40d68fdcfe809b66c897 (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:12.360139 24579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67f0d862a4be40d68fdcfe809b66c897. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.356249 24581 tablet_service.cc:1511] Processing CreateTablet for tablet d42119e7b9b546fb8742111dc9fc01c4 (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:12.363713 24581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d42119e7b9b546fb8742111dc9fc01c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.363464 24580 tablet_service.cc:1511] Processing CreateTablet for tablet f8d01567151542098a0cc1638736f603 (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:12.365033 24580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8d01567151542098a0cc1638736f603. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.366792 24578 tablet_service.cc:1511] Processing CreateTablet for tablet 97bd80b3c6af4dd0b6a6933cdc6dc892 (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:12.368355 24578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97bd80b3c6af4dd0b6a6933cdc6dc892. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.370857 24577 tablet_service.cc:1511] Processing CreateTablet for tablet 9491028dda7d4ca09d41395fa0996fdc (DEFAULT_TABLE table=test-workload [id=63aa62bd38bb4af6a3a1a094c1f0847c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:12.372318 24577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9491028dda7d4ca09d41395fa0996fdc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:12.407692 24709 tablet_bootstrap.cc:492] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8: No bootstrap required, opened a new log
I20260709 13:08:12.408320 24709 ts_tablet_manager.cc:1403] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8: Time spent bootstrapping tablet: real 0.086s	user 0.012s	sys 0.000s
I20260709 13:08:12.411878 24709 raft_consensus.cc:359] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.412721 24709 raft_consensus.cc:385] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.413045 24709 raft_consensus.cc:740] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.414286 24710 tablet_bootstrap.cc:492] T f3281cd03afa4f269851daf856bcc0ec P 48f59673e33a4636acca78951e868651: No bootstrap required, opened a new log
I20260709 13:08:12.414103 24709 consensus_queue.cc:260] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.422045 24710 ts_tablet_manager.cc:1403] T f3281cd03afa4f269851daf856bcc0ec P 48f59673e33a4636acca78951e868651: Time spent bootstrapping tablet: real 0.078s	user 0.029s	sys 0.024s
I20260709 13:08:12.425443 24710 raft_consensus.cc:359] T f3281cd03afa4f269851daf856bcc0ec P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.430477 24710 raft_consensus.cc:385] T f3281cd03afa4f269851daf856bcc0ec P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.430924 24710 raft_consensus.cc:740] T f3281cd03afa4f269851daf856bcc0ec P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48f59673e33a4636acca78951e868651, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.429132 24713 tablet_bootstrap.cc:492] T f3281cd03afa4f269851daf856bcc0ec P 26b8e896a2a74a22999486af393f83f8: Bootstrap starting.
I20260709 13:08:12.431912 24710 consensus_queue.cc:260] T f3281cd03afa4f269851daf856bcc0ec P 48f59673e33a4636acca78951e868651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.435156 24694 heartbeater.cc:499] Master 127.11.44.254:40303 was elected leader, sending a full tablet report...
I20260709 13:08:12.435786 24710 ts_tablet_manager.cc:1434] T f3281cd03afa4f269851daf856bcc0ec P 48f59673e33a4636acca78951e868651: Time spent starting tablet: real 0.013s	user 0.000s	sys 0.008s
I20260709 13:08:12.436975 24710 tablet_bootstrap.cc:492] T 5587c38c35e6480e9f60445cfba5c6d6 P 48f59673e33a4636acca78951e868651: Bootstrap starting.
I20260709 13:08:12.442075 24709 ts_tablet_manager.cc:1434] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8: Time spent starting tablet: real 0.033s	user 0.016s	sys 0.000s
I20260709 13:08:12.443004 24545 heartbeater.cc:499] Master 127.11.44.254:40303 was elected leader, sending a full tablet report...
I20260709 13:08:12.444435 24710 tablet_bootstrap.cc:654] T 5587c38c35e6480e9f60445cfba5c6d6 P 48f59673e33a4636acca78951e868651: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.446357 24709 tablet_bootstrap.cc:492] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8: Bootstrap starting.
I20260709 13:08:12.454766 24713 tablet_bootstrap.cc:654] T f3281cd03afa4f269851daf856bcc0ec P 26b8e896a2a74a22999486af393f83f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.457459 24710 tablet_bootstrap.cc:492] T 5587c38c35e6480e9f60445cfba5c6d6 P 48f59673e33a4636acca78951e868651: No bootstrap required, opened a new log
I20260709 13:08:12.458140 24710 ts_tablet_manager.cc:1403] T 5587c38c35e6480e9f60445cfba5c6d6 P 48f59673e33a4636acca78951e868651: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.010s
I20260709 13:08:12.459578 24709 tablet_bootstrap.cc:654] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.462183 24710 raft_consensus.cc:359] T 5587c38c35e6480e9f60445cfba5c6d6 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } }
I20260709 13:08:12.462949 24710 raft_consensus.cc:385] T 5587c38c35e6480e9f60445cfba5c6d6 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.464003 24710 raft_consensus.cc:740] T 5587c38c35e6480e9f60445cfba5c6d6 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48f59673e33a4636acca78951e868651, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.465404 24710 consensus_queue.cc:260] T 5587c38c35e6480e9f60445cfba5c6d6 P 48f59673e33a4636acca78951e868651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } }
I20260709 13:08:12.466464 24713 tablet_bootstrap.cc:492] T f3281cd03afa4f269851daf856bcc0ec P 26b8e896a2a74a22999486af393f83f8: No bootstrap required, opened a new log
I20260709 13:08:12.467103 24709 tablet_bootstrap.cc:492] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8: No bootstrap required, opened a new log
I20260709 13:08:12.467175 24713 ts_tablet_manager.cc:1403] T f3281cd03afa4f269851daf856bcc0ec P 26b8e896a2a74a22999486af393f83f8: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.004s
I20260709 13:08:12.467756 24709 ts_tablet_manager.cc:1403] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.000s
I20260709 13:08:12.468139 24710 ts_tablet_manager.cc:1434] T 5587c38c35e6480e9f60445cfba5c6d6 P 48f59673e33a4636acca78951e868651: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:08:12.469218 24710 tablet_bootstrap.cc:492] T d42119e7b9b546fb8742111dc9fc01c4 P 48f59673e33a4636acca78951e868651: Bootstrap starting.
I20260709 13:08:12.471061 24713 raft_consensus.cc:359] T f3281cd03afa4f269851daf856bcc0ec P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.471905 24713 raft_consensus.cc:385] T f3281cd03afa4f269851daf856bcc0ec P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.471625 24709 raft_consensus.cc:359] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } }
I20260709 13:08:12.472281 24713 raft_consensus.cc:740] T f3281cd03afa4f269851daf856bcc0ec P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.472524 24709 raft_consensus.cc:385] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.472946 24709 raft_consensus.cc:740] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.473534 24713 consensus_queue.cc:260] T f3281cd03afa4f269851daf856bcc0ec P 26b8e896a2a74a22999486af393f83f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.473933 24709 consensus_queue.cc:260] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } }
I20260709 13:08:12.476629 24709 ts_tablet_manager.cc:1434] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:08:12.476661 24710 tablet_bootstrap.cc:654] T d42119e7b9b546fb8742111dc9fc01c4 P 48f59673e33a4636acca78951e868651: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.477770 24709 tablet_bootstrap.cc:492] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8: Bootstrap starting.
I20260709 13:08:12.490662 24710 tablet_bootstrap.cc:492] T d42119e7b9b546fb8742111dc9fc01c4 P 48f59673e33a4636acca78951e868651: No bootstrap required, opened a new log
I20260709 13:08:12.484431 24709 tablet_bootstrap.cc:654] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.485705 24713 ts_tablet_manager.cc:1434] T f3281cd03afa4f269851daf856bcc0ec P 26b8e896a2a74a22999486af393f83f8: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 13:08:12.491863 24710 ts_tablet_manager.cc:1403] T d42119e7b9b546fb8742111dc9fc01c4 P 48f59673e33a4636acca78951e868651: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.000s
I20260709 13:08:12.492635 24713 tablet_bootstrap.cc:492] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8: Bootstrap starting.
I20260709 13:08:12.484967 24620 heartbeater.cc:499] Master 127.11.44.254:40303 was elected leader, sending a full tablet report...
I20260709 13:08:12.494992 24710 raft_consensus.cc:359] T d42119e7b9b546fb8742111dc9fc01c4 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.495872 24710 raft_consensus.cc:385] T d42119e7b9b546fb8742111dc9fc01c4 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.496212 24710 raft_consensus.cc:740] T d42119e7b9b546fb8742111dc9fc01c4 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48f59673e33a4636acca78951e868651, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.497077 24710 consensus_queue.cc:260] T d42119e7b9b546fb8742111dc9fc01c4 P 48f59673e33a4636acca78951e868651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.499778 24710 ts_tablet_manager.cc:1434] T d42119e7b9b546fb8742111dc9fc01c4 P 48f59673e33a4636acca78951e868651: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:08:12.500170 24713 tablet_bootstrap.cc:654] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.500947 24710 tablet_bootstrap.cc:492] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651: Bootstrap starting.
I20260709 13:08:12.510658 24710 tablet_bootstrap.cc:654] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.537151 24709 tablet_bootstrap.cc:492] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8: No bootstrap required, opened a new log
I20260709 13:08:12.537732 24709 ts_tablet_manager.cc:1403] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8: Time spent bootstrapping tablet: real 0.060s	user 0.032s	sys 0.016s
I20260709 13:08:12.541594 24709 raft_consensus.cc:359] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.542351 24709 raft_consensus.cc:385] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.542640 24709 raft_consensus.cc:740] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.543083 24713 tablet_bootstrap.cc:492] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8: No bootstrap required, opened a new log
I20260709 13:08:12.543705 24713 ts_tablet_manager.cc:1403] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.001s
I20260709 13:08:12.543537 24709 consensus_queue.cc:260] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.544210 24710 tablet_bootstrap.cc:492] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651: No bootstrap required, opened a new log
I20260709 13:08:12.544813 24710 ts_tablet_manager.cc:1403] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.008s
I20260709 13:08:12.546886 24713 raft_consensus.cc:359] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } }
I20260709 13:08:12.547734 24713 raft_consensus.cc:385] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.547937 24709 ts_tablet_manager.cc:1434] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:08:12.548050 24713 raft_consensus.cc:740] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.547974 24710 raft_consensus.cc:359] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.549284 24709 tablet_bootstrap.cc:492] T 9491028dda7d4ca09d41395fa0996fdc P c3378e831c4f417a81e4cd63bde179a8: Bootstrap starting.
I20260709 13:08:12.549254 24710 raft_consensus.cc:385] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.550112 24710 raft_consensus.cc:740] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48f59673e33a4636acca78951e868651, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.549394 24713 consensus_queue.cc:260] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } }
I20260709 13:08:12.551034 24710 consensus_queue.cc:260] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.552207 24713 ts_tablet_manager.cc:1434] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.003s
I20260709 13:08:12.553254 24710 ts_tablet_manager.cc:1434] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:12.553318 24713 tablet_bootstrap.cc:492] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8: Bootstrap starting.
I20260709 13:08:12.560810 24713 tablet_bootstrap.cc:654] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.563858 24709 tablet_bootstrap.cc:654] T 9491028dda7d4ca09d41395fa0996fdc P c3378e831c4f417a81e4cd63bde179a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.566011 24710 tablet_bootstrap.cc:492] T a51ff652d2a24a81a51cdd8d20e1fd25 P 48f59673e33a4636acca78951e868651: Bootstrap starting.
I20260709 13:08:12.571705 24715 raft_consensus.cc:493] T d42119e7b9b546fb8742111dc9fc01c4 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.572335 24715 raft_consensus.cc:515] T d42119e7b9b546fb8742111dc9fc01c4 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.573539 24710 tablet_bootstrap.cc:654] T a51ff652d2a24a81a51cdd8d20e1fd25 P 48f59673e33a4636acca78951e868651: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.575096 24715 leader_election.cc:290] T d42119e7b9b546fb8742111dc9fc01c4 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553)
I20260709 13:08:12.576930 24713 tablet_bootstrap.cc:492] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8: No bootstrap required, opened a new log
I20260709 13:08:12.577557 24713 ts_tablet_manager.cc:1403] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.007s
I20260709 13:08:12.581856 24713 raft_consensus.cc:359] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.582964 24713 raft_consensus.cc:385] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.583400 24713 raft_consensus.cc:740] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.585628 24713 consensus_queue.cc:260] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
W20260709 13:08:12.588616 24695 tablet.cc:2406] T 5587c38c35e6480e9f60445cfba5c6d6 P 48f59673e33a4636acca78951e868651: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:08:12.588660 24713 ts_tablet_manager.cc:1434] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 13:08:12.592166 24713 tablet_bootstrap.cc:492] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8: Bootstrap starting.
I20260709 13:08:12.593210 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d42119e7b9b546fb8742111dc9fc01c4" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8" is_pre_election: true
I20260709 13:08:12.595005 24709 tablet_bootstrap.cc:492] T 9491028dda7d4ca09d41395fa0996fdc P c3378e831c4f417a81e4cd63bde179a8: No bootstrap required, opened a new log
W20260709 13:08:12.595036 24634 leader_election.cc:343] T d42119e7b9b546fb8742111dc9fc01c4 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:12.595791 24709 ts_tablet_manager.cc:1403] T 9491028dda7d4ca09d41395fa0996fdc P c3378e831c4f417a81e4cd63bde179a8: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.000s
I20260709 13:08:12.598773 24713 tablet_bootstrap.cc:654] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.600945 24709 raft_consensus.cc:359] T 9491028dda7d4ca09d41395fa0996fdc P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.601886 24709 raft_consensus.cc:385] T 9491028dda7d4ca09d41395fa0996fdc P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.602245 24709 raft_consensus.cc:740] T 9491028dda7d4ca09d41395fa0996fdc P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.602276 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d42119e7b9b546fb8742111dc9fc01c4" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8" is_pre_election: true
I20260709 13:08:12.603231 24709 consensus_queue.cc:260] T 9491028dda7d4ca09d41395fa0996fdc P c3378e831c4f417a81e4cd63bde179a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
W20260709 13:08:12.604470 24634 leader_election.cc:343] T d42119e7b9b546fb8742111dc9fc01c4 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:12.605036 24634 leader_election.cc:304] T d42119e7b9b546fb8742111dc9fc01c4 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48f59673e33a4636acca78951e868651; no voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8
I20260709 13:08:12.606029 24709 ts_tablet_manager.cc:1434] T 9491028dda7d4ca09d41395fa0996fdc P c3378e831c4f417a81e4cd63bde179a8: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 13:08:12.606456 24715 raft_consensus.cc:2749] T d42119e7b9b546fb8742111dc9fc01c4 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:12.609961 24709 tablet_bootstrap.cc:492] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8: Bootstrap starting.
I20260709 13:08:12.610018 24710 tablet_bootstrap.cc:492] T a51ff652d2a24a81a51cdd8d20e1fd25 P 48f59673e33a4636acca78951e868651: No bootstrap required, opened a new log
I20260709 13:08:12.610807 24710 ts_tablet_manager.cc:1403] T a51ff652d2a24a81a51cdd8d20e1fd25 P 48f59673e33a4636acca78951e868651: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.007s
I20260709 13:08:12.614928 24710 raft_consensus.cc:359] T a51ff652d2a24a81a51cdd8d20e1fd25 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.615756 24710 raft_consensus.cc:385] T a51ff652d2a24a81a51cdd8d20e1fd25 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.616060 24710 raft_consensus.cc:740] T a51ff652d2a24a81a51cdd8d20e1fd25 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48f59673e33a4636acca78951e868651, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.616892 24710 consensus_queue.cc:260] T a51ff652d2a24a81a51cdd8d20e1fd25 P 48f59673e33a4636acca78951e868651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.617625 24709 tablet_bootstrap.cc:654] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.617475 24713 tablet_bootstrap.cc:492] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8: No bootstrap required, opened a new log
I20260709 13:08:12.618606 24713 ts_tablet_manager.cc:1403] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.004s
I20260709 13:08:12.622748 24710 ts_tablet_manager.cc:1434] T a51ff652d2a24a81a51cdd8d20e1fd25 P 48f59673e33a4636acca78951e868651: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 13:08:12.622192 24713 raft_consensus.cc:359] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.624023 24713 raft_consensus.cc:385] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.624642 24713 raft_consensus.cc:740] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.625056 24710 tablet_bootstrap.cc:492] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651: Bootstrap starting.
I20260709 13:08:12.625655 24713 consensus_queue.cc:260] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.628319 24713 ts_tablet_manager.cc:1434] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:08:12.626595 24709 tablet_bootstrap.cc:492] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8: No bootstrap required, opened a new log
I20260709 13:08:12.629649 24713 tablet_bootstrap.cc:492] T a0eaf0a51afd41ee8b06d2f3c60da098 P 26b8e896a2a74a22999486af393f83f8: Bootstrap starting.
I20260709 13:08:12.630051 24709 ts_tablet_manager.cc:1403] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 13:08:12.632232 24710 tablet_bootstrap.cc:654] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.633553 24709 raft_consensus.cc:359] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.634938 24709 raft_consensus.cc:385] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.635288 24709 raft_consensus.cc:740] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.636193 24709 consensus_queue.cc:260] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.638499 24713 tablet_bootstrap.cc:654] T a0eaf0a51afd41ee8b06d2f3c60da098 P 26b8e896a2a74a22999486af393f83f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.638927 24709 ts_tablet_manager.cc:1434] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:08:12.640230 24709 tablet_bootstrap.cc:492] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8: Bootstrap starting.
I20260709 13:08:12.644023 24710 tablet_bootstrap.cc:492] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651: No bootstrap required, opened a new log
I20260709 13:08:12.644655 24710 ts_tablet_manager.cc:1403] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651: Time spent bootstrapping tablet: real 0.020s	user 0.006s	sys 0.012s
I20260709 13:08:12.648013 24710 raft_consensus.cc:359] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.649013 24710 raft_consensus.cc:385] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.649529 24710 raft_consensus.cc:740] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48f59673e33a4636acca78951e868651, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.649863 24709 tablet_bootstrap.cc:654] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.650561 24710 consensus_queue.cc:260] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.654865 24710 ts_tablet_manager.cc:1434] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:08:12.656092 24710 tablet_bootstrap.cc:492] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 48f59673e33a4636acca78951e868651: Bootstrap starting.
W20260709 13:08:12.659958 24466 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:12.661779 24713 tablet_bootstrap.cc:492] T a0eaf0a51afd41ee8b06d2f3c60da098 P 26b8e896a2a74a22999486af393f83f8: No bootstrap required, opened a new log
I20260709 13:08:12.662642 24713 ts_tablet_manager.cc:1403] T a0eaf0a51afd41ee8b06d2f3c60da098 P 26b8e896a2a74a22999486af393f83f8: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.010s
I20260709 13:08:12.665838 24710 tablet_bootstrap.cc:654] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 48f59673e33a4636acca78951e868651: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.666453 24713 raft_consensus.cc:359] T a0eaf0a51afd41ee8b06d2f3c60da098 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.667218 24713 raft_consensus.cc:385] T a0eaf0a51afd41ee8b06d2f3c60da098 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.667531 24713 raft_consensus.cc:740] T a0eaf0a51afd41ee8b06d2f3c60da098 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.667920 24709 tablet_bootstrap.cc:492] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8: No bootstrap required, opened a new log
I20260709 13:08:12.668450 24709 ts_tablet_manager.cc:1403] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.007s
I20260709 13:08:12.668316 24713 consensus_queue.cc:260] T a0eaf0a51afd41ee8b06d2f3c60da098 P 26b8e896a2a74a22999486af393f83f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.670804 24713 ts_tablet_manager.cc:1434] T a0eaf0a51afd41ee8b06d2f3c60da098 P 26b8e896a2a74a22999486af393f83f8: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:08:12.671905 24713 tablet_bootstrap.cc:492] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8: Bootstrap starting.
I20260709 13:08:12.671465 24709 raft_consensus.cc:359] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.673295 24709 raft_consensus.cc:385] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.673720 24709 raft_consensus.cc:740] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.674875 24710 tablet_bootstrap.cc:492] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 48f59673e33a4636acca78951e868651: No bootstrap required, opened a new log
I20260709 13:08:12.674527 24709 consensus_queue.cc:260] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.675500 24710 ts_tablet_manager.cc:1403] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 48f59673e33a4636acca78951e868651: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.003s
I20260709 13:08:12.677192 24709 ts_tablet_manager.cc:1434] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:08:12.678386 24709 tablet_bootstrap.cc:492] T d42119e7b9b546fb8742111dc9fc01c4 P c3378e831c4f417a81e4cd63bde179a8: Bootstrap starting.
I20260709 13:08:12.679168 24713 tablet_bootstrap.cc:654] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.679013 24710 raft_consensus.cc:359] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.680567 24714 raft_consensus.cc:493] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.680936 24710 raft_consensus.cc:385] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.681149 24714 raft_consensus.cc:515] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.681991 24710 raft_consensus.cc:740] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48f59673e33a4636acca78951e868651, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.683069 24710 consensus_queue.cc:260] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 48f59673e33a4636acca78951e868651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.688278 24710 ts_tablet_manager.cc:1434] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 48f59673e33a4636acca78951e868651: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 13:08:12.688427 24709 tablet_bootstrap.cc:654] T d42119e7b9b546fb8742111dc9fc01c4 P c3378e831c4f417a81e4cd63bde179a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.689513 24710 tablet_bootstrap.cc:492] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651: Bootstrap starting.
I20260709 13:08:12.697345 24710 tablet_bootstrap.cc:654] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.701891 24709 tablet_bootstrap.cc:492] T d42119e7b9b546fb8742111dc9fc01c4 P c3378e831c4f417a81e4cd63bde179a8: No bootstrap required, opened a new log
I20260709 13:08:12.702682 24709 ts_tablet_manager.cc:1403] T d42119e7b9b546fb8742111dc9fc01c4 P c3378e831c4f417a81e4cd63bde179a8: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.008s
I20260709 13:08:12.706446 24709 raft_consensus.cc:359] T d42119e7b9b546fb8742111dc9fc01c4 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.707737 24709 raft_consensus.cc:385] T d42119e7b9b546fb8742111dc9fc01c4 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.708194 24709 raft_consensus.cc:740] T d42119e7b9b546fb8742111dc9fc01c4 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.709349 24709 consensus_queue.cc:260] T d42119e7b9b546fb8742111dc9fc01c4 P c3378e831c4f417a81e4cd63bde179a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.710065 24719 raft_consensus.cc:493] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.710834 24719 raft_consensus.cc:515] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } }
I20260709 13:08:12.716588 24715 raft_consensus.cc:493] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.717352 24715 raft_consensus.cc:515] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.718626 24714 leader_election.cc:290] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:12.719549 24715 leader_election.cc:290] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553)
I20260709 13:08:12.722095 24709 ts_tablet_manager.cc:1434] T d42119e7b9b546fb8742111dc9fc01c4 P c3378e831c4f417a81e4cd63bde179a8: Time spent starting tablet: real 0.019s	user 0.015s	sys 0.000s
I20260709 13:08:12.722471 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eaf0a51afd41ee8b06d2f3c60da098" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8" is_pre_election: true
I20260709 13:08:12.723133 24595 raft_consensus.cc:2468] T a0eaf0a51afd41ee8b06d2f3c60da098 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 0.
I20260709 13:08:12.723353 24709 tablet_bootstrap.cc:492] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8: Bootstrap starting.
I20260709 13:08:12.728963 24719 leader_election.cc:290] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:12.732285 24709 tablet_bootstrap.cc:654] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.732787 24710 tablet_bootstrap.cc:492] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651: No bootstrap required, opened a new log
I20260709 13:08:12.733594 24710 ts_tablet_manager.cc:1403] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.007s
I20260709 13:08:12.740101 24719 raft_consensus.cc:493] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.740881 24719 raft_consensus.cc:515] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.768460 24634 leader_election.cc:304] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, 48f59673e33a4636acca78951e868651; no voters: 
I20260709 13:08:12.769649 24715 raft_consensus.cc:2804] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:12.770087 24715 raft_consensus.cc:493] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.770459 24715 raft_consensus.cc:3060] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:12.737238 24710 raft_consensus.cc:359] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.772544 24710 raft_consensus.cc:385] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.772939 24710 raft_consensus.cc:740] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48f59673e33a4636acca78951e868651, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.773999 24710 consensus_queue.cc:260] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.779047 24719 leader_election.cc:290] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:12.780428 24710 ts_tablet_manager.cc:1434] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.002s
I20260709 13:08:12.781416 24710 tablet_bootstrap.cc:492] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651: Bootstrap starting.
I20260709 13:08:12.780270 24713 tablet_bootstrap.cc:492] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8: No bootstrap required, opened a new log
I20260709 13:08:12.782713 24713 ts_tablet_manager.cc:1403] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8: Time spent bootstrapping tablet: real 0.111s	user 0.043s	sys 0.031s
I20260709 13:08:12.783245 24715 raft_consensus.cc:515] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.784842 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3281cd03afa4f269851daf856bcc0ec" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8" is_pre_election: true
I20260709 13:08:12.785625 24595 raft_consensus.cc:2468] T f3281cd03afa4f269851daf856bcc0ec P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 0.
I20260709 13:08:12.787633 24485 leader_election.cc:304] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:12.788245 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eaf0a51afd41ee8b06d2f3c60da098" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8" is_pre_election: true
I20260709 13:08:12.788606 24739 raft_consensus.cc:2804] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:12.789032 24520 raft_consensus.cc:2468] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 0.
I20260709 13:08:12.789270 24710 tablet_bootstrap.cc:654] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.788529 24709 tablet_bootstrap.cc:492] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8: No bootstrap required, opened a new log
I20260709 13:08:12.789109 24739 raft_consensus.cc:493] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.790113 24739 raft_consensus.cc:3060] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:12.790241 24709 ts_tablet_manager.cc:1403] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.023s
I20260709 13:08:12.792623 24744 raft_consensus.cc:493] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.793131 24744 raft_consensus.cc:515] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.793751 24709 raft_consensus.cc:359] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.794410 24709 raft_consensus.cc:385] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.794656 24709 raft_consensus.cc:740] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.795351 24744 leader_election.cc:290] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553)
I20260709 13:08:12.795460 24709 consensus_queue.cc:260] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.785808 24713 raft_consensus.cc:359] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.798085 24713 raft_consensus.cc:385] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.797914 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eaf0a51afd41ee8b06d2f3c60da098" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8"
I20260709 13:08:12.798676 24595 raft_consensus.cc:3060] T a0eaf0a51afd41ee8b06d2f3c60da098 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:12.800208 24709 ts_tablet_manager.cc:1434] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:08:12.800343 24739 raft_consensus.cc:515] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.801322 24709 tablet_bootstrap.cc:492] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8: Bootstrap starting.
I20260709 13:08:12.802846 24739 leader_election.cc:290] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 election: Requested vote from peers 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:12.785581 24715 leader_election.cc:290] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 election: Requested vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553)
I20260709 13:08:12.804792 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3281cd03afa4f269851daf856bcc0ec" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8"
I20260709 13:08:12.804826 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eaf0a51afd41ee8b06d2f3c60da098" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
I20260709 13:08:12.805640 24594 raft_consensus.cc:3060] T f3281cd03afa4f269851daf856bcc0ec P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:12.806103 24520 raft_consensus.cc:3060] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:12.806551 24595 raft_consensus.cc:2468] T a0eaf0a51afd41ee8b06d2f3c60da098 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 1.
I20260709 13:08:12.808374 24713 raft_consensus.cc:740] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.810770 24713 consensus_queue.cc:260] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.813253 24709 tablet_bootstrap.cc:654] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:12.817086 24520 raft_consensus.cc:2468] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 1.
I20260709 13:08:12.821208 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491028dda7d4ca09d41395fa0996fdc" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8" is_pre_election: true
I20260709 13:08:12.819716 24634 leader_election.cc:304] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, 48f59673e33a4636acca78951e868651; no voters: 
I20260709 13:08:12.821434 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491028dda7d4ca09d41395fa0996fdc" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8" is_pre_election: true
I20260709 13:08:12.822038 24519 raft_consensus.cc:2468] T 9491028dda7d4ca09d41395fa0996fdc P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 0.
I20260709 13:08:12.822252 24595 raft_consensus.cc:2468] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 0.
I20260709 13:08:12.823037 24745 raft_consensus.cc:2804] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:12.823633 24745 raft_consensus.cc:697] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Becoming Leader. State: Replica: 48f59673e33a4636acca78951e868651, State: Running, Role: LEADER
I20260709 13:08:12.825966 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491028dda7d4ca09d41395fa0996fdc" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8" is_pre_election: true
I20260709 13:08:12.826956 24518 raft_consensus.cc:2468] T 9491028dda7d4ca09d41395fa0996fdc P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 0.
I20260709 13:08:12.825984 24634 leader_election.cc:304] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, 48f59673e33a4636acca78951e868651; no voters: 
I20260709 13:08:12.828388 24560 leader_election.cc:304] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:12.829310 24719 raft_consensus.cc:2804] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:12.824563 24745 consensus_queue.cc:237] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.829870 24719 raft_consensus.cc:493] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.830338 24719 raft_consensus.cc:3060] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:12.830569 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5587c38c35e6480e9f60445cfba5c6d6" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8" is_pre_election: true
I20260709 13:08:12.831013 24594 raft_consensus.cc:2468] T f3281cd03afa4f269851daf856bcc0ec P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 1.
I20260709 13:08:12.831275 24519 raft_consensus.cc:2468] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 0.
I20260709 13:08:12.832309 24713 ts_tablet_manager.cc:1434] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 13:08:12.832787 24560 leader_election.cc:304] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:12.833019 24715 raft_consensus.cc:2804] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:12.833400 24715 raft_consensus.cc:493] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.833814 24715 raft_consensus.cc:3060] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:12.837976 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3281cd03afa4f269851daf856bcc0ec" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:12.838783 24668 raft_consensus.cc:3060] T f3281cd03afa4f269851daf856bcc0ec P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:12.839244 24710 tablet_bootstrap.cc:492] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651: No bootstrap required, opened a new log
I20260709 13:08:12.839558 24739 raft_consensus.cc:493] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.839782 24710 ts_tablet_manager.cc:1403] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651: Time spent bootstrapping tablet: real 0.059s	user 0.013s	sys 0.002s
I20260709 13:08:12.840157 24739 raft_consensus.cc:515] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.842087 24744 raft_consensus.cc:493] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.842757 24744 raft_consensus.cc:515] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.847420 24713 tablet_bootstrap.cc:492] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8: Bootstrap starting.
I20260709 13:08:12.847121 24710 raft_consensus.cc:359] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.847886 24710 raft_consensus.cc:385] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.847919 24739 leader_election.cc:290] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:12.837541 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3281cd03afa4f269851daf856bcc0ec" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651" is_pre_election: true
I20260709 13:08:12.848899 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51ff652d2a24a81a51cdd8d20e1fd25" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651" is_pre_election: true
I20260709 13:08:12.851071 24667 raft_consensus.cc:2468] T a51ff652d2a24a81a51cdd8d20e1fd25 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 0.
I20260709 13:08:12.833971 24485 leader_election.cc:304] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:12.852756 24483 leader_election.cc:304] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48f59673e33a4636acca78951e868651, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:12.853281 24710 raft_consensus.cc:740] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48f59673e33a4636acca78951e868651, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.853797 24714 raft_consensus.cc:2804] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:12.854131 24710 consensus_queue.cc:260] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.854836 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51ff652d2a24a81a51cdd8d20e1fd25" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8" is_pre_election: true
I20260709 13:08:12.855758 24744 leader_election.cc:290] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553)
W20260709 13:08:12.857472 24485 leader_election.cc:343] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:12.858502 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0d862a4be40d68fdcfe809b66c897" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8" is_pre_election: true
W20260709 13:08:12.866120 24634 leader_election.cc:343] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:12.866724 24739 raft_consensus.cc:2804] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:12.867404 24739 raft_consensus.cc:493] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.871888 24739 raft_consensus.cc:3060] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:12.876864 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491028dda7d4ca09d41395fa0996fdc" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651" is_pre_election: true
I20260709 13:08:12.876981 24719 raft_consensus.cc:515] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.877924 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5587c38c35e6480e9f60445cfba5c6d6" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651" is_pre_election: true
I20260709 13:08:12.878716 24667 raft_consensus.cc:2468] T 5587c38c35e6480e9f60445cfba5c6d6 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 0.
I20260709 13:08:12.880142 24719 leader_election.cc:290] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 election: Requested vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:12.881036 24719 raft_consensus.cc:2804] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:12.871119 24668 raft_consensus.cc:2468] T f3281cd03afa4f269851daf856bcc0ec P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 1.
I20260709 13:08:12.881309 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491028dda7d4ca09d41395fa0996fdc" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:12.891222 24719 raft_consensus.cc:493] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.886464 24752 raft_consensus.cc:493] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.887624 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0d862a4be40d68fdcfe809b66c897" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8" is_pre_election: true
I20260709 13:08:12.893548 24719 raft_consensus.cc:3060] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:12.889159 24560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.193:35831, user_credentials={real_user=slave}} blocked reactor thread for 56471.6us
I20260709 13:08:12.867749 24715 raft_consensus.cc:515] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.894407 24713 tablet_bootstrap.cc:654] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:12.894567 24634 leader_election.cc:343] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:12.895152 24634 leader_election.cc:304] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48f59673e33a4636acca78951e868651; no voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8
I20260709 13:08:12.896377 24715 leader_election.cc:290] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 election: Requested vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553)
I20260709 13:08:12.896986 24715 raft_consensus.cc:2749] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:12.897272 24669 raft_consensus.cc:2393] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26b8e896a2a74a22999486af393f83f8 in current term 1: Already voted for candidate 48f59673e33a4636acca78951e868651 in this term.
I20260709 13:08:12.892041 24710 ts_tablet_manager.cc:1434] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651: Time spent starting tablet: real 0.052s	user 0.010s	sys 0.007s
I20260709 13:08:12.901713 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491028dda7d4ca09d41395fa0996fdc" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
I20260709 13:08:12.902552 24519 raft_consensus.cc:3060] T 9491028dda7d4ca09d41395fa0996fdc P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:12.904037 24719 raft_consensus.cc:515] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } }
I20260709 13:08:12.881124 24739 raft_consensus.cc:515] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.893150 24709 tablet_bootstrap.cc:492] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8: No bootstrap required, opened a new log
I20260709 13:08:12.906625 24709 ts_tablet_manager.cc:1403] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8: Time spent bootstrapping tablet: real 0.106s	user 0.017s	sys 0.008s
I20260709 13:08:12.907349 24752 raft_consensus.cc:515] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.909776 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491028dda7d4ca09d41395fa0996fdc" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8"
I20260709 13:08:12.910086 24709 raft_consensus.cc:359] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.910897 24709 raft_consensus.cc:385] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.910980 24594 raft_consensus.cc:2393] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 48f59673e33a4636acca78951e868651 in current term 1: Already voted for candidate 26b8e896a2a74a22999486af393f83f8 in this term.
I20260709 13:08:12.911242 24709 raft_consensus.cc:740] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Initialized, Role: FOLLOWER
I20260709 13:08:12.911444 24739 leader_election.cc:290] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 election: Requested vote from peers 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:12.912184 24709 consensus_queue.cc:260] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.917459 24709 ts_tablet_manager.cc:1434] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 13:08:12.918129 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9491028dda7d4ca09d41395fa0996fdc" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
I20260709 13:08:12.918573 24719 leader_election.cc:290] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 election: Requested vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:12.919612 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5587c38c35e6480e9f60445cfba5c6d6" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
I20260709 13:08:12.920603 24520 raft_consensus.cc:3060] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:12.922099 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d42119e7b9b546fb8742111dc9fc01c4" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8" is_pre_election: true
I20260709 13:08:12.923195 24517 raft_consensus.cc:2468] T d42119e7b9b546fb8742111dc9fc01c4 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 0.
I20260709 13:08:12.924996 24519 raft_consensus.cc:2468] T 9491028dda7d4ca09d41395fa0996fdc P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 1.
I20260709 13:08:12.906684 24714 raft_consensus.cc:697] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Becoming Leader. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Running, Role: LEADER
I20260709 13:08:12.930193 24752 leader_election.cc:290] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:12.931188 24714 consensus_queue.cc:237] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.931701 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51ff652d2a24a81a51cdd8d20e1fd25" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8"
I20260709 13:08:12.938235 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51ff652d2a24a81a51cdd8d20e1fd25" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:12.940330 24669 raft_consensus.cc:3060] T a51ff652d2a24a81a51cdd8d20e1fd25 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:08:12.940618 24485 leader_election.cc:343] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:12.938975 24560 leader_election.cc:304] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8; no voters: 48f59673e33a4636acca78951e868651, c3378e831c4f417a81e4cd63bde179a8
I20260709 13:08:12.939121 24634 leader_election.cc:304] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48f59673e33a4636acca78951e868651, c3378e831c4f417a81e4cd63bde179a8; no voters: 26b8e896a2a74a22999486af393f83f8
I20260709 13:08:12.943282 24560 leader_election.cc:304] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:12.944116 24719 raft_consensus.cc:2749] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:12.944278 24739 raft_consensus.cc:493] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.944675 24750 raft_consensus.cc:2804] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:12.945538 24750 raft_consensus.cc:697] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Becoming Leader. State: Replica: 48f59673e33a4636acca78951e868651, State: Running, Role: LEADER
I20260709 13:08:12.946754 24750 consensus_queue.cc:237] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.945539 24739 raft_consensus.cc:515] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.949076 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5587c38c35e6480e9f60445cfba5c6d6" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:12.949966 24667 raft_consensus.cc:3060] T 5587c38c35e6480e9f60445cfba5c6d6 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:12.950431 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d42119e7b9b546fb8742111dc9fc01c4" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651" is_pre_election: true
I20260709 13:08:12.950652 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97bd80b3c6af4dd0b6a6933cdc6dc892" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8" is_pre_election: true
I20260709 13:08:12.951337 24668 raft_consensus.cc:2468] T d42119e7b9b546fb8742111dc9fc01c4 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 0.
W20260709 13:08:12.952431 24485 leader_election.cc:343] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:12.947319 24415 catalog_manager.cc:5697] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48f59673e33a4636acca78951e868651 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "48f59673e33a4636acca78951e868651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.944689 24752 raft_consensus.cc:2804] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:12.957502 24752 raft_consensus.cc:493] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.955907 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97bd80b3c6af4dd0b6a6933cdc6dc892" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651" is_pre_election: true
I20260709 13:08:12.958388 24667 raft_consensus.cc:2468] T 5587c38c35e6480e9f60445cfba5c6d6 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 1.
I20260709 13:08:12.958590 24668 raft_consensus.cc:2468] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 0.
I20260709 13:08:12.949954 24669 raft_consensus.cc:2468] T a51ff652d2a24a81a51cdd8d20e1fd25 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 1.
I20260709 13:08:12.960727 24558 leader_election.cc:304] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, 48f59673e33a4636acca78951e868651; no voters: 
I20260709 13:08:12.960834 24483 leader_election.cc:304] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48f59673e33a4636acca78951e868651, c3378e831c4f417a81e4cd63bde179a8; no voters: 26b8e896a2a74a22999486af393f83f8
I20260709 13:08:12.961678 24719 raft_consensus.cc:2804] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:12.962311 24719 raft_consensus.cc:697] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [term 1 LEADER]: Becoming Leader. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Running, Role: LEADER
I20260709 13:08:12.962634 24749 raft_consensus.cc:2804] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:12.958122 24739 leader_election.cc:290] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:12.963433 24749 raft_consensus.cc:493] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.963292 24719 consensus_queue.cc:237] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } }
I20260709 13:08:12.964097 24749 raft_consensus.cc:3060] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:12.958189 24752 raft_consensus.cc:3060] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:12.980367 24520 raft_consensus.cc:2468] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 1.
I20260709 13:08:12.986227 24713 tablet_bootstrap.cc:492] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8: No bootstrap required, opened a new log
I20260709 13:08:12.987139 24713 ts_tablet_manager.cc:1403] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8: Time spent bootstrapping tablet: real 0.140s	user 0.040s	sys 0.056s
I20260709 13:08:12.980778 24483 leader_election.cc:304] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48f59673e33a4636acca78951e868651, c3378e831c4f417a81e4cd63bde179a8; no voters: 26b8e896a2a74a22999486af393f83f8
I20260709 13:08:12.992880 24739 raft_consensus.cc:2804] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:12.993784 24713 raft_consensus.cc:359] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.994719 24713 raft_consensus.cc:385] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:12.994445 24749 raft_consensus.cc:515] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:12.995085 24713 raft_consensus.cc:740] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.004771 24739 raft_consensus.cc:697] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Becoming Leader. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Running, Role: LEADER
I20260709 13:08:13.004940 24713 consensus_queue.cc:260] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.007284 24739 consensus_queue.cc:237] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.009037 24713 ts_tablet_manager.cc:1434] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.002s
I20260709 13:08:13.010011 24749 leader_election.cc:290] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 election: Requested vote from peers 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:13.010303 24713 tablet_bootstrap.cc:492] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8: Bootstrap starting.
I20260709 13:08:13.010774 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97bd80b3c6af4dd0b6a6933cdc6dc892" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8"
I20260709 13:08:13.011157 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97bd80b3c6af4dd0b6a6933cdc6dc892" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:13.011610 24749 raft_consensus.cc:493] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.011830 24667 raft_consensus.cc:3060] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.012310 24749 raft_consensus.cc:515] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.014640 24749 leader_election.cc:290] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:13.010982 24750 raft_consensus.cc:493] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.015452 24750 raft_consensus.cc:515] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.015830 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d01567151542098a0cc1638736f603" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651" is_pre_election: true
I20260709 13:08:13.016571 24668 raft_consensus.cc:2468] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 0.
I20260709 13:08:13.016924 24713 tablet_bootstrap.cc:654] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8: Neither blocks nor log segments found. Creating new log.
W20260709 13:08:13.017843 24485 leader_election.cc:343] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:13.018602 24483 leader_election.cc:304] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48f59673e33a4636acca78951e868651, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:13.018797 24750 leader_election.cc:290] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553)
I20260709 13:08:13.018814 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d01567151542098a0cc1638736f603" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8" is_pre_election: true
I20260709 13:08:13.020783 24749 raft_consensus.cc:2804] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:13.026064 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d01567151542098a0cc1638736f603" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8" is_pre_election: true
I20260709 13:08:13.027175 24594 raft_consensus.cc:2468] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 0.
I20260709 13:08:13.026216 24749 raft_consensus.cc:493] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.028877 24749 raft_consensus.cc:3060] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.031019 24667 raft_consensus.cc:2468] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 1.
I20260709 13:08:13.032317 24483 leader_election.cc:304] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 48f59673e33a4636acca78951e868651, c3378e831c4f417a81e4cd63bde179a8; no voters: 26b8e896a2a74a22999486af393f83f8
I20260709 13:08:13.033167 24714 raft_consensus.cc:2804] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:13.033706 24714 raft_consensus.cc:697] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Becoming Leader. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Running, Role: LEADER
I20260709 13:08:13.032955 24416 catalog_manager.cc:5697] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "c3378e831c4f417a81e4cd63bde179a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.034660 24714 consensus_queue.cc:237] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.021653 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d01567151542098a0cc1638736f603" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8" is_pre_election: true
I20260709 13:08:13.036892 24595 raft_consensus.cc:2468] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 0.
I20260709 13:08:13.038056 24634 leader_election.cc:304] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, 48f59673e33a4636acca78951e868651; no voters: 
I20260709 13:08:13.039564 24750 raft_consensus.cc:2804] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:13.045397 24750 raft_consensus.cc:493] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.028203 24417 catalog_manager.cc:5697] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26b8e896a2a74a22999486af393f83f8 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "26b8e896a2a74a22999486af393f83f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:13.066684 24749 raft_consensus.cc:515] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.062593 24750 raft_consensus.cc:3060] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.068806 24520 raft_consensus.cc:2393] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 48f59673e33a4636acca78951e868651 in current term 1: Already voted for candidate c3378e831c4f417a81e4cd63bde179a8 in this term.
I20260709 13:08:13.072297 24749 leader_election.cc:290] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 election: Requested vote from peers 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:13.072539 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d01567151542098a0cc1638736f603" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8"
I20260709 13:08:13.073225 24595 raft_consensus.cc:3060] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.073452 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d01567151542098a0cc1638736f603" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:13.078182 24713 tablet_bootstrap.cc:492] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8: No bootstrap required, opened a new log
I20260709 13:08:13.078781 24713 ts_tablet_manager.cc:1403] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8: Time spent bootstrapping tablet: real 0.069s	user 0.031s	sys 0.016s
I20260709 13:08:13.079663 24750 raft_consensus.cc:515] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.081118 24595 raft_consensus.cc:2468] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 1.
I20260709 13:08:13.082170 24750 leader_election.cc:290] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 election: Requested vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553)
I20260709 13:08:13.082307 24485 leader_election.cc:304] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:13.084906 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d01567151542098a0cc1638736f603" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8"
I20260709 13:08:13.085161 24713 raft_consensus.cc:359] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.086051 24713 raft_consensus.cc:385] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.086320 24713 raft_consensus.cc:740] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.086627 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d01567151542098a0cc1638736f603" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
I20260709 13:08:13.086992 24713 consensus_queue.cc:260] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.087455 24520 raft_consensus.cc:2393] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 48f59673e33a4636acca78951e868651 in current term 1: Already voted for candidate c3378e831c4f417a81e4cd63bde179a8 in this term.
I20260709 13:08:13.087921 24667 raft_consensus.cc:2393] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c3378e831c4f417a81e4cd63bde179a8 in current term 1: Already voted for candidate 48f59673e33a4636acca78951e868651 in this term.
I20260709 13:08:13.085772 24594 raft_consensus.cc:2393] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 48f59673e33a4636acca78951e868651 in current term 1: Already voted for candidate c3378e831c4f417a81e4cd63bde179a8 in this term.
I20260709 13:08:13.089099 24713 ts_tablet_manager.cc:1434] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:08:13.089813 24739 raft_consensus.cc:2804] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:13.090114 24634 leader_election.cc:304] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 48f59673e33a4636acca78951e868651; no voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8
I20260709 13:08:13.090271 24713 tablet_bootstrap.cc:492] T a51ff652d2a24a81a51cdd8d20e1fd25 P 26b8e896a2a74a22999486af393f83f8: Bootstrap starting.
I20260709 13:08:13.090802 24750 raft_consensus.cc:2749] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:13.090901 24739 raft_consensus.cc:697] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Becoming Leader. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Running, Role: LEADER
I20260709 13:08:13.091949 24739 consensus_queue.cc:237] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.073513 24752 raft_consensus.cc:515] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.098325 24713 tablet_bootstrap.cc:654] T a51ff652d2a24a81a51cdd8d20e1fd25 P 26b8e896a2a74a22999486af393f83f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:13.102487 24752 leader_election.cc:290] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 election: Requested vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:13.103245 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d42119e7b9b546fb8742111dc9fc01c4" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
I20260709 13:08:13.103866 24520 raft_consensus.cc:3060] T d42119e7b9b546fb8742111dc9fc01c4 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.107941 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d42119e7b9b546fb8742111dc9fc01c4" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:13.108635 24667 raft_consensus.cc:3060] T d42119e7b9b546fb8742111dc9fc01c4 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.111979 24520 raft_consensus.cc:2468] T d42119e7b9b546fb8742111dc9fc01c4 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 1.
I20260709 13:08:13.112180 24713 tablet_bootstrap.cc:492] T a51ff652d2a24a81a51cdd8d20e1fd25 P 26b8e896a2a74a22999486af393f83f8: No bootstrap required, opened a new log
I20260709 13:08:13.112897 24713 ts_tablet_manager.cc:1403] T a51ff652d2a24a81a51cdd8d20e1fd25 P 26b8e896a2a74a22999486af393f83f8: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.000s
I20260709 13:08:13.114761 24560 leader_election.cc:304] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:13.115465 24667 raft_consensus.cc:2468] T d42119e7b9b546fb8742111dc9fc01c4 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 1.
I20260709 13:08:13.115739 24713 raft_consensus.cc:359] T a51ff652d2a24a81a51cdd8d20e1fd25 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.116511 24713 raft_consensus.cc:385] T a51ff652d2a24a81a51cdd8d20e1fd25 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:13.116757 24713 raft_consensus.cc:740] T a51ff652d2a24a81a51cdd8d20e1fd25 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Initialized, Role: FOLLOWER
I20260709 13:08:13.117424 24713 consensus_queue.cc:260] T a51ff652d2a24a81a51cdd8d20e1fd25 P 26b8e896a2a74a22999486af393f83f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.118417 24719 raft_consensus.cc:2804] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:13.118885 24719 raft_consensus.cc:697] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8 [term 1 LEADER]: Becoming Leader. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Running, Role: LEADER
I20260709 13:08:13.113286 24416 catalog_manager.cc:5697] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48f59673e33a4636acca78951e868651 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "48f59673e33a4636acca78951e868651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:13.119479 24713 ts_tablet_manager.cc:1434] T a51ff652d2a24a81a51cdd8d20e1fd25 P 26b8e896a2a74a22999486af393f83f8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:08:13.119704 24719 consensus_queue.cc:237] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.122937 24415 catalog_manager.cc:5697] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "c3378e831c4f417a81e4cd63bde179a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.124532 24415 catalog_manager.cc:5697] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "c3378e831c4f417a81e4cd63bde179a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.139585 24417 catalog_manager.cc:5697] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "c3378e831c4f417a81e4cd63bde179a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.142292 24415 catalog_manager.cc:5697] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26b8e896a2a74a22999486af393f83f8 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "26b8e896a2a74a22999486af393f83f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.144076 24719 raft_consensus.cc:493] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.144676 24719 raft_consensus.cc:515] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.147017 24719 leader_election.cc:290] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:13.148097 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97bd80b3c6af4dd0b6a6933cdc6dc892" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651" is_pre_election: true
I20260709 13:08:13.148242 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97bd80b3c6af4dd0b6a6933cdc6dc892" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8" is_pre_election: true
I20260709 13:08:13.150297 24667 raft_consensus.cc:2393] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26b8e896a2a74a22999486af393f83f8 in current term 1: Already voted for candidate c3378e831c4f417a81e4cd63bde179a8 in this term.
I20260709 13:08:13.151314 24558 leader_election.cc:304] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8; no voters: 48f59673e33a4636acca78951e868651, c3378e831c4f417a81e4cd63bde179a8
I20260709 13:08:13.152163 24719 raft_consensus.cc:3060] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.158329 24719 raft_consensus.cc:2749] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:13.212615 24719 raft_consensus.cc:493] T a51ff652d2a24a81a51cdd8d20e1fd25 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.213121 24719 raft_consensus.cc:515] T a51ff652d2a24a81a51cdd8d20e1fd25 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.215076 24719 leader_election.cc:290] T a51ff652d2a24a81a51cdd8d20e1fd25 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:13.215974 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51ff652d2a24a81a51cdd8d20e1fd25" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8" is_pre_election: true
I20260709 13:08:13.216084 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a51ff652d2a24a81a51cdd8d20e1fd25" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651" is_pre_election: true
I20260709 13:08:13.217031 24667 raft_consensus.cc:2393] T a51ff652d2a24a81a51cdd8d20e1fd25 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26b8e896a2a74a22999486af393f83f8 in current term 1: Already voted for candidate c3378e831c4f417a81e4cd63bde179a8 in this term.
I20260709 13:08:13.218051 24558 leader_election.cc:304] T a51ff652d2a24a81a51cdd8d20e1fd25 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8; no voters: 48f59673e33a4636acca78951e868651, c3378e831c4f417a81e4cd63bde179a8
I20260709 13:08:13.218765 24719 raft_consensus.cc:3060] T a51ff652d2a24a81a51cdd8d20e1fd25 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.223918 24719 raft_consensus.cc:2749] T a51ff652d2a24a81a51cdd8d20e1fd25 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:13.272511 24750 consensus_queue.cc:1048] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:13.284482 24739 raft_consensus.cc:493] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.284999 24739 raft_consensus.cc:515] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.286446 24715 consensus_queue.cc:1048] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.287350 24739 leader_election.cc:290] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:13.288646 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0d862a4be40d68fdcfe809b66c897" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651" is_pre_election: true
I20260709 13:08:13.289974 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0d862a4be40d68fdcfe809b66c897" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8" is_pre_election: true
I20260709 13:08:13.289394 24667 raft_consensus.cc:2468] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 0.
I20260709 13:08:13.290679 24595 raft_consensus.cc:2468] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 0.
I20260709 13:08:13.292028 24485 leader_election.cc:304] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:13.293054 24739 raft_consensus.cc:2804] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:13.293457 24739 raft_consensus.cc:493] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.293871 24739 raft_consensus.cc:3060] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.302464 24739 raft_consensus.cc:515] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.304736 24739 leader_election.cc:290] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 election: Requested vote from peers 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:13.305513 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0d862a4be40d68fdcfe809b66c897" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8"
I20260709 13:08:13.306239 24594 raft_consensus.cc:3060] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.306053 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0d862a4be40d68fdcfe809b66c897" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:13.306773 24667 raft_consensus.cc:3060] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:13.313768 24667 raft_consensus.cc:2468] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 1.
I20260709 13:08:13.313768 24594 raft_consensus.cc:2468] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 1.
I20260709 13:08:13.315543 24483 leader_election.cc:304] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48f59673e33a4636acca78951e868651, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:13.316277 24739 raft_consensus.cc:2804] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:13.316794 24739 raft_consensus.cc:697] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Becoming Leader. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Running, Role: LEADER
I20260709 13:08:13.317541 24739 consensus_queue.cc:237] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.325882 24417 catalog_manager.cc:5697] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "c3378e831c4f417a81e4cd63bde179a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.391451 24715 consensus_queue.cc:1048] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.403268 24715 consensus_queue.cc:1048] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.407334 24749 consensus_queue.cc:1048] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:13.410858 24739 consensus_queue.cc:1048] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.493081 24749 consensus_queue.cc:1048] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.504593 24749 consensus_queue.cc:1048] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.545861 24719 consensus_queue.cc:1048] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.560279 24752 consensus_queue.cc:1048] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.563141 24749 consensus_queue.cc:1048] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.563565 24594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5587c38c35e6480e9f60445cfba5c6d6"
dest_uuid: "26b8e896a2a74a22999486af393f83f8"
mode: GRACEFUL
new_leader_uuid: "c3378e831c4f417a81e4cd63bde179a8"
 from {username='slave'} at 127.0.0.1:59718
I20260709 13:08:13.564220 24594 raft_consensus.cc:606] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [term 1 LEADER]: Received request to transfer leadership to TS c3378e831c4f417a81e4cd63bde179a8
I20260709 13:08:13.566695 24752 raft_consensus.cc:993] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8: : Instructing follower c3378e831c4f417a81e4cd63bde179a8 to start an election
I20260709 13:08:13.567169 24752 raft_consensus.cc:1081] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [term 1 LEADER]: Signalling peer c3378e831c4f417a81e4cd63bde179a8 to start an election
I20260709 13:08:13.571372 24520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5587c38c35e6480e9f60445cfba5c6d6"
dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
 from {username='slave'} at 127.0.0.1:42260
I20260709 13:08:13.572182 24520 raft_consensus.cc:493] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:13.572669 24520 raft_consensus.cc:3060] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:13.573789 24749 consensus_queue.cc:1048] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:13.585402 24520 raft_consensus.cc:515] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } }
I20260709 13:08:13.591670 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5587c38c35e6480e9f60445cfba5c6d6" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:13.591889 24520 leader_election.cc:290] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 2 election: Requested vote from peers 48f59673e33a4636acca78951e868651 (127.11.44.195:39911), 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553)
I20260709 13:08:13.593977 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5587c38c35e6480e9f60445cfba5c6d6" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26b8e896a2a74a22999486af393f83f8"
I20260709 13:08:13.594666 24595 raft_consensus.cc:3055] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:13.595018 24595 raft_consensus.cc:740] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Running, Role: LEADER
I20260709 13:08:13.596052 24595 consensus_queue.cc:260] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } }
I20260709 13:08:13.597473 24595 raft_consensus.cc:3060] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:13.611169 24595 raft_consensus.cc:2468] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 2.
I20260709 13:08:13.612483 24485 leader_election.cc:304] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8; no voters: 48f59673e33a4636acca78951e868651
I20260709 13:08:13.614548 24759 raft_consensus.cc:2804] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:13.614719 24668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0eaf0a51afd41ee8b06d2f3c60da098"
dest_uuid: "48f59673e33a4636acca78951e868651"
mode: GRACEFUL
new_leader_uuid: "c3378e831c4f417a81e4cd63bde179a8"
 from {username='slave'} at 127.0.0.1:59108
I20260709 13:08:13.615144 24759 raft_consensus.cc:697] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8 [term 2 LEADER]: Becoming Leader. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Running, Role: LEADER
I20260709 13:08:13.615435 24668 raft_consensus.cc:606] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Received request to transfer leadership to TS c3378e831c4f417a81e4cd63bde179a8
I20260709 13:08:13.616178 24759 consensus_queue.cc:237] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } }
I20260709 13:08:13.628485 24418 catalog_manager.cc:5697] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8 reported cstate change: term changed from 1 to 2, leader changed from 26b8e896a2a74a22999486af393f83f8 (127.11.44.194) to c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "c3378e831c4f417a81e4cd63bde179a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.632978 24759 consensus_queue.cc:1048] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.642521 24520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8d01567151542098a0cc1638736f603"
dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
mode: GRACEFUL
new_leader_uuid: "26b8e896a2a74a22999486af393f83f8"
 from {username='slave'} at 127.0.0.1:42276
I20260709 13:08:13.643172 24520 raft_consensus.cc:606] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Received request to transfer leadership to TS 26b8e896a2a74a22999486af393f83f8
I20260709 13:08:13.648694 24714 consensus_queue.cc:1048] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.655825 24520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67f0d862a4be40d68fdcfe809b66c897"
dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
mode: GRACEFUL
new_leader_uuid: "26b8e896a2a74a22999486af393f83f8"
 from {username='slave'} at 127.0.0.1:42276
I20260709 13:08:13.656556 24520 raft_consensus.cc:606] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Received request to transfer leadership to TS 26b8e896a2a74a22999486af393f83f8
I20260709 13:08:13.662510 24520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97bd80b3c6af4dd0b6a6933cdc6dc892"
dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
mode: GRACEFUL
new_leader_uuid: "26b8e896a2a74a22999486af393f83f8"
 from {username='slave'} at 127.0.0.1:42276
I20260709 13:08:13.663204 24520 raft_consensus.cc:606] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Received request to transfer leadership to TS 26b8e896a2a74a22999486af393f83f8
I20260709 13:08:13.669118 24714 raft_consensus.cc:993] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8: : Instructing follower 26b8e896a2a74a22999486af393f83f8 to start an election
I20260709 13:08:13.669720 24739 raft_consensus.cc:1081] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Signalling peer 26b8e896a2a74a22999486af393f83f8 to start an election
I20260709 13:08:13.671602 24594 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8d01567151542098a0cc1638736f603"
dest_uuid: "26b8e896a2a74a22999486af393f83f8"
 from {username='slave'} at 127.0.0.1:59710
I20260709 13:08:13.672210 24594 raft_consensus.cc:493] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:13.672531 24594 raft_consensus.cc:3060] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:13.677839 24594 raft_consensus.cc:515] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.679492 24594 leader_election.cc:290] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 2 election: Requested vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:13.680636 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d01567151542098a0cc1638736f603" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
I20260709 13:08:13.680662 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8d01567151542098a0cc1638736f603" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:13.681303 24520 raft_consensus.cc:3055] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:13.681423 24667 raft_consensus.cc:3060] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:13.681669 24520 raft_consensus.cc:740] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Running, Role: LEADER
I20260709 13:08:13.682478 24520 consensus_queue.cc:260] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.683458 24520 raft_consensus.cc:3060] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:13.687569 24667 raft_consensus.cc:2468] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 2.
I20260709 13:08:13.688591 24520 raft_consensus.cc:2468] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 2.
I20260709 13:08:13.688854 24558 leader_election.cc:304] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, 48f59673e33a4636acca78951e868651; no voters: 
I20260709 13:08:13.689849 24752 raft_consensus.cc:2804] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:13.690238 24752 raft_consensus.cc:697] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8 [term 2 LEADER]: Becoming Leader. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Running, Role: LEADER
I20260709 13:08:13.691095 24752 consensus_queue.cc:237] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.697839 24414 catalog_manager.cc:5697] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8 reported cstate change: term changed from 1 to 2, leader changed from c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193) to 26b8e896a2a74a22999486af393f83f8 (127.11.44.194). New cstate: current_term: 2 leader_uuid: "26b8e896a2a74a22999486af393f83f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.700767 24752 consensus_queue.cc:1048] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.715066 24791 consensus_queue.cc:1048] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:13.812536 24715 raft_consensus.cc:993] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651: : Instructing follower c3378e831c4f417a81e4cd63bde179a8 to start an election
I20260709 13:08:13.813035 24750 raft_consensus.cc:1081] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Signalling peer c3378e831c4f417a81e4cd63bde179a8 to start an election
I20260709 13:08:13.813655 24739 consensus_queue.cc:1048] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:13.814905 24520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0eaf0a51afd41ee8b06d2f3c60da098"
dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
 from {username='slave'} at 127.0.0.1:42252
I20260709 13:08:13.815547 24520 raft_consensus.cc:493] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:13.815889 24520 raft_consensus.cc:3060] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:13.815858 24739 consensus_queue.cc:1048] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:13.822683 24739 raft_consensus.cc:993] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8: : Instructing follower 26b8e896a2a74a22999486af393f83f8 to start an election
I20260709 13:08:13.823184 24739 raft_consensus.cc:1081] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Signalling peer 26b8e896a2a74a22999486af393f83f8 to start an election
I20260709 13:08:13.824887 24520 raft_consensus.cc:515] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.830049 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eaf0a51afd41ee8b06d2f3c60da098" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:13.830755 24667 raft_consensus.cc:3055] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:13.831188 24667 raft_consensus.cc:740] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48f59673e33a4636acca78951e868651, State: Running, Role: LEADER
I20260709 13:08:13.831477 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eaf0a51afd41ee8b06d2f3c60da098" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26b8e896a2a74a22999486af393f83f8"
I20260709 13:08:13.832191 24595 raft_consensus.cc:3060] T a0eaf0a51afd41ee8b06d2f3c60da098 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:13.832088 24667 consensus_queue.cc:260] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.832973 24520 leader_election.cc:290] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 2 election: Requested vote from peers 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:13.833540 24667 raft_consensus.cc:3060] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:13.830386 24594 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67f0d862a4be40d68fdcfe809b66c897"
dest_uuid: "26b8e896a2a74a22999486af393f83f8"
 from {username='slave'} at 127.0.0.1:59710
I20260709 13:08:13.834880 24594 raft_consensus.cc:493] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:13.835278 24594 raft_consensus.cc:3060] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:13.840116 24595 raft_consensus.cc:2468] T a0eaf0a51afd41ee8b06d2f3c60da098 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 2.
I20260709 13:08:13.841465 24485 leader_election.cc:304] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:13.842481 24749 raft_consensus.cc:2804] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:13.842968 24749 raft_consensus.cc:697] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [term 2 LEADER]: Becoming Leader. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Running, Role: LEADER
I20260709 13:08:13.843830 24749 consensus_queue.cc:237] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.845335 24594 raft_consensus.cc:515] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.848475 24667 raft_consensus.cc:2468] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 2.
I20260709 13:08:13.848510 24594 leader_election.cc:290] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 2 election: Requested vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:13.850044 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0d862a4be40d68fdcfe809b66c897" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
I20260709 13:08:13.850395 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0d862a4be40d68fdcfe809b66c897" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:13.850759 24520 raft_consensus.cc:3055] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:13.851045 24668 raft_consensus.cc:3060] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:13.851297 24520 raft_consensus.cc:740] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Running, Role: LEADER
I20260709 13:08:13.852595 24520 consensus_queue.cc:260] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.853960 24520 raft_consensus.cc:3060] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:13.857460 24668 raft_consensus.cc:2468] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 2.
I20260709 13:08:13.857808 24414 catalog_manager.cc:5697] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 reported cstate change: term changed from 1 to 2, leader changed from 48f59673e33a4636acca78951e868651 (127.11.44.195) to c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "c3378e831c4f417a81e4cd63bde179a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:13.858981 24558 leader_election.cc:304] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, 48f59673e33a4636acca78951e868651; no voters: 
I20260709 13:08:13.859884 24791 raft_consensus.cc:2804] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:13.860379 24791 raft_consensus.cc:697] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [term 2 LEADER]: Becoming Leader. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Running, Role: LEADER
I20260709 13:08:13.861177 24791 consensus_queue.cc:237] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:13.862498 24520 raft_consensus.cc:2468] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 2.
I20260709 13:08:13.872095 24415 catalog_manager.cc:5697] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 reported cstate change: term changed from 1 to 2, leader changed from c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193) to 26b8e896a2a74a22999486af393f83f8 (127.11.44.194). New cstate: current_term: 2 leader_uuid: "26b8e896a2a74a22999486af393f83f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:14.082562 24749 raft_consensus.cc:993] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8: : Instructing follower 26b8e896a2a74a22999486af393f83f8 to start an election
I20260709 13:08:14.083312 24749 raft_consensus.cc:1081] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Signalling peer 26b8e896a2a74a22999486af393f83f8 to start an election
I20260709 13:08:14.085312 24595 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97bd80b3c6af4dd0b6a6933cdc6dc892"
dest_uuid: "26b8e896a2a74a22999486af393f83f8"
 from {username='slave'} at 127.0.0.1:59710
I20260709 13:08:14.086408 24595 raft_consensus.cc:493] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:14.086827 24595 raft_consensus.cc:3060] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.096699 24595 raft_consensus.cc:515] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:14.098893 24595 leader_election.cc:290] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 2 election: Requested vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:14.100721 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97bd80b3c6af4dd0b6a6933cdc6dc892" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:14.101325 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97bd80b3c6af4dd0b6a6933cdc6dc892" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
I20260709 13:08:14.101645 24668 raft_consensus.cc:3060] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.102138 24520 raft_consensus.cc:3055] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:14.102487 24520 raft_consensus.cc:740] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Running, Role: LEADER
I20260709 13:08:14.103597 24520 consensus_queue.cc:260] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:14.105022 24520 raft_consensus.cc:3060] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.110668 24668 raft_consensus.cc:2468] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 2.
I20260709 13:08:14.112720 24558 leader_election.cc:304] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, 48f59673e33a4636acca78951e868651; no voters: 
I20260709 13:08:14.114161 24791 raft_consensus.cc:2804] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:14.114732 24791 raft_consensus.cc:697] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8 [term 2 LEADER]: Becoming Leader. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Running, Role: LEADER
I20260709 13:08:14.116436 24520 raft_consensus.cc:2468] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 2.
I20260709 13:08:14.116665 24791 consensus_queue.cc:237] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:14.127866 24595 raft_consensus.cc:1275] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Refusing update from remote peer c3378e831c4f417a81e4cd63bde179a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.130333 24749 consensus_queue.cc:1048] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:14.135977 24415 catalog_manager.cc:5697] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8 reported cstate change: term changed from 1 to 2, leader changed from c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193) to 26b8e896a2a74a22999486af393f83f8 (127.11.44.194). New cstate: current_term: 2 leader_uuid: "26b8e896a2a74a22999486af393f83f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:14.151437 24668 raft_consensus.cc:3060] T 5587c38c35e6480e9f60445cfba5c6d6 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:14.154608 24667 raft_consensus.cc:1275] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Refusing update from remote peer 26b8e896a2a74a22999486af393f83f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.156219 24791 consensus_queue.cc:1048] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.163391 24668 raft_consensus.cc:1275] T 5587c38c35e6480e9f60445cfba5c6d6 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Refusing update from remote peer c3378e831c4f417a81e4cd63bde179a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.165293 24714 consensus_queue.cc:1048] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:14.171180 24520 raft_consensus.cc:1275] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Refusing update from remote peer 26b8e896a2a74a22999486af393f83f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.176395 24719 consensus_queue.cc:1048] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:14.347043 24667 raft_consensus.cc:1275] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Refusing update from remote peer 26b8e896a2a74a22999486af393f83f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.348340 24719 consensus_queue.cc:1048] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.359983 24520 raft_consensus.cc:1275] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Refusing update from remote peer 26b8e896a2a74a22999486af393f83f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.362077 24719 consensus_queue.cc:1048] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.390584 24594 raft_consensus.cc:1275] T a0eaf0a51afd41ee8b06d2f3c60da098 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Refusing update from remote peer c3378e831c4f417a81e4cd63bde179a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.392004 24714 consensus_queue.cc:1048] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.404227 24667 raft_consensus.cc:1275] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Refusing update from remote peer c3378e831c4f417a81e4cd63bde179a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.407137 24714 consensus_queue.cc:1048] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:14.556658 24668 raft_consensus.cc:1275] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Refusing update from remote peer 26b8e896a2a74a22999486af393f83f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.558117 24719 consensus_queue.cc:1048] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:14.567649 24520 raft_consensus.cc:1275] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Refusing update from remote peer 26b8e896a2a74a22999486af393f83f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:14.569419 24791 consensus_queue.cc:1048] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:16.700021 24417 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49954:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:08:16.702615 24417 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:08:16.768061 24504 tablet_service.cc:1511] Processing CreateTablet for tablet b6d070792e14439dbe52e09e8db9daf8 (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:16.768909 24578 tablet_service.cc:1511] Processing CreateTablet for tablet b6d070792e14439dbe52e09e8db9daf8 (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:16.770124 24504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6d070792e14439dbe52e09e8db9daf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.770665 24578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6d070792e14439dbe52e09e8db9daf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.770290 24654 tablet_service.cc:1511] Processing CreateTablet for tablet b6d070792e14439dbe52e09e8db9daf8 (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:08:16.772200 24654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6d070792e14439dbe52e09e8db9daf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.773880 24505 tablet_service.cc:1511] Processing CreateTablet for tablet 8ccf6ea4c3b545b986a671f5a9d6396b (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:16.774011 24584 tablet_service.cc:1511] Processing CreateTablet for tablet 8ccf6ea4c3b545b986a671f5a9d6396b (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:16.775717 24584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ccf6ea4c3b545b986a671f5a9d6396b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.775808 24505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ccf6ea4c3b545b986a671f5a9d6396b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.783006 24651 tablet_service.cc:1511] Processing CreateTablet for tablet 8ccf6ea4c3b545b986a671f5a9d6396b (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:08:16.784904 24651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ccf6ea4c3b545b986a671f5a9d6396b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.790488 24506 tablet_service.cc:1511] Processing CreateTablet for tablet 1cbe51dfac234c36b8d00ea89ce862ed (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:16.792050 24506 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cbe51dfac234c36b8d00ea89ce862ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.805156 24579 tablet_service.cc:1511] Processing CreateTablet for tablet 1cbe51dfac234c36b8d00ea89ce862ed (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:16.806703 24579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cbe51dfac234c36b8d00ea89ce862ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.822515 24652 tablet_service.cc:1511] Processing CreateTablet for tablet 1cbe51dfac234c36b8d00ea89ce862ed (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:08:16.824154 24652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cbe51dfac234c36b8d00ea89ce862ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.824394 24810 tablet_bootstrap.cc:492] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8: Bootstrap starting.
I20260709 13:08:16.833249 24810 tablet_bootstrap.cc:654] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.839555 24504 tablet_service.cc:1511] Processing CreateTablet for tablet b74af9c5ab79476989c0fb06d7307239 (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:16.841037 24504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b74af9c5ab79476989c0fb06d7307239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.842794 24581 tablet_service.cc:1511] Processing CreateTablet for tablet b74af9c5ab79476989c0fb06d7307239 (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:16.844301 24581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b74af9c5ab79476989c0fb06d7307239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.844414 24507 tablet_service.cc:1511] Processing CreateTablet for tablet 8a42a90385ae49ddab7d0531125c9446 (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:16.845846 24507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a42a90385ae49ddab7d0531125c9446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.849875 24654 tablet_service.cc:1511] Processing CreateTablet for tablet b74af9c5ab79476989c0fb06d7307239 (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:08:16.857061 24582 tablet_service.cc:1511] Processing CreateTablet for tablet 8a42a90385ae49ddab7d0531125c9446 (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:16.858510 24582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a42a90385ae49ddab7d0531125c9446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.845794 24809 tablet_bootstrap.cc:492] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651: Bootstrap starting.
I20260709 13:08:16.864435 24654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b74af9c5ab79476989c0fb06d7307239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.873442 24651 tablet_service.cc:1511] Processing CreateTablet for tablet 8a42a90385ae49ddab7d0531125c9446 (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:08:16.874960 24651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a42a90385ae49ddab7d0531125c9446. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.884793 24809 tablet_bootstrap.cc:654] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.889714 24812 tablet_bootstrap.cc:492] T b6d070792e14439dbe52e09e8db9daf8 P 26b8e896a2a74a22999486af393f83f8: Bootstrap starting.
I20260709 13:08:16.898777 24505 tablet_service.cc:1511] Processing CreateTablet for tablet 4a3151a793f54182a82f23d4acb34d39 (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:16.900381 24505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a3151a793f54182a82f23d4acb34d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.900967 24578 tablet_service.cc:1511] Processing CreateTablet for tablet 4a3151a793f54182a82f23d4acb34d39 (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:16.901459 24810 tablet_bootstrap.cc:492] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8: No bootstrap required, opened a new log
I20260709 13:08:16.902143 24810 ts_tablet_manager.cc:1403] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8: Time spent bootstrapping tablet: real 0.078s	user 0.021s	sys 0.019s
I20260709 13:08:16.902426 24578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a3151a793f54182a82f23d4acb34d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.906375 24810 raft_consensus.cc:359] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:16.907331 24810 raft_consensus.cc:385] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.907734 24810 raft_consensus.cc:740] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.908550 24810 consensus_queue.cc:260] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:16.913201 24809 tablet_bootstrap.cc:492] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651: No bootstrap required, opened a new log
I20260709 13:08:16.914041 24809 ts_tablet_manager.cc:1403] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.003s
I20260709 13:08:16.914477 24507 tablet_service.cc:1511] Processing CreateTablet for tablet a558c4fbb0cb4e078e2c117a00e871c3 (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:16.916734 24507 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a558c4fbb0cb4e078e2c117a00e871c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.919117 24810 ts_tablet_manager.cc:1434] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 13:08:16.920392 24810 tablet_bootstrap.cc:492] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8: Bootstrap starting.
I20260709 13:08:16.920430 24652 tablet_service.cc:1511] Processing CreateTablet for tablet 4a3151a793f54182a82f23d4acb34d39 (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:08:16.921943 24652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a3151a793f54182a82f23d4acb34d39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.930552 24651 tablet_service.cc:1511] Processing CreateTablet for tablet a558c4fbb0cb4e078e2c117a00e871c3 (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:16.932046 24651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a558c4fbb0cb4e078e2c117a00e871c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.933930 24810 tablet_bootstrap.cc:654] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.932314 24582 tablet_service.cc:1511] Processing CreateTablet for tablet a558c4fbb0cb4e078e2c117a00e871c3 (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:08:16.935397 24582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a558c4fbb0cb4e078e2c117a00e871c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.939569 24504 tablet_service.cc:1511] Processing CreateTablet for tablet e96515055d724359aaf1e626e5936bd2 (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:16.962908 24504 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e96515055d724359aaf1e626e5936bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.942050 24579 tablet_service.cc:1511] Processing CreateTablet for tablet e96515055d724359aaf1e626e5936bd2 (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:16.944423 24809 raft_consensus.cc:359] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:16.948299 24812 tablet_bootstrap.cc:654] T b6d070792e14439dbe52e09e8db9daf8 P 26b8e896a2a74a22999486af393f83f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.966336 24809 raft_consensus.cc:385] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.966713 24809 raft_consensus.cc:740] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48f59673e33a4636acca78951e868651, State: Initialized, Role: FOLLOWER
I20260709 13:08:16.967479 24809 consensus_queue.cc:260] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:16.957845 24654 tablet_service.cc:1511] Processing CreateTablet for tablet e96515055d724359aaf1e626e5936bd2 (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:08:16.970098 24654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e96515055d724359aaf1e626e5936bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.982129 24809 ts_tablet_manager.cc:1434] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.007s
I20260709 13:08:16.983650 24809 tablet_bootstrap.cc:492] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651: Bootstrap starting.
I20260709 13:08:16.985329 24579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e96515055d724359aaf1e626e5936bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:16.991967 24809 tablet_bootstrap.cc:654] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:16.992842 24812 tablet_bootstrap.cc:492] T b6d070792e14439dbe52e09e8db9daf8 P 26b8e896a2a74a22999486af393f83f8: No bootstrap required, opened a new log
I20260709 13:08:16.993453 24812 ts_tablet_manager.cc:1403] T b6d070792e14439dbe52e09e8db9daf8 P 26b8e896a2a74a22999486af393f83f8: Time spent bootstrapping tablet: real 0.104s	user 0.016s	sys 0.004s
I20260709 13:08:16.997525 24812 raft_consensus.cc:359] T b6d070792e14439dbe52e09e8db9daf8 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:16.999300 24812 raft_consensus.cc:385] T b6d070792e14439dbe52e09e8db9daf8 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:16.999655 24812 raft_consensus.cc:740] T b6d070792e14439dbe52e09e8db9daf8 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.000648 24812 consensus_queue.cc:260] T b6d070792e14439dbe52e09e8db9daf8 P 26b8e896a2a74a22999486af393f83f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.004659 24505 tablet_service.cc:1511] Processing CreateTablet for tablet ab8d263e522342d0b92bb31689822558 (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:17.006301 24505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab8d263e522342d0b92bb31689822558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.007820 24812 ts_tablet_manager.cc:1434] T b6d070792e14439dbe52e09e8db9daf8 P 26b8e896a2a74a22999486af393f83f8: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.005s
I20260709 13:08:17.008945 24812 tablet_bootstrap.cc:492] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8: Bootstrap starting.
I20260709 13:08:17.010298 24578 tablet_service.cc:1511] Processing CreateTablet for tablet ab8d263e522342d0b92bb31689822558 (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:17.011612 24578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab8d263e522342d0b92bb31689822558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.025312 24654 tablet_service.cc:1511] Processing CreateTablet for tablet ab8d263e522342d0b92bb31689822558 (DEFAULT_TABLE table=soft_deleted_table [id=20daab772ee84f228330e453a2d8708d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:08:17.031985 24654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab8d263e522342d0b92bb31689822558. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:17.032874 24809 tablet_bootstrap.cc:492] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651: No bootstrap required, opened a new log
I20260709 13:08:17.033499 24809 ts_tablet_manager.cc:1403] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651: Time spent bootstrapping tablet: real 0.050s	user 0.022s	sys 0.001s
I20260709 13:08:17.036823 24809 raft_consensus.cc:359] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.037642 24809 raft_consensus.cc:385] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.037935 24809 raft_consensus.cc:740] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48f59673e33a4636acca78951e868651, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.038872 24809 consensus_queue.cc:260] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.040592 24810 tablet_bootstrap.cc:492] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8: No bootstrap required, opened a new log
I20260709 13:08:17.041294 24810 ts_tablet_manager.cc:1403] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8: Time spent bootstrapping tablet: real 0.121s	user 0.022s	sys 0.033s
I20260709 13:08:17.041673 24809 ts_tablet_manager.cc:1434] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 13:08:17.042722 24809 tablet_bootstrap.cc:492] T b74af9c5ab79476989c0fb06d7307239 P 48f59673e33a4636acca78951e868651: Bootstrap starting.
I20260709 13:08:17.044646 24810 raft_consensus.cc:359] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.045456 24810 raft_consensus.cc:385] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.045779 24810 raft_consensus.cc:740] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.046663 24810 consensus_queue.cc:260] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.049769 24809 tablet_bootstrap.cc:654] T b74af9c5ab79476989c0fb06d7307239 P 48f59673e33a4636acca78951e868651: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.052932 24812 tablet_bootstrap.cc:654] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.058560 24810 ts_tablet_manager.cc:1434] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:08:17.068600 24739 raft_consensus.cc:493] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.069373 24739 raft_consensus.cc:515] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.081239 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbe51dfac234c36b8d00ea89ce862ed" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8" is_pre_election: true
W20260709 13:08:17.084040 24485 leader_election.cc:343] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:17.081166 24739 leader_election.cc:290] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:17.096303 24810 tablet_bootstrap.cc:492] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8: Bootstrap starting.
I20260709 13:08:17.108415 24809 tablet_bootstrap.cc:492] T b74af9c5ab79476989c0fb06d7307239 P 48f59673e33a4636acca78951e868651: No bootstrap required, opened a new log
I20260709 13:08:17.109126 24809 ts_tablet_manager.cc:1403] T b74af9c5ab79476989c0fb06d7307239 P 48f59673e33a4636acca78951e868651: Time spent bootstrapping tablet: real 0.067s	user 0.024s	sys 0.041s
I20260709 13:08:17.109685 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbe51dfac234c36b8d00ea89ce862ed" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651" is_pre_election: true
I20260709 13:08:17.112466 24809 raft_consensus.cc:359] T b74af9c5ab79476989c0fb06d7307239 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.113270 24809 raft_consensus.cc:385] T b74af9c5ab79476989c0fb06d7307239 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:08:17.113144 24483 leader_election.cc:343] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48f59673e33a4636acca78951e868651 (127.11.44.195:39911): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:17.113907 24809 raft_consensus.cc:740] T b74af9c5ab79476989c0fb06d7307239 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48f59673e33a4636acca78951e868651, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.114157 24483 leader_election.cc:304] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3378e831c4f417a81e4cd63bde179a8; no voters: 26b8e896a2a74a22999486af393f83f8, 48f59673e33a4636acca78951e868651
I20260709 13:08:17.114765 24809 consensus_queue.cc:260] T b74af9c5ab79476989c0fb06d7307239 P 48f59673e33a4636acca78951e868651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.115384 24739 raft_consensus.cc:2749] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:17.119951 24812 tablet_bootstrap.cc:492] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8: No bootstrap required, opened a new log
I20260709 13:08:17.120028 24809 ts_tablet_manager.cc:1434] T b74af9c5ab79476989c0fb06d7307239 P 48f59673e33a4636acca78951e868651: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:08:17.120756 24812 ts_tablet_manager.cc:1403] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8: Time spent bootstrapping tablet: real 0.112s	user 0.053s	sys 0.020s
I20260709 13:08:17.121166 24810 tablet_bootstrap.cc:654] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.121436 24809 tablet_bootstrap.cc:492] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651: Bootstrap starting.
I20260709 13:08:17.125592 24812 raft_consensus.cc:359] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.126396 24812 raft_consensus.cc:385] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.126735 24812 raft_consensus.cc:740] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.127542 24812 consensus_queue.cc:260] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.132838 24812 ts_tablet_manager.cc:1434] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.003s
I20260709 13:08:17.133174 24809 tablet_bootstrap.cc:654] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.133735 24810 tablet_bootstrap.cc:492] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8: No bootstrap required, opened a new log
I20260709 13:08:17.134336 24810 ts_tablet_manager.cc:1403] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.012s
I20260709 13:08:17.134333 24812 tablet_bootstrap.cc:492] T 8ccf6ea4c3b545b986a671f5a9d6396b P 26b8e896a2a74a22999486af393f83f8: Bootstrap starting.
I20260709 13:08:17.138407 24810 raft_consensus.cc:359] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.139441 24810 raft_consensus.cc:385] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.139904 24810 raft_consensus.cc:740] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.141108 24810 consensus_queue.cc:260] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.143720 24791 raft_consensus.cc:493] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.144284 24791 raft_consensus.cc:515] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.145905 24809 tablet_bootstrap.cc:492] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651: No bootstrap required, opened a new log
I20260709 13:08:17.146476 24791 leader_election.cc:290] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:17.146500 24809 ts_tablet_manager.cc:1403] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.002s
I20260709 13:08:17.147208 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74af9c5ab79476989c0fb06d7307239" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8" is_pre_election: true
I20260709 13:08:17.147644 24812 tablet_bootstrap.cc:654] T 8ccf6ea4c3b545b986a671f5a9d6396b P 26b8e896a2a74a22999486af393f83f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.147950 24520 raft_consensus.cc:2468] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 0.
I20260709 13:08:17.148133 24810 ts_tablet_manager.cc:1434] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:08:17.149545 24810 tablet_bootstrap.cc:492] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8: Bootstrap starting.
I20260709 13:08:17.150411 24809 raft_consensus.cc:359] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.151271 24809 raft_consensus.cc:385] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.151638 24809 raft_consensus.cc:740] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48f59673e33a4636acca78951e868651, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.151434 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74af9c5ab79476989c0fb06d7307239" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651" is_pre_election: true
I20260709 13:08:17.152494 24668 raft_consensus.cc:2468] T b74af9c5ab79476989c0fb06d7307239 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 0.
I20260709 13:08:17.154659 24560 leader_election.cc:304] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:17.154886 24809 consensus_queue.cc:260] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.157776 24809 ts_tablet_manager.cc:1434] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.007s
I20260709 13:08:17.158977 24809 tablet_bootstrap.cc:492] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651: Bootstrap starting.
I20260709 13:08:17.159245 24791 raft_consensus.cc:2804] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:17.159868 24791 raft_consensus.cc:493] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.160295 24791 raft_consensus.cc:3060] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.163455 24810 tablet_bootstrap.cc:654] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.167711 24809 tablet_bootstrap.cc:654] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.170519 24812 tablet_bootstrap.cc:492] T 8ccf6ea4c3b545b986a671f5a9d6396b P 26b8e896a2a74a22999486af393f83f8: No bootstrap required, opened a new log
I20260709 13:08:17.170567 24815 raft_consensus.cc:493] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.171233 24812 ts_tablet_manager.cc:1403] T 8ccf6ea4c3b545b986a671f5a9d6396b P 26b8e896a2a74a22999486af393f83f8: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.011s
I20260709 13:08:17.171231 24815 raft_consensus.cc:515] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.174628 24815 leader_election.cc:290] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553)
I20260709 13:08:17.176810 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d070792e14439dbe52e09e8db9daf8" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8" is_pre_election: true
I20260709 13:08:17.177747 24812 raft_consensus.cc:359] T 8ccf6ea4c3b545b986a671f5a9d6396b P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.178817 24594 raft_consensus.cc:2468] T b6d070792e14439dbe52e09e8db9daf8 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 0.
I20260709 13:08:17.178856 24812 raft_consensus.cc:385] T 8ccf6ea4c3b545b986a671f5a9d6396b P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.179426 24812 raft_consensus.cc:740] T 8ccf6ea4c3b545b986a671f5a9d6396b P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.180400 24812 consensus_queue.cc:260] T 8ccf6ea4c3b545b986a671f5a9d6396b P 26b8e896a2a74a22999486af393f83f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.185799 24810 tablet_bootstrap.cc:492] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8: No bootstrap required, opened a new log
I20260709 13:08:17.186550 24634 leader_election.cc:304] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, 48f59673e33a4636acca78951e868651; no voters: 
I20260709 13:08:17.177925 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d070792e14439dbe52e09e8db9daf8" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8" is_pre_election: true
I20260709 13:08:17.188428 24520 raft_consensus.cc:2468] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 0.
I20260709 13:08:17.189052 24750 raft_consensus.cc:2804] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:17.187484 24815 raft_consensus.cc:493] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.191347 24750 raft_consensus.cc:493] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.193390 24750 raft_consensus.cc:3060] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.186584 24810 ts_tablet_manager.cc:1403] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.001s
I20260709 13:08:17.175356 24791 raft_consensus.cc:515] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.194995 24815 raft_consensus.cc:515] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.202438 24815 leader_election.cc:290] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553)
I20260709 13:08:17.203547 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ccf6ea4c3b545b986a671f5a9d6396b" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8" is_pre_election: true
I20260709 13:08:17.204737 24810 raft_consensus.cc:359] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.205451 24810 raft_consensus.cc:385] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.203637 24812 ts_tablet_manager.cc:1434] T 8ccf6ea4c3b545b986a671f5a9d6396b P 26b8e896a2a74a22999486af393f83f8: Time spent starting tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 13:08:17.206130 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74af9c5ab79476989c0fb06d7307239" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
I20260709 13:08:17.206820 24519 raft_consensus.cc:3060] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.207183 24791 leader_election.cc:290] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 election: Requested vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:17.206957 24750 raft_consensus.cc:515] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.205823 24810 raft_consensus.cc:740] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.209745 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ccf6ea4c3b545b986a671f5a9d6396b" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8" is_pre_election: true
I20260709 13:08:17.210525 24812 tablet_bootstrap.cc:492] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8: Bootstrap starting.
I20260709 13:08:17.210621 24809 tablet_bootstrap.cc:492] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651: No bootstrap required, opened a new log
I20260709 13:08:17.211352 24809 ts_tablet_manager.cc:1403] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651: Time spent bootstrapping tablet: real 0.053s	user 0.017s	sys 0.020s
I20260709 13:08:17.210533 24594 raft_consensus.cc:2468] T 8ccf6ea4c3b545b986a671f5a9d6396b P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 0.
I20260709 13:08:17.213446 24750 leader_election.cc:290] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 election: Requested vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553)
I20260709 13:08:17.215590 24809 raft_consensus.cc:359] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.216303 24809 raft_consensus.cc:385] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.216594 24809 raft_consensus.cc:740] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48f59673e33a4636acca78951e868651, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.210749 24810 consensus_queue.cc:260] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.217341 24809 consensus_queue.cc:260] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.219381 24812 tablet_bootstrap.cc:654] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.220484 24810 ts_tablet_manager.cc:1434] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 13:08:17.217953 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74af9c5ab79476989c0fb06d7307239" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:17.221798 24668 raft_consensus.cc:3060] T b74af9c5ab79476989c0fb06d7307239 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.221958 24810 tablet_bootstrap.cc:492] T 8a42a90385ae49ddab7d0531125c9446 P c3378e831c4f417a81e4cd63bde179a8: Bootstrap starting.
I20260709 13:08:17.222123 24809 ts_tablet_manager.cc:1434] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 13:08:17.223251 24809 tablet_bootstrap.cc:492] T a558c4fbb0cb4e078e2c117a00e871c3 P 48f59673e33a4636acca78951e868651: Bootstrap starting.
W20260709 13:08:17.216737 24634 leader_election.cc:343] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:17.230014 24809 tablet_bootstrap.cc:654] T a558c4fbb0cb4e078e2c117a00e871c3 P 48f59673e33a4636acca78951e868651: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.230976 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d070792e14439dbe52e09e8db9daf8" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8"
I20260709 13:08:17.231739 24594 raft_consensus.cc:3060] T b6d070792e14439dbe52e09e8db9daf8 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.232255 24634 leader_election.cc:304] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, 48f59673e33a4636acca78951e868651; no voters: c3378e831c4f417a81e4cd63bde179a8
I20260709 13:08:17.233135 24750 raft_consensus.cc:2804] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:17.229640 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d070792e14439dbe52e09e8db9daf8" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
I20260709 13:08:17.233600 24750 raft_consensus.cc:493] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.234163 24750 raft_consensus.cc:3060] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.235440 24810 tablet_bootstrap.cc:654] T 8a42a90385ae49ddab7d0531125c9446 P c3378e831c4f417a81e4cd63bde179a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.241381 24812 tablet_bootstrap.cc:492] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8: No bootstrap required, opened a new log
I20260709 13:08:17.242266 24812 ts_tablet_manager.cc:1403] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.008s
I20260709 13:08:17.246306 24812 raft_consensus.cc:359] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.247360 24812 raft_consensus.cc:385] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.247620 24739 raft_consensus.cc:493] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.247781 24812 raft_consensus.cc:740] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.248240 24739 raft_consensus.cc:515] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.249287 24812 consensus_queue.cc:260] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.250949 24739 leader_election.cc:290] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:17.252842 24812 ts_tablet_manager.cc:1434] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:08:17.252465 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ccf6ea4c3b545b986a671f5a9d6396b" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8" is_pre_election: true
I20260709 13:08:17.253727 24595 raft_consensus.cc:2468] T 8ccf6ea4c3b545b986a671f5a9d6396b P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 0.
I20260709 13:08:17.254315 24812 tablet_bootstrap.cc:492] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8: Bootstrap starting.
I20260709 13:08:17.255872 24485 leader_election.cc:304] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:17.256565 24810 tablet_bootstrap.cc:492] T 8a42a90385ae49ddab7d0531125c9446 P c3378e831c4f417a81e4cd63bde179a8: No bootstrap required, opened a new log
I20260709 13:08:17.257222 24810 ts_tablet_manager.cc:1403] T 8a42a90385ae49ddab7d0531125c9446 P c3378e831c4f417a81e4cd63bde179a8: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.000s
I20260709 13:08:17.253873 24750 raft_consensus.cc:515] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.260979 24810 raft_consensus.cc:359] T 8a42a90385ae49ddab7d0531125c9446 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.261863 24810 raft_consensus.cc:385] T 8a42a90385ae49ddab7d0531125c9446 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.262187 24810 raft_consensus.cc:740] T 8a42a90385ae49ddab7d0531125c9446 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.262794 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ccf6ea4c3b545b986a671f5a9d6396b" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651" is_pre_election: true
I20260709 13:08:17.263001 24810 consensus_queue.cc:260] T 8a42a90385ae49ddab7d0531125c9446 P c3378e831c4f417a81e4cd63bde179a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.263933 24667 raft_consensus.cc:2393] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c3378e831c4f417a81e4cd63bde179a8 in current term 1: Already voted for candidate 48f59673e33a4636acca78951e868651 in this term.
I20260709 13:08:17.264288 24820 raft_consensus.cc:2804] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:17.264827 24820 raft_consensus.cc:493] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.265182 24820 raft_consensus.cc:3060] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.265918 24810 ts_tablet_manager.cc:1434] T 8a42a90385ae49ddab7d0531125c9446 P c3378e831c4f417a81e4cd63bde179a8: Time spent starting tablet: real 0.008s	user 0.011s	sys 0.000s
I20260709 13:08:17.266415 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ccf6ea4c3b545b986a671f5a9d6396b" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
I20260709 13:08:17.267107 24810 tablet_bootstrap.cc:492] T a558c4fbb0cb4e078e2c117a00e871c3 P c3378e831c4f417a81e4cd63bde179a8: Bootstrap starting.
I20260709 13:08:17.268016 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ccf6ea4c3b545b986a671f5a9d6396b" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8"
I20260709 13:08:17.268908 24595 raft_consensus.cc:3060] T 8ccf6ea4c3b545b986a671f5a9d6396b P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.275559 24810 tablet_bootstrap.cc:654] T a558c4fbb0cb4e078e2c117a00e871c3 P c3378e831c4f417a81e4cd63bde179a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.278187 24750 leader_election.cc:290] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 election: Requested vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553)
I20260709 13:08:17.278908 24520 raft_consensus.cc:3060] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.280372 24820 raft_consensus.cc:515] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.282393 24517 raft_consensus.cc:2393] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 48f59673e33a4636acca78951e868651 in current term 1: Already voted for candidate c3378e831c4f417a81e4cd63bde179a8 in this term.
I20260709 13:08:17.298475 24812 tablet_bootstrap.cc:654] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.302740 24820 leader_election.cc:290] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 election: Requested vote from peers 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:17.307262 24810 tablet_bootstrap.cc:492] T a558c4fbb0cb4e078e2c117a00e871c3 P c3378e831c4f417a81e4cd63bde179a8: No bootstrap required, opened a new log
I20260709 13:08:17.307780 24812 tablet_bootstrap.cc:492] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8: No bootstrap required, opened a new log
I20260709 13:08:17.307907 24810 ts_tablet_manager.cc:1403] T a558c4fbb0cb4e078e2c117a00e871c3 P c3378e831c4f417a81e4cd63bde179a8: Time spent bootstrapping tablet: real 0.041s	user 0.021s	sys 0.017s
I20260709 13:08:17.309700 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ccf6ea4c3b545b986a671f5a9d6396b" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8"
I20260709 13:08:17.311669 24810 raft_consensus.cc:359] T a558c4fbb0cb4e078e2c117a00e871c3 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.312582 24810 raft_consensus.cc:385] T a558c4fbb0cb4e078e2c117a00e871c3 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.312585 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ccf6ea4c3b545b986a671f5a9d6396b" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:17.313359 24810 raft_consensus.cc:740] T a558c4fbb0cb4e078e2c117a00e871c3 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.313685 24812 ts_tablet_manager.cc:1403] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.001s
I20260709 13:08:17.314075 24667 raft_consensus.cc:2393] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c3378e831c4f417a81e4cd63bde179a8 in current term 1: Already voted for candidate 48f59673e33a4636acca78951e868651 in this term.
I20260709 13:08:17.314430 24810 consensus_queue.cc:260] T a558c4fbb0cb4e078e2c117a00e871c3 P c3378e831c4f417a81e4cd63bde179a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.317278 24810 ts_tablet_manager.cc:1434] T a558c4fbb0cb4e078e2c117a00e871c3 P c3378e831c4f417a81e4cd63bde179a8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:08:17.317297 24485 leader_election.cc:304] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3378e831c4f417a81e4cd63bde179a8; no voters: 26b8e896a2a74a22999486af393f83f8, 48f59673e33a4636acca78951e868651
I20260709 13:08:17.317760 24812 raft_consensus.cc:359] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.318476 24810 tablet_bootstrap.cc:492] T 4a3151a793f54182a82f23d4acb34d39 P c3378e831c4f417a81e4cd63bde179a8: Bootstrap starting.
I20260709 13:08:17.318930 24812 raft_consensus.cc:385] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.319554 24750 raft_consensus.cc:493] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.319952 24739 raft_consensus.cc:2749] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:08:17.320164 24750 raft_consensus.cc:515] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.322682 24750 leader_election.cc:290] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553)
I20260709 13:08:17.325399 24517 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a42a90385ae49ddab7d0531125c9446" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8" is_pre_election: true
I20260709 13:08:17.326236 24517 raft_consensus.cc:2468] T 8a42a90385ae49ddab7d0531125c9446 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 0.
I20260709 13:08:17.326859 24810 tablet_bootstrap.cc:654] T 4a3151a793f54182a82f23d4acb34d39 P c3378e831c4f417a81e4cd63bde179a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.327450 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a42a90385ae49ddab7d0531125c9446" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8" is_pre_election: true
I20260709 13:08:17.328969 24634 leader_election.cc:304] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48f59673e33a4636acca78951e868651, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:17.330127 24750 raft_consensus.cc:2804] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:17.330680 24750 raft_consensus.cc:493] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.331141 24750 raft_consensus.cc:3060] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.333425 24519 raft_consensus.cc:2468] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 1.
I20260709 13:08:17.335196 24560 leader_election.cc:304] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:17.336139 24791 raft_consensus.cc:2804] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:17.336678 24791 raft_consensus.cc:697] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [term 1 LEADER]: Becoming Leader. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Running, Role: LEADER
I20260709 13:08:17.337695 24791 consensus_queue.cc:237] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.338346 24812 raft_consensus.cc:740] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.339370 24812 consensus_queue.cc:260] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.340533 24593 raft_consensus.cc:2468] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 0.
I20260709 13:08:17.352205 24750 raft_consensus.cc:515] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.355960 24810 tablet_bootstrap.cc:492] T 4a3151a793f54182a82f23d4acb34d39 P c3378e831c4f417a81e4cd63bde179a8: No bootstrap required, opened a new log
I20260709 13:08:17.356462 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a42a90385ae49ddab7d0531125c9446" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
I20260709 13:08:17.358338 24519 raft_consensus.cc:3060] T 8a42a90385ae49ddab7d0531125c9446 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.356000 24812 ts_tablet_manager.cc:1434] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.001s
I20260709 13:08:17.358532 24810 ts_tablet_manager.cc:1403] T 4a3151a793f54182a82f23d4acb34d39 P c3378e831c4f417a81e4cd63bde179a8: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.008s
I20260709 13:08:17.360226 24812 tablet_bootstrap.cc:492] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8: Bootstrap starting.
I20260709 13:08:17.364045 24810 raft_consensus.cc:359] T 4a3151a793f54182a82f23d4acb34d39 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.368357 24810 raft_consensus.cc:385] T 4a3151a793f54182a82f23d4acb34d39 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.369246 24810 raft_consensus.cc:740] T 4a3151a793f54182a82f23d4acb34d39 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.370819 24668 raft_consensus.cc:2468] T b74af9c5ab79476989c0fb06d7307239 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 1.
I20260709 13:08:17.365208 24595 raft_consensus.cc:2468] T 8ccf6ea4c3b545b986a671f5a9d6396b P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 1.
I20260709 13:08:17.373700 24593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a42a90385ae49ddab7d0531125c9446" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8"
I20260709 13:08:17.376839 24739 raft_consensus.cc:493] T a558c4fbb0cb4e078e2c117a00e871c3 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.377290 24593 raft_consensus.cc:3060] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.377642 24739 raft_consensus.cc:515] T a558c4fbb0cb4e078e2c117a00e871c3 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.381235 24520 raft_consensus.cc:2468] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 1.
I20260709 13:08:17.382006 24739 leader_election.cc:290] T a558c4fbb0cb4e078e2c117a00e871c3 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:17.382210 24634 leader_election.cc:304] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, 48f59673e33a4636acca78951e868651; no voters: c3378e831c4f417a81e4cd63bde179a8
I20260709 13:08:17.382313 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a558c4fbb0cb4e078e2c117a00e871c3" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651" is_pre_election: true
I20260709 13:08:17.390072 24815 raft_consensus.cc:2804] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:17.374267 24750 leader_election.cc:290] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 election: Requested vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553)
I20260709 13:08:17.385825 24416 catalog_manager.cc:5697] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26b8e896a2a74a22999486af393f83f8 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "26b8e896a2a74a22999486af393f83f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:17.370998 24810 consensus_queue.cc:260] T 4a3151a793f54182a82f23d4acb34d39 P c3378e831c4f417a81e4cd63bde179a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.387449 24593 raft_consensus.cc:2468] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 1.
I20260709 13:08:17.387641 24594 raft_consensus.cc:2468] T b6d070792e14439dbe52e09e8db9daf8 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 1.
I20260709 13:08:17.383392 24595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a558c4fbb0cb4e078e2c117a00e871c3" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8" is_pre_election: true
I20260709 13:08:17.391441 24809 tablet_bootstrap.cc:492] T a558c4fbb0cb4e078e2c117a00e871c3 P 48f59673e33a4636acca78951e868651: No bootstrap required, opened a new log
I20260709 13:08:17.390617 24634 leader_election.cc:304] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48f59673e33a4636acca78951e868651, c3378e831c4f417a81e4cd63bde179a8; no voters: 
W20260709 13:08:17.391829 24483 leader_election.cc:343] T a558c4fbb0cb4e078e2c117a00e871c3 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48f59673e33a4636acca78951e868651 (127.11.44.195:39911): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:08:17.396855 24485 leader_election.cc:343] T a558c4fbb0cb4e078e2c117a00e871c3 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:17.397260 24750 raft_consensus.cc:2804] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:17.397454 24485 leader_election.cc:304] T a558c4fbb0cb4e078e2c117a00e871c3 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3378e831c4f417a81e4cd63bde179a8; no voters: 26b8e896a2a74a22999486af393f83f8, 48f59673e33a4636acca78951e868651
I20260709 13:08:17.397902 24750 raft_consensus.cc:697] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Becoming Leader. State: Replica: 48f59673e33a4636acca78951e868651, State: Running, Role: LEADER
I20260709 13:08:17.398970 24750 consensus_queue.cc:237] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.399603 24739 raft_consensus.cc:2749] T a558c4fbb0cb4e078e2c117a00e871c3 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:17.396920 24634 leader_election.cc:304] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, 48f59673e33a4636acca78951e868651; no voters: 
I20260709 13:08:17.404119 24809 ts_tablet_manager.cc:1403] T a558c4fbb0cb4e078e2c117a00e871c3 P 48f59673e33a4636acca78951e868651: Time spent bootstrapping tablet: real 0.181s	user 0.066s	sys 0.081s
I20260709 13:08:17.404830 24810 ts_tablet_manager.cc:1434] T 4a3151a793f54182a82f23d4acb34d39 P c3378e831c4f417a81e4cd63bde179a8: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.006s
I20260709 13:08:17.406121 24810 tablet_bootstrap.cc:492] T e96515055d724359aaf1e626e5936bd2 P c3378e831c4f417a81e4cd63bde179a8: Bootstrap starting.
I20260709 13:08:17.408511 24809 raft_consensus.cc:359] T a558c4fbb0cb4e078e2c117a00e871c3 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.409685 24809 raft_consensus.cc:385] T a558c4fbb0cb4e078e2c117a00e871c3 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.409979 24809 raft_consensus.cc:740] T a558c4fbb0cb4e078e2c117a00e871c3 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48f59673e33a4636acca78951e868651, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.410688 24809 consensus_queue.cc:260] T a558c4fbb0cb4e078e2c117a00e871c3 P 48f59673e33a4636acca78951e868651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.402475 24519 raft_consensus.cc:2468] T 8a42a90385ae49ddab7d0531125c9446 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 1.
I20260709 13:08:17.416541 24812 tablet_bootstrap.cc:654] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.419586 24815 raft_consensus.cc:697] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Becoming Leader. State: Replica: 48f59673e33a4636acca78951e868651, State: Running, Role: LEADER
I20260709 13:08:17.420778 24815 consensus_queue.cc:237] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.423153 24810 tablet_bootstrap.cc:654] T e96515055d724359aaf1e626e5936bd2 P c3378e831c4f417a81e4cd63bde179a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.429400 24836 raft_consensus.cc:2804] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:17.430002 24836 raft_consensus.cc:697] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Becoming Leader. State: Replica: 48f59673e33a4636acca78951e868651, State: Running, Role: LEADER
I20260709 13:08:17.430310 24809 ts_tablet_manager.cc:1434] T a558c4fbb0cb4e078e2c117a00e871c3 P 48f59673e33a4636acca78951e868651: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.014s
I20260709 13:08:17.430878 24836 consensus_queue.cc:237] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.431538 24809 tablet_bootstrap.cc:492] T 4a3151a793f54182a82f23d4acb34d39 P 48f59673e33a4636acca78951e868651: Bootstrap starting.
W20260709 13:08:17.440605 24634 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.44.194:45553, user_credentials={real_user=slave}} blocked reactor thread for 43761.2us
I20260709 13:08:17.460618 24810 tablet_bootstrap.cc:492] T e96515055d724359aaf1e626e5936bd2 P c3378e831c4f417a81e4cd63bde179a8: No bootstrap required, opened a new log
I20260709 13:08:17.461393 24810 ts_tablet_manager.cc:1403] T e96515055d724359aaf1e626e5936bd2 P c3378e831c4f417a81e4cd63bde179a8: Time spent bootstrapping tablet: real 0.056s	user 0.023s	sys 0.009s
I20260709 13:08:17.465665 24810 raft_consensus.cc:359] T e96515055d724359aaf1e626e5936bd2 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.466632 24810 raft_consensus.cc:385] T e96515055d724359aaf1e626e5936bd2 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.467006 24810 raft_consensus.cc:740] T e96515055d724359aaf1e626e5936bd2 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.468387 24810 consensus_queue.cc:260] T e96515055d724359aaf1e626e5936bd2 P c3378e831c4f417a81e4cd63bde179a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.470674 24810 ts_tablet_manager.cc:1434] T e96515055d724359aaf1e626e5936bd2 P c3378e831c4f417a81e4cd63bde179a8: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:08:17.475203 24810 tablet_bootstrap.cc:492] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8: Bootstrap starting.
I20260709 13:08:17.495307 24809 tablet_bootstrap.cc:654] T 4a3151a793f54182a82f23d4acb34d39 P 48f59673e33a4636acca78951e868651: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.500283 24414 catalog_manager.cc:5697] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48f59673e33a4636acca78951e868651 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "48f59673e33a4636acca78951e868651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:17.502027 24812 tablet_bootstrap.cc:492] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8: No bootstrap required, opened a new log
I20260709 13:08:17.502872 24812 ts_tablet_manager.cc:1403] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8: Time spent bootstrapping tablet: real 0.143s	user 0.014s	sys 0.034s
I20260709 13:08:17.507375 24812 raft_consensus.cc:359] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.507949 24810 tablet_bootstrap.cc:654] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.509690 24812 raft_consensus.cc:385] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.510126 24812 raft_consensus.cc:740] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.510931 24812 consensus_queue.cc:260] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.512087 24809 tablet_bootstrap.cc:492] T 4a3151a793f54182a82f23d4acb34d39 P 48f59673e33a4636acca78951e868651: No bootstrap required, opened a new log
I20260709 13:08:17.512583 24809 ts_tablet_manager.cc:1403] T 4a3151a793f54182a82f23d4acb34d39 P 48f59673e33a4636acca78951e868651: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.011s
I20260709 13:08:17.513387 24812 ts_tablet_manager.cc:1434] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:08:17.514528 24812 tablet_bootstrap.cc:492] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8: Bootstrap starting.
I20260709 13:08:17.516093 24809 raft_consensus.cc:359] T 4a3151a793f54182a82f23d4acb34d39 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.517187 24809 raft_consensus.cc:385] T 4a3151a793f54182a82f23d4acb34d39 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.517580 24809 raft_consensus.cc:740] T 4a3151a793f54182a82f23d4acb34d39 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48f59673e33a4636acca78951e868651, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.518561 24809 consensus_queue.cc:260] T 4a3151a793f54182a82f23d4acb34d39 P 48f59673e33a4636acca78951e868651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.521852 24809 ts_tablet_manager.cc:1434] T 4a3151a793f54182a82f23d4acb34d39 P 48f59673e33a4636acca78951e868651: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.001s
I20260709 13:08:17.522320 24812 tablet_bootstrap.cc:654] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.522859 24809 tablet_bootstrap.cc:492] T e96515055d724359aaf1e626e5936bd2 P 48f59673e33a4636acca78951e868651: Bootstrap starting.
I20260709 13:08:17.523490 24810 tablet_bootstrap.cc:492] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8: No bootstrap required, opened a new log
I20260709 13:08:17.523967 24810 ts_tablet_manager.cc:1403] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8: Time spent bootstrapping tablet: real 0.049s	user 0.007s	sys 0.009s
I20260709 13:08:17.529740 24809 tablet_bootstrap.cc:654] T e96515055d724359aaf1e626e5936bd2 P 48f59673e33a4636acca78951e868651: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.528855 24416 catalog_manager.cc:5697] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48f59673e33a4636acca78951e868651 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "48f59673e33a4636acca78951e868651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:17.532361 24812 tablet_bootstrap.cc:492] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8: No bootstrap required, opened a new log
I20260709 13:08:17.531741 24416 catalog_manager.cc:5697] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48f59673e33a4636acca78951e868651 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "48f59673e33a4636acca78951e868651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:17.532891 24812 ts_tablet_manager.cc:1403] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.001s
I20260709 13:08:17.535141 24739 raft_consensus.cc:493] T e96515055d724359aaf1e626e5936bd2 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.535893 24739 raft_consensus.cc:515] T e96515055d724359aaf1e626e5936bd2 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.535889 24812 raft_consensus.cc:359] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.537071 24812 raft_consensus.cc:385] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.537351 24812 raft_consensus.cc:740] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.537745 24791 raft_consensus.cc:493] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.538655 24809 tablet_bootstrap.cc:492] T e96515055d724359aaf1e626e5936bd2 P 48f59673e33a4636acca78951e868651: No bootstrap required, opened a new log
I20260709 13:08:17.538270 24791 raft_consensus.cc:515] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.538151 24812 consensus_queue.cc:260] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.539177 24809 ts_tablet_manager.cc:1403] T e96515055d724359aaf1e626e5936bd2 P 48f59673e33a4636acca78951e868651: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 13:08:17.540467 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96515055d724359aaf1e626e5936bd2" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651" is_pre_election: true
I20260709 13:08:17.540592 24791 leader_election.cc:290] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:17.540767 24812 ts_tablet_manager.cc:1434] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:08:17.541708 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96515055d724359aaf1e626e5936bd2" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8" is_pre_election: true
I20260709 13:08:17.541982 24812 tablet_bootstrap.cc:492] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8: Bootstrap starting.
I20260709 13:08:17.542699 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3151a793f54182a82f23d4acb34d39" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8" is_pre_election: true
W20260709 13:08:17.543119 24483 leader_election.cc:343] T e96515055d724359aaf1e626e5936bd2 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 48f59673e33a4636acca78951e868651 (127.11.44.195:39911): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:17.543368 24519 raft_consensus.cc:2468] T 4a3151a793f54182a82f23d4acb34d39 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 0.
W20260709 13:08:17.545133 24485 leader_election.cc:343] T e96515055d724359aaf1e626e5936bd2 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:08:17.545647 24485 leader_election.cc:304] T e96515055d724359aaf1e626e5936bd2 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3378e831c4f417a81e4cd63bde179a8; no voters: 26b8e896a2a74a22999486af393f83f8, 48f59673e33a4636acca78951e868651
I20260709 13:08:17.545936 24560 leader_election.cc:304] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:17.546519 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3151a793f54182a82f23d4acb34d39" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651" is_pre_election: true
I20260709 13:08:17.547092 24808 raft_consensus.cc:2804] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:17.547171 24668 raft_consensus.cc:2468] T 4a3151a793f54182a82f23d4acb34d39 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 0.
I20260709 13:08:17.547663 24808 raft_consensus.cc:493] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.548161 24808 raft_consensus.cc:3060] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.542004 24809 raft_consensus.cc:359] T e96515055d724359aaf1e626e5936bd2 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.549682 24812 tablet_bootstrap.cc:654] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.549821 24809 raft_consensus.cc:385] T e96515055d724359aaf1e626e5936bd2 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.549877 24739 leader_election.cc:290] T e96515055d724359aaf1e626e5936bd2 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:17.550351 24809 raft_consensus.cc:740] T e96515055d724359aaf1e626e5936bd2 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48f59673e33a4636acca78951e868651, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.551484 24809 consensus_queue.cc:260] T e96515055d724359aaf1e626e5936bd2 P 48f59673e33a4636acca78951e868651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.553097 24739 raft_consensus.cc:2749] T e96515055d724359aaf1e626e5936bd2 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:17.554149 24809 ts_tablet_manager.cc:1434] T e96515055d724359aaf1e626e5936bd2 P 48f59673e33a4636acca78951e868651: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:08:17.561249 24812 tablet_bootstrap.cc:492] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8: No bootstrap required, opened a new log
I20260709 13:08:17.561838 24812 ts_tablet_manager.cc:1403] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.008s
I20260709 13:08:17.526764 24810 raft_consensus.cc:359] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.562047 24809 tablet_bootstrap.cc:492] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651: Bootstrap starting.
I20260709 13:08:17.562924 24808 raft_consensus.cc:515] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.564724 24812 raft_consensus.cc:359] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.565433 24812 raft_consensus.cc:385] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.565733 24812 raft_consensus.cc:740] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.566001 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3151a793f54182a82f23d4acb34d39" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
I20260709 13:08:17.566635 24519 raft_consensus.cc:3060] T 4a3151a793f54182a82f23d4acb34d39 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.566546 24812 consensus_queue.cc:260] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.568974 24812 ts_tablet_manager.cc:1434] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:08:17.570554 24809 tablet_bootstrap.cc:654] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.569953 24812 tablet_bootstrap.cc:492] T ab8d263e522342d0b92bb31689822558 P 26b8e896a2a74a22999486af393f83f8: Bootstrap starting.
I20260709 13:08:17.577010 24519 raft_consensus.cc:2468] T 4a3151a793f54182a82f23d4acb34d39 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 1.
I20260709 13:08:17.579228 24560 leader_election.cc:304] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:17.579909 24812 tablet_bootstrap.cc:654] T ab8d263e522342d0b92bb31689822558 P 26b8e896a2a74a22999486af393f83f8: Neither blocks nor log segments found. Creating new log.
I20260709 13:08:17.580480 24791 raft_consensus.cc:2804] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:17.585520 24808 leader_election.cc:290] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 election: Requested vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:17.586071 24810 raft_consensus.cc:385] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.586498 24810 raft_consensus.cc:740] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.586756 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a3151a793f54182a82f23d4acb34d39" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:17.587392 24668 raft_consensus.cc:3060] T 4a3151a793f54182a82f23d4acb34d39 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.587425 24810 consensus_queue.cc:260] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.590153 24810 ts_tablet_manager.cc:1434] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260709 13:08:17.593412 24809 tablet_bootstrap.cc:492] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651: No bootstrap required, opened a new log
I20260709 13:08:17.594314 24809 ts_tablet_manager.cc:1403] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.011s
I20260709 13:08:17.596180 24668 raft_consensus.cc:2468] T 4a3151a793f54182a82f23d4acb34d39 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 1.
I20260709 13:08:17.597746 24809 raft_consensus.cc:359] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.598609 24809 raft_consensus.cc:385] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.598905 24809 raft_consensus.cc:740] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48f59673e33a4636acca78951e868651, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.599677 24809 consensus_queue.cc:260] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.602504 24809 ts_tablet_manager.cc:1434] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:08:17.605427 24812 tablet_bootstrap.cc:492] T ab8d263e522342d0b92bb31689822558 P 26b8e896a2a74a22999486af393f83f8: No bootstrap required, opened a new log
I20260709 13:08:17.606046 24812 ts_tablet_manager.cc:1403] T ab8d263e522342d0b92bb31689822558 P 26b8e896a2a74a22999486af393f83f8: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.000s
I20260709 13:08:17.606631 24750 raft_consensus.cc:493] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.607188 24750 raft_consensus.cc:515] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.609159 24750 leader_election.cc:290] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553)
I20260709 13:08:17.610610 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbe51dfac234c36b8d00ea89ce862ed" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8" is_pre_election: true
I20260709 13:08:17.611188 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbe51dfac234c36b8d00ea89ce862ed" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8" is_pre_election: true
I20260709 13:08:17.611398 24808 raft_consensus.cc:493] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.611959 24808 raft_consensus.cc:515] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.613003 24594 raft_consensus.cc:2468] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 0.
I20260709 13:08:17.614089 24808 leader_election.cc:290] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:17.609037 24812 raft_consensus.cc:359] T ab8d263e522342d0b92bb31689822558 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.614776 24812 raft_consensus.cc:385] T ab8d263e522342d0b92bb31689822558 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:08:17.614940 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbe51dfac234c36b8d00ea89ce862ed" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8" is_pre_election: true
I20260709 13:08:17.611968 24519 raft_consensus.cc:2468] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 0.
I20260709 13:08:17.615556 24634 leader_election.cc:304] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, 48f59673e33a4636acca78951e868651; no voters: 
I20260709 13:08:17.616406 24791 raft_consensus.cc:697] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8 [term 1 LEADER]: Becoming Leader. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Running, Role: LEADER
I20260709 13:08:17.616679 24750 raft_consensus.cc:2804] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:17.617098 24750 raft_consensus.cc:493] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.615085 24812 raft_consensus.cc:740] T ab8d263e522342d0b92bb31689822558 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Initialized, Role: FOLLOWER
I20260709 13:08:17.617430 24750 raft_consensus.cc:3060] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.617352 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbe51dfac234c36b8d00ea89ce862ed" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651" is_pre_election: true
I20260709 13:08:17.617940 24812 consensus_queue.cc:260] T ab8d263e522342d0b92bb31689822558 P 26b8e896a2a74a22999486af393f83f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.617375 24791 consensus_queue.cc:237] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.622306 24808 raft_consensus.cc:493] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.622861 24808 raft_consensus.cc:515] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.623862 24812 ts_tablet_manager.cc:1434] T ab8d263e522342d0b92bb31689822558 P 26b8e896a2a74a22999486af393f83f8: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:08:17.624945 24808 leader_election.cc:290] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:17.626060 24750 raft_consensus.cc:515] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.625685 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a558c4fbb0cb4e078e2c117a00e871c3" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8" is_pre_election: true
I20260709 13:08:17.626415 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a558c4fbb0cb4e078e2c117a00e871c3" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651" is_pre_election: true
I20260709 13:08:17.627755 24520 raft_consensus.cc:2468] T a558c4fbb0cb4e078e2c117a00e871c3 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 0.
I20260709 13:08:17.627964 24668 raft_consensus.cc:2393] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 26b8e896a2a74a22999486af393f83f8 in current term 1: Already voted for candidate 48f59673e33a4636acca78951e868651 in this term.
I20260709 13:08:17.628393 24667 raft_consensus.cc:2468] T a558c4fbb0cb4e078e2c117a00e871c3 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 0.
I20260709 13:08:17.629262 24560 leader_election.cc:304] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:17.630792 24750 leader_election.cc:290] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 election: Requested vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553)
I20260709 13:08:17.630879 24558 leader_election.cc:304] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8; no voters: 48f59673e33a4636acca78951e868651, c3378e831c4f417a81e4cd63bde179a8
I20260709 13:08:17.631476 24850 raft_consensus.cc:2804] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:17.632061 24850 raft_consensus.cc:493] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.632120 24808 raft_consensus.cc:3060] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.632555 24850 raft_consensus.cc:3060] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.634150 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbe51dfac234c36b8d00ea89ce862ed" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
I20260709 13:08:17.634824 24520 raft_consensus.cc:3060] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.639039 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbe51dfac234c36b8d00ea89ce862ed" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8"
I20260709 13:08:17.642045 24808 raft_consensus.cc:2749] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:08:17.642292 24850 raft_consensus.cc:515] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.642681 24520 raft_consensus.cc:2468] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 1.
I20260709 13:08:17.645910 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a558c4fbb0cb4e078e2c117a00e871c3" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
I20260709 13:08:17.646567 24519 raft_consensus.cc:3060] T a558c4fbb0cb4e078e2c117a00e871c3 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.646445 24414 catalog_manager.cc:5697] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26b8e896a2a74a22999486af393f83f8 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "26b8e896a2a74a22999486af393f83f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:17.647967 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a558c4fbb0cb4e078e2c117a00e871c3" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:17.648603 24668 raft_consensus.cc:3060] T a558c4fbb0cb4e078e2c117a00e871c3 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.654143 24634 leader_election.cc:304] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48f59673e33a4636acca78951e868651, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:17.654495 24519 raft_consensus.cc:2468] T a558c4fbb0cb4e078e2c117a00e871c3 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 1.
I20260709 13:08:17.645349 24850 leader_election.cc:290] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 election: Requested vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:17.662406 24560 leader_election.cc:304] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:17.663335 24850 raft_consensus.cc:2804] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:17.663846 24850 raft_consensus.cc:697] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8 [term 1 LEADER]: Becoming Leader. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Running, Role: LEADER
I20260709 13:08:17.664705 24750 raft_consensus.cc:2804] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:17.664749 24850 consensus_queue.cc:237] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.665462 24750 raft_consensus.cc:697] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Becoming Leader. State: Replica: 48f59673e33a4636acca78951e868651, State: Running, Role: LEADER
I20260709 13:08:17.665776 24668 raft_consensus.cc:2468] T a558c4fbb0cb4e078e2c117a00e871c3 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 1.
I20260709 13:08:17.666910 24750 consensus_queue.cc:237] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.667932 24594 raft_consensus.cc:2468] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 1.
I20260709 13:08:17.679975 24414 catalog_manager.cc:5697] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26b8e896a2a74a22999486af393f83f8 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "26b8e896a2a74a22999486af393f83f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:17.681289 24416 catalog_manager.cc:5697] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48f59673e33a4636acca78951e868651 (127.11.44.195). New cstate: current_term: 1 leader_uuid: "48f59673e33a4636acca78951e868651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:17.691604 24791 raft_consensus.cc:493] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.692175 24791 raft_consensus.cc:515] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.693902 24791 leader_election.cc:290] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:17.694710 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96515055d724359aaf1e626e5936bd2" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8" is_pre_election: true
I20260709 13:08:17.695034 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96515055d724359aaf1e626e5936bd2" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651" is_pre_election: true
I20260709 13:08:17.695362 24519 raft_consensus.cc:2468] T e96515055d724359aaf1e626e5936bd2 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 0.
I20260709 13:08:17.695783 24668 raft_consensus.cc:2468] T e96515055d724359aaf1e626e5936bd2 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 0.
I20260709 13:08:17.696398 24560 leader_election.cc:304] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:17.697497 24791 raft_consensus.cc:2804] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:17.697861 24791 raft_consensus.cc:493] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.698133 24791 raft_consensus.cc:3060] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.703263 24791 raft_consensus.cc:515] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.704921 24791 leader_election.cc:290] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 election: Requested vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:17.705776 24519 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96515055d724359aaf1e626e5936bd2" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
I20260709 13:08:17.705940 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e96515055d724359aaf1e626e5936bd2" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:17.706336 24519 raft_consensus.cc:3060] T e96515055d724359aaf1e626e5936bd2 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.706542 24668 raft_consensus.cc:3060] T e96515055d724359aaf1e626e5936bd2 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.711828 24668 raft_consensus.cc:2468] T e96515055d724359aaf1e626e5936bd2 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 1.
I20260709 13:08:17.711830 24519 raft_consensus.cc:2468] T e96515055d724359aaf1e626e5936bd2 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 1.
I20260709 13:08:17.712966 24558 leader_election.cc:304] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, 48f59673e33a4636acca78951e868651; no voters: 
I20260709 13:08:17.713838 24791 raft_consensus.cc:2804] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:17.714227 24791 raft_consensus.cc:697] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8 [term 1 LEADER]: Becoming Leader. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Running, Role: LEADER
I20260709 13:08:17.714929 24791 consensus_queue.cc:237] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.723624 24416 catalog_manager.cc:5697] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 26b8e896a2a74a22999486af393f83f8 (127.11.44.194). New cstate: current_term: 1 leader_uuid: "26b8e896a2a74a22999486af393f83f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:17.729189 24466 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:08:17.802939 24791 consensus_queue.cc:1048] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:17.817199 24850 consensus_queue.cc:1048] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:17.825297 24739 raft_consensus.cc:493] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.825984 24739 raft_consensus.cc:515] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.827903 24739 leader_election.cc:290] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:17.829120 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8d263e522342d0b92bb31689822558" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651" is_pre_election: true
I20260709 13:08:17.829869 24668 raft_consensus.cc:2468] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 0.
I20260709 13:08:17.828912 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8d263e522342d0b92bb31689822558" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8" is_pre_election: true
I20260709 13:08:17.830839 24594 raft_consensus.cc:2468] T ab8d263e522342d0b92bb31689822558 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 0.
I20260709 13:08:17.831984 24485 leader_election.cc:304] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:17.835479 24739 raft_consensus.cc:2804] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:08:17.836143 24739 raft_consensus.cc:493] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.836623 24739 raft_consensus.cc:3060] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.843071 24739 raft_consensus.cc:515] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.846360 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8d263e522342d0b92bb31689822558" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "26b8e896a2a74a22999486af393f83f8"
I20260709 13:08:17.846956 24594 raft_consensus.cc:3060] T ab8d263e522342d0b92bb31689822558 P 26b8e896a2a74a22999486af393f83f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.853060 24594 raft_consensus.cc:2468] T ab8d263e522342d0b92bb31689822558 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 1.
I20260709 13:08:17.853977 24739 leader_election.cc:290] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 election: Requested vote from peers 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:17.854293 24485 leader_election.cc:304] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:17.855110 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8d263e522342d0b92bb31689822558" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:17.855340 24739 raft_consensus.cc:2804] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:08:17.855623 24668 raft_consensus.cc:3060] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:08:17.856626 24739 raft_consensus.cc:697] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Becoming Leader. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Running, Role: LEADER
I20260709 13:08:17.857520 24739 consensus_queue.cc:237] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:17.861271 24668 raft_consensus.cc:2468] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 1.
I20260709 13:08:17.865541 24414 catalog_manager.cc:5697] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193). New cstate: current_term: 1 leader_uuid: "c3378e831c4f417a81e4cd63bde179a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:17.892488 24750 consensus_queue.cc:1048] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:17.902575 24836 consensus_queue.cc:1048] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:17.907720 24836 consensus_queue.cc:1048] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:17.921814 24835 consensus_queue.cc:1048] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:17.951170 24668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6d070792e14439dbe52e09e8db9daf8"
dest_uuid: "48f59673e33a4636acca78951e868651"
mode: GRACEFUL
new_leader_uuid: "c3378e831c4f417a81e4cd63bde179a8"
 from {username='slave'} at 127.0.0.1:59108
I20260709 13:08:17.951766 24668 raft_consensus.cc:606] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Received request to transfer leadership to TS c3378e831c4f417a81e4cd63bde179a8
I20260709 13:08:17.957767 24668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ccf6ea4c3b545b986a671f5a9d6396b"
dest_uuid: "48f59673e33a4636acca78951e868651"
mode: GRACEFUL
new_leader_uuid: "c3378e831c4f417a81e4cd63bde179a8"
 from {username='slave'} at 127.0.0.1:59108
I20260709 13:08:17.958263 24668 raft_consensus.cc:606] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Received request to transfer leadership to TS c3378e831c4f417a81e4cd63bde179a8
I20260709 13:08:17.963688 24668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cbe51dfac234c36b8d00ea89ce862ed"
dest_uuid: "48f59673e33a4636acca78951e868651"
mode: GRACEFUL
new_leader_uuid: "c3378e831c4f417a81e4cd63bde179a8"
 from {username='slave'} at 127.0.0.1:59108
I20260709 13:08:17.964191 24668 raft_consensus.cc:606] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Received request to transfer leadership to TS c3378e831c4f417a81e4cd63bde179a8
I20260709 13:08:17.969761 24594 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b74af9c5ab79476989c0fb06d7307239"
dest_uuid: "26b8e896a2a74a22999486af393f83f8"
mode: GRACEFUL
new_leader_uuid: "c3378e831c4f417a81e4cd63bde179a8"
 from {username='slave'} at 127.0.0.1:59718
I20260709 13:08:17.970249 24594 raft_consensus.cc:606] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [term 1 LEADER]: Received request to transfer leadership to TS c3378e831c4f417a81e4cd63bde179a8
I20260709 13:08:17.975466 24668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a42a90385ae49ddab7d0531125c9446"
dest_uuid: "48f59673e33a4636acca78951e868651"
mode: GRACEFUL
new_leader_uuid: "26b8e896a2a74a22999486af393f83f8"
 from {username='slave'} at 127.0.0.1:59108
I20260709 13:08:17.975921 24668 raft_consensus.cc:606] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Received request to transfer leadership to TS 26b8e896a2a74a22999486af393f83f8
I20260709 13:08:17.990414 24519 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab8d263e522342d0b92bb31689822558"
dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
mode: GRACEFUL
new_leader_uuid: "48f59673e33a4636acca78951e868651"
 from {username='slave'} at 127.0.0.1:42276
I20260709 13:08:17.990976 24519 raft_consensus.cc:606] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Received request to transfer leadership to TS 48f59673e33a4636acca78951e868651
I20260709 13:08:17.991776 24835 consensus_queue.cc:1048] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:18.003063 24836 consensus_queue.cc:1048] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:18.011504 24750 raft_consensus.cc:993] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651: : Instructing follower c3378e831c4f417a81e4cd63bde179a8 to start an election
I20260709 13:08:18.012039 24836 raft_consensus.cc:1081] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Signalling peer c3378e831c4f417a81e4cd63bde179a8 to start an election
I20260709 13:08:18.013718 24519 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ccf6ea4c3b545b986a671f5a9d6396b"
dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
 from {username='slave'} at 127.0.0.1:42252
I20260709 13:08:18.014393 24519 raft_consensus.cc:493] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.014716 24519 raft_consensus.cc:3060] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.019809 24519 raft_consensus.cc:515] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:18.021450 24519 leader_election.cc:290] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 2 election: Requested vote from peers 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:18.022301 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ccf6ea4c3b545b986a671f5a9d6396b" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26b8e896a2a74a22999486af393f83f8"
I20260709 13:08:18.022924 24594 raft_consensus.cc:3060] T 8ccf6ea4c3b545b986a671f5a9d6396b P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.022894 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ccf6ea4c3b545b986a671f5a9d6396b" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:18.023768 24668 raft_consensus.cc:3055] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:18.024075 24668 raft_consensus.cc:740] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48f59673e33a4636acca78951e868651, State: Running, Role: LEADER
I20260709 13:08:18.024782 24668 consensus_queue.cc:260] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:18.026000 24668 raft_consensus.cc:3060] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.029928 24594 raft_consensus.cc:2468] T 8ccf6ea4c3b545b986a671f5a9d6396b P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 2.
I20260709 13:08:18.031147 24485 leader_election.cc:304] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:18.031870 24739 raft_consensus.cc:2804] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:18.032235 24668 raft_consensus.cc:2468] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 2.
I20260709 13:08:18.032336 24739 raft_consensus.cc:697] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [term 2 LEADER]: Becoming Leader. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Running, Role: LEADER
I20260709 13:08:18.033516 24739 consensus_queue.cc:237] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:18.040288 24414 catalog_manager.cc:5697] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 reported cstate change: term changed from 1 to 2, leader changed from 48f59673e33a4636acca78951e868651 (127.11.44.195) to c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "c3378e831c4f417a81e4cd63bde179a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.106977 24850 consensus_queue.cc:1048] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:18.118635 24791 consensus_queue.cc:1048] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:18.144407 24836 consensus_queue.cc:1048] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:18.154237 24836 consensus_queue.cc:1048] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:18.162264 24835 raft_consensus.cc:993] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651: : Instructing follower c3378e831c4f417a81e4cd63bde179a8 to start an election
I20260709 13:08:18.162781 24836 raft_consensus.cc:1081] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Signalling peer c3378e831c4f417a81e4cd63bde179a8 to start an election
I20260709 13:08:18.164467 24519 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cbe51dfac234c36b8d00ea89ce862ed"
dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
 from {username='slave'} at 127.0.0.1:42252
I20260709 13:08:18.165108 24519 raft_consensus.cc:493] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.165462 24519 raft_consensus.cc:3060] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.170416 24808 consensus_queue.cc:1048] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:18.172092 24519 raft_consensus.cc:515] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:18.174324 24519 leader_election.cc:290] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 2 election: Requested vote from peers 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:18.175179 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbe51dfac234c36b8d00ea89ce862ed" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26b8e896a2a74a22999486af393f83f8"
I20260709 13:08:18.175532 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cbe51dfac234c36b8d00ea89ce862ed" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:18.175840 24594 raft_consensus.cc:3060] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.176071 24668 raft_consensus.cc:3055] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:18.176388 24668 raft_consensus.cc:740] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48f59673e33a4636acca78951e868651, State: Running, Role: LEADER
I20260709 13:08:18.177155 24668 consensus_queue.cc:260] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:18.178548 24668 raft_consensus.cc:3060] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.183642 24791 consensus_queue.cc:1048] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:08:18.185781 24668 raft_consensus.cc:2468] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 2.
I20260709 13:08:18.187155 24483 leader_election.cc:304] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48f59673e33a4636acca78951e868651, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:18.188591 24739 raft_consensus.cc:2804] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:18.189034 24739 raft_consensus.cc:697] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [term 2 LEADER]: Becoming Leader. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Running, Role: LEADER
I20260709 13:08:18.189877 24739 consensus_queue.cc:237] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:18.197783 24594 raft_consensus.cc:2468] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 2.
I20260709 13:08:18.201792 24415 catalog_manager.cc:5697] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 reported cstate change: term changed from 1 to 2, leader changed from 48f59673e33a4636acca78951e868651 (127.11.44.195) to c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "c3378e831c4f417a81e4cd63bde179a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.235287 24791 consensus_queue.cc:1048] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:18.248155 24791 consensus_queue.cc:1048] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:18.281987 24791 raft_consensus.cc:993] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8: : Instructing follower c3378e831c4f417a81e4cd63bde179a8 to start an election
I20260709 13:08:18.282528 24853 raft_consensus.cc:1081] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [term 1 LEADER]: Signalling peer c3378e831c4f417a81e4cd63bde179a8 to start an election
I20260709 13:08:18.284220 24520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b74af9c5ab79476989c0fb06d7307239"
dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
 from {username='slave'} at 127.0.0.1:42260
I20260709 13:08:18.284677 24520 raft_consensus.cc:493] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.284958 24520 raft_consensus.cc:3060] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.289811 24520 raft_consensus.cc:515] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:18.291155 24520 leader_election.cc:290] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 2 election: Requested vote from peers 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:18.292006 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74af9c5ab79476989c0fb06d7307239" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26b8e896a2a74a22999486af393f83f8"
I20260709 13:08:18.292384 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b74af9c5ab79476989c0fb06d7307239" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:18.292565 24594 raft_consensus.cc:3055] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:18.292976 24667 raft_consensus.cc:3060] T b74af9c5ab79476989c0fb06d7307239 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.292958 24594 raft_consensus.cc:740] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Running, Role: LEADER
I20260709 13:08:18.293905 24594 consensus_queue.cc:260] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:18.294793 24594 raft_consensus.cc:3060] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.298552 24667 raft_consensus.cc:2468] T b74af9c5ab79476989c0fb06d7307239 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 2.
I20260709 13:08:18.299146 24594 raft_consensus.cc:2468] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 2.
I20260709 13:08:18.299954 24483 leader_election.cc:304] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48f59673e33a4636acca78951e868651, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:18.300733 24739 raft_consensus.cc:2804] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:18.301164 24739 raft_consensus.cc:697] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8 [term 2 LEADER]: Becoming Leader. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Running, Role: LEADER
I20260709 13:08:18.301795 24739 consensus_queue.cc:237] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:18.308102 24414 catalog_manager.cc:5697] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8 reported cstate change: term changed from 1 to 2, leader changed from 26b8e896a2a74a22999486af393f83f8 (127.11.44.194) to c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "c3378e831c4f417a81e4cd63bde179a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.337533 24750 raft_consensus.cc:993] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651: : Instructing follower c3378e831c4f417a81e4cd63bde179a8 to start an election
I20260709 13:08:18.338076 24836 raft_consensus.cc:1081] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Signalling peer c3378e831c4f417a81e4cd63bde179a8 to start an election
I20260709 13:08:18.339613 24520 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6d070792e14439dbe52e09e8db9daf8"
dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
 from {username='slave'} at 127.0.0.1:42252
I20260709 13:08:18.340126 24520 raft_consensus.cc:493] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.340448 24520 raft_consensus.cc:3060] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.345124 24520 raft_consensus.cc:515] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:18.346944 24520 leader_election.cc:290] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 2 election: Requested vote from peers 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:18.347892 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d070792e14439dbe52e09e8db9daf8" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26b8e896a2a74a22999486af393f83f8"
I20260709 13:08:18.348369 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6d070792e14439dbe52e09e8db9daf8" candidate_uuid: "c3378e831c4f417a81e4cd63bde179a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:18.348541 24594 raft_consensus.cc:3060] T b6d070792e14439dbe52e09e8db9daf8 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.349066 24667 raft_consensus.cc:3055] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:18.349380 24667 raft_consensus.cc:740] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48f59673e33a4636acca78951e868651, State: Running, Role: LEADER
I20260709 13:08:18.350220 24667 consensus_queue.cc:260] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:18.351577 24667 raft_consensus.cc:3060] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.354354 24594 raft_consensus.cc:2468] T b6d070792e14439dbe52e09e8db9daf8 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 2.
I20260709 13:08:18.355428 24485 leader_election.cc:304] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:18.356201 24739 raft_consensus.cc:2804] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:18.357059 24667 raft_consensus.cc:2468] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3378e831c4f417a81e4cd63bde179a8 in term 2.
I20260709 13:08:18.356751 24739 raft_consensus.cc:697] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8 [term 2 LEADER]: Becoming Leader. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Running, Role: LEADER
I20260709 13:08:18.358629 24739 consensus_queue.cc:237] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:18.365074 24414 catalog_manager.cc:5697] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8 reported cstate change: term changed from 1 to 2, leader changed from 48f59673e33a4636acca78951e868651 (127.11.44.195) to c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193). New cstate: current_term: 2 leader_uuid: "c3378e831c4f417a81e4cd63bde179a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.383675 24739 consensus_queue.cc:1048] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:18.396019 24879 consensus_queue.cc:1048] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:08:18.408346 24862 raft_consensus.cc:993] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8: : Instructing follower 48f59673e33a4636acca78951e868651 to start an election
I20260709 13:08:18.409076 24879 raft_consensus.cc:1081] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Signalling peer 48f59673e33a4636acca78951e868651 to start an election
I20260709 13:08:18.410722 24668 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab8d263e522342d0b92bb31689822558"
dest_uuid: "48f59673e33a4636acca78951e868651"
 from {username='slave'} at 127.0.0.1:59090
I20260709 13:08:18.411196 24668 raft_consensus.cc:493] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.411474 24668 raft_consensus.cc:3060] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.416533 24668 raft_consensus.cc:515] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:18.418273 24668 leader_election.cc:290] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 2 election: Requested vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553)
I20260709 13:08:18.419162 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8d263e522342d0b92bb31689822558" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
I20260709 13:08:18.419469 24594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab8d263e522342d0b92bb31689822558" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "26b8e896a2a74a22999486af393f83f8"
I20260709 13:08:18.419857 24520 raft_consensus.cc:3055] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:18.419991 24594 raft_consensus.cc:3060] T ab8d263e522342d0b92bb31689822558 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.420274 24520 raft_consensus.cc:740] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Running, Role: LEADER
I20260709 13:08:18.421134 24520 consensus_queue.cc:260] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:18.422341 24520 raft_consensus.cc:3060] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.426782 24594 raft_consensus.cc:2468] T ab8d263e522342d0b92bb31689822558 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 2.
I20260709 13:08:18.428000 24634 leader_election.cc:304] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, 48f59673e33a4636acca78951e868651; no voters: 
I20260709 13:08:18.428503 24520 raft_consensus.cc:2468] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 2.
I20260709 13:08:18.428671 24835 raft_consensus.cc:2804] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:18.429168 24835 raft_consensus.cc:697] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651 [term 2 LEADER]: Becoming Leader. State: Replica: 48f59673e33a4636acca78951e868651, State: Running, Role: LEADER
I20260709 13:08:18.430042 24835 consensus_queue.cc:237] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:18.436926 24415 catalog_manager.cc:5697] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651 reported cstate change: term changed from 1 to 2, leader changed from c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193) to 48f59673e33a4636acca78951e868651 (127.11.44.195). New cstate: current_term: 2 leader_uuid: "48f59673e33a4636acca78951e868651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:18.488838 24750 raft_consensus.cc:993] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651: : Instructing follower 26b8e896a2a74a22999486af393f83f8 to start an election
I20260709 13:08:18.489419 24835 raft_consensus.cc:1081] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Signalling peer 26b8e896a2a74a22999486af393f83f8 to start an election
I20260709 13:08:18.490942 24594 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a42a90385ae49ddab7d0531125c9446"
dest_uuid: "26b8e896a2a74a22999486af393f83f8"
 from {username='slave'} at 127.0.0.1:59698
I20260709 13:08:18.491405 24594 raft_consensus.cc:493] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:18.491686 24594 raft_consensus.cc:3060] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.496147 24594 raft_consensus.cc:515] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:18.497633 24594 leader_election.cc:290] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 2 election: Requested vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 48f59673e33a4636acca78951e868651 (127.11.44.195:39911)
I20260709 13:08:18.498723 24520 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a42a90385ae49ddab7d0531125c9446" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
I20260709 13:08:18.498723 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a42a90385ae49ddab7d0531125c9446" candidate_uuid: "26b8e896a2a74a22999486af393f83f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "48f59673e33a4636acca78951e868651"
I20260709 13:08:18.499428 24520 raft_consensus.cc:3060] T 8a42a90385ae49ddab7d0531125c9446 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.499507 24668 raft_consensus.cc:3055] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:08:18.499934 24668 raft_consensus.cc:740] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 48f59673e33a4636acca78951e868651, State: Running, Role: LEADER
I20260709 13:08:18.500674 24668 consensus_queue.cc:260] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:18.501845 24668 raft_consensus.cc:3060] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:08:18.504447 24520 raft_consensus.cc:2468] T 8a42a90385ae49ddab7d0531125c9446 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 2.
I20260709 13:08:18.505589 24560 leader_election.cc:304] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:18.506330 24853 raft_consensus.cc:2804] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:08:18.506747 24853 raft_consensus.cc:697] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8 [term 2 LEADER]: Becoming Leader. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Running, Role: LEADER
I20260709 13:08:18.507236 24668 raft_consensus.cc:2468] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 26b8e896a2a74a22999486af393f83f8 in term 2.
I20260709 13:08:18.507484 24853 consensus_queue.cc:237] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:18.515305 24415 catalog_manager.cc:5697] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8 reported cstate change: term changed from 1 to 2, leader changed from 48f59673e33a4636acca78951e868651 (127.11.44.195) to 26b8e896a2a74a22999486af393f83f8 (127.11.44.194). New cstate: current_term: 2 leader_uuid: "26b8e896a2a74a22999486af393f83f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:18.531952 24667 raft_consensus.cc:1275] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Refusing update from remote peer c3378e831c4f417a81e4cd63bde179a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:18.533249 24862 consensus_queue.cc:1048] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:08:18.542091 24594 raft_consensus.cc:1275] T 8ccf6ea4c3b545b986a671f5a9d6396b P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Refusing update from remote peer c3378e831c4f417a81e4cd63bde179a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:18.544364 24879 consensus_queue.cc:1048] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:08:18.727242 24594 raft_consensus.cc:1275] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Refusing update from remote peer c3378e831c4f417a81e4cd63bde179a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:18.728637 24879 consensus_queue.cc:1048] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:18.738644 24667 raft_consensus.cc:1275] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Refusing update from remote peer c3378e831c4f417a81e4cd63bde179a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:18.740096 24879 consensus_queue.cc:1048] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:18.753337 24667 raft_consensus.cc:1275] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Refusing update from remote peer c3378e831c4f417a81e4cd63bde179a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:18.754979 24739 consensus_queue.cc:1048] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:18.765586 24594 raft_consensus.cc:1275] T b6d070792e14439dbe52e09e8db9daf8 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Refusing update from remote peer c3378e831c4f417a81e4cd63bde179a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:18.766995 24862 consensus_queue.cc:1048] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:18.785099 24594 raft_consensus.cc:1275] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Refusing update from remote peer c3378e831c4f417a81e4cd63bde179a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:18.786527 24862 consensus_queue.cc:1048] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:18.794667 24668 raft_consensus.cc:1275] T b74af9c5ab79476989c0fb06d7307239 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Refusing update from remote peer c3378e831c4f417a81e4cd63bde179a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:18.796202 24739 consensus_queue.cc:1048] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:18.810369 24594 raft_consensus.cc:1275] T ab8d263e522342d0b92bb31689822558 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Refusing update from remote peer 48f59673e33a4636acca78951e868651: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:18.811803 24835 consensus_queue.cc:1048] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:18.819960 24520 raft_consensus.cc:1275] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Refusing update from remote peer 48f59673e33a4636acca78951e868651: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:18.821492 24836 consensus_queue.cc:1048] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:18.904084 24668 raft_consensus.cc:1275] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Refusing update from remote peer 26b8e896a2a74a22999486af393f83f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:18.905470 24791 consensus_queue.cc:1048] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:18.915544 24520 raft_consensus.cc:1275] T 8a42a90385ae49ddab7d0531125c9446 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Refusing update from remote peer 26b8e896a2a74a22999486af393f83f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:08:18.917497 24853 consensus_queue.cc:1048] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:08:20.994889 24414 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49954:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:08:21.016631 24414 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49954:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:08:21.045568 11443 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:21.106844 24914 tablet.cc:1724] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:21.143651 24920 tablet.cc:1724] T b6d070792e14439dbe52e09e8db9daf8 P 26b8e896a2a74a22999486af393f83f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:08:21.309574 24483 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:39911, user_credentials={real_user=slave}} blocked reactor thread for 56412.2us
I20260709 13:08:21.309300 24942 tablet.cc:1724] T 4a3151a793f54182a82f23d4acb34d39 P 48f59673e33a4636acca78951e868651: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:08:21.329288 24485 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.194:45553, user_credentials={real_user=slave}} blocked reactor thread for 80662.8us
I20260709 13:08:21.342538 24595 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67f0d862a4be40d68fdcfe809b66c897"
dest_uuid: "26b8e896a2a74a22999486af393f83f8"
mode: GRACEFUL
new_leader_uuid: "48f59673e33a4636acca78951e868651"
 from {username='slave'} at 127.0.0.1:59734
I20260709 13:08:21.343330 24595 raft_consensus.cc:606] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [term 2 LEADER]: Received request to transfer leadership to TS 48f59673e33a4636acca78951e868651
I20260709 13:08:21.346031 24939 tablet.cc:1724] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:21.374197 24936 tablet.cc:1724] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:21.382254 24940 tablet.cc:1724] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:21.372334 24914 tablet.cc:1724] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:21.398721 24948 tablet.cc:1724] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:21.402220 24942 tablet.cc:1724] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:21.412817 24949 tablet.cc:1724] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:08:21.419282 24483 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:39911, user_credentials={real_user=slave}} blocked reactor thread for 95825us
I20260709 13:08:21.419797 24950 tablet.cc:1724] T b74af9c5ab79476989c0fb06d7307239 P 48f59673e33a4636acca78951e868651: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:21.384588 24920 tablet.cc:1724] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:21.429266 24947 tablet.cc:1724] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:21.452349 24936 tablet.cc:1724] T ab8d263e522342d0b92bb31689822558 P 26b8e896a2a74a22999486af393f83f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:21.459158 24952 tablet.cc:1724] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:21.464205 24920 tablet.cc:1724] T 8ccf6ea4c3b545b986a671f5a9d6396b P 26b8e896a2a74a22999486af393f83f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:21.468219 24949 tablet.cc:1724] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:21.469147 24955 tablet.cc:1724] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:08:21.484454 24483 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.195:39911, user_credentials={real_user=slave}} blocked reactor thread for 52816us
I20260709 13:08:21.489653 24520 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0eaf0a51afd41ee8b06d2f3c60da098"
dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
mode: GRACEFUL
new_leader_uuid: "48f59673e33a4636acca78951e868651"
 from {username='slave'} at 127.0.0.1:42278
I20260709 13:08:21.490262 24520 raft_consensus.cc:606] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [term 2 LEADER]: Received request to transfer leadership to TS 48f59673e33a4636acca78951e868651
I20260709 13:08:21.489748 24950 tablet.cc:1724] T e96515055d724359aaf1e626e5936bd2 P 48f59673e33a4636acca78951e868651: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:21.491719 11443 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:21.492429 11443 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:21.492935 24560 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.44.193:35831, user_credentials={real_user=slave}} blocked reactor thread for 243612us
I20260709 13:08:21.480979 24936 tablet.cc:1724] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:21.476851 24942 tablet.cc:1724] T a558c4fbb0cb4e078e2c117a00e871c3 P 48f59673e33a4636acca78951e868651: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:21.501677 24950 tablet.cc:1724] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:21.480894 24948 tablet.cc:1724] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:21.524114 24914 tablet.cc:1724] T a558c4fbb0cb4e078e2c117a00e871c3 P c3378e831c4f417a81e4cd63bde179a8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:21.540571 24947 tablet.cc:1724] T e96515055d724359aaf1e626e5936bd2 P c3378e831c4f417a81e4cd63bde179a8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:21.541414 24940 tablet.cc:1724] T 4a3151a793f54182a82f23d4acb34d39 P c3378e831c4f417a81e4cd63bde179a8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:21.545186 24939 tablet.cc:1724] T 8a42a90385ae49ddab7d0531125c9446 P c3378e831c4f417a81e4cd63bde179a8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:08:21.562500 24951 raft_consensus.cc:993] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8: : Instructing follower 48f59673e33a4636acca78951e868651 to start an election
I20260709 13:08:21.563206 24791 raft_consensus.cc:1081] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [term 2 LEADER]: Signalling peer 48f59673e33a4636acca78951e868651 to start an election
I20260709 13:08:21.565223 24662 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67f0d862a4be40d68fdcfe809b66c897"
dest_uuid: "48f59673e33a4636acca78951e868651"
 from {username='slave'} at 127.0.0.1:59100
I20260709 13:08:21.565820 24662 raft_consensus.cc:493] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.566169 24662 raft_consensus.cc:3060] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:21.604626 24662 raft_consensus.cc:515] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:21.606985 24662 leader_election.cc:290] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 3 election: Requested vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553)
I20260709 13:08:21.608804 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0d862a4be40d68fdcfe809b66c897" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "26b8e896a2a74a22999486af393f83f8"
I20260709 13:08:21.609440 24592 raft_consensus.cc:3055] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:21.610563 24592 raft_consensus.cc:740] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 26b8e896a2a74a22999486af393f83f8, State: Running, Role: LEADER
I20260709 13:08:21.611488 24592 consensus_queue.cc:260] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:21.612921 24592 raft_consensus.cc:3060] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:21.617571 24915 raft_consensus.cc:993] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8: : Instructing follower 48f59673e33a4636acca78951e868651 to start an election
I20260709 13:08:21.618191 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67f0d862a4be40d68fdcfe809b66c897" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
I20260709 13:08:21.618371 24915 raft_consensus.cc:1081] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [term 2 LEADER]: Signalling peer 48f59673e33a4636acca78951e868651 to start an election
I20260709 13:08:21.618870 24518 raft_consensus.cc:3060] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:21.620776 24667 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0eaf0a51afd41ee8b06d2f3c60da098"
dest_uuid: "48f59673e33a4636acca78951e868651"
 from {username='slave'} at 127.0.0.1:59090
I20260709 13:08:21.621366 24667 raft_consensus.cc:493] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:21.622682 24667 raft_consensus.cc:3060] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:21.629585 24592 raft_consensus.cc:2468] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 3.
I20260709 13:08:21.631469 24634 leader_election.cc:304] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 26b8e896a2a74a22999486af393f83f8, 48f59673e33a4636acca78951e868651; no voters: 
I20260709 13:08:21.633087 24518 raft_consensus.cc:2468] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 3.
I20260709 13:08:21.633112 24836 raft_consensus.cc:2804] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:21.634460 24836 raft_consensus.cc:697] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [term 3 LEADER]: Becoming Leader. State: Replica: 48f59673e33a4636acca78951e868651, State: Running, Role: LEADER
I20260709 13:08:21.635548 24836 consensus_queue.cc:237] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:21.636981 24414 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332: soft_deleted_table [id=20daab772ee84f228330e453a2d8708d] alter complete (version 1)
I20260709 13:08:21.646255 24667 raft_consensus.cc:515] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:21.648445 24667 leader_election.cc:290] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 3 election: Requested vote from peers c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831), 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553)
I20260709 13:08:21.654371 24518 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eaf0a51afd41ee8b06d2f3c60da098" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c3378e831c4f417a81e4cd63bde179a8"
I20260709 13:08:21.655004 24518 raft_consensus.cc:3055] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:08:21.655356 24518 raft_consensus.cc:740] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c3378e831c4f417a81e4cd63bde179a8, State: Running, Role: LEADER
I20260709 13:08:21.656152 24518 consensus_queue.cc:260] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:21.657526 24518 raft_consensus.cc:3060] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:21.658941 24592 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0eaf0a51afd41ee8b06d2f3c60da098" candidate_uuid: "48f59673e33a4636acca78951e868651" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "26b8e896a2a74a22999486af393f83f8"
I20260709 13:08:21.659687 24592 raft_consensus.cc:3060] T a0eaf0a51afd41ee8b06d2f3c60da098 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:08:21.664059 24416 catalog_manager.cc:5697] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 reported cstate change: term changed from 2 to 3, leader changed from 26b8e896a2a74a22999486af393f83f8 (127.11.44.194) to 48f59673e33a4636acca78951e868651 (127.11.44.195). New cstate: current_term: 3 leader_uuid: "48f59673e33a4636acca78951e868651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.668998 24518 raft_consensus.cc:2468] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 3.
I20260709 13:08:21.670526 24634 leader_election.cc:304] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48f59673e33a4636acca78951e868651, c3378e831c4f417a81e4cd63bde179a8; no voters: 
I20260709 13:08:21.671411 24836 raft_consensus.cc:2804] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:08:21.672132 24836 raft_consensus.cc:697] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 3 LEADER]: Becoming Leader. State: Replica: 48f59673e33a4636acca78951e868651, State: Running, Role: LEADER
I20260709 13:08:21.673055 24836 consensus_queue.cc:237] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } }
I20260709 13:08:21.679344 24592 raft_consensus.cc:2468] T a0eaf0a51afd41ee8b06d2f3c60da098 P 26b8e896a2a74a22999486af393f83f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48f59673e33a4636acca78951e868651 in term 3.
I20260709 13:08:21.689075 24416 catalog_manager.cc:5697] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 reported cstate change: term changed from 2 to 3, leader changed from c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193) to 48f59673e33a4636acca78951e868651 (127.11.44.195). New cstate: current_term: 3 leader_uuid: "48f59673e33a4636acca78951e868651" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48f59673e33a4636acca78951e868651" member_type: VOTER last_known_addr { host: "127.11.44.195" port: 39911 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:22.059651 24592 raft_consensus.cc:1275] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [term 3 FOLLOWER]: Refusing update from remote peer 48f59673e33a4636acca78951e868651: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:22.061149 24836 consensus_queue.cc:1048] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:22.072917 24518 raft_consensus.cc:1275] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [term 3 FOLLOWER]: Refusing update from remote peer 48f59673e33a4636acca78951e868651: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:22.074258 24836 consensus_queue.cc:1048] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:22.172816 24592 raft_consensus.cc:1275] T a0eaf0a51afd41ee8b06d2f3c60da098 P 26b8e896a2a74a22999486af393f83f8 [term 3 FOLLOWER]: Refusing update from remote peer 48f59673e33a4636acca78951e868651: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:22.174203 24836 consensus_queue.cc:1048] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "26b8e896a2a74a22999486af393f83f8" member_type: VOTER last_known_addr { host: "127.11.44.194" port: 45553 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:22.184612 24518 raft_consensus.cc:1275] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [term 3 FOLLOWER]: Refusing update from remote peer 48f59673e33a4636acca78951e868651: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:08:22.185988 24908 consensus_queue.cc:1048] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3378e831c4f417a81e4cd63bde179a8" member_type: VOTER last_known_addr { host: "127.11.44.193" port: 35831 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:08:22.558239 11443 tablet_server.cc:179] TabletServer@127.11.44.193:0 shutting down...
W20260709 13:08:22.579941 24560 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 13 similar messages]
W20260709 13:08:22.587984 24560 consensus_peers.cc:597] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8 -> Peer c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831): Couldn't send request to peer c3378e831c4f417a81e4cd63bde179a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:22.592093 24634 consensus_peers.cc:597] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 -> Peer c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831): Couldn't send request to peer c3378e831c4f417a81e4cd63bde179a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:22.594942 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:22.595897 11443 tablet_replica.cc:333] T e96515055d724359aaf1e626e5936bd2 P c3378e831c4f417a81e4cd63bde179a8: stopping tablet replica
I20260709 13:08:22.596463 11443 raft_consensus.cc:2243] T e96515055d724359aaf1e626e5936bd2 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.596930 11443 raft_consensus.cc:2272] T e96515055d724359aaf1e626e5936bd2 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.599052 11443 tablet_replica.cc:333] T a558c4fbb0cb4e078e2c117a00e871c3 P c3378e831c4f417a81e4cd63bde179a8: stopping tablet replica
I20260709 13:08:22.599611 11443 raft_consensus.cc:2243] T a558c4fbb0cb4e078e2c117a00e871c3 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.599987 11443 raft_consensus.cc:2272] T a558c4fbb0cb4e078e2c117a00e871c3 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.602449 11443 tablet_replica.cc:333] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8: stopping tablet replica
I20260709 13:08:22.603011 11443 raft_consensus.cc:2243] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.603452 11443 raft_consensus.cc:2272] T ab8d263e522342d0b92bb31689822558 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.605320 11443 tablet_replica.cc:333] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8: stopping tablet replica
I20260709 13:08:22.605947 11443 raft_consensus.cc:2243] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.606637 11443 raft_consensus.cc:2272] T 8ccf6ea4c3b545b986a671f5a9d6396b P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.608412 11443 tablet_replica.cc:333] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8: stopping tablet replica
I20260709 13:08:22.608904 11443 raft_consensus.cc:2243] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.609764 11443 raft_consensus.cc:2272] T b74af9c5ab79476989c0fb06d7307239 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.611585 11443 tablet_replica.cc:333] T 4a3151a793f54182a82f23d4acb34d39 P c3378e831c4f417a81e4cd63bde179a8: stopping tablet replica
I20260709 13:08:22.612110 11443 raft_consensus.cc:2243] T 4a3151a793f54182a82f23d4acb34d39 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.612555 11443 raft_consensus.cc:2272] T 4a3151a793f54182a82f23d4acb34d39 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.614480 11443 tablet_replica.cc:333] T 8a42a90385ae49ddab7d0531125c9446 P c3378e831c4f417a81e4cd63bde179a8: stopping tablet replica
I20260709 13:08:22.615031 11443 raft_consensus.cc:2243] T 8a42a90385ae49ddab7d0531125c9446 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.615465 11443 raft_consensus.cc:2272] T 8a42a90385ae49ddab7d0531125c9446 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.617261 11443 tablet_replica.cc:333] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8: stopping tablet replica
I20260709 13:08:22.617882 11443 raft_consensus.cc:2243] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.618561 11443 raft_consensus.cc:2272] T 1cbe51dfac234c36b8d00ea89ce862ed P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.620216 11443 tablet_replica.cc:333] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8: stopping tablet replica
I20260709 13:08:22.620685 11443 raft_consensus.cc:2243] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.621101 11443 raft_consensus.cc:2272] T f8d01567151542098a0cc1638736f603 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.623041 11443 tablet_replica.cc:333] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8: stopping tablet replica
I20260709 13:08:22.623572 11443 raft_consensus.cc:2243] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.623911 11443 raft_consensus.cc:2272] T 67f0d862a4be40d68fdcfe809b66c897 P c3378e831c4f417a81e4cd63bde179a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.626436 11443 tablet_replica.cc:333] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8: stopping tablet replica
I20260709 13:08:22.626955 11443 raft_consensus.cc:2243] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.627326 11443 raft_consensus.cc:2272] T a0eaf0a51afd41ee8b06d2f3c60da098 P c3378e831c4f417a81e4cd63bde179a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.629827 11443 tablet_replica.cc:333] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8: stopping tablet replica
I20260709 13:08:22.630322 11443 raft_consensus.cc:2243] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.631023 11443 raft_consensus.cc:2272] T b6d070792e14439dbe52e09e8db9daf8 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.632848 11443 tablet_replica.cc:333] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8: stopping tablet replica
I20260709 13:08:22.633347 11443 raft_consensus.cc:2243] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.634349 11443 raft_consensus.cc:2272] T a51ff652d2a24a81a51cdd8d20e1fd25 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.636837 11443 tablet_replica.cc:333] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8: stopping tablet replica
I20260709 13:08:22.637521 11443 raft_consensus.cc:2243] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.637979 11443 raft_consensus.cc:2272] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.640000 11443 tablet_replica.cc:333] T d42119e7b9b546fb8742111dc9fc01c4 P c3378e831c4f417a81e4cd63bde179a8: stopping tablet replica
I20260709 13:08:22.640446 11443 raft_consensus.cc:2243] T d42119e7b9b546fb8742111dc9fc01c4 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.640806 11443 raft_consensus.cc:2272] T d42119e7b9b546fb8742111dc9fc01c4 P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.642691 11443 tablet_replica.cc:333] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8: stopping tablet replica
I20260709 13:08:22.643152 11443 raft_consensus.cc:2243] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.643848 11443 raft_consensus.cc:2272] T 5587c38c35e6480e9f60445cfba5c6d6 P c3378e831c4f417a81e4cd63bde179a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.645704 11443 tablet_replica.cc:333] T 9491028dda7d4ca09d41395fa0996fdc P c3378e831c4f417a81e4cd63bde179a8: stopping tablet replica
I20260709 13:08:22.646147 11443 raft_consensus.cc:2243] T 9491028dda7d4ca09d41395fa0996fdc P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.646497 11443 raft_consensus.cc:2272] T 9491028dda7d4ca09d41395fa0996fdc P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.648487 11443 tablet_replica.cc:333] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8: stopping tablet replica
I20260709 13:08:22.648984 11443 raft_consensus.cc:2243] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.649818 11443 raft_consensus.cc:2272] T f3281cd03afa4f269851daf856bcc0ec P c3378e831c4f417a81e4cd63bde179a8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:22.663458 24560 consensus_peers.cc:597] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8 -> Peer c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831): Couldn't send request to peer c3378e831c4f417a81e4cd63bde179a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:22.690246 11443 tablet_server.cc:196] TabletServer@127.11.44.193:0 shutdown complete.
I20260709 13:08:22.724464 11443 tablet_server.cc:179] TabletServer@127.11.44.194:0 shutting down...
I20260709 13:08:22.762272 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:22.763136 11443 tablet_replica.cc:333] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8: stopping tablet replica
I20260709 13:08:22.763790 11443 raft_consensus.cc:2243] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.764562 11443 raft_consensus.cc:2272] T e96515055d724359aaf1e626e5936bd2 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.766527 11443 tablet_replica.cc:333] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8: stopping tablet replica
I20260709 13:08:22.767036 11443 raft_consensus.cc:2243] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.767745 11443 raft_consensus.cc:2272] T a558c4fbb0cb4e078e2c117a00e871c3 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.769480 11443 tablet_replica.cc:333] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8: stopping tablet replica
I20260709 13:08:22.770092 11443 raft_consensus.cc:2243] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.770823 11443 raft_consensus.cc:2272] T 4a3151a793f54182a82f23d4acb34d39 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.772706 11443 tablet_replica.cc:333] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8: stopping tablet replica
I20260709 13:08:22.773358 11443 raft_consensus.cc:2243] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.774188 11443 raft_consensus.cc:2272] T 8a42a90385ae49ddab7d0531125c9446 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.775956 11443 tablet_replica.cc:333] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8: stopping tablet replica
I20260709 13:08:22.776484 11443 raft_consensus.cc:2243] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.776912 11443 raft_consensus.cc:2272] T 1cbe51dfac234c36b8d00ea89ce862ed P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.778710 11443 tablet_replica.cc:333] T ab8d263e522342d0b92bb31689822558 P 26b8e896a2a74a22999486af393f83f8: stopping tablet replica
I20260709 13:08:22.779235 11443 raft_consensus.cc:2243] T ab8d263e522342d0b92bb31689822558 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.779639 11443 raft_consensus.cc:2272] T ab8d263e522342d0b92bb31689822558 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.781477 11443 tablet_replica.cc:333] T 8ccf6ea4c3b545b986a671f5a9d6396b P 26b8e896a2a74a22999486af393f83f8: stopping tablet replica
I20260709 13:08:22.782091 11443 raft_consensus.cc:2243] T 8ccf6ea4c3b545b986a671f5a9d6396b P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.782626 11443 raft_consensus.cc:2272] T 8ccf6ea4c3b545b986a671f5a9d6396b P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.784346 11443 tablet_replica.cc:333] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8: stopping tablet replica
I20260709 13:08:22.784878 11443 raft_consensus.cc:2243] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.785315 11443 raft_consensus.cc:2272] T b74af9c5ab79476989c0fb06d7307239 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.787220 11443 tablet_replica.cc:333] T b6d070792e14439dbe52e09e8db9daf8 P 26b8e896a2a74a22999486af393f83f8: stopping tablet replica
I20260709 13:08:22.787758 11443 raft_consensus.cc:2243] T b6d070792e14439dbe52e09e8db9daf8 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.788184 11443 raft_consensus.cc:2272] T b6d070792e14439dbe52e09e8db9daf8 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.789914 11443 tablet_replica.cc:333] T a51ff652d2a24a81a51cdd8d20e1fd25 P 26b8e896a2a74a22999486af393f83f8: stopping tablet replica
I20260709 13:08:22.790439 11443 raft_consensus.cc:2243] T a51ff652d2a24a81a51cdd8d20e1fd25 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.790892 11443 raft_consensus.cc:2272] T a51ff652d2a24a81a51cdd8d20e1fd25 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.792871 11443 tablet_replica.cc:333] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8: stopping tablet replica
I20260709 13:08:22.793421 11443 raft_consensus.cc:2243] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.794284 11443 raft_consensus.cc:2272] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.796213 11443 tablet_replica.cc:333] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8: stopping tablet replica
I20260709 13:08:22.796746 11443 raft_consensus.cc:2243] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.797513 11443 raft_consensus.cc:2272] T f8d01567151542098a0cc1638736f603 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.799590 11443 tablet_replica.cc:333] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8: stopping tablet replica
I20260709 13:08:22.800103 11443 raft_consensus.cc:2243] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.800894 11443 raft_consensus.cc:2272] T d42119e7b9b546fb8742111dc9fc01c4 P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.802946 11443 tablet_replica.cc:333] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8: stopping tablet replica
I20260709 13:08:22.803483 11443 raft_consensus.cc:2243] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.803936 11443 raft_consensus.cc:2272] T 5587c38c35e6480e9f60445cfba5c6d6 P 26b8e896a2a74a22999486af393f83f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.805918 11443 tablet_replica.cc:333] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8: stopping tablet replica
I20260709 13:08:22.806425 11443 raft_consensus.cc:2243] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.806830 11443 raft_consensus.cc:2272] T 67f0d862a4be40d68fdcfe809b66c897 P 26b8e896a2a74a22999486af393f83f8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.809854 11443 tablet_replica.cc:333] T a0eaf0a51afd41ee8b06d2f3c60da098 P 26b8e896a2a74a22999486af393f83f8: stopping tablet replica
I20260709 13:08:22.810403 11443 raft_consensus.cc:2243] T a0eaf0a51afd41ee8b06d2f3c60da098 P 26b8e896a2a74a22999486af393f83f8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.810878 11443 raft_consensus.cc:2272] T a0eaf0a51afd41ee8b06d2f3c60da098 P 26b8e896a2a74a22999486af393f83f8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.813908 11443 tablet_replica.cc:333] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8: stopping tablet replica
I20260709 13:08:22.814433 11443 raft_consensus.cc:2243] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.814977 11443 raft_consensus.cc:2272] T 9491028dda7d4ca09d41395fa0996fdc P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.816949 11443 tablet_replica.cc:333] T f3281cd03afa4f269851daf856bcc0ec P 26b8e896a2a74a22999486af393f83f8: stopping tablet replica
I20260709 13:08:22.817404 11443 raft_consensus.cc:2243] T f3281cd03afa4f269851daf856bcc0ec P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.817914 11443 raft_consensus.cc:2272] T f3281cd03afa4f269851daf856bcc0ec P 26b8e896a2a74a22999486af393f83f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.851142 11443 tablet_server.cc:196] TabletServer@127.11.44.194:0 shutdown complete.
W20260709 13:08:22.855877 24634 consensus_peers.cc:597] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651 -> Peer c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831): Couldn't send request to peer c3378e831c4f417a81e4cd63bde179a8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35831: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:22.856748 24634 consensus_peers.cc:597] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651 -> Peer 26b8e896a2a74a22999486af393f83f8 (127.11.44.194:45553): Couldn't send request to peer 26b8e896a2a74a22999486af393f83f8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.194:45553: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:22.871667 24634 consensus_peers.cc:597] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 -> Peer c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831): Couldn't send request to peer c3378e831c4f417a81e4cd63bde179a8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35831: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:22.887493 11443 tablet_server.cc:179] TabletServer@127.11.44.195:0 shutting down...
W20260709 13:08:22.894258 24634 consensus_peers.cc:597] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 -> Peer c3378e831c4f417a81e4cd63bde179a8 (127.11.44.193:35831): Couldn't send request to peer c3378e831c4f417a81e4cd63bde179a8. Status: Network error: Client connection negotiation failed: client connection to 127.11.44.193:35831: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:22.914326 11443 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:22.915452 11443 tablet_replica.cc:333] T e96515055d724359aaf1e626e5936bd2 P 48f59673e33a4636acca78951e868651: stopping tablet replica
I20260709 13:08:22.916399 11443 raft_consensus.cc:2243] T e96515055d724359aaf1e626e5936bd2 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.917080 11443 raft_consensus.cc:2272] T e96515055d724359aaf1e626e5936bd2 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.919725 11443 tablet_replica.cc:333] T a558c4fbb0cb4e078e2c117a00e871c3 P 48f59673e33a4636acca78951e868651: stopping tablet replica
I20260709 13:08:22.920478 11443 raft_consensus.cc:2243] T a558c4fbb0cb4e078e2c117a00e871c3 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.921007 11443 raft_consensus.cc:2272] T a558c4fbb0cb4e078e2c117a00e871c3 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.923390 11443 tablet_replica.cc:333] T 4a3151a793f54182a82f23d4acb34d39 P 48f59673e33a4636acca78951e868651: stopping tablet replica
I20260709 13:08:22.924125 11443 raft_consensus.cc:2243] T 4a3151a793f54182a82f23d4acb34d39 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.924666 11443 raft_consensus.cc:2272] T 4a3151a793f54182a82f23d4acb34d39 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.926868 11443 tablet_replica.cc:333] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651: stopping tablet replica
I20260709 13:08:22.927438 11443 raft_consensus.cc:2243] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.927891 11443 raft_consensus.cc:2272] T 8a42a90385ae49ddab7d0531125c9446 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.929754 11443 tablet_replica.cc:333] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651: stopping tablet replica
I20260709 13:08:22.930270 11443 raft_consensus.cc:2243] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.930703 11443 raft_consensus.cc:2272] T 1cbe51dfac234c36b8d00ea89ce862ed P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.932399 11443 tablet_replica.cc:333] T b74af9c5ab79476989c0fb06d7307239 P 48f59673e33a4636acca78951e868651: stopping tablet replica
I20260709 13:08:22.932915 11443 raft_consensus.cc:2243] T b74af9c5ab79476989c0fb06d7307239 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.933331 11443 raft_consensus.cc:2272] T b74af9c5ab79476989c0fb06d7307239 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.935204 11443 tablet_replica.cc:333] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651: stopping tablet replica
I20260709 13:08:22.935752 11443 raft_consensus.cc:2243] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.936506 11443 raft_consensus.cc:2272] T ab8d263e522342d0b92bb31689822558 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.938498 11443 tablet_replica.cc:333] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651: stopping tablet replica
I20260709 13:08:22.939060 11443 raft_consensus.cc:2243] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.939493 11443 raft_consensus.cc:2272] T 8ccf6ea4c3b545b986a671f5a9d6396b P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.941257 11443 tablet_replica.cc:333] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651: stopping tablet replica
I20260709 13:08:22.941876 11443 raft_consensus.cc:2243] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.942315 11443 raft_consensus.cc:2272] T f8d01567151542098a0cc1638736f603 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.944283 11443 tablet_replica.cc:333] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 48f59673e33a4636acca78951e868651: stopping tablet replica
I20260709 13:08:22.944799 11443 raft_consensus.cc:2243] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.945225 11443 raft_consensus.cc:2272] T 97bd80b3c6af4dd0b6a6933cdc6dc892 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.947190 11443 tablet_replica.cc:333] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651: stopping tablet replica
I20260709 13:08:22.947708 11443 raft_consensus.cc:2243] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.948179 11443 raft_consensus.cc:2272] T b6d070792e14439dbe52e09e8db9daf8 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.950143 11443 tablet_replica.cc:333] T a51ff652d2a24a81a51cdd8d20e1fd25 P 48f59673e33a4636acca78951e868651: stopping tablet replica
I20260709 13:08:22.950709 11443 raft_consensus.cc:2243] T a51ff652d2a24a81a51cdd8d20e1fd25 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.951129 11443 raft_consensus.cc:2272] T a51ff652d2a24a81a51cdd8d20e1fd25 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.953215 11443 tablet_replica.cc:333] T d42119e7b9b546fb8742111dc9fc01c4 P 48f59673e33a4636acca78951e868651: stopping tablet replica
I20260709 13:08:22.953860 11443 raft_consensus.cc:2243] T d42119e7b9b546fb8742111dc9fc01c4 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.954291 11443 raft_consensus.cc:2272] T d42119e7b9b546fb8742111dc9fc01c4 P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.956152 11443 tablet_replica.cc:333] T 5587c38c35e6480e9f60445cfba5c6d6 P 48f59673e33a4636acca78951e868651: stopping tablet replica
I20260709 13:08:22.956664 11443 raft_consensus.cc:2243] T 5587c38c35e6480e9f60445cfba5c6d6 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.957082 11443 raft_consensus.cc:2272] T 5587c38c35e6480e9f60445cfba5c6d6 P 48f59673e33a4636acca78951e868651 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.959090 11443 tablet_replica.cc:333] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651: stopping tablet replica
I20260709 13:08:22.959599 11443 raft_consensus.cc:2243] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.960328 11443 raft_consensus.cc:2272] T 67f0d862a4be40d68fdcfe809b66c897 P 48f59673e33a4636acca78951e868651 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.962745 11443 tablet_replica.cc:333] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651: stopping tablet replica
I20260709 13:08:22.963230 11443 raft_consensus.cc:2243] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.963943 11443 raft_consensus.cc:2272] T a0eaf0a51afd41ee8b06d2f3c60da098 P 48f59673e33a4636acca78951e868651 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.966753 11443 tablet_replica.cc:333] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651: stopping tablet replica
I20260709 13:08:22.967188 11443 raft_consensus.cc:2243] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:22.967893 11443 raft_consensus.cc:2272] T 9491028dda7d4ca09d41395fa0996fdc P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:22.969779 11443 tablet_replica.cc:333] T f3281cd03afa4f269851daf856bcc0ec P 48f59673e33a4636acca78951e868651: stopping tablet replica
I20260709 13:08:22.970218 11443 raft_consensus.cc:2243] T f3281cd03afa4f269851daf856bcc0ec P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:22.970589 11443 raft_consensus.cc:2272] T f3281cd03afa4f269851daf856bcc0ec P 48f59673e33a4636acca78951e868651 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:23.009336 11443 tablet_server.cc:196] TabletServer@127.11.44.195:0 shutdown complete.
I20260709 13:08:23.038983 11443 master.cc:562] Master@127.11.44.254:40303 shutting down...
I20260709 13:08:23.065100 11443 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:08:23.065850 11443 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:23.066143 11443 tablet_replica.cc:333] T 00000000000000000000000000000000 P 523fe5d389f64f2fbb27427f76f19332: stopping tablet replica
I20260709 13:08:23.087880 11443 master.cc:584] Master@127.11.44.254:40303 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11639 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24597 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (370757 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:08:23.146786 11443 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 402 messages since previous log ~14 seconds ago
I20260709 13:08:23.147001 11443 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 402 messages since previous log ~14 seconds ago
I20260709 13:08:23.147147 11443 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 400 messages since previous log ~14 seconds ago
I20260709 13:08:23.147401 11443 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:08:23.147555 11443 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:08:23.147696 11443 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~76 seconds ago
I20260709 13:08:23.147867 11443 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 5 messages since previous log ~125 seconds ago
I20260709 13:08:23.148016 11443 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~177 seconds ago
I20260709 13:08:23.148164 11443 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 1 messages since previous log ~178 seconds ago
I20260709 13:08:23.148355 11443 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 6 messages since previous log ~0 seconds ago
I20260709 13:08:23.148597 11443 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~10 seconds ago
